2024-04-13T10:35:17.714 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-13T10:35:17.714 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi --owner scheduled_teuthology@teuthology --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624 -- /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624/orig.config.yaml 2024-04-13T10:35:17.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T10:35:17.988 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624 branch: reef description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7646624' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 5108bc67b831101bc32a1061150595384640c56c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5108bc67b831101bc32a1061150595384640c56c kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: d540ebaca6b131a1dd560e7f69e024b133bbaa42 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 4929 sha1: 5108bc67b831101bc32a1061150595384640c56c sleep_before_teardown: 0 subset: 11/64 suite: orch suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d540ebaca6b131a1dd560e7f69e024b133bbaa42 targets: smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEaWXPfAFzMiodwxKKfpGEv9GNBJtG32Qcn2qo5Te2LpTFHZ06mu+pWqzHeKquUk73oJEQJTzgDAKjdNJHib01M= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZ3N5aBmLn4o0oQqVBcUzyNsUPfRvA3hsp7qIFOl9b3WNOjHC6yfKipPoQP3wc2h/FQVdfWGyocMX3aynA9eP8= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-08_22:08:01 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-13T10:35:17.989 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa; will attempt to use it 2024-04-13T10:35:17.989 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks 2024-04-13T10:35:17.989 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-13T10:35:17.991 INFO:teuthology.task.internal:Checking packages... 2024-04-13T10:35:18.013 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5108bc67b831101bc32a1061150595384640c56c' 2024-04-13T10:35:18.013 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-13T10:35:18.014 INFO:teuthology.packaging:ref: None 2024-04-13T10:35:18.014 INFO:teuthology.packaging:tag: None 2024-04-13T10:35:18.014 INFO:teuthology.packaging:branch: reef 2024-04-13T10:35:18.014 INFO:teuthology.packaging:sha1: 5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:35:18.014 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-13T10:35:18.267 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1217.g7d36322c 2024-04-13T10:35:18.269 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-13T10:35:18.275 INFO:teuthology.task.internal:no buildpackages task found 2024-04-13T10:35:18.275 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-13T10:35:18.284 INFO:teuthology.task.internal:Saving configuration 2024-04-13T10:35:18.304 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-13T10:35:18.310 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-13T10:35:18.336 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 10:30:09.901230', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEaWXPfAFzMiodwxKKfpGEv9GNBJtG32Qcn2qo5Te2LpTFHZ06mu+pWqzHeKquUk73oJEQJTzgDAKjdNJHib01M='} 2024-04-13T10:35:18.354 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 10:30:09.902511', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZ3N5aBmLn4o0oQqVBcUzyNsUPfRvA3hsp7qIFOl9b3WNOjHC6yfKipPoQP3wc2h/FQVdfWGyocMX3aynA9eP8='} 2024-04-13T10:35:18.355 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-13T10:35:18.361 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-13T10:35:18.361 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-13T10:35:18.361 INFO:teuthology.run_tasks:Running task console_log... 2024-04-13T10:35:18.438 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f63553290d0>, signals=[15]) 2024-04-13T10:35:18.438 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-13T10:35:18.444 INFO:teuthology.task.internal:Opening connections... 2024-04-13T10:35:18.444 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T10:35:18.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T10:35:18.519 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-04-13T10:35:18.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T10:35:18.592 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-13T10:35:18.598 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-04-13T10:35:18.620 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-04-13T10:35:18.620 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-04-13T10:35:18.681 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-04-13T10:35:18.681 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8" 2024-04-13T10:35:18.681 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-04-13T10:35:18.681 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-04-13T10:35:18.681 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2024-04-13T10:35:18.681 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2024-04-13T10:35:18.681 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-13T10:35:18.681 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-04-13T10:35:18.681 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-13T10:35:18.682 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-04-13T10:35:18.682 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T10:35:18.682 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T10:35:18.682 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-13T10:35:18.682 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-04-13T10:35:18.715 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-04-13T10:35:18.737 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-04-13T10:35:18.737 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-04-13T10:35:18.798 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-04-13T10:35:18.798 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8" 2024-04-13T10:35:18.798 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-04-13T10:35:18.798 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-04-13T10:35:18.798 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8" 2024-04-13T10:35:18.798 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2024-04-13T10:35:18.799 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-13T10:35:18.799 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-04-13T10:35:18.799 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-13T10:35:18.799 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-04-13T10:35:18.799 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T10:35:18.799 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T10:35:18.799 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-13T10:35:18.799 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-04-13T10:35:18.823 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-13T10:35:18.833 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-13T10:35:18.838 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-13T10:35:18.838 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-04-13T10:35:18.840 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-04-13T10:35:18.859 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-13T10:35:18.868 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-13T10:35:18.868 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-04-13T10:35:18.900 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-04-13T10:35:18.933 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-13T10:35:18.987 INFO:teuthology.run_tasks:Running task kernel... 2024-04-13T10:35:19.002 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-13T10:35:19.002 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-13T10:35:19.003 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-13T10:35:19.003 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-13T10:35:19.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T10:35:19.023 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-13T10:35:19.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T10:35:19.024 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-04-13T10:35:19.084 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-489.el8.x86_64 2024-04-13T10:35:19.084 INFO:teuthology.task.kernel:Running kernel on smithi134: 4.18.0-489.el8.x86_64 2024-04-13T10:35:19.084 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-04-13T10:35:19.085 INFO:teuthology.orchestra.run.smithi194.stdout:4.18.0-489.el8.x86_64 2024-04-13T10:35:19.086 INFO:teuthology.task.kernel:Running kernel on smithi194: 4.18.0-489.el8.x86_64 2024-04-13T10:35:19.086 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2024-04-13T10:35:23.256 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - AppStream 19 MB/s | 28 MB 00:01 2024-04-13T10:35:23.266 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - AppStream 17 MB/s | 28 MB 00:01 2024-04-13T10:35:29.998 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - BaseOS 6.0 MB/s | 10 MB 00:01 2024-04-13T10:35:30.041 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - BaseOS 6.0 MB/s | 10 MB 00:01 2024-04-13T10:35:32.033 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras 50 kB/s | 18 kB 00:00 2024-04-13T10:35:32.106 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2024-04-13T10:35:32.450 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras common packages 25 kB/s | 7.7 kB 00:00 2024-04-13T10:35:32.456 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras common packages 32 kB/s | 7.7 kB 00:00 2024-04-13T10:35:32.675 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-13T10:35:32.676 INFO:teuthology.orchestra.run.smithi194.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-13T10:35:33.744 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2024-04-13T10:35:33.917 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-13T10:35:37.586 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 338 kB/s | 24 kB 00:00 2024-04-13T10:35:37.718 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 392 kB/s | 24 kB 00:00 2024-04-13T10:35:40.566 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-13T10:35:40.566 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-13T10:35:40.671 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:35:40.672 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:35:40.672 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-04-13T10:35:40.672 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:35:40.672 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:35:40.672 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-13T10:35:40.672 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-04-13T10:35:40.673 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-13T10:35:40.673 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-13T10:35:40.673 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:35:40.673 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:35:40.673 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:35:40.673 INFO:teuthology.orchestra.run.smithi194.stdout:Install 3 Packages 2024-04-13T10:35:40.673 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:35:40.674 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 90 M 2024-04-13T10:35:40.674 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 96 M 2024-04-13T10:35:40.674 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:35:40.748 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-13T10:35:40.748 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-13T10:35:40.860 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:35:40.861 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:35:40.861 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-13T10:35:40.861 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:35:40.861 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:35:40.861 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-13T10:35:40.861 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-13T10:35:40.861 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-13T10:35:40.862 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-13T10:35:40.862 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:35:40.862 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:35:40.862 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:35:40.862 INFO:teuthology.orchestra.run.smithi134.stdout:Install 3 Packages 2024-04-13T10:35:40.862 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:35:40.862 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 90 M 2024-04-13T10:35:40.863 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 96 M 2024-04-13T10:35:40.863 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:35:41.704 INFO:teuthology.orchestra.run.smithi194.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 11 MB/s | 10 MB 00:00 2024-04-13T10:35:42.602 INFO:teuthology.orchestra.run.smithi134.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 6.7 MB/s | 10 MB 00:01 2024-04-13T10:35:42.754 INFO:teuthology.orchestra.run.smithi194.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 18 MB/s | 36 MB 00:01 2024-04-13T10:35:43.137 INFO:teuthology.orchestra.run.smithi194.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 18 MB/s | 44 MB 00:02 2024-04-13T10:35:43.137 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:35:43.137 INFO:teuthology.orchestra.run.smithi194.stdout:Total 37 MB/s | 90 MB 00:02 2024-04-13T10:35:43.535 INFO:teuthology.orchestra.run.smithi134.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 15 MB/s | 36 MB 00:02 2024-04-13T10:35:43.822 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi134.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 15 MB/s | 44 MB 00:02 2024-04-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi134.stdout:Total 30 MB/s | 90 MB 00:03 2024-04-13T10:35:44.245 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:35:44.245 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:35:44.610 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:35:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:35:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:35:45.511 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:35:45.528 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:35:46.301 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:35:46.335 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:35:48.393 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:35:48.923 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-13T10:35:49.119 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:35:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-13T10:35:52.562 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-13T10:35:52.939 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-13T10:35:53.280 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-13T10:35:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-13T10:35:56.370 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-13T10:35:56.664 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-13T10:35:57.130 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-13T10:35:57.497 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-13T10:36:18.540 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-13T10:36:18.564 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-13T10:36:18.914 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-13T10:36:18.914 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-13T10:36:18.914 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-13T10:36:19.461 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-13T10:36:19.480 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-13T10:36:19.480 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:36:19.480 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:36:19.480 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-13T10:36:19.480 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-13T10:36:19.480 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:36:19.480 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:36:19.486 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-13T10:36:19.624 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-04-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-13T10:36:19.847 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-13T10:36:19.847 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-13T10:36:19.847 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-13T10:36:19.847 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-13T10:36:19.847 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-04-13T10:36:19.847 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2024-04-13T10:36:19.848 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-04-13T10:36:20.060 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-13T10:36:20.060 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-13T10:36:20.060 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2024-04-13T10:36:20.093 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2024-04-13T10:36:20.093 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2024-04-13T10:36:20.093 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.02 2024-04-13T10:36:20.093 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 129.el8 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Group : System Environment/Base 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 9265586 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Relocations : (not relocatable) 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : CentOS BuildSystem 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-13T10:36:20.094 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2024-04-13T10:36:20.095 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2024-04-13T10:36:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:36:20.095 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-13T10:36:20.095 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-13T10:36:20.095 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-13T10:36:20.095 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2024-04-13T10:36:20.095 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:36:20.095 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2024-04-13T10:36:20.096 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-13T10:36:20.096 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 4.18.0-552.el8.x86_64 2024-04-13T10:36:20.096 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:36:20.525 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-04-13T10:36:20.745 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-13T10:36:20.746 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-13T10:36:20.746 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-13T10:36:20.746 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-13T10:36:20.746 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-13T10:36:20.746 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-04-13T10:36:20.746 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-04-13T10:36:20.746 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-04-13T10:36:20.957 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-13T10:36:20.957 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-13T10:36:20.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-04-13T10:36:20.990 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-04-13T10:36:20.990 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-04-13T10:36:20.990 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.02 2024-04-13T10:36:20.990 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 129.el8 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Group : System Environment/Base 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 9265586 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Relocations : (not relocatable) 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : CentOS BuildSystem 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-04-13T10:36:20.991 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-04-13T10:36:20.992 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:36:20.992 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-13T10:36:20.992 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-13T10:36:20.992 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-13T10:36:20.992 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-04-13T10:36:20.992 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:36:20.992 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-04-13T10:36:20.993 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-13T10:36:20.993 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 4.18.0-552.el8.x86_64 2024-04-13T10:36:20.993 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-13T10:36:21.916 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-04-13T10:36:22.494 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-04-13T10:36:24.009 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-04-13T10:36:24.011 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-04-13T10:36:24.044 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.zw3mVZrkET 2024-04-13T10:36:24.045 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zw3mVZrkET 2024-04-13T10:36:24.135 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.zw3mVZrkET 2024-04-13T10:36:24.238 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.zw3mVZrkET is 6KB 2024-04-13T10:36:24.286 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.zw3mVZrkET 2024-04-13T10:36:24.290 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-04-13T10:36:24.291 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-04-13T10:36:24.306 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2024-04-13T10:36:24.326 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.ULbdgMdzBJ 2024-04-13T10:36:24.326 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ULbdgMdzBJ 2024-04-13T10:36:24.383 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-13T10:36:24.383 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-13T10:36:24.383 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-13T10:36:24.383 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-13T10:36:24.384 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-13T10:36:24.408 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.ULbdgMdzBJ 2024-04-13T10:36:24.551 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-04-13T10:36:24.555 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.ULbdgMdzBJ is 6KB 2024-04-13T10:36:24.604 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.ULbdgMdzBJ 2024-04-13T10:36:24.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-04-13T10:36:24.701 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-13T10:36:24.701 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-13T10:36:24.701 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-13T10:36:24.701 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-13T10:36:24.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-13T10:36:24.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-04-13T10:36:54.580 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-13T10:36:54.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-13T10:36:54.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T10:36:54.882 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-13T10:36:54.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-13T10:36:54.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T10:37:13.118 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-13T10:37:22.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-13T10:37:22.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T10:37:25.182 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-04-13T10:37:29.502 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-13T10:37:37.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-13T10:37:37.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T10:37:38.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-13T10:37:38.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T10:37:56.895 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-13T10:38:08.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-13T10:38:08.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T10:38:09.298 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-13T10:38:09.349 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-04-13T10:38:09.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-13T10:38:09.601 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-552.el8.x86_64"... 2024-04-13T10:38:09.601 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-04-13T10:38:09.618 INFO:teuthology.orchestra.run.smithi194.stdout:4.18.0-552.el8.x86_64 2024-04-13T10:38:09.618 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-13T10:38:09.618 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-13T10:38:09.618 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-13T10:38:09.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-13T10:38:09.637 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-552.el8.x86_64"... 2024-04-13T10:38:09.637 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-13T10:38:09.654 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-552.el8.x86_64 2024-04-13T10:38:09.654 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-13T10:38:09.654 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-13T10:38:09.654 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-13T10:38:10.619 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-13T10:38:10.620 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-13T10:38:10.655 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-13T10:38:10.655 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-13T10:38:10.694 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-04-13T10:38:10.708 DEBUG:teuthology.parallel:result is None 2024-04-13T10:38:10.749 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-04-13T10:38:10.762 DEBUG:teuthology.parallel:result is None 2024-04-13T10:38:10.762 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-13T10:38:10.770 INFO:teuthology.task.internal:Creating test directory... 2024-04-13T10:38:10.770 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-13T10:38:10.772 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-13T10:38:10.793 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-13T10:38:10.800 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-13T10:38:10.808 INFO:teuthology.task.internal:Creating archive directory... 2024-04-13T10:38:10.808 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-13T10:38:10.829 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-13T10:38:10.877 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-13T10:38:10.883 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-13T10:38:10.884 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-13T10:38:10.901 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-13T10:38:10.927 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-13T10:38:10.938 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-13T10:38:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-13T10:38:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-13T10:38:10.957 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-13T10:38:10.964 INFO:teuthology.task.internal:Configuring sudo... 2024-04-13T10:38:10.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-13T10:38:10.983 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-13T10:38:11.025 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-13T10:38:11.034 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-13T10:38:11.034 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-13T10:38:11.051 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-13T10:38:11.083 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-13T10:38:11.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-13T10:38:11.200 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-13T10:38:11.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-13T10:38:11.326 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:38:11.326 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-13T10:38:11.391 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-13T10:38:11.437 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-13T10:38:11.487 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-13T10:38:11.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-13T10:38:11.616 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:38:11.616 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-13T10:38:11.683 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-04-13T10:38:11.695 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-04-13T10:38:11.788 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-13T10:38:11.797 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-13T10:38:12.008 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-13T10:38:12.015 INFO:teuthology.task.internal:Starting timer... 2024-04-13T10:38:12.015 INFO:teuthology.run_tasks:Running task pcp... 2024-04-13T10:38:12.026 INFO:teuthology.run_tasks:Running task selinux... 2024-04-13T10:38:12.034 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-13T10:38:12.035 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-04-13T10:38:12.834 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-04-13T10:38:12.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-04-13T10:38:12.938 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-04-13T10:38:12.939 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-13T10:38:12.939 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-04-13T10:38:12.995 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-04-13T10:38:12.995 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-04-13T10:38:13.042 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-04-13T10:38:13.042 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-04-13T10:38:13.042 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-13T10:38:13.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T10:38:13.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-13T10:38:13.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T10:38:13.498 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-13T10:38:13.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-04-13T10:38:13.526 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-04-13T10:38:13.576 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-13T10:38:13.590 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-13T10:38:13.608 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-13T10:38:13.609 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi134.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-13T10:44:09.790 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-04-13T10:44:09.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-13T10:44:09.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T10:44:09.871 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-13T10:44:09.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-13T10:44:09.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-13T10:44:09.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T10:44:10.014 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-04-13T10:44:10.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-04-13T10:44:10.086 INFO:teuthology.run_tasks:Running task clock... 2024-04-13T10:44:10.098 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-13T10:44:10.099 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-13T10:44:10.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-13T10:44:10.101 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-13T10:44:10.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-13T10:44:10.131 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-13T10:44:10.145 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-13T10:44:10.160 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-13T10:44:10.174 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-13T10:44:10.205 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-04-13T10:44:10.216 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-04-13T10:44:10.230 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-13T10:44:10.239 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-04-13T10:44:10.243 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-13T10:44:10.251 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-04-13T10:44:10.264 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-13T10:44:10.278 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-13T10:44:10.328 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2024-04-13T10:44:10.331 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-13T10:44:10.332 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-04-13T10:44:10.332 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T10:44:10.332 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T10:44:10.332 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T10:44:10.332 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T10:44:10.345 INFO:teuthology.orchestra.run.smithi194.stderr:bash: ntpq: command not found 2024-04-13T10:44:10.350 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-13T10:44:10.350 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-04-13T10:44:10.350 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T10:44:10.350 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T10:44:10.350 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T10:44:10.351 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T10:44:10.351 INFO:teuthology.run_tasks:Running task pexec... 2024-04-13T10:44:10.360 INFO:teuthology.task.pexec:Executing custom commands... 2024-04-13T10:44:10.360 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T10:44:10.361 DEBUG:teuthology.orchestra.run.smithi134:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-13T10:44:10.361 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi194.front.sepia.ceph.com 2024-04-13T10:44:10.361 DEBUG:teuthology.orchestra.run.smithi194:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-13T10:44:11.139 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:21 ago on Sat 13 Apr 2024 10:42:49 AM UTC. 2024-04-13T10:44:11.153 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:30 ago on Sat 13 Apr 2024 10:42:40 AM UTC. 2024-04-13T10:44:13.255 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:44:13.256 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:44:13.256 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-04-13T10:44:13.256 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:44:13.256 INFO:teuthology.orchestra.run.smithi194.stdout:Resetting modules: 2024-04-13T10:44:13.256 INFO:teuthology.orchestra.run.smithi194.stdout: container-tools 2024-04-13T10:44:13.256 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:44:13.256 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:44:13.256 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:44:13.256 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:44:13.299 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:44:13.300 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:44:13.300 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-13T10:44:13.300 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:44:13.300 INFO:teuthology.orchestra.run.smithi134.stdout:Resetting modules: 2024-04-13T10:44:13.300 INFO:teuthology.orchestra.run.smithi134.stdout: container-tools 2024-04-13T10:44:13.300 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:44:13.300 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:44:13.300 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:44:13.300 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:44:13.498 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:44:13.561 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:44:14.297 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:34 ago on Sat 13 Apr 2024 10:42:40 AM UTC. 2024-04-13T10:44:14.384 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:25 ago on Sat 13 Apr 2024 10:42:49 AM UTC. 2024-04-13T10:44:16.420 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:44:16.458 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:44:16.458 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-04-13T10:44:16.458 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:44:16.458 INFO:teuthology.orchestra.run.smithi194.stdout:Installing group/module packages: 2024-04-13T10:44:16.458 INFO:teuthology.orchestra.run.smithi194.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-04-13T10:44:16.458 INFO:teuthology.orchestra.run.smithi194.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-04-13T10:44:16.458 INFO:teuthology.orchestra.run.smithi194.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-04-13T10:44:16.458 INFO:teuthology.orchestra.run.smithi194.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-04-13T10:44:16.458 INFO:teuthology.orchestra.run.smithi194.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout:Installing module profiles: 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout: container-tools/common 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:44:16.459 INFO:teuthology.orchestra.run.smithi194.stdout:Enabling module streams: 2024-04-13T10:44:16.460 INFO:teuthology.orchestra.run.smithi194.stdout: container-tools rhel8 2024-04-13T10:44:16.460 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:44:16.460 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:44:16.460 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:44:16.460 INFO:teuthology.orchestra.run.smithi194.stdout:Install 13 Packages 2024-04-13T10:44:16.460 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:44:16.460 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 27 M 2024-04-13T10:44:16.460 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 91 M 2024-04-13T10:44:16.461 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:44:16.496 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:44:16.533 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:44:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-13T10:44:16.533 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:44:16.533 INFO:teuthology.orchestra.run.smithi134.stdout:Installing group/module packages: 2024-04-13T10:44:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-04-13T10:44:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout:Installing module profiles: 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: container-tools/common 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling module streams: 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: container-tools rhel8 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-04-13T10:44:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:44:16.536 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 27 M 2024-04-13T10:44:16.536 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 91 M 2024-04-13T10:44:16.536 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:44:16.824 INFO:teuthology.orchestra.run.smithi194.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 2.2 MB/s | 689 kB 00:00 2024-04-13T10:44:16.866 INFO:teuthology.orchestra.run.smithi194.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 2.9 MB/s | 1.0 MB 00:00 2024-04-13T10:44:16.891 INFO:teuthology.orchestra.run.smithi194.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 566 kB/s | 38 kB 00:00 2024-04-13T10:44:16.933 INFO:teuthology.orchestra.run.smithi194.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 3.8 MB/s | 258 kB 00:00 2024-04-13T10:44:17.026 INFO:teuthology.orchestra.run.smithi194.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 1.9 MB/s | 180 kB 00:00 2024-04-13T10:44:17.029 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 2.2 MB/s | 689 kB 00:00 2024-04-13T10:44:17.071 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 2.9 MB/s | 1.0 MB 00:00 2024-04-13T10:44:17.084 INFO:teuthology.orchestra.run.smithi194.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 424 kB/s | 25 kB 00:00 2024-04-13T10:44:17.096 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 565 kB/s | 38 kB 00:00 2024-04-13T10:44:17.164 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 2.7 MB/s | 258 kB 00:00 2024-04-13T10:44:17.193 INFO:teuthology.orchestra.run.smithi194.stdout:(7/13): buildah-1.33.6-2.module_el8+976+1136073 14 MB/s | 9.6 MB 00:00 2024-04-13T10:44:17.210 INFO:teuthology.orchestra.run.smithi194.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 749 kB/s | 94 kB 00:00 2024-04-13T10:44:17.238 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 2.4 MB/s | 180 kB 00:00 2024-04-13T10:44:17.293 INFO:teuthology.orchestra.run.smithi194.stdout:(9/13): netavark-1.10.3-1.module_el8+951+32019c 10 MB/s | 4.1 MB 00:00 2024-04-13T10:44:17.339 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): netavark-1.10.3-1.module_el8+951+32019c 17 MB/s | 4.1 MB 00:00 2024-04-13T10:44:17.343 INFO:teuthology.orchestra.run.smithi194.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 1.0 MB/s | 53 kB 00:00 2024-04-13T10:44:17.364 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-pytoml-0.1.14-5.git7dea353.el8. 198 kB/s | 25 kB 00:00 2024-04-13T10:44:17.427 INFO:teuthology.orchestra.run.smithi194.stdout:(11/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 12 MB/s | 2.5 MB 00:00 2024-04-13T10:44:17.444 INFO:teuthology.orchestra.run.smithi194.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 408 kB/s | 41 kB 00:00 2024-04-13T10:44:17.498 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): buildah-1.33.6-2.module_el8+976+1136073 13 MB/s | 9.6 MB 00:00 2024-04-13T10:44:17.523 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-pyxdg-0.25-16.el8.noarch.rpm 510 kB/s | 94 kB 00:00 2024-04-13T10:44:17.570 INFO:teuthology.orchestra.run.smithi194.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 23 MB/s | 8.8 MB 00:00 2024-04-13T10:44:17.570 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:44:17.570 INFO:teuthology.orchestra.run.smithi194.stdout:Total 25 MB/s | 27 MB 00:01 2024-04-13T10:44:17.590 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 792 kB/s | 53 kB 00:00 2024-04-13T10:44:17.649 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): toolbox-0.0.99.5-2.module_el8+971+3d3d 17 MB/s | 2.5 MB 00:00 2024-04-13T10:44:17.665 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 544 kB/s | 41 kB 00:00 2024-04-13T10:44:17.824 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 19 MB/s | 8.8 MB 00:00 2024-04-13T10:44:17.824 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:44:17.825 INFO:teuthology.orchestra.run.smithi134.stdout:Total 21 MB/s | 27 MB 00:01 2024-04-13T10:44:17.837 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:44:17.858 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:44:17.858 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:44:18.094 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:44:18.109 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:44:18.112 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:44:18.115 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:44:18.115 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:44:18.388 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:44:18.391 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:44:18.773 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:44:19.041 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:44:19.745 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-04-13T10:44:19.946 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-04-13T10:44:19.982 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-04-13T10:44:20.133 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-04-13T10:44:20.178 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-04-13T10:44:20.348 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-04-13T10:44:20.360 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-04-13T10:44:20.571 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-04-13T10:44:20.601 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-04-13T10:44:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-04-13T10:44:21.178 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-04-13T10:44:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-04-13T10:44:22.156 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-04-13T10:44:22.296 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-04-13T10:44:22.436 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-04-13T10:44:22.538 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-04-13T10:44:22.632 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-04-13T10:44:22.759 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-04-13T10:44:23.078 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-04-13T10:44:23.206 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-04-13T10:44:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-13T10:44:23.371 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-13T10:44:23.554 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-13T10:44:23.597 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-13T10:44:23.773 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-13T10:44:23.822 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-13T10:44:24.200 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-13T10:44:24.201 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-13T10:44:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-04-13T10:44:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-04-13T10:44:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-04-13T10:44:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-04-13T10:44:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-04-13T10:44:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-04-13T10:44:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-04-13T10:44:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-04-13T10:44:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-04-13T10:44:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-04-13T10:44:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-04-13T10:44:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-04-13T10:44:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-04-13T10:44:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-04-13T10:44:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:44:24.729 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:44:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-04-13T10:44:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-04-13T10:44:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-04-13T10:44:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-04-13T10:44:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-04-13T10:44:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-04-13T10:44:24.729 INFO:teuthology.orchestra.run.smithi194.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-04-13T10:44:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-13T10:44:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-13T10:44:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-04-13T10:44:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-04-13T10:44:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-04-13T10:44:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-13T10:44:24.730 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:44:24.730 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:44:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-04-13T10:44:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:44:24.850 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:44:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-04-13T10:44:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-04-13T10:44:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-04-13T10:44:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:44:24.851 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:44:25.027 DEBUG:teuthology.parallel:result is None 2024-04-13T10:44:25.156 DEBUG:teuthology.parallel:result is None 2024-04-13T10:44:25.156 INFO:teuthology.run_tasks:Running task install... 2024-04-13T10:44:25.166 DEBUG:teuthology.task.install:project ceph 2024-04-13T10:44:25.167 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5108bc67b831101bc32a1061150595384640c56c'}} 2024-04-13T10:44:25.167 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': '5108bc67b831101bc32a1061150595384640c56c'} 2024-04-13T10:44:25.167 INFO:teuthology.task.install:Using flavor: default 2024-04-13T10:44:25.176 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-13T10:44:25.176 INFO:teuthology.task.install:extra packages: [] 2024-04-13T10:44:25.176 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5108bc67b831101bc32a1061150595384640c56c', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-04-13T10:44:25.176 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-13T10:44:25.177 INFO:teuthology.packaging:ref: None 2024-04-13T10:44:25.177 INFO:teuthology.packaging:tag: v18.2.0 2024-04-13T10:44:25.177 INFO:teuthology.packaging:branch: None 2024-04-13T10:44:25.177 INFO:teuthology.packaging:sha1: 5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:44:27.595 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-04-13T10:44:27.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-04-13T10:44:27.598 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5108bc67b831101bc32a1061150595384640c56c', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-04-13T10:44:27.599 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-13T10:44:27.599 INFO:teuthology.packaging:ref: None 2024-04-13T10:44:27.599 INFO:teuthology.packaging:tag: v18.2.0 2024-04-13T10:44:27.599 INFO:teuthology.packaging:branch: None 2024-04-13T10:44:27.599 INFO:teuthology.packaging:sha1: 5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:44:27.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-04-13T10:44:27.818 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/8/flavors/default/ 2024-04-13T10:44:27.819 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-04-13T10:44:27.822 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/8/flavors/default/ 2024-04-13T10:44:27.822 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-04-13T10:44:27.867 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-13T10:44:27.867 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:44:27.867 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-13T10:44:27.884 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-13T10:44:27.884 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:44:27.884 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-13T10:44:27.901 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-13T10:44:27.901 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-13T10:44:27.901 INFO:teuthology.packaging:ref: None 2024-04-13T10:44:27.901 INFO:teuthology.packaging:tag: v18.2.0 2024-04-13T10:44:27.902 INFO:teuthology.packaging:branch: None 2024-04-13T10:44:27.902 INFO:teuthology.packaging:sha1: 5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:44:27.902 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-13T10:44:27.918 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-13T10:44:27.918 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-13T10:44:27.919 INFO:teuthology.packaging:ref: None 2024-04-13T10:44:27.919 INFO:teuthology.packaging:tag: v18.2.0 2024-04-13T10:44:27.919 INFO:teuthology.packaging:branch: None 2024-04-13T10:44:27.919 INFO:teuthology.packaging:sha1: 5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:44:27.919 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-13T10:44:27.974 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-13T10:44:27.990 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-13T10:44:28.055 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-13T10:44:28.070 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-13T10:44:28.123 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-04-13T10:44:28.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-04-13T10:44:28.138 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-04-13T10:44:28.139 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-04-13T10:44:28.393 INFO:teuthology.orchestra.run.smithi134.stdout:78 files removed 2024-04-13T10:44:28.414 INFO:teuthology.orchestra.run.smithi194.stdout:78 files removed 2024-04-13T10:44:28.421 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2024-04-13T10:44:28.442 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw 2024-04-13T10:44:28.956 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 600 kB/s | 79 kB 00:00 2024-04-13T10:44:28.969 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 651 kB/s | 79 kB 00:00 2024-04-13T10:44:29.153 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 64 kB/s | 9.3 kB 00:00 2024-04-13T10:44:29.165 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 55 kB/s | 9.3 kB 00:00 2024-04-13T10:44:29.278 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 18 kB/s | 1.8 kB 00:00 2024-04-13T10:44:29.299 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 17 kB/s | 1.8 kB 00:00 2024-04-13T10:44:30.404 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - AppStream 25 MB/s | 28 MB 00:01 2024-04-13T10:44:30.716 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - AppStream 20 MB/s | 28 MB 00:01 2024-04-13T10:44:35.955 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 10 MB 00:00 2024-04-13T10:44:36.534 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 10 MB 00:00 2024-04-13T10:44:37.930 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2024-04-13T10:44:38.272 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras common packages 33 kB/s | 7.7 kB 00:00 2024-04-13T10:44:38.526 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2024-04-13T10:44:38.824 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 5.0 MB 00:00 2024-04-13T10:44:39.027 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 7.7 kB 00:00 2024-04-13T10:44:39.678 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - PowerTools 8.8 MB/s | 5.0 MB 00:00 2024-04-13T10:44:39.875 INFO:teuthology.orchestra.run.smithi194.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-13T10:44:40.661 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2024-04-13T10:44:40.737 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-13T10:44:42.097 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-13T10:44:44.502 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 412 kB/s | 24 kB 00:00 2024-04-13T10:44:45.889 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 523 kB/s | 24 kB 00:00 2024-04-13T10:44:48.112 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:44:48.115 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:44:48.115 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-04-13T10:44:48.115 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:44:48.115 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:44:48.115 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:18.2.0-0.el8 ceph 13 M 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:18.2.0-0.el8 ceph 3.7 M 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:18.2.0-0.el8 ceph 3.6 M 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:18.2.0-0.el8 ceph 5.4 M 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:18.2.0-0.el8 ceph 22 M 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:18.2.0-0.el8 ceph 24 k 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:18.2.0-0.el8 ceph 768 k 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-13T10:44:48.116 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:18.2.0-0.el8 ceph 476 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:18.2.0-0.el8 ceph 6.5 M 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el8 ceph 45 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:18.2.0-0.el8 ceph 118 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:18.2.0-0.el8 ceph 190 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:18.2.0-0.el8 ceph 371 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:18.2.0-0.el8 ceph 363 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:18.2.0-0.el8 ceph 107 k 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-13T10:44:48.117 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:44:48.118 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:44:48.118 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:44:48.118 INFO:teuthology.orchestra.run.smithi194.stdout:Install 21 Packages 2024-04-13T10:44:48.118 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 2 Packages 2024-04-13T10:44:48.118 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:44:48.118 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 59 M 2024-04-13T10:44:48.118 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:44:48.694 INFO:teuthology.orchestra.run.smithi194.stdout:(1/23): ceph-base-18.2.0-0.el8.x86_64.rpm 25 MB/s | 5.4 MB 00:00 2024-04-13T10:44:48.736 INFO:teuthology.orchestra.run.smithi194.stdout:(2/23): ceph-selinux-18.2.0-0.el8.x86_64.rpm 586 kB/s | 24 kB 00:00 2024-04-13T10:44:48.803 INFO:teuthology.orchestra.run.smithi194.stdout:(3/23): libcephfs2-18.2.0-0.el8.x86_64.rpm 11 MB/s | 768 kB 00:00 2024-04-13T10:44:49.420 INFO:teuthology.orchestra.run.smithi194.stdout:(4/23): ceph-common-18.2.0-0.el8.x86_64.rpm 23 MB/s | 22 MB 00:00 2024-04-13T10:44:49.453 INFO:teuthology.orchestra.run.smithi194.stdout:(5/23): libradosstriper1-18.2.0-0.el8.x86_64.rp 732 kB/s | 476 kB 00:00 2024-04-13T10:44:49.529 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:44:49.531 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:44:49.531 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-13T10:44:49.531 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:18.2.0-0.el8 ceph 13 M 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:18.2.0-0.el8 ceph 3.7 M 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:18.2.0-0.el8 ceph 3.6 M 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:18.2.0-0.el8 ceph 5.4 M 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:18.2.0-0.el8 ceph 22 M 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:18.2.0-0.el8 ceph 24 k 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:18.2.0-0.el8 ceph 768 k 2024-04-13T10:44:49.532 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:18.2.0-0.el8 ceph 476 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:18.2.0-0.el8 ceph 6.5 M 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el8 ceph 45 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:18.2.0-0.el8 ceph 118 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:18.2.0-0.el8 ceph 190 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:18.2.0-0.el8 ceph 371 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:18.2.0-0.el8 ceph 363 k 2024-04-13T10:44:49.533 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:18.2.0-0.el8 ceph 107 k 2024-04-13T10:44:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-13T10:44:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:44:49.534 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:44:49.534 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:44:49.534 INFO:teuthology.orchestra.run.smithi134.stdout:Install 21 Packages 2024-04-13T10:44:49.534 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2024-04-13T10:44:49.534 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:44:49.534 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 59 M 2024-04-13T10:44:49.535 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:44:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:(6/23): librgw2-18.2.0-0.el8.x86_64.rpm 25 MB/s | 6.5 MB 00:00 2024-04-13T10:44:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:(7/23): python3-ceph-argparse-18.2.0-0.el8.x86_ 178 kB/s | 45 kB 00:00 2024-04-13T10:44:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:(8/23): python3-ceph-common-18.2.0-0.el8.x86_64 2.8 MB/s | 118 kB 00:00 2024-04-13T10:44:49.746 INFO:teuthology.orchestra.run.smithi194.stdout:(9/23): python3-cephfs-18.2.0-0.el8.x86_64.rpm 4.4 MB/s | 190 kB 00:00 2024-04-13T10:44:49.780 INFO:teuthology.orchestra.run.smithi194.stdout:(10/23): python3-rados-18.2.0-0.el8.x86_64.rpm 6.2 MB/s | 371 kB 00:00 2024-04-13T10:44:49.805 INFO:teuthology.orchestra.run.smithi194.stdout:(11/23): python3-rbd-18.2.0-0.el8.x86_64.rpm 6.0 MB/s | 363 kB 00:00 2024-04-13T10:44:49.830 INFO:teuthology.orchestra.run.smithi194.stdout:(12/23): python3-rgw-18.2.0-0.el8.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-04-13T10:44:49.989 INFO:teuthology.orchestra.run.smithi194.stdout:(13/23): ceph-radosgw-18.2.0-0.el8.x86_64.rpm 8.6 MB/s | 13 MB 00:01 2024-04-13T10:44:50.015 INFO:teuthology.orchestra.run.smithi134.stdout:(1/23): ceph-base-18.2.0-0.el8.x86_64.rpm 31 MB/s | 5.4 MB 00:00 2024-04-13T10:44:50.040 INFO:teuthology.orchestra.run.smithi134.stdout:(2/23): ceph-selinux-18.2.0-0.el8.x86_64.rpm 978 kB/s | 24 kB 00:00 2024-04-13T10:44:50.074 INFO:teuthology.orchestra.run.smithi134.stdout:(3/23): libcephfs2-18.2.0-0.el8.x86_64.rpm 22 MB/s | 768 kB 00:00 2024-04-13T10:44:50.107 INFO:teuthology.orchestra.run.smithi134.stdout:(4/23): libradosstriper1-18.2.0-0.el8.x86_64.rp 14 MB/s | 476 kB 00:00 2024-04-13T10:44:50.147 INFO:teuthology.orchestra.run.smithi194.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 278 kB/s | 44 kB 00:00 2024-04-13T10:44:50.241 INFO:teuthology.orchestra.run.smithi134.stdout:(5/23): librgw2-18.2.0-0.el8.x86_64.rpm 49 MB/s | 6.5 MB 00:00 2024-04-13T10:44:50.248 INFO:teuthology.orchestra.run.smithi194.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 622 kB/s | 259 kB 00:00 2024-04-13T10:44:50.266 INFO:teuthology.orchestra.run.smithi134.stdout:(6/23): python3-ceph-argparse-18.2.0-0.el8.x86_ 1.8 MB/s | 45 kB 00:00 2024-04-13T10:44:50.273 INFO:teuthology.orchestra.run.smithi194.stdout:(16/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 375 kB/s | 47 kB 00:00 2024-04-13T10:44:50.302 INFO:teuthology.orchestra.run.smithi194.stdout:(17/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.3 MB/s | 677 kB 00:00 2024-04-13T10:44:50.321 INFO:teuthology.orchestra.run.smithi134.stdout:(7/23): python3-ceph-common-18.2.0-0.el8.x86_64 2.1 MB/s | 118 kB 00:00 2024-04-13T10:44:50.349 INFO:teuthology.orchestra.run.smithi194.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 782 kB/s | 59 kB 00:00 2024-04-13T10:44:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:(8/23): python3-cephfs-18.2.0-0.el8.x86_64.rpm 5.1 MB/s | 190 kB 00:00 2024-04-13T10:44:50.366 INFO:teuthology.orchestra.run.smithi194.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2024-04-13T10:44:50.399 INFO:teuthology.orchestra.run.smithi194.stdout:(20/23): gperftools-libs-2.7-9.el8.x86_64.rpm 2.0 MB/s | 306 kB 00:00 2024-04-13T10:44:50.475 INFO:teuthology.orchestra.run.smithi194.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2024-04-13T10:44:50.492 INFO:teuthology.orchestra.run.smithi134.stdout:(9/23): ceph-radosgw-18.2.0-0.el8.x86_64.rpm 20 MB/s | 13 MB 00:00 2024-04-13T10:44:50.550 INFO:teuthology.orchestra.run.smithi194.stdout:(22/23): librados2-18.2.0-0.el8.x86_64.rpm 20 MB/s | 3.7 MB 00:00 2024-04-13T10:44:50.617 INFO:teuthology.orchestra.run.smithi194.stdout:(23/23): librbd1-18.2.0-0.el8.x86_64.rpm 16 MB/s | 3.6 MB 00:00 2024-04-13T10:44:50.619 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:44:50.619 INFO:teuthology.orchestra.run.smithi194.stdout:Total 24 MB/s | 59 MB 00:02 2024-04-13T10:44:50.654 INFO:teuthology.orchestra.run.smithi134.stdout:(10/23): python3-rados-18.2.0-0.el8.x86_64.rpm 1.2 MB/s | 371 kB 00:00 2024-04-13T10:44:50.661 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:44:50.706 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:44:50.706 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:44:50.851 INFO:teuthology.orchestra.run.smithi134.stdout:(11/23): python3-rgw-18.2.0-0.el8.x86_64.rpm 542 kB/s | 107 kB 00:00 2024-04-13T10:44:50.876 INFO:teuthology.orchestra.run.smithi134.stdout:(12/23): python3-rbd-18.2.0-0.el8.x86_64.rpm 947 kB/s | 363 kB 00:00 2024-04-13T10:44:51.066 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:44:51.069 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:44:51.135 INFO:teuthology.orchestra.run.smithi134.stdout:(13/23): ceph-common-18.2.0-0.el8.x86_64.rpm 17 MB/s | 22 MB 00:01 2024-04-13T10:44:51.310 INFO:teuthology.orchestra.run.smithi134.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 251 kB/s | 44 kB 00:00 2024-04-13T10:44:51.344 INFO:teuthology.orchestra.run.smithi134.stdout:(15/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.3 MB/s | 677 kB 00:00 2024-04-13T10:44:51.369 INFO:teuthology.orchestra.run.smithi134.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 527 kB/s | 259 kB 00:00 2024-04-13T10:44:51.436 INFO:teuthology.orchestra.run.smithi134.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 882 kB/s | 59 kB 00:00 2024-04-13T10:44:51.462 INFO:teuthology.orchestra.run.smithi134.stdout:(18/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 312 kB/s | 47 kB 00:00 2024-04-13T10:44:51.487 INFO:teuthology.orchestra.run.smithi134.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-04-13T10:44:51.512 INFO:teuthology.orchestra.run.smithi134.stdout:(20/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.8 MB/s | 306 kB 00:00 2024-04-13T10:44:51.621 INFO:teuthology.orchestra.run.smithi134.stdout:(21/23): librbd1-18.2.0-0.el8.x86_64.rpm 33 MB/s | 3.6 MB 00:00 2024-04-13T10:44:51.671 INFO:teuthology.orchestra.run.smithi134.stdout:(22/23): librados2-18.2.0-0.el8.x86_64.rpm 20 MB/s | 3.7 MB 00:00 2024-04-13T10:44:51.713 INFO:teuthology.orchestra.run.smithi134.stdout:(23/23): thrift-0.13.0-2.el8.x86_64.rpm 6.9 MB/s | 1.7 MB 00:00 2024-04-13T10:44:51.715 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:44:51.715 INFO:teuthology.orchestra.run.smithi134.stdout:Total 27 MB/s | 59 MB 00:02 2024-04-13T10:44:51.759 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:44:51.805 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:44:51.805 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:44:52.185 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:44:52.188 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:44:52.257 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:44:52.509 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2024-04-13T10:44:53.323 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2024-04-13T10:44:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:44:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2024-04-13T10:44:53.828 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2024-04-13T10:44:53.848 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2024-04-13T10:44:54.052 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2024-04-13T10:44:54.248 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2024-04-13T10:44:54.449 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2024-04-13T10:44:54.469 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:18.2.0-0.el8.x86_64 4/25 2024-04-13T10:44:54.570 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:18.2.0-0.el8.x86_64 4/25 2024-04-13T10:44:54.660 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:18.2.0-0.el8.x86_64 4/25 2024-04-13T10:44:54.764 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:18.2.0-0.el8.x86_64 4/25 2024-04-13T10:44:54.890 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:18.2.0-0.el8.x86_64 5/25 2024-04-13T10:44:55.013 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:18.2.0-0.el8.x86_64 5/25 2024-04-13T10:44:55.027 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:18.2.0-0.el8.x86_64 6/25 2024-04-13T10:44:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:18.2.0-0.el8.x86_64 6/25 2024-04-13T10:44:55.425 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el8.x86_64 6/25 2024-04-13T10:44:55.596 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el8.x86_64 6/25 2024-04-13T10:44:55.652 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:18.2.0-0.el8.x86_64 7/25 2024-04-13T10:44:55.715 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:18.2.0-0.el8.x86_64 7/25 2024-04-13T10:44:55.801 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:18.2.0-0.el8.x86_64 7/25 2024-04-13T10:44:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:18.2.0-0.el8.x86_64 7/25 2024-04-13T10:44:55.945 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/25 2024-04-13T10:44:56.070 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/25 2024-04-13T10:44:56.150 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2024-04-13T10:44:56.304 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el8.x86_64 10/25 2024-04-13T10:44:56.527 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:18.2.0-0.el8.x86_64 11/25 2024-04-13T10:44:56.776 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2024-04-13T10:44:56.778 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:18.2.0-0.el8.x86_64 12/25 2024-04-13T10:44:56.921 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el8.x86_64 10/25 2024-04-13T10:44:56.936 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:18.2.0-0.el8.x86_64 13/25 2024-04-13T10:44:56.989 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el8.x86_64 13/25 2024-04-13T10:44:57.123 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:18.2.0-0.el8.x86_64 11/25 2024-04-13T10:44:57.236 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2024-04-13T10:44:57.328 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:18.2.0-0.el8.x86_64 12/25 2024-04-13T10:44:57.468 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:18.2.0-0.el8.x86_64 13/25 2024-04-13T10:44:57.537 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el8.x86_64 13/25 2024-04-13T10:44:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2024-04-13T10:44:58.033 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2024-04-13T10:44:58.219 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:18.2.0-0.el8.x86_64 16/25 2024-04-13T10:44:58.344 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:18.2.0-0.el8.x86_64 16/25 2024-04-13T10:44:58.493 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:18.2.0-0.el8.x86_64 17/25 2024-04-13T10:44:58.541 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2024-04-13T10:44:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:18.2.0-0.el8.x86_64 16/25 2024-04-13T10:44:58.716 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-04-13T10:44:58.748 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:18.2.0-0.el8.x86_64 16/25 2024-04-13T10:44:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:18.2.0-0.el8.x86_64 17/25 2024-04-13T10:44:59.176 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-04-13T10:44:59.186 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:18.2.0-0.el8.x86_64 19/25 2024-04-13T10:44:59.360 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:18.2.0-0.el8.x86_64 19/25 2024-04-13T10:45:01.718 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el8.x86_64 20/25 2024-04-13T10:45:01.916 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el8.x86_64 20/25 2024-04-13T10:45:01.985 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:18.2.0-0.el8.x86_64 20/25 2024-04-13T10:45:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:18.2.0-0.el8.x86_64 20/25 2024-04-13T10:45:02.582 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el8.x86_64 20/25 2024-04-13T10:45:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el8.x86_64 20/25 2024-04-13T10:45:02.892 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:18.2.0-0.el8.x86_64 21/25 2024-04-13T10:45:03.000 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el8.x86_64 21/25 2024-04-13T10:45:03.062 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:18.2.0-0.el8.x86_64 21/25 2024-04-13T10:45:03.165 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el8.x86_64 21/25 2024-04-13T10:45:03.226 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:18.2.0-0.el8.x86_64 22/25 2024-04-13T10:45:03.359 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:18.2.0-0.el8.x86_64 22/25 2024-04-13T10:45:22.640 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el8.x86_64 22/25 2024-04-13T10:45:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-04-13T10:45:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-04-13T10:45:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2024-04-13T10:45:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /run 2024-04-13T10:45:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-04-13T10:45:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-04-13T10:45:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-04-13T10:45:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-04-13T10:45:22.641 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2024-04-13T10:45:22.641 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:22.700 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el8.x86_64 22/25 2024-04-13T10:45:22.700 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-04-13T10:45:22.700 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-04-13T10:45:22.701 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /dev 2024-04-13T10:45:22.701 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /run 2024-04-13T10:45:22.701 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-04-13T10:45:22.701 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-04-13T10:45:22.701 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-04-13T10:45:22.701 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-04-13T10:45:22.701 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /dev 2024-04-13T10:45:22.701 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:18.2.0-0.el8.x86_64 23/25 2024-04-13T10:45:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el8.x86_64 23/25 2024-04-13T10:45:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-13T10:45:24.114 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:18.2.0-0.el8.x86_64 23/25 2024-04-13T10:45:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el8.x86_64 23/25 2024-04-13T10:45:24.136 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-13T10:45:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-13T10:45:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-13T10:45:24.383 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-13T10:45:24.383 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-13T10:45:24.949 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-13T10:45:24.949 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:18.2.0-0.el8.x86_64 1/25 2024-04-13T10:45:24.949 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:18.2.0-0.el8.x86_64 2/25 2024-04-13T10:45:24.950 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el8.x86_64 3/25 2024-04-13T10:45:24.950 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:18.2.0-0.el8.x86_64 4/25 2024-04-13T10:45:24.950 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:18.2.0-0.el8.x86_64 5/25 2024-04-13T10:45:24.950 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:18.2.0-0.el8.x86_64 6/25 2024-04-13T10:45:24.950 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:18.2.0-0.el8.x86_64 7/25 2024-04-13T10:45:24.950 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el8.x86_64 8/25 2024-04-13T10:45:24.950 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el8.x86_64 9/25 2024-04-13T10:45:24.950 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:18.2.0-0.el8.x86_64 10/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:18.2.0-0.el8.x86_64 11/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:18.2.0-0.el8.x86_64 12/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:18.2.0-0.el8.x86_64 13/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:18.2.0-0.el8.x86_64 22/25 2024-04-13T10:45:24.951 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-04-13T10:45:24.952 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:18.2.0-0.el8.x86_64 24/25 2024-04-13T10:45:25.095 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-13T10:45:25.095 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:18.2.0-0.el8.x86_64 1/25 2024-04-13T10:45:25.095 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:18.2.0-0.el8.x86_64 2/25 2024-04-13T10:45:25.095 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el8.x86_64 3/25 2024-04-13T10:45:25.095 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:18.2.0-0.el8.x86_64 4/25 2024-04-13T10:45:25.095 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:18.2.0-0.el8.x86_64 5/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:18.2.0-0.el8.x86_64 6/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:18.2.0-0.el8.x86_64 7/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el8.x86_64 8/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el8.x86_64 9/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:18.2.0-0.el8.x86_64 10/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:18.2.0-0.el8.x86_64 11/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:18.2.0-0.el8.x86_64 12/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:18.2.0-0.el8.x86_64 13/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-04-13T10:45:25.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2024-04-13T10:45:25.097 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2024-04-13T10:45:25.097 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2024-04-13T10:45:25.097 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:18.2.0-0.el8.x86_64 22/25 2024-04-13T10:45:25.097 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-04-13T10:45:25.097 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:18.2.0-0.el8.x86_64 24/25 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:18.2.0-0.el8.x86_64 librbd1-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-13T10:45:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-13T10:45:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:25.798 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:45:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-04-13T10:45:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:26.001 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-04-13T10:45:26.001 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:18.2.0-0.el8.x86_64 librbd1-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.002 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:26.003 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:45:26.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2024-04-13T10:45:26.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-test 2024-04-13T10:45:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:41 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:45:27.054 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:43 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:45:28.496 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:45:28.497 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:45:28.497 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-13T10:45:28.497 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:45:28.497 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:45:28.497 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:18.2.0-0.el8 ceph 47 M 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:18.2.0-0.el8 ceph 137 k 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-04-13T10:45:28.498 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:28.499 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 48 M 2024-04-13T10:45:28.499 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 211 M 2024-04-13T10:45:28.499 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:45:28.688 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:45:28.689 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:45:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-04-13T10:45:28.689 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:45:28.689 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:45:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:18.2.0-0.el8 ceph 47 M 2024-04-13T10:45:28.689 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-04-13T10:45:28.689 INFO:teuthology.orchestra.run.smithi194.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-13T10:45:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:18.2.0-0.el8 ceph 137 k 2024-04-13T10:45:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-13T10:45:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-13T10:45:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-13T10:45:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:28.690 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:45:28.690 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:45:28.690 INFO:teuthology.orchestra.run.smithi194.stdout:Install 6 Packages 2024-04-13T10:45:28.690 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:28.691 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 48 M 2024-04-13T10:45:28.691 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 211 M 2024-04-13T10:45:28.691 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:45:29.798 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): libcephsqlite-18.2.0-0.el8.x86_64.rpm 1.4 MB/s | 137 kB 00:00 2024-04-13T10:45:29.931 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 888 kB/s | 203 kB 00:00 2024-04-13T10:45:30.023 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 836 kB/s | 188 kB 00:00 2024-04-13T10:45:30.079 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2024-04-13T10:45:30.104 INFO:teuthology.orchestra.run.smithi194.stdout:(1/6): libcephsqlite-18.2.0-0.el8.x86_64.rpm 657 kB/s | 137 kB 00:00 2024-04-13T10:45:30.107 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 846 kB/s | 71 kB 00:00 2024-04-13T10:45:30.162 INFO:teuthology.orchestra.run.smithi194.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 760 kB/s | 203 kB 00:00 2024-04-13T10:45:30.304 INFO:teuthology.orchestra.run.smithi194.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2024-04-13T10:45:30.363 INFO:teuthology.orchestra.run.smithi194.stdout:(4/6): oniguruma-6.8.2-3.el8.x86_64.rpm 728 kB/s | 188 kB 00:00 2024-04-13T10:45:30.412 INFO:teuthology.orchestra.run.smithi194.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 657 kB/s | 71 kB 00:00 2024-04-13T10:45:30.890 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): ceph-test-18.2.0-0.el8.x86_64.rpm 39 MB/s | 47 MB 00:01 2024-04-13T10:45:30.892 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:45:30.893 INFO:teuthology.orchestra.run.smithi134.stdout:Total 20 MB/s | 48 MB 00:02 2024-04-13T10:45:30.897 INFO:teuthology.orchestra.run.smithi194.stdout:(6/6): ceph-test-18.2.0-0.el8.x86_64.rpm 47 MB/s | 47 MB 00:01 2024-04-13T10:45:30.899 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:45:30.899 INFO:teuthology.orchestra.run.smithi194.stdout:Total 22 MB/s | 48 MB 00:02 2024-04-13T10:45:30.935 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:45:30.941 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:45:30.956 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:45:30.956 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:45:30.962 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:45:30.962 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:45:31.223 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:45:31.226 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:45:31.227 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:45:31.231 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:45:31.678 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:45:31.709 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:45:31.937 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-04-13T10:45:31.942 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-04-13T10:45:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-04-13T10:45:32.241 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-04-13T10:45:32.279 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-13T10:45:32.380 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-13T10:45:32.387 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-13T10:45:32.468 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-04-13T10:45:32.574 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-04-13T10:45:32.663 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-04-13T10:45:32.746 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:18.2.0-0.el8.x86_64 5/6 2024-04-13T10:45:32.834 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:18.2.0-0.el8.x86_64 5/6 2024-04-13T10:45:37.237 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el8.x86_64 5/6 2024-04-13T10:45:37.319 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el8.x86_64 5/6 2024-04-13T10:45:37.477 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:18.2.0-0.el8.x86_64 6/6 2024-04-13T10:45:37.577 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:18.2.0-0.el8.x86_64 6/6 2024-04-13T10:45:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el8.x86_64 6/6 2024-04-13T10:45:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:18.2.0-0.el8.x86_64 1/6 2024-04-13T10:45:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:18.2.0-0.el8.x86_64 2/6 2024-04-13T10:45:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-04-13T10:45:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-04-13T10:45:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-04-13T10:45:37.865 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el8.x86_64 6/6 2024-04-13T10:45:37.865 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:18.2.0-0.el8.x86_64 1/6 2024-04-13T10:45:37.866 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:18.2.0-0.el8.x86_64 2/6 2024-04-13T10:45:37.866 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-04-13T10:45:37.866 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-04-13T10:45:37.866 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-04-13T10:45:38.174 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-04-13T10:45:38.174 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:38.174 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:45:38.174 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:18.2.0-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-13T10:45:38.175 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:18.2.0-0.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-04-13T10:45:38.175 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-04-13T10:45:38.175 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:38.175 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:45:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-04-13T10:45:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:38.278 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:45:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:18.2.0-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-13T10:45:38.278 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:18.2.0-0.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-04-13T10:45:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-04-13T10:45:38.279 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:38.279 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:45:38.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2024-04-13T10:45:38.502 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph 2024-04-13T10:45:39.181 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:54 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:45:39.239 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:55 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:45:40.810 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:45:40.813 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:45:40.813 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-13T10:45:40.813 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:45:40.813 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:45:40.813 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:18.2.0-0.el8 ceph 6.3 k 2024-04-13T10:45:40.813 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-13T10:45:40.814 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:18.2.0-0.el8 ceph 2.3 M 2024-04-13T10:45:40.814 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:18.2.0-0.el8 ceph 1.5 M 2024-04-13T10:45:40.814 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el8 ceph-noarch 240 k 2024-04-13T10:45:40.814 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:18.2.0-0.el8 ceph 4.6 M 2024-04-13T10:45:40.814 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:18.2.0-0.el8 ceph 18 M 2024-04-13T10:45:40.814 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-13T10:45:40.814 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-13T10:45:40.814 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-13T10:45:40.814 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-13T10:45:40.814 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-13T10:45:40.815 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout:Install 32 Packages 2024-04-13T10:45:40.816 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:40.817 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 30 M 2024-04-13T10:45:40.817 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 119 M 2024-04-13T10:45:40.817 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:45:40.880 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:45:40.883 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:45:40.883 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-04-13T10:45:40.883 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:18.2.0-0.el8 ceph 6.3 k 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:18.2.0-0.el8 ceph 2.3 M 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:18.2.0-0.el8 ceph 1.5 M 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el8 ceph-noarch 240 k 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:18.2.0-0.el8 ceph 4.6 M 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:18.2.0-0.el8 ceph 18 M 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-13T10:45:40.884 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-13T10:45:40.885 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout:Install 32 Packages 2024-04-13T10:45:40.886 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:40.887 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 30 M 2024-04-13T10:45:40.887 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 119 M 2024-04-13T10:45:40.887 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:45:41.075 INFO:teuthology.orchestra.run.smithi134.stdout:(1/32): ceph-18.2.0-0.el8.x86_64.rpm 75 kB/s | 6.3 kB 00:00 2024-04-13T10:45:41.134 INFO:teuthology.orchestra.run.smithi134.stdout:(2/32): ceph-mgr-18.2.0-0.el8.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2024-04-13T10:45:41.184 INFO:teuthology.orchestra.run.smithi134.stdout:(3/32): ceph-mds-18.2.0-0.el8.x86_64.rpm 12 MB/s | 2.3 MB 00:00 2024-04-13T10:45:41.226 INFO:teuthology.orchestra.run.smithi134.stdout:(4/32): ceph-mgr-modules-core-18.2.0-0.el8.noar 5.6 MB/s | 240 kB 00:00 2024-04-13T10:45:41.306 INFO:teuthology.orchestra.run.smithi194.stdout:(1/32): ceph-18.2.0-0.el8.x86_64.rpm 123 kB/s | 6.3 kB 00:00 2024-04-13T10:45:41.326 INFO:teuthology.orchestra.run.smithi134.stdout:(5/32): ceph-mon-18.2.0-0.el8.x86_64.rpm 18 MB/s | 4.6 MB 00:00 2024-04-13T10:45:41.356 INFO:teuthology.orchestra.run.smithi194.stdout:(2/32): ceph-mgr-18.2.0-0.el8.x86_64.rpm 15 MB/s | 1.5 MB 00:00 2024-04-13T10:45:41.406 INFO:teuthology.orchestra.run.smithi194.stdout:(3/32): ceph-mds-18.2.0-0.el8.x86_64.rpm 15 MB/s | 2.3 MB 00:00 2024-04-13T10:45:41.432 INFO:teuthology.orchestra.run.smithi194.stdout:(4/32): ceph-mgr-modules-core-18.2.0-0.el8.noar 9.4 MB/s | 240 kB 00:00 2024-04-13T10:45:41.460 INFO:teuthology.orchestra.run.smithi134.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 291 kB/s | 39 kB 00:00 2024-04-13T10:45:41.510 INFO:teuthology.orchestra.run.smithi134.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 554 kB/s | 157 kB 00:00 2024-04-13T10:45:41.549 INFO:teuthology.orchestra.run.smithi194.stdout:(5/32): ceph-mon-18.2.0-0.el8.x86_64.rpm 19 MB/s | 4.6 MB 00:00 2024-04-13T10:45:41.728 INFO:teuthology.orchestra.run.smithi134.stdout:(8/32): ceph-osd-18.2.0-0.el8.x86_64.rpm 30 MB/s | 18 MB 00:00 2024-04-13T10:45:41.752 INFO:teuthology.orchestra.run.smithi134.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 354 kB/s | 103 kB 00:00 2024-04-13T10:45:41.770 INFO:teuthology.orchestra.run.smithi134.stdout:(10/32): python3-pytz-2017.2-11.el8.noarch.rpm 220 kB/s | 57 kB 00:00 2024-04-13T10:45:41.788 INFO:teuthology.orchestra.run.smithi194.stdout:(6/32): ceph-osd-18.2.0-0.el8.x86_64.rpm 41 MB/s | 18 MB 00:00 2024-04-13T10:45:41.808 INFO:teuthology.orchestra.run.smithi194.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 150 kB/s | 39 kB 00:00 2024-04-13T10:45:41.841 INFO:teuthology.orchestra.run.smithi194.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 384 kB/s | 157 kB 00:00 2024-04-13T10:45:41.892 INFO:teuthology.orchestra.run.smithi194.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 681 kB/s | 57 kB 00:00 2024-04-13T10:45:41.936 INFO:teuthology.orchestra.run.smithi134.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2024-04-13T10:45:41.987 INFO:teuthology.orchestra.run.smithi134.stdout:(12/32): python3-cryptography-3.2.1-7.el8.x86_6 2.9 MB/s | 641 kB 00:00 2024-04-13T10:45:41.992 INFO:teuthology.orchestra.run.smithi194.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 3.0 MB/s | 457 kB 00:00 2024-04-13T10:45:42.012 INFO:teuthology.orchestra.run.smithi134.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.4 MB/s | 109 kB 00:00 2024-04-13T10:45:42.017 INFO:teuthology.orchestra.run.smithi194.stdout:(11/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 452 kB/s | 103 kB 00:00 2024-04-13T10:45:42.046 INFO:teuthology.orchestra.run.smithi134.stdout:(14/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.4 MB/s | 457 kB 00:00 2024-04-13T10:45:42.084 INFO:teuthology.orchestra.run.smithi194.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2024-04-13T10:45:42.137 INFO:teuthology.orchestra.run.smithi134.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 290 kB/s | 44 kB 00:00 2024-04-13T10:45:42.185 INFO:teuthology.orchestra.run.smithi194.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 3.3 MB/s | 641 kB 00:00 2024-04-13T10:45:42.210 INFO:teuthology.orchestra.run.smithi194.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 566 kB/s | 109 kB 00:00 2024-04-13T10:45:42.221 INFO:teuthology.orchestra.run.smithi134.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 908 kB/s | 185 kB 00:00 2024-04-13T10:45:42.247 INFO:teuthology.orchestra.run.smithi134.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 884 kB/s | 173 kB 00:00 2024-04-13T10:45:42.260 INFO:teuthology.orchestra.run.smithi194.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 248 kB/s | 44 kB 00:00 2024-04-13T10:45:42.272 INFO:teuthology.orchestra.run.smithi134.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2024-04-13T10:45:42.297 INFO:teuthology.orchestra.run.smithi134.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 350 kB/s | 18 kB 00:00 2024-04-13T10:45:42.322 INFO:teuthology.orchestra.run.smithi134.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 972 kB/s | 49 kB 00:00 2024-04-13T10:45:42.348 INFO:teuthology.orchestra.run.smithi134.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2024-04-13T10:45:42.373 INFO:teuthology.orchestra.run.smithi134.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.6 MB/s | 384 kB 00:00 2024-04-13T10:45:42.398 INFO:teuthology.orchestra.run.smithi134.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2024-04-13T10:45:42.423 INFO:teuthology.orchestra.run.smithi134.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.7 MB/s | 283 kB 00:00 2024-04-13T10:45:42.449 INFO:teuthology.orchestra.run.smithi134.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 248 kB/s | 19 kB 00:00 2024-04-13T10:45:42.500 INFO:teuthology.orchestra.run.smithi134.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 236 kB/s | 24 kB 00:00 2024-04-13T10:45:42.524 INFO:teuthology.orchestra.run.smithi134.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 291 kB/s | 29 kB 00:00 2024-04-13T10:45:42.536 INFO:teuthology.orchestra.run.smithi194.stdout:(16/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.4 MB/s | 384 kB 00:00 2024-04-13T10:45:42.549 INFO:teuthology.orchestra.run.smithi134.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 561 kB/s | 27 kB 00:00 2024-04-13T10:45:42.575 INFO:teuthology.orchestra.run.smithi134.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.4 MB/s | 255 kB 00:00 2024-04-13T10:45:42.600 INFO:teuthology.orchestra.run.smithi134.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2024-04-13T10:45:42.604 INFO:teuthology.orchestra.run.smithi194.stdout:(17/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 442 kB/s | 185 kB 00:00 2024-04-13T10:45:42.626 INFO:teuthology.orchestra.run.smithi134.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 455 kB/s | 23 kB 00:00 2024-04-13T10:45:42.636 INFO:teuthology.orchestra.run.smithi194.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-04-13T10:45:42.651 INFO:teuthology.orchestra.run.smithi134.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.9 MB/s | 251 kB 00:00 2024-04-13T10:45:42.655 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:45:42.655 INFO:teuthology.orchestra.run.smithi134.stdout:Total 16 MB/s | 30 MB 00:01 2024-04-13T10:45:42.661 INFO:teuthology.orchestra.run.smithi194.stdout:(19/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 383 kB/s | 173 kB 00:00 2024-04-13T10:45:42.687 INFO:teuthology.orchestra.run.smithi194.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 213 kB/s | 18 kB 00:00 2024-04-13T10:45:42.712 INFO:teuthology.orchestra.run.smithi194.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 646 kB/s | 49 kB 00:00 2024-04-13T10:45:42.736 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:45:42.737 INFO:teuthology.orchestra.run.smithi194.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 780 kB/s | 59 kB 00:00 2024-04-13T10:45:42.774 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:45:42.774 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:45:42.796 INFO:teuthology.orchestra.run.smithi194.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2024-04-13T10:45:42.821 INFO:teuthology.orchestra.run.smithi194.stdout:(24/32): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2024-04-13T10:45:42.880 INFO:teuthology.orchestra.run.smithi194.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 131 kB/s | 19 kB 00:00 2024-04-13T10:45:42.905 INFO:teuthology.orchestra.run.smithi194.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 220 kB/s | 24 kB 00:00 2024-04-13T10:45:42.930 INFO:teuthology.orchestra.run.smithi194.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 269 kB/s | 29 kB 00:00 2024-04-13T10:45:42.955 INFO:teuthology.orchestra.run.smithi194.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2024-04-13T10:45:43.039 INFO:teuthology.orchestra.run.smithi194.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.3 MB/s | 255 kB 00:00 2024-04-13T10:45:43.064 INFO:teuthology.orchestra.run.smithi194.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 785 kB/s | 85 kB 00:00 2024-04-13T10:45:43.067 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:45:43.070 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:45:43.090 INFO:teuthology.orchestra.run.smithi194.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.5 MB/s | 251 kB 00:00 2024-04-13T10:45:43.140 INFO:teuthology.orchestra.run.smithi194.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 229 kB/s | 23 kB 00:00 2024-04-13T10:45:43.141 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:45:43.141 INFO:teuthology.orchestra.run.smithi194.stdout:Total 13 MB/s | 30 MB 00:02 2024-04-13T10:45:43.224 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:45:43.262 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:45:43.262 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:45:43.586 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:45:43.589 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:45:44.221 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:45:44.473 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-13T10:45:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-13T10:45:44.753 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:45:44.966 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-13T10:45:44.993 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-13T10:45:45.194 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-13T10:45:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-13T10:45:45.444 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-13T10:45:45.447 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-13T10:45:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-13T10:45:45.705 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-13T10:45:45.880 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-13T10:45:45.923 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-13T10:45:46.024 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-13T10:45:46.120 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-13T10:45:46.231 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-13T10:45:46.314 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-13T10:45:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-13T10:45:46.508 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-13T10:45:46.691 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-13T10:45:46.742 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-13T10:45:46.907 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-13T10:45:46.996 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-13T10:45:47.243 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-13T10:45:47.299 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-13T10:45:47.524 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-13T10:45:47.554 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-13T10:45:47.779 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-13T10:45:47.914 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-13T10:45:48.062 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-13T10:45:48.163 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-13T10:45:48.310 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-13T10:45:48.418 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-13T10:45:48.628 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-13T10:45:48.761 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-13T10:45:48.890 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-13T10:45:48.995 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-13T10:45:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-13T10:45:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-13T10:45:49.324 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-13T10:45:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-13T10:45:49.566 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-13T10:45:49.700 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-13T10:45:49.737 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-13T10:45:49.949 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-13T10:45:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-13T10:45:50.184 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-13T10:45:50.295 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-13T10:45:50.432 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-13T10:45:50.613 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-13T10:45:50.672 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-13T10:45:50.991 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el8.noarch 27/32 2024-04-13T10:45:50.997 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-13T10:45:51.154 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:18.2.0-0.el8.x86_64 28/32 2024-04-13T10:45:51.356 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-13T10:45:51.754 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el8.noarch 27/32 2024-04-13T10:45:52.026 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:18.2.0-0.el8.x86_64 28/32 2024-04-13T10:45:52.737 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el8.x86_64 28/32 2024-04-13T10:45:52.904 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:18.2.0-0.el8.x86_64 29/32 2024-04-13T10:45:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el8.x86_64 29/32 2024-04-13T10:45:53.534 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:18.2.0-0.el8.x86_64 30/32 2024-04-13T10:45:53.602 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el8.x86_64 28/32 2024-04-13T10:45:53.748 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el8.x86_64 30/32 2024-04-13T10:45:53.834 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:18.2.0-0.el8.x86_64 29/32 2024-04-13T10:45:53.959 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:18.2.0-0.el8.x86_64 31/32 2024-04-13T10:45:53.977 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el8.x86_64 31/32 2024-04-13T10:45:54.109 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:18.2.0-0.el8.x86_64 32/32 2024-04-13T10:45:54.292 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el8.x86_64 29/32 2024-04-13T10:45:54.504 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:18.2.0-0.el8.x86_64 32/32 2024-04-13T10:45:54.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:18.2.0-0.el8.x86_64 1/32 2024-04-13T10:45:54.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:18.2.0-0.el8.x86_64 2/32 2024-04-13T10:45:54.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:18.2.0-0.el8.x86_64 3/32 2024-04-13T10:45:54.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:18.2.0-0.el8.x86_64 4/32 2024-04-13T10:45:54.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:18.2.0-0.el8.x86_64 5/32 2024-04-13T10:45:54.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el8.noarch 6/32 2024-04-13T10:45:54.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-13T10:45:54.504 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-13T10:45:54.505 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-13T10:45:54.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-13T10:45:54.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-13T10:45:54.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-13T10:45:54.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-13T10:45:54.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-13T10:45:54.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-13T10:45:54.506 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-13T10:45:54.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-13T10:45:54.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-13T10:45:54.509 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-13T10:45:54.543 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:18.2.0-0.el8.x86_64 30/32 2024-04-13T10:45:54.758 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el8.x86_64 30/32 2024-04-13T10:45:54.959 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:18.2.0-0.el8.x86_64 31/32 2024-04-13T10:45:54.977 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el8.x86_64 31/32 2024-04-13T10:45:55.134 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:18.2.0-0.el8.x86_64 32/32 2024-04-13T10:45:55.342 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-13T10:45:55.342 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:55.342 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:45:55.342 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:55.342 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:55.343 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:55.343 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:18.2.0-0.el8.noarch 2024-04-13T10:45:55.343 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:55.343 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:55.343 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-13T10:45:55.343 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-13T10:45:55.343 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-13T10:45:55.343 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-13T10:45:55.343 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-2.6-1.el8.noarch 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-13T10:45:55.344 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:45:55.345 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:45:55.547 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-2:18.2.0-0.el8.x86_64 32/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:18.2.0-0.el8.x86_64 1/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:18.2.0-0.el8.x86_64 2/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:18.2.0-0.el8.x86_64 3/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:18.2.0-0.el8.x86_64 4/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:18.2.0-0.el8.x86_64 5/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el8.noarch 6/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-13T10:45:55.548 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-13T10:45:55.549 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-13T10:45:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-13T10:45:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-13T10:45:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-13T10:45:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-13T10:45:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-13T10:45:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-13T10:45:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-13T10:45:55.551 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-13T10:45:55.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2024-04-13T10:45:56.384 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:11 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:45:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-13T10:45:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:56.392 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:45:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:18.2.0-0.el8.noarch 2024-04-13T10:45:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:18.2.0-0.el8.x86_64 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-13T10:45:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-2.6-1.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-13T10:45:56.394 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-13T10:45:56.395 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:45:56.395 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:45:56.664 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-base 2024-04-13T10:45:57.406 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:13 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:45:57.990 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:45:58.038 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:45:58.039 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-13T10:45:58.039 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:45:58.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2024-04-13T10:45:58.894 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:13 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:45:59.000 INFO:teuthology.orchestra.run.smithi194.stdout:Package ceph-base-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:45:59.049 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:45:59.050 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-04-13T10:45:59.050 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:45:59.146 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install cephadm 2024-04-13T10:45:59.874 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:15 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:00.527 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:00.528 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-13T10:46:00.529 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:00.529 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:46:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:18.2.0-0.el8 ceph-noarch 160 k 2024-04-13T10:46:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:00.529 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:46:00.529 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:00.529 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-13T10:46:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:00.530 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 160 k 2024-04-13T10:46:00.530 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 639 k 2024-04-13T10:46:00.530 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:46:00.597 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-18.2.0-0.el8.noarch.rpm 2.3 MB/s | 160 kB 00:00 2024-04-13T10:46:00.598 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:00.598 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.3 MB/s | 160 kB 00:00 2024-04-13T10:46:00.598 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:46:00.606 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:46:00.606 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:46:00.608 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:46:00.611 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:46:00.654 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:46:01.186 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:18.2.0-0.el8.noarch 1/1 2024-04-13T10:46:01.357 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:18.2.0-0.el8.noarch 1/1 2024-04-13T10:46:01.500 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:01.501 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:01.501 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-04-13T10:46:01.501 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:01.501 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:46:01.501 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:18.2.0-0.el8 ceph-noarch 160 k 2024-04-13T10:46:01.501 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:01.501 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:46:01.501 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:01.501 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-04-13T10:46:01.501 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:01.502 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 160 k 2024-04-13T10:46:01.502 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 639 k 2024-04-13T10:46:01.502 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:46:01.553 INFO:teuthology.orchestra.run.smithi194.stdout:cephadm-18.2.0-0.el8.noarch.rpm 3.1 MB/s | 160 kB 00:00 2024-04-13T10:46:01.554 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:01.554 INFO:teuthology.orchestra.run.smithi194.stdout:Total 3.0 MB/s | 160 kB 00:00 2024-04-13T10:46:01.554 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:46:01.562 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:46:01.562 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:46:01.564 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:46:01.567 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:46:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:18.2.0-0.el8.noarch 1/1 2024-04-13T10:46:01.621 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:46:01.977 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:18.2.0-0.el8.noarch 1/1 2024-04-13T10:46:01.978 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:01.978 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:46:01.978 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:18.2.0-0.el8.noarch 2024-04-13T10:46:01.978 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:01.978 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:46:02.148 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:18.2.0-0.el8.noarch 1/1 2024-04-13T10:46:02.257 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2024-04-13T10:46:02.362 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:18.2.0-0.el8.noarch 1/1 2024-04-13T10:46:02.585 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:18.2.0-0.el8.noarch 1/1 2024-04-13T10:46:02.994 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:17 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:46:03.021 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:18.2.0-0.el8.noarch 1/1 2024-04-13T10:46:03.021 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:03.021 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:46:03.021 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:18.2.0-0.el8.noarch 2024-04-13T10:46:03.021 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:03.021 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:03.280 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-immutable-object-cache 2024-04-13T10:46:04.010 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:20 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:04.631 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:04.632 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:04.632 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-04-13T10:46:04.632 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:04.632 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:46:04.632 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el8 ceph 165 k 2024-04-13T10:46:04.632 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:04.632 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:46:04.632 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:04.632 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-13T10:46:04.632 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:04.633 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 165 k 2024-04-13T10:46:04.633 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 503 k 2024-04-13T10:46:04.633 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:46:04.710 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-18.2.0-0.el8.x86_64 2.1 MB/s | 165 kB 00:00 2024-04-13T10:46:04.711 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:04.711 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.1 MB/s | 165 kB 00:00 2024-04-13T10:46:04.711 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:46:04.722 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:46:04.722 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:46:04.770 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:46:04.773 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:46:04.885 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:46:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:05.521 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:05.659 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:05.659 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:05.659 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-04-13T10:46:05.659 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:05.659 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:46:05.659 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el8 ceph 165 k 2024-04-13T10:46:05.660 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:05.660 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:46:05.660 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:05.660 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-04-13T10:46:05.660 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:05.660 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 165 k 2024-04-13T10:46:05.660 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 503 k 2024-04-13T10:46:05.661 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:46:05.717 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-immutable-object-cache-18.2.0-0.el8.x86_64 2.9 MB/s | 165 kB 00:00 2024-04-13T10:46:05.718 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:05.718 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.8 MB/s | 165 kB 00:00 2024-04-13T10:46:05.718 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:46:05.728 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:46:05.728 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:46:05.775 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:46:05.778 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:46:05.885 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:46:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:05.892 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:46:05.892 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:18.2.0-0.el8.x86_64 2024-04-13T10:46:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:05.893 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:46:06.124 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:06.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2024-04-13T10:46:06.533 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:06.892 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:46:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:18.2.0-0.el8.x86_64 2024-04-13T10:46:06.892 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:06.893 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:06.924 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:21 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:46:07.095 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr 2024-04-13T10:46:07.840 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:23 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:08.504 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:46:08.552 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:08.553 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-13T10:46:08.553 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:46:09.249 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2024-04-13T10:46:09.383 INFO:teuthology.orchestra.run.smithi194.stdout:Package ceph-mgr-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:46:09.433 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:09.434 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-04-13T10:46:09.434 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:09.588 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-dashboard 2024-04-13T10:46:09.986 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:24 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:46:10.315 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:26 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:11.626 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:11.627 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el8 ceph-noarch 1.7 M 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el8 ceph-noarch 23 k 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el8 ceph-noarch 14 k 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:46:11.628 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:11.629 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-04-13T10:46:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:11.629 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.0 M 2024-04-13T10:46:11.629 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 8.0 M 2024-04-13T10:46:11.629 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:46:11.932 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:11.933 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:11.933 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-04-13T10:46:11.933 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:11.933 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:46:11.933 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el8 ceph-noarch 1.7 M 2024-04-13T10:46:11.933 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-04-13T10:46:11.933 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el8 ceph-noarch 23 k 2024-04-13T10:46:11.933 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el8 ceph-noarch 14 k 2024-04-13T10:46:11.933 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-13T10:46:11.934 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-13T10:46:11.934 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-13T10:46:11.934 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:11.934 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:46:11.934 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:11.934 INFO:teuthology.orchestra.run.smithi194.stdout:Install 6 Packages 2024-04-13T10:46:11.934 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:11.935 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 2.0 M 2024-04-13T10:46:11.935 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 8.0 M 2024-04-13T10:46:11.935 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:46:12.038 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): ceph-grafana-dashboards-18.2.0-0.el8.noa 263 kB/s | 23 kB 00:00 2024-04-13T10:46:12.088 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): ceph-prometheus-alerts-18.2.0-0.el8.noar 105 kB/s | 14 kB 00:00 2024-04-13T10:46:12.122 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): ceph-mgr-dashboard-18.2.0-0.el8.noarch.r 9.9 MB/s | 1.7 MB 00:00 2024-04-13T10:46:12.122 INFO:teuthology.orchestra.run.smithi194.stdout:(1/6): ceph-prometheus-alerts-18.2.0-0.el8.noar 203 kB/s | 14 kB 00:00 2024-04-13T10:46:12.152 INFO:teuthology.orchestra.run.smithi194.stdout:(2/6): ceph-grafana-dashboards-18.2.0-0.el8.noa 225 kB/s | 23 kB 00:00 2024-04-13T10:46:12.155 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 363 kB/s | 43 kB 00:00 2024-04-13T10:46:12.194 INFO:teuthology.orchestra.run.smithi194.stdout:(3/6): ceph-mgr-dashboard-18.2.0-0.el8.noarch.r 12 MB/s | 1.7 MB 00:00 2024-04-13T10:46:12.213 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 268 kB/s | 34 kB 00:00 2024-04-13T10:46:12.295 INFO:teuthology.orchestra.run.smithi194.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 247 kB/s | 43 kB 00:00 2024-04-13T10:46:12.320 INFO:teuthology.orchestra.run.smithi194.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 201 kB/s | 34 kB 00:00 2024-04-13T10:46:12.339 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 905 kB/s | 196 kB 00:00 2024-04-13T10:46:12.341 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:12.341 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.8 MB/s | 2.0 MB 00:00 2024-04-13T10:46:12.352 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:46:12.361 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:46:12.362 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:46:12.362 INFO:teuthology.orchestra.run.smithi194.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.2 MB/s | 196 kB 00:00 2024-04-13T10:46:12.364 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:12.365 INFO:teuthology.orchestra.run.smithi194.stdout:Total 4.6 MB/s | 2.0 MB 00:00 2024-04-13T10:46:12.375 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:46:12.383 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:46:12.383 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:46:12.445 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:46:12.449 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:46:12.466 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:46:12.469 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:46:12.724 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:46:12.734 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:46:12.937 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-04-13T10:46:12.970 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-04-13T10:46:13.174 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-04-13T10:46:13.240 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-04-13T10:46:13.400 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-04-13T10:46:13.458 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-04-13T10:46:13.570 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el8.noarch 4/6 2024-04-13T10:46:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el8.noarch 4/6 2024-04-13T10:46:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el8.noarch 5/6 2024-04-13T10:46:13.969 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el8.noarch 5/6 2024-04-13T10:46:14.183 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el8.noarch 6/6 2024-04-13T10:46:14.205 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el8.noarch 6/6 2024-04-13T10:46:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el8.noarch 6/6 2024-04-13T10:46:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el8.noarch 1/6 2024-04-13T10:46:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el8.noarch 2/6 2024-04-13T10:46:14.471 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el8.noarch 3/6 2024-04-13T10:46:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-04-13T10:46:14.472 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-04-13T10:46:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el8.noarch 6/6 2024-04-13T10:46:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el8.noarch 1/6 2024-04-13T10:46:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el8.noarch 2/6 2024-04-13T10:46:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el8.noarch 3/6 2024-04-13T10:46:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-04-13T10:46:14.519 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-04-13T10:46:14.881 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-04-13T10:46:14.881 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:46:14.881 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:18.2.0-0.el8.noarch 2024-04-13T10:46:14.882 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:18.2.0-0.el8.noarch 2024-04-13T10:46:14.882 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:18.2.0-0.el8.noarch 2024-04-13T10:46:14.882 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-13T10:46:14.882 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-13T10:46:14.882 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-13T10:46:14.882 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:46:14.942 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-04-13T10:46:14.942 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:14.942 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:46:14.942 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:18.2.0-0.el8.noarch 2024-04-13T10:46:14.942 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:18.2.0-0.el8.noarch 2024-04-13T10:46:14.942 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:18.2.0-0.el8.noarch 2024-04-13T10:46:14.943 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-13T10:46:14.943 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-13T10:46:14.943 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-13T10:46:14.943 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:14.943 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:15.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-13T10:46:15.071 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-13T10:46:15.761 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:30 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:46:15.804 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:31 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:17.379 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:17.380 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================================ 2024-04-13T10:46:17.380 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-13T10:46:17.380 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================================ 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el8 ceph-noarch 7.4 M 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-13T10:46:17.381 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:17.382 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:46:17.382 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================================ 2024-04-13T10:46:17.382 INFO:teuthology.orchestra.run.smithi134.stdout:Install 8 Packages 2024-04-13T10:46:17.382 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:17.382 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 36 M 2024-04-13T10:46:17.383 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 210 M 2024-04-13T10:46:17.383 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:46:17.443 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:17.444 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================ 2024-04-13T10:46:17.444 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-04-13T10:46:17.444 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================ 2024-04-13T10:46:17.444 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:46:17.444 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el8 ceph-noarch 7.4 M 2024-04-13T10:46:17.444 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-04-13T10:46:17.444 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-13T10:46:17.444 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-13T10:46:17.444 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-13T10:46:17.444 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-13T10:46:17.445 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-13T10:46:17.445 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-13T10:46:17.445 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-13T10:46:17.445 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:17.445 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:46:17.445 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================ 2024-04-13T10:46:17.445 INFO:teuthology.orchestra.run.smithi194.stdout:Install 8 Packages 2024-04-13T10:46:17.446 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:17.446 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 36 M 2024-04-13T10:46:17.446 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 210 M 2024-04-13T10:46:17.446 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:46:17.901 INFO:teuthology.orchestra.run.smithi194.stdout:(1/8): ceph-mgr-diskprediction-local-18.2.0-0.e 34 MB/s | 7.4 MB 00:00 2024-04-13T10:46:17.911 INFO:teuthology.orchestra.run.smithi134.stdout:(1/8): ceph-mgr-diskprediction-local-18.2.0-0.e 22 MB/s | 7.4 MB 00:00 2024-04-13T10:46:18.202 INFO:teuthology.orchestra.run.smithi194.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 9.2 MB/s | 4.7 MB 00:00 2024-04-13T10:46:18.257 INFO:teuthology.orchestra.run.smithi134.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 7.2 MB/s | 4.9 MB 00:00 2024-04-13T10:46:18.293 INFO:teuthology.orchestra.run.smithi194.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 8.0 MB/s | 4.9 MB 00:00 2024-04-13T10:46:18.318 INFO:teuthology.orchestra.run.smithi194.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.9 MB/s | 225 kB 00:00 2024-04-13T10:46:18.329 INFO:teuthology.orchestra.run.smithi134.stdout:(3/8): openblas-0.3.15-4.el8.x86_64.rpm 6.3 MB/s | 4.7 MB 00:00 2024-04-13T10:46:18.354 INFO:teuthology.orchestra.run.smithi134.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.3 MB/s | 225 kB 00:00 2024-04-13T10:46:18.444 INFO:teuthology.orchestra.run.smithi194.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 6.9 MB/s | 3.7 MB 00:00 2024-04-13T10:46:18.454 INFO:teuthology.orchestra.run.smithi134.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 6.9 MB/s | 3.7 MB 00:00 2024-04-13T10:46:18.547 INFO:teuthology.orchestra.run.smithi194.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.8 MB/s | 645 kB 00:00 2024-04-13T10:46:18.588 INFO:teuthology.orchestra.run.smithi134.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.7 MB/s | 645 kB 00:00 2024-04-13T10:46:18.603 INFO:teuthology.orchestra.run.smithi194.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2024-04-13T10:46:18.630 INFO:teuthology.orchestra.run.smithi134.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 986 kB/s | 172 kB 00:00 2024-04-13T10:46:18.830 INFO:teuthology.orchestra.run.smithi194.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 27 MB/s | 14 MB 00:00 2024-04-13T10:46:18.926 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:18.926 INFO:teuthology.orchestra.run.smithi194.stdout:Total 26 MB/s | 36 MB 00:01 2024-04-13T10:46:19.059 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:46:19.078 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:46:19.078 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:46:19.159 INFO:teuthology.orchestra.run.smithi134.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 17 MB/s | 14 MB 00:00 2024-04-13T10:46:19.159 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:19.159 INFO:teuthology.orchestra.run.smithi134.stdout:Total 20 MB/s | 36 MB 00:01 2024-04-13T10:46:19.391 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:46:19.409 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:46:19.409 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:46:19.512 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:46:19.515 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:46:19.957 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:46:19.960 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:46:20.178 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:46:20.313 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-13T10:46:20.438 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-13T10:46:20.593 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-13T10:46:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:46:20.988 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-13T10:46:21.118 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-04-13T10:46:21.231 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-13T10:46:21.254 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-13T10:46:21.388 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-13T10:46:21.853 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-04-13T10:46:21.995 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-13T10:46:22.038 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-04-13T10:46:22.134 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-13T10:46:22.657 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-04-13T10:46:22.796 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-13T10:46:22.801 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-13T10:46:23.157 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-13T10:46:23.426 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-13T10:46:23.480 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-04-13T10:46:23.858 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-13T10:46:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-13T10:46:25.188 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-13T10:46:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-13T10:46:26.397 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-13T10:46:26.875 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el8.noarch 8/8 2024-04-13T10:46:27.241 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el8.noarch 8/8 2024-04-13T10:46:27.241 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el8.noarch 1/8 2024-04-13T10:46:27.242 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-13T10:46:27.242 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-13T10:46:27.242 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-13T10:46:27.242 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-13T10:46:27.242 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-13T10:46:27.242 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-13T10:46:27.366 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-04-13T10:46:27.596 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el8.noarch 8/8 2024-04-13T10:46:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-13T10:46:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:27.662 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:46:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el8.noarch 2024-04-13T10:46:27.662 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-13T10:46:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-13T10:46:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-13T10:46:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-13T10:46:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-13T10:46:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-13T10:46:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-13T10:46:27.663 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:27.663 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:27.798 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-rook 2024-04-13T10:46:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el8.noarch 8/8 2024-04-13T10:46:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el8.noarch 1/8 2024-04-13T10:46:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-04-13T10:46:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-04-13T10:46:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-13T10:46:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-13T10:46:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-04-13T10:46:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-04-13T10:46:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-04-13T10:46:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:28.307 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:46:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el8.noarch 2024-04-13T10:46:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-13T10:46:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-13T10:46:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-13T10:46:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-13T10:46:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-13T10:46:28.307 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-13T10:46:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-13T10:46:28.308 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:28.308 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:46:28.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2024-04-13T10:46:28.525 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:44 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:29.187 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:44 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:46:30.145 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:30.147 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:30.147 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-04-13T10:46:30.147 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:30.147 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:46:30.147 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el8 ceph-noarch 47 k 2024-04-13T10:46:30.147 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-04-13T10:46:30.147 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-13T10:46:30.147 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:46:30.148 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:30.149 INFO:teuthology.orchestra.run.smithi194.stdout:Install 13 Packages 2024-04-13T10:46:30.149 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:30.149 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 1.9 M 2024-04-13T10:46:30.149 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 25 M 2024-04-13T10:46:30.149 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:46:30.714 INFO:teuthology.orchestra.run.smithi194.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el8.noarch.rpm 329 kB/s | 47 kB 00:00 2024-04-13T10:46:30.743 INFO:teuthology.orchestra.run.smithi194.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 153 kB/s | 27 kB 00:00 2024-04-13T10:46:30.769 INFO:teuthology.orchestra.run.smithi194.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 101 kB/s | 20 kB 00:00 2024-04-13T10:46:30.825 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el8 ceph-noarch 47 k 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-13T10:46:30.827 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-04-13T10:46:30.828 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:30.829 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 1.9 M 2024-04-13T10:46:30.829 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 25 M 2024-04-13T10:46:30.829 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:46:30.844 INFO:teuthology.orchestra.run.smithi194.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 976 kB/s | 126 kB 00:00 2024-04-13T10:46:30.903 INFO:teuthology.orchestra.run.smithi194.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 822 kB/s | 110 kB 00:00 2024-04-13T10:46:30.928 INFO:teuthology.orchestra.run.smithi194.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 975 kB/s | 155 kB 00:00 2024-04-13T10:46:30.953 INFO:teuthology.orchestra.run.smithi194.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 391 kB/s | 43 kB 00:00 2024-04-13T10:46:31.112 INFO:teuthology.orchestra.run.smithi194.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 158 kB/s | 33 kB 00:00 2024-04-13T10:46:31.129 INFO:teuthology.orchestra.run.smithi194.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 81 kB/s | 16 kB 00:00 2024-04-13T10:46:31.171 INFO:teuthology.orchestra.run.smithi194.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 373 kB/s | 81 kB 00:00 2024-04-13T10:46:31.263 INFO:teuthology.orchestra.run.smithi194.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 479 kB/s | 64 kB 00:00 2024-04-13T10:46:31.288 INFO:teuthology.orchestra.run.smithi194.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 525 kB/s | 61 kB 00:00 2024-04-13T10:46:31.405 INFO:teuthology.orchestra.run.smithi194.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.0 MB/s | 1.2 MB 00:00 2024-04-13T10:46:31.408 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:31.408 INFO:teuthology.orchestra.run.smithi194.stdout:Total 1.5 MB/s | 1.9 MB 00:01 2024-04-13T10:46:31.460 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:46:31.476 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:46:31.476 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:46:31.507 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el8.noarch.rpm 637 kB/s | 47 kB 00:00 2024-04-13T10:46:31.562 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:46:31.565 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:46:31.615 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 109 kB/s | 20 kB 00:00 2024-04-13T10:46:31.641 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 127 kB/s | 27 kB 00:00 2024-04-13T10:46:31.716 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 605 kB/s | 126 kB 00:00 2024-04-13T10:46:31.741 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 876 kB/s | 110 kB 00:00 2024-04-13T10:46:31.783 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.1 MB/s | 155 kB 00:00 2024-04-13T10:46:31.833 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 363 kB/s | 43 kB 00:00 2024-04-13T10:46:32.009 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 72 kB/s | 16 kB 00:00 2024-04-13T10:46:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 113 kB/s | 33 kB 00:00 2024-04-13T10:46:32.096 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:46:32.134 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 274 kB/s | 81 kB 00:00 2024-04-13T10:46:32.190 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 412 kB/s | 64 kB 00:00 2024-04-13T10:46:32.226 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 668 kB/s | 61 kB 00:00 2024-04-13T10:46:32.313 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-04-13T10:46:32.385 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 3.1 MB/s | 1.2 MB 00:00 2024-04-13T10:46:32.387 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:32.387 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.2 MB/s | 1.9 MB 00:01 2024-04-13T10:46:32.445 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:46:32.462 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:46:32.462 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:46:32.494 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-04-13T10:46:32.548 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:46:32.552 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:46:32.763 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-04-13T10:46:32.992 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-04-13T10:46:33.061 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:46:33.217 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-04-13T10:46:33.289 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-04-13T10:46:33.449 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-04-13T10:46:33.494 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-04-13T10:46:33.754 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-04-13T10:46:33.765 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-04-13T10:46:33.985 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-04-13T10:46:34.023 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-04-13T10:46:34.233 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-04-13T10:46:34.497 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-04-13T10:46:34.806 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-04-13T10:46:35.060 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-04-13T10:46:35.065 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-04-13T10:46:35.350 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-04-13T10:46:35.613 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-04-13T10:46:35.852 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-04-13T10:46:36.032 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el8.noarch 13/13 2024-04-13T10:46:36.103 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-04-13T10:46:36.338 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el8.noarch 13/13 2024-04-13T10:46:36.338 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el8.noarch 1/13 2024-04-13T10:46:36.338 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-04-13T10:46:36.338 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-04-13T10:46:36.338 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-04-13T10:46:36.338 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-04-13T10:46:36.338 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-04-13T10:46:36.338 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-04-13T10:46:36.339 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-04-13T10:46:36.339 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-04-13T10:46:36.339 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-04-13T10:46:36.339 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-04-13T10:46:36.339 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-04-13T10:46:36.392 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-04-13T10:46:36.676 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-04-13T10:46:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-04-13T10:46:37.061 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-04-13T10:46:37.061 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:46:37.061 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:18.2.0-0.el8.noarch 2024-04-13T10:46:37.061 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-13T10:46:37.061 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-13T10:46:37.061 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-13T10:46:37.061 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-13T10:46:37.061 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-13T10:46:37.062 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-13T10:46:37.062 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-13T10:46:37.062 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-13T10:46:37.062 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-13T10:46:37.062 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-13T10:46:37.062 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-13T10:46:37.062 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-13T10:46:37.062 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:37.062 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:37.127 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el8.noarch 13/13 2024-04-13T10:46:37.196 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-cephadm 2024-04-13T10:46:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el8.noarch 13/13 2024-04-13T10:46:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el8.noarch 1/13 2024-04-13T10:46:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-04-13T10:46:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-04-13T10:46:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-04-13T10:46:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-04-13T10:46:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-04-13T10:46:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-04-13T10:46:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-04-13T10:46:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-04-13T10:46:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-04-13T10:46:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-04-13T10:46:37.403 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-04-13T10:46:37.854 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-04-13T10:46:37.854 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:18.2.0-0.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-13T10:46:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-13T10:46:37.856 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-13T10:46:37.856 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:37.856 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:46:37.932 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:53 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:38.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2024-04-13T10:46:38.744 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:53 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:46:39.551 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el8 ceph-noarch 127 k 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-13T10:46:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:39.553 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:46:39.553 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:39.553 INFO:teuthology.orchestra.run.smithi194.stdout:Install 5 Packages 2024-04-13T10:46:39.553 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:39.553 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 6.0 M 2024-04-13T10:46:39.553 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 26 M 2024-04-13T10:46:39.553 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:46:39.754 INFO:teuthology.orchestra.run.smithi194.stdout:(1/5): ceph-mgr-cephadm-18.2.0-0.el8.noarch.rpm 1.8 MB/s | 127 kB 00:00 2024-04-13T10:46:40.013 INFO:teuthology.orchestra.run.smithi194.stdout:(2/5): python3-jinja2-2.10.1-4.el8.noarch.rpm 1.7 MB/s | 578 kB 00:00 2024-04-13T10:46:40.138 INFO:teuthology.orchestra.run.smithi194.stdout:(3/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.2 MB/s | 476 kB 00:00 2024-04-13T10:46:40.221 INFO:teuthology.orchestra.run.smithi194.stdout:(4/5): python3-babel-2.5.1-7.el8.noarch.rpm 8.9 MB/s | 4.8 MB 00:00 2024-04-13T10:46:40.247 INFO:teuthology.orchestra.run.smithi194.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 258 kB/s | 60 kB 00:00 2024-04-13T10:46:40.247 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:40.247 INFO:teuthology.orchestra.run.smithi194.stdout:Total 8.6 MB/s | 6.0 MB 00:00 2024-04-13T10:46:40.298 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:46:40.309 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:46:40.309 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:46:40.385 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:40.386 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-13T10:46:40.386 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:40.386 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:46:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el8 ceph-noarch 127 k 2024-04-13T10:46:40.387 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-13T10:46:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-13T10:46:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-13T10:46:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-13T10:46:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-13T10:46:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:40.387 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:46:40.387 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:40.387 INFO:teuthology.orchestra.run.smithi134.stdout:Install 5 Packages 2024-04-13T10:46:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:40.388 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 6.0 M 2024-04-13T10:46:40.388 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 26 M 2024-04-13T10:46:40.389 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:46:40.419 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:46:40.422 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:46:40.689 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:46:40.841 INFO:teuthology.orchestra.run.smithi134.stdout:(1/5): ceph-mgr-cephadm-18.2.0-0.el8.noarch.rpm 3.8 MB/s | 127 kB 00:00 2024-04-13T10:46:40.980 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2024-04-13T10:46:41.083 INFO:teuthology.orchestra.run.smithi134.stdout:(2/5): python3-jinja2-2.10.1-4.el8.noarch.rpm 2.1 MB/s | 578 kB 00:00 2024-04-13T10:46:41.125 INFO:teuthology.orchestra.run.smithi134.stdout:(3/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.6 MB/s | 476 kB 00:00 2024-04-13T10:46:41.258 INFO:teuthology.orchestra.run.smithi134.stdout:(4/5): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2024-04-13T10:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 301 kB/s | 60 kB 00:00 2024-04-13T10:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:41.284 INFO:teuthology.orchestra.run.smithi134.stdout:Total 6.7 MB/s | 6.0 MB 00:00 2024-04-13T10:46:41.334 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:46:41.345 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:46:41.345 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:46:41.448 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:46:41.451 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:46:41.738 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:46:41.977 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2024-04-13T10:46:42.096 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2024-04-13T10:46:42.312 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2024-04-13T10:46:42.570 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 4/5 2024-04-13T10:46:42.806 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el8.noarch 5/5 2024-04-13T10:46:43.034 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2024-04-13T10:46:43.075 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el8.noarch 5/5 2024-04-13T10:46:43.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el8.noarch 1/5 2024-04-13T10:46:43.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2024-04-13T10:46:43.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/5 2024-04-13T10:46:43.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2024-04-13T10:46:43.363 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2024-04-13T10:46:43.468 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2024-04-13T10:46:43.468 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:43.468 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:46:43.468 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:18.2.0-0.el8.noarch python3-asyncssh-2.7.0-2.el8.noarch 2024-04-13T10:46:43.469 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.5.1-7.el8.noarch python3-jinja2-2.10.1-4.el8.noarch 2024-04-13T10:46:43.469 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-13T10:46:43.469 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:43.469 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 4/5 2024-04-13T10:46:43.666 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-fuse 2024-04-13T10:46:43.818 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el8.noarch 5/5 2024-04-13T10:46:44.128 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el8.noarch 5/5 2024-04-13T10:46:44.129 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el8.noarch 1/5 2024-04-13T10:46:44.129 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2024-04-13T10:46:44.129 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/5 2024-04-13T10:46:44.129 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2024-04-13T10:46:44.388 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:00 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2024-04-13T10:46:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:44.545 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:46:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:18.2.0-0.el8.noarch python3-asyncssh-2.7.0-2.el8.noarch 2024-04-13T10:46:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.5.1-7.el8.noarch python3-jinja2-2.10.1-4.el8.noarch 2024-04-13T10:46:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-13T10:46:44.545 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:44.546 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:46:44.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2024-04-13T10:46:45.458 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:00 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:46:46.024 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:46.025 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:46.025 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-04-13T10:46:46.025 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:46.025 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:46:46.025 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:18.2.0-0.el8 ceph 847 k 2024-04-13T10:46:46.025 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-04-13T10:46:46.025 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-13T10:46:46.026 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:46.026 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:46:46.026 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:46.026 INFO:teuthology.orchestra.run.smithi194.stdout:Install 2 Packages 2024-04-13T10:46:46.026 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:46.026 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 930 k 2024-04-13T10:46:46.027 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 3.0 M 2024-04-13T10:46:46.027 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:46:46.304 INFO:teuthology.orchestra.run.smithi194.stdout:(1/2): ceph-fuse-18.2.0-0.el8.x86_64.rpm 9.8 MB/s | 847 kB 00:00 2024-04-13T10:46:46.337 INFO:teuthology.orchestra.run.smithi194.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 708 kB/s | 83 kB 00:00 2024-04-13T10:46:46.338 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:46.338 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.9 MB/s | 930 kB 00:00 2024-04-13T10:46:46.348 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:46:46.370 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:46:46.370 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:46:46.457 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:46:46.460 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:46:46.668 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:46:46.957 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-13T10:46:47.097 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:18.2.0-0.el8 ceph 847 k 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:47.098 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2024-04-13T10:46:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:47.099 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 930 k 2024-04-13T10:46:47.099 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 3.0 M 2024-04-13T10:46:47.099 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:46:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:18.2.0-0.el8.x86_64 2/2 2024-04-13T10:46:47.325 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): ceph-fuse-18.2.0-0.el8.x86_64.rpm 19 MB/s | 847 kB 00:00 2024-04-13T10:46:47.425 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 575 kB/s | 83 kB 00:00 2024-04-13T10:46:47.426 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:47.426 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.8 MB/s | 930 kB 00:00 2024-04-13T10:46:47.436 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:46:47.457 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:46:47.457 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:46:47.544 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:46:47.547 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:46:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el8.x86_64 2/2 2024-04-13T10:46:47.584 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:18.2.0-0.el8.x86_64 1/2 2024-04-13T10:46:47.716 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:46:47.990 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-13T10:46:48.008 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-13T10:46:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:48.009 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:46:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:18.2.0-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-13T10:46:48.009 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:48.009 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:48.209 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:18.2.0-0.el8.x86_64 2/2 2024-04-13T10:46:48.237 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librados-devel 2024-04-13T10:46:48.604 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el8.x86_64 2/2 2024-04-13T10:46:48.604 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:18.2.0-0.el8.x86_64 1/2 2024-04-13T10:46:48.973 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:04 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-13T10:46:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:49.037 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:46:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:18.2.0-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-13T10:46:49.037 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:49.038 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:46:49.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2024-04-13T10:46:49.991 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:04 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:46:50.598 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:50.598 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:50.598 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-04-13T10:46:50.599 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:50.599 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:46:50.599 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:18.2.0-0.el8 ceph 139 k 2024-04-13T10:46:50.599 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:50.599 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:46:50.599 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:50.599 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-04-13T10:46:50.599 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:50.600 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 139 k 2024-04-13T10:46:50.600 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 513 k 2024-04-13T10:46:50.600 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:46:50.674 INFO:teuthology.orchestra.run.smithi194.stdout:librados-devel-18.2.0-0.el8.x86_64.rpm 1.8 MB/s | 139 kB 00:00 2024-04-13T10:46:50.675 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:50.675 INFO:teuthology.orchestra.run.smithi194.stdout:Total 1.8 MB/s | 139 kB 00:00 2024-04-13T10:46:50.675 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:46:50.680 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:46:50.680 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:46:50.730 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:46:50.732 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:46:50.848 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:46:51.049 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:51.354 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:51.599 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:51.600 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-13T10:46:51.600 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:51.600 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:46:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:18.2.0-0.el8 ceph 139 k 2024-04-13T10:46:51.600 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:51.600 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:46:51.601 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:51.601 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-13T10:46:51.601 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:51.601 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 139 k 2024-04-13T10:46:51.601 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 513 k 2024-04-13T10:46:51.601 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:46:51.646 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-18.2.0-0.el8.x86_64.rpm 3.0 MB/s | 139 kB 00:00 2024-04-13T10:46:51.650 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:51.651 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.9 MB/s | 139 kB 00:00 2024-04-13T10:46:51.651 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:46:51.652 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:46:51.652 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:46:51.703 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:46:51.705 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:46:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:51.758 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:46:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:18.2.0-0.el8.x86_64 2024-04-13T10:46:51.758 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:51.758 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:51.817 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:46:51.993 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs2 2024-04-13T10:46:52.740 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:08 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:53.107 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:53.829 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:53.829 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:53.829 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:46:53.829 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:18.2.0-0.el8.x86_64 2024-04-13T10:46:53.829 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:53.829 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:46:54.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2024-04-13T10:46:54.335 INFO:teuthology.orchestra.run.smithi194.stdout:Package libcephfs2-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:46:54.383 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:54.384 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-04-13T10:46:54.384 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:54.485 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs-devel 2024-04-13T10:46:54.848 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:09 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:46:55.211 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:11 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:56.406 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:46:56.454 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:56.455 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-13T10:46:56.455 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:46:56.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2024-04-13T10:46:56.835 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:18.2.0-0.el8 ceph 30 k 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:56.836 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 30 k 2024-04-13T10:46:56.837 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 137 k 2024-04-13T10:46:56.837 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:46:56.904 INFO:teuthology.orchestra.run.smithi194.stdout:libcephfs-devel-18.2.0-0.el8.x86_64.rpm 453 kB/s | 30 kB 00:00 2024-04-13T10:46:56.904 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:56.904 INFO:teuthology.orchestra.run.smithi194.stdout:Total 445 kB/s | 30 kB 00:00 2024-04-13T10:46:56.905 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:46:56.908 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:46:56.908 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:46:56.933 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:46:56.936 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:46:56.998 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:46:57.206 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:57.308 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:12 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:46:57.467 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:57.813 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:46:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:18.2.0-0.el8.x86_64 2024-04-13T10:46:57.813 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:46:57.813 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:46:57.937 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librados2 2024-04-13T10:46:58.662 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:14 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:46:58.958 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:46:58.958 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-13T10:46:58.958 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:58.959 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:46:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:18.2.0-0.el8 ceph 30 k 2024-04-13T10:46:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:58.959 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:46:58.959 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:46:58.959 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-13T10:46:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:46:58.959 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 30 k 2024-04-13T10:46:58.960 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 137 k 2024-04-13T10:46:58.960 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:46:59.251 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-18.2.0-0.el8.x86_64.rpm 104 kB/s | 30 kB 00:00 2024-04-13T10:46:59.252 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:46:59.252 INFO:teuthology.orchestra.run.smithi134.stdout:Total 104 kB/s | 30 kB 00:00 2024-04-13T10:46:59.252 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:46:59.256 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:46:59.256 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:46:59.278 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:46:59.281 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:46:59.341 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:46:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:46:59.815 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:00.190 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:00.191 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:00.191 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:47:00.191 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:18.2.0-0.el8.x86_64 2024-04-13T10:47:00.191 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:00.191 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:47:00.254 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:00.302 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:47:00.304 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-04-13T10:47:00.304 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:47:00.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2024-04-13T10:47:00.405 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librbd1 2024-04-13T10:47:01.057 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:16 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:47:01.134 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:17 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:47:02.623 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:02.671 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:47:02.672 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-13T10:47:02.673 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:47:02.711 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:02.759 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:47:02.760 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-04-13T10:47:02.760 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:47:02.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2024-04-13T10:47:02.893 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rados 2024-04-13T10:47:03.515 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:18 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:47:03.625 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:19 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:47:05.100 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:05.148 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:47:05.149 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-13T10:47:05.149 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:47:05.199 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rados-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:05.246 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:47:05.246 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-04-13T10:47:05.247 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:47:05.260 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2024-04-13T10:47:05.350 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rgw 2024-04-13T10:47:05.986 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:20 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:47:06.078 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:22 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:47:07.598 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:07.646 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:47:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-13T10:47:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:47:07.671 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rgw-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:07.719 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:47:07.720 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-04-13T10:47:07.720 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:47:07.775 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2024-04-13T10:47:07.826 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-cephfs 2024-04-13T10:47:08.509 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:23 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:47:08.554 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:24 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:47:10.056 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:10.106 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:47:10.107 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-13T10:47:10.107 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:47:10.108 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-cephfs-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:10.156 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:47:10.157 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-04-13T10:47:10.157 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:47:10.240 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2024-04-13T10:47:10.264 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rbd 2024-04-13T10:47:10.967 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:25 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:47:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:26 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:47:12.534 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:12.564 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rbd-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:12.582 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:47:12.583 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-13T10:47:12.583 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:47:12.611 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:47:12.612 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-04-13T10:47:12.612 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:47:12.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2024-04-13T10:47:12.720 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-fuse 2024-04-13T10:47:13.430 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:28 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:47:13.448 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:29 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:47:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:18.2.0-0.el8.x86_64 is already installed. 2024-04-13T10:47:15.075 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:47:15.076 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-04-13T10:47:15.076 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:47:15.093 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:47:15.094 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:47:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-04-13T10:47:15.094 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:47:15.094 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:47:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:18.2.0-0.el8 ceph 94 k 2024-04-13T10:47:15.094 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:15.094 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:47:15.094 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:47:15.094 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-04-13T10:47:15.095 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:15.095 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 94 k 2024-04-13T10:47:15.095 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 276 k 2024-04-13T10:47:15.095 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:47:15.310 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-fuse-18.2.0-0.el8.x86_64.rpm 438 kB/s | 94 kB 00:00 2024-04-13T10:47:15.311 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:47:15.311 INFO:teuthology.orchestra.run.smithi194.stdout:Total 436 kB/s | 94 kB 00:00 2024-04-13T10:47:15.311 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:47:15.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2024-04-13T10:47:15.321 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:47:15.321 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:47:15.370 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:47:15.373 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:47:15.480 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:47:15.703 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:15.974 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:16.037 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:31 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:47:16.402 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:16.402 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:16.402 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:47:16.402 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:18.2.0-0.el8.x86_64 2024-04-13T10:47:16.402 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:16.402 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:47:16.621 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-mirror 2024-04-13T10:47:17.362 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:33 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:47:17.678 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:47:17.678 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:47:17.678 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-13T10:47:17.679 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:47:17.679 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:47:17.679 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:18.2.0-0.el8 ceph 94 k 2024-04-13T10:47:17.679 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:17.679 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:47:17.679 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:47:17.679 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-13T10:47:17.679 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:17.680 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 94 k 2024-04-13T10:47:17.680 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 276 k 2024-04-13T10:47:17.680 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:47:17.744 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-18.2.0-0.el8.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-13T10:47:17.745 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:47:17.745 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.4 MB/s | 94 kB 00:00 2024-04-13T10:47:17.745 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:47:17.756 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:47:17.756 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:47:17.804 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:47:17.807 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:47:17.914 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:47:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:18.433 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:18.809 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:47:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:18.2.0-0.el8.x86_64 2024-04-13T10:47:18.809 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:18.809 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:47:18.997 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:47:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:47:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-04-13T10:47:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:47:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:47:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:18.2.0-0.el8 ceph 3.4 M 2024-04-13T10:47:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:47:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:47:18.998 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-04-13T10:47:18.998 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:18.999 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 3.4 M 2024-04-13T10:47:18.999 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 16 M 2024-04-13T10:47:18.999 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:47:19.069 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2024-04-13T10:47:19.140 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-mirror-18.2.0-0.el8.x86_64.rpm 24 MB/s | 3.4 MB 00:00 2024-04-13T10:47:19.141 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:47:19.141 INFO:teuthology.orchestra.run.smithi194.stdout:Total 24 MB/s | 3.4 MB 00:00 2024-04-13T10:47:19.142 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:47:19.154 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:47:19.154 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:47:19.215 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:47:19.218 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:47:19.652 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:47:19.811 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:34 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:47:19.878 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:20.297 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:20.679 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:20.680 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:20.680 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:47:20.680 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:18.2.0-0.el8.x86_64 2024-04-13T10:47:20.680 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:20.680 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:47:20.923 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-nbd 2024-04-13T10:47:21.412 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:47:21.413 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:47:21.413 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-13T10:47:21.413 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:47:21.413 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:47:21.413 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:18.2.0-0.el8 ceph 3.4 M 2024-04-13T10:47:21.413 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:21.413 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:47:21.413 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:47:21.414 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-13T10:47:21.414 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:21.414 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.4 M 2024-04-13T10:47:21.414 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 16 M 2024-04-13T10:47:21.414 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:47:21.509 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-18.2.0-0.el8.x86_64.rpm 36 MB/s | 3.4 MB 00:00 2024-04-13T10:47:21.510 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:47:21.510 INFO:teuthology.orchestra.run.smithi134.stdout:Total 35 MB/s | 3.4 MB 00:00 2024-04-13T10:47:21.511 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:47:21.522 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:47:21.523 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:47:21.583 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:47:21.586 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:47:21.663 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:37 ago on Sat 13 Apr 2024 10:44:44 AM UTC. 2024-04-13T10:47:22.060 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:47:22.245 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:22.666 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:23.027 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:47:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:18.2.0-0.el8.x86_64 2024-04-13T10:47:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:23.027 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:47:23.275 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-04-13T10:47:23.275 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:47:23.276 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-04-13T10:47:23.276 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:47:23.276 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-04-13T10:47:23.276 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:18.2.0-0.el8 ceph 179 k 2024-04-13T10:47:23.276 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:23.276 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-04-13T10:47:23.276 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-04-13T10:47:23.276 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-04-13T10:47:23.276 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:23.277 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 179 k 2024-04-13T10:47:23.277 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 564 k 2024-04-13T10:47:23.277 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-04-13T10:47:23.289 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2024-04-13T10:47:23.351 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-nbd-18.2.0-0.el8.x86_64.rpm 2.4 MB/s | 179 kB 00:00 2024-04-13T10:47:23.352 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:47:23.352 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.3 MB/s | 179 kB 00:00 2024-04-13T10:47:23.352 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-04-13T10:47:23.363 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-04-13T10:47:23.363 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-04-13T10:47:23.414 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-04-13T10:47:23.417 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-04-13T10:47:23.532 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-04-13T10:47:23.743 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:24.029 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:39 ago on Sat 13 Apr 2024 10:44:45 AM UTC. 2024-04-13T10:47:24.048 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:24.457 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:24.457 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:24.457 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-04-13T10:47:24.457 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:18.2.0-0.el8.x86_64 2024-04-13T10:47:24.457 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:47:24.457 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-04-13T10:47:24.731 DEBUG:teuthology.parallel:result is None 2024-04-13T10:47:25.642 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-13T10:47:25.643 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:47:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-13T10:47:25.643 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:47:25.643 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-13T10:47:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:18.2.0-0.el8 ceph 179 k 2024-04-13T10:47:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:25.643 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-13T10:47:25.644 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-13T10:47:25.644 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-04-13T10:47:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:25.646 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 179 k 2024-04-13T10:47:25.646 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 564 k 2024-04-13T10:47:25.646 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-13T10:47:25.874 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-18.2.0-0.el8.x86_64.rpm 788 kB/s | 179 kB 00:00 2024-04-13T10:47:25.875 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:47:25.875 INFO:teuthology.orchestra.run.smithi134.stdout:Total 784 kB/s | 179 kB 00:00 2024-04-13T10:47:25.875 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-13T10:47:25.886 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-13T10:47:25.886 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-13T10:47:25.937 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-13T10:47:25.940 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-13T10:47:26.057 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-13T10:47:26.279 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:26.555 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:18.2.0-0.el8.x86_64 1/1 2024-04-13T10:47:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:26.947 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-13T10:47:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:18.2.0-0.el8.x86_64 2024-04-13T10:47:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:26.947 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-13T10:47:27.239 DEBUG:teuthology.parallel:result is None 2024-04-13T10:47:27.240 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-13T10:47:27.240 INFO:teuthology.packaging:ref: None 2024-04-13T10:47:27.240 INFO:teuthology.packaging:tag: v18.2.0 2024-04-13T10:47:27.240 INFO:teuthology.packaging:branch: None 2024-04-13T10:47:27.240 INFO:teuthology.packaging:sha1: 5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:47:27.241 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-04-13T10:47:27.457 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-13T10:47:27.480 INFO:teuthology.orchestra.run.smithi134.stdout:18.2.0-0.el8 2024-04-13T10:47:27.481 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el8 2024-04-13T10:47:27.481 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-04-13T10:47:27.483 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-04-13T10:47:27.483 INFO:teuthology.packaging:ref: None 2024-04-13T10:47:27.483 INFO:teuthology.packaging:tag: v18.2.0 2024-04-13T10:47:27.483 INFO:teuthology.packaging:branch: None 2024-04-13T10:47:27.483 INFO:teuthology.packaging:sha1: 5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:47:27.483 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-04-13T10:47:27.696 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-13T10:47:27.723 INFO:teuthology.orchestra.run.smithi194.stdout:18.2.0-0.el8 2024-04-13T10:47:27.723 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el8 2024-04-13T10:47:27.723 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-04-13T10:47:27.725 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-13T10:47:27.725 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:47:27.726 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-13T10:47:27.754 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:47:27.754 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-13T10:47:27.795 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-13T10:47:27.795 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:47:27.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-04-13T10:47:27.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-13T10:47:27.888 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:47:27.888 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-04-13T10:47:27.917 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-13T10:47:27.986 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-13T10:47:27.987 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:47:27.987 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-13T10:47:28.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-13T10:47:28.080 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:47:28.080 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-13T10:47:28.108 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-13T10:47:28.176 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-13T10:47:28.177 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:47:28.177 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-04-13T10:47:28.203 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-13T10:47:28.270 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:47:28.270 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-04-13T10:47:28.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-13T10:47:28.365 INFO:teuthology.run_tasks:Running task print... 2024-04-13T10:47:28.393 INFO:teuthology.task.print:**** done install task... 2024-04-13T10:47:28.393 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-13T10:47:28.511 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '5108bc67b831101bc32a1061150595384640c56c'} 2024-04-13T10:47:28.511 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-04-13T10:47:28.511 INFO:tasks.cephadm:Cluster fsid is 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:47:28.511 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-13T10:47:28.511 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-13T10:47:28.511 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi134': '172.21.15.134', 'mon.smithi194': '172.21.15.194'} 2024-04-13T10:47:28.512 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-13T10:47:28.512 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-04-13T10:47:28.539 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname $(hostname -s) 2024-04-13T10:47:28.568 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-13T10:47:28.568 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:47:28.787 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '5108bc67b831101bc32a1061150595384640c56c', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/54847/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1173-g5108bc67', 'node_name': '172.21.4.65+confusa03', 'job_name': 'ceph-dev-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1173.g5108bc67'}, 'url': 'https://1.chacra.ceph.com/r/ceph/reef/5108bc67b831101bc32a1061150595384640c56c/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-04-08 00:10:22.854547', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/reef/5108bc67b831101bc32a1061150595384640c56c/centos/8/flavors/default/', 'archs': ['source', 'x86_64', 'arm64'], 'distro': 'centos'}] 2024-04-13T10:47:28.924 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref reef, sha1 5108bc67b831101bc32a1061150595384640c56c from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:47:28.926 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/reef/5108bc67b831101bc32a1061150595384640c56c/centos/8/x86_64/flavors/default/cephadm 2024-04-13T10:47:28.926 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/5108bc67b831101bc32a1061150595384640c56c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-13T10:47:29.354 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Apr 13 10:47 /home/ubuntu/cephtest/cephadm 2024-04-13T10:47:29.354 DEBUG:teuthology.orchestra.run.smithi194:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/5108bc67b831101bc32a1061150595384640c56c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-13T10:47:29.781 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Apr 13 10:47 /home/ubuntu/cephtest/cephadm 2024-04-13T10:47:29.782 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-13T10:47:29.805 DEBUG:teuthology.orchestra.run.smithi194:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-13T10:47:29.840 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-04-13T10:47:29.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-04-13T10:47:29.847 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-04-13T10:47:31.120 INFO:teuthology.orchestra.run.smithi194.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-04-13T10:47:31.141 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-04-13T10:47:49.032 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-13T10:47:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-04-13T10:47:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-04-13T10:47:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: "repo_digests": [ 2024-04-13T10:47:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-04-13T10:47:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-04-13T10:47:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-04-13T10:47:49.033 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-13T10:47:49.427 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:47:49.495 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-04-13T10:47:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-04-13T10:47:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-04-13T10:47:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-04-13T10:47:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-04-13T10:47:49.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-13T10:47:49.496 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:47:49.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-04-13T10:47:49.527 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph 2024-04-13T10:47:49.561 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-04-13T10:47:49.594 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /etc/ceph 2024-04-13T10:47:49.628 INFO:tasks.cephadm:Writing seed config... 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-13T10:47:49.630 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-13T10:47:49.631 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-13T10:47:49.632 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-13T10:47:49.633 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:47:49.633 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-13T10:47:49.652 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 38dd2ea8-f983-11ee-bc8d-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-13T10:47:49.652 DEBUG:teuthology.orchestra.run.smithi134:mon.smithi134> sudo journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi134.service 2024-04-13T10:47:49.695 INFO:tasks.cephadm:Bootstrapping... 2024-04-13T10:47:49.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.134 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-13T10:47:49.721 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:-- Logs begin at Sat 2024-04-13 10:37:50 UTC. -- 2024-04-13T10:47:49.853 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-13T10:47:49.853 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', '38dd2ea8-f983-11ee-bc8d-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.134', '--skip-admin-label'] 2024-04-13T10:47:49.885 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-13T10:47:49.885 INFO:teuthology.orchestra.run.smithi134.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-13T10:47:49.885 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying podman|docker is present... 2024-04-13T10:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-13T10:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying lvm2 is present... 2024-04-13T10:47:49.914 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying time synchronization is in place... 2024-04-13T10:47:49.922 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-13T10:47:49.922 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-13T10:47:49.927 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-13T10:47:49.927 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-04-13T10:47:49.933 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout enabled 2024-04-13T10:47:49.939 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout active 2024-04-13T10:47:49.939 INFO:teuthology.orchestra.run.smithi134.stdout:Unit chronyd.service is enabled and running 2024-04-13T10:47:49.939 INFO:teuthology.orchestra.run.smithi134.stdout:Repeating the final host check... 2024-04-13T10:47:49.971 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-13T10:47:49.971 INFO:teuthology.orchestra.run.smithi134.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-13T10:47:49.971 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl is present 2024-04-13T10:47:49.972 INFO:teuthology.orchestra.run.smithi134.stdout:lvcreate is present 2024-04-13T10:47:49.977 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-13T10:47:49.977 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-13T10:47:49.983 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-13T10:47:49.983 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-04-13T10:47:49.989 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout enabled 2024-04-13T10:47:49.995 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout active 2024-04-13T10:47:49.995 INFO:teuthology.orchestra.run.smithi134.stdout:Unit chronyd.service is enabled and running 2024-04-13T10:47:49.995 INFO:teuthology.orchestra.run.smithi134.stdout:Host looks OK 2024-04-13T10:47:49.995 INFO:teuthology.orchestra.run.smithi134.stdout:Cluster fsid: 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:47:49.995 INFO:teuthology.orchestra.run.smithi134.stdout:Acquiring lock 140092667570664 on /run/cephadm/38dd2ea8-f983-11ee-bc8d-c7b262605968.lock 2024-04-13T10:47:49.995 INFO:teuthology.orchestra.run.smithi134.stdout:Lock 140092667570664 acquired on /run/cephadm/38dd2ea8-f983-11ee-bc8d-c7b262605968.lock 2024-04-13T10:47:49.998 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying IP 172.21.15.134 port 3300 ... 2024-04-13T10:47:49.998 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying IP 172.21.15.134 port 6789 ... 2024-04-13T10:47:49.998 INFO:teuthology.orchestra.run.smithi134.stdout:Base mon IP(s) is [172.21.15.134:3300, 172.21.15.134:6789], mon addrv is [v2:172.21.15.134:3300,v1:172.21.15.134:6789] 2024-04-13T10:47:50.000 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.134 metric 100 2024-04-13T10:47:50.000 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.134 metric 100 2024-04-13T10:47:50.002 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-13T10:47:50.002 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-13T10:47:50.003 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1783sec hoplimit 64 pref medium 2024-04-13T10:47:50.005 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-13T10:47:50.005 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-13T10:47:50.005 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-13T10:47:50.005 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-13T10:47:50.005 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-04-13T10:47:50.005 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-13T10:47:50.006 INFO:teuthology.orchestra.run.smithi134.stdout:Mon IP `172.21.15.134` is in CIDR network `172.21.0.0/20` 2024-04-13T10:47:50.006 INFO:teuthology.orchestra.run.smithi134.stdout:Mon IP `172.21.15.134` is in CIDR network `172.21.0.0/20` 2024-04-13T10:47:50.006 INFO:teuthology.orchestra.run.smithi134.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-13T10:47:50.007 INFO:teuthology.orchestra.run.smithi134.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-13T10:47:50.008 INFO:teuthology.orchestra.run.smithi134.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-04-13T10:47:50.788 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-04-13T10:47:50.903 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-04-13T10:47:50.903 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Getting image source signatures 2024-04-13T10:47:50.903 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-04-13T10:47:50.903 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-04-13T10:47:50.903 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-04-13T10:47:50.903 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-13T10:47:52.094 INFO:teuthology.orchestra.run.smithi134.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-04-13T10:47:52.094 INFO:teuthology.orchestra.run.smithi134.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-04-13T10:47:52.094 INFO:teuthology.orchestra.run.smithi134.stdout:Extracting ceph user uid/gid from container image... 2024-04-13T10:47:53.182 INFO:teuthology.orchestra.run.smithi134.stdout:stat: stdout 167 167 2024-04-13T10:47:53.183 INFO:teuthology.orchestra.run.smithi134.stdout:Creating initial keys... 2024-04-13T10:47:54.345 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph-authtool: stdout AQDZYhpmuEAFJxAAzVrru/0ISgbIVh1Fm/rgHQ== 2024-04-13T10:47:55.510 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph-authtool: stdout AQDaYhpmuY1zLhAABLcnUw6PGt6+o2zVWGkQbQ== 2024-04-13T10:47:56.570 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph-authtool: stdout AQDbYhpmX+XFORAAXTlTw7BR+yp0RdAXhXzCpA== 2024-04-13T10:47:56.570 INFO:teuthology.orchestra.run.smithi134.stdout:Creating initial monmap... 2024-04-13T10:47:58.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-13T10:47:58.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-04-13T10:47:58.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:47:58.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-13T10:47:58.094 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool for smithi134 [v2:172.21.15.134:3300,v1:172.21.15.134:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-13T10:47:58.095 INFO:teuthology.orchestra.run.smithi134.stdout:setting min_mon_release = pacific 2024-04-13T10:47:58.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: set fsid to 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:47:58.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-13T10:47:58.095 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:47:58.095 INFO:teuthology.orchestra.run.smithi134.stdout:Creating mon... 2024-04-13T10:47:59.278 INFO:teuthology.orchestra.run.smithi134.stdout:create mon.smithi134 on 2024-04-13T10:47:59.409 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-04-13T10:47:59.498 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-13T10:47:59.622 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968.target → /etc/systemd/system/ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968.target. 2024-04-13T10:47:59.622 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968.target → /etc/systemd/system/ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968.target. 2024-04-13T10:47:59.825 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi134 2024-04-13T10:47:59.825 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to reset failed state of unit ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi134.service: Unit ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi134.service not loaded. 2024-04-13T10:47:59.916 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968.target.wants/ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi134.service → /etc/systemd/system/ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@.service. 2024-04-13T10:48:00.597 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-13T10:48:00.597 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-04-13T10:48:00.604 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-13T10:48:00.604 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-04-13T10:48:00.604 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-04-13T10:48:00.604 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to enable service . firewalld.service is not available 2024-04-13T10:48:00.605 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mon to start... 2024-04-13T10:48:00.605 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mon... 2024-04-13T10:48:00.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:00 smithi134 bash[39168]: 54aea47a987ea9094d0da3f3f301da09eb48d751a4b6b3fa299678f5faf1d60c 2024-04-13T10:48:00.837 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:00 smithi134 systemd[1]: Started Ceph mon.smithi134 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T10:48:01.935 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout cluster: 2024-04-13T10:48:01.935 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout id: 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:48:01.935 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-13T10:48:01.935 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout services: 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi134 (age 0.705004s) 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout data: 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout pgs: 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.173+0000 7f98009ba700 1 Processor -- start 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.173+0000 7f98009ba700 1 -- start start 2024-04-13T10:48:01.936 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.173+0000 7f98009ba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc108810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:01.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:01 smithi134 ceph-mon[39206]: mon.smithi134 is new leader, mons smithi134 in quorum (ranks 0) 2024-04-13T10:48:01.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:01 smithi134 ceph-mon[39206]: monmap e1: 1 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} 2024-04-13T10:48:01.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:01 smithi134 ceph-mon[39206]: fsmap 2024-04-13T10:48:01.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:01 smithi134 ceph-mon[39206]: osdmap e1: 0 total, 0 up, 0 in 2024-04-13T10:48:01.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:01 smithi134 ceph-mon[39206]: mgrmap e1: no daemons active 2024-04-13T10:48:01.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:01 smithi134 ceph-mon[39206]: from='client.? 172.21.15.134:0/809089038' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-13T10:48:01.942 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.173+0000 7f98009ba700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc079d10 con 0x7f97fc106430 2024-04-13T10:48:01.942 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.174+0000 7f97fa59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc108810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:01.942 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.174+0000 7f97fa59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc108810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50714/0 (socket says 172.21.15.134:50714) 2024-04-13T10:48:01.942 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.174+0000 7f97fa59c700 1 -- 172.21.15.134:0/1841790678 learned_addr learned my addr 172.21.15.134:0/1841790678 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:01.942 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.174+0000 7f97fa59c700 1 -- 172.21.15.134:0/1841790678 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc079e50 con 0x7f97fc106430 2024-04-13T10:48:01.942 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.174+0000 7f97fa59c700 1 --2- 172.21.15.134:0/1841790678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc108810 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f97f00098a0 tx=0x7f97f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a644665b1045146 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.174+0000 7f97f959a700 1 -- 172.21.15.134:0/1841790678 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97f0004180 con 0x7f97fc106430 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.174+0000 7f97f959a700 1 -- 172.21.15.134:0/1841790678 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f00042e0 con 0x7f97fc106430 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.174+0000 7f97f959a700 1 -- 172.21.15.134:0/1841790678 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97f00036a0 con 0x7f97fc106430 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.175+0000 7f98009ba700 1 -- 172.21.15.134:0/1841790678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 msgr2=0x7f97fc108810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.175+0000 7f98009ba700 1 --2- 172.21.15.134:0/1841790678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc108810 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f97f00098a0 tx=0x7f97f0009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.175+0000 7f98009ba700 1 -- 172.21.15.134:0/1841790678 shutdown_connections 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.175+0000 7f98009ba700 1 --2- 172.21.15.134:0/1841790678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc108810 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.175+0000 7f98009ba700 1 -- 172.21.15.134:0/1841790678 >> 172.21.15.134:0/1841790678 conn(0x7f97fc0ffe30 msgr2=0x7f97fc102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.175+0000 7f98009ba700 1 -- 172.21.15.134:0/1841790678 shutdown_connections 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.175+0000 7f98009ba700 1 -- 172.21.15.134:0/1841790678 wait complete. 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.176+0000 7f98009ba700 1 Processor -- start 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.176+0000 7f98009ba700 1 -- start start 2024-04-13T10:48:01.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.176+0000 7f98009ba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.176+0000 7f98009ba700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc1992d0 con 0x7f97fc106430 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.176+0000 7f97fa59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.176+0000 7f97fa59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50724/0 (socket says 172.21.15.134:50724) 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.176+0000 7f97fa59c700 1 -- 172.21.15.134:0/809089038 learned_addr learned my addr 172.21.15.134:0/809089038 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.176+0000 7f97fa59c700 1 -- 172.21.15.134:0/809089038 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f0009550 con 0x7f97fc106430 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.176+0000 7f97fa59c700 1 --2- 172.21.15.134:0/809089038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc198d90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f97f0004000 tx=0x7f97f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.177+0000 7f97eb7fe700 1 -- 172.21.15.134:0/809089038 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97f0003ce0 con 0x7f97fc106430 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.177+0000 7f97eb7fe700 1 -- 172.21.15.134:0/809089038 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f0020070 con 0x7f97fc106430 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.177+0000 7f98009ba700 1 -- 172.21.15.134:0/809089038 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97fc1994d0 con 0x7f97fc106430 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.177+0000 7f97eb7fe700 1 -- 172.21.15.134:0/809089038 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97f0011630 con 0x7f97fc106430 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.177+0000 7f98009ba700 1 -- 172.21.15.134:0/809089038 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97fc1998f0 con 0x7f97fc106430 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.177+0000 7f97eb7fe700 1 -- 172.21.15.134:0/809089038 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f97f0022030 con 0x7f97fc106430 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.177+0000 7f97eb7fe700 1 -- 172.21.15.134:0/809089038 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f97f0025d40 con 0x7f97fc106430 2024-04-13T10:48:01.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.178+0000 7f98009ba700 1 -- 172.21.15.134:0/809089038 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97fc192ba0 con 0x7f97fc106430 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.180+0000 7f97eb7fe700 1 -- 172.21.15.134:0/809089038 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f97f0025480 con 0x7f97fc106430 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.250+0000 7f98009ba700 1 -- 172.21.15.134:0/809089038 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f97fc02cea0 con 0x7f97fc106430 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.250+0000 7f97eb7fe700 1 -- 172.21.15.134:0/809089038 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f97f0036070 con 0x7f97fc106430 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.251+0000 7f98009ba700 1 -- 172.21.15.134:0/809089038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 msgr2=0x7f97fc198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.251+0000 7f98009ba700 1 --2- 172.21.15.134:0/809089038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc198d90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f97f0004000 tx=0x7f97f0004750 comp rx=0 tx=0).stop 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.251+0000 7f98009ba700 1 -- 172.21.15.134:0/809089038 shutdown_connections 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.251+0000 7f98009ba700 1 --2- 172.21.15.134:0/809089038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97fc106430 0x7f97fc198d90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.251+0000 7f98009ba700 1 -- 172.21.15.134:0/809089038 >> 172.21.15.134:0/809089038 conn(0x7f97fc0ffe30 msgr2=0x7f97fc101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.251+0000 7f98009ba700 1 -- 172.21.15.134:0/809089038 shutdown_connections 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:01.251+0000 7f98009ba700 1 -- 172.21.15.134:0/809089038 wait complete. 2024-04-13T10:48:01.945 INFO:teuthology.orchestra.run.smithi134.stdout:mon is available 2024-04-13T10:48:01.946 INFO:teuthology.orchestra.run.smithi134.stdout:Assimilating anything we can from ceph.conf... 2024-04-13T10:48:02.920 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:02 smithi134 ceph-mon[39206]: from='client.? 172.21.15.134:0/2056129945' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-13T10:48:02.920 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:02 smithi134 ceph-mon[39206]: from='client.? 172.21.15.134:0/2056129945' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-13T10:48:03.171 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:03.171 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [global] 2024-04-13T10:48:03.171 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout fsid = 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:48:03.171 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.134:3300,v1:172.21.15.134:6789] 2024-04-13T10:48:03.171 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-13T10:48:03.171 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [osd] 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.483+0000 7f3cd0943700 1 Processor -- start 2024-04-13T10:48:03.172 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.483+0000 7f3cd0943700 1 -- start start 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.483+0000 7f3cd0943700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc1087e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.483+0000 7f3cd0943700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc079d30 con 0x7f3ccc106400 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.484+0000 7f3cca59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc1087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.484+0000 7f3cca59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc1087e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50740/0 (socket says 172.21.15.134:50740) 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.484+0000 7f3cca59c700 1 -- 172.21.15.134:0/3795898075 learned_addr learned my addr 172.21.15.134:0/3795898075 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.484+0000 7f3cca59c700 1 -- 172.21.15.134:0/3795898075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc079e70 con 0x7f3ccc106400 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.484+0000 7f3cca59c700 1 --2- 172.21.15.134:0/3795898075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc1087e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00098a0 tx=0x7f3cc0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fc4898b615b9f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.484+0000 7f3cc959a700 1 -- 172.21.15.134:0/3795898075 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3cc0004180 con 0x7f3ccc106400 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.484+0000 7f3cc959a700 1 -- 172.21.15.134:0/3795898075 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc00042e0 con 0x7f3ccc106400 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.484+0000 7f3cc959a700 1 -- 172.21.15.134:0/3795898075 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3cc00036a0 con 0x7f3ccc106400 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.485+0000 7f3cd0943700 1 -- 172.21.15.134:0/3795898075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 msgr2=0x7f3ccc1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.485+0000 7f3cd0943700 1 --2- 172.21.15.134:0/3795898075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc1087e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00098a0 tx=0x7f3cc0009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:03.173 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.485+0000 7f3cd0943700 1 -- 172.21.15.134:0/3795898075 shutdown_connections 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.485+0000 7f3cd0943700 1 --2- 172.21.15.134:0/3795898075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc1087e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.485+0000 7f3cd0943700 1 -- 172.21.15.134:0/3795898075 >> 172.21.15.134:0/3795898075 conn(0x7f3ccc0ffe00 msgr2=0x7f3ccc102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.485+0000 7f3cd0943700 1 -- 172.21.15.134:0/3795898075 shutdown_connections 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.485+0000 7f3cd0943700 1 -- 172.21.15.134:0/3795898075 wait complete. 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.486+0000 7f3cd0943700 1 Processor -- start 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.486+0000 7f3cd0943700 1 -- start start 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.486+0000 7f3cd0943700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.486+0000 7f3cd0943700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc199280 con 0x7f3ccc106400 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.486+0000 7f3cca59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.486+0000 7f3cca59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50752/0 (socket says 172.21.15.134:50752) 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.486+0000 7f3cca59c700 1 -- 172.21.15.134:0/2056129945 learned_addr learned my addr 172.21.15.134:0/2056129945 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.487+0000 7f3cca59c700 1 -- 172.21.15.134:0/2056129945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc0009550 con 0x7f3ccc106400 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.487+0000 7f3cca59c700 1 --2- 172.21.15.134:0/2056129945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc198d40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0004000 tx=0x7f3cc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.487+0000 7f3cbb7fe700 1 -- 172.21.15.134:0/2056129945 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3cc0003ce0 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.487+0000 7f3cbb7fe700 1 -- 172.21.15.134:0/2056129945 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc0020070 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.487+0000 7f3cbb7fe700 1 -- 172.21.15.134:0/2056129945 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3cc0011630 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.487+0000 7f3cd0943700 1 -- 172.21.15.134:0/2056129945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc1994e0 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.487+0000 7f3cd0943700 1 -- 172.21.15.134:0/2056129945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc199960 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.487+0000 7f3cbb7fe700 1 -- 172.21.15.134:0/2056129945 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3cc0022030 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.487+0000 7f3cbb7fe700 1 -- 172.21.15.134:0/2056129945 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3cc0025cf0 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.488+0000 7f3cd0943700 1 -- 172.21.15.134:0/2056129945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc192b30 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.490+0000 7f3cbb7fe700 1 -- 172.21.15.134:0/2056129945 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f3cc0025480 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.558+0000 7f3cd0943700 1 -- 172.21.15.134:0/2056129945 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3ccc02ce00 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.561+0000 7f3cbb7fe700 1 -- 172.21.15.134:0/2056129945 <== mon.0 v2:172.21.15.134:3300/0 7 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f3cc0011c20 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.561+0000 7f3cbb7fe700 1 -- 172.21.15.134:0/2056129945 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f3cc001c450 con 0x7f3ccc106400 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.562+0000 7f3cd0943700 1 -- 172.21.15.134:0/2056129945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 msgr2=0x7f3ccc198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.562+0000 7f3cd0943700 1 --2- 172.21.15.134:0/2056129945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc198d40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0004000 tx=0x7f3cc0004750 comp rx=0 tx=0).stop 2024-04-13T10:48:03.176 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.562+0000 7f3cd0943700 1 -- 172.21.15.134:0/2056129945 shutdown_connections 2024-04-13T10:48:03.176 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.562+0000 7f3cd0943700 1 --2- 172.21.15.134:0/2056129945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc106400 0x7f3ccc198d40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:03.176 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.562+0000 7f3cd0943700 1 -- 172.21.15.134:0/2056129945 >> 172.21.15.134:0/2056129945 conn(0x7f3ccc0ffe00 msgr2=0x7f3ccc101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:03.176 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.562+0000 7f3cd0943700 1 -- 172.21.15.134:0/2056129945 shutdown_connections 2024-04-13T10:48:03.176 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:02.562+0000 7f3cd0943700 1 -- 172.21.15.134:0/2056129945 wait complete. 2024-04-13T10:48:03.176 INFO:teuthology.orchestra.run.smithi134.stdout:Generating new minimal ceph.conf... 2024-04-13T10:48:04.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:03 smithi134 ceph-mon[39206]: from='client.? 172.21.15.134:0/2947670283' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:48:04.462 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.709+0000 7efceaf44700 1 Processor -- start 2024-04-13T10:48:04.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.709+0000 7efceaf44700 1 -- start start 2024-04-13T10:48:04.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.709+0000 7efceaf44700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce41050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.709+0000 7efceaf44700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce41055f0 con 0x7efce4104ca0 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.709+0000 7efce8ce0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce41050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.709+0000 7efce8ce0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce41050b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50768/0 (socket says 172.21.15.134:50768) 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.709+0000 7efce8ce0700 1 -- 172.21.15.134:0/645394259 learned_addr learned my addr 172.21.15.134:0/645394259 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.710+0000 7efce8ce0700 1 -- 172.21.15.134:0/645394259 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4105730 con 0x7efce4104ca0 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.710+0000 7efce8ce0700 1 --2- 172.21.15.134:0/645394259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce41050b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efcd80098a0 tx=0x7efcd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb88949319a12e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.710+0000 7efce37fe700 1 -- 172.21.15.134:0/645394259 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcd8004180 con 0x7efce4104ca0 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.710+0000 7efce37fe700 1 -- 172.21.15.134:0/645394259 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7efcd80042e0 con 0x7efce4104ca0 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.710+0000 7efce37fe700 1 -- 172.21.15.134:0/645394259 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcd80119d0 con 0x7efce4104ca0 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.710+0000 7efceaf44700 1 -- 172.21.15.134:0/645394259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 msgr2=0x7efce41050b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.710+0000 7efceaf44700 1 --2- 172.21.15.134:0/645394259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce41050b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efcd80098a0 tx=0x7efcd8009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efceaf44700 1 -- 172.21.15.134:0/645394259 shutdown_connections 2024-04-13T10:48:04.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efceaf44700 1 --2- 172.21.15.134:0/645394259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce41050b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efceaf44700 1 -- 172.21.15.134:0/645394259 >> 172.21.15.134:0/645394259 conn(0x7efce40ff590 msgr2=0x7efce41019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efceaf44700 1 -- 172.21.15.134:0/645394259 shutdown_connections 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efceaf44700 1 -- 172.21.15.134:0/645394259 wait complete. 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efceaf44700 1 Processor -- start 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efceaf44700 1 -- start start 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efceaf44700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce4198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efceaf44700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce41989c0 con 0x7efce4104ca0 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efce8ce0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce4198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efce8ce0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce4198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50780/0 (socket says 172.21.15.134:50780) 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.711+0000 7efce8ce0700 1 -- 172.21.15.134:0/2947670283 learned_addr learned my addr 172.21.15.134:0/2947670283 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.712+0000 7efce8ce0700 1 -- 172.21.15.134:0/2947670283 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd8009550 con 0x7efce4104ca0 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.712+0000 7efce8ce0700 1 --2- 172.21.15.134:0/2947670283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce4198480 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efcd8006af0 tx=0x7efcd8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:04.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.712+0000 7efce1ffb700 1 -- 172.21.15.134:0/2947670283 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcd8003b40 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.712+0000 7efce1ffb700 1 -- 172.21.15.134:0/2947670283 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7efcd801a880 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.712+0000 7efceaf44700 1 -- 172.21.15.134:0/2947670283 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce4198bc0 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.712+0000 7efce1ffb700 1 -- 172.21.15.134:0/2947670283 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcd8019890 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.712+0000 7efceaf44700 1 -- 172.21.15.134:0/2947670283 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce4198fe0 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.712+0000 7efce1ffb700 1 -- 172.21.15.134:0/2947670283 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efcd802d440 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.712+0000 7efce1ffb700 1 -- 172.21.15.134:0/2947670283 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efcd80247c0 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.713+0000 7efceaf44700 1 -- 172.21.15.134:0/2947670283 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce4062380 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.715+0000 7efce1ffb700 1 -- 172.21.15.134:0/2947670283 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7efcd801adf0 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.783+0000 7efceaf44700 1 -- 172.21.15.134:0/2947670283 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7efce4106620 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.784+0000 7efce1ffb700 1 -- 172.21.15.134:0/2947670283 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7efcd801aaa0 con 0x7efce4104ca0 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.784+0000 7efceaf44700 1 -- 172.21.15.134:0/2947670283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 msgr2=0x7efce4198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.784+0000 7efceaf44700 1 --2- 172.21.15.134:0/2947670283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce4198480 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efcd8006af0 tx=0x7efcd8011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.785+0000 7efceaf44700 1 -- 172.21.15.134:0/2947670283 shutdown_connections 2024-04-13T10:48:04.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.785+0000 7efceaf44700 1 --2- 172.21.15.134:0/2947670283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efce4104ca0 0x7efce4198480 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:04.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.785+0000 7efceaf44700 1 -- 172.21.15.134:0/2947670283 >> 172.21.15.134:0/2947670283 conn(0x7efce40ff590 msgr2=0x7efce4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:04.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.785+0000 7efceaf44700 1 -- 172.21.15.134:0/2947670283 shutdown_connections 2024-04-13T10:48:04.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:03.785+0000 7efceaf44700 1 -- 172.21.15.134:0/2947670283 wait complete. 2024-04-13T10:48:04.471 INFO:teuthology.orchestra.run.smithi134.stdout:Restarting the monitor... 2024-04-13T10:48:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:04 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T10:48:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:04 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134[39183]: 2024-04-13T10:48:04.710+0000 7fbc9c8e5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T10:48:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:04 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134[39183]: 2024-04-13T10:48:04.710+0000 7fbc9c8e5700 -1 mon.smithi134@0(leader) e1 *** Got Signal Terminated *** 2024-04-13T10:48:05.502 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:05 smithi134 bash[39536]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134 2024-04-13T10:48:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:05 smithi134 systemd[1]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi134.service: Succeeded. 2024-04-13T10:48:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:05 smithi134 systemd[1]: Stopped Ceph mon.smithi134 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T10:48:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:05 smithi134 systemd[1]: Starting Ceph mon.smithi134 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T10:48:06.288 INFO:teuthology.orchestra.run.smithi134.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-13T10:48:06.512 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: set uid:gid to 167:167 (ceph:ceph) 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 7 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: pidfile_write: ignore empty --pid-file 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: load: jerasure load: lrc 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: RocksDB version: 7.9.2 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Git sha 0 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Compile date 2023-08-03 19:21:13 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: DB SUMMARY 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: DB Session ID: T2P3M84Q397QICHYAGUF 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: CURRENT file: CURRENT 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: IDENTITY file: IDENTITY 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 1, files: 000008.sst 2024-04-13T10:48:06.513 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000009.log size: 96868 ; 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.error_if_exists: 0 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.create_if_missing: 0 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.paranoid_checks: 1 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.env: 0x562a8e817720 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.fs: PosixFileSystem 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.info_log: 0x562a9027d2c0 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_file_opening_threads: 16 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.statistics: (nil) 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.use_fsync: 0 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_log_file_size: 0 2024-04-13T10:48:06.514 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.keep_log_file_num: 1000 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.recycle_log_file_num: 0 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.allow_fallocate: 1 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.allow_mmap_reads: 0 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.allow_mmap_writes: 0 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.use_direct_reads: 0 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.create_missing_column_families: 0 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.db_log_dir: 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.wal_dir: 2024-04-13T10:48:06.515 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-13T10:48:06.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-13T10:48:06.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-13T10:48:06.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-13T10:48:06.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-13T10:48:06.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-13T10:48:06.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.advise_random_on_open: 1 2024-04-13T10:48:06.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.db_write_buffer_size: 0 2024-04-13T10:48:06.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.write_buffer_manager: 0x562a8f4ee3c0 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.rate_limiter: (nil) 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.wal_recovery_mode: 2 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.enable_thread_tracking: 0 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.enable_pipelined_write: 0 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.unordered_write: 0 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-13T10:48:06.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.row_cache: None 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.wal_filter: None 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.allow_ingest_behind: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.two_write_queues: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.manual_wal_flush: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.wal_compression: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.atomic_flush: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.log_readahead_size: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.best_efforts_recovery: 0 2024-04-13T10:48:06.519 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.allow_data_in_errors: 0 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.db_host_id: __hostname__ 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_background_jobs: 2 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_background_compactions: -1 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_subcompactions: 1 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-13T10:48:06.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_total_wal_size: 0 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_open_files: -1 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bytes_per_sync: 0 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_readahead_size: 0 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_background_flushes: -1 2024-04-13T10:48:06.521 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Compression algorithms supported: 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: kZSTD supported: 0 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: kXpressCompression supported: 0 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: kLZ4HCCompression supported: 1 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: kZlibCompression supported: 1 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: kSnappyCompression supported: 1 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: kLZ4Compression supported: 1 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: kBZip2Compression supported: 0 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000010 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.merge_operator: 2024-04-13T10:48:06.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_filter: None 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_filter_factory: None 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.sst_partitioner_factory: None 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562a9027d3c0) 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_type: 0 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_index_type: 0 2024-04-13T10:48:06.523 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_shortening: 1 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: checksum: 4 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: no_block_cache: 0 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache: 0x562a8f58f1f0 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_options: 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: capacity : 536870912 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_shard_bits : 4 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: strict_capacity_limit : 0 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_compressed: (nil) 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: persistent_cache: (nil) 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size: 4096 2024-04-13T10:48:06.524 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size_deviation: 10 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_restart_interval: 16 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_block_restart_interval: 1 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_block_size: 4096 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: partition_filters: 0 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: use_delta_encoding: 1 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: filter_policy: bloomfilter 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: whole_key_filtering: 1 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: verify_compression: 0 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: format_version: 5 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_index_compression: 1 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_align: 0 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_auto_readahead_size: 262144 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: prepopulate_block_cache: 0 2024-04-13T10:48:06.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: initial_auto_readahead_size: 8192 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.write_buffer_size: 33554432 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_write_buffer_number: 2 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compression: NoCompression 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bottommost_compression: Disabled 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.prefix_extractor: nullptr 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.num_levels: 7 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-13T10:48:06.526 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compression_opts.level: 32767 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compression_opts.strategy: 0 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compression_opts.enabled: false 2024-04-13T10:48:06.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.target_file_size_base: 67108864 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-13T10:48:06.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.arena_block_size: 1048576 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.disable_auto_compactions: 0 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-13T10:48:06.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.table_properties_collectors: 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.inplace_update_support: 0 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.bloom_locality: 0 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.max_successive_merges: 0 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.paranoid_file_checks: 0 2024-04-13T10:48:06.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.force_consistency_checks: 1 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.report_bg_io_stats: 0 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.ttl: 2592000 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.enable_blob_files: false 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.min_blob_size: 0 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.blob_file_size: 268435456 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-13T10:48:06.531 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.blob_file_starting_level: 0 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1d3d4ebd-9179-4c9f-bea0-889289a70e40 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713005286239359, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713005286240335, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92315, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 308, "table_properties": {"data_size": 90332, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13225, "raw_average_key_size": 49, "raw_value_size": 83071, "raw_average_value_size": 311, "num_data_blocks": 11, "num_entries": 267, "num_filter_entries": 267, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713005286, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1d3d4ebd-9179-4c9f-bea0-889289a70e40", "db_session_id": "T2P3M84Q397QICHYAGUF", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713005286240413, "job": 1, "event": "recovery_finished"} 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi134/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562a8f62c000 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: DB pointer 0x562a8f618000 2024-04-13T10:48:06.532 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** DB Stats ** 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-13T10:48:06.533 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 2/0 92.02 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 92.02 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 142.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-13T10:48:06.534 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 29.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 29.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache BinnedLRUCache@0x562a8f58f1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: starting mon.smithi134 rank 0 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: mon.smithi134@-1(???) e1 preinit fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: mon.smithi134@-1(???).mds e1 new map 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: mon.smithi134@-1(???).mds e1 print_map 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: e1 2024-04-13T10:48:06.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: legacy client fscid: -1 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: No filesystems configured 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: mon.smithi134@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: mon.smithi134@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: mon.smithi134@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: mon.smithi134@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: mon.smithi134@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta expand map: {default=false} 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta from 'false' to 'false' 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta expanded map: {default=false} 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta expand map: {default=info} 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta from 'info' to 'info' 2024-04-13T10:48:06.536 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta expanded map: {default=info} 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta expand map: {default=daemon} 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta from 'daemon' to 'daemon' 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta expanded map: {default=daemon} 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta expand map: {default=debug} 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta from 'debug' to 'debug' 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: expand_channel_meta expanded map: {default=debug} 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 bash[39658]: 049d3d5322cab70b7c41ad23c855874c4fafa8c1d91ba7eda54200c683a55cc8 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 systemd[1]: Started Ceph mon.smithi134 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: mon.smithi134 is new leader, mons smithi134 in quorum (ranks 0) 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: monmap e1: 1 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: fsmap 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: osdmap e1: 0 total, 0 up, 0 in 2024-04-13T10:48:06.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:06 smithi134 ceph-mon[39696]: mgrmap e1: no daemons active 2024-04-13T10:48:07.460 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.782+0000 7fe931149700 1 Processor -- start 2024-04-13T10:48:07.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.782+0000 7fe931149700 1 -- start start 2024-04-13T10:48:07.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.783+0000 7fe931149700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.783+0000 7fe931149700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c107830 con 0x7fe92c106ee0 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.783+0000 7fe92ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.783+0000 7fe92ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50784/0 (socket says 172.21.15.134:50784) 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.783+0000 7fe92ad9d700 1 -- 172.21.15.134:0/3062032867 learned_addr learned my addr 172.21.15.134:0/3062032867 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.783+0000 7fe92ad9d700 1 -- 172.21.15.134:0/3062032867 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c107970 con 0x7fe92c106ee0 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.783+0000 7fe92ad9d700 1 --2- 172.21.15.134:0/3062032867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1072f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe9140098a0 tx=0x7fe914009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e20b73413364a3d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.784+0000 7fe929d9b700 1 -- 172.21.15.134:0/3062032867 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe914004180 con 0x7fe92c106ee0 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.784+0000 7fe929d9b700 1 -- 172.21.15.134:0/3062032867 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fe9140042e0 con 0x7fe92c106ee0 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.784+0000 7fe929d9b700 1 -- 172.21.15.134:0/3062032867 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9140119d0 con 0x7fe92c106ee0 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.784+0000 7fe931149700 1 -- 172.21.15.134:0/3062032867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 msgr2=0x7fe92c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.784+0000 7fe931149700 1 --2- 172.21.15.134:0/3062032867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1072f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe9140098a0 tx=0x7fe914009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.784+0000 7fe931149700 1 -- 172.21.15.134:0/3062032867 shutdown_connections 2024-04-13T10:48:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.784+0000 7fe931149700 1 --2- 172.21.15.134:0/3062032867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1072f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.784+0000 7fe931149700 1 -- 172.21.15.134:0/3062032867 >> 172.21.15.134:0/3062032867 conn(0x7fe92c0ff590 msgr2=0x7fe92c1019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.784+0000 7fe931149700 1 -- 172.21.15.134:0/3062032867 shutdown_connections 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.784+0000 7fe931149700 1 -- 172.21.15.134:0/3062032867 wait complete. 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.785+0000 7fe931149700 1 Processor -- start 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.785+0000 7fe931149700 1 -- start start 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe931149700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1065e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe931149700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c106b20 con 0x7fe92c106ee0 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe92ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe92ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1065e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50796/0 (socket says 172.21.15.134:50796) 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe92ad9d700 1 -- 172.21.15.134:0/1566928155 learned_addr learned my addr 172.21.15.134:0/1566928155 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe92ad9d700 1 -- 172.21.15.134:0/1566928155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914009550 con 0x7fe92c106ee0 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe92ad9d700 1 --2- 172.21.15.134:0/1566928155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1065e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe914006af0 tx=0x7fe914011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:07.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe923fff700 1 -- 172.21.15.134:0/1566928155 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe914024430 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe923fff700 1 -- 172.21.15.134:0/1566928155 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fe9140249e0 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe931149700 1 -- 172.21.15.134:0/1566928155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c104c30 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe923fff700 1 -- 172.21.15.134:0/1566928155 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe91401aa00 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe931149700 1 -- 172.21.15.134:0/1566928155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c105050 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe923fff700 1 -- 172.21.15.134:0/1566928155 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe91402d3f0 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.786+0000 7fe923fff700 1 -- 172.21.15.134:0/1566928155 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe914019830 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.787+0000 7fe931149700 1 -- 172.21.15.134:0/1566928155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c1043a0 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.789+0000 7fe923fff700 1 -- 172.21.15.134:0/1566928155 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe914024b50 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.856+0000 7fe931149700 1 -- 172.21.15.134:0/1566928155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe92c104590 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.859+0000 7fe923fff700 1 -- 172.21.15.134:0/1566928155 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe92c104590 con 0x7fe92c106ee0 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.859+0000 7fe931149700 1 -- 172.21.15.134:0/1566928155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 msgr2=0x7fe92c1065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.859+0000 7fe931149700 1 --2- 172.21.15.134:0/1566928155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1065e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe914006af0 tx=0x7fe914011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.859+0000 7fe931149700 1 -- 172.21.15.134:0/1566928155 shutdown_connections 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.859+0000 7fe931149700 1 --2- 172.21.15.134:0/1566928155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe92c106ee0 0x7fe92c1065e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:07.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.859+0000 7fe931149700 1 -- 172.21.15.134:0/1566928155 >> 172.21.15.134:0/1566928155 conn(0x7fe92c0ff590 msgr2=0x7fe92c100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:07.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.859+0000 7fe931149700 1 -- 172.21.15.134:0/1566928155 shutdown_connections 2024-04-13T10:48:07.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:06.859+0000 7fe931149700 1 -- 172.21.15.134:0/1566928155 wait complete. 2024-04-13T10:48:07.468 INFO:teuthology.orchestra.run.smithi134.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-13T10:48:07.490 INFO:teuthology.orchestra.run.smithi134.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-13T10:48:07.490 INFO:teuthology.orchestra.run.smithi134.stdout:Creating mgr... 2024-04-13T10:48:07.491 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-13T10:48:07.491 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-13T10:48:07.491 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying port 0.0.0.0:8443 ... 2024-04-13T10:48:07.700 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mgr.smithi134.tmanda 2024-04-13T10:48:07.700 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to reset failed state of unit ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mgr.smithi134.tmanda.service: Unit ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mgr.smithi134.tmanda.service not loaded. 2024-04-13T10:48:07.791 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968.target.wants/ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mgr.smithi134.tmanda.service → /etc/systemd/system/ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@.service. 2024-04-13T10:48:08.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:07 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1566928155' entity='client.admin' 2024-04-13T10:48:10.164 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-13T10:48:10.164 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-04-13T10:48:10.172 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-13T10:48:10.173 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-04-13T10:48:10.173 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-04-13T10:48:10.173 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to enable service . firewalld.service is not available 2024-04-13T10:48:10.181 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-13T10:48:10.181 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-04-13T10:48:10.190 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-13T10:48:10.190 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-04-13T10:48:10.190 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-04-13T10:48:10.191 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-04-13T10:48:10.191 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr to start... 2024-04-13T10:48:10.191 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr... 2024-04-13T10:48:11.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:10 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2859746570' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-13T10:48:11.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:11.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-04-13T10:48:11.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "38dd2ea8-f983-11ee-bc8d-c7b262605968", 2024-04-13T10:48:11.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-04-13T10:48:11.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-13T10:48:11.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-13T10:48:11.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-13T10:48:11.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:11.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-13T10:48:11.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-13T10:48:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-04-13T10:48:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-04-13T10:48:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-13T10:48:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-04-13T10:48:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-04-13T10:48:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-04-13T10:48:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-13T10:48:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-13T10:48:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-13T10:48:11.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-13T10:48:11.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-04-13T10:48:00.547759+0000", 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-13T10:48:11.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.752+0000 7f6f4037d700 1 Processor -- start 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.752+0000 7f6f4037d700 1 -- start start 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.752+0000 7f6f4037d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f38103fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.752+0000 7f6f4037d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f381044e0 con 0x7f6f38103b90 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.752+0000 7f6f3e119700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f38103fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.752+0000 7f6f3e119700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f38103fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38300/0 (socket says 172.21.15.134:38300) 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.752+0000 7f6f3e119700 1 -- 172.21.15.134:0/1423560024 learned_addr learned my addr 172.21.15.134:0/1423560024 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.753+0000 7f6f3e119700 1 -- 172.21.15.134:0/1423560024 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38104620 con 0x7f6f38103b90 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.753+0000 7f6f3e119700 1 --2- 172.21.15.134:0/1423560024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f38103fa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6f340098a0 tx=0x7f6f34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcd50a4f9a4341 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.753+0000 7f6f3d117700 1 -- 172.21.15.134:0/1423560024 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f34004180 con 0x7f6f38103b90 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.753+0000 7f6f3d117700 1 -- 172.21.15.134:0/1423560024 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f6f340042e0 con 0x7f6f38103b90 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.753+0000 7f6f3d117700 1 -- 172.21.15.134:0/1423560024 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f340119d0 con 0x7f6f38103b90 2024-04-13T10:48:11.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.754+0000 7f6f4037d700 1 -- 172.21.15.134:0/1423560024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 msgr2=0x7f6f38103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.754+0000 7f6f4037d700 1 --2- 172.21.15.134:0/1423560024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f38103fa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6f340098a0 tx=0x7f6f34009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.754+0000 7f6f4037d700 1 -- 172.21.15.134:0/1423560024 shutdown_connections 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.754+0000 7f6f4037d700 1 --2- 172.21.15.134:0/1423560024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f38103fa0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.754+0000 7f6f4037d700 1 -- 172.21.15.134:0/1423560024 >> 172.21.15.134:0/1423560024 conn(0x7f6f380ff590 msgr2=0x7f6f381019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.754+0000 7f6f4037d700 1 -- 172.21.15.134:0/1423560024 shutdown_connections 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.754+0000 7f6f4037d700 1 -- 172.21.15.134:0/1423560024 wait complete. 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.754+0000 7f6f4037d700 1 Processor -- start 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f4037d700 1 -- start start 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f4037d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f381995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f4037d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38199b20 con 0x7f6f38103b90 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f3e119700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f381995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f3e119700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f381995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38308/0 (socket says 172.21.15.134:38308) 2024-04-13T10:48:11.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f3e119700 1 -- 172.21.15.134:0/2859746570 learned_addr learned my addr 172.21.15.134:0/2859746570 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f3e119700 1 -- 172.21.15.134:0/2859746570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f34009550 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f3e119700 1 --2- 172.21.15.134:0/2859746570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f381995e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6f34006b20 tx=0x7f6f34011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f2f7fe700 1 -- 172.21.15.134:0/2859746570 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f34003a40 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f4037d700 1 -- 172.21.15.134:0/2859746570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f38199d20 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f2f7fe700 1 -- 172.21.15.134:0/2859746570 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f6f3401a880 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.755+0000 7f6f2f7fe700 1 -- 172.21.15.134:0/2859746570 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f34024720 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.756+0000 7f6f4037d700 1 -- 172.21.15.134:0/2859746570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3819a140 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.756+0000 7f6f2f7fe700 1 -- 172.21.15.134:0/2859746570 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6f34024c90 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.756+0000 7f6f2f7fe700 1 -- 172.21.15.134:0/2859746570 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6f340193c0 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.757+0000 7f6f2d7fa700 1 -- 172.21.15.134:0/2859746570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f200052f0 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.759+0000 7f6f2f7fe700 1 -- 172.21.15.134:0/2859746570 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6f3401ada0 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.831+0000 7f6f2d7fa700 1 -- 172.21.15.134:0/2859746570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6f20005c90 con 0x7f6f38103b90 2024-04-13T10:48:11.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.831+0000 7f6f2f7fe700 1 -- 172.21.15.134:0/2859746570 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f6f3401a9f0 con 0x7f6f38103b90 2024-04-13T10:48:11.501 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.832+0000 7f6f2d7fa700 1 -- 172.21.15.134:0/2859746570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 msgr2=0x7f6f381995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:11.501 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.832+0000 7f6f2d7fa700 1 --2- 172.21.15.134:0/2859746570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f381995e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6f34006b20 tx=0x7f6f34011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:11.501 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.832+0000 7f6f2d7fa700 1 -- 172.21.15.134:0/2859746570 shutdown_connections 2024-04-13T10:48:11.501 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.832+0000 7f6f2d7fa700 1 --2- 172.21.15.134:0/2859746570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f38103b90 0x7f6f381995e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:11.501 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.832+0000 7f6f2d7fa700 1 -- 172.21.15.134:0/2859746570 >> 172.21.15.134:0/2859746570 conn(0x7f6f380ff590 msgr2=0x7f6f38100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:11.501 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.832+0000 7f6f2d7fa700 1 -- 172.21.15.134:0/2859746570 shutdown_connections 2024-04-13T10:48:11.501 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:10.832+0000 7f6f2d7fa700 1 -- 172.21.15.134:0/2859746570 wait complete. 2024-04-13T10:48:11.501 INFO:teuthology.orchestra.run.smithi134.stdout:mgr not available, waiting (1/15)... 2024-04-13T10:48:14.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:14 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/936967480' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-13T10:48:15.623 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:15.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-04-13T10:48:15.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "38dd2ea8-f983-11ee-bc8d-c7b262605968", 2024-04-13T10:48:15.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-04-13T10:48:15.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-13T10:48:15.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-13T10:48:15.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-13T10:48:15.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:15.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-13T10:48:15.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-13T10:48:15.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:15.640 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-13T10:48:15.641 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:15.642 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-04-13T10:48:00.547759+0000", 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-13T10:48:15.643 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.096+0000 7f17f68a3700 1 Processor -- start 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.096+0000 7f17f68a3700 1 -- start start 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.096+0000 7f17f68a3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01087e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.096+0000 7f17f68a3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0074380 con 0x7f17f0106400 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.096+0000 7f17effff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.096+0000 7f17effff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01087e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38324/0 (socket says 172.21.15.134:38324) 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.096+0000 7f17effff700 1 -- 172.21.15.134:0/676072997 learned_addr learned my addr 172.21.15.134:0/676072997 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.096+0000 7f17effff700 1 -- 172.21.15.134:0/676072997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00744c0 con 0x7f17f0106400 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.097+0000 7f17effff700 1 --2- 172.21.15.134:0/676072997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01087e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f17e00098a0 tx=0x7f17e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9696981c9b055e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.097+0000 7f17eeffd700 1 -- 172.21.15.134:0/676072997 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17e0004180 con 0x7f17f0106400 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.097+0000 7f17eeffd700 1 -- 172.21.15.134:0/676072997 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f17e00042e0 con 0x7f17f0106400 2024-04-13T10:48:15.644 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.097+0000 7f17eeffd700 1 -- 172.21.15.134:0/676072997 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17e00119d0 con 0x7f17f0106400 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.097+0000 7f17f68a3700 1 -- 172.21.15.134:0/676072997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 msgr2=0x7f17f01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.097+0000 7f17f68a3700 1 --2- 172.21.15.134:0/676072997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01087e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f17e00098a0 tx=0x7f17e0009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.097+0000 7f17f68a3700 1 -- 172.21.15.134:0/676072997 shutdown_connections 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.097+0000 7f17f68a3700 1 --2- 172.21.15.134:0/676072997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01087e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.097+0000 7f17f68a3700 1 -- 172.21.15.134:0/676072997 >> 172.21.15.134:0/676072997 conn(0x7f17f00ffe20 msgr2=0x7f17f0102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.097+0000 7f17f68a3700 1 -- 172.21.15.134:0/676072997 shutdown_connections 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.098+0000 7f17f68a3700 1 -- 172.21.15.134:0/676072997 wait complete. 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.098+0000 7f17f68a3700 1 Processor -- start 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.098+0000 7f17f68a3700 1 -- start start 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17f68a3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17f68a3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0199a30 con 0x7f17f0106400 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17effff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17effff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38338/0 (socket says 172.21.15.134:38338) 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17effff700 1 -- 172.21.15.134:0/936967480 learned_addr learned my addr 172.21.15.134:0/936967480 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:15.645 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17effff700 1 -- 172.21.15.134:0/936967480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e0009550 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17effff700 1 --2- 172.21.15.134:0/936967480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01994f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17e0006af0 tx=0x7f17e0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17ed7fa700 1 -- 172.21.15.134:0/936967480 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17e0024430 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17ed7fa700 1 -- 172.21.15.134:0/936967480 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f17e00249e0 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17f68a3700 1 -- 172.21.15.134:0/936967480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f0199c90 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17ed7fa700 1 -- 172.21.15.134:0/936967480 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17e001a970 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.099+0000 7f17f68a3700 1 -- 172.21.15.134:0/936967480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f019a110 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.100+0000 7f17ed7fa700 1 -- 172.21.15.134:0/936967480 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f17e002d3f0 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.100+0000 7f17ed7fa700 1 -- 172.21.15.134:0/936967480 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f17e0019790 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.100+0000 7f17f68a3700 1 -- 172.21.15.134:0/936967480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f0109880 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.102+0000 7f17ed7fa700 1 -- 172.21.15.134:0/936967480 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f17e0024b50 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.175+0000 7f17f68a3700 1 -- 172.21.15.134:0/936967480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f17f0109a70 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.175+0000 7f17ed7fa700 1 -- 172.21.15.134:0/936967480 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f17e0024cf0 con 0x7f17f0106400 2024-04-13T10:48:15.646 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.176+0000 7f17f68a3700 1 -- 172.21.15.134:0/936967480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 msgr2=0x7f17f01994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:15.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.176+0000 7f17f68a3700 1 --2- 172.21.15.134:0/936967480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01994f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17e0006af0 tx=0x7f17e0011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:15.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.176+0000 7f17f68a3700 1 -- 172.21.15.134:0/936967480 shutdown_connections 2024-04-13T10:48:15.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.176+0000 7f17f68a3700 1 --2- 172.21.15.134:0/936967480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17f0106400 0x7f17f01994f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:15.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.176+0000 7f17f68a3700 1 -- 172.21.15.134:0/936967480 >> 172.21.15.134:0/936967480 conn(0x7f17f00ffe20 msgr2=0x7f17f01014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:15.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.177+0000 7f17f68a3700 1 -- 172.21.15.134:0/936967480 shutdown_connections 2024-04-13T10:48:15.647 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:14.177+0000 7f17f68a3700 1 -- 172.21.15.134:0/936967480 wait complete. 2024-04-13T10:48:15.647 INFO:teuthology.orchestra.run.smithi134.stdout:mgr not available, waiting (2/15)... 2024-04-13T10:48:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: Activating manager daemon smithi134.tmanda 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: mgrmap e2: smithi134.tmanda(active, starting, since 0.00317564s) 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: from='mgr.14100 172.21.15.134:0/3217311360' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: from='mgr.14100 172.21.15.134:0/3217311360' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: from='mgr.14100 172.21.15.134:0/3217311360' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: from='mgr.14100 172.21.15.134:0/3217311360' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: from='mgr.14100 172.21.15.134:0/3217311360' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr metadata", "who": "smithi134.tmanda", "id": "smithi134.tmanda"}]: dispatch 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: Manager daemon smithi134.tmanda is now available 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: from='mgr.14100 172.21.15.134:0/3217311360' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/mirror_snapshot_schedule"}]: dispatch 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: from='mgr.14100 172.21.15.134:0/3217311360' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/trash_purge_schedule"}]: dispatch 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: from='mgr.14100 172.21.15.134:0/3217311360' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: from='mgr.14100 172.21.15.134:0/3217311360' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:17 smithi134 ceph-mon[39696]: from='mgr.14100 172.21.15.134:0/3217311360' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:18.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:18 smithi134 ceph-mon[39696]: mgrmap e3: smithi134.tmanda(active, since 1.00702s) 2024-04-13T10:48:20.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:20 smithi134 ceph-mon[39696]: mgrmap e4: smithi134.tmanda(active, since 3s) 2024-04-13T10:48:22.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:22 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2501716440' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-13T10:48:24.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:24.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-04-13T10:48:24.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "38dd2ea8-f983-11ee-bc8d-c7b262605968", 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-04-13T10:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2024-04-13T10:48:24.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-13T10:48:24.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:24.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-13T10:48:24.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-13T10:48:24.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:24.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-13T10:48:24.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:24.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-13T10:48:24.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-13T10:48:24.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-13T10:48:24.787 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-13T10:48:24.787 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-13T10:48:24.787 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-13T10:48:24.787 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:24.787 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-13T10:48:24.787 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-13T10:48:24.787 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-13T10:48:24.787 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-13T10:48:24.787 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-13T10:48:24.787 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-13T10:48:24.788 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-04-13T10:48:00.547759+0000", 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.821+0000 7f18e4a05700 1 Processor -- start 2024-04-13T10:48:24.789 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.821+0000 7f18e4a05700 1 -- start start 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.821+0000 7f18e4a05700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.822+0000 7f18e4a05700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0105100 con 0x7f18e01047b0 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.822+0000 7f18de59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.822+0000 7f18de59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36916/0 (socket says 172.21.15.134:36916) 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.822+0000 7f18de59c700 1 -- 172.21.15.134:0/3808006304 learned_addr learned my addr 172.21.15.134:0/3808006304 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.822+0000 7f18de59c700 1 -- 172.21.15.134:0/3808006304 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0105240 con 0x7f18e01047b0 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.822+0000 7f18de59c700 1 --2- 172.21.15.134:0/3808006304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0104bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f18d80098a0 tx=0x7f18d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e6329ace715bcc server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.822+0000 7f18dd59a700 1 -- 172.21.15.134:0/3808006304 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18d8004180 con 0x7f18e01047b0 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.822+0000 7f18dd59a700 1 -- 172.21.15.134:0/3808006304 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f18d80042e0 con 0x7f18e01047b0 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.822+0000 7f18dd59a700 1 -- 172.21.15.134:0/3808006304 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18d80119d0 con 0x7f18e01047b0 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.823+0000 7f18e4a05700 1 -- 172.21.15.134:0/3808006304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 msgr2=0x7f18e0104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.823+0000 7f18e4a05700 1 --2- 172.21.15.134:0/3808006304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0104bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f18d80098a0 tx=0x7f18d8009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:24.790 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.823+0000 7f18e4a05700 1 -- 172.21.15.134:0/3808006304 shutdown_connections 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.823+0000 7f18e4a05700 1 --2- 172.21.15.134:0/3808006304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0104bc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.823+0000 7f18e4a05700 1 -- 172.21.15.134:0/3808006304 >> 172.21.15.134:0/3808006304 conn(0x7f18e00ffe20 msgr2=0x7f18e0102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.823+0000 7f18e4a05700 1 -- 172.21.15.134:0/3808006304 shutdown_connections 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.823+0000 7f18e4a05700 1 -- 172.21.15.134:0/3808006304 wait complete. 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.824+0000 7f18e4a05700 1 Processor -- start 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.824+0000 7f18e4a05700 1 -- start start 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.824+0000 7f18e4a05700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.824+0000 7f18e4a05700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0198990 con 0x7f18e01047b0 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.824+0000 7f18de59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.824+0000 7f18de59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36932/0 (socket says 172.21.15.134:36932) 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.824+0000 7f18de59c700 1 -- 172.21.15.134:0/2501716440 learned_addr learned my addr 172.21.15.134:0/2501716440 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.825+0000 7f18de59c700 1 -- 172.21.15.134:0/2501716440 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d8009550 con 0x7f18e01047b0 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.825+0000 7f18de59c700 1 --2- 172.21.15.134:0/2501716440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0198450 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f18d8006af0 tx=0x7f18d8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.825+0000 7f18cf7fe700 1 -- 172.21.15.134:0/2501716440 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18d8024430 con 0x7f18e01047b0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.825+0000 7f18cf7fe700 1 -- 172.21.15.134:0/2501716440 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f18d80249e0 con 0x7f18e01047b0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.825+0000 7f18e4a05700 1 -- 172.21.15.134:0/2501716440 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e0198b90 con 0x7f18e01047b0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.825+0000 7f18cf7fe700 1 -- 172.21.15.134:0/2501716440 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18d801aa00 con 0x7f18e01047b0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.825+0000 7f18e4a05700 1 -- 172.21.15.134:0/2501716440 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0198fb0 con 0x7f18e01047b0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.826+0000 7f18cf7fe700 1 -- 172.21.15.134:0/2501716440 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f18d801acc0 con 0x7f18e01047b0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.826+0000 7f18cf7fe700 1 --2- 172.21.15.134:0/2501716440 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f18c80383a0 0x7f18c803a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.826+0000 7f18e4a05700 1 -- 172.21.15.134:0/2501716440 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e0062380 con 0x7f18e01047b0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.826+0000 7f18cf7fe700 1 -- 172.21.15.134:0/2501716440 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f18d804c3f0 con 0x7f18e01047b0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.826+0000 7f18ddd9b700 1 --2- 172.21.15.134:0/2501716440 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f18c80383a0 0x7f18c803a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.826+0000 7f18ddd9b700 1 --2- 172.21.15.134:0/2501716440 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f18c80383a0 0x7f18c803a850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f18d4006fd0 tx=0x7f18d4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:21.831+0000 7f18cf7fe700 1 -- 172.21.15.134:0/2501716440 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f18d80189a0 con 0x7f18e01047b0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.092+0000 7f18e4a05700 1 -- 172.21.15.134:0/2501716440 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f18e019c080 con 0x7f18e01047b0 2024-04-13T10:48:24.792 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.093+0000 7f18cf7fe700 1 -- 172.21.15.134:0/2501716440 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f18d8018350 con 0x7f18e01047b0 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.095+0000 7f18e4a05700 1 -- 172.21.15.134:0/2501716440 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f18c80383a0 msgr2=0x7f18c803a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.095+0000 7f18e4a05700 1 --2- 172.21.15.134:0/2501716440 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f18c80383a0 0x7f18c803a850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f18d4006fd0 tx=0x7f18d4006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.095+0000 7f18e4a05700 1 -- 172.21.15.134:0/2501716440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 msgr2=0x7f18e0198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.095+0000 7f18e4a05700 1 --2- 172.21.15.134:0/2501716440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0198450 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f18d8006af0 tx=0x7f18d8011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.095+0000 7f18e4a05700 1 -- 172.21.15.134:0/2501716440 shutdown_connections 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.095+0000 7f18e4a05700 1 --2- 172.21.15.134:0/2501716440 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f18c80383a0 0x7f18c803a850 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.095+0000 7f18e4a05700 1 --2- 172.21.15.134:0/2501716440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e01047b0 0x7f18e0198450 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.095+0000 7f18e4a05700 1 -- 172.21.15.134:0/2501716440 >> 172.21.15.134:0/2501716440 conn(0x7f18e00ffe20 msgr2=0x7f18e01014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.095+0000 7f18e4a05700 1 -- 172.21.15.134:0/2501716440 shutdown_connections 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:22.095+0000 7f18e4a05700 1 -- 172.21.15.134:0/2501716440 wait complete. 2024-04-13T10:48:24.793 INFO:teuthology.orchestra.run.smithi134.stdout:mgr is available 2024-04-13T10:48:25.869 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:25 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3347982686' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-13T10:48:26.145 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [global] 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout fsid = 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [osd] 2024-04-13T10:48:26.146 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.357+0000 7f3bb5e3e700 1 Processor -- start 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.357+0000 7f3bb5e3e700 1 -- start start 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.357+0000 7f3bb5e3e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb01087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.357+0000 7f3bb5e3e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00743c0 con 0x7f3bb01063c0 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.357+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb01087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.357+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb01087a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36936/0 (socket says 172.21.15.134:36936) 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.357+0000 7f3baf7fe700 1 -- 172.21.15.134:0/1992040013 learned_addr learned my addr 172.21.15.134:0/1992040013 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.357+0000 7f3baf7fe700 1 -- 172.21.15.134:0/1992040013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0074500 con 0x7f3bb01063c0 2024-04-13T10:48:26.147 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3baf7fe700 1 --2- 172.21.15.134:0/1992040013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb01087a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00098a0 tx=0x7f3ba0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dfab61075cf4c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3bae7fc700 1 -- 172.21.15.134:0/1992040013 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ba0004180 con 0x7f3bb01063c0 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3bae7fc700 1 -- 172.21.15.134:0/1992040013 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f3ba00042e0 con 0x7f3bb01063c0 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3bae7fc700 1 -- 172.21.15.134:0/1992040013 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ba00119d0 con 0x7f3bb01063c0 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/1992040013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 msgr2=0x7f3bb01087a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3bb5e3e700 1 --2- 172.21.15.134:0/1992040013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb01087a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00098a0 tx=0x7f3ba0009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/1992040013 shutdown_connections 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3bb5e3e700 1 --2- 172.21.15.134:0/1992040013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb01087a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/1992040013 >> 172.21.15.134:0/1992040013 conn(0x7f3bb00ffe20 msgr2=0x7f3bb0102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/1992040013 shutdown_connections 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.358+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/1992040013 wait complete. 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.359+0000 7f3bb5e3e700 1 Processor -- start 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.359+0000 7f3bb5e3e700 1 -- start start 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.359+0000 7f3bb5e3e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb0105d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.359+0000 7f3bb5e3e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0106260 con 0x7f3bb01063c0 2024-04-13T10:48:26.148 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.359+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb0105d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.359+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb0105d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36950/0 (socket says 172.21.15.134:36950) 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.359+0000 7f3baf7fe700 1 -- 172.21.15.134:0/3347982686 learned_addr learned my addr 172.21.15.134:0/3347982686 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.360+0000 7f3baf7fe700 1 -- 172.21.15.134:0/3347982686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0009550 con 0x7f3bb01063c0 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.360+0000 7f3baf7fe700 1 --2- 172.21.15.134:0/3347982686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb0105d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0006af0 tx=0x7f3ba0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.360+0000 7f3bacff9700 1 -- 172.21.15.134:0/3347982686 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ba0024430 con 0x7f3bb01063c0 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.360+0000 7f3bacff9700 1 -- 172.21.15.134:0/3347982686 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f3ba00249e0 con 0x7f3bb01063c0 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.360+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/3347982686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb0104370 con 0x7f3bb01063c0 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.360+0000 7f3bacff9700 1 -- 172.21.15.134:0/3347982686 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ba001a970 con 0x7f3bb01063c0 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.360+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/3347982686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb0104790 con 0x7f3bb01063c0 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.361+0000 7f3bacff9700 1 -- 172.21.15.134:0/3347982686 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f3ba001abe0 con 0x7f3bb01063c0 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.361+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/3347982686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb01098d0 con 0x7f3bb01063c0 2024-04-13T10:48:26.149 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.361+0000 7f3bacff9700 1 --2- 172.21.15.134:0/3347982686 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f3b980383f0 0x7f3b9803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.361+0000 7f3bacff9700 1 -- 172.21.15.134:0/3347982686 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3ba004c550 con 0x7f3bb01063c0 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.361+0000 7f3baeffd700 1 --2- 172.21.15.134:0/3347982686 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f3b980383f0 0x7f3b9803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.362+0000 7f3baeffd700 1 --2- 172.21.15.134:0/3347982686 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f3b980383f0 0x7f3b9803a8a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4006fd0 tx=0x7f3ba4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.366+0000 7f3bacff9700 1 -- 172.21.15.134:0/3347982686 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3ba002d3f0 con 0x7f3bb01063c0 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.552+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/3347982686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3bb0109af0 con 0x7f3bb01063c0 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.553+0000 7f3bacff9700 1 -- 172.21.15.134:0/3347982686 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f3ba0018350 con 0x7f3bb01063c0 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.555+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/3347982686 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f3b980383f0 msgr2=0x7f3b9803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.555+0000 7f3bb5e3e700 1 --2- 172.21.15.134:0/3347982686 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f3b980383f0 0x7f3b9803a8a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4006fd0 tx=0x7f3ba4006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.555+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/3347982686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 msgr2=0x7f3bb0105d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.555+0000 7f3bb5e3e700 1 --2- 172.21.15.134:0/3347982686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb0105d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0006af0 tx=0x7f3ba0011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.555+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/3347982686 shutdown_connections 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.555+0000 7f3bb5e3e700 1 --2- 172.21.15.134:0/3347982686 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f3b980383f0 0x7f3b9803a8a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:26.150 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.555+0000 7f3bb5e3e700 1 --2- 172.21.15.134:0/3347982686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb01063c0 0x7f3bb0105d20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:26.151 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.555+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/3347982686 >> 172.21.15.134:0/3347982686 conn(0x7f3bb00ffe20 msgr2=0x7f3bb01014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:26.151 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.555+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/3347982686 shutdown_connections 2024-04-13T10:48:26.151 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:25.555+0000 7f3bb5e3e700 1 -- 172.21.15.134:0/3347982686 wait complete. 2024-04-13T10:48:26.151 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling cephadm module... 2024-04-13T10:48:27.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:27 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/654697883' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-13T10:48:27.942 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.659+0000 7f93bdcfc700 1 Processor -- start 2024-04-13T10:48:27.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.659+0000 7f93bdcfc700 1 -- start start 2024-04-13T10:48:27.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.659+0000 7f93bdcfc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b8105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:27.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.659+0000 7f93bdcfc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8106210 con 0x7f93b81058c0 2024-04-13T10:48:27.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.660+0000 7f93b77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b8105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:27.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.660+0000 7f93b77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b8105cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36954/0 (socket says 172.21.15.134:36954) 2024-04-13T10:48:27.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.660+0000 7f93b77fe700 1 -- 172.21.15.134:0/802365575 learned_addr learned my addr 172.21.15.134:0/802365575 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:27.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.660+0000 7f93b77fe700 1 -- 172.21.15.134:0/802365575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b8106350 con 0x7f93b81058c0 2024-04-13T10:48:27.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.660+0000 7f93b77fe700 1 --2- 172.21.15.134:0/802365575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b8105cd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0098a0 tx=0x7f93ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33770611c883af4b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:27.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.660+0000 7f93b67fc700 1 -- 172.21.15.134:0/802365575 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93ac004180 con 0x7f93b81058c0 2024-04-13T10:48:27.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.660+0000 7f93b67fc700 1 -- 172.21.15.134:0/802365575 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f93ac0042e0 con 0x7f93b81058c0 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.660+0000 7f93b67fc700 1 -- 172.21.15.134:0/802365575 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93ac0119d0 con 0x7f93b81058c0 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.661+0000 7f93bdcfc700 1 -- 172.21.15.134:0/802365575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 msgr2=0x7f93b8105cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.661+0000 7f93bdcfc700 1 --2- 172.21.15.134:0/802365575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b8105cd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0098a0 tx=0x7f93ac009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.661+0000 7f93bdcfc700 1 -- 172.21.15.134:0/802365575 shutdown_connections 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.661+0000 7f93bdcfc700 1 --2- 172.21.15.134:0/802365575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b8105cd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.661+0000 7f93bdcfc700 1 -- 172.21.15.134:0/802365575 >> 172.21.15.134:0/802365575 conn(0x7f93b8100f30 msgr2=0x7f93b8103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.661+0000 7f93bdcfc700 1 -- 172.21.15.134:0/802365575 shutdown_connections 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.661+0000 7f93bdcfc700 1 -- 172.21.15.134:0/802365575 wait complete. 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.661+0000 7f93bdcfc700 1 Processor -- start 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93bdcfc700 1 -- start start 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93bdcfc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b81995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93bdcfc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8199b00 con 0x7f93b81058c0 2024-04-13T10:48:27.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93b77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b81995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:27.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93b77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b81995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36966/0 (socket says 172.21.15.134:36966) 2024-04-13T10:48:27.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93b77fe700 1 -- 172.21.15.134:0/654697883 learned_addr learned my addr 172.21.15.134:0/654697883 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:27.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93b77fe700 1 -- 172.21.15.134:0/654697883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac009550 con 0x7f93b81058c0 2024-04-13T10:48:27.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93b77fe700 1 --2- 172.21.15.134:0/654697883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b81995c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009130 tx=0x7f93ac011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:27.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93b4ff9700 1 -- 172.21.15.134:0/654697883 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93ac003900 con 0x7f93b81058c0 2024-04-13T10:48:27.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93b4ff9700 1 -- 172.21.15.134:0/654697883 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f93ac003a60 con 0x7f93b81058c0 2024-04-13T10:48:27.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93bdcfc700 1 -- 172.21.15.134:0/654697883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b8199d00 con 0x7f93b81058c0 2024-04-13T10:48:27.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93b4ff9700 1 -- 172.21.15.134:0/654697883 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93ac0246e0 con 0x7f93b81058c0 2024-04-13T10:48:27.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.662+0000 7f93bdcfc700 1 -- 172.21.15.134:0/654697883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b819a120 con 0x7f93b81058c0 2024-04-13T10:48:27.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.663+0000 7f93b4ff9700 1 -- 172.21.15.134:0/654697883 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f93ac02d3f0 con 0x7f93b81058c0 2024-04-13T10:48:27.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.663+0000 7f93bdcfc700 1 -- 172.21.15.134:0/654697883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b8062380 con 0x7f93b81058c0 2024-04-13T10:48:27.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.663+0000 7f93b4ff9700 1 --2- 172.21.15.134:0/654697883 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f93a00383a0 0x7f93a003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:27.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.663+0000 7f93b4ff9700 1 -- 172.21.15.134:0/654697883 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f93ac04bf90 con 0x7f93b81058c0 2024-04-13T10:48:27.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.664+0000 7f93b6ffd700 1 --2- 172.21.15.134:0/654697883 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f93a00383a0 0x7f93a003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:27.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.664+0000 7f93b6ffd700 1 --2- 172.21.15.134:0/654697883 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f93a00383a0 0x7f93a003a850 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93a8006fd0 tx=0x7f93a8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:27.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.668+0000 7f93b4ff9700 1 -- 172.21.15.134:0/654697883 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f93ac07e720 con 0x7f93b81058c0 2024-04-13T10:48:27.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:26.907+0000 7f93bdcfc700 1 -- 172.21.15.134:0/654697883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f93b819d2e0 con 0x7f93b81058c0 2024-04-13T10:48:27.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.254+0000 7f93b4ff9700 1 -- 172.21.15.134:0/654697883 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f93ac01ab80 con 0x7f93b81058c0 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.255+0000 7f93b4ff9700 1 -- 172.21.15.134:0/654697883 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f93ac00b800 con 0x7f93b81058c0 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.257+0000 7f93bdcfc700 1 -- 172.21.15.134:0/654697883 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f93a00383a0 msgr2=0x7f93a003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.257+0000 7f93bdcfc700 1 --2- 172.21.15.134:0/654697883 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f93a00383a0 0x7f93a003a850 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93a8006fd0 tx=0x7f93a8006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.257+0000 7f93bdcfc700 1 -- 172.21.15.134:0/654697883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 msgr2=0x7f93b81995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.257+0000 7f93bdcfc700 1 --2- 172.21.15.134:0/654697883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b81995c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009130 tx=0x7f93ac011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.257+0000 7f93bdcfc700 1 -- 172.21.15.134:0/654697883 shutdown_connections 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.257+0000 7f93bdcfc700 1 --2- 172.21.15.134:0/654697883 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f93a00383a0 0x7f93a003a850 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.258+0000 7f93bdcfc700 1 --2- 172.21.15.134:0/654697883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b81058c0 0x7f93b81995c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.258+0000 7f93bdcfc700 1 -- 172.21.15.134:0/654697883 >> 172.21.15.134:0/654697883 conn(0x7f93b8100f30 msgr2=0x7f93b8102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.258+0000 7f93bdcfc700 1 -- 172.21.15.134:0/654697883 shutdown_connections 2024-04-13T10:48:27.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:27.258+0000 7f93bdcfc700 1 -- 172.21.15.134:0/654697883 wait complete. 2024-04-13T10:48:28.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:28 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/654697883' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-13T10:48:28.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:28 smithi134 ceph-mon[39696]: mgrmap e5: smithi134.tmanda(active, since 10s) 2024-04-13T10:48:29.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:29 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/4160710400' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-13T10:48:29.491 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "active_name": "smithi134.tmanda", 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.433+0000 7f43df95a700 1 Processor -- start 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.434+0000 7f43df95a700 1 -- start start 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.434+0000 7f43df95a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.434+0000 7f43df95a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d8105100 con 0x7f43d81047b0 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.434+0000 7f43dd6f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:29.492 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.434+0000 7f43dd6f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36998/0 (socket says 172.21.15.134:36998) 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.434+0000 7f43dd6f6700 1 -- 172.21.15.134:0/856008156 learned_addr learned my addr 172.21.15.134:0/856008156 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.434+0000 7f43dd6f6700 1 -- 172.21.15.134:0/856008156 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d8105240 con 0x7f43d81047b0 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.434+0000 7f43dd6f6700 1 --2- 172.21.15.134:0/856008156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8104bc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f43d40098a0 tx=0x7f43d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feed6ad12e4decb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.435+0000 7f43cffff700 1 -- 172.21.15.134:0/856008156 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43d4004180 con 0x7f43d81047b0 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.435+0000 7f43cffff700 1 -- 172.21.15.134:0/856008156 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f43d40042e0 con 0x7f43d81047b0 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.435+0000 7f43cffff700 1 -- 172.21.15.134:0/856008156 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43d40119d0 con 0x7f43d81047b0 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.435+0000 7f43df95a700 1 -- 172.21.15.134:0/856008156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 msgr2=0x7f43d8104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.435+0000 7f43df95a700 1 --2- 172.21.15.134:0/856008156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8104bc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f43d40098a0 tx=0x7f43d4009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.435+0000 7f43df95a700 1 -- 172.21.15.134:0/856008156 shutdown_connections 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.435+0000 7f43df95a700 1 --2- 172.21.15.134:0/856008156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8104bc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.435+0000 7f43df95a700 1 -- 172.21.15.134:0/856008156 >> 172.21.15.134:0/856008156 conn(0x7f43d80ffe20 msgr2=0x7f43d8102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.435+0000 7f43df95a700 1 -- 172.21.15.134:0/856008156 shutdown_connections 2024-04-13T10:48:29.493 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.435+0000 7f43df95a700 1 -- 172.21.15.134:0/856008156 wait complete. 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.436+0000 7f43df95a700 1 Processor -- start 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.436+0000 7f43df95a700 1 -- start start 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.436+0000 7f43df95a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43df95a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d8198990 con 0x7f43d81047b0 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43dd6f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43dd6f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37006/0 (socket says 172.21.15.134:37006) 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43dd6f6700 1 -- 172.21.15.134:0/4160710400 learned_addr learned my addr 172.21.15.134:0/4160710400 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43dd6f6700 1 -- 172.21.15.134:0/4160710400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4009550 con 0x7f43d81047b0 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43dd6f6700 1 --2- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8198450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f43d4006af0 tx=0x7f43d4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43ce7fc700 1 -- 172.21.15.134:0/4160710400 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43d4024430 con 0x7f43d81047b0 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43df95a700 1 -- 172.21.15.134:0/4160710400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d8198b90 con 0x7f43d81047b0 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43ce7fc700 1 -- 172.21.15.134:0/4160710400 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f43d40249e0 con 0x7f43d81047b0 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43ce7fc700 1 -- 172.21.15.134:0/4160710400 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43d401aa00 con 0x7f43d81047b0 2024-04-13T10:48:29.494 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.437+0000 7f43df95a700 1 -- 172.21.15.134:0/4160710400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d8198fb0 con 0x7f43d81047b0 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.438+0000 7f43ce7fc700 1 -- 172.21.15.134:0/4160710400 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f43d401acc0 con 0x7f43d81047b0 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.438+0000 7f43df95a700 1 -- 172.21.15.134:0/4160710400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d81065c0 con 0x7f43d81047b0 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.438+0000 7f43ce7fc700 1 --2- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f43c40383f0 0x7f43c403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.439+0000 7f43ce7fc700 1 -- 172.21.15.134:0/4160710400 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f43d404c4a0 con 0x7f43d81047b0 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.439+0000 7f43dcef5700 1 -- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f43c40383f0 msgr2=0x7f43c403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3448754383 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.439+0000 7f43dcef5700 1 --2- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f43c40383f0 0x7f43c403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.443+0000 7f43ce7fc700 1 -- 172.21.15.134:0/4160710400 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f43d40193c0 con 0x7f43d81047b0 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.640+0000 7f43dcef5700 1 -- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f43c40383f0 msgr2=0x7f43c403a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3448754383 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.640+0000 7f43dcef5700 1 --2- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f43c40383f0 0x7f43c403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.694+0000 7f43df95a700 1 -- 172.21.15.134:0/4160710400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f43d819be10 con 0x7f43d81047b0 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.694+0000 7f43ce7fc700 1 -- 172.21.15.134:0/4160710400 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f43d4023390 con 0x7f43d81047b0 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.698+0000 7f43df95a700 1 -- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f43c40383f0 msgr2=0x7f43c403a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-13T10:48:29.495 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.698+0000 7f43df95a700 1 --2- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f43c40383f0 0x7f43c403a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.698+0000 7f43df95a700 1 -- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 msgr2=0x7f43d8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.698+0000 7f43df95a700 1 --2- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8198450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f43d4006af0 tx=0x7f43d4011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.698+0000 7f43df95a700 1 -- 172.21.15.134:0/4160710400 shutdown_connections 2024-04-13T10:48:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.698+0000 7f43df95a700 1 --2- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7f43c40383f0 0x7f43c403a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.698+0000 7f43df95a700 1 --2- 172.21.15.134:0/4160710400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d81047b0 0x7f43d8198450 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.698+0000 7f43df95a700 1 -- 172.21.15.134:0/4160710400 >> 172.21.15.134:0/4160710400 conn(0x7f43d80ffe20 msgr2=0x7f43d81014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.698+0000 7f43df95a700 1 -- 172.21.15.134:0/4160710400 shutdown_connections 2024-04-13T10:48:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:28.698+0000 7f43df95a700 1 -- 172.21.15.134:0/4160710400 wait complete. 2024-04-13T10:48:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for the mgr to restart... 2024-04-13T10:48:29.496 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr epoch 5... 2024-04-13T10:48:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: Active manager daemon smithi134.tmanda restarted 2024-04-13T10:48:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: Activating manager daemon smithi134.tmanda 2024-04-13T10:48:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: osdmap e2: 0 total, 0 up, 0 in 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: mgrmap e6: smithi134.tmanda(active, starting, since 0.00303193s) 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr metadata", "who": "smithi134.tmanda", "id": "smithi134.tmanda"}]: dispatch 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: Manager daemon smithi134.tmanda is now available 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:48:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:33 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:48:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:34 smithi134 ceph-mon[39696]: Found migration_current of "None". Setting to last migration. 2024-04-13T10:48:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:34 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/mirror_snapshot_schedule"}]: dispatch 2024-04-13T10:48:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:34 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/trash_purge_schedule"}]: dispatch 2024-04-13T10:48:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:34 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:34 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:34 smithi134 ceph-mon[39696]: mgrmap e7: smithi134.tmanda(active, since 1.00506s) 2024-04-13T10:48:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-04-13T10:48:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-13T10:48:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-13T10:48:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-04-13T10:48:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.324+0000 7fe7ee19d700 1 Processor -- start 2024-04-13T10:48:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.324+0000 7fe7ee19d700 1 -- start start 2024-04-13T10:48:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.324+0000 7fe7ee19d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e8105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.325+0000 7fe7ee19d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8106210 con 0x7fe7e81058c0 2024-04-13T10:48:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.325+0000 7fe7e77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e8105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.325+0000 7fe7e77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e8105cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35218/0 (socket says 172.21.15.134:35218) 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.325+0000 7fe7e77fe700 1 -- 172.21.15.134:0/2024424328 learned_addr learned my addr 172.21.15.134:0/2024424328 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.325+0000 7fe7e77fe700 1 -- 172.21.15.134:0/2024424328 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8106350 con 0x7fe7e81058c0 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.325+0000 7fe7e77fe700 1 --2- 172.21.15.134:0/2024424328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e8105cd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80098a0 tx=0x7fe7d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d5bbae16d61cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.325+0000 7fe7e67fc700 1 -- 172.21.15.134:0/2024424328 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7d8004180 con 0x7fe7e81058c0 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.325+0000 7fe7e67fc700 1 -- 172.21.15.134:0/2024424328 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fe7d80042e0 con 0x7fe7e81058c0 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.325+0000 7fe7e67fc700 1 -- 172.21.15.134:0/2024424328 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7d80119d0 con 0x7fe7e81058c0 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.326+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2024424328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 msgr2=0x7fe7e8105cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.326+0000 7fe7ee19d700 1 --2- 172.21.15.134:0/2024424328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e8105cd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80098a0 tx=0x7fe7d8009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.326+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2024424328 shutdown_connections 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.326+0000 7fe7ee19d700 1 --2- 172.21.15.134:0/2024424328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e8105cd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.326+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2024424328 >> 172.21.15.134:0/2024424328 conn(0x7fe7e8100f30 msgr2=0x7fe7e8103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:35.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.326+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2024424328 shutdown_connections 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.326+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2024424328 wait complete. 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.327+0000 7fe7ee19d700 1 Processor -- start 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.327+0000 7fe7ee19d700 1 -- start start 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.327+0000 7fe7ee19d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e81995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.327+0000 7fe7ee19d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8199b10 con 0x7fe7e81058c0 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.327+0000 7fe7e77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e81995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.327+0000 7fe7e77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e81995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35226/0 (socket says 172.21.15.134:35226) 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.327+0000 7fe7e77fe700 1 -- 172.21.15.134:0/2756990611 learned_addr learned my addr 172.21.15.134:0/2756990611 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.328+0000 7fe7e77fe700 1 -- 172.21.15.134:0/2756990611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8009550 con 0x7fe7e81058c0 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.328+0000 7fe7e77fe700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e81995d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009130 tx=0x7fe7d8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.328+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7d8003900 con 0x7fe7e81058c0 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.328+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7fe7d8003a60 con 0x7fe7e81058c0 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.328+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2756990611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e8199d10 con 0x7fe7e81058c0 2024-04-13T10:48:35.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.328+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7d80246e0 con 0x7fe7e81058c0 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.328+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2756990611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e819a130 con 0x7fe7e81058c0 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.329+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fe7d802d3f0 con 0x7fe7e81058c0 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.329+0000 7fe7e4ff9700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 0x7fe7d003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.329+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2756990611 --> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7e8062380 con 0x7fe7d0038440 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.329+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe7d804c250 con 0x7fe7e81058c0 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.329+0000 7fe7e6ffd700 1 -- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 msgr2=0x7fe7d003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3448754383 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.329+0000 7fe7e6ffd700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 0x7fe7d003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.530+0000 7fe7e6ffd700 1 -- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 msgr2=0x7fe7d003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3448754383 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.530+0000 7fe7e6ffd700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 0x7fe7d003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.931+0000 7fe7e6ffd700 1 -- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 msgr2=0x7fe7d003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3448754383 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:30.931+0000 7fe7e6ffd700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 0x7fe7d003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:31.732+0000 7fe7e6ffd700 1 -- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 msgr2=0x7fe7d003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3448754383 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:31.732+0000 7fe7e6ffd700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 0x7fe7d003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:33.333+0000 7fe7e6ffd700 1 -- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 msgr2=0x7fe7d003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3448754383 2024-04-13T10:48:35.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:33.333+0000 7fe7e6ffd700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 0x7fe7d003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:33.850+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7fe7d801ab80 con 0x7fe7e81058c0 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:33.850+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 msgr2=0x7fe7d003a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:33.850+0000 7fe7e4ff9700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 0x7fe7d003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.851+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7fe7d804b050 con 0x7fe7e81058c0 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.851+0000 7fe7e4ff9700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fe7d003bb60 0x7fe7d003df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.851+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7e8062380 con 0x7fe7d003bb60 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.851+0000 7fe7e6ffd700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fe7d003bb60 0x7fe7d003df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.852+0000 7fe7e6ffd700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fe7d003bb60 0x7fe7d003df40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc003a10 tx=0x7fe7dc0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.853+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fe7e8062380 con 0x7fe7d003bb60 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2756990611 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fe7e819a910 con 0x7fe7d003bb60 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7e4ff9700 1 -- 172.21.15.134:0/2756990611 <== mgr.14118 v2:172.21.15.134:6800/1656434316 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe7e819a910 con 0x7fe7d003bb60 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fe7d003bb60 msgr2=0x7fe7d003df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:35.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7ee19d700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fe7d003bb60 0x7fe7d003df40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc003a10 tx=0x7fe7dc0092b0 comp rx=0 tx=0).stop 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 msgr2=0x7fe7e81995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7ee19d700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e81995d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009130 tx=0x7fe7d8011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2756990611 shutdown_connections 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7ee19d700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fe7d003bb60 0x7fe7d003df40 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7ee19d700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e81058c0 0x7fe7e81995d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7ee19d700 1 --2- 172.21.15.134:0/2756990611 >> [v2:172.21.15.134:6800/3448754383,v1:172.21.15.134:6801/3448754383] conn(0x7fe7d0038440 0x7fe7d003a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.859+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2756990611 >> 172.21.15.134:0/2756990611 conn(0x7fe7e8100f30 msgr2=0x7fe7e81025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.860+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2756990611 shutdown_connections 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:34.860+0000 7fe7ee19d700 1 -- 172.21.15.134:0/2756990611 wait complete. 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:mgr epoch 5 is available 2024-04-13T10:48:35.594 INFO:teuthology.orchestra.run.smithi134.stdout:Setting orchestrator backend to cephadm... 2024-04-13T10:48:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:35 smithi134 ceph-mon[39696]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-13T10:48:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:35 smithi134 ceph-mon[39696]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-13T10:48:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:35 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:48:37.027 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.191+0000 7f1257463700 1 Processor -- start 2024-04-13T10:48:37.027 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.192+0000 7f1257463700 1 -- start start 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.192+0000 7f1257463700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f1250104330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.192+0000 7f1257463700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250104870 con 0x7f1250103f20 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.192+0000 7f12551ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f1250104330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.192+0000 7f12551ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f1250104330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35292/0 (socket says 172.21.15.134:35292) 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.192+0000 7f12551ff700 1 -- 172.21.15.134:0/1769352597 learned_addr learned my addr 172.21.15.134:0/1769352597 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.192+0000 7f12551ff700 1 -- 172.21.15.134:0/1769352597 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12501049b0 con 0x7f1250103f20 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.192+0000 7f12551ff700 1 --2- 172.21.15.134:0/1769352597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f1250104330 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f12400098a0 tx=0x7f1240009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb7f915e5a599b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.192+0000 7f1247fff700 1 -- 172.21.15.134:0/1769352597 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1240004180 con 0x7f1250103f20 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.193+0000 7f1247fff700 1 -- 172.21.15.134:0/1769352597 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f12400042e0 con 0x7f1250103f20 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.193+0000 7f1247fff700 1 -- 172.21.15.134:0/1769352597 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12400119d0 con 0x7f1250103f20 2024-04-13T10:48:37.028 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.193+0000 7f1257463700 1 -- 172.21.15.134:0/1769352597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 msgr2=0x7f1250104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.193+0000 7f1257463700 1 --2- 172.21.15.134:0/1769352597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f1250104330 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f12400098a0 tx=0x7f1240009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.193+0000 7f1257463700 1 -- 172.21.15.134:0/1769352597 shutdown_connections 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.193+0000 7f1257463700 1 --2- 172.21.15.134:0/1769352597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f1250104330 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.193+0000 7f1257463700 1 -- 172.21.15.134:0/1769352597 >> 172.21.15.134:0/1769352597 conn(0x7f12500ff590 msgr2=0x7f12501019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.193+0000 7f1257463700 1 -- 172.21.15.134:0/1769352597 shutdown_connections 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.193+0000 7f1257463700 1 -- 172.21.15.134:0/1769352597 wait complete. 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.194+0000 7f1257463700 1 Processor -- start 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.194+0000 7f1257463700 1 -- start start 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.194+0000 7f1257463700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f125019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.194+0000 7f1257463700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125019bc80 con 0x7f1250103f20 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.194+0000 7f12551ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f125019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:37.029 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.194+0000 7f12551ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f125019b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35300/0 (socket says 172.21.15.134:35300) 2024-04-13T10:48:37.030 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.194+0000 7f12551ff700 1 -- 172.21.15.134:0/2861212479 learned_addr learned my addr 172.21.15.134:0/2861212479 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:37.030 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.194+0000 7f12551ff700 1 -- 172.21.15.134:0/2861212479 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240009550 con 0x7f1250103f20 2024-04-13T10:48:37.030 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.195+0000 7f12551ff700 1 --2- 172.21.15.134:0/2861212479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f125019b740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1240006af0 tx=0x7f1240011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:37.030 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.195+0000 7f12467fc700 1 -- 172.21.15.134:0/2861212479 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1240024430 con 0x7f1250103f20 2024-04-13T10:48:37.030 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.195+0000 7f12467fc700 1 -- 172.21.15.134:0/2861212479 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f12400249e0 con 0x7f1250103f20 2024-04-13T10:48:37.030 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.195+0000 7f12467fc700 1 -- 172.21.15.134:0/2861212479 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f124001aa00 con 0x7f1250103f20 2024-04-13T10:48:37.030 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.195+0000 7f1257463700 1 -- 172.21.15.134:0/2861212479 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125019be80 con 0x7f1250103f20 2024-04-13T10:48:37.030 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.195+0000 7f1257463700 1 -- 172.21.15.134:0/2861212479 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125019c2a0 con 0x7f1250103f20 2024-04-13T10:48:37.030 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.196+0000 7f12467fc700 1 -- 172.21.15.134:0/2861212479 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f124001ac70 con 0x7f1250103f20 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.196+0000 7f12467fc700 1 --2- 172.21.15.134:0/2861212479 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f123c038440 0x7f123c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.196+0000 7f1257463700 1 -- 172.21.15.134:0/2861212479 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1250062380 con 0x7f1250103f20 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.196+0000 7f12467fc700 1 -- 172.21.15.134:0/2861212479 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f124004c680 con 0x7f1250103f20 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.196+0000 7f12549fe700 1 --2- 172.21.15.134:0/2861212479 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f123c038440 0x7f123c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.196+0000 7f12549fe700 1 --2- 172.21.15.134:0/2861212479 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f123c038440 0x7f123c03a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f124c006fd0 tx=0x7f124c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.201+0000 7f12467fc700 1 -- 172.21.15.134:0/2861212479 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f124002d3f0 con 0x7f1250103f20 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.404+0000 7f1257463700 1 -- 172.21.15.134:0/2861212479 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f125018b800 con 0x7f123c038440 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.411+0000 7f12467fc700 1 -- 172.21.15.134:0/2861212479 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f125018b800 con 0x7f123c038440 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.413+0000 7f1257463700 1 -- 172.21.15.134:0/2861212479 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f123c038440 msgr2=0x7f123c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.413+0000 7f1257463700 1 --2- 172.21.15.134:0/2861212479 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f123c038440 0x7f123c03a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f124c006fd0 tx=0x7f124c006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.413+0000 7f1257463700 1 -- 172.21.15.134:0/2861212479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 msgr2=0x7f125019b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.413+0000 7f1257463700 1 --2- 172.21.15.134:0/2861212479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f125019b740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1240006af0 tx=0x7f1240011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:37.031 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.413+0000 7f1257463700 1 -- 172.21.15.134:0/2861212479 shutdown_connections 2024-04-13T10:48:37.032 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.413+0000 7f1257463700 1 --2- 172.21.15.134:0/2861212479 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f123c038440 0x7f123c03a8f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:37.032 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.413+0000 7f1257463700 1 --2- 172.21.15.134:0/2861212479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1250103f20 0x7f125019b740 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:37.032 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.414+0000 7f1257463700 1 -- 172.21.15.134:0/2861212479 >> 172.21.15.134:0/2861212479 conn(0x7f12500ff590 msgr2=0x7f125018b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:37.032 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.414+0000 7f1257463700 1 -- 172.21.15.134:0/2861212479 shutdown_connections 2024-04-13T10:48:37.032 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:36.414+0000 7f1257463700 1 -- 172.21.15.134:0/2861212479 wait complete. 2024-04-13T10:48:37.032 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:36 smithi134 ceph-mon[39696]: [13/Apr/2024:10:48:35] ENGINE Bus STARTING 2024-04-13T10:48:37.032 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:36 smithi134 ceph-mon[39696]: [13/Apr/2024:10:48:35] ENGINE Serving on https://172.21.15.134:7150 2024-04-13T10:48:37.033 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:36 smithi134 ceph-mon[39696]: [13/Apr/2024:10:48:35] ENGINE Serving on http://172.21.15.134:8765 2024-04-13T10:48:37.033 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:36 smithi134 ceph-mon[39696]: [13/Apr/2024:10:48:35] ENGINE Bus STARTED 2024-04-13T10:48:37.033 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:36 smithi134 ceph-mon[39696]: mgrmap e8: smithi134.tmanda(active, since 2s) 2024-04-13T10:48:37.033 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:36 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:37.033 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:36 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:48:38.143 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:37 smithi134 ceph-mon[39696]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:38.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-13T10:48:38.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f36111c1700 1 Processor -- start 2024-04-13T10:48:38.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f36111c1700 1 -- start start 2024-04-13T10:48:38.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f36111c1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1084b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:38.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f36111c1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c1089f0 con 0x7f360c0742e0 2024-04-13T10:48:38.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f360ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:38.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f360ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1084b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35314/0 (socket says 172.21.15.134:35314) 2024-04-13T10:48:38.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f360ad9d700 1 -- 172.21.15.134:0/3505429839 learned_addr learned my addr 172.21.15.134:0/3505429839 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f360ad9d700 1 -- 172.21.15.134:0/3505429839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c108b30 con 0x7f360c0742e0 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f360ad9d700 1 --2- 172.21.15.134:0/3505429839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1084b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36000098a0 tx=0x7f3600009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34aa02c2388f0d0b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f3609d9b700 1 -- 172.21.15.134:0/3505429839 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3600004180 con 0x7f360c0742e0 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f3609d9b700 1 -- 172.21.15.134:0/3505429839 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f36000042e0 con 0x7f360c0742e0 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.527+0000 7f3609d9b700 1 -- 172.21.15.134:0/3505429839 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36000119d0 con 0x7f360c0742e0 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.528+0000 7f36111c1700 1 -- 172.21.15.134:0/3505429839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 msgr2=0x7f360c1084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.528+0000 7f36111c1700 1 --2- 172.21.15.134:0/3505429839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1084b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36000098a0 tx=0x7f3600009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.528+0000 7f36111c1700 1 -- 172.21.15.134:0/3505429839 shutdown_connections 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.528+0000 7f36111c1700 1 --2- 172.21.15.134:0/3505429839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1084b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.528+0000 7f36111c1700 1 -- 172.21.15.134:0/3505429839 >> 172.21.15.134:0/3505429839 conn(0x7f360c0ffe20 msgr2=0x7f360c102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.528+0000 7f36111c1700 1 -- 172.21.15.134:0/3505429839 shutdown_connections 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.528+0000 7f36111c1700 1 -- 172.21.15.134:0/3505429839 wait complete. 2024-04-13T10:48:38.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.529+0000 7f36111c1700 1 Processor -- start 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.529+0000 7f36111c1700 1 -- start start 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.529+0000 7f36111c1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.529+0000 7f36111c1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c199af0 con 0x7f360c0742e0 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.529+0000 7f360ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.529+0000 7f360ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35326/0 (socket says 172.21.15.134:35326) 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.529+0000 7f360ad9d700 1 -- 172.21.15.134:0/1279038305 learned_addr learned my addr 172.21.15.134:0/1279038305 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.529+0000 7f360ad9d700 1 -- 172.21.15.134:0/1279038305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600009550 con 0x7f360c0742e0 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.529+0000 7f360ad9d700 1 --2- 172.21.15.134:0/1279038305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1995b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3600006af0 tx=0x7f3600011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.530+0000 7f35f3fff700 1 -- 172.21.15.134:0/1279038305 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3600024430 con 0x7f360c0742e0 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.530+0000 7f36111c1700 1 -- 172.21.15.134:0/1279038305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c199cf0 con 0x7f360c0742e0 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.530+0000 7f35f3fff700 1 -- 172.21.15.134:0/1279038305 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f36000249e0 con 0x7f360c0742e0 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.530+0000 7f35f3fff700 1 -- 172.21.15.134:0/1279038305 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f360001a970 con 0x7f360c0742e0 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.530+0000 7f36111c1700 1 -- 172.21.15.134:0/1279038305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c19a110 con 0x7f360c0742e0 2024-04-13T10:48:38.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.530+0000 7f35f3fff700 1 -- 172.21.15.134:0/1279038305 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f360001ac30 con 0x7f360c0742e0 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.531+0000 7f36111c1700 1 -- 172.21.15.134:0/1279038305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c062380 con 0x7f360c0742e0 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.531+0000 7f35f3fff700 1 --2- 172.21.15.134:0/1279038305 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f35f40383f0 0x7f35f403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.531+0000 7f35f3fff700 1 -- 172.21.15.134:0/1279038305 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f360004c4e0 con 0x7f360c0742e0 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.531+0000 7f360a59c700 1 --2- 172.21.15.134:0/1279038305 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f35f40383f0 0x7f35f403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.531+0000 7f360a59c700 1 --2- 172.21.15.134:0/1279038305 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f35f40383f0 0x7f35f403a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f35fc006fd0 tx=0x7f35fc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.535+0000 7f35f3fff700 1 -- 172.21.15.134:0/1279038305 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f360002de30 con 0x7f360c0742e0 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.725+0000 7f36111c1700 1 -- 172.21.15.134:0/1279038305 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f360c102150 con 0x7f35f40383f0 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.726+0000 7f35f3fff700 1 -- 172.21.15.134:0/1279038305 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f360c102150 con 0x7f35f40383f0 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.728+0000 7f36111c1700 1 -- 172.21.15.134:0/1279038305 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f35f40383f0 msgr2=0x7f35f403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.728+0000 7f36111c1700 1 --2- 172.21.15.134:0/1279038305 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f35f40383f0 0x7f35f403a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f35fc006fd0 tx=0x7f35fc006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.728+0000 7f36111c1700 1 -- 172.21.15.134:0/1279038305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 msgr2=0x7f360c1995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.728+0000 7f36111c1700 1 --2- 172.21.15.134:0/1279038305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1995b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3600006af0 tx=0x7f3600011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:38.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.728+0000 7f36111c1700 1 -- 172.21.15.134:0/1279038305 shutdown_connections 2024-04-13T10:48:38.457 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.728+0000 7f36111c1700 1 --2- 172.21.15.134:0/1279038305 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f35f40383f0 0x7f35f403a8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:38.457 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.728+0000 7f36111c1700 1 --2- 172.21.15.134:0/1279038305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c0742e0 0x7f360c1995b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:38.457 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.728+0000 7f36111c1700 1 -- 172.21.15.134:0/1279038305 >> 172.21.15.134:0/1279038305 conn(0x7f360c0ffe20 msgr2=0x7f360c101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:38.457 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.729+0000 7f36111c1700 1 -- 172.21.15.134:0/1279038305 shutdown_connections 2024-04-13T10:48:38.457 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:37.729+0000 7f36111c1700 1 -- 172.21.15.134:0/1279038305 wait complete. 2024-04-13T10:48:38.457 INFO:teuthology.orchestra.run.smithi134.stdout:Generating ssh key... 2024-04-13T10:48:39.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:38 smithi134 ceph-mon[39696]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:40.123 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.989+0000 7f9b02976700 1 Processor -- start 2024-04-13T10:48:40.123 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.989+0000 7f9b02976700 1 -- start start 2024-04-13T10:48:40.123 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.990+0000 7f9b02976700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc1087e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:40.123 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.990+0000 7f9b02976700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc074380 con 0x7f9afc106400 2024-04-13T10:48:40.123 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.990+0000 7f9afbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc1087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:40.123 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.990+0000 7f9afbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc1087e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35338/0 (socket says 172.21.15.134:35338) 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.990+0000 7f9afbfff700 1 -- 172.21.15.134:0/4027015042 learned_addr learned my addr 172.21.15.134:0/4027015042 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.990+0000 7f9afbfff700 1 -- 172.21.15.134:0/4027015042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0744c0 con 0x7f9afc106400 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.990+0000 7f9afbfff700 1 --2- 172.21.15.134:0/4027015042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc1087e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0098a0 tx=0x7f9aec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fc64479047f36e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.990+0000 7f9afaffd700 1 -- 172.21.15.134:0/4027015042 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9aec004180 con 0x7f9afc106400 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.990+0000 7f9afaffd700 1 -- 172.21.15.134:0/4027015042 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f9aec0042e0 con 0x7f9afc106400 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.990+0000 7f9afaffd700 1 -- 172.21.15.134:0/4027015042 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9aec0119d0 con 0x7f9afc106400 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.991+0000 7f9b02976700 1 -- 172.21.15.134:0/4027015042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 msgr2=0x7f9afc1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.991+0000 7f9b02976700 1 --2- 172.21.15.134:0/4027015042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc1087e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0098a0 tx=0x7f9aec009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.991+0000 7f9b02976700 1 -- 172.21.15.134:0/4027015042 shutdown_connections 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.991+0000 7f9b02976700 1 --2- 172.21.15.134:0/4027015042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc1087e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.991+0000 7f9b02976700 1 -- 172.21.15.134:0/4027015042 >> 172.21.15.134:0/4027015042 conn(0x7f9afc0ffe20 msgr2=0x7f9afc102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.991+0000 7f9b02976700 1 -- 172.21.15.134:0/4027015042 shutdown_connections 2024-04-13T10:48:40.124 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.991+0000 7f9b02976700 1 -- 172.21.15.134:0/4027015042 wait complete. 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.992+0000 7f9b02976700 1 Processor -- start 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.992+0000 7f9b02976700 1 -- start start 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.992+0000 7f9b02976700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc105d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.992+0000 7f9b02976700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc1062a0 con 0x7f9afc106400 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.992+0000 7f9afbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc105d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.992+0000 7f9afbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc105d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35348/0 (socket says 172.21.15.134:35348) 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.992+0000 7f9afbfff700 1 -- 172.21.15.134:0/2683952320 learned_addr learned my addr 172.21.15.134:0/2683952320 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.992+0000 7f9afbfff700 1 -- 172.21.15.134:0/2683952320 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec009550 con 0x7f9afc106400 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.992+0000 7f9afbfff700 1 --2- 172.21.15.134:0/2683952320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc105d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9aec006af0 tx=0x7f9aec011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.993+0000 7f9af97fa700 1 -- 172.21.15.134:0/2683952320 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9aec003b40 con 0x7f9afc106400 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.993+0000 7f9af97fa700 1 -- 172.21.15.134:0/2683952320 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f9aec01a880 con 0x7f9afc106400 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.993+0000 7f9af97fa700 1 -- 172.21.15.134:0/2683952320 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9aec019890 con 0x7f9afc106400 2024-04-13T10:48:40.125 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.993+0000 7f9b02976700 1 -- 172.21.15.134:0/2683952320 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc104410 con 0x7f9afc106400 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.993+0000 7f9b02976700 1 -- 172.21.15.134:0/2683952320 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc104890 con 0x7f9afc106400 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.993+0000 7f9af97fa700 1 -- 172.21.15.134:0/2683952320 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9aec01a9f0 con 0x7f9afc106400 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.994+0000 7f9af97fa700 1 --2- 172.21.15.134:0/2683952320 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f9ae4038400 0x7f9ae403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.994+0000 7f9b02976700 1 -- 172.21.15.134:0/2683952320 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc109880 con 0x7f9afc106400 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.994+0000 7f9af97fa700 1 -- 172.21.15.134:0/2683952320 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9aec04c730 con 0x7f9afc106400 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.994+0000 7f9afb7fe700 1 --2- 172.21.15.134:0/2683952320 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f9ae4038400 0x7f9ae403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.994+0000 7f9afb7fe700 1 --2- 172.21.15.134:0/2683952320 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f9ae4038400 0x7f9ae403a8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9af0006fd0 tx=0x7f9af0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:38.999+0000 7f9af97fa700 1 -- 172.21.15.134:0/2683952320 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9aec01adf0 con 0x7f9afc106400 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.185+0000 7f9b02976700 1 -- 172.21.15.134:0/2683952320 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f9afc1020d0 con 0x7f9ae4038400 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.407+0000 7f9af97fa700 1 -- 172.21.15.134:0/2683952320 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9afc1020d0 con 0x7f9ae4038400 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.409+0000 7f9b02976700 1 -- 172.21.15.134:0/2683952320 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f9ae4038400 msgr2=0x7f9ae403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.409+0000 7f9b02976700 1 --2- 172.21.15.134:0/2683952320 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f9ae4038400 0x7f9ae403a8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9af0006fd0 tx=0x7f9af0006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:40.126 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.409+0000 7f9b02976700 1 -- 172.21.15.134:0/2683952320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 msgr2=0x7f9afc105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.409+0000 7f9b02976700 1 --2- 172.21.15.134:0/2683952320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc105d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9aec006af0 tx=0x7f9aec011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.409+0000 7f9b02976700 1 -- 172.21.15.134:0/2683952320 shutdown_connections 2024-04-13T10:48:40.127 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.409+0000 7f9b02976700 1 --2- 172.21.15.134:0/2683952320 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f9ae4038400 0x7f9ae403a8b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:39 smithi134 ceph-mon[39696]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:39 smithi134 ceph-mon[39696]: Generating ssh key... 2024-04-13T10:48:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:39 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:39 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.409+0000 7f9b02976700 1 --2- 172.21.15.134:0/2683952320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9afc106400 0x7f9afc105d60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.409+0000 7f9b02976700 1 -- 172.21.15.134:0/2683952320 >> 172.21.15.134:0/2683952320 conn(0x7f9afc0ffe20 msgr2=0x7f9afc1014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.409+0000 7f9b02976700 1 -- 172.21.15.134:0/2683952320 shutdown_connections 2024-04-13T10:48:40.128 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:39.409+0000 7f9b02976700 1 -- 172.21.15.134:0/2683952320 wait complete. 2024-04-13T10:48:41.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn+rVs2MGTIY7OkY+kaeWrk2kRwgPlrYoyq56DnelerR3OnfRenGDZ5Jno22uedTO8zfPaavNwlTA8ct7AmWsAj/IUb/4h8/K2AbJD0SEVvxUfLTLh8RsvNaSkD0PknVRuYAT8yi9CuRDw0OqCyHnjQItqYhlAo2rIH2ViMboy9Q30wT8EATb2uEPMaL+IKGe3aAwLcxIDJ3lnxjgxK8X8xGpOKVflkMTO/xkQ1ELU+jKWlvK0YI3FbLCjDjnI99aov8WbJAv3ratJCY3Ou1xQZaYoGBCYRa6hokYNgQTL25nplui9B5BB6NXE6dyFn022jMeNTxJl+HI6trpZGCupJrXv5Vh0PQxz6HS3l7HyDPW1W+aga/OeJbswYWlnO/GRQupQOh6gaNXEB6szqZDwqP9KanYTkWZ/ahMLXf9FZFi5khVZvVbDzwaImTKyd/NFp9IZ2UsK0pBeZ+rp+jiSD2tZrJuHeVT+mwQQ55K7ErI2RgIFfl41xAOOI9HYdUM= ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.887+0000 7efe41b60700 1 Processor -- start 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.887+0000 7efe41b60700 1 -- start start 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.887+0000 7efe41b60700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c108490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.887+0000 7efe41b60700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1089d0 con 0x7efe3c074300 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.887+0000 7efe3b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.887+0000 7efe3b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c108490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39444/0 (socket says 172.21.15.134:39444) 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.887+0000 7efe3b7fe700 1 -- 172.21.15.134:0/3121143973 learned_addr learned my addr 172.21.15.134:0/3121143973 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.888+0000 7efe3b7fe700 1 -- 172.21.15.134:0/3121143973 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c108b10 con 0x7efe3c074300 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.888+0000 7efe3b7fe700 1 --2- 172.21.15.134:0/3121143973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c108490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efe240098a0 tx=0x7efe24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39e7d5085f53d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.888+0000 7efe3a7fc700 1 -- 172.21.15.134:0/3121143973 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe24004180 con 0x7efe3c074300 2024-04-13T10:48:41.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.888+0000 7efe3a7fc700 1 -- 172.21.15.134:0/3121143973 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7efe240042e0 con 0x7efe3c074300 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.888+0000 7efe3a7fc700 1 -- 172.21.15.134:0/3121143973 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe240119d0 con 0x7efe3c074300 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.889+0000 7efe41b60700 1 -- 172.21.15.134:0/3121143973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 msgr2=0x7efe3c108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.889+0000 7efe41b60700 1 --2- 172.21.15.134:0/3121143973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c108490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efe240098a0 tx=0x7efe24009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.889+0000 7efe41b60700 1 -- 172.21.15.134:0/3121143973 shutdown_connections 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.889+0000 7efe41b60700 1 --2- 172.21.15.134:0/3121143973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c108490 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.889+0000 7efe41b60700 1 -- 172.21.15.134:0/3121143973 >> 172.21.15.134:0/3121143973 conn(0x7efe3c0ffe20 msgr2=0x7efe3c102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.889+0000 7efe41b60700 1 -- 172.21.15.134:0/3121143973 shutdown_connections 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.889+0000 7efe41b60700 1 -- 172.21.15.134:0/3121143973 wait complete. 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.889+0000 7efe41b60700 1 Processor -- start 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.889+0000 7efe41b60700 1 -- start start 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe41b60700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe41b60700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c199b20 con 0x7efe3c074300 2024-04-13T10:48:41.675 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe3b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe3b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c1995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39450/0 (socket says 172.21.15.134:39450) 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe3b7fe700 1 -- 172.21.15.134:0/3588997 learned_addr learned my addr 172.21.15.134:0/3588997 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe3b7fe700 1 -- 172.21.15.134:0/3588997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe24009550 con 0x7efe3c074300 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe3b7fe700 1 --2- 172.21.15.134:0/3588997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c1995e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe24009130 tx=0x7efe24011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe38ff9700 1 -- 172.21.15.134:0/3588997 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe240039c0 con 0x7efe3c074300 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe38ff9700 1 -- 172.21.15.134:0/3588997 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7efe24003b20 con 0x7efe3c074300 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe38ff9700 1 -- 172.21.15.134:0/3588997 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe24019780 con 0x7efe3c074300 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe41b60700 1 -- 172.21.15.134:0/3588997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c199d20 con 0x7efe3c074300 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.890+0000 7efe41b60700 1 -- 172.21.15.134:0/3588997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c19a140 con 0x7efe3c074300 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.891+0000 7efe38ff9700 1 -- 172.21.15.134:0/3588997 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7efe240199b0 con 0x7efe3c074300 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.891+0000 7efe41b60700 1 -- 172.21.15.134:0/3588997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c062380 con 0x7efe3c074300 2024-04-13T10:48:41.676 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.891+0000 7efe38ff9700 1 --2- 172.21.15.134:0/3588997 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7efe28038440 0x7efe2803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.891+0000 7efe38ff9700 1 -- 172.21.15.134:0/3588997 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7efe2404c4d0 con 0x7efe3c074300 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.891+0000 7efe3affd700 1 --2- 172.21.15.134:0/3588997 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7efe28038440 0x7efe2803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.892+0000 7efe3affd700 1 --2- 172.21.15.134:0/3588997 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7efe28038440 0x7efe2803a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe2c006fd0 tx=0x7efe2c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:40.896+0000 7efe38ff9700 1 -- 172.21.15.134:0/3588997 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efe24018db0 con 0x7efe3c074300 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.083+0000 7efe41b60700 1 -- 172.21.15.134:0/3588997 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7efe3c1020f0 con 0x7efe28038440 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.083+0000 7efe38ff9700 1 -- 172.21.15.134:0/3588997 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7efe3c1020f0 con 0x7efe28038440 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.085+0000 7efe41b60700 1 -- 172.21.15.134:0/3588997 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7efe28038440 msgr2=0x7efe2803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.085+0000 7efe41b60700 1 --2- 172.21.15.134:0/3588997 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7efe28038440 0x7efe2803a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe2c006fd0 tx=0x7efe2c006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.085+0000 7efe41b60700 1 -- 172.21.15.134:0/3588997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 msgr2=0x7efe3c1995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.085+0000 7efe41b60700 1 --2- 172.21.15.134:0/3588997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c1995e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe24009130 tx=0x7efe24011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:41.677 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.085+0000 7efe41b60700 1 -- 172.21.15.134:0/3588997 shutdown_connections 2024-04-13T10:48:41.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.085+0000 7efe41b60700 1 --2- 172.21.15.134:0/3588997 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7efe28038440 0x7efe2803a8f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:41.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.085+0000 7efe41b60700 1 --2- 172.21.15.134:0/3588997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe3c074300 0x7efe3c1995e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:41.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.085+0000 7efe41b60700 1 -- 172.21.15.134:0/3588997 >> 172.21.15.134:0/3588997 conn(0x7efe3c0ffe20 msgr2=0x7efe3c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:41.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.085+0000 7efe41b60700 1 -- 172.21.15.134:0/3588997 shutdown_connections 2024-04-13T10:48:41.678 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:41.085+0000 7efe41b60700 1 -- 172.21.15.134:0/3588997 wait complete. 2024-04-13T10:48:41.678 INFO:teuthology.orchestra.run.smithi134.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-13T10:48:41.678 INFO:teuthology.orchestra.run.smithi134.stdout:Adding key to root@localhost authorized_keys... 2024-04-13T10:48:41.678 INFO:teuthology.orchestra.run.smithi134.stdout:Adding host smithi134... 2024-04-13T10:48:42.504 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:42 smithi134 ceph-mon[39696]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:43 smithi134 ceph-mon[39696]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "addr": "172.21.15.134", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:43 smithi134 ceph-mon[39696]: Deploying cephadm binary to smithi134 2024-04-13T10:48:45.198 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Added host 'smithi134' with addr '172.21.15.134' 2024-04-13T10:48:45.198 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.174+0000 7f1e201d1700 1 Processor -- start 2024-04-13T10:48:45.198 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.175+0000 7f1e201d1700 1 -- start start 2024-04-13T10:48:45.198 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.175+0000 7f1e201d1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e18104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:45.198 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.175+0000 7f1e201d1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18105100 con 0x7f1e181047b0 2024-04-13T10:48:45.198 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.175+0000 7f1e1df6d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e18104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.175+0000 7f1e1df6d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e18104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39454/0 (socket says 172.21.15.134:39454) 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.175+0000 7f1e1df6d700 1 -- 172.21.15.134:0/3684575491 learned_addr learned my addr 172.21.15.134:0/3684575491 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.175+0000 7f1e1df6d700 1 -- 172.21.15.134:0/3684575491 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e18105240 con 0x7f1e181047b0 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.175+0000 7f1e1df6d700 1 --2- 172.21.15.134:0/3684575491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e18104bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e140098a0 tx=0x7f1e14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6f72de6c01dc3e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.175+0000 7f1e1cf6b700 1 -- 172.21.15.134:0/3684575491 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e14004180 con 0x7f1e181047b0 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.176+0000 7f1e1cf6b700 1 -- 172.21.15.134:0/3684575491 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f1e140042e0 con 0x7f1e181047b0 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.176+0000 7f1e1cf6b700 1 -- 172.21.15.134:0/3684575491 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e140119d0 con 0x7f1e181047b0 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.176+0000 7f1e201d1700 1 -- 172.21.15.134:0/3684575491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 msgr2=0x7f1e18104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.176+0000 7f1e201d1700 1 --2- 172.21.15.134:0/3684575491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e18104bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e140098a0 tx=0x7f1e14009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.176+0000 7f1e201d1700 1 -- 172.21.15.134:0/3684575491 shutdown_connections 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.176+0000 7f1e201d1700 1 --2- 172.21.15.134:0/3684575491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e18104bc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:45.199 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.176+0000 7f1e201d1700 1 -- 172.21.15.134:0/3684575491 >> 172.21.15.134:0/3684575491 conn(0x7f1e180ffe00 msgr2=0x7f1e18102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.176+0000 7f1e201d1700 1 -- 172.21.15.134:0/3684575491 shutdown_connections 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.176+0000 7f1e201d1700 1 -- 172.21.15.134:0/3684575491 wait complete. 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.177+0000 7f1e201d1700 1 Processor -- start 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.177+0000 7f1e201d1700 1 -- start start 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.177+0000 7f1e201d1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e181984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.177+0000 7f1e201d1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18198a20 con 0x7f1e181047b0 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.177+0000 7f1e1df6d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e181984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.177+0000 7f1e1df6d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e181984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39466/0 (socket says 172.21.15.134:39466) 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.177+0000 7f1e1df6d700 1 -- 172.21.15.134:0/3256052006 learned_addr learned my addr 172.21.15.134:0/3256052006 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.178+0000 7f1e1df6d700 1 -- 172.21.15.134:0/3256052006 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e14009550 con 0x7f1e181047b0 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.178+0000 7f1e1df6d700 1 --2- 172.21.15.134:0/3256052006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e181984e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009130 tx=0x7f1e14011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.178+0000 7f1e0effd700 1 -- 172.21.15.134:0/3256052006 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e14003900 con 0x7f1e181047b0 2024-04-13T10:48:45.200 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.178+0000 7f1e0effd700 1 -- 172.21.15.134:0/3256052006 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7f1e14003a60 con 0x7f1e181047b0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.178+0000 7f1e201d1700 1 -- 172.21.15.134:0/3256052006 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e18198c20 con 0x7f1e181047b0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.178+0000 7f1e0effd700 1 -- 172.21.15.134:0/3256052006 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e140246e0 con 0x7f1e181047b0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.178+0000 7f1e201d1700 1 -- 172.21.15.134:0/3256052006 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e18199040 con 0x7f1e181047b0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.179+0000 7f1e0effd700 1 -- 172.21.15.134:0/3256052006 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1e1401ab80 con 0x7f1e181047b0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.179+0000 7f1e0effd700 1 --2- 172.21.15.134:0/3256052006 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1e040383f0 0x7f1e0403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.179+0000 7f1e201d1700 1 -- 172.21.15.134:0/3256052006 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e18062380 con 0x7f1e181047b0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.179+0000 7f1e0effd700 1 -- 172.21.15.134:0/3256052006 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1e1404c390 con 0x7f1e181047b0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.179+0000 7f1e1d76c700 1 --2- 172.21.15.134:0/3256052006 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1e040383f0 0x7f1e0403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.179+0000 7f1e1d76c700 1 --2- 172.21.15.134:0/3256052006 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1e040383f0 0x7f1e0403a8a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1e08006fd0 tx=0x7f1e08006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.184+0000 7f1e0effd700 1 -- 172.21.15.134:0/3256052006 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1e1402d3f0 con 0x7f1e181047b0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:42.376+0000 7f1e201d1700 1 -- 172.21.15.134:0/3256052006 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi134", "addr": "172.21.15.134", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e181020f0 con 0x7f1e040383f0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.546+0000 7f1e0effd700 1 -- 172.21.15.134:0/3256052006 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1e181020f0 con 0x7f1e040383f0 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.548+0000 7f1e201d1700 1 -- 172.21.15.134:0/3256052006 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1e040383f0 msgr2=0x7f1e0403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:45.201 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.548+0000 7f1e201d1700 1 --2- 172.21.15.134:0/3256052006 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1e040383f0 0x7f1e0403a8a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1e08006fd0 tx=0x7f1e08006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:45.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.548+0000 7f1e201d1700 1 -- 172.21.15.134:0/3256052006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 msgr2=0x7f1e181984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:45.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.548+0000 7f1e201d1700 1 --2- 172.21.15.134:0/3256052006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e181984e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009130 tx=0x7f1e14011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:45.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.549+0000 7f1e201d1700 1 -- 172.21.15.134:0/3256052006 shutdown_connections 2024-04-13T10:48:45.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.549+0000 7f1e201d1700 1 --2- 172.21.15.134:0/3256052006 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1e040383f0 0x7f1e0403a8a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:45.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.549+0000 7f1e201d1700 1 --2- 172.21.15.134:0/3256052006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e181047b0 0x7f1e181984e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:45.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.549+0000 7f1e201d1700 1 -- 172.21.15.134:0/3256052006 >> 172.21.15.134:0/3256052006 conn(0x7f1e180ffe00 msgr2=0x7f1e18101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:45.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.549+0000 7f1e201d1700 1 -- 172.21.15.134:0/3256052006 shutdown_connections 2024-04-13T10:48:45.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:44.549+0000 7f1e201d1700 1 -- 172.21.15.134:0/3256052006 wait complete. 2024-04-13T10:48:45.202 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying mon service with default placement... 2024-04-13T10:48:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:45 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:45 smithi134 ceph-mon[39696]: Added host smithi134 2024-04-13T10:48:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:45 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:48:47.427 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-13T10:48:47.427 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.893+0000 7ff468242700 1 Processor -- start 2024-04-13T10:48:47.427 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.893+0000 7ff468242700 1 -- start start 2024-04-13T10:48:47.427 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.894+0000 7ff468242700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff460074340 0x7ff46010a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:47.427 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.894+0000 7ff468242700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff460106240 con 0x7ff460074340 2024-04-13T10:48:47.427 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.894+0000 7ff465fde700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff460074340 0x7ff46010a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:47.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.894+0000 7ff465fde700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff460074340 0x7ff46010a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39472/0 (socket says 172.21.15.134:39472) 2024-04-13T10:48:47.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.894+0000 7ff465fde700 1 -- 172.21.15.134:0/1802185609 learned_addr learned my addr 172.21.15.134:0/1802185609 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:47.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.894+0000 7ff465fde700 1 -- 172.21.15.134:0/1802185609 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46010ad90 con 0x7ff460074340 2024-04-13T10:48:47.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.894+0000 7ff465fde700 1 --2- 172.21.15.134:0/1802185609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff460074340 0x7ff46010a850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0098a0 tx=0x7ff45c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b719f38f35259efd server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:47.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.894+0000 7ff464fdc700 1 -- 172.21.15.134:0/1802185609 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff45c004180 con 0x7ff460074340 2024-04-13T10:48:47.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.895+0000 7ff464fdc700 1 -- 172.21.15.134:0/1802185609 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7ff45c0042e0 con 0x7ff460074340 2024-04-13T10:48:47.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.895+0000 7ff464fdc700 1 -- 172.21.15.134:0/1802185609 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff45c0119d0 con 0x7ff460074340 2024-04-13T10:48:47.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.895+0000 7ff468242700 1 -- 172.21.15.134:0/1802185609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff460074340 msgr2=0x7ff46010a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:47.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.895+0000 7ff468242700 1 --2- 172.21.15.134:0/1802185609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff460074340 0x7ff46010a850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0098a0 tx=0x7ff45c009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:47.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.895+0000 7ff468242700 1 -- 172.21.15.134:0/1802185609 shutdown_connections 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.895+0000 7ff468242700 1 --2- 172.21.15.134:0/1802185609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff460074340 0x7ff46010a850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.895+0000 7ff468242700 1 -- 172.21.15.134:0/1802185609 >> 172.21.15.134:0/1802185609 conn(0x7ff4600ffe20 msgr2=0x7ff460102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.895+0000 7ff468242700 1 -- 172.21.15.134:0/1802185609 shutdown_connections 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.895+0000 7ff468242700 1 -- 172.21.15.134:0/1802185609 wait complete. 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.896+0000 7ff468242700 1 Processor -- start 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.896+0000 7ff468242700 1 -- start start 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.896+0000 7ff468242700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff46019b780 0x7ff46019bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.896+0000 7ff468242700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46019c0d0 con 0x7ff46019b780 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.896+0000 7ff465fde700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff46019b780 0x7ff46019bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.896+0000 7ff465fde700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff46019b780 0x7ff46019bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39488/0 (socket says 172.21.15.134:39488) 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.896+0000 7ff465fde700 1 -- 172.21.15.134:0/451111669 learned_addr learned my addr 172.21.15.134:0/451111669 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.896+0000 7ff465fde700 1 -- 172.21.15.134:0/451111669 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c009550 con 0x7ff46019b780 2024-04-13T10:48:47.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.897+0000 7ff465fde700 1 --2- 172.21.15.134:0/451111669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff46019b780 0x7ff46019bb90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006af0 tx=0x7ff45c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.897+0000 7ff456ffd700 1 -- 172.21.15.134:0/451111669 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff45c003b40 con 0x7ff46019b780 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.897+0000 7ff468242700 1 -- 172.21.15.134:0/451111669 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46019c2d0 con 0x7ff46019b780 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.897+0000 7ff456ffd700 1 -- 172.21.15.134:0/451111669 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1002+0+0 (secure 0 0 0) 0x7ff45c01a880 con 0x7ff46019b780 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.897+0000 7ff456ffd700 1 -- 172.21.15.134:0/451111669 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff45c019890 con 0x7ff46019b780 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.897+0000 7ff468242700 1 -- 172.21.15.134:0/451111669 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46019ef30 con 0x7ff46019b780 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.898+0000 7ff456ffd700 1 -- 172.21.15.134:0/451111669 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff45c019b10 con 0x7ff46019b780 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.898+0000 7ff468242700 1 -- 172.21.15.134:0/451111669 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff460074340 con 0x7ff46019b780 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.898+0000 7ff456ffd700 1 --2- 172.21.15.134:0/451111669 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7ff44c0383b0 0x7ff44c03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.898+0000 7ff456ffd700 1 -- 172.21.15.134:0/451111669 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff45c04c940 con 0x7ff46019b780 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.898+0000 7ff4657dd700 1 --2- 172.21.15.134:0/451111669 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7ff44c0383b0 0x7ff44c03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.898+0000 7ff4657dd700 1 --2- 172.21.15.134:0/451111669 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7ff44c0383b0 0x7ff44c03a860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff450006fd0 tx=0x7ff450006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:45.903+0000 7ff456ffd700 1 -- 172.21.15.134:0/451111669 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff45c02b340 con 0x7ff46019b780 2024-04-13T10:48:47.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.111+0000 7ff468242700 1 -- 172.21.15.134:0/451111669 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7ff460102110 con 0x7ff44c0383b0 2024-04-13T10:48:47.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.116+0000 7ff456ffd700 1 -- 172.21.15.134:0/451111669 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff460102110 con 0x7ff44c0383b0 2024-04-13T10:48:47.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.118+0000 7ff468242700 1 -- 172.21.15.134:0/451111669 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7ff44c0383b0 msgr2=0x7ff44c03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:47.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.118+0000 7ff468242700 1 --2- 172.21.15.134:0/451111669 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7ff44c0383b0 0x7ff44c03a860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff450006fd0 tx=0x7ff450006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:47.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.118+0000 7ff468242700 1 -- 172.21.15.134:0/451111669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff46019b780 msgr2=0x7ff46019bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:47.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.118+0000 7ff468242700 1 --2- 172.21.15.134:0/451111669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff46019b780 0x7ff46019bb90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006af0 tx=0x7ff45c011a30 comp rx=0 tx=0).stop 2024-04-13T10:48:47.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.118+0000 7ff468242700 1 -- 172.21.15.134:0/451111669 shutdown_connections 2024-04-13T10:48:47.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.118+0000 7ff468242700 1 --2- 172.21.15.134:0/451111669 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7ff44c0383b0 0x7ff44c03a860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:47.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.118+0000 7ff468242700 1 --2- 172.21.15.134:0/451111669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff46019b780 0x7ff46019bb90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:47.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.118+0000 7ff468242700 1 -- 172.21.15.134:0/451111669 >> 172.21.15.134:0/451111669 conn(0x7ff4600ffe20 msgr2=0x7ff4601014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:47.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.118+0000 7ff468242700 1 -- 172.21.15.134:0/451111669 shutdown_connections 2024-04-13T10:48:47.432 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:46.118+0000 7ff468242700 1 -- 172.21.15.134:0/451111669 wait complete. 2024-04-13T10:48:47.432 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying mgr service with default placement... 2024-04-13T10:48:47.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:47 smithi134 ceph-mon[39696]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:47.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:47 smithi134 ceph-mon[39696]: Saving service mon spec with placement count:5 2024-04-13T10:48:47.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:47 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:47.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:47 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:49.137 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:48 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:49.137 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:48 smithi134 ceph-mon[39696]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:49.138 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:48 smithi134 ceph-mon[39696]: Saving service mgr spec with placement count:2 2024-04-13T10:48:49.138 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:48 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.043+0000 7f4710bf4700 1 Processor -- start 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.043+0000 7f4710bf4700 1 -- start start 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.044+0000 7f4710bf4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.044+0000 7f4710bf4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c106210 con 0x7f470c1058c0 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.044+0000 7f470a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.044+0000 7f470a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c105cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39500/0 (socket says 172.21.15.134:39500) 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.044+0000 7f470a59c700 1 -- 172.21.15.134:0/4172206951 learned_addr learned my addr 172.21.15.134:0/4172206951 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.044+0000 7f470a59c700 1 -- 172.21.15.134:0/4172206951 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c106350 con 0x7f470c1058c0 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.044+0000 7f470a59c700 1 --2- 172.21.15.134:0/4172206951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c105cd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0098a0 tx=0x7f46fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fceeb93745deb99 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.045+0000 7f470959a700 1 -- 172.21.15.134:0/4172206951 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46fc004180 con 0x7f470c1058c0 2024-04-13T10:48:49.471 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.045+0000 7f470959a700 1 -- 172.21.15.134:0/4172206951 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f46fc0042e0 con 0x7f470c1058c0 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.045+0000 7f470959a700 1 -- 172.21.15.134:0/4172206951 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46fc011a30 con 0x7f470c1058c0 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.045+0000 7f4710bf4700 1 -- 172.21.15.134:0/4172206951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 msgr2=0x7f470c105cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.045+0000 7f4710bf4700 1 --2- 172.21.15.134:0/4172206951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c105cd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0098a0 tx=0x7f46fc009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.045+0000 7f4710bf4700 1 -- 172.21.15.134:0/4172206951 shutdown_connections 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.045+0000 7f4710bf4700 1 --2- 172.21.15.134:0/4172206951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c105cd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.045+0000 7f4710bf4700 1 -- 172.21.15.134:0/4172206951 >> 172.21.15.134:0/4172206951 conn(0x7f470c100f30 msgr2=0x7f470c103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.046+0000 7f4710bf4700 1 -- 172.21.15.134:0/4172206951 shutdown_connections 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.046+0000 7f4710bf4700 1 -- 172.21.15.134:0/4172206951 wait complete. 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.046+0000 7f4710bf4700 1 Processor -- start 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.046+0000 7f4710bf4700 1 -- start start 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.047+0000 7f4710bf4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c07bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.047+0000 7f4710bf4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c07c180 con 0x7f470c1058c0 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.047+0000 7f470a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c07bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:49.472 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.047+0000 7f470a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c07bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39516/0 (socket says 172.21.15.134:39516) 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.047+0000 7f470a59c700 1 -- 172.21.15.134:0/398304442 learned_addr learned my addr 172.21.15.134:0/398304442 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.047+0000 7f470a59c700 1 -- 172.21.15.134:0/398304442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc009550 con 0x7f470c1058c0 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.047+0000 7f470a59c700 1 --2- 172.21.15.134:0/398304442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c07bc40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f46fc011a00 tx=0x7f46fc011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.047+0000 7f46fb7fe700 1 -- 172.21.15.134:0/398304442 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46fc003bd0 con 0x7f470c1058c0 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.048+0000 7f46fb7fe700 1 -- 172.21.15.134:0/398304442 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f46fc0248d0 con 0x7f470c1058c0 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.048+0000 7f46fb7fe700 1 -- 172.21.15.134:0/398304442 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46fc01a7e0 con 0x7f470c1058c0 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.048+0000 7f4710bf4700 1 -- 172.21.15.134:0/398304442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c07a290 con 0x7f470c1058c0 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.048+0000 7f4710bf4700 1 -- 172.21.15.134:0/398304442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c07a6b0 con 0x7f470c1058c0 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.048+0000 7f46fb7fe700 1 -- 172.21.15.134:0/398304442 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f46fc01aa50 con 0x7f470c1058c0 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.049+0000 7f46fb7fe700 1 --2- 172.21.15.134:0/398304442 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f46f40383f0 0x7f46f403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.049+0000 7f46fb7fe700 1 -- 172.21.15.134:0/398304442 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f46fc04d450 con 0x7f470c1058c0 2024-04-13T10:48:49.473 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.049+0000 7f4709d9b700 1 --2- 172.21.15.134:0/398304442 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f46f40383f0 0x7f46f403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.049+0000 7f4710bf4700 1 -- 172.21.15.134:0/398304442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470c062380 con 0x7f470c1058c0 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.049+0000 7f4709d9b700 1 --2- 172.21.15.134:0/398304442 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f46f40383f0 0x7f46f403a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4700006fd0 tx=0x7f4700006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.054+0000 7f46fb7fe700 1 -- 172.21.15.134:0/398304442 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f46fc01ad00 con 0x7f470c1058c0 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.266+0000 7f4710bf4700 1 -- 172.21.15.134:0/398304442 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f470c07b0a0 con 0x7f46f40383f0 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.270+0000 7f46fb7fe700 1 -- 172.21.15.134:0/398304442 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f470c07b0a0 con 0x7f46f40383f0 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.273+0000 7f4710bf4700 1 -- 172.21.15.134:0/398304442 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f46f40383f0 msgr2=0x7f46f403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.273+0000 7f4710bf4700 1 --2- 172.21.15.134:0/398304442 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f46f40383f0 0x7f46f403a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4700006fd0 tx=0x7f4700006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.273+0000 7f4710bf4700 1 -- 172.21.15.134:0/398304442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 msgr2=0x7f470c07bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.273+0000 7f4710bf4700 1 --2- 172.21.15.134:0/398304442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c07bc40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f46fc011a00 tx=0x7f46fc011ae0 comp rx=0 tx=0).stop 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.273+0000 7f4710bf4700 1 -- 172.21.15.134:0/398304442 shutdown_connections 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.273+0000 7f4710bf4700 1 --2- 172.21.15.134:0/398304442 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f46f40383f0 0x7f46f403a8a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.273+0000 7f4710bf4700 1 --2- 172.21.15.134:0/398304442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f470c1058c0 0x7f470c07bc40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.273+0000 7f4710bf4700 1 -- 172.21.15.134:0/398304442 >> 172.21.15.134:0/398304442 conn(0x7f470c100f30 msgr2=0x7f470c1025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:49.474 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.273+0000 7f4710bf4700 1 -- 172.21.15.134:0/398304442 shutdown_connections 2024-04-13T10:48:49.475 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:48.273+0000 7f4710bf4700 1 -- 172.21.15.134:0/398304442 wait complete. 2024-04-13T10:48:49.475 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying crash service with default placement... 2024-04-13T10:48:50.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:50 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:50.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-13T10:48:50.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.067+0000 7f91674f6700 1 Processor -- start 2024-04-13T10:48:50.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.067+0000 7f91674f6700 1 -- start start 2024-04-13T10:48:50.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.068+0000 7f91674f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:50.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.068+0000 7f91674f6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9160106210 con 0x7f91601058c0 2024-04-13T10:48:50.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.068+0000 7f9165292700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:50.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.068+0000 7f9165292700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160105cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60806/0 (socket says 172.21.15.134:60806) 2024-04-13T10:48:50.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.068+0000 7f9165292700 1 -- 172.21.15.134:0/1691397572 learned_addr learned my addr 172.21.15.134:0/1691397572 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:50.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.068+0000 7f9165292700 1 -- 172.21.15.134:0/1691397572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160106350 con 0x7f91601058c0 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.068+0000 7f9165292700 1 --2- 172.21.15.134:0/1691397572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160105cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91500098a0 tx=0x7f9150009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabaee77421333d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.069+0000 7f9157fff700 1 -- 172.21.15.134:0/1691397572 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9150004180 con 0x7f91601058c0 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.069+0000 7f9157fff700 1 -- 172.21.15.134:0/1691397572 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f91500042e0 con 0x7f91601058c0 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.069+0000 7f9157fff700 1 -- 172.21.15.134:0/1691397572 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9150011a30 con 0x7f91601058c0 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.069+0000 7f91674f6700 1 -- 172.21.15.134:0/1691397572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 msgr2=0x7f9160105cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.069+0000 7f91674f6700 1 --2- 172.21.15.134:0/1691397572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160105cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91500098a0 tx=0x7f9150009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.069+0000 7f91674f6700 1 -- 172.21.15.134:0/1691397572 shutdown_connections 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.069+0000 7f91674f6700 1 --2- 172.21.15.134:0/1691397572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160105cd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.069+0000 7f91674f6700 1 -- 172.21.15.134:0/1691397572 >> 172.21.15.134:0/1691397572 conn(0x7f9160100f30 msgr2=0x7f9160103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.069+0000 7f91674f6700 1 -- 172.21.15.134:0/1691397572 shutdown_connections 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.069+0000 7f91674f6700 1 -- 172.21.15.134:0/1691397572 wait complete. 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.070+0000 7f91674f6700 1 Processor -- start 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.070+0000 7f91674f6700 1 -- start start 2024-04-13T10:48:50.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.070+0000 7f91674f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.070+0000 7f91674f6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9160199b40 con 0x7f91601058c0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.070+0000 7f9165292700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.070+0000 7f9165292700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60818/0 (socket says 172.21.15.134:60818) 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.070+0000 7f9165292700 1 -- 172.21.15.134:0/132541965 learned_addr learned my addr 172.21.15.134:0/132541965 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.070+0000 7f9165292700 1 -- 172.21.15.134:0/132541965 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9150009550 con 0x7f91601058c0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.070+0000 7f9165292700 1 --2- 172.21.15.134:0/132541965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160199600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9150011a00 tx=0x7f9150011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.071+0000 7f91567fc700 1 -- 172.21.15.134:0/132541965 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9150003bd0 con 0x7f91601058c0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.071+0000 7f91567fc700 1 -- 172.21.15.134:0/132541965 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f91500248d0 con 0x7f91601058c0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.071+0000 7f91567fc700 1 -- 172.21.15.134:0/132541965 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f915001a7e0 con 0x7f91601058c0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.071+0000 7f91674f6700 1 -- 172.21.15.134:0/132541965 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9160199d40 con 0x7f91601058c0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.071+0000 7f91674f6700 1 -- 172.21.15.134:0/132541965 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916019a160 con 0x7f91601058c0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.072+0000 7f91567fc700 1 -- 172.21.15.134:0/132541965 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9150024440 con 0x7f91601058c0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.072+0000 7f91674f6700 1 -- 172.21.15.134:0/132541965 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9160109d50 con 0x7f91601058c0 2024-04-13T10:48:50.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.072+0000 7f91567fc700 1 --2- 172.21.15.134:0/132541965 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f914c0383f0 0x7f914c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.072+0000 7f91567fc700 1 -- 172.21.15.134:0/132541965 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f915004c5c0 con 0x7f91601058c0 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.072+0000 7f9164a91700 1 --2- 172.21.15.134:0/132541965 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f914c0383f0 0x7f914c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.072+0000 7f9164a91700 1 --2- 172.21.15.134:0/132541965 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f914c0383f0 0x7f914c03a8a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f915c006fd0 tx=0x7f915c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.076+0000 7f91567fc700 1 -- 172.21.15.134:0/132541965 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f91500246f0 con 0x7f91601058c0 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.289+0000 7f91674f6700 1 -- 172.21.15.134:0/132541965 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f91601023f0 con 0x7f914c0383f0 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.294+0000 7f91567fc700 1 -- 172.21.15.134:0/132541965 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f91601023f0 con 0x7f914c0383f0 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.296+0000 7f91674f6700 1 -- 172.21.15.134:0/132541965 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f914c0383f0 msgr2=0x7f914c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.296+0000 7f91674f6700 1 --2- 172.21.15.134:0/132541965 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f914c0383f0 0x7f914c03a8a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f915c006fd0 tx=0x7f915c006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.296+0000 7f91674f6700 1 -- 172.21.15.134:0/132541965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 msgr2=0x7f9160199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.296+0000 7f91674f6700 1 --2- 172.21.15.134:0/132541965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160199600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9150011a00 tx=0x7f9150011ae0 comp rx=0 tx=0).stop 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.296+0000 7f91674f6700 1 -- 172.21.15.134:0/132541965 shutdown_connections 2024-04-13T10:48:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.296+0000 7f91674f6700 1 --2- 172.21.15.134:0/132541965 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f914c0383f0 0x7f914c03a8a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:50.909 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.296+0000 7f91674f6700 1 --2- 172.21.15.134:0/132541965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91601058c0 0x7f9160199600 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:50.909 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.296+0000 7f91674f6700 1 -- 172.21.15.134:0/132541965 >> 172.21.15.134:0/132541965 conn(0x7f9160100f30 msgr2=0x7f9160101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:50.909 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.296+0000 7f91674f6700 1 -- 172.21.15.134:0/132541965 shutdown_connections 2024-04-13T10:48:50.909 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:50.296+0000 7f91674f6700 1 -- 172.21.15.134:0/132541965 wait complete. 2024-04-13T10:48:50.909 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying ceph-exporter service with default placement... 2024-04-13T10:48:51.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:51 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:51.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:51 smithi134 ceph-mon[39696]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:51.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:51 smithi134 ceph-mon[39696]: Saving service crash spec with placement * 2024-04-13T10:48:51.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:51 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:52.583 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-04-13T10:48:52.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.503+0000 7f2cdaf8b700 1 Processor -- start 2024-04-13T10:48:52.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.503+0000 7f2cdaf8b700 1 -- start start 2024-04-13T10:48:52.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.503+0000 7f2cdaf8b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4104330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:52.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.503+0000 7f2cdaf8b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd4104870 con 0x7f2cd4103f20 2024-04-13T10:48:52.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.504+0000 7f2cd8d27700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4104330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:52.589 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.504+0000 7f2cd8d27700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4104330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60834/0 (socket says 172.21.15.134:60834) 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.504+0000 7f2cd8d27700 1 -- 172.21.15.134:0/2229580201 learned_addr learned my addr 172.21.15.134:0/2229580201 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.504+0000 7f2cd8d27700 1 -- 172.21.15.134:0/2229580201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd41049b0 con 0x7f2cd4103f20 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.504+0000 7f2cd8d27700 1 --2- 172.21.15.134:0/2229580201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4104330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800aa40 tx=0x7f2cc800ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e711c9e0e5876bb server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.504+0000 7f2cd37fe700 1 -- 172.21.15.134:0/2229580201 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cc8004180 con 0x7f2cd4103f20 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.504+0000 7f2cd37fe700 1 -- 172.21.15.134:0/2229580201 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f2cc800cd80 con 0x7f2cd4103f20 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.504+0000 7f2cd37fe700 1 -- 172.21.15.134:0/2229580201 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cc8003c90 con 0x7f2cd4103f20 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.505+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/2229580201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 msgr2=0x7f2cd4104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.505+0000 7f2cdaf8b700 1 --2- 172.21.15.134:0/2229580201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4104330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800aa40 tx=0x7f2cc800ad50 comp rx=0 tx=0).stop 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.505+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/2229580201 shutdown_connections 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.505+0000 7f2cdaf8b700 1 --2- 172.21.15.134:0/2229580201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4104330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.505+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/2229580201 >> 172.21.15.134:0/2229580201 conn(0x7f2cd40ff590 msgr2=0x7f2cd41019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.505+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/2229580201 shutdown_connections 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.505+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/2229580201 wait complete. 2024-04-13T10:48:52.590 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.505+0000 7f2cdaf8b700 1 Processor -- start 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.505+0000 7f2cdaf8b700 1 -- start start 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cdaf8b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cdaf8b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd4199ad0 con 0x7f2cd4103f20 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cd8d27700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cd8d27700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60838/0 (socket says 172.21.15.134:60838) 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cd8d27700 1 -- 172.21.15.134:0/4014626155 learned_addr learned my addr 172.21.15.134:0/4014626155 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cd8d27700 1 -- 172.21.15.134:0/4014626155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc800a6f0 con 0x7f2cd4103f20 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cd8d27700 1 --2- 172.21.15.134:0/4014626155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4199590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80041b0 tx=0x7f2cc8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cd1ffb700 1 -- 172.21.15.134:0/4014626155 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cc8004520 con 0x7f2cd4103f20 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cd1ffb700 1 -- 172.21.15.134:0/4014626155 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f2cc8010a90 con 0x7f2cd4103f20 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/4014626155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd4199cd0 con 0x7f2cd4103f20 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cd1ffb700 1 -- 172.21.15.134:0/4014626155 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cc80208f0 con 0x7f2cd4103f20 2024-04-13T10:48:52.591 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.506+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/4014626155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd419a0f0 con 0x7f2cd4103f20 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.507+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/4014626155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd4190b90 con 0x7f2cd4103f20 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.508+0000 7f2cd1ffb700 1 -- 172.21.15.134:0/4014626155 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f2cc8010c00 con 0x7f2cd4103f20 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.508+0000 7f2cd1ffb700 1 --2- 172.21.15.134:0/4014626155 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f2cc4038400 0x7f2cc403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.508+0000 7f2cd1ffb700 1 -- 172.21.15.134:0/4014626155 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2cc804c5e0 con 0x7f2cd4103f20 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.508+0000 7f2cd3fff700 1 --2- 172.21.15.134:0/4014626155 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f2cc4038400 0x7f2cc403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.509+0000 7f2cd3fff700 1 --2- 172.21.15.134:0/4014626155 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f2cc4038400 0x7f2cc403a8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0006fd0 tx=0x7f2cc0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.512+0000 7f2cd1ffb700 1 -- 172.21.15.134:0/4014626155 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2cc80297a0 con 0x7f2cd4103f20 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.724+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/4014626155 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cd4061190 con 0x7f2cc4038400 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.731+0000 7f2cd1ffb700 1 -- 172.21.15.134:0/4014626155 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f2cd4061190 con 0x7f2cc4038400 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.734+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/4014626155 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f2cc4038400 msgr2=0x7f2cc403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.734+0000 7f2cdaf8b700 1 --2- 172.21.15.134:0/4014626155 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f2cc4038400 0x7f2cc403a8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0006fd0 tx=0x7f2cc0006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.734+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/4014626155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 msgr2=0x7f2cd4199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.734+0000 7f2cdaf8b700 1 --2- 172.21.15.134:0/4014626155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4199590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80041b0 tx=0x7f2cc8004290 comp rx=0 tx=0).stop 2024-04-13T10:48:52.592 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.734+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/4014626155 shutdown_connections 2024-04-13T10:48:52.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.734+0000 7f2cdaf8b700 1 --2- 172.21.15.134:0/4014626155 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f2cc4038400 0x7f2cc403a8b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:52.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.734+0000 7f2cdaf8b700 1 --2- 172.21.15.134:0/4014626155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cd4103f20 0x7f2cd4199590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:52.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.734+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/4014626155 >> 172.21.15.134:0/4014626155 conn(0x7f2cd40ff590 msgr2=0x7f2cd418b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:52.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.734+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/4014626155 shutdown_connections 2024-04-13T10:48:52.593 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:51.734+0000 7f2cdaf8b700 1 -- 172.21.15.134:0/4014626155 wait complete. 2024-04-13T10:48:52.593 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying prometheus service with default placement... 2024-04-13T10:48:52.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:52 smithi134 ceph-mon[39696]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:52.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:52 smithi134 ceph-mon[39696]: Saving service ceph-exporter spec with placement * 2024-04-13T10:48:52.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:52 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:53.989 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-13T10:48:53.989 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.173+0000 7f876bebd700 1 Processor -- start 2024-04-13T10:48:53.989 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.173+0000 7f876bebd700 1 -- start start 2024-04-13T10:48:53.989 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.173+0000 7f876bebd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f87641050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:53.989 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.173+0000 7f876bebd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87641055f0 con 0x7f8764104ca0 2024-04-13T10:48:53.989 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.173+0000 7f8769c59700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f87641050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:53.989 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.173+0000 7f8769c59700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f87641050b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60844/0 (socket says 172.21.15.134:60844) 2024-04-13T10:48:53.989 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.173+0000 7f8769c59700 1 -- 172.21.15.134:0/1426845202 learned_addr learned my addr 172.21.15.134:0/1426845202 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:53.990 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.173+0000 7f8769c59700 1 -- 172.21.15.134:0/1426845202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8764105730 con 0x7f8764104ca0 2024-04-13T10:48:53.990 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f8769c59700 1 --2- 172.21.15.134:0/1426845202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f87641050b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f87600098a0 tx=0x7f8760009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c988196ce6826d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:53.990 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f8768c57700 1 -- 172.21.15.134:0/1426845202 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8760004180 con 0x7f8764104ca0 2024-04-13T10:48:53.990 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f8768c57700 1 -- 172.21.15.134:0/1426845202 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f87600042e0 con 0x7f8764104ca0 2024-04-13T10:48:53.990 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f8768c57700 1 -- 172.21.15.134:0/1426845202 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8760011a30 con 0x7f8764104ca0 2024-04-13T10:48:53.990 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f876bebd700 1 -- 172.21.15.134:0/1426845202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 msgr2=0x7f87641050b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:53.990 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f876bebd700 1 --2- 172.21.15.134:0/1426845202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f87641050b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f87600098a0 tx=0x7f8760009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:53.990 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f876bebd700 1 -- 172.21.15.134:0/1426845202 shutdown_connections 2024-04-13T10:48:53.990 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f876bebd700 1 --2- 172.21.15.134:0/1426845202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f87641050b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:53.991 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f876bebd700 1 -- 172.21.15.134:0/1426845202 >> 172.21.15.134:0/1426845202 conn(0x7f87640ff590 msgr2=0x7f87641019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:53.991 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f876bebd700 1 -- 172.21.15.134:0/1426845202 shutdown_connections 2024-04-13T10:48:53.991 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.174+0000 7f876bebd700 1 -- 172.21.15.134:0/1426845202 wait complete. 2024-04-13T10:48:53.992 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.175+0000 7f876bebd700 1 Processor -- start 2024-04-13T10:48:53.992 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.175+0000 7f876bebd700 1 -- start start 2024-04-13T10:48:53.992 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.175+0000 7f876bebd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f876419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:53.992 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.175+0000 7f876bebd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876419bd50 con 0x7f8764104ca0 2024-04-13T10:48:53.992 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.175+0000 7f8769c59700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f876419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:53.992 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.175+0000 7f8769c59700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f876419b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60846/0 (socket says 172.21.15.134:60846) 2024-04-13T10:48:53.992 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.175+0000 7f8769c59700 1 -- 172.21.15.134:0/2674835710 learned_addr learned my addr 172.21.15.134:0/2674835710 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.175+0000 7f8769c59700 1 -- 172.21.15.134:0/2674835710 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009550 con 0x7f8764104ca0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.175+0000 7f8769c59700 1 --2- 172.21.15.134:0/2674835710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f876419b810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8760006af0 tx=0x7f87600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.176+0000 7f8756ffd700 1 -- 172.21.15.134:0/2674835710 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8760003b10 con 0x7f8764104ca0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.176+0000 7f876bebd700 1 -- 172.21.15.134:0/2674835710 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876419bf50 con 0x7f8764104ca0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.176+0000 7f8756ffd700 1 -- 172.21.15.134:0/2674835710 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f8760003c70 con 0x7f8764104ca0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.176+0000 7f8756ffd700 1 -- 172.21.15.134:0/2674835710 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87600196e0 con 0x7f8764104ca0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.176+0000 7f876bebd700 1 -- 172.21.15.134:0/2674835710 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876419c370 con 0x7f8764104ca0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.176+0000 7f8756ffd700 1 -- 172.21.15.134:0/2674835710 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f87600199a0 con 0x7f8764104ca0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.177+0000 7f876bebd700 1 -- 172.21.15.134:0/2674835710 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8764195500 con 0x7f8764104ca0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.177+0000 7f8756ffd700 1 --2- 172.21.15.134:0/2674835710 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f87500383a0 0x7f875003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.177+0000 7f8756ffd700 1 -- 172.21.15.134:0/2674835710 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f876004c6e0 con 0x7f8764104ca0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.177+0000 7f8769458700 1 --2- 172.21.15.134:0/2674835710 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f87500383a0 0x7f875003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.177+0000 7f8769458700 1 --2- 172.21.15.134:0/2674835710 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f87500383a0 0x7f875003a850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8758006fd0 tx=0x7f8758006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.181+0000 7f8756ffd700 1 -- 172.21.15.134:0/2674835710 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f876001a950 con 0x7f8764104ca0 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.380+0000 7f876bebd700 1 -- 172.21.15.134:0/2674835710 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f8764061190 con 0x7f87500383a0 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.384+0000 7f8756ffd700 1 -- 172.21.15.134:0/2674835710 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f8764061190 con 0x7f87500383a0 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.388+0000 7f876bebd700 1 -- 172.21.15.134:0/2674835710 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f87500383a0 msgr2=0x7f875003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.388+0000 7f876bebd700 1 --2- 172.21.15.134:0/2674835710 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f87500383a0 0x7f875003a850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8758006fd0 tx=0x7f8758006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.388+0000 7f876bebd700 1 -- 172.21.15.134:0/2674835710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 msgr2=0x7f876419b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.388+0000 7f876bebd700 1 --2- 172.21.15.134:0/2674835710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f876419b810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8760006af0 tx=0x7f87600047c0 comp rx=0 tx=0).stop 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.388+0000 7f876bebd700 1 -- 172.21.15.134:0/2674835710 shutdown_connections 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.388+0000 7f876bebd700 1 --2- 172.21.15.134:0/2674835710 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f87500383a0 0x7f875003a850 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.388+0000 7f876bebd700 1 --2- 172.21.15.134:0/2674835710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8764104ca0 0x7f876419b810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.388+0000 7f876bebd700 1 -- 172.21.15.134:0/2674835710 >> 172.21.15.134:0/2674835710 conn(0x7f87640ff590 msgr2=0x7f8764192640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.388+0000 7f876bebd700 1 -- 172.21.15.134:0/2674835710 shutdown_connections 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:53.388+0000 7f876bebd700 1 -- 172.21.15.134:0/2674835710 wait complete. 2024-04-13T10:48:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying grafana service with default placement... 2024-04-13T10:48:54.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:54 smithi134 ceph-mon[39696]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:54.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:54 smithi134 ceph-mon[39696]: Saving service prometheus spec with placement count:1 2024-04-13T10:48:54.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:54 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:54.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:54 smithi134 ceph-mon[39696]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf227f2700 1 Processor -- start 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf227f2700 1 -- start start 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf227f2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf227f2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c105100 con 0x7fdf1c1047b0 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf1bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf1bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60850/0 (socket says 172.21.15.134:60850) 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf1bfff700 1 -- 172.21.15.134:0/4094899377 learned_addr learned my addr 172.21.15.134:0/4094899377 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf1bfff700 1 -- 172.21.15.134:0/4094899377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c105240 con 0x7fdf1c1047b0 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf1bfff700 1 --2- 172.21.15.134:0/4094899377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c104bc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0098a0 tx=0x7fdf0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c04eb769dfaff0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:55.496 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf1affd700 1 -- 172.21.15.134:0/4094899377 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf0c004180 con 0x7fdf1c1047b0 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf1affd700 1 -- 172.21.15.134:0/4094899377 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fdf0c0042e0 con 0x7fdf1c1047b0 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.631+0000 7fdf1affd700 1 -- 172.21.15.134:0/4094899377 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf0c011a30 con 0x7fdf1c1047b0 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.632+0000 7fdf227f2700 1 -- 172.21.15.134:0/4094899377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 msgr2=0x7fdf1c104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.632+0000 7fdf227f2700 1 --2- 172.21.15.134:0/4094899377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c104bc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0098a0 tx=0x7fdf0c009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.632+0000 7fdf227f2700 1 -- 172.21.15.134:0/4094899377 shutdown_connections 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.632+0000 7fdf227f2700 1 --2- 172.21.15.134:0/4094899377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c104bc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.632+0000 7fdf227f2700 1 -- 172.21.15.134:0/4094899377 >> 172.21.15.134:0/4094899377 conn(0x7fdf1c0ffe20 msgr2=0x7fdf1c102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.632+0000 7fdf227f2700 1 -- 172.21.15.134:0/4094899377 shutdown_connections 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.632+0000 7fdf227f2700 1 -- 172.21.15.134:0/4094899377 wait complete. 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.632+0000 7fdf227f2700 1 Processor -- start 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.632+0000 7fdf227f2700 1 -- start start 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf227f2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:55.497 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf227f2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c197900 con 0x7fdf1c1047b0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf1bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf1bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c1973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60864/0 (socket says 172.21.15.134:60864) 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf1bfff700 1 -- 172.21.15.134:0/149214160 learned_addr learned my addr 172.21.15.134:0/149214160 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf1bfff700 1 -- 172.21.15.134:0/149214160 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c009550 con 0x7fdf1c1047b0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf1bfff700 1 --2- 172.21.15.134:0/149214160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c1973c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c006af0 tx=0x7fdf0c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf197fa700 1 -- 172.21.15.134:0/149214160 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf0c003bc0 con 0x7fdf1c1047b0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf197fa700 1 -- 172.21.15.134:0/149214160 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fdf0c01a8c0 con 0x7fdf1c1047b0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf227f2700 1 -- 172.21.15.134:0/149214160 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c197b00 con 0x7fdf1c1047b0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.633+0000 7fdf197fa700 1 -- 172.21.15.134:0/149214160 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf0c019860 con 0x7fdf1c1047b0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.634+0000 7fdf227f2700 1 -- 172.21.15.134:0/149214160 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c197f20 con 0x7fdf1c1047b0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.634+0000 7fdf197fa700 1 -- 172.21.15.134:0/149214160 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fdf0c019b20 con 0x7fdf1c1047b0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.634+0000 7fdf227f2700 1 -- 172.21.15.134:0/149214160 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c1910e0 con 0x7fdf1c1047b0 2024-04-13T10:48:55.498 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.634+0000 7fdf197fa700 1 --2- 172.21.15.134:0/149214160 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdf0403a5b0 0x7fdf0403ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.635+0000 7fdf197fa700 1 -- 172.21.15.134:0/149214160 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdf0c04c830 con 0x7fdf1c1047b0 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.635+0000 7fdf1b7fe700 1 --2- 172.21.15.134:0/149214160 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdf0403a5b0 0x7fdf0403ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.635+0000 7fdf1b7fe700 1 --2- 172.21.15.134:0/149214160 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdf0403a5b0 0x7fdf0403ca60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdf10006fd0 tx=0x7fdf10006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.640+0000 7fdf197fa700 1 -- 172.21.15.134:0/149214160 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdf0c02d430 con 0x7fdf1c1047b0 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.841+0000 7fdf227f2700 1 -- 172.21.15.134:0/149214160 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf1c061190 con 0x7fdf0403a5b0 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.849+0000 7fdf197fa700 1 -- 172.21.15.134:0/149214160 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fdf1c061190 con 0x7fdf0403a5b0 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.851+0000 7fdf227f2700 1 -- 172.21.15.134:0/149214160 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdf0403a5b0 msgr2=0x7fdf0403ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.851+0000 7fdf227f2700 1 --2- 172.21.15.134:0/149214160 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdf0403a5b0 0x7fdf0403ca60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdf10006fd0 tx=0x7fdf10006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.851+0000 7fdf227f2700 1 -- 172.21.15.134:0/149214160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 msgr2=0x7fdf1c1973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.851+0000 7fdf227f2700 1 --2- 172.21.15.134:0/149214160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c1973c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c006af0 tx=0x7fdf0c011ab0 comp rx=0 tx=0).stop 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.851+0000 7fdf227f2700 1 -- 172.21.15.134:0/149214160 shutdown_connections 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.851+0000 7fdf227f2700 1 --2- 172.21.15.134:0/149214160 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdf0403a5b0 0x7fdf0403ca60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:55.499 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.851+0000 7fdf227f2700 1 --2- 172.21.15.134:0/149214160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf1c1047b0 0x7fdf1c1973c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:55.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.851+0000 7fdf227f2700 1 -- 172.21.15.134:0/149214160 >> 172.21.15.134:0/149214160 conn(0x7fdf1c0ffe20 msgr2=0x7fdf1c18e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:55.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.851+0000 7fdf227f2700 1 -- 172.21.15.134:0/149214160 shutdown_connections 2024-04-13T10:48:55.500 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:54.851+0000 7fdf227f2700 1 -- 172.21.15.134:0/149214160 wait complete. 2024-04-13T10:48:55.500 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying node-exporter service with default placement... 2024-04-13T10:48:56.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:55 smithi134 ceph-mon[39696]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:56.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:55 smithi134 ceph-mon[39696]: Saving service grafana spec with placement count:1 2024-04-13T10:48:56.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:55 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:56.876 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.053+0000 7f8cec95f700 1 Processor -- start 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.053+0000 7f8cec95f700 1 -- start start 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.053+0000 7f8cec95f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.053+0000 7f8cec95f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80743c0 con 0x7f8ce81063c0 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.053+0000 7f8ce659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.053+0000 7f8ce659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81087a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60878/0 (socket says 172.21.15.134:60878) 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.053+0000 7f8ce659c700 1 -- 172.21.15.134:0/853526706 learned_addr learned my addr 172.21.15.134:0/853526706 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.053+0000 7f8ce659c700 1 -- 172.21.15.134:0/853526706 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8074500 con 0x7f8ce81063c0 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8ce659c700 1 --2- 172.21.15.134:0/853526706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81087a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80098a0 tx=0x7f8cd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98ba5a858268bd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8ce559a700 1 -- 172.21.15.134:0/853526706 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd8004180 con 0x7f8ce81063c0 2024-04-13T10:48:56.877 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8ce559a700 1 -- 172.21.15.134:0/853526706 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f8cd80042e0 con 0x7f8ce81063c0 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8ce559a700 1 -- 172.21.15.134:0/853526706 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd8011a30 con 0x7f8ce81063c0 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8cec95f700 1 -- 172.21.15.134:0/853526706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 msgr2=0x7f8ce81087a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8cec95f700 1 --2- 172.21.15.134:0/853526706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81087a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80098a0 tx=0x7f8cd8009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8cec95f700 1 -- 172.21.15.134:0/853526706 shutdown_connections 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8cec95f700 1 --2- 172.21.15.134:0/853526706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81087a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8cec95f700 1 -- 172.21.15.134:0/853526706 >> 172.21.15.134:0/853526706 conn(0x7f8ce80ffe20 msgr2=0x7f8ce8102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8cec95f700 1 -- 172.21.15.134:0/853526706 shutdown_connections 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.054+0000 7f8cec95f700 1 -- 172.21.15.134:0/853526706 wait complete. 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.055+0000 7f8cec95f700 1 Processor -- start 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.055+0000 7f8cec95f700 1 -- start start 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8cec95f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8cec95f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8199b30 con 0x7f8ce81063c0 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8ce659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:56.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8ce659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60892/0 (socket says 172.21.15.134:60892) 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8ce659c700 1 -- 172.21.15.134:0/3327080475 learned_addr learned my addr 172.21.15.134:0/3327080475 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8ce659c700 1 -- 172.21.15.134:0/3327080475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8009550 con 0x7f8ce81063c0 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8ce659c700 1 --2- 172.21.15.134:0/3327080475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81995f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8006af0 tx=0x7f8cd8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8cd77fe700 1 -- 172.21.15.134:0/3327080475 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd8003bc0 con 0x7f8ce81063c0 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8cd77fe700 1 -- 172.21.15.134:0/3327080475 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f8cd801a8c0 con 0x7f8ce81063c0 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8cd77fe700 1 -- 172.21.15.134:0/3327080475 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cd8019820 con 0x7f8ce81063c0 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8cec95f700 1 -- 172.21.15.134:0/3327080475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce8199d30 con 0x7f8ce81063c0 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.056+0000 7f8cec95f700 1 -- 172.21.15.134:0/3327080475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce819a150 con 0x7f8ce81063c0 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.057+0000 7f8cd77fe700 1 -- 172.21.15.134:0/3327080475 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f8cd8019aa0 con 0x7f8ce81063c0 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.057+0000 7f8cec95f700 1 -- 172.21.15.134:0/3327080475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce8062380 con 0x7f8ce81063c0 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.057+0000 7f8cd77fe700 1 --2- 172.21.15.134:0/3327080475 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f8cd00383b0 0x7f8cd003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.057+0000 7f8cd77fe700 1 -- 172.21.15.134:0/3327080475 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8cd804c980 con 0x7f8ce81063c0 2024-04-13T10:48:56.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.057+0000 7f8ce5d9b700 1 --2- 172.21.15.134:0/3327080475 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f8cd00383b0 0x7f8cd003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.058+0000 7f8ce5d9b700 1 --2- 172.21.15.134:0/3327080475 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f8cd00383b0 0x7f8cd003a860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc006fd0 tx=0x7f8cdc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.062+0000 7f8cd77fe700 1 -- 172.21.15.134:0/3327080475 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8cd802b750 con 0x7f8ce81063c0 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.266+0000 7f8cec95f700 1 -- 172.21.15.134:0/3327080475 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ce8102110 con 0x7f8cd00383b0 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.271+0000 7f8cd77fe700 1 -- 172.21.15.134:0/3327080475 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f8ce8102110 con 0x7f8cd00383b0 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.273+0000 7f8cec95f700 1 -- 172.21.15.134:0/3327080475 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f8cd00383b0 msgr2=0x7f8cd003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.273+0000 7f8cec95f700 1 --2- 172.21.15.134:0/3327080475 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f8cd00383b0 0x7f8cd003a860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc006fd0 tx=0x7f8cdc006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.273+0000 7f8cec95f700 1 -- 172.21.15.134:0/3327080475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 msgr2=0x7f8ce81995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.273+0000 7f8cec95f700 1 --2- 172.21.15.134:0/3327080475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81995f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8006af0 tx=0x7f8cd8011ab0 comp rx=0 tx=0).stop 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.273+0000 7f8cec95f700 1 -- 172.21.15.134:0/3327080475 shutdown_connections 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.273+0000 7f8cec95f700 1 --2- 172.21.15.134:0/3327080475 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f8cd00383b0 0x7f8cd003a860 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.273+0000 7f8cec95f700 1 --2- 172.21.15.134:0/3327080475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ce81063c0 0x7f8ce81995f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.273+0000 7f8cec95f700 1 -- 172.21.15.134:0/3327080475 >> 172.21.15.134:0/3327080475 conn(0x7f8ce80ffe20 msgr2=0x7f8ce81014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.273+0000 7f8cec95f700 1 -- 172.21.15.134:0/3327080475 shutdown_connections 2024-04-13T10:48:56.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:56.273+0000 7f8cec95f700 1 -- 172.21.15.134:0/3327080475 wait complete. 2024-04-13T10:48:56.881 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying alertmanager service with default placement... 2024-04-13T10:48:57.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:57 smithi134 ceph-mon[39696]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:48:57.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:57 smithi134 ceph-mon[39696]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:57.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:57 smithi134 ceph-mon[39696]: Saving service node-exporter spec with placement * 2024-04-13T10:48:57.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:57 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:58.385 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-13T10:48:58.386 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.425+0000 7fdd01f25700 1 Processor -- start 2024-04-13T10:48:58.386 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.425+0000 7fdd01f25700 1 -- start start 2024-04-13T10:48:58.386 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.426+0000 7fdd01f25700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:58.386 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.426+0000 7fdd01f25700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc07a830 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.386 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.426+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.426+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60904/0 (socket says 172.21.15.134:60904) 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.426+0000 7fdcfb7fe700 1 -- 172.21.15.134:0/595120166 learned_addr learned my addr 172.21.15.134:0/595120166 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.426+0000 7fdcfb7fe700 1 -- 172.21.15.134:0/595120166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc07a970 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.426+0000 7fdcfb7fe700 1 --2- 172.21.15.134:0/595120166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc07a2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdce40098a0 tx=0x7fdce4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c08fbc9338c304 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.426+0000 7fdcfa7fc700 1 -- 172.21.15.134:0/595120166 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdce4004180 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.426+0000 7fdcfa7fc700 1 -- 172.21.15.134:0/595120166 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fdce40042e0 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.426+0000 7fdcfa7fc700 1 -- 172.21.15.134:0/595120166 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdce4011a30 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.427+0000 7fdd01f25700 1 -- 172.21.15.134:0/595120166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 msgr2=0x7fdcfc07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.427+0000 7fdd01f25700 1 --2- 172.21.15.134:0/595120166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc07a2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdce40098a0 tx=0x7fdce4009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.427+0000 7fdd01f25700 1 -- 172.21.15.134:0/595120166 shutdown_connections 2024-04-13T10:48:58.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.427+0000 7fdd01f25700 1 --2- 172.21.15.134:0/595120166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc07a2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.427+0000 7fdd01f25700 1 -- 172.21.15.134:0/595120166 >> 172.21.15.134:0/595120166 conn(0x7fdcfc100f30 msgr2=0x7fdcfc103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.427+0000 7fdd01f25700 1 -- 172.21.15.134:0/595120166 shutdown_connections 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.427+0000 7fdd01f25700 1 -- 172.21.15.134:0/595120166 wait complete. 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.428+0000 7fdd01f25700 1 Processor -- start 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.428+0000 7fdd01f25700 1 -- start start 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.428+0000 7fdd01f25700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.428+0000 7fdd01f25700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc19be00 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.428+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.428+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc19b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60912/0 (socket says 172.21.15.134:60912) 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.428+0000 7fdcfb7fe700 1 -- 172.21.15.134:0/4240729937 learned_addr learned my addr 172.21.15.134:0/4240729937 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.428+0000 7fdcfb7fe700 1 -- 172.21.15.134:0/4240729937 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce4009550 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.429+0000 7fdcfb7fe700 1 --2- 172.21.15.134:0/4240729937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc19b8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdce4003f60 tx=0x7fdce4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.429+0000 7fdcf8ff9700 1 -- 172.21.15.134:0/4240729937 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdce4003a40 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.429+0000 7fdcf8ff9700 1 -- 172.21.15.134:0/4240729937 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fdce4003ba0 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.429+0000 7fdd01f25700 1 -- 172.21.15.134:0/4240729937 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc19c000 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.429+0000 7fdcf8ff9700 1 -- 172.21.15.134:0/4240729937 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdce4024660 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.429+0000 7fdd01f25700 1 -- 172.21.15.134:0/4240729937 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc19c420 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.430+0000 7fdcf8ff9700 1 -- 172.21.15.134:0/4240729937 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fdce401aac0 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.430+0000 7fdd01f25700 1 -- 172.21.15.134:0/4240729937 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc1958c0 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.430+0000 7fdcf8ff9700 1 --2- 172.21.15.134:0/4240729937 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdce8038440 0x7fdce803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.430+0000 7fdcf8ff9700 1 -- 172.21.15.134:0/4240729937 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdce404c310 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.430+0000 7fdcfaffd700 1 --2- 172.21.15.134:0/4240729937 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdce8038440 0x7fdce803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.430+0000 7fdcfaffd700 1 --2- 172.21.15.134:0/4240729937 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdce8038440 0x7fdce803a8f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdcec006fd0 tx=0x7fdcec006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.435+0000 7fdcf8ff9700 1 -- 172.21.15.134:0/4240729937 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdce4010380 con 0x7fdcfc07bdf0 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.630+0000 7fdd01f25700 1 -- 172.21.15.134:0/4240729937 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcfc061190 con 0x7fdce8038440 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.635+0000 7fdcf8ff9700 1 -- 172.21.15.134:0/4240729937 <== mgr.14118 v2:172.21.15.134:6800/1656434316 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fdcfc061190 con 0x7fdce8038440 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.637+0000 7fdd01f25700 1 -- 172.21.15.134:0/4240729937 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdce8038440 msgr2=0x7fdce803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:58.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.637+0000 7fdd01f25700 1 --2- 172.21.15.134:0/4240729937 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdce8038440 0x7fdce803a8f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdcec006fd0 tx=0x7fdcec006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:58.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.637+0000 7fdd01f25700 1 -- 172.21.15.134:0/4240729937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 msgr2=0x7fdcfc19b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:58.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.637+0000 7fdd01f25700 1 --2- 172.21.15.134:0/4240729937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc19b8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdce4003f60 tx=0x7fdce4011ab0 comp rx=0 tx=0).stop 2024-04-13T10:48:58.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.637+0000 7fdd01f25700 1 -- 172.21.15.134:0/4240729937 shutdown_connections 2024-04-13T10:48:58.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.637+0000 7fdd01f25700 1 --2- 172.21.15.134:0/4240729937 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fdce8038440 0x7fdce803a8f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:58.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.637+0000 7fdd01f25700 1 --2- 172.21.15.134:0/4240729937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcfc07bdf0 0x7fdcfc19b8c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:58.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.637+0000 7fdd01f25700 1 -- 172.21.15.134:0/4240729937 >> 172.21.15.134:0/4240729937 conn(0x7fdcfc100f30 msgr2=0x7fdcfc102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:58.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.638+0000 7fdd01f25700 1 -- 172.21.15.134:0/4240729937 shutdown_connections 2024-04-13T10:48:58.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:57.638+0000 7fdd01f25700 1 -- 172.21.15.134:0/4240729937 wait complete. 2024-04-13T10:48:58.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:58 smithi134 ceph-mon[39696]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:48:58.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:58 smithi134 ceph-mon[39696]: Saving service alertmanager spec with placement count:1 2024-04-13T10:48:58.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:58 smithi134 ceph-mon[39696]: from='mgr.14118 172.21.15.134:0/2760204221' entity='mgr.smithi134.tmanda' 2024-04-13T10:48:58.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:48:58 smithi134 ceph-mon[39696]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:48:59.772 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.903+0000 7f604253e700 1 Processor -- start 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.903+0000 7f604253e700 1 -- start start 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.903+0000 7f604253e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c079cf0 0x7f603c10a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.903+0000 7f604253e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c106250 con 0x7f603c079cf0 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.903+0000 7f603bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c079cf0 0x7f603c10a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.903+0000 7f603bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c079cf0 0x7f603c10a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60928/0 (socket says 172.21.15.134:60928) 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.904+0000 7f603bfff700 1 -- 172.21.15.134:0/2817034075 learned_addr learned my addr 172.21.15.134:0/2817034075 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.904+0000 7f603bfff700 1 -- 172.21.15.134:0/2817034075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c10ada0 con 0x7f603c079cf0 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.904+0000 7f603bfff700 1 --2- 172.21.15.134:0/2817034075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c079cf0 0x7f603c10a860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f60300098a0 tx=0x7f6030009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d525a903e5c69a server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.904+0000 7f603affd700 1 -- 172.21.15.134:0/2817034075 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6030004180 con 0x7f603c079cf0 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.904+0000 7f603affd700 1 -- 172.21.15.134:0/2817034075 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f60300042e0 con 0x7f603c079cf0 2024-04-13T10:48:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.904+0000 7f603affd700 1 -- 172.21.15.134:0/2817034075 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6030011a30 con 0x7f603c079cf0 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.905+0000 7f604253e700 1 -- 172.21.15.134:0/2817034075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c079cf0 msgr2=0x7f603c10a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.905+0000 7f604253e700 1 --2- 172.21.15.134:0/2817034075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c079cf0 0x7f603c10a860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f60300098a0 tx=0x7f6030009bb0 comp rx=0 tx=0).stop 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.905+0000 7f604253e700 1 -- 172.21.15.134:0/2817034075 shutdown_connections 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.905+0000 7f604253e700 1 --2- 172.21.15.134:0/2817034075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c079cf0 0x7f603c10a860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.905+0000 7f604253e700 1 -- 172.21.15.134:0/2817034075 >> 172.21.15.134:0/2817034075 conn(0x7f603c0ffe30 msgr2=0x7f603c102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.905+0000 7f604253e700 1 -- 172.21.15.134:0/2817034075 shutdown_connections 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.905+0000 7f604253e700 1 -- 172.21.15.134:0/2817034075 wait complete. 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.905+0000 7f604253e700 1 Processor -- start 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.905+0000 7f604253e700 1 -- start start 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f604253e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c19b7d0 0x7f603c19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f604253e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c19c120 con 0x7f603c19b7d0 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f603bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c19b7d0 0x7f603c19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:59.774 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f603bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c19b7d0 0x7f603c19bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60940/0 (socket says 172.21.15.134:60940) 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f603bfff700 1 -- 172.21.15.134:0/1257405668 learned_addr learned my addr 172.21.15.134:0/1257405668 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f603bfff700 1 -- 172.21.15.134:0/1257405668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030009550 con 0x7f603c19b7d0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f603bfff700 1 --2- 172.21.15.134:0/1257405668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c19b7d0 0x7f603c19bbe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6030006af0 tx=0x7f6030011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f60397fa700 1 -- 172.21.15.134:0/1257405668 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6030003bc0 con 0x7f603c19b7d0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f604253e700 1 -- 172.21.15.134:0/1257405668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c19c320 con 0x7f603c19b7d0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f60397fa700 1 -- 172.21.15.134:0/1257405668 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f603001a8c0 con 0x7f603c19b7d0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f60397fa700 1 -- 172.21.15.134:0/1257405668 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6030019820 con 0x7f603c19b7d0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.906+0000 7f604253e700 1 -- 172.21.15.134:0/1257405668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c19ef80 con 0x7f603c19b7d0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.907+0000 7f60397fa700 1 -- 172.21.15.134:0/1257405668 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6030019aa0 con 0x7f603c19b7d0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.907+0000 7f604253e700 1 -- 172.21.15.134:0/1257405668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c079cf0 con 0x7f603c19b7d0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.907+0000 7f60397fa700 1 --2- 172.21.15.134:0/1257405668 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f6024038400 0x7f602403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.907+0000 7f60397fa700 1 -- 172.21.15.134:0/1257405668 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f603004c820 con 0x7f603c19b7d0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.907+0000 7f603b7fe700 1 --2- 172.21.15.134:0/1257405668 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f6024038400 0x7f602403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:48:59.775 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.908+0000 7f603b7fe700 1 --2- 172.21.15.134:0/1257405668 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f6024038400 0x7f602403a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f602c006fd0 tx=0x7f602c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:58.912+0000 7f60397fa700 1 -- 172.21.15.134:0/1257405668 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f603002b750 con 0x7f603c19b7d0 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.099+0000 7f604253e700 1 -- 172.21.15.134:0/1257405668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f603c19c4e0 con 0x7f603c19b7d0 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.103+0000 7f60397fa700 1 -- 172.21.15.134:0/1257405668 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f6030023390 con 0x7f603c19b7d0 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.106+0000 7f604253e700 1 -- 172.21.15.134:0/1257405668 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f6024038400 msgr2=0x7f602403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.106+0000 7f604253e700 1 --2- 172.21.15.134:0/1257405668 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f6024038400 0x7f602403a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f602c006fd0 tx=0x7f602c006e40 comp rx=0 tx=0).stop 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.106+0000 7f604253e700 1 -- 172.21.15.134:0/1257405668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c19b7d0 msgr2=0x7f603c19bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.106+0000 7f604253e700 1 --2- 172.21.15.134:0/1257405668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c19b7d0 0x7f603c19bbe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6030006af0 tx=0x7f6030011ab0 comp rx=0 tx=0).stop 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.106+0000 7f604253e700 1 -- 172.21.15.134:0/1257405668 shutdown_connections 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.106+0000 7f604253e700 1 --2- 172.21.15.134:0/1257405668 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f6024038400 0x7f602403a8b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.106+0000 7f604253e700 1 --2- 172.21.15.134:0/1257405668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f603c19b7d0 0x7f603c19bbe0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.106+0000 7f604253e700 1 -- 172.21.15.134:0/1257405668 >> 172.21.15.134:0/1257405668 conn(0x7f603c0ffe30 msgr2=0x7f603c101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.106+0000 7f604253e700 1 -- 172.21.15.134:0/1257405668 shutdown_connections 2024-04-13T10:48:59.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:48:59.106+0000 7f604253e700 1 -- 172.21.15.134:0/1257405668 wait complete. 2024-04-13T10:49:00.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:00 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1257405668' entity='client.admin' 2024-04-13T10:49:01.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.383+0000 7f24fb710700 1 Processor -- start 2024-04-13T10:49:01.428 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.383+0000 7f24fb710700 1 -- start start 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.384+0000 7f24fb710700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f4104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.384+0000 7f24fb710700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4105100 con 0x7f24f41047b0 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.384+0000 7f24f94ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f4104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.384+0000 7f24f94ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f4104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33592/0 (socket says 172.21.15.134:33592) 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.384+0000 7f24f94ac700 1 -- 172.21.15.134:0/3164324291 learned_addr learned my addr 172.21.15.134:0/3164324291 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.384+0000 7f24f94ac700 1 -- 172.21.15.134:0/3164324291 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f4105240 con 0x7f24f41047b0 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.384+0000 7f24f94ac700 1 --2- 172.21.15.134:0/3164324291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f4104bc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24e40098a0 tx=0x7f24e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d518cad248f7c36c server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.384+0000 7f24ebfff700 1 -- 172.21.15.134:0/3164324291 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24e4004180 con 0x7f24f41047b0 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.384+0000 7f24ebfff700 1 -- 172.21.15.134:0/3164324291 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f24e40042e0 con 0x7f24f41047b0 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.384+0000 7f24ebfff700 1 -- 172.21.15.134:0/3164324291 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24e4011a30 con 0x7f24f41047b0 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.385+0000 7f24fb710700 1 -- 172.21.15.134:0/3164324291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 msgr2=0x7f24f4104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.385+0000 7f24fb710700 1 --2- 172.21.15.134:0/3164324291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f4104bc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24e40098a0 tx=0x7f24e4009bb0 comp rx=0 tx=0).stop 2024-04-13T10:49:01.429 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.385+0000 7f24fb710700 1 -- 172.21.15.134:0/3164324291 shutdown_connections 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.385+0000 7f24fb710700 1 --2- 172.21.15.134:0/3164324291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f4104bc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.385+0000 7f24fb710700 1 -- 172.21.15.134:0/3164324291 >> 172.21.15.134:0/3164324291 conn(0x7f24f40ffe20 msgr2=0x7f24f4102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.385+0000 7f24fb710700 1 -- 172.21.15.134:0/3164324291 shutdown_connections 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.385+0000 7f24fb710700 1 -- 172.21.15.134:0/3164324291 wait complete. 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24fb710700 1 Processor -- start 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24fb710700 1 -- start start 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24fb710700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f41995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24fb710700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4199af0 con 0x7f24f41047b0 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24f94ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f41995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24f94ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f41995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33604/0 (socket says 172.21.15.134:33604) 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24f94ac700 1 -- 172.21.15.134:0/2879646571 learned_addr learned my addr 172.21.15.134:0/2879646571 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24f94ac700 1 -- 172.21.15.134:0/2879646571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e4009550 con 0x7f24f41047b0 2024-04-13T10:49:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24f94ac700 1 --2- 172.21.15.134:0/2879646571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f41995b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f24e4006af0 tx=0x7f24e4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24ea7fc700 1 -- 172.21.15.134:0/2879646571 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24e4003bc0 con 0x7f24f41047b0 2024-04-13T10:49:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24ea7fc700 1 -- 172.21.15.134:0/2879646571 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f24e401a8c0 con 0x7f24f41047b0 2024-04-13T10:49:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24ea7fc700 1 -- 172.21.15.134:0/2879646571 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24e4019860 con 0x7f24f41047b0 2024-04-13T10:49:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24fb710700 1 -- 172.21.15.134:0/2879646571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f4199cf0 con 0x7f24f41047b0 2024-04-13T10:49:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.386+0000 7f24fb710700 1 -- 172.21.15.134:0/2879646571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f419a110 con 0x7f24f41047b0 2024-04-13T10:49:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.387+0000 7f24ea7fc700 1 -- 172.21.15.134:0/2879646571 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f24e4019b20 con 0x7f24f41047b0 2024-04-13T10:49:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.387+0000 7f24fb710700 1 -- 172.21.15.134:0/2879646571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f4062380 con 0x7f24f41047b0 2024-04-13T10:49:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.387+0000 7f24ea7fc700 1 --2- 172.21.15.134:0/2879646571 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f24e00383b0 0x7f24e003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.387+0000 7f24ea7fc700 1 -- 172.21.15.134:0/2879646571 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f24e404c930 con 0x7f24f41047b0 2024-04-13T10:49:01.431 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.387+0000 7f24f8cab700 1 --2- 172.21.15.134:0/2879646571 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f24e00383b0 0x7f24e003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:01.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:01 smithi134 ceph-mon[39696]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:01.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:01 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2879646571' entity='client.admin' 2024-04-13T10:49:01.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.388+0000 7f24f8cab700 1 --2- 172.21.15.134:0/2879646571 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f24e00383b0 0x7f24e003a860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24f0006fd0 tx=0x7f24f0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:01.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.392+0000 7f24ea7fc700 1 -- 172.21.15.134:0/2879646571 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f24e402b750 con 0x7f24f41047b0 2024-04-13T10:49:01.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.580+0000 7f24fb710700 1 -- 172.21.15.134:0/2879646571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f24f4108c50 con 0x7f24f41047b0 2024-04-13T10:49:01.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.584+0000 7f24ea7fc700 1 -- 172.21.15.134:0/2879646571 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f24e4023390 con 0x7f24f41047b0 2024-04-13T10:49:01.433 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.587+0000 7f24fb710700 1 -- 172.21.15.134:0/2879646571 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f24e00383b0 msgr2=0x7f24e003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.587+0000 7f24fb710700 1 --2- 172.21.15.134:0/2879646571 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f24e00383b0 0x7f24e003a860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24f0006fd0 tx=0x7f24f0006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.587+0000 7f24fb710700 1 -- 172.21.15.134:0/2879646571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 msgr2=0x7f24f41995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.587+0000 7f24fb710700 1 --2- 172.21.15.134:0/2879646571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f41995b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f24e4006af0 tx=0x7f24e4011ab0 comp rx=0 tx=0).stop 2024-04-13T10:49:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.587+0000 7f24fb710700 1 -- 172.21.15.134:0/2879646571 shutdown_connections 2024-04-13T10:49:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.587+0000 7f24fb710700 1 --2- 172.21.15.134:0/2879646571 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f24e00383b0 0x7f24e003a860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.587+0000 7f24fb710700 1 --2- 172.21.15.134:0/2879646571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24f41047b0 0x7f24f41995b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.587+0000 7f24fb710700 1 -- 172.21.15.134:0/2879646571 >> 172.21.15.134:0/2879646571 conn(0x7f24f40ffe20 msgr2=0x7f24f4073ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.587+0000 7f24fb710700 1 -- 172.21.15.134:0/2879646571 shutdown_connections 2024-04-13T10:49:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:00.587+0000 7f24fb710700 1 -- 172.21.15.134:0/2879646571 wait complete. 2024-04-13T10:49:01.434 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling the dashboard module... 2024-04-13T10:49:02.598 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:02 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/662826793' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-13T10:49:03.043 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.917+0000 7fcaa8037700 1 Processor -- start 2024-04-13T10:49:03.043 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.918+0000 7fcaa8037700 1 -- start start 2024-04-13T10:49:03.043 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.918+0000 7fcaa8037700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa0107300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:03.043 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.918+0000 7fcaa8037700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0107840 con 0x7fcaa0106ef0 2024-04-13T10:49:03.043 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.918+0000 7fcaa5dd3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa0107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:03.043 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.918+0000 7fcaa5dd3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa0107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33612/0 (socket says 172.21.15.134:33612) 2024-04-13T10:49:03.043 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.918+0000 7fcaa5dd3700 1 -- 172.21.15.134:0/1113848295 learned_addr learned my addr 172.21.15.134:0/1113848295 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.918+0000 7fcaa5dd3700 1 -- 172.21.15.134:0/1113848295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa0107980 con 0x7fcaa0106ef0 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.918+0000 7fcaa5dd3700 1 --2- 172.21.15.134:0/1113848295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa0107300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0098a0 tx=0x7fca9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8aaa0b131911904 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.918+0000 7fcaa4dd1700 1 -- 172.21.15.134:0/1113848295 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca9c004180 con 0x7fcaa0106ef0 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.919+0000 7fcaa4dd1700 1 -- 172.21.15.134:0/1113848295 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fca9c0042e0 con 0x7fcaa0106ef0 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.919+0000 7fcaa4dd1700 1 -- 172.21.15.134:0/1113848295 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca9c011a30 con 0x7fcaa0106ef0 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.919+0000 7fcaa8037700 1 -- 172.21.15.134:0/1113848295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 msgr2=0x7fcaa0107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.919+0000 7fcaa8037700 1 --2- 172.21.15.134:0/1113848295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa0107300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0098a0 tx=0x7fca9c009bb0 comp rx=0 tx=0).stop 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.919+0000 7fcaa8037700 1 -- 172.21.15.134:0/1113848295 shutdown_connections 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.919+0000 7fcaa8037700 1 --2- 172.21.15.134:0/1113848295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa0107300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.919+0000 7fcaa8037700 1 -- 172.21.15.134:0/1113848295 >> 172.21.15.134:0/1113848295 conn(0x7fcaa00ff580 msgr2=0x7fcaa01019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.919+0000 7fcaa8037700 1 -- 172.21.15.134:0/1113848295 shutdown_connections 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.919+0000 7fcaa8037700 1 -- 172.21.15.134:0/1113848295 wait complete. 2024-04-13T10:49:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.920+0000 7fcaa8037700 1 Processor -- start 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.920+0000 7fcaa8037700 1 -- start start 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.920+0000 7fcaa8037700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa01065f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.920+0000 7fcaa8037700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0106b30 con 0x7fcaa0106ef0 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.920+0000 7fcaa5dd3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa01065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.920+0000 7fcaa5dd3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa01065f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33614/0 (socket says 172.21.15.134:33614) 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.920+0000 7fcaa5dd3700 1 -- 172.21.15.134:0/662826793 learned_addr learned my addr 172.21.15.134:0/662826793 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.920+0000 7fcaa5dd3700 1 -- 172.21.15.134:0/662826793 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c009550 con 0x7fcaa0106ef0 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.920+0000 7fcaa5dd3700 1 --2- 172.21.15.134:0/662826793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa01065f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca9c011a00 tx=0x7fca9c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.921+0000 7fca96ffd700 1 -- 172.21.15.134:0/662826793 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca9c003bd0 con 0x7fcaa0106ef0 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.921+0000 7fca96ffd700 1 -- 172.21.15.134:0/662826793 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fca9c0248d0 con 0x7fcaa0106ef0 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.921+0000 7fcaa8037700 1 -- 172.21.15.134:0/662826793 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa0104c40 con 0x7fcaa0106ef0 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.921+0000 7fca96ffd700 1 -- 172.21.15.134:0/662826793 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca9c01a7e0 con 0x7fcaa0106ef0 2024-04-13T10:49:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.921+0000 7fcaa8037700 1 -- 172.21.15.134:0/662826793 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa0105060 con 0x7fcaa0106ef0 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.922+0000 7fca96ffd700 1 -- 172.21.15.134:0/662826793 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fca9c024440 con 0x7fcaa0106ef0 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.922+0000 7fca96ffd700 1 --2- 172.21.15.134:0/662826793 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fca8c038440 0x7fca8c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.922+0000 7fcaa8037700 1 -- 172.21.15.134:0/662826793 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa01043e0 con 0x7fcaa0106ef0 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.922+0000 7fca96ffd700 1 -- 172.21.15.134:0/662826793 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fca9c04c460 con 0x7fcaa0106ef0 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.922+0000 7fcaa55d2700 1 --2- 172.21.15.134:0/662826793 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fca8c038440 0x7fca8c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.922+0000 7fcaa55d2700 1 --2- 172.21.15.134:0/662826793 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fca8c038440 0x7fca8c03a8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fca90006fd0 tx=0x7fca90006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:01.927+0000 7fca96ffd700 1 -- 172.21.15.134:0/662826793 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fca9c0246f0 con 0x7fcaa0106ef0 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.168+0000 7fcaa8037700 1 -- 172.21.15.134:0/662826793 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fcaa0104600 con 0x7fcaa0106ef0 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.258+0000 7fca96ffd700 1 -- 172.21.15.134:0/662826793 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fca9c02d910 con 0x7fcaa0106ef0 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.260+0000 7fca96ffd700 1 -- 172.21.15.134:0/662826793 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fca9c018d90 con 0x7fcaa0106ef0 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.262+0000 7fcaa8037700 1 -- 172.21.15.134:0/662826793 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fca8c038440 msgr2=0x7fca8c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.262+0000 7fcaa8037700 1 --2- 172.21.15.134:0/662826793 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fca8c038440 0x7fca8c03a8f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fca90006fd0 tx=0x7fca90006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:03.046 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.262+0000 7fcaa8037700 1 -- 172.21.15.134:0/662826793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 msgr2=0x7fcaa01065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:03.047 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.262+0000 7fcaa8037700 1 --2- 172.21.15.134:0/662826793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa01065f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca9c011a00 tx=0x7fca9c011ae0 comp rx=0 tx=0).stop 2024-04-13T10:49:03.047 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.262+0000 7fcaa8037700 1 -- 172.21.15.134:0/662826793 shutdown_connections 2024-04-13T10:49:03.047 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.262+0000 7fcaa8037700 1 --2- 172.21.15.134:0/662826793 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7fca8c038440 0x7fca8c03a8f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:03.047 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.262+0000 7fcaa8037700 1 --2- 172.21.15.134:0/662826793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaa0106ef0 0x7fcaa01065f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:03.047 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.262+0000 7fcaa8037700 1 -- 172.21.15.134:0/662826793 >> 172.21.15.134:0/662826793 conn(0x7fcaa00ff580 msgr2=0x7fcaa0100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:03.047 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.262+0000 7fcaa8037700 1 -- 172.21.15.134:0/662826793 shutdown_connections 2024-04-13T10:49:03.047 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:02.262+0000 7fcaa8037700 1 -- 172.21.15.134:0/662826793 wait complete. 2024-04-13T10:49:03.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:03 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/662826793' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-13T10:49:03.666 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:03 smithi134 ceph-mon[39696]: mgrmap e9: smithi134.tmanda(active, since 28s) 2024-04-13T10:49:04.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:04 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/881373780' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-13T10:49:04.542 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-04-13T10:49:04.542 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-13T10:49:04.542 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-13T10:49:04.542 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "active_name": "smithi134.tmanda", 2024-04-13T10:49:04.542 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-13T10:49:04.542 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-04-13T10:49:04.542 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.599+0000 7f14203ef700 1 Processor -- start 2024-04-13T10:49:04.542 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.599+0000 7f14203ef700 1 -- start start 2024-04-13T10:49:04.542 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.600+0000 7f14203ef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f14181050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:04.542 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.600+0000 7f14203ef700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418105600 con 0x7f1418104cb0 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.600+0000 7f141e18b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f14181050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.600+0000 7f141e18b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f14181050c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33646/0 (socket says 172.21.15.134:33646) 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.600+0000 7f141e18b700 1 -- 172.21.15.134:0/3108395315 learned_addr learned my addr 172.21.15.134:0/3108395315 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.600+0000 7f141e18b700 1 -- 172.21.15.134:0/3108395315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418105740 con 0x7f1418104cb0 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.601+0000 7f141e18b700 1 --2- 172.21.15.134:0/3108395315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f14181050c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14140098a0 tx=0x7f1414009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187f5ac240421e81 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.601+0000 7f141d189700 1 -- 172.21.15.134:0/3108395315 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1414004180 con 0x7f1418104cb0 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.601+0000 7f141d189700 1 -- 172.21.15.134:0/3108395315 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f14140042e0 con 0x7f1418104cb0 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.601+0000 7f141d189700 1 -- 172.21.15.134:0/3108395315 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1414011a30 con 0x7f1418104cb0 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.602+0000 7f14203ef700 1 -- 172.21.15.134:0/3108395315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 msgr2=0x7f14181050c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.602+0000 7f14203ef700 1 --2- 172.21.15.134:0/3108395315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f14181050c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14140098a0 tx=0x7f1414009bb0 comp rx=0 tx=0).stop 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.602+0000 7f14203ef700 1 -- 172.21.15.134:0/3108395315 shutdown_connections 2024-04-13T10:49:04.543 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.602+0000 7f14203ef700 1 --2- 172.21.15.134:0/3108395315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f14181050c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.602+0000 7f14203ef700 1 -- 172.21.15.134:0/3108395315 >> 172.21.15.134:0/3108395315 conn(0x7f14180ff580 msgr2=0x7f14181019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.602+0000 7f14203ef700 1 -- 172.21.15.134:0/3108395315 shutdown_connections 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.602+0000 7f14203ef700 1 -- 172.21.15.134:0/3108395315 wait complete. 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.603+0000 7f14203ef700 1 Processor -- start 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.603+0000 7f14203ef700 1 -- start start 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.603+0000 7f14203ef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f1418104470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.603+0000 7f14203ef700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141819c2e0 con 0x7f1418104cb0 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.603+0000 7f141e18b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f1418104470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.603+0000 7f141e18b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f1418104470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33650/0 (socket says 172.21.15.134:33650) 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.603+0000 7f141e18b700 1 -- 172.21.15.134:0/881373780 learned_addr learned my addr 172.21.15.134:0/881373780 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.603+0000 7f141e18b700 1 -- 172.21.15.134:0/881373780 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1414009550 con 0x7f1418104cb0 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.603+0000 7f141e18b700 1 --2- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f1418104470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1414006af0 tx=0x7f1414011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.604+0000 7f140f7fe700 1 -- 172.21.15.134:0/881373780 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1414003a80 con 0x7f1418104cb0 2024-04-13T10:49:04.544 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.604+0000 7f140f7fe700 1 -- 172.21.15.134:0/881373780 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f1414003be0 con 0x7f1418104cb0 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.604+0000 7f14203ef700 1 -- 172.21.15.134:0/881373780 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141819c420 con 0x7f1418104cb0 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.604+0000 7f140f7fe700 1 -- 172.21.15.134:0/881373780 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1414019770 con 0x7f1418104cb0 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.604+0000 7f14203ef700 1 -- 172.21.15.134:0/881373780 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141819c840 con 0x7f1418104cb0 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.604+0000 7f140f7fe700 1 -- 172.21.15.134:0/881373780 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f1414019a30 con 0x7f1418104cb0 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.605+0000 7f14203ef700 1 -- 172.21.15.134:0/881373780 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1418062380 con 0x7f1418104cb0 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.605+0000 7f140f7fe700 1 --2- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1404038400 0x7f140403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.605+0000 7f140f7fe700 1 -- 172.21.15.134:0/881373780 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f141404c8a0 con 0x7f1418104cb0 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.605+0000 7f141d98a700 1 -- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1404038400 msgr2=0x7f140403a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1656434316 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.605+0000 7f141d98a700 1 --2- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1404038400 0x7f140403a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.609+0000 7f140f7fe700 1 -- 172.21.15.134:0/881373780 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f141402b750 con 0x7f1418104cb0 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.806+0000 7f141d98a700 1 -- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1404038400 msgr2=0x7f140403a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1656434316 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.806+0000 7f141d98a700 1 --2- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1404038400 0x7f140403a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.864+0000 7f14203ef700 1 -- 172.21.15.134:0/881373780 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f141819d2d0 con 0x7f1418104cb0 2024-04-13T10:49:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.864+0000 7f140f7fe700 1 -- 172.21.15.134:0/881373780 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f1414023390 con 0x7f1418104cb0 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.866+0000 7f14203ef700 1 -- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1404038400 msgr2=0x7f140403a8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.866+0000 7f14203ef700 1 --2- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1404038400 0x7f140403a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.866+0000 7f14203ef700 1 -- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 msgr2=0x7f1418104470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.866+0000 7f14203ef700 1 --2- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f1418104470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1414006af0 tx=0x7f1414011b20 comp rx=0 tx=0).stop 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.866+0000 7f14203ef700 1 -- 172.21.15.134:0/881373780 shutdown_connections 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.866+0000 7f14203ef700 1 --2- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f1404038400 0x7f140403a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.866+0000 7f14203ef700 1 --2- 172.21.15.134:0/881373780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1418104cb0 0x7f1418104470 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.866+0000 7f14203ef700 1 -- 172.21.15.134:0/881373780 >> 172.21.15.134:0/881373780 conn(0x7f14180ff580 msgr2=0x7f1418100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.866+0000 7f14203ef700 1 -- 172.21.15.134:0/881373780 shutdown_connections 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:03.866+0000 7f14203ef700 1 -- 172.21.15.134:0/881373780 wait complete. 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for the mgr to restart... 2024-04-13T10:49:04.546 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr epoch 9... 2024-04-13T10:49:09.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: Active manager daemon smithi134.tmanda restarted 2024-04-13T10:49:09.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: Activating manager daemon smithi134.tmanda 2024-04-13T10:49:09.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: osdmap e3: 0 total, 0 up, 0 in 2024-04-13T10:49:09.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: mgrmap e10: smithi134.tmanda(active, starting, since 0.0058823s) 2024-04-13T10:49:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:49:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr metadata", "who": "smithi134.tmanda", "id": "smithi134.tmanda"}]: dispatch 2024-04-13T10:49:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-13T10:49:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-13T10:49:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-13T10:49:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: Manager daemon smithi134.tmanda is now available 2024-04-13T10:49:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:49:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:08 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:49:10.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:09 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/mirror_snapshot_schedule"}]: dispatch 2024-04-13T10:49:10.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:09 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/trash_purge_schedule"}]: dispatch 2024-04-13T10:49:10.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:09 smithi134 ceph-mon[39696]: mgrmap e11: smithi134.tmanda(active, since 1.00578s) 2024-04-13T10:49:10.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-04-13T10:49:10.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-13T10:49:10.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-13T10:49:10.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-04-13T10:49:10.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.116+0000 7f48ff7b1700 1 Processor -- start 2024-04-13T10:49:10.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.116+0000 7f48ff7b1700 1 -- start start 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.117+0000 7f48ff7b1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f81087e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.117+0000 7f48ff7b1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8074380 con 0x7f48f8106400 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.117+0000 7f48fd54d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f81087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.117+0000 7f48fd54d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f81087e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33662/0 (socket says 172.21.15.134:33662) 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.117+0000 7f48fd54d700 1 -- 172.21.15.134:0/2894573897 learned_addr learned my addr 172.21.15.134:0/2894573897 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.117+0000 7f48fd54d700 1 -- 172.21.15.134:0/2894573897 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f80744c0 con 0x7f48f8106400 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.117+0000 7f48fd54d700 1 --2- 172.21.15.134:0/2894573897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f81087e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48e80098a0 tx=0x7f48e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96ba6a7cf694203 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.117+0000 7f48effff700 1 -- 172.21.15.134:0/2894573897 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48e8004180 con 0x7f48f8106400 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.117+0000 7f48effff700 1 -- 172.21.15.134:0/2894573897 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f48e80042e0 con 0x7f48f8106400 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.117+0000 7f48effff700 1 -- 172.21.15.134:0/2894573897 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48e8011a30 con 0x7f48f8106400 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.118+0000 7f48ff7b1700 1 -- 172.21.15.134:0/2894573897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 msgr2=0x7f48f81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.118+0000 7f48ff7b1700 1 --2- 172.21.15.134:0/2894573897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f81087e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48e80098a0 tx=0x7f48e8009bb0 comp rx=0 tx=0).stop 2024-04-13T10:49:10.753 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.118+0000 7f48ff7b1700 1 -- 172.21.15.134:0/2894573897 shutdown_connections 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.118+0000 7f48ff7b1700 1 --2- 172.21.15.134:0/2894573897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f81087e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.118+0000 7f48ff7b1700 1 -- 172.21.15.134:0/2894573897 >> 172.21.15.134:0/2894573897 conn(0x7f48f80ffe20 msgr2=0x7f48f8102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.118+0000 7f48ff7b1700 1 -- 172.21.15.134:0/2894573897 shutdown_connections 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.118+0000 7f48ff7b1700 1 -- 172.21.15.134:0/2894573897 wait complete. 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.119+0000 7f48ff7b1700 1 Processor -- start 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.119+0000 7f48ff7b1700 1 -- start start 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.119+0000 7f48ff7b1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f8199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.119+0000 7f48ff7b1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8199ad0 con 0x7f48f8106400 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.119+0000 7f48fd54d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f8199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.119+0000 7f48fd54d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f8199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33670/0 (socket says 172.21.15.134:33670) 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.119+0000 7f48fd54d700 1 -- 172.21.15.134:0/1558940185 learned_addr learned my addr 172.21.15.134:0/1558940185 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.119+0000 7f48fd54d700 1 -- 172.21.15.134:0/1558940185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8009550 con 0x7f48f8106400 2024-04-13T10:49:10.754 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.119+0000 7f48fd54d700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f8199590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48e8006af0 tx=0x7f48e8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.120+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48e8003bc0 con 0x7f48f8106400 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.120+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f48e801a8c0 con 0x7f48f8106400 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.120+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48e8019820 con 0x7f48f8106400 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.120+0000 7f48ff7b1700 1 -- 172.21.15.134:0/1558940185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f8199d30 con 0x7f48f8106400 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.120+0000 7f48ff7b1700 1 -- 172.21.15.134:0/1558940185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f819a1b0 con 0x7f48f8106400 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.121+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f48e8019aa0 con 0x7f48f8106400 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.121+0000 7f48ee7fc700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 0x7f48e403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.121+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 --> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48e403afc0 con 0x7f48e4038400 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.121+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f48e804c740 con 0x7f48f8106400 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.121+0000 7f48fcd4c700 1 -- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 msgr2=0x7f48e403a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1656434316 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.121+0000 7f48fcd4c700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 0x7f48e403a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.322+0000 7f48fcd4c700 1 -- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 msgr2=0x7f48e403a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1656434316 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.322+0000 7f48fcd4c700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 0x7f48e403a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-13T10:49:10.755 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.723+0000 7f48fcd4c700 1 -- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 msgr2=0x7f48e403a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1656434316 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:05.723+0000 7f48fcd4c700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 0x7f48e403a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:06.524+0000 7f48fcd4c700 1 -- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 msgr2=0x7f48e403a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1656434316 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:06.524+0000 7f48fcd4c700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 0x7f48e403a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:08.125+0000 7f48fcd4c700 1 -- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 msgr2=0x7f48e403a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1656434316 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:08.125+0000 7f48fcd4c700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 0x7f48e403a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:08.878+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7f48e802d440 con 0x7f48f8106400 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:08.878+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 msgr2=0x7f48e403a8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:08.878+0000 7f48ee7fc700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 0x7f48e403a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.877+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7f48e802d7c0 con 0x7f48f8106400 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.878+0000 7f48ee7fc700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f48e403beb0 0x7f48e403e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.878+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 --> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48e403afc0 con 0x7f48e403beb0 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.878+0000 7f48fcd4c700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f48e403beb0 0x7f48e403e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.879+0000 7f48fcd4c700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f48e403beb0 0x7f48e403e290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f48f4003a10 tx=0x7f48f40092b0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:10.756 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.879+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 <== mgr.14162 v2:172.21.15.134:6800/2524753251 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f48e403afc0 con 0x7f48e403beb0 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.885+0000 7f48ff7b1700 1 -- 172.21.15.134:0/1558940185 --> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f48f819a8d0 con 0x7f48e403beb0 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ee7fc700 1 -- 172.21.15.134:0/1558940185 <== mgr.14162 v2:172.21.15.134:6800/2524753251 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f48f819a8d0 con 0x7f48e403beb0 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 -- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f48e403beb0 msgr2=0x7f48e403e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f48e403beb0 0x7f48e403e290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f48f4003a10 tx=0x7f48f40092b0 comp rx=0 tx=0).stop 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 -- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 msgr2=0x7f48f8199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f8199590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48e8006af0 tx=0x7f48e8011ab0 comp rx=0 tx=0).stop 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 -- 172.21.15.134:0/1558940185 shutdown_connections 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f48e403beb0 0x7f48e403e290 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48f8106400 0x7f48f8199590 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 --2- 172.21.15.134:0/1558940185 >> [v2:172.21.15.134:6800/1656434316,v1:172.21.15.134:6801/1656434316] conn(0x7f48e4038400 0x7f48e403a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 -- 172.21.15.134:0/1558940185 >> 172.21.15.134:0/1558940185 conn(0x7f48f80ffe20 msgr2=0x7f48f81014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 -- 172.21.15.134:0/1558940185 shutdown_connections 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:09.886+0000 7f48ff7b1700 1 -- 172.21.15.134:0/1558940185 wait complete. 2024-04-13T10:49:10.757 INFO:teuthology.orchestra.run.smithi134.stdout:mgr epoch 9 is available 2024-04-13T10:49:10.758 INFO:teuthology.orchestra.run.smithi134.stdout:Generating a dashboard self-signed certificate... 2024-04-13T10:49:11.021 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:10 smithi134 ceph-mon[39696]: [13/Apr/2024:10:49:09] ENGINE Bus STARTING 2024-04-13T10:49:11.021 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:10 smithi134 ceph-mon[39696]: [13/Apr/2024:10:49:09] ENGINE Serving on http://172.21.15.134:8765 2024-04-13T10:49:11.021 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:10 smithi134 ceph-mon[39696]: [13/Apr/2024:10:49:09] ENGINE Serving on https://172.21.15.134:7150 2024-04-13T10:49:11.021 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:10 smithi134 ceph-mon[39696]: [13/Apr/2024:10:49:09] ENGINE Bus STARTED 2024-04-13T10:49:11.021 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:10 smithi134 ceph-mon[39696]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-13T10:49:11.022 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:10 smithi134 ceph-mon[39696]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-13T10:49:12.006 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:11 smithi134 ceph-mon[39696]: mgrmap e12: smithi134.tmanda(active, since 2s) 2024-04-13T10:49:12.007 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:11 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:12.007 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:11 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:12.007 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:11 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:12.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-13T10:49:12.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.355+0000 7f18fabb2700 1 Processor -- start 2024-04-13T10:49:12.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.355+0000 7f18fabb2700 1 -- start start 2024-04-13T10:49:12.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.355+0000 7f18fabb2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f4104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:12.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.355+0000 7f18fabb2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4105100 con 0x7f18f41047b0 2024-04-13T10:49:12.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.355+0000 7f18f894e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f4104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:12.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.355+0000 7f18f894e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f4104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44520/0 (socket says 172.21.15.134:44520) 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.355+0000 7f18f894e700 1 -- 172.21.15.134:0/1052211524 learned_addr learned my addr 172.21.15.134:0/1052211524 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18f894e700 1 -- 172.21.15.134:0/1052211524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4105240 con 0x7f18f41047b0 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18f894e700 1 --2- 172.21.15.134:0/1052211524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f4104bc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18e80098a0 tx=0x7f18e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50249054606e4ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18f37fe700 1 -- 172.21.15.134:0/1052211524 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18e8004180 con 0x7f18f41047b0 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18f37fe700 1 -- 172.21.15.134:0/1052211524 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f18e80042e0 con 0x7f18f41047b0 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18f37fe700 1 -- 172.21.15.134:0/1052211524 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18e8011a30 con 0x7f18f41047b0 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18fabb2700 1 -- 172.21.15.134:0/1052211524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 msgr2=0x7f18f4104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18fabb2700 1 --2- 172.21.15.134:0/1052211524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f4104bc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18e80098a0 tx=0x7f18e8009bb0 comp rx=0 tx=0).stop 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18fabb2700 1 -- 172.21.15.134:0/1052211524 shutdown_connections 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18fabb2700 1 --2- 172.21.15.134:0/1052211524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f4104bc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18fabb2700 1 -- 172.21.15.134:0/1052211524 >> 172.21.15.134:0/1052211524 conn(0x7f18f40ffe20 msgr2=0x7f18f4102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:12.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18fabb2700 1 -- 172.21.15.134:0/1052211524 shutdown_connections 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.356+0000 7f18fabb2700 1 -- 172.21.15.134:0/1052211524 wait complete. 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.357+0000 7f18fabb2700 1 Processor -- start 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.357+0000 7f18fabb2700 1 -- start start 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.357+0000 7f18fabb2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f41995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.357+0000 7f18fabb2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4199af0 con 0x7f18f41047b0 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.357+0000 7f18f894e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f41995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.357+0000 7f18f894e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f41995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44536/0 (socket says 172.21.15.134:44536) 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.357+0000 7f18f894e700 1 -- 172.21.15.134:0/3193428482 learned_addr learned my addr 172.21.15.134:0/3193428482 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.357+0000 7f18f894e700 1 -- 172.21.15.134:0/3193428482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e8009550 con 0x7f18f41047b0 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.358+0000 7f18f894e700 1 --2- 172.21.15.134:0/3193428482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f41995b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18e8006af0 tx=0x7f18e8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.358+0000 7f18f1ffb700 1 -- 172.21.15.134:0/3193428482 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18e8003bc0 con 0x7f18f41047b0 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.358+0000 7f18f1ffb700 1 -- 172.21.15.134:0/3193428482 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f18e801a8c0 con 0x7f18f41047b0 2024-04-13T10:49:12.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.358+0000 7f18fabb2700 1 -- 172.21.15.134:0/3193428482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f4199cf0 con 0x7f18f41047b0 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.358+0000 7f18f1ffb700 1 -- 172.21.15.134:0/3193428482 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18e8019860 con 0x7f18f41047b0 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.358+0000 7f18fabb2700 1 -- 172.21.15.134:0/3193428482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f419a110 con 0x7f18f41047b0 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.359+0000 7f18f1ffb700 1 -- 172.21.15.134:0/3193428482 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f18e8019ad0 con 0x7f18f41047b0 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.359+0000 7f18f1ffb700 1 --2- 172.21.15.134:0/3193428482 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f18e4038450 0x7f18e403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.359+0000 7f18f1ffb700 1 -- 172.21.15.134:0/3193428482 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f18e804c820 con 0x7f18f41047b0 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.359+0000 7f18fabb2700 1 -- 172.21.15.134:0/3193428482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f4062380 con 0x7f18f41047b0 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.359+0000 7f18f3fff700 1 --2- 172.21.15.134:0/3193428482 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f18e4038450 0x7f18e403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.359+0000 7f18f3fff700 1 --2- 172.21.15.134:0/3193428482 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f18e4038450 0x7f18e403a900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f18e0006fd0 tx=0x7f18e0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.364+0000 7f18f1ffb700 1 -- 172.21.15.134:0/3193428482 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f18e802c3a0 con 0x7f18f41047b0 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.577+0000 7f18fabb2700 1 -- 172.21.15.134:0/3193428482 --> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f18f4101f50 con 0x7f18e4038450 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.666+0000 7f18f1ffb700 1 -- 172.21.15.134:0/3193428482 <== mgr.14162 v2:172.21.15.134:6800/2524753251 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f18f4101f50 con 0x7f18e4038450 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.668+0000 7f18fabb2700 1 -- 172.21.15.134:0/3193428482 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f18e4038450 msgr2=0x7f18e403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:12.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.668+0000 7f18fabb2700 1 --2- 172.21.15.134:0/3193428482 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f18e4038450 0x7f18e403a900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f18e0006fd0 tx=0x7f18e0006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:12.260 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.668+0000 7f18fabb2700 1 -- 172.21.15.134:0/3193428482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 msgr2=0x7f18f41995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:12.260 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.668+0000 7f18fabb2700 1 --2- 172.21.15.134:0/3193428482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f41995b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18e8006af0 tx=0x7f18e8011ab0 comp rx=0 tx=0).stop 2024-04-13T10:49:12.260 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.668+0000 7f18fabb2700 1 -- 172.21.15.134:0/3193428482 shutdown_connections 2024-04-13T10:49:12.260 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.668+0000 7f18fabb2700 1 --2- 172.21.15.134:0/3193428482 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f18e4038450 0x7f18e403a900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:12.260 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.668+0000 7f18fabb2700 1 --2- 172.21.15.134:0/3193428482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18f41047b0 0x7f18f41995b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:12.260 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.668+0000 7f18fabb2700 1 -- 172.21.15.134:0/3193428482 >> 172.21.15.134:0/3193428482 conn(0x7f18f40ffe20 msgr2=0x7f18f4073ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:12.260 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.668+0000 7f18fabb2700 1 -- 172.21.15.134:0/3193428482 shutdown_connections 2024-04-13T10:49:12.260 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:11.668+0000 7f18fabb2700 1 -- 172.21.15.134:0/3193428482 wait complete. 2024-04-13T10:49:12.260 INFO:teuthology.orchestra.run.smithi134.stdout:Creating initial admin user... 2024-04-13T10:49:13.219 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:12 smithi134 ceph-mon[39696]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:49:13.219 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:12 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:14.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:14 smithi134 ceph-mon[39696]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:49:14.527 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:14 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$OITAmrUe5L0BqDvHxe6xk.8rOLfzjrJPSn7vvkNAYIE04IBJu4XAS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713005353, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.837+0000 7fcc6623a700 1 Processor -- start 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.837+0000 7fcc6623a700 1 -- start start 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.838+0000 7fcc6623a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc60103fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.838+0000 7fcc6623a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc601044e0 con 0x7fcc60103b90 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.838+0000 7fcc5f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc60103fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.838+0000 7fcc5f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc60103fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44552/0 (socket says 172.21.15.134:44552) 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.838+0000 7fcc5f7fe700 1 -- 172.21.15.134:0/3216277411 learned_addr learned my addr 172.21.15.134:0/3216277411 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.838+0000 7fcc5f7fe700 1 -- 172.21.15.134:0/3216277411 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc60104620 con 0x7fcc60103b90 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.838+0000 7fcc5f7fe700 1 --2- 172.21.15.134:0/3216277411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc60103fa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009e80 tx=0x7fcc5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3882d471c8887c38 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:14.820 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.838+0000 7fcc5e7fc700 1 -- 172.21.15.134:0/3216277411 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc5800e070 con 0x7fcc60103b90 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.838+0000 7fcc5e7fc700 1 -- 172.21.15.134:0/3216277411 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fcc5800b8c0 con 0x7fcc60103b90 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.838+0000 7fcc5e7fc700 1 -- 172.21.15.134:0/3216277411 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc58004440 con 0x7fcc60103b90 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.839+0000 7fcc6623a700 1 -- 172.21.15.134:0/3216277411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 msgr2=0x7fcc60103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.839+0000 7fcc6623a700 1 --2- 172.21.15.134:0/3216277411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc60103fa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009e80 tx=0x7fcc5800b330 comp rx=0 tx=0).stop 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.839+0000 7fcc6623a700 1 -- 172.21.15.134:0/3216277411 shutdown_connections 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.839+0000 7fcc6623a700 1 --2- 172.21.15.134:0/3216277411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc60103fa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.839+0000 7fcc6623a700 1 -- 172.21.15.134:0/3216277411 >> 172.21.15.134:0/3216277411 conn(0x7fcc600ff590 msgr2=0x7fcc601019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.839+0000 7fcc6623a700 1 -- 172.21.15.134:0/3216277411 shutdown_connections 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.839+0000 7fcc6623a700 1 -- 172.21.15.134:0/3216277411 wait complete. 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc6623a700 1 Processor -- start 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc6623a700 1 -- start start 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc6623a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc601995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:14.821 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc6623a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc60199b00 con 0x7fcc60103b90 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc5f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc601995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc5f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc601995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44556/0 (socket says 172.21.15.134:44556) 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc5f7fe700 1 -- 172.21.15.134:0/2352791163 learned_addr learned my addr 172.21.15.134:0/2352791163 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc5f7fe700 1 -- 172.21.15.134:0/2352791163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc58009b30 con 0x7fcc60103b90 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc5f7fe700 1 --2- 172.21.15.134:0/2352791163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc601995c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc580072a0 tx=0x7fcc58003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc5cff9700 1 -- 172.21.15.134:0/2352791163 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc5800e040 con 0x7fcc60103b90 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc5cff9700 1 -- 172.21.15.134:0/2352791163 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fcc5800bc40 con 0x7fcc60103b90 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.840+0000 7fcc6623a700 1 -- 172.21.15.134:0/2352791163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc60199d00 con 0x7fcc60103b90 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.841+0000 7fcc5cff9700 1 -- 172.21.15.134:0/2352791163 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc580126b0 con 0x7fcc60103b90 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.841+0000 7fcc6623a700 1 -- 172.21.15.134:0/2352791163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6019a180 con 0x7fcc60103b90 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.841+0000 7fcc5cff9700 1 -- 172.21.15.134:0/2352791163 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fcc58019040 con 0x7fcc60103b90 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.841+0000 7fcc6623a700 1 -- 172.21.15.134:0/2352791163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc60062380 con 0x7fcc60103b90 2024-04-13T10:49:14.822 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.842+0000 7fcc5cff9700 1 --2- 172.21.15.134:0/2352791163 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fcc48038450 0x7fcc4803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.842+0000 7fcc5cff9700 1 -- 172.21.15.134:0/2352791163 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcc5804be40 con 0x7fcc60103b90 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.842+0000 7fcc5effd700 1 --2- 172.21.15.134:0/2352791163 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fcc48038450 0x7fcc4803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.842+0000 7fcc5effd700 1 --2- 172.21.15.134:0/2352791163 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fcc48038450 0x7fcc4803a900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc54006fd0 tx=0x7fcc54006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:12.846+0000 7fcc5cff9700 1 -- 172.21.15.134:0/2352791163 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcc58011750 con 0x7fcc60103b90 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.065+0000 7fcc6623a700 1 -- 172.21.15.134:0/2352791163 --> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fcc60109dc0 con 0x7fcc48038450 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.293+0000 7fcc5cff9700 1 -- 172.21.15.134:0/2352791163 <== mgr.14162 v2:172.21.15.134:6800/2524753251 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fcc60109dc0 con 0x7fcc48038450 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.296+0000 7fcc6623a700 1 -- 172.21.15.134:0/2352791163 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fcc48038450 msgr2=0x7fcc4803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.296+0000 7fcc6623a700 1 --2- 172.21.15.134:0/2352791163 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fcc48038450 0x7fcc4803a900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc54006fd0 tx=0x7fcc54006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.296+0000 7fcc6623a700 1 -- 172.21.15.134:0/2352791163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 msgr2=0x7fcc601995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.296+0000 7fcc6623a700 1 --2- 172.21.15.134:0/2352791163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc601995c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc580072a0 tx=0x7fcc58003d70 comp rx=0 tx=0).stop 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.296+0000 7fcc6623a700 1 -- 172.21.15.134:0/2352791163 shutdown_connections 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.296+0000 7fcc6623a700 1 --2- 172.21.15.134:0/2352791163 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fcc48038450 0x7fcc4803a900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.296+0000 7fcc6623a700 1 --2- 172.21.15.134:0/2352791163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc60103b90 0x7fcc601995c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:14.823 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.296+0000 7fcc6623a700 1 -- 172.21.15.134:0/2352791163 >> 172.21.15.134:0/2352791163 conn(0x7fcc600ff590 msgr2=0x7fcc60100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:14.824 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.296+0000 7fcc6623a700 1 -- 172.21.15.134:0/2352791163 shutdown_connections 2024-04-13T10:49:14.824 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:13.296+0000 7fcc6623a700 1 -- 172.21.15.134:0/2352791163 wait complete. 2024-04-13T10:49:14.824 INFO:teuthology.orchestra.run.smithi134.stdout:Fetching dashboard port number... 2024-04-13T10:49:16.217 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 8443 2024-04-13T10:49:16.217 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.342+0000 7f18a96cd700 1 Processor -- start 2024-04-13T10:49:16.217 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.342+0000 7f18a96cd700 1 -- start start 2024-04-13T10:49:16.217 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.342+0000 7f18a96cd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a41087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:16.217 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.342+0000 7f18a96cd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a4079d30 con 0x7f18a4106410 2024-04-13T10:49:16.217 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.342+0000 7f18a2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a41087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:16.218 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.342+0000 7f18a2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a41087f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44560/0 (socket says 172.21.15.134:44560) 2024-04-13T10:49:16.218 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.342+0000 7f18a2ffd700 1 -- 172.21.15.134:0/1854393957 learned_addr learned my addr 172.21.15.134:0/1854393957 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:16.218 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.343+0000 7f18a2ffd700 1 -- 172.21.15.134:0/1854393957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a4079e70 con 0x7f18a4106410 2024-04-13T10:49:16.218 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.343+0000 7f18a2ffd700 1 --2- 172.21.15.134:0/1854393957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a41087f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18940098a0 tx=0x7f1894009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd41ff57fac0a6c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:16.218 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.343+0000 7f18a1ffb700 1 -- 172.21.15.134:0/1854393957 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1894004180 con 0x7f18a4106410 2024-04-13T10:49:16.218 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.343+0000 7f18a1ffb700 1 -- 172.21.15.134:0/1854393957 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f18940042e0 con 0x7f18a4106410 2024-04-13T10:49:16.218 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.343+0000 7f18a1ffb700 1 -- 172.21.15.134:0/1854393957 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1894011a30 con 0x7f18a4106410 2024-04-13T10:49:16.218 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.344+0000 7f18a96cd700 1 -- 172.21.15.134:0/1854393957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 msgr2=0x7f18a41087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:16.222 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.344+0000 7f18a96cd700 1 --2- 172.21.15.134:0/1854393957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a41087f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18940098a0 tx=0x7f1894009bb0 comp rx=0 tx=0).stop 2024-04-13T10:49:16.222 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.344+0000 7f18a96cd700 1 -- 172.21.15.134:0/1854393957 shutdown_connections 2024-04-13T10:49:16.222 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.344+0000 7f18a96cd700 1 --2- 172.21.15.134:0/1854393957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a41087f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.344+0000 7f18a96cd700 1 -- 172.21.15.134:0/1854393957 >> 172.21.15.134:0/1854393957 conn(0x7f18a40ffe30 msgr2=0x7f18a4102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.344+0000 7f18a96cd700 1 -- 172.21.15.134:0/1854393957 shutdown_connections 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.344+0000 7f18a96cd700 1 -- 172.21.15.134:0/1854393957 wait complete. 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.344+0000 7f18a96cd700 1 Processor -- start 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.344+0000 7f18a96cd700 1 -- start start 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f18a96cd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f18a96cd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a419bd00 con 0x7f18a4106410 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f18a2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f18a2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a419b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44562/0 (socket says 172.21.15.134:44562) 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f18a2ffd700 1 -- 172.21.15.134:0/3960597543 learned_addr learned my addr 172.21.15.134:0/3960597543 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f18a2ffd700 1 -- 172.21.15.134:0/3960597543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894009550 con 0x7f18a4106410 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f18a2ffd700 1 --2- 172.21.15.134:0/3960597543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a419b7c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1894000c00 tx=0x7f1894011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:16.223 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f188bfff700 1 -- 172.21.15.134:0/3960597543 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1894003bc0 con 0x7f18a4106410 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f188bfff700 1 -- 172.21.15.134:0/3960597543 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f18940248d0 con 0x7f18a4106410 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f18a96cd700 1 -- 172.21.15.134:0/3960597543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a419bf60 con 0x7f18a4106410 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f188bfff700 1 -- 172.21.15.134:0/3960597543 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f189401a890 con 0x7f18a4106410 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.345+0000 7f18a96cd700 1 -- 172.21.15.134:0/3960597543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a419c3e0 con 0x7f18a4106410 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.346+0000 7f18a96cd700 1 -- 172.21.15.134:0/3960597543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a41098c0 con 0x7f18a4106410 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.347+0000 7f188bfff700 1 -- 172.21.15.134:0/3960597543 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f1894024a40 con 0x7f18a4106410 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.347+0000 7f188bfff700 1 --2- 172.21.15.134:0/3960597543 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f188c0384e0 0x7f188c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.347+0000 7f188bfff700 1 -- 172.21.15.134:0/3960597543 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f189404cb60 con 0x7f18a4106410 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.347+0000 7f18a27fc700 1 --2- 172.21.15.134:0/3960597543 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f188c0384e0 0x7f188c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.347+0000 7f18a27fc700 1 --2- 172.21.15.134:0/3960597543 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f188c0384e0 0x7f188c03a990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1898006fd0 tx=0x7f1898006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.351+0000 7f188bfff700 1 -- 172.21.15.134:0/3960597543 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1894018710 con 0x7f18a4106410 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.539+0000 7f18a96cd700 1 -- 172.21.15.134:0/3960597543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f18a419f180 con 0x7f18a4106410 2024-04-13T10:49:16.224 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.539+0000 7f188bfff700 1 -- 172.21.15.134:0/3960597543 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f1894018350 con 0x7f18a4106410 2024-04-13T10:49:16.225 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.541+0000 7f18a96cd700 1 -- 172.21.15.134:0/3960597543 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f188c0384e0 msgr2=0x7f188c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:16.225 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.541+0000 7f18a96cd700 1 --2- 172.21.15.134:0/3960597543 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f188c0384e0 0x7f188c03a990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1898006fd0 tx=0x7f1898006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:16.225 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.542+0000 7f18a96cd700 1 -- 172.21.15.134:0/3960597543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 msgr2=0x7f18a419b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:16.225 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.542+0000 7f18a96cd700 1 --2- 172.21.15.134:0/3960597543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a419b7c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1894000c00 tx=0x7f1894011ab0 comp rx=0 tx=0).stop 2024-04-13T10:49:16.225 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.542+0000 7f18a96cd700 1 -- 172.21.15.134:0/3960597543 shutdown_connections 2024-04-13T10:49:16.225 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.542+0000 7f18a96cd700 1 --2- 172.21.15.134:0/3960597543 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f188c0384e0 0x7f188c03a990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:16.225 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.542+0000 7f18a96cd700 1 --2- 172.21.15.134:0/3960597543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4106410 0x7f18a419b7c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:16.225 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.542+0000 7f18a96cd700 1 -- 172.21.15.134:0/3960597543 >> 172.21.15.134:0/3960597543 conn(0x7f18a40ffe30 msgr2=0x7f18a41014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:16.226 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.542+0000 7f18a96cd700 1 -- 172.21.15.134:0/3960597543 shutdown_connections 2024-04-13T10:49:16.226 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:15.542+0000 7f18a96cd700 1 -- 172.21.15.134:0/3960597543 wait complete. 2024-04-13T10:49:16.226 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-13T10:49:16.226 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-04-13T10:49:16.231 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-13T10:49:16.231 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-04-13T10:49:16.231 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-04-13T10:49:16.231 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-13T10:49:16.234 INFO:teuthology.orchestra.run.smithi134.stdout:Ceph Dashboard is now available at: 2024-04-13T10:49:16.234 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:16.234 INFO:teuthology.orchestra.run.smithi134.stdout: URL: https://smithi134.front.sepia.ceph.com:8443/ 2024-04-13T10:49:16.235 INFO:teuthology.orchestra.run.smithi134.stdout: User: admin 2024-04-13T10:49:16.235 INFO:teuthology.orchestra.run.smithi134.stdout: Password: kxy0ry5oj5 2024-04-13T10:49:16.235 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:16.235 INFO:teuthology.orchestra.run.smithi134.stdout:Saving cluster configuration to /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config directory 2024-04-13T10:49:16.235 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling autotune for osd_memory_target 2024-04-13T10:49:16.493 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:16 smithi134 ceph-mon[39696]: mgrmap e13: smithi134.tmanda(active, since 6s) 2024-04-13T10:49:16.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:16 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3960597543' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-13T10:49:17.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.835+0000 7f68d6a4c700 1 Processor -- start 2024-04-13T10:49:17.670 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.835+0000 7f68d6a4c700 1 -- start start 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.835+0000 7f68d6a4c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d0104bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.835+0000 7f68d6a4c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0105110 con 0x7f68d01047c0 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.835+0000 7f68cffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d0104bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.836+0000 7f68cffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d0104bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44576/0 (socket says 172.21.15.134:44576) 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.836+0000 7f68cffff700 1 -- 172.21.15.134:0/3680850100 learned_addr learned my addr 172.21.15.134:0/3680850100 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.836+0000 7f68cffff700 1 -- 172.21.15.134:0/3680850100 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0105250 con 0x7f68d01047c0 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.836+0000 7f68cffff700 1 --2- 172.21.15.134:0/3680850100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d0104bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f68c400bb40 tx=0x7f68c400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ea17f089eebc04 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.836+0000 7f68ceffd700 1 -- 172.21.15.134:0/3680850100 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68c400dc00 con 0x7f68d01047c0 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.836+0000 7f68ceffd700 1 -- 172.21.15.134:0/3680850100 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f68c40044c0 con 0x7f68d01047c0 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.836+0000 7f68ceffd700 1 -- 172.21.15.134:0/3680850100 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68c4003e90 con 0x7f68d01047c0 2024-04-13T10:49:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.837+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3680850100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 msgr2=0x7f68d0104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.837+0000 7f68d6a4c700 1 --2- 172.21.15.134:0/3680850100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d0104bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f68c400bb40 tx=0x7f68c400be50 comp rx=0 tx=0).stop 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.837+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3680850100 shutdown_connections 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.837+0000 7f68d6a4c700 1 --2- 172.21.15.134:0/3680850100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d0104bd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.837+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3680850100 >> 172.21.15.134:0/3680850100 conn(0x7f68d00ffe30 msgr2=0x7f68d0102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.837+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3680850100 shutdown_connections 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.837+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3680850100 wait complete. 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.837+0000 7f68d6a4c700 1 Processor -- start 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68d6a4c700 1 -- start start 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68d6a4c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68d6a4c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d019bd10 con 0x7f68d01047c0 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68cffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68cffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d019b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44592/0 (socket says 172.21.15.134:44592) 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68cffff700 1 -- 172.21.15.134:0/3236268825 learned_addr learned my addr 172.21.15.134:0/3236268825 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:17.672 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68cffff700 1 -- 172.21.15.134:0/3236268825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c400b7f0 con 0x7f68d01047c0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68cffff700 1 --2- 172.21.15.134:0/3236268825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d019b7d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68c4003a10 tx=0x7f68c4003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68cd7fa700 1 -- 172.21.15.134:0/3236268825 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68c4010580 con 0x7f68d01047c0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68cd7fa700 1 -- 172.21.15.134:0/3236268825 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f68c4010b70 con 0x7f68d01047c0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3236268825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d019bf10 con 0x7f68d01047c0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.838+0000 7f68cd7fa700 1 -- 172.21.15.134:0/3236268825 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68c4021c00 con 0x7f68d01047c0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.839+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3236268825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d019c2d0 con 0x7f68d01047c0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.839+0000 7f68cd7fa700 1 -- 172.21.15.134:0/3236268825 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f68c40193f0 con 0x7f68d01047c0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.839+0000 7f68cd7fa700 1 --2- 172.21.15.134:0/3236268825 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f68b80384e0 0x7f68b803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.839+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3236268825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d01910f0 con 0x7f68d01047c0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.839+0000 7f68cd7fa700 1 -- 172.21.15.134:0/3236268825 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f68c404c660 con 0x7f68d01047c0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.840+0000 7f68cf7fe700 1 --2- 172.21.15.134:0/3236268825 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f68b80384e0 0x7f68b803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.840+0000 7f68cf7fe700 1 --2- 172.21.15.134:0/3236268825 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f68b80384e0 0x7f68b803a990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f68c0006fd0 tx=0x7f68c0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:17.673 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:16.844+0000 7f68cd7fa700 1 -- 172.21.15.134:0/3236268825 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f68c400e950 con 0x7f68d01047c0 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.032+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3236268825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f68d002d050 con 0x7f68d01047c0 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.032+0000 7f68cd7fa700 1 -- 172.21.15.134:0/3236268825 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f68c4010ce0 con 0x7f68d01047c0 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.034+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3236268825 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f68b80384e0 msgr2=0x7f68b803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.034+0000 7f68d6a4c700 1 --2- 172.21.15.134:0/3236268825 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f68b80384e0 0x7f68b803a990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f68c0006fd0 tx=0x7f68c0006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.034+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3236268825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 msgr2=0x7f68d019b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.034+0000 7f68d6a4c700 1 --2- 172.21.15.134:0/3236268825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d019b7d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68c4003a10 tx=0x7f68c4003f70 comp rx=0 tx=0).stop 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.034+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3236268825 shutdown_connections 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.034+0000 7f68d6a4c700 1 --2- 172.21.15.134:0/3236268825 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f68b80384e0 0x7f68b803a990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.034+0000 7f68d6a4c700 1 --2- 172.21.15.134:0/3236268825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68d01047c0 0x7f68d019b7d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.034+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3236268825 >> 172.21.15.134:0/3236268825 conn(0x7f68d00ffe30 msgr2=0x7f68d018e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.034+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3236268825 shutdown_connections 2024-04-13T10:49:17.674 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:17.034+0000 7f68d6a4c700 1 -- 172.21.15.134:0/3236268825 wait complete. 2024-04-13T10:49:19.229 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.198+0000 7f9dcaf1a700 1 Processor -- start 2024-04-13T10:49:19.230 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.198+0000 7f9dcaf1a700 1 -- start start 2024-04-13T10:49:19.230 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.198+0000 7f9dcaf1a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc4079cf0 0x7f9dc410a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:19.230 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.198+0000 7f9dcaf1a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc4106250 con 0x7f9dc4079cf0 2024-04-13T10:49:19.230 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.199+0000 7f9dc8cb6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc4079cf0 0x7f9dc410a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:19.230 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.199+0000 7f9dc8cb6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc4079cf0 0x7f9dc410a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44606/0 (socket says 172.21.15.134:44606) 2024-04-13T10:49:19.230 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.199+0000 7f9dc8cb6700 1 -- 172.21.15.134:0/3379695666 learned_addr learned my addr 172.21.15.134:0/3379695666 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:19.230 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.199+0000 7f9dc8cb6700 1 -- 172.21.15.134:0/3379695666 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc410ada0 con 0x7f9dc4079cf0 2024-04-13T10:49:19.230 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.199+0000 7f9dc8cb6700 1 --2- 172.21.15.134:0/3379695666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc4079cf0 0x7f9dc410a860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9db80098a0 tx=0x7f9db8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffca3c2ded44c7cf server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:19.230 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.199+0000 7f9dc37fe700 1 -- 172.21.15.134:0/3379695666 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9db8004180 con 0x7f9dc4079cf0 2024-04-13T10:49:19.230 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.199+0000 7f9dc37fe700 1 -- 172.21.15.134:0/3379695666 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f9db80042e0 con 0x7f9dc4079cf0 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.199+0000 7f9dc37fe700 1 -- 172.21.15.134:0/3379695666 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9db8011a30 con 0x7f9dc4079cf0 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/3379695666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc4079cf0 msgr2=0x7f9dc410a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 --2- 172.21.15.134:0/3379695666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc4079cf0 0x7f9dc410a860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9db80098a0 tx=0x7f9db8009bb0 comp rx=0 tx=0).stop 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/3379695666 shutdown_connections 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 --2- 172.21.15.134:0/3379695666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc4079cf0 0x7f9dc410a860 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/3379695666 >> 172.21.15.134:0/3379695666 conn(0x7f9dc40ffe30 msgr2=0x7f9dc4102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/3379695666 shutdown_connections 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/3379695666 wait complete. 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 Processor -- start 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 -- start start 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc419b7d0 0x7f9dc419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dcaf1a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc419c120 con 0x7f9dc419b7d0 2024-04-13T10:49:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dc8cb6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc419b7d0 0x7f9dc419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dc8cb6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc419b7d0 0x7f9dc419bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44616/0 (socket says 172.21.15.134:44616) 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.200+0000 7f9dc8cb6700 1 -- 172.21.15.134:0/204989077 learned_addr learned my addr 172.21.15.134:0/204989077 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.201+0000 7f9dc8cb6700 1 -- 172.21.15.134:0/204989077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8009550 con 0x7f9dc419b7d0 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.201+0000 7f9dc8cb6700 1 --2- 172.21.15.134:0/204989077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc419b7d0 0x7f9dc419bbe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9db8006af0 tx=0x7f9db8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.201+0000 7f9dc1ffb700 1 -- 172.21.15.134:0/204989077 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9db8003bc0 con 0x7f9dc419b7d0 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.201+0000 7f9dc1ffb700 1 -- 172.21.15.134:0/204989077 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f9db801a8c0 con 0x7f9dc419b7d0 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.201+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/204989077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc419c320 con 0x7f9dc419b7d0 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.201+0000 7f9dc1ffb700 1 -- 172.21.15.134:0/204989077 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9db8019820 con 0x7f9dc419b7d0 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.201+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/204989077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc419ef80 con 0x7f9dc419b7d0 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.202+0000 7f9dc1ffb700 1 -- 172.21.15.134:0/204989077 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f9db8019aa0 con 0x7f9dc419b7d0 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.202+0000 7f9dc1ffb700 1 --2- 172.21.15.134:0/204989077 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f9db40384f0 0x7f9db403a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.202+0000 7f9dc1ffb700 1 -- 172.21.15.134:0/204989077 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9db804ca40 con 0x7f9dc419b7d0 2024-04-13T10:49:19.232 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.202+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/204989077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc4079cf0 con 0x7f9dc419b7d0 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.202+0000 7f9dc3fff700 1 --2- 172.21.15.134:0/204989077 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f9db40384f0 0x7f9db403a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.203+0000 7f9dc3fff700 1 --2- 172.21.15.134:0/204989077 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f9db40384f0 0x7f9db403a9a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006fd0 tx=0x7f9db0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.207+0000 7f9dc1ffb700 1 -- 172.21.15.134:0/204989077 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9db802c3a0 con 0x7f9dc419b7d0 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.499+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/204989077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f9dc4079f10 con 0x7f9dc419b7d0 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.501+0000 7f9dc1ffb700 1 -- 172.21.15.134:0/204989077 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f9db8023390 con 0x7f9dc419b7d0 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.503+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/204989077 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f9db40384f0 msgr2=0x7f9db403a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.504+0000 7f9dcaf1a700 1 --2- 172.21.15.134:0/204989077 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f9db40384f0 0x7f9db403a9a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006fd0 tx=0x7f9db0006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.504+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/204989077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc419b7d0 msgr2=0x7f9dc419bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.504+0000 7f9dcaf1a700 1 --2- 172.21.15.134:0/204989077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc419b7d0 0x7f9dc419bbe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9db8006af0 tx=0x7f9db8011ab0 comp rx=0 tx=0).stop 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.504+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/204989077 shutdown_connections 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.504+0000 7f9dcaf1a700 1 --2- 172.21.15.134:0/204989077 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f9db40384f0 0x7f9db403a9a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.504+0000 7f9dcaf1a700 1 --2- 172.21.15.134:0/204989077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc419b7d0 0x7f9dc419bbe0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.504+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/204989077 >> 172.21.15.134:0/204989077 conn(0x7f9dc40ffe30 msgr2=0x7f9dc4101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:19.233 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.504+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/204989077 shutdown_connections 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-04-13T10:49:18.504+0000 7f9dcaf1a700 1 -- 172.21.15.134:0/204989077 wait complete. 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout:Or, if you are only running a single cluster on this host: 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph telemetry on 2024-04-13T10:49:19.234 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:19.235 INFO:teuthology.orchestra.run.smithi134.stdout:For more information see: 2024-04-13T10:49:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-13T10:49:19.235 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:19.235 INFO:teuthology.orchestra.run.smithi134.stdout:Bootstrap complete. 2024-04-13T10:49:19.263 INFO:tasks.cephadm:Fetching config... 2024-04-13T10:49:19.263 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:49:19.263 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-13T10:49:19.321 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-13T10:49:19.322 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:49:19.322 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-13T10:49:19.379 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-13T10:49:19.380 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:49:19.380 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/keyring of=/dev/stdout 2024-04-13T10:49:19.448 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-13T10:49:19.448 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:49:19.448 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-13T10:49:19.506 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-13T10:49:19.507 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn+rVs2MGTIY7OkY+kaeWrk2kRwgPlrYoyq56DnelerR3OnfRenGDZ5Jno22uedTO8zfPaavNwlTA8ct7AmWsAj/IUb/4h8/K2AbJD0SEVvxUfLTLh8RsvNaSkD0PknVRuYAT8yi9CuRDw0OqCyHnjQItqYhlAo2rIH2ViMboy9Q30wT8EATb2uEPMaL+IKGe3aAwLcxIDJ3lnxjgxK8X8xGpOKVflkMTO/xkQ1ELU+jKWlvK0YI3FbLCjDjnI99aov8WbJAv3ratJCY3Ou1xQZaYoGBCYRa6hokYNgQTL25nplui9B5BB6NXE6dyFn022jMeNTxJl+HI6trpZGCupJrXv5Vh0PQxz6HS3l7HyDPW1W+aga/OeJbswYWlnO/GRQupQOh6gaNXEB6szqZDwqP9KanYTkWZ/ahMLXf9FZFi5khVZvVbDzwaImTKyd/NFp9IZ2UsK0pBeZ+rp+jiSD2tZrJuHeVT+mwQQ55K7ErI2RgIFfl41xAOOI9HYdUM= ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-13T10:49:19.590 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn+rVs2MGTIY7OkY+kaeWrk2kRwgPlrYoyq56DnelerR3OnfRenGDZ5Jno22uedTO8zfPaavNwlTA8ct7AmWsAj/IUb/4h8/K2AbJD0SEVvxUfLTLh8RsvNaSkD0PknVRuYAT8yi9CuRDw0OqCyHnjQItqYhlAo2rIH2ViMboy9Q30wT8EATb2uEPMaL+IKGe3aAwLcxIDJ3lnxjgxK8X8xGpOKVflkMTO/xkQ1ELU+jKWlvK0YI3FbLCjDjnI99aov8WbJAv3ratJCY3Ou1xQZaYoGBCYRa6hokYNgQTL25nplui9B5BB6NXE6dyFn022jMeNTxJl+HI6trpZGCupJrXv5Vh0PQxz6HS3l7HyDPW1W+aga/OeJbswYWlnO/GRQupQOh6gaNXEB6szqZDwqP9KanYTkWZ/ahMLXf9FZFi5khVZvVbDzwaImTKyd/NFp9IZ2UsK0pBeZ+rp+jiSD2tZrJuHeVT+mwQQ55K7ErI2RgIFfl41xAOOI9HYdUM= ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:49:19.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn+rVs2MGTIY7OkY+kaeWrk2kRwgPlrYoyq56DnelerR3OnfRenGDZ5Jno22uedTO8zfPaavNwlTA8ct7AmWsAj/IUb/4h8/K2AbJD0SEVvxUfLTLh8RsvNaSkD0PknVRuYAT8yi9CuRDw0OqCyHnjQItqYhlAo2rIH2ViMboy9Q30wT8EATb2uEPMaL+IKGe3aAwLcxIDJ3lnxjgxK8X8xGpOKVflkMTO/xkQ1ELU+jKWlvK0YI3FbLCjDjnI99aov8WbJAv3ratJCY3Ou1xQZaYoGBCYRa6hokYNgQTL25nplui9B5BB6NXE6dyFn022jMeNTxJl+HI6trpZGCupJrXv5Vh0PQxz6HS3l7HyDPW1W+aga/OeJbswYWlnO/GRQupQOh6gaNXEB6szqZDwqP9KanYTkWZ/ahMLXf9FZFi5khVZvVbDzwaImTKyd/NFp9IZ2UsK0pBeZ+rp+jiSD2tZrJuHeVT+mwQQ55K7ErI2RgIFfl41xAOOI9HYdUM= ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-13T10:49:19.647 INFO:teuthology.orchestra.run.smithi194.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCn+rVs2MGTIY7OkY+kaeWrk2kRwgPlrYoyq56DnelerR3OnfRenGDZ5Jno22uedTO8zfPaavNwlTA8ct7AmWsAj/IUb/4h8/K2AbJD0SEVvxUfLTLh8RsvNaSkD0PknVRuYAT8yi9CuRDw0OqCyHnjQItqYhlAo2rIH2ViMboy9Q30wT8EATb2uEPMaL+IKGe3aAwLcxIDJ3lnxjgxK8X8xGpOKVflkMTO/xkQ1ELU+jKWlvK0YI3FbLCjDjnI99aov8WbJAv3ratJCY3Ou1xQZaYoGBCYRa6hokYNgQTL25nplui9B5BB6NXE6dyFn022jMeNTxJl+HI6trpZGCupJrXv5Vh0PQxz6HS3l7HyDPW1W+aga/OeJbswYWlnO/GRQupQOh6gaNXEB6szqZDwqP9KanYTkWZ/ahMLXf9FZFi5khVZvVbDzwaImTKyd/NFp9IZ2UsK0pBeZ+rp+jiSD2tZrJuHeVT+mwQQ55K7ErI2RgIFfl41xAOOI9HYdUM= ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:49:19.659 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-13T10:49:19.916 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:49:19.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:19 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/204989077' entity='client.admin' 2024-04-13T10:49:22.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.408+0000 7fb2a6401700 1 -- 172.21.15.134:0/3521079616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00fed30 msgr2=0x7fb2a00ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:22.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.408+0000 7fb2a6401700 1 --2- 172.21.15.134:0/3521079616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00fed30 0x7fb2a00ff140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb290009910 tx=0x7fb290009c20 comp rx=0 tx=0).stop 2024-04-13T10:49:22.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.408+0000 7fb2a6401700 1 -- 172.21.15.134:0/3521079616 shutdown_connections 2024-04-13T10:49:22.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.408+0000 7fb2a6401700 1 --2- 172.21.15.134:0/3521079616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00fed30 0x7fb2a00ff140 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:22.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.408+0000 7fb2a6401700 1 -- 172.21.15.134:0/3521079616 >> 172.21.15.134:0/3521079616 conn(0x7fb2a00fa2c0 msgr2=0x7fb2a00fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:22.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.408+0000 7fb2a6401700 1 -- 172.21.15.134:0/3521079616 shutdown_connections 2024-04-13T10:49:22.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.408+0000 7fb2a6401700 1 -- 172.21.15.134:0/3521079616 wait complete. 2024-04-13T10:49:22.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.409+0000 7fb2a6401700 1 Processor -- start 2024-04-13T10:49:22.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.409+0000 7fb2a6401700 1 -- start start 2024-04-13T10:49:22.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.409+0000 7fb2a6401700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00fed30 0x7fb2a0193e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:22.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.409+0000 7fb2a6401700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0194340 con 0x7fb2a00fed30 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.409+0000 7fb29ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00fed30 0x7fb2a0193e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.409+0000 7fb29ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00fed30 0x7fb2a0193e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47320/0 (socket says 172.21.15.134:47320) 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.409+0000 7fb29ffff700 1 -- 172.21.15.134:0/2137285192 learned_addr learned my addr 172.21.15.134:0/2137285192 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.410+0000 7fb29ffff700 1 -- 172.21.15.134:0/2137285192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2900095f0 con 0x7fb2a00fed30 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.410+0000 7fb29ffff700 1 --2- 172.21.15.134:0/2137285192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00fed30 0x7fb2a0193e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb290004f70 tx=0x7fb290005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.410+0000 7fb29d7fa700 1 -- 172.21.15.134:0/2137285192 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb29001d070 con 0x7fb2a00fed30 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.410+0000 7fb2a6401700 1 -- 172.21.15.134:0/2137285192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a0194540 con 0x7fb2a00fed30 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.410+0000 7fb29d7fa700 1 -- 172.21.15.134:0/2137285192 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fb29000bdf0 con 0x7fb2a00fed30 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.410+0000 7fb29d7fa700 1 -- 172.21.15.134:0/2137285192 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb290022e40 con 0x7fb2a00fed30 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.410+0000 7fb2a6401700 1 -- 172.21.15.134:0/2137285192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a01949e0 con 0x7fb2a00fed30 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.411+0000 7fb2a6401700 1 -- 172.21.15.134:0/2137285192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a018d8d0 con 0x7fb2a00fed30 2024-04-13T10:49:22.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.411+0000 7fb29d7fa700 1 -- 172.21.15.134:0/2137285192 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fb29000f4a0 con 0x7fb2a00fed30 2024-04-13T10:49:22.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.411+0000 7fb29d7fa700 1 --2- 172.21.15.134:0/2137285192 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fb2880384e0 0x7fb28803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:22.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.411+0000 7fb29d7fa700 1 -- 172.21.15.134:0/2137285192 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb29004c320 con 0x7fb2a00fed30 2024-04-13T10:49:22.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.411+0000 7fb29f7fe700 1 --2- 172.21.15.134:0/2137285192 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fb2880384e0 0x7fb28803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:22.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.412+0000 7fb29f7fe700 1 --2- 172.21.15.134:0/2137285192 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fb2880384e0 0x7fb28803a990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb294006fd0 tx=0x7fb294006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:22.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.416+0000 7fb29d7fa700 1 -- 172.21.15.134:0/2137285192 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb290017440 con 0x7fb2a00fed30 2024-04-13T10:49:22.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:22 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:22.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:22 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:22.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:22 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:49:22.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:22 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:22.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:22 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-13T10:49:22.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:22 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-13T10:49:22.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:22 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:49:22.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:22 smithi134 ceph-mon[39696]: Deploying daemon ceph-exporter.smithi134 on smithi134 2024-04-13T10:49:22.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.619+0000 7fb2a6401700 1 -- 172.21.15.134:0/2137285192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fb2a002cc30 con 0x7fb2a00fed30 2024-04-13T10:49:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.624+0000 7fb29d7fa700 1 -- 172.21.15.134:0/2137285192 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb290027030 con 0x7fb2a00fed30 2024-04-13T10:49:22.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.626+0000 7fb2a6401700 1 -- 172.21.15.134:0/2137285192 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fb2880384e0 msgr2=0x7fb28803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:22.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.626+0000 7fb2a6401700 1 --2- 172.21.15.134:0/2137285192 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fb2880384e0 0x7fb28803a990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb294006fd0 tx=0x7fb294006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:22.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.626+0000 7fb2a6401700 1 -- 172.21.15.134:0/2137285192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00fed30 msgr2=0x7fb2a0193e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:22.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.626+0000 7fb2a6401700 1 --2- 172.21.15.134:0/2137285192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00fed30 0x7fb2a0193e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb290004f70 tx=0x7fb290005ee0 comp rx=0 tx=0).stop 2024-04-13T10:49:22.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.626+0000 7fb2a6401700 1 -- 172.21.15.134:0/2137285192 shutdown_connections 2024-04-13T10:49:22.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.626+0000 7fb2a6401700 1 --2- 172.21.15.134:0/2137285192 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fb2880384e0 0x7fb28803a990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:22.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.626+0000 7fb2a6401700 1 --2- 172.21.15.134:0/2137285192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00fed30 0x7fb2a0193e00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:22.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.626+0000 7fb2a6401700 1 -- 172.21.15.134:0/2137285192 >> 172.21.15.134:0/2137285192 conn(0x7fb2a00fa2c0 msgr2=0x7fb2a00faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:22.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.626+0000 7fb2a6401700 1 -- 172.21.15.134:0/2137285192 shutdown_connections 2024-04-13T10:49:22.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:22.626+0000 7fb2a6401700 1 -- 172.21.15.134:0/2137285192 wait complete. 2024-04-13T10:49:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:23 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2137285192' entity='client.admin' 2024-04-13T10:49:24.010 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-13T10:49:24.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-13T10:49:24.890 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:49:27.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.014+0000 7f137cd67700 1 -- 172.21.15.134:0/1793405292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13780fed30 msgr2=0x7f13780ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.014+0000 7f137cd67700 1 --2- 172.21.15.134:0/1793405292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13780fed30 0x7f13780ff140 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1368009910 tx=0x7f1368009c20 comp rx=0 tx=0).stop 2024-04-13T10:49:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.014+0000 7f137cd67700 1 -- 172.21.15.134:0/1793405292 shutdown_connections 2024-04-13T10:49:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.014+0000 7f137cd67700 1 --2- 172.21.15.134:0/1793405292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13780fed30 0x7f13780ff140 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:27.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.014+0000 7f137cd67700 1 -- 172.21.15.134:0/1793405292 >> 172.21.15.134:0/1793405292 conn(0x7f13780fa2c0 msgr2=0x7f13780fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.014+0000 7f137cd67700 1 -- 172.21.15.134:0/1793405292 shutdown_connections 2024-04-13T10:49:27.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.014+0000 7f137cd67700 1 -- 172.21.15.134:0/1793405292 wait complete. 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.015+0000 7f137cd67700 1 Processor -- start 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.015+0000 7f137cd67700 1 -- start start 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.015+0000 7f137cd67700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13780fed30 0x7f1378193e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.015+0000 7f137cd67700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1378194340 con 0x7f13780fed30 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.015+0000 7f137659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13780fed30 0x7f1378193e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.015+0000 7f137659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13780fed30 0x7f1378193e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47328/0 (socket says 172.21.15.134:47328) 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.015+0000 7f137659c700 1 -- 172.21.15.134:0/330407143 learned_addr learned my addr 172.21.15.134:0/330407143 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.016+0000 7f137659c700 1 -- 172.21.15.134:0/330407143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680095f0 con 0x7f13780fed30 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.016+0000 7f137659c700 1 --2- 172.21.15.134:0/330407143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13780fed30 0x7f1378193e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1368004f70 tx=0x7f1368005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.016+0000 7f13677fe700 1 -- 172.21.15.134:0/330407143 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f136801d070 con 0x7f13780fed30 2024-04-13T10:49:27.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.016+0000 7f13677fe700 1 -- 172.21.15.134:0/330407143 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f136800bdf0 con 0x7f13780fed30 2024-04-13T10:49:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.016+0000 7f137cd67700 1 -- 172.21.15.134:0/330407143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1378194540 con 0x7f13780fed30 2024-04-13T10:49:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.016+0000 7f13677fe700 1 -- 172.21.15.134:0/330407143 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1368022e40 con 0x7f13780fed30 2024-04-13T10:49:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.016+0000 7f137cd67700 1 -- 172.21.15.134:0/330407143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13781949e0 con 0x7f13780fed30 2024-04-13T10:49:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.017+0000 7f13677fe700 1 -- 172.21.15.134:0/330407143 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f136800f4b0 con 0x7f13780fed30 2024-04-13T10:49:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.017+0000 7f137cd67700 1 -- 172.21.15.134:0/330407143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137818d8d0 con 0x7f13780fed30 2024-04-13T10:49:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.017+0000 7f13677fe700 1 --2- 172.21.15.134:0/330407143 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1360038490 0x7f136003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.017+0000 7f13677fe700 1 -- 172.21.15.134:0/330407143 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f136804c410 con 0x7f13780fed30 2024-04-13T10:49:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.017+0000 7f1375d9b700 1 --2- 172.21.15.134:0/330407143 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1360038490 0x7f136003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.017+0000 7f1375d9b700 1 --2- 172.21.15.134:0/330407143 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1360038490 0x7f136003a940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f136c006fd0 tx=0x7f136c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:27.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.022+0000 7f13677fe700 1 -- 172.21.15.134:0/330407143 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1368020dd0 con 0x7f13780fed30 2024-04-13T10:49:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.218+0000 7f137cd67700 1 -- 172.21.15.134:0/330407143 --> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f1378061220 con 0x7f1360038490 2024-04-13T10:49:27.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.221+0000 7f13677fe700 1 -- 172.21.15.134:0/330407143 <== mgr.14162 v2:172.21.15.134:6800/2524753251 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1378061220 con 0x7f1360038490 2024-04-13T10:49:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.223+0000 7f137cd67700 1 -- 172.21.15.134:0/330407143 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1360038490 msgr2=0x7f136003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.223+0000 7f137cd67700 1 --2- 172.21.15.134:0/330407143 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1360038490 0x7f136003a940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f136c006fd0 tx=0x7f136c006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.223+0000 7f137cd67700 1 -- 172.21.15.134:0/330407143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13780fed30 msgr2=0x7f1378193e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.223+0000 7f137cd67700 1 --2- 172.21.15.134:0/330407143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13780fed30 0x7f1378193e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1368004f70 tx=0x7f1368005ee0 comp rx=0 tx=0).stop 2024-04-13T10:49:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.224+0000 7f137cd67700 1 -- 172.21.15.134:0/330407143 shutdown_connections 2024-04-13T10:49:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.224+0000 7f137cd67700 1 --2- 172.21.15.134:0/330407143 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1360038490 0x7f136003a940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.224+0000 7f137cd67700 1 --2- 172.21.15.134:0/330407143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13780fed30 0x7f1378193e00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.224+0000 7f137cd67700 1 -- 172.21.15.134:0/330407143 >> 172.21.15.134:0/330407143 conn(0x7f13780fa2c0 msgr2=0x7f13780faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.224+0000 7f137cd67700 1 -- 172.21.15.134:0/330407143 shutdown_connections 2024-04-13T10:49:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:27.224+0000 7f137cd67700 1 -- 172.21.15.134:0/330407143 wait complete. 2024-04-13T10:49:27.920 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi194 2024-04-13T10:49:27.920 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:49:27.920 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.conf 2024-04-13T10:49:27.942 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:49:27.942 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:49:28.003 INFO:tasks.cephadm:Adding host smithi194 to orchestrator... 2024-04-13T10:49:28.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph orch host add smithi194 2024-04-13T10:49:28.259 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:49:28.503 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:28 smithi134 ceph-mon[39696]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:49:28.503 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:28 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:29.606 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:29 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:29.607 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:29 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:29.607 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:29 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:29.607 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:29 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:29.607 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:29 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-13T10:49:29.607 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:29 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-13T10:49:29.607 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:29 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:49:29.607 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:29 smithi134 ceph-mon[39696]: Deploying daemon crash.smithi134 on smithi134 2024-04-13T10:49:29.607 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:29 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:30.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:30 smithi134 ceph-mon[39696]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.977+0000 7f8b7029c700 1 -- 172.21.15.134:0/1301678299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b680fed30 msgr2=0x7f8b680ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.977+0000 7f8b7029c700 1 --2- 172.21.15.134:0/1301678299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b680fed30 0x7f8b680ff140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009910 tx=0x7f8b64009c20 comp rx=0 tx=0).stop 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.977+0000 7f8b7029c700 1 -- 172.21.15.134:0/1301678299 shutdown_connections 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.977+0000 7f8b7029c700 1 --2- 172.21.15.134:0/1301678299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b680fed30 0x7f8b680ff140 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.977+0000 7f8b7029c700 1 -- 172.21.15.134:0/1301678299 >> 172.21.15.134:0/1301678299 conn(0x7f8b680fa2e0 msgr2=0x7f8b680fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.977+0000 7f8b7029c700 1 -- 172.21.15.134:0/1301678299 shutdown_connections 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.977+0000 7f8b7029c700 1 -- 172.21.15.134:0/1301678299 wait complete. 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b7029c700 1 Processor -- start 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b7029c700 1 -- start start 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b7029c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b680fed30 0x7f8b68193dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:31.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b7029c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b68194310 con 0x7f8b680fed30 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b6e038700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b680fed30 0x7f8b68193dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b6e038700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b680fed30 0x7f8b68193dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37956/0 (socket says 172.21.15.134:37956) 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b6e038700 1 -- 172.21.15.134:0/2621949851 learned_addr learned my addr 172.21.15.134:0/2621949851 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b6e038700 1 -- 172.21.15.134:0/2621949851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b640095f0 con 0x7f8b680fed30 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b6e038700 1 --2- 172.21.15.134:0/2621949851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b680fed30 0x7f8b68193dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b64006010 tx=0x7f8b640057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b5f7fe700 1 -- 172.21.15.134:0/2621949851 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b6401d070 con 0x7f8b680fed30 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b7029c700 1 -- 172.21.15.134:0/2621949851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b68194510 con 0x7f8b680fed30 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b5f7fe700 1 -- 172.21.15.134:0/2621949851 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f8b6400bdf0 con 0x7f8b680fed30 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b5f7fe700 1 -- 172.21.15.134:0/2621949851 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b64022e50 con 0x7f8b680fed30 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.978+0000 7f8b7029c700 1 -- 172.21.15.134:0/2621949851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b681949b0 con 0x7f8b680fed30 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.979+0000 7f8b5f7fe700 1 -- 172.21.15.134:0/2621949851 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f8b64022700 con 0x7f8b680fed30 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.979+0000 7f8b5f7fe700 1 --2- 172.21.15.134:0/2621949851 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f8b54038440 0x7f8b5403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.979+0000 7f8b7029c700 1 -- 172.21.15.134:0/2621949851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6818d8d0 con 0x7f8b680fed30 2024-04-13T10:49:31.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.979+0000 7f8b5f7fe700 1 -- 172.21.15.134:0/2621949851 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8b6404c360 con 0x7f8b680fed30 2024-04-13T10:49:31.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.980+0000 7f8b6d837700 1 --2- 172.21.15.134:0/2621949851 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f8b54038440 0x7f8b5403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:31.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.980+0000 7f8b6d837700 1 --2- 172.21.15.134:0/2621949851 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f8b54038440 0x7f8b5403a8f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8b58006fd0 tx=0x7f8b58006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:31.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:30.984+0000 7f8b5f7fe700 1 -- 172.21.15.134:0/2621949851 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8b6400b960 con 0x7f8b680fed30 2024-04-13T10:49:31.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:31.185+0000 7f8b7029c700 1 -- 172.21.15.134:0/2621949851 --> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b68061190 con 0x7f8b54038440 2024-04-13T10:49:32.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:32 smithi134 ceph-mon[39696]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:32.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:32 smithi134 ceph-mon[39696]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:49:32.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:32 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:32.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:32 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:32.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:32 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:32.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:32 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:33.359 INFO:teuthology.orchestra.run.smithi134.stdout:Added host 'smithi194' with addr '172.21.15.194' 2024-04-13T10:49:33.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.357+0000 7f8b5f7fe700 1 -- 172.21.15.134:0/2621949851 <== mgr.14162 v2:172.21.15.134:6800/2524753251 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8b68061190 con 0x7f8b54038440 2024-04-13T10:49:33.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.359+0000 7f8b7029c700 1 -- 172.21.15.134:0/2621949851 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f8b54038440 msgr2=0x7f8b5403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:33.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.359+0000 7f8b7029c700 1 --2- 172.21.15.134:0/2621949851 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f8b54038440 0x7f8b5403a8f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8b58006fd0 tx=0x7f8b58006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:33.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.359+0000 7f8b7029c700 1 -- 172.21.15.134:0/2621949851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b680fed30 msgr2=0x7f8b68193dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:33.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.359+0000 7f8b7029c700 1 --2- 172.21.15.134:0/2621949851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b680fed30 0x7f8b68193dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b64006010 tx=0x7f8b640057b0 comp rx=0 tx=0).stop 2024-04-13T10:49:33.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.360+0000 7f8b7029c700 1 -- 172.21.15.134:0/2621949851 shutdown_connections 2024-04-13T10:49:33.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.360+0000 7f8b7029c700 1 --2- 172.21.15.134:0/2621949851 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f8b54038440 0x7f8b5403a8f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:33.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.360+0000 7f8b7029c700 1 --2- 172.21.15.134:0/2621949851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b680fed30 0x7f8b68193dd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:33.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.360+0000 7f8b7029c700 1 -- 172.21.15.134:0/2621949851 >> 172.21.15.134:0/2621949851 conn(0x7f8b680fa2e0 msgr2=0x7f8b680fafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:33.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.364+0000 7f8b7029c700 1 -- 172.21.15.134:0/2621949851 shutdown_connections 2024-04-13T10:49:33.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:33.364+0000 7f8b7029c700 1 -- 172.21.15.134:0/2621949851 wait complete. 2024-04-13T10:49:33.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:33 smithi134 ceph-mon[39696]: Deploying daemon node-exporter.smithi134 on smithi134 2024-04-13T10:49:33.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:33 smithi134 ceph-mon[39696]: Deploying cephadm binary to smithi194 2024-04-13T10:49:34.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:34 smithi134 ceph-mon[39696]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:34.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:34 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:34.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:34 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:34.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph orch host ls --format=json 2024-04-13T10:49:35.216 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:49:35.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:35 smithi134 ceph-mon[39696]: Added host smithi194 2024-04-13T10:49:35.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:35 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:35.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:35 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:35.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:35 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:35.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:35 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:36.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:36 smithi134 ceph-mon[39696]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:36.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:36 smithi134 ceph-mon[39696]: Deploying daemon alertmanager.smithi134 on smithi134 2024-04-13T10:49:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.895+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/2760120358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d40fe0f0 msgr2=0x7fc9d40fe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.895+0000 7fc9d8bd4700 1 --2- 172.21.15.134:0/2760120358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d40fe0f0 0x7fc9d40fe500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009910 tx=0x7fc9c4009c20 comp rx=0 tx=0).stop 2024-04-13T10:49:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.895+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/2760120358 shutdown_connections 2024-04-13T10:49:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.895+0000 7fc9d8bd4700 1 --2- 172.21.15.134:0/2760120358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d40fe0f0 0x7fc9d40fe500 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.895+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/2760120358 >> 172.21.15.134:0/2760120358 conn(0x7fc9d40f9a60 msgr2=0x7fc9d40fbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.895+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/2760120358 shutdown_connections 2024-04-13T10:49:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.895+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/2760120358 wait complete. 2024-04-13T10:49:36.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9d8bd4700 1 Processor -- start 2024-04-13T10:49:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9d8bd4700 1 -- start start 2024-04-13T10:49:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9d8bd4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d40fe0f0 0x7fc9d4194f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9d8bd4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d4195440 con 0x7fc9d40fe0f0 2024-04-13T10:49:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9d259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d40fe0f0 0x7fc9d4194f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9d259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d40fe0f0 0x7fc9d4194f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37974/0 (socket says 172.21.15.134:37974) 2024-04-13T10:49:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9d259c700 1 -- 172.21.15.134:0/818704881 learned_addr learned my addr 172.21.15.134:0/818704881 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9d259c700 1 -- 172.21.15.134:0/818704881 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40095f0 con 0x7fc9d40fe0f0 2024-04-13T10:49:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9d259c700 1 --2- 172.21.15.134:0/818704881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d40fe0f0 0x7fc9d4194f00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4006010 tx=0x7fc9c40057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9c37fe700 1 -- 172.21.15.134:0/818704881 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9c401d070 con 0x7fc9d40fe0f0 2024-04-13T10:49:36.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.896+0000 7fc9c37fe700 1 -- 172.21.15.134:0/818704881 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fc9c400bdf0 con 0x7fc9d40fe0f0 2024-04-13T10:49:36.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.897+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/818704881 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d4195640 con 0x7fc9d40fe0f0 2024-04-13T10:49:36.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.897+0000 7fc9c37fe700 1 -- 172.21.15.134:0/818704881 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9c4022e50 con 0x7fc9d40fe0f0 2024-04-13T10:49:36.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.897+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/818704881 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d4195ae0 con 0x7fc9d40fe0f0 2024-04-13T10:49:36.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.897+0000 7fc9c37fe700 1 -- 172.21.15.134:0/818704881 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fc9c400f460 con 0x7fc9d40fe0f0 2024-04-13T10:49:36.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.898+0000 7fc9c37fe700 1 --2- 172.21.15.134:0/818704881 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fc9bc038490 0x7fc9bc03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:36.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.898+0000 7fc9c37fe700 1 -- 172.21.15.134:0/818704881 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc9c404c500 con 0x7fc9d40fe0f0 2024-04-13T10:49:36.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.898+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/818704881 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d418e9d0 con 0x7fc9d40fe0f0 2024-04-13T10:49:36.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.898+0000 7fc9d1d9b700 1 --2- 172.21.15.134:0/818704881 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fc9bc038490 0x7fc9bc03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:36.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.898+0000 7fc9d1d9b700 1 --2- 172.21.15.134:0/818704881 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fc9bc038490 0x7fc9bc03a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8006fd0 tx=0x7fc9c8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:36.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:36.903+0000 7fc9c37fe700 1 -- 172.21.15.134:0/818704881 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc9c4027070 con 0x7fc9d40fe0f0 2024-04-13T10:49:37.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.102+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/818704881 --> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9d4061190 con 0x7fc9bc038490 2024-04-13T10:49:37.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.103+0000 7fc9c37fe700 1 -- 172.21.15.134:0/818704881 <== mgr.14162 v2:172.21.15.134:6800/2524753251 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7fc9d4061190 con 0x7fc9bc038490 2024-04-13T10:49:37.104 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:49:37.104 INFO:teuthology.orchestra.run.smithi134.stdout:[{"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}, {"addr": "172.21.15.194", "hostname": "smithi194", "labels": [], "status": ""}] 2024-04-13T10:49:37.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.105+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/818704881 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fc9bc038490 msgr2=0x7fc9bc03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:37.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.105+0000 7fc9d8bd4700 1 --2- 172.21.15.134:0/818704881 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fc9bc038490 0x7fc9bc03a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8006fd0 tx=0x7fc9c8006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:37.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.105+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/818704881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d40fe0f0 msgr2=0x7fc9d4194f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:37.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.105+0000 7fc9d8bd4700 1 --2- 172.21.15.134:0/818704881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d40fe0f0 0x7fc9d4194f00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4006010 tx=0x7fc9c40057b0 comp rx=0 tx=0).stop 2024-04-13T10:49:37.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.105+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/818704881 shutdown_connections 2024-04-13T10:49:37.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.105+0000 7fc9d8bd4700 1 --2- 172.21.15.134:0/818704881 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fc9bc038490 0x7fc9bc03a940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:37.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.105+0000 7fc9d8bd4700 1 --2- 172.21.15.134:0/818704881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d40fe0f0 0x7fc9d4194f00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:37.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.105+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/818704881 >> 172.21.15.134:0/818704881 conn(0x7fc9d40f9a60 msgr2=0x7fc9d40fa730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:37.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.105+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/818704881 shutdown_connections 2024-04-13T10:49:37.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:37.105+0000 7fc9d8bd4700 1 -- 172.21.15.134:0/818704881 wait complete. 2024-04-13T10:49:38.086 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-13T10:49:38.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd crush tunables default 2024-04-13T10:49:38.305 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:49:38.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:38 smithi134 ceph-mon[39696]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:38.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:38 smithi134 ceph-mon[39696]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-13T10:49:40.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:39 smithi134 ceph-mon[39696]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:40.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:39 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:42.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.010+0000 7fd74e130700 1 -- 172.21.15.134:0/1929042373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7480fed30 msgr2=0x7fd7480ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:42.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.010+0000 7fd74e130700 1 --2- 172.21.15.134:0/1929042373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7480fed30 0x7fd7480ff140 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd738009910 tx=0x7fd738009c20 comp rx=0 tx=0).stop 2024-04-13T10:49:42.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.010+0000 7fd74e130700 1 -- 172.21.15.134:0/1929042373 shutdown_connections 2024-04-13T10:49:42.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.010+0000 7fd74e130700 1 --2- 172.21.15.134:0/1929042373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7480fed30 0x7fd7480ff140 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:42.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.010+0000 7fd74e130700 1 -- 172.21.15.134:0/1929042373 >> 172.21.15.134:0/1929042373 conn(0x7fd7480fa2e0 msgr2=0x7fd7480fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:42.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.010+0000 7fd74e130700 1 -- 172.21.15.134:0/1929042373 shutdown_connections 2024-04-13T10:49:42.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.010+0000 7fd74e130700 1 -- 172.21.15.134:0/1929042373 wait complete. 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.010+0000 7fd74e130700 1 Processor -- start 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.010+0000 7fd74e130700 1 -- start start 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd74e130700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7480fed30 0x7fd748068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd74e130700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748197c00 con 0x7fd7480fed30 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd7477fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7480fed30 0x7fd748068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd7477fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7480fed30 0x7fd748068ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40946/0 (socket says 172.21.15.134:40946) 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd7477fe700 1 -- 172.21.15.134:0/3246395054 learned_addr learned my addr 172.21.15.134:0/3246395054 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd7477fe700 1 -- 172.21.15.134:0/3246395054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380095f0 con 0x7fd7480fed30 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd7477fe700 1 --2- 172.21.15.134:0/3246395054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7480fed30 0x7fd748068ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd738004f70 tx=0x7fd738005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd744ff9700 1 -- 172.21.15.134:0/3246395054 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd73801d070 con 0x7fd7480fed30 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd744ff9700 1 -- 172.21.15.134:0/3246395054 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fd73800bdf0 con 0x7fd7480fed30 2024-04-13T10:49:42.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd74e130700 1 -- 172.21.15.134:0/3246395054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd748197d40 con 0x7fd7480fed30 2024-04-13T10:49:42.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd744ff9700 1 -- 172.21.15.134:0/3246395054 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd738022e40 con 0x7fd7480fed30 2024-04-13T10:49:42.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.011+0000 7fd74e130700 1 -- 172.21.15.134:0/3246395054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7481981e0 con 0x7fd7480fed30 2024-04-13T10:49:42.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.012+0000 7fd744ff9700 1 -- 172.21.15.134:0/3246395054 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fd73800f4b0 con 0x7fd7480fed30 2024-04-13T10:49:42.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.012+0000 7fd74e130700 1 -- 172.21.15.134:0/3246395054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74818d8d0 con 0x7fd7480fed30 2024-04-13T10:49:42.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.012+0000 7fd744ff9700 1 --2- 172.21.15.134:0/3246395054 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fd730038490 0x7fd73003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:42.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.012+0000 7fd744ff9700 1 -- 172.21.15.134:0/3246395054 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd73804c670 con 0x7fd7480fed30 2024-04-13T10:49:42.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.012+0000 7fd746ffd700 1 --2- 172.21.15.134:0/3246395054 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fd730038490 0x7fd73003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:42.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.013+0000 7fd746ffd700 1 --2- 172.21.15.134:0/3246395054 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fd730038490 0x7fd73003a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd73c006fd0 tx=0x7fd73c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:42.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.018+0000 7fd744ff9700 1 -- 172.21.15.134:0/3246395054 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd738020dd0 con 0x7fd7480fed30 2024-04-13T10:49:42.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.216+0000 7fd74e130700 1 -- 172.21.15.134:0/3246395054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd74802cc30 con 0x7fd7480fed30 2024-04-13T10:49:42.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.269+0000 7fd744ff9700 1 -- 172.21.15.134:0/3246395054 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd738027070 con 0x7fd7480fed30 2024-04-13T10:49:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.271+0000 7fd74e130700 1 -- 172.21.15.134:0/3246395054 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fd730038490 msgr2=0x7fd73003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.271+0000 7fd74e130700 1 --2- 172.21.15.134:0/3246395054 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fd730038490 0x7fd73003a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd73c006fd0 tx=0x7fd73c006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:42.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.271+0000 7fd74e130700 1 -- 172.21.15.134:0/3246395054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7480fed30 msgr2=0x7fd748068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:42.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.271+0000 7fd74e130700 1 --2- 172.21.15.134:0/3246395054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7480fed30 0x7fd748068ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd738004f70 tx=0x7fd738005ee0 comp rx=0 tx=0).stop 2024-04-13T10:49:42.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.271+0000 7fd74e130700 1 -- 172.21.15.134:0/3246395054 shutdown_connections 2024-04-13T10:49:42.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.271+0000 7fd74e130700 1 --2- 172.21.15.134:0/3246395054 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fd730038490 0x7fd73003a940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:42.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.271+0000 7fd74e130700 1 --2- 172.21.15.134:0/3246395054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7480fed30 0x7fd748068ae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:42.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.271+0000 7fd74e130700 1 -- 172.21.15.134:0/3246395054 >> 172.21.15.134:0/3246395054 conn(0x7fd7480fa2e0 msgr2=0x7fd7480fafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:42.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.271+0000 7fd74e130700 1 -- 172.21.15.134:0/3246395054 shutdown_connections 2024-04-13T10:49:42.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:49:42.271+0000 7fd74e130700 1 -- 172.21.15.134:0/3246395054 wait complete. 2024-04-13T10:49:42.271 INFO:teuthology.orchestra.run.smithi134.stderr:adjusted tunables profile to default 2024-04-13T10:49:42.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:42 smithi134 ceph-mon[39696]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:42.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:42 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3246395054' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-13T10:49:43.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:43 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3246395054' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-13T10:49:43.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:43 smithi134 ceph-mon[39696]: osdmap e4: 0 total, 0 up, 0 in 2024-04-13T10:49:44.041 INFO:tasks.cephadm:Adding mon.smithi134 on smithi134 2024-04-13T10:49:44.042 INFO:tasks.cephadm:Adding mon.smithi194 on smithi194 2024-04-13T10:49:44.042 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph orch apply mon '2;smithi134:172.21.15.134=smithi134;smithi194:172.21.15.194=smithi194' 2024-04-13T10:49:44.290 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:49:44.352 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:49:44.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:44 smithi134 ceph-mon[39696]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:46.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.278+0000 7f04c0923700 1 -- 172.21.15.194:0/3355259100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04bc0fed30 msgr2=0x7f04bc0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:46.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.278+0000 7f04c0923700 1 --2- 172.21.15.194:0/3355259100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04bc0fed30 0x7f04bc0ff140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009910 tx=0x7f04ac009c20 comp rx=0 tx=0).stop 2024-04-13T10:49:46.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.278+0000 7f04c0923700 1 -- 172.21.15.194:0/3355259100 shutdown_connections 2024-04-13T10:49:46.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.278+0000 7f04c0923700 1 --2- 172.21.15.194:0/3355259100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04bc0fed30 0x7f04bc0ff140 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:46.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.278+0000 7f04c0923700 1 -- 172.21.15.194:0/3355259100 >> 172.21.15.194:0/3355259100 conn(0x7f04bc0fa2c0 msgr2=0x7f04bc0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:46.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.278+0000 7f04c0923700 1 -- 172.21.15.194:0/3355259100 shutdown_connections 2024-04-13T10:49:46.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.278+0000 7f04c0923700 1 -- 172.21.15.194:0/3355259100 wait complete. 2024-04-13T10:49:46.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.279+0000 7f04c0923700 1 Processor -- start 2024-04-13T10:49:46.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.279+0000 7f04c0923700 1 -- start start 2024-04-13T10:49:46.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.279+0000 7f04c0923700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04bc0fed30 0x7f04bc193e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:46.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.279+0000 7f04c0923700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc194340 con 0x7f04bc0fed30 2024-04-13T10:49:46.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.279+0000 7f04ba59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04bc0fed30 0x7f04bc193e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:46.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.279+0000 7f04ba59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04bc0fed30 0x7f04bc193e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:52538/0 (socket says 172.21.15.194:52538) 2024-04-13T10:49:46.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.279+0000 7f04ba59c700 1 -- 172.21.15.194:0/1604737202 learned_addr learned my addr 172.21.15.194:0/1604737202 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:49:46.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.279+0000 7f04ba59c700 1 -- 172.21.15.194:0/1604737202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0095f0 con 0x7f04bc0fed30 2024-04-13T10:49:46.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.280+0000 7f04ba59c700 1 --2- 172.21.15.194:0/1604737202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04bc0fed30 0x7f04bc193e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f04ac006010 tx=0x7f04ac0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:46.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.280+0000 7f04ab7fe700 1 -- 172.21.15.194:0/1604737202 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04ac01d070 con 0x7f04bc0fed30 2024-04-13T10:49:46.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.280+0000 7f04ab7fe700 1 -- 172.21.15.194:0/1604737202 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f04ac00bdf0 con 0x7f04bc0fed30 2024-04-13T10:49:46.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.280+0000 7f04c0923700 1 -- 172.21.15.194:0/1604737202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc194540 con 0x7f04bc0fed30 2024-04-13T10:49:46.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.280+0000 7f04ab7fe700 1 -- 172.21.15.194:0/1604737202 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04ac022e50 con 0x7f04bc0fed30 2024-04-13T10:49:46.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.280+0000 7f04c0923700 1 -- 172.21.15.194:0/1604737202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc1949e0 con 0x7f04bc0fed30 2024-04-13T10:49:46.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.281+0000 7f04c0923700 1 -- 172.21.15.194:0/1604737202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc18d8d0 con 0x7f04bc0fed30 2024-04-13T10:49:46.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.283+0000 7f04ab7fe700 1 -- 172.21.15.194:0/1604737202 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f04ac022700 con 0x7f04bc0fed30 2024-04-13T10:49:46.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.283+0000 7f04ab7fe700 1 --2- 172.21.15.194:0/1604737202 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f04a4038440 0x7f04a403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:46.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.283+0000 7f04ab7fe700 1 -- 172.21.15.194:0/1604737202 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f04ac04c8d0 con 0x7f04bc0fed30 2024-04-13T10:49:46.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.284+0000 7f04b9d9b700 1 --2- 172.21.15.194:0/1604737202 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f04a4038440 0x7f04a403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:46.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.284+0000 7f04b9d9b700 1 --2- 172.21.15.194:0/1604737202 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f04a4038440 0x7f04a403a8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f04b0006fd0 tx=0x7f04b0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:46.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.287+0000 7f04ab7fe700 1 -- 172.21.15.194:0/1604737202 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f04ac00b960 con 0x7f04bc0fed30 2024-04-13T10:49:46.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.484+0000 7f04c0923700 1 -- 172.21.15.194:0/1604737202 --> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi134:172.21.15.134=smithi134;smithi194:172.21.15.194=smithi194", "target": ["mon-mgr", ""]}) v1 -- 0x7f04bc061300 con 0x7f04a4038440 2024-04-13T10:49:46.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.491+0000 7f04ab7fe700 1 -- 172.21.15.194:0/1604737202 <== mgr.14162 v2:172.21.15.134:6800/2524753251 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f04bc061300 con 0x7f04a4038440 2024-04-13T10:49:46.490 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mon update... 2024-04-13T10:49:46.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.492+0000 7f04c0923700 1 -- 172.21.15.194:0/1604737202 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f04a4038440 msgr2=0x7f04a403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:46.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.492+0000 7f04c0923700 1 --2- 172.21.15.194:0/1604737202 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f04a4038440 0x7f04a403a8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f04b0006fd0 tx=0x7f04b0006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:46.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.493+0000 7f04c0923700 1 -- 172.21.15.194:0/1604737202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04bc0fed30 msgr2=0x7f04bc193e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:46.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.493+0000 7f04c0923700 1 --2- 172.21.15.194:0/1604737202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04bc0fed30 0x7f04bc193e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f04ac006010 tx=0x7f04ac0057b0 comp rx=0 tx=0).stop 2024-04-13T10:49:46.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.493+0000 7f04c0923700 1 -- 172.21.15.194:0/1604737202 shutdown_connections 2024-04-13T10:49:46.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.493+0000 7f04c0923700 1 --2- 172.21.15.194:0/1604737202 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f04a4038440 0x7f04a403a8f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:46.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.493+0000 7f04c0923700 1 --2- 172.21.15.194:0/1604737202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04bc0fed30 0x7f04bc193e00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:46.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.493+0000 7f04c0923700 1 -- 172.21.15.194:0/1604737202 >> 172.21.15.194:0/1604737202 conn(0x7f04bc0fa2c0 msgr2=0x7f04bc0faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:46.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.493+0000 7f04c0923700 1 -- 172.21.15.194:0/1604737202 shutdown_connections 2024-04-13T10:49:46.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:46.493+0000 7f04c0923700 1 -- 172.21.15.194:0/1604737202 wait complete. 2024-04-13T10:49:46.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:46 smithi134 ceph-mon[39696]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:46.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:46 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:46.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:46 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:46.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:46 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:46.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:46 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:46.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:46 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:46.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:46 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:46.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:46 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-13T10:49:46.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:46 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:47.065 DEBUG:teuthology.orchestra.run.smithi194:mon.smithi194> sudo journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi194.service 2024-04-13T10:49:47.067 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:49:47.068 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:49:47.097 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:-- Logs begin at Sat 2024-04-13 10:37:46 UTC. -- 2024-04-13T10:49:47.330 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:49:47.391 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:49:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:47 smithi134 ceph-mon[39696]: Regenerating cephadm self-signed grafana TLS certificates 2024-04-13T10:49:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:47 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-13T10:49:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:47 smithi134 ceph-mon[39696]: Deploying daemon grafana.smithi134 on smithi134 2024-04-13T10:49:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:47 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:48.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:48 smithi134 ceph-mon[39696]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi134:172.21.15.134=smithi134;smithi194:172.21.15.194=smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:49:48.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:48 smithi134 ceph-mon[39696]: Saving service mon spec with placement smithi134:172.21.15.134=smithi134;smithi194:172.21.15.194=smithi194;count:2 2024-04-13T10:49:48.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:48 smithi134 ceph-mon[39696]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:48.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.936+0000 7f2215557700 1 -- 172.21.15.194:0/3677478965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22101008c0 msgr2=0x7f2210102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:48.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.936+0000 7f2215557700 1 --2- 172.21.15.194:0/3677478965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22101008c0 0x7f2210102ca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2204009910 tx=0x7f2204009c20 comp rx=0 tx=0).stop 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.936+0000 7f2215557700 1 -- 172.21.15.194:0/3677478965 shutdown_connections 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.936+0000 7f2215557700 1 --2- 172.21.15.194:0/3677478965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22101008c0 0x7f2210102ca0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.936+0000 7f2215557700 1 -- 172.21.15.194:0/3677478965 >> 172.21.15.194:0/3677478965 conn(0x7f22100fa2e0 msgr2=0x7f22100fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.936+0000 7f2215557700 1 -- 172.21.15.194:0/3677478965 shutdown_connections 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.936+0000 7f2215557700 1 -- 172.21.15.194:0/3677478965 wait complete. 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.936+0000 7f2215557700 1 Processor -- start 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f2215557700 1 -- start start 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f2215557700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22101008c0 0x7f2210100220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f2215557700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2210100760 con 0x7f22101008c0 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f220effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22101008c0 0x7f2210100220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f220effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22101008c0 0x7f2210100220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:52554/0 (socket says 172.21.15.194:52554) 2024-04-13T10:49:48.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f220effd700 1 -- 172.21.15.194:0/3561019879 learned_addr learned my addr 172.21.15.194:0/3561019879 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:49:48.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f220effd700 1 -- 172.21.15.194:0/3561019879 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040095f0 con 0x7f22101008c0 2024-04-13T10:49:48.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f220effd700 1 --2- 172.21.15.194:0/3561019879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22101008c0 0x7f2210100220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2204004f40 tx=0x7f22040057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:48.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f21f7fff700 1 -- 172.21.15.194:0/3561019879 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f220401d070 con 0x7f22101008c0 2024-04-13T10:49:48.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f2215557700 1 -- 172.21.15.194:0/3561019879 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22100fe870 con 0x7f22101008c0 2024-04-13T10:49:48.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f21f7fff700 1 -- 172.21.15.194:0/3561019879 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f220400bdf0 con 0x7f22101008c0 2024-04-13T10:49:48.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.937+0000 7f21f7fff700 1 -- 172.21.15.194:0/3561019879 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2204022e30 con 0x7f22101008c0 2024-04-13T10:49:48.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.938+0000 7f2215557700 1 -- 172.21.15.194:0/3561019879 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22100fed10 con 0x7f22101008c0 2024-04-13T10:49:48.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.939+0000 7f21f7fff700 1 -- 172.21.15.194:0/3561019879 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f220400f4f0 con 0x7f22101008c0 2024-04-13T10:49:48.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.939+0000 7f2215557700 1 -- 172.21.15.194:0/3561019879 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2210062380 con 0x7f22101008c0 2024-04-13T10:49:48.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.939+0000 7f21f7fff700 1 --2- 172.21.15.194:0/3561019879 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f21f8038490 0x7f21f803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:48.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.939+0000 7f21f7fff700 1 -- 172.21.15.194:0/3561019879 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f220404c450 con 0x7f22101008c0 2024-04-13T10:49:48.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.939+0000 7f220e7fc700 1 --2- 172.21.15.194:0/3561019879 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f21f8038490 0x7f21f803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:48.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.939+0000 7f220e7fc700 1 --2- 172.21.15.194:0/3561019879 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f21f8038490 0x7f21f803a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2200006fd0 tx=0x7f2200006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:48.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:48.944+0000 7f21f7fff700 1 -- 172.21.15.194:0/3561019879 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f220402bba0 con 0x7f22101008c0 2024-04-13T10:49:49.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.204+0000 7f2215557700 1 -- 172.21.15.194:0/3561019879 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f221018e3b0 con 0x7f22101008c0 2024-04-13T10:49:49.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.205+0000 7f21f7fff700 1 -- 172.21.15.194:0/3561019879 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f2204027070 con 0x7f22101008c0 2024-04-13T10:49:49.205 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:49:49.205 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:49:49.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.207+0000 7f2215557700 1 -- 172.21.15.194:0/3561019879 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f21f8038490 msgr2=0x7f21f803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:49.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.207+0000 7f2215557700 1 --2- 172.21.15.194:0/3561019879 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f21f8038490 0x7f21f803a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2200006fd0 tx=0x7f2200006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:49.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.207+0000 7f2215557700 1 -- 172.21.15.194:0/3561019879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22101008c0 msgr2=0x7f2210100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:49.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.207+0000 7f2215557700 1 --2- 172.21.15.194:0/3561019879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22101008c0 0x7f2210100220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2204004f40 tx=0x7f22040057b0 comp rx=0 tx=0).stop 2024-04-13T10:49:49.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.207+0000 7f2215557700 1 -- 172.21.15.194:0/3561019879 shutdown_connections 2024-04-13T10:49:49.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.207+0000 7f2215557700 1 --2- 172.21.15.194:0/3561019879 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f21f8038490 0x7f21f803a940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:49.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.207+0000 7f2215557700 1 --2- 172.21.15.194:0/3561019879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22101008c0 0x7f2210100220 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:49.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.207+0000 7f2215557700 1 -- 172.21.15.194:0/3561019879 >> 172.21.15.194:0/3561019879 conn(0x7f22100fa2e0 msgr2=0x7f22100faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:49.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.207+0000 7f2215557700 1 -- 172.21.15.194:0/3561019879 shutdown_connections 2024-04-13T10:49:49.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:49.207+0000 7f2215557700 1 -- 172.21.15.194:0/3561019879 wait complete. 2024-04-13T10:49:49.207 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:49:50.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:49 smithi134 ceph-mon[39696]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:50.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:49 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:49:50.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:49 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/3561019879' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:49:50.788 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:49:50.789 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:49:51.041 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:49:51.102 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:49:52.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:52 smithi134 ceph-mon[39696]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.932+0000 7f7aae90f700 1 -- 172.21.15.194:0/668310400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa80fed30 msgr2=0x7f7aa80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.932+0000 7f7aae90f700 1 --2- 172.21.15.194:0/668310400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa80fed30 0x7f7aa80ff140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009910 tx=0x7f7a98009c20 comp rx=0 tx=0).stop 2024-04-13T10:49:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.932+0000 7f7aae90f700 1 -- 172.21.15.194:0/668310400 shutdown_connections 2024-04-13T10:49:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.932+0000 7f7aae90f700 1 --2- 172.21.15.194:0/668310400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa80fed30 0x7f7aa80ff140 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.932+0000 7f7aae90f700 1 -- 172.21.15.194:0/668310400 >> 172.21.15.194:0/668310400 conn(0x7f7aa80fa2e0 msgr2=0x7f7aa80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.932+0000 7f7aae90f700 1 -- 172.21.15.194:0/668310400 shutdown_connections 2024-04-13T10:49:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.932+0000 7f7aae90f700 1 -- 172.21.15.194:0/668310400 wait complete. 2024-04-13T10:49:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.933+0000 7f7aae90f700 1 Processor -- start 2024-04-13T10:49:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.933+0000 7f7aae90f700 1 -- start start 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.933+0000 7f7aae90f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa80fed30 0x7f7aa8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.933+0000 7f7aae90f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8197c00 con 0x7f7aa80fed30 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.934+0000 7f7aa7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa80fed30 0x7f7aa8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.934+0000 7f7aa7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa80fed30 0x7f7aa8068ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:52576/0 (socket says 172.21.15.194:52576) 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.934+0000 7f7aa7fff700 1 -- 172.21.15.194:0/1207397586 learned_addr learned my addr 172.21.15.194:0/1207397586 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.934+0000 7f7aa7fff700 1 -- 172.21.15.194:0/1207397586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a980095f0 con 0x7f7aa80fed30 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.934+0000 7f7aa7fff700 1 --2- 172.21.15.194:0/1207397586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa80fed30 0x7f7aa8068ae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a98006010 tx=0x7f7a980057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.934+0000 7f7aa57fa700 1 -- 172.21.15.194:0/1207397586 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a9801d070 con 0x7f7aa80fed30 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.934+0000 7f7aa57fa700 1 -- 172.21.15.194:0/1207397586 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f7a9800bdf0 con 0x7f7aa80fed30 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.934+0000 7f7aae90f700 1 -- 172.21.15.194:0/1207397586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa8197d40 con 0x7f7aa80fed30 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.934+0000 7f7aa57fa700 1 -- 172.21.15.194:0/1207397586 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a98022e50 con 0x7f7aa80fed30 2024-04-13T10:49:52.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.934+0000 7f7aae90f700 1 -- 172.21.15.194:0/1207397586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa81981e0 con 0x7f7aa80fed30 2024-04-13T10:49:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.935+0000 7f7aa57fa700 1 -- 172.21.15.194:0/1207397586 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f7a9800b960 con 0x7f7aa80fed30 2024-04-13T10:49:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.935+0000 7f7aae90f700 1 -- 172.21.15.194:0/1207397586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa818d8d0 con 0x7f7aa80fed30 2024-04-13T10:49:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.935+0000 7f7aa57fa700 1 --2- 172.21.15.194:0/1207397586 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f7a90038490 0x7f7a9003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.935+0000 7f7aa57fa700 1 -- 172.21.15.194:0/1207397586 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7a9804c2f0 con 0x7f7aa80fed30 2024-04-13T10:49:52.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.935+0000 7f7aa77fe700 1 --2- 172.21.15.194:0/1207397586 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f7a90038490 0x7f7a9003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:52.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.936+0000 7f7aa77fe700 1 --2- 172.21.15.194:0/1207397586 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f7a90038490 0x7f7a9003a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c006fd0 tx=0x7f7a9c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:52.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:52.941+0000 7f7aa57fa700 1 -- 172.21.15.194:0/1207397586 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7a9800f7e0 con 0x7f7aa80fed30 2024-04-13T10:49:53.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.204+0000 7f7aae90f700 1 -- 172.21.15.194:0/1207397586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7aa802cc30 con 0x7f7aa80fed30 2024-04-13T10:49:53.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.204+0000 7f7aa57fa700 1 -- 172.21.15.194:0/1207397586 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f7a98027020 con 0x7f7aa80fed30 2024-04-13T10:49:53.205 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:49:53.205 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:49:53.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.206+0000 7f7aae90f700 1 -- 172.21.15.194:0/1207397586 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f7a90038490 msgr2=0x7f7a9003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:53.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.206+0000 7f7aae90f700 1 --2- 172.21.15.194:0/1207397586 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f7a90038490 0x7f7a9003a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c006fd0 tx=0x7f7a9c006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:53.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.206+0000 7f7aae90f700 1 -- 172.21.15.194:0/1207397586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa80fed30 msgr2=0x7f7aa8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:53.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.206+0000 7f7aae90f700 1 --2- 172.21.15.194:0/1207397586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa80fed30 0x7f7aa8068ae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a98006010 tx=0x7f7a980057b0 comp rx=0 tx=0).stop 2024-04-13T10:49:53.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.207+0000 7f7aae90f700 1 -- 172.21.15.194:0/1207397586 shutdown_connections 2024-04-13T10:49:53.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.207+0000 7f7aae90f700 1 --2- 172.21.15.194:0/1207397586 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f7a90038490 0x7f7a9003a940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:53.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.207+0000 7f7aae90f700 1 --2- 172.21.15.194:0/1207397586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aa80fed30 0x7f7aa8068ae0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:53.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.207+0000 7f7aae90f700 1 -- 172.21.15.194:0/1207397586 >> 172.21.15.194:0/1207397586 conn(0x7f7aa80fa2e0 msgr2=0x7f7aa80fafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:53.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.207+0000 7f7aae90f700 1 -- 172.21.15.194:0/1207397586 shutdown_connections 2024-04-13T10:49:53.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:53.207+0000 7f7aae90f700 1 -- 172.21.15.194:0/1207397586 wait complete. 2024-04-13T10:49:53.210 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:49:53.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:53 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/1207397586' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:49:54.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:54 smithi134 ceph-mon[39696]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:54.952 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:49:54.953 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:49:55.202 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:49:55.268 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:49:56.609 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:56 smithi134 ceph-mon[39696]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.045+0000 7f1983852700 1 -- 172.21.15.194:0/2426979507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197c0fed30 msgr2=0x7f197c0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.045+0000 7f1983852700 1 --2- 172.21.15.194:0/2426979507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197c0fed30 0x7f197c0ff140 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1978009910 tx=0x7f1978009c20 comp rx=0 tx=0).stop 2024-04-13T10:49:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.045+0000 7f1983852700 1 -- 172.21.15.194:0/2426979507 shutdown_connections 2024-04-13T10:49:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.045+0000 7f1983852700 1 --2- 172.21.15.194:0/2426979507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197c0fed30 0x7f197c0ff140 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.045+0000 7f1983852700 1 -- 172.21.15.194:0/2426979507 >> 172.21.15.194:0/2426979507 conn(0x7f197c0fa2e0 msgr2=0x7f197c0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.045+0000 7f1983852700 1 -- 172.21.15.194:0/2426979507 shutdown_connections 2024-04-13T10:49:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.045+0000 7f1983852700 1 -- 172.21.15.194:0/2426979507 wait complete. 2024-04-13T10:49:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.046+0000 7f1983852700 1 Processor -- start 2024-04-13T10:49:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.046+0000 7f1983852700 1 -- start start 2024-04-13T10:49:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.046+0000 7f1983852700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197c0fed30 0x7f197c193dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.046+0000 7f1983852700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c194300 con 0x7f197c0fed30 2024-04-13T10:49:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.046+0000 7f19815ee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197c0fed30 0x7f197c193dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.046+0000 7f19815ee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197c0fed30 0x7f197c193dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:50756/0 (socket says 172.21.15.194:50756) 2024-04-13T10:49:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.046+0000 7f19815ee700 1 -- 172.21.15.194:0/173220185 learned_addr learned my addr 172.21.15.194:0/173220185 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:49:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.047+0000 7f19815ee700 1 -- 172.21.15.194:0/173220185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780095f0 con 0x7f197c0fed30 2024-04-13T10:49:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.047+0000 7f19815ee700 1 --2- 172.21.15.194:0/173220185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197c0fed30 0x7f197c193dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1978006010 tx=0x7f19780057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.047+0000 7f19727fc700 1 -- 172.21.15.194:0/173220185 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f197801d070 con 0x7f197c0fed30 2024-04-13T10:49:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.047+0000 7f19727fc700 1 -- 172.21.15.194:0/173220185 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f197800bdf0 con 0x7f197c0fed30 2024-04-13T10:49:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.047+0000 7f1983852700 1 -- 172.21.15.194:0/173220185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c194500 con 0x7f197c0fed30 2024-04-13T10:49:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.047+0000 7f19727fc700 1 -- 172.21.15.194:0/173220185 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1978022e50 con 0x7f197c0fed30 2024-04-13T10:49:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.047+0000 7f1983852700 1 -- 172.21.15.194:0/173220185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c1949a0 con 0x7f197c0fed30 2024-04-13T10:49:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.048+0000 7f19727fc700 1 -- 172.21.15.194:0/173220185 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f1978022700 con 0x7f197c0fed30 2024-04-13T10:49:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.048+0000 7f1983852700 1 -- 172.21.15.194:0/173220185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c18d8d0 con 0x7f197c0fed30 2024-04-13T10:49:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.048+0000 7f19727fc700 1 --2- 172.21.15.194:0/173220185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1968038440 0x7f196803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:49:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.048+0000 7f19727fc700 1 -- 172.21.15.194:0/173220185 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f197804c360 con 0x7f197c0fed30 2024-04-13T10:49:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.048+0000 7f1980ded700 1 --2- 172.21.15.194:0/173220185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1968038440 0x7f196803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:49:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.049+0000 7f1980ded700 1 --2- 172.21.15.194:0/173220185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1968038440 0x7f196803a8f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f196c006fd0 tx=0x7f196c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:49:57.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.053+0000 7f19727fc700 1 -- 172.21.15.194:0/173220185 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f197800b960 con 0x7f197c0fed30 2024-04-13T10:49:57.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.317+0000 7f1983852700 1 -- 172.21.15.194:0/173220185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f197c02cc30 con 0x7f197c0fed30 2024-04-13T10:49:57.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.318+0000 7f19727fc700 1 -- 172.21.15.194:0/173220185 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f1978027020 con 0x7f197c0fed30 2024-04-13T10:49:57.318 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:49:57.318 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:49:57.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.320+0000 7f1983852700 1 -- 172.21.15.194:0/173220185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1968038440 msgr2=0x7f196803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:57.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.320+0000 7f1983852700 1 --2- 172.21.15.194:0/173220185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1968038440 0x7f196803a8f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f196c006fd0 tx=0x7f196c006e40 comp rx=0 tx=0).stop 2024-04-13T10:49:57.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.320+0000 7f1983852700 1 -- 172.21.15.194:0/173220185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197c0fed30 msgr2=0x7f197c193dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:49:57.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.320+0000 7f1983852700 1 --2- 172.21.15.194:0/173220185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197c0fed30 0x7f197c193dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1978006010 tx=0x7f19780057b0 comp rx=0 tx=0).stop 2024-04-13T10:49:57.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.320+0000 7f1983852700 1 -- 172.21.15.194:0/173220185 shutdown_connections 2024-04-13T10:49:57.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.320+0000 7f1983852700 1 --2- 172.21.15.194:0/173220185 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f1968038440 0x7f196803a8f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:57.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.320+0000 7f1983852700 1 --2- 172.21.15.194:0/173220185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197c0fed30 0x7f197c193dc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:49:57.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.320+0000 7f1983852700 1 -- 172.21.15.194:0/173220185 >> 172.21.15.194:0/173220185 conn(0x7f197c0fa2e0 msgr2=0x7f197c0faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:49:57.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.320+0000 7f1983852700 1 -- 172.21.15.194:0/173220185 shutdown_connections 2024-04-13T10:49:57.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:49:57.320+0000 7f1983852700 1 -- 172.21.15.194:0/173220185 wait complete. 2024-04-13T10:49:57.321 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:49:58.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:58 smithi134 ceph-mon[39696]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:49:58.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:49:58 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/173220185' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:49:59.042 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:49:59.043 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:49:59.294 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:49:59.353 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:00.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:00 smithi134 ceph-mon[39696]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:00.441 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:00 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:00.441 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:00 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:00.441 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:00 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:00.441 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:00 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:00.441 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:00 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:00.441 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:00 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:01.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.215+0000 7f12d2c50700 1 -- 172.21.15.194:0/757236873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12cc0fed30 msgr2=0x7f12cc0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:01.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.215+0000 7f12d2c50700 1 --2- 172.21.15.194:0/757236873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12cc0fed30 0x7f12cc0ff140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009910 tx=0x7f12c0009c20 comp rx=0 tx=0).stop 2024-04-13T10:50:01.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.215+0000 7f12d2c50700 1 -- 172.21.15.194:0/757236873 shutdown_connections 2024-04-13T10:50:01.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.215+0000 7f12d2c50700 1 --2- 172.21.15.194:0/757236873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12cc0fed30 0x7f12cc0ff140 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:01.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.215+0000 7f12d2c50700 1 -- 172.21.15.194:0/757236873 >> 172.21.15.194:0/757236873 conn(0x7f12cc0fa2e0 msgr2=0x7f12cc0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:01.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.215+0000 7f12d2c50700 1 -- 172.21.15.194:0/757236873 shutdown_connections 2024-04-13T10:50:01.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.215+0000 7f12d2c50700 1 -- 172.21.15.194:0/757236873 wait complete. 2024-04-13T10:50:01.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.216+0000 7f12d2c50700 1 Processor -- start 2024-04-13T10:50:01.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.216+0000 7f12d2c50700 1 -- start start 2024-04-13T10:50:01.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.216+0000 7f12d2c50700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12cc0fed30 0x7f12cc193dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.216+0000 7f12d2c50700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc194310 con 0x7f12cc0fed30 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.217+0000 7f12d09ec700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12cc0fed30 0x7f12cc193dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.217+0000 7f12d09ec700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12cc0fed30 0x7f12cc193dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:50764/0 (socket says 172.21.15.194:50764) 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.217+0000 7f12d09ec700 1 -- 172.21.15.194:0/1766627309 learned_addr learned my addr 172.21.15.194:0/1766627309 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.217+0000 7f12d09ec700 1 -- 172.21.15.194:0/1766627309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00095f0 con 0x7f12cc0fed30 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.217+0000 7f12d09ec700 1 --2- 172.21.15.194:0/1766627309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12cc0fed30 0x7f12cc193dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12c0006010 tx=0x7f12c00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.217+0000 7f12c9ffb700 1 -- 172.21.15.194:0/1766627309 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12c001d070 con 0x7f12cc0fed30 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.217+0000 7f12c9ffb700 1 -- 172.21.15.194:0/1766627309 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f12c000bdf0 con 0x7f12cc0fed30 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.217+0000 7f12d2c50700 1 -- 172.21.15.194:0/1766627309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12cc194510 con 0x7f12cc0fed30 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.217+0000 7f12c9ffb700 1 -- 172.21.15.194:0/1766627309 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12c0022e50 con 0x7f12cc0fed30 2024-04-13T10:50:01.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.217+0000 7f12d2c50700 1 -- 172.21.15.194:0/1766627309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12cc1949b0 con 0x7f12cc0fed30 2024-04-13T10:50:01.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.218+0000 7f12c9ffb700 1 -- 172.21.15.194:0/1766627309 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f12c000f460 con 0x7f12cc0fed30 2024-04-13T10:50:01.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.219+0000 7f12d2c50700 1 -- 172.21.15.194:0/1766627309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12cc18d8d0 con 0x7f12cc0fed30 2024-04-13T10:50:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.219+0000 7f12c9ffb700 1 --2- 172.21.15.194:0/1766627309 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f12bc038490 0x7f12bc03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.219+0000 7f12c9ffb700 1 -- 172.21.15.194:0/1766627309 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f12c004c3c0 con 0x7f12cc0fed30 2024-04-13T10:50:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.219+0000 7f12cbfff700 1 --2- 172.21.15.194:0/1766627309 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f12bc038490 0x7f12bc03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.219+0000 7f12cbfff700 1 --2- 172.21.15.194:0/1766627309 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f12bc038490 0x7f12bc03a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f12b8006fd0 tx=0x7f12b8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.223+0000 7f12c9ffb700 1 -- 172.21.15.194:0/1766627309 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f12c0017440 con 0x7f12cc0fed30 2024-04-13T10:50:01.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.484+0000 7f12d2c50700 1 -- 172.21.15.194:0/1766627309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f12cc02cc30 con 0x7f12cc0fed30 2024-04-13T10:50:01.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.484+0000 7f12c9ffb700 1 -- 172.21.15.194:0/1766627309 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f12c0027020 con 0x7f12cc0fed30 2024-04-13T10:50:01.486 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:01.486 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:01.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.487+0000 7f12d2c50700 1 -- 172.21.15.194:0/1766627309 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f12bc038490 msgr2=0x7f12bc03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.487+0000 7f12d2c50700 1 --2- 172.21.15.194:0/1766627309 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f12bc038490 0x7f12bc03a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f12b8006fd0 tx=0x7f12b8006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.487+0000 7f12d2c50700 1 -- 172.21.15.194:0/1766627309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12cc0fed30 msgr2=0x7f12cc193dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.487+0000 7f12d2c50700 1 --2- 172.21.15.194:0/1766627309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12cc0fed30 0x7f12cc193dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12c0006010 tx=0x7f12c00057b0 comp rx=0 tx=0).stop 2024-04-13T10:50:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.487+0000 7f12d2c50700 1 -- 172.21.15.194:0/1766627309 shutdown_connections 2024-04-13T10:50:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.487+0000 7f12d2c50700 1 --2- 172.21.15.194:0/1766627309 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f12bc038490 0x7f12bc03a940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.487+0000 7f12d2c50700 1 --2- 172.21.15.194:0/1766627309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12cc0fed30 0x7f12cc193dd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.487+0000 7f12d2c50700 1 -- 172.21.15.194:0/1766627309 >> 172.21.15.194:0/1766627309 conn(0x7f12cc0fa2e0 msgr2=0x7f12cc0fafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.487+0000 7f12d2c50700 1 -- 172.21.15.194:0/1766627309 shutdown_connections 2024-04-13T10:50:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:01.487+0000 7f12d2c50700 1 -- 172.21.15.194:0/1766627309 wait complete. 2024-04-13T10:50:01.489 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:01 smithi134 ceph-mon[39696]: Deploying daemon prometheus.smithi134 on smithi134 2024-04-13T10:50:02.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:02 smithi134 ceph-mon[39696]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:02.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:02 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/1766627309' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:03.159 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:03.160 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:03.411 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:03.475 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:04.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:04 smithi134 ceph-mon[39696]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:04.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:04 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:05.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.213+0000 7fdee05b5700 1 -- 172.21.15.194:0/3108267596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded80fed30 msgr2=0x7fded80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.213+0000 7fdee05b5700 1 --2- 172.21.15.194:0/3108267596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded80fed30 0x7fded80ff140 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009910 tx=0x7fdecc009c20 comp rx=0 tx=0).stop 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.213+0000 7fdee05b5700 1 -- 172.21.15.194:0/3108267596 shutdown_connections 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.213+0000 7fdee05b5700 1 --2- 172.21.15.194:0/3108267596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded80fed30 0x7fded80ff140 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.213+0000 7fdee05b5700 1 -- 172.21.15.194:0/3108267596 >> 172.21.15.194:0/3108267596 conn(0x7fded80fa2e0 msgr2=0x7fded80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.213+0000 7fdee05b5700 1 -- 172.21.15.194:0/3108267596 shutdown_connections 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.213+0000 7fdee05b5700 1 -- 172.21.15.194:0/3108267596 wait complete. 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.214+0000 7fdee05b5700 1 Processor -- start 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.214+0000 7fdee05b5700 1 -- start start 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.214+0000 7fdee05b5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded80fed30 0x7fded80fc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.214+0000 7fdee05b5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded80fc7b0 con 0x7fded80fed30 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.214+0000 7fdede351700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded80fed30 0x7fded80fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.214+0000 7fdede351700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded80fed30 0x7fded80fc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:50794/0 (socket says 172.21.15.194:50794) 2024-04-13T10:50:05.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.214+0000 7fdede351700 1 -- 172.21.15.194:0/21220457 learned_addr learned my addr 172.21.15.194:0/21220457 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:05.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.214+0000 7fdede351700 1 -- 172.21.15.194:0/21220457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc0095f0 con 0x7fded80fed30 2024-04-13T10:50:05.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.214+0000 7fdede351700 1 --2- 172.21.15.194:0/21220457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded80fed30 0x7fded80fc270 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdecc006010 tx=0x7fdecc0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:05.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.215+0000 7fdecb7fe700 1 -- 172.21.15.194:0/21220457 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdecc01d070 con 0x7fded80fed30 2024-04-13T10:50:05.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.215+0000 7fdecb7fe700 1 -- 172.21.15.194:0/21220457 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fdecc00bdf0 con 0x7fded80fed30 2024-04-13T10:50:05.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.215+0000 7fdee05b5700 1 -- 172.21.15.194:0/21220457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded80fa8c0 con 0x7fded80fed30 2024-04-13T10:50:05.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.215+0000 7fdecb7fe700 1 -- 172.21.15.194:0/21220457 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdecc022e50 con 0x7fded80fed30 2024-04-13T10:50:05.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.215+0000 7fdee05b5700 1 -- 172.21.15.194:0/21220457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded80fad60 con 0x7fded80fed30 2024-04-13T10:50:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.215+0000 7fdee05b5700 1 -- 172.21.15.194:0/21220457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded8062380 con 0x7fded80fed30 2024-04-13T10:50:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.216+0000 7fdecb7fe700 1 -- 172.21.15.194:0/21220457 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fdecc022700 con 0x7fded80fed30 2024-04-13T10:50:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.216+0000 7fdecb7fe700 1 --2- 172.21.15.194:0/21220457 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fdec4038490 0x7fdec403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.216+0000 7fdecb7fe700 1 -- 172.21.15.194:0/21220457 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdecc04c420 con 0x7fded80fed30 2024-04-13T10:50:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.216+0000 7fdeddb50700 1 --2- 172.21.15.194:0/21220457 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fdec4038490 0x7fdec403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.216+0000 7fdeddb50700 1 --2- 172.21.15.194:0/21220457 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fdec4038490 0x7fdec403a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fded4006fd0 tx=0x7fded4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:05.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.222+0000 7fdecb7fe700 1 -- 172.21.15.194:0/21220457 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdecc00f460 con 0x7fded80fed30 2024-04-13T10:50:05.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.486+0000 7fdee05b5700 1 -- 172.21.15.194:0/21220457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fded818e2c0 con 0x7fded80fed30 2024-04-13T10:50:05.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.486+0000 7fdecb7fe700 1 -- 172.21.15.194:0/21220457 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fdecc027030 con 0x7fded80fed30 2024-04-13T10:50:05.487 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:05.487 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:05.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.488+0000 7fdee05b5700 1 -- 172.21.15.194:0/21220457 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fdec4038490 msgr2=0x7fdec403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:05.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.488+0000 7fdee05b5700 1 --2- 172.21.15.194:0/21220457 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fdec4038490 0x7fdec403a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fded4006fd0 tx=0x7fded4006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:05.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.488+0000 7fdee05b5700 1 -- 172.21.15.194:0/21220457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded80fed30 msgr2=0x7fded80fc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:05.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.488+0000 7fdee05b5700 1 --2- 172.21.15.194:0/21220457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded80fed30 0x7fded80fc270 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdecc006010 tx=0x7fdecc0057b0 comp rx=0 tx=0).stop 2024-04-13T10:50:05.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.488+0000 7fdee05b5700 1 -- 172.21.15.194:0/21220457 shutdown_connections 2024-04-13T10:50:05.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.488+0000 7fdee05b5700 1 --2- 172.21.15.194:0/21220457 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fdec4038490 0x7fdec403a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:05.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.488+0000 7fdee05b5700 1 --2- 172.21.15.194:0/21220457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded80fed30 0x7fded80fc270 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:05.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.488+0000 7fdee05b5700 1 -- 172.21.15.194:0/21220457 >> 172.21.15.194:0/21220457 conn(0x7fded80fa2e0 msgr2=0x7fded80687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:05.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.488+0000 7fdee05b5700 1 -- 172.21.15.194:0/21220457 shutdown_connections 2024-04-13T10:50:05.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:05.488+0000 7fdee05b5700 1 -- 172.21.15.194:0/21220457 wait complete. 2024-04-13T10:50:05.490 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:06.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:06 smithi134 ceph-mon[39696]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:06.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:06 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/21220457' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:07.050 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:07.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:07.298 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:07.368 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:08.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:08 smithi134 ceph-mon[39696]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:09.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.161+0000 7f27c60a8700 1 -- 172.21.15.194:0/2830376722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c01008c0 msgr2=0x7f27c0102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:09.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.161+0000 7f27c60a8700 1 --2- 172.21.15.194:0/2830376722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c01008c0 0x7f27c0102ca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009910 tx=0x7f27b4009c20 comp rx=0 tx=0).stop 2024-04-13T10:50:09.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.161+0000 7f27c60a8700 1 -- 172.21.15.194:0/2830376722 shutdown_connections 2024-04-13T10:50:09.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.161+0000 7f27c60a8700 1 --2- 172.21.15.194:0/2830376722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c01008c0 0x7f27c0102ca0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:09.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.161+0000 7f27c60a8700 1 -- 172.21.15.194:0/2830376722 >> 172.21.15.194:0/2830376722 conn(0x7f27c00fa2c0 msgr2=0x7f27c00fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:09.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.161+0000 7f27c60a8700 1 -- 172.21.15.194:0/2830376722 shutdown_connections 2024-04-13T10:50:09.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.161+0000 7f27c60a8700 1 -- 172.21.15.194:0/2830376722 wait complete. 2024-04-13T10:50:09.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.161+0000 7f27c60a8700 1 Processor -- start 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.162+0000 7f27c60a8700 1 -- start start 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.162+0000 7f27c60a8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c01008c0 0x7f27c0194e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.162+0000 7f27c60a8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c01953b0 con 0x7f27c01008c0 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.162+0000 7f27bf7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c01008c0 0x7f27c0194e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.162+0000 7f27bf7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c01008c0 0x7f27c0194e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:45784/0 (socket says 172.21.15.194:45784) 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.162+0000 7f27bf7fe700 1 -- 172.21.15.194:0/2967086849 learned_addr learned my addr 172.21.15.194:0/2967086849 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.162+0000 7f27bf7fe700 1 -- 172.21.15.194:0/2967086849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40095f0 con 0x7f27c01008c0 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.162+0000 7f27bf7fe700 1 --2- 172.21.15.194:0/2967086849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c01008c0 0x7f27c0194e70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f27b4004f40 tx=0x7f27b40057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.163+0000 7f27bcff9700 1 -- 172.21.15.194:0/2967086849 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27b401d070 con 0x7f27c01008c0 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.163+0000 7f27bcff9700 1 -- 172.21.15.194:0/2967086849 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f27b400bdf0 con 0x7f27c01008c0 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.163+0000 7f27c60a8700 1 -- 172.21.15.194:0/2967086849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c01955b0 con 0x7f27c01008c0 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.163+0000 7f27bcff9700 1 -- 172.21.15.194:0/2967086849 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27b4022e30 con 0x7f27c01008c0 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.163+0000 7f27c60a8700 1 -- 172.21.15.194:0/2967086849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c0195a50 con 0x7f27c01008c0 2024-04-13T10:50:09.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.163+0000 7f27c60a8700 1 -- 172.21.15.194:0/2967086849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c018e9d0 con 0x7f27c01008c0 2024-04-13T10:50:09.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.164+0000 7f27bcff9700 1 -- 172.21.15.194:0/2967086849 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f27b400b960 con 0x7f27c01008c0 2024-04-13T10:50:09.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.164+0000 7f27bcff9700 1 --2- 172.21.15.194:0/2967086849 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f27a8038490 0x7f27a803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:09.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.164+0000 7f27bcff9700 1 -- 172.21.15.194:0/2967086849 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f27b404c370 con 0x7f27c01008c0 2024-04-13T10:50:09.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.164+0000 7f27beffd700 1 --2- 172.21.15.194:0/2967086849 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f27a8038490 0x7f27a803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:09.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.165+0000 7f27beffd700 1 --2- 172.21.15.194:0/2967086849 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f27a8038490 0x7f27a803a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f27b0006fd0 tx=0x7f27b0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:09.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.170+0000 7f27bcff9700 1 -- 172.21.15.194:0/2967086849 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f27b402bd00 con 0x7f27c01008c0 2024-04-13T10:50:09.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.435+0000 7f27c60a8700 1 -- 172.21.15.194:0/2967086849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f27c002cc30 con 0x7f27c01008c0 2024-04-13T10:50:09.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.435+0000 7f27bcff9700 1 -- 172.21.15.194:0/2967086849 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f27b4027070 con 0x7f27c01008c0 2024-04-13T10:50:09.436 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:09.436 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:09.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.437+0000 7f27c60a8700 1 -- 172.21.15.194:0/2967086849 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f27a8038490 msgr2=0x7f27a803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:09.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.437+0000 7f27c60a8700 1 --2- 172.21.15.194:0/2967086849 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f27a8038490 0x7f27a803a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f27b0006fd0 tx=0x7f27b0006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:09.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.437+0000 7f27c60a8700 1 -- 172.21.15.194:0/2967086849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c01008c0 msgr2=0x7f27c0194e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:09.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.437+0000 7f27c60a8700 1 --2- 172.21.15.194:0/2967086849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c01008c0 0x7f27c0194e70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f27b4004f40 tx=0x7f27b40057b0 comp rx=0 tx=0).stop 2024-04-13T10:50:09.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.437+0000 7f27c60a8700 1 -- 172.21.15.194:0/2967086849 shutdown_connections 2024-04-13T10:50:09.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.437+0000 7f27c60a8700 1 --2- 172.21.15.194:0/2967086849 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f27a8038490 0x7f27a803a940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:09.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.437+0000 7f27c60a8700 1 --2- 172.21.15.194:0/2967086849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27c01008c0 0x7f27c0194e70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:09.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.437+0000 7f27c60a8700 1 -- 172.21.15.194:0/2967086849 >> 172.21.15.194:0/2967086849 conn(0x7f27c00fa2c0 msgr2=0x7f27c00faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:09.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.437+0000 7f27c60a8700 1 -- 172.21.15.194:0/2967086849 shutdown_connections 2024-04-13T10:50:09.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:09.437+0000 7f27c60a8700 1 -- 172.21.15.194:0/2967086849 wait complete. 2024-04-13T10:50:09.439 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:10.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:10 smithi134 ceph-mon[39696]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:10.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:10 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/2967086849' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:11.101 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:11.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:11.353 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:11.413 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:12.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:12 smithi134 ceph-mon[39696]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:13.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.972+0000 7f514dd6c700 1 -- 172.21.15.194:0/2857883399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480fed30 msgr2=0x7f51480ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:13.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.972+0000 7f514dd6c700 1 --2- 172.21.15.194:0/2857883399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480fed30 0x7f51480ff140 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f514000b0a0 tx=0x7f514000b3b0 comp rx=0 tx=0).stop 2024-04-13T10:50:13.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.972+0000 7f514dd6c700 1 -- 172.21.15.194:0/2857883399 shutdown_connections 2024-04-13T10:50:13.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.972+0000 7f514dd6c700 1 --2- 172.21.15.194:0/2857883399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480fed30 0x7f51480ff140 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:13.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.972+0000 7f514dd6c700 1 -- 172.21.15.194:0/2857883399 >> 172.21.15.194:0/2857883399 conn(0x7f51480fa2c0 msgr2=0x7f51480fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.972+0000 7f514dd6c700 1 -- 172.21.15.194:0/2857883399 shutdown_connections 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.972+0000 7f514dd6c700 1 -- 172.21.15.194:0/2857883399 wait complete. 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.973+0000 7f514dd6c700 1 Processor -- start 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.973+0000 7f514dd6c700 1 -- start start 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.973+0000 7f514dd6c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480fed30 0x7f51480fc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.973+0000 7f514dd6c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51480fc7b0 con 0x7f51480fed30 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.973+0000 7f51477fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480fed30 0x7f51480fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.973+0000 7f51477fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480fed30 0x7f51480fc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:45800/0 (socket says 172.21.15.194:45800) 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.973+0000 7f51477fe700 1 -- 172.21.15.194:0/2069314752 learned_addr learned my addr 172.21.15.194:0/2069314752 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.973+0000 7f51477fe700 1 -- 172.21.15.194:0/2069314752 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140009d00 con 0x7f51480fed30 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.974+0000 7f51477fe700 1 --2- 172.21.15.194:0/2069314752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480fed30 0x7f51480fc270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f51400062a0 tx=0x7f514000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:13.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.974+0000 7f5144ff9700 1 -- 172.21.15.194:0/2069314752 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f514000e040 con 0x7f51480fed30 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.974+0000 7f514dd6c700 1 -- 172.21.15.194:0/2069314752 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51480fa8c0 con 0x7f51480fed30 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.974+0000 7f5144ff9700 1 -- 172.21.15.194:0/2069314752 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f5140012ad0 con 0x7f51480fed30 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.974+0000 7f5144ff9700 1 -- 172.21.15.194:0/2069314752 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f514001c860 con 0x7f51480fed30 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.974+0000 7f514dd6c700 1 -- 172.21.15.194:0/2069314752 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51480fad60 con 0x7f51480fed30 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.975+0000 7f514dd6c700 1 -- 172.21.15.194:0/2069314752 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5148062380 con 0x7f51480fed30 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.975+0000 7f5144ff9700 1 -- 172.21.15.194:0/2069314752 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f5140012c40 con 0x7f51480fed30 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.975+0000 7f5144ff9700 1 --2- 172.21.15.194:0/2069314752 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f5134038490 0x7f513403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.975+0000 7f5144ff9700 1 -- 172.21.15.194:0/2069314752 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f514004c550 con 0x7f51480fed30 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.975+0000 7f5146ffd700 1 --2- 172.21.15.194:0/2069314752 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f5134038490 0x7f513403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.976+0000 7f5146ffd700 1 --2- 172.21.15.194:0/2069314752 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f5134038490 0x7f513403a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5130006fd0 tx=0x7f5130006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:13.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:12.980+0000 7f5144ff9700 1 -- 172.21.15.194:0/2069314752 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5140011390 con 0x7f51480fed30 2024-04-13T10:50:13.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.246+0000 7f514dd6c700 1 -- 172.21.15.194:0/2069314752 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f514818e2c0 con 0x7f51480fed30 2024-04-13T10:50:13.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.247+0000 7f5144ff9700 1 -- 172.21.15.194:0/2069314752 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f514001b360 con 0x7f51480fed30 2024-04-13T10:50:13.248 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:13.248 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:13.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.249+0000 7f514dd6c700 1 -- 172.21.15.194:0/2069314752 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f5134038490 msgr2=0x7f513403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:13.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.249+0000 7f514dd6c700 1 --2- 172.21.15.194:0/2069314752 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f5134038490 0x7f513403a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5130006fd0 tx=0x7f5130006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:13.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.249+0000 7f514dd6c700 1 -- 172.21.15.194:0/2069314752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480fed30 msgr2=0x7f51480fc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:13.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.249+0000 7f514dd6c700 1 --2- 172.21.15.194:0/2069314752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480fed30 0x7f51480fc270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f51400062a0 tx=0x7f514000bd40 comp rx=0 tx=0).stop 2024-04-13T10:50:13.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.249+0000 7f514dd6c700 1 -- 172.21.15.194:0/2069314752 shutdown_connections 2024-04-13T10:50:13.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.249+0000 7f514dd6c700 1 --2- 172.21.15.194:0/2069314752 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f5134038490 0x7f513403a940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:13.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.249+0000 7f514dd6c700 1 --2- 172.21.15.194:0/2069314752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480fed30 0x7f51480fc270 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:13.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.249+0000 7f514dd6c700 1 -- 172.21.15.194:0/2069314752 >> 172.21.15.194:0/2069314752 conn(0x7f51480fa2c0 msgr2=0x7f5148069060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:13.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.249+0000 7f514dd6c700 1 -- 172.21.15.194:0/2069314752 shutdown_connections 2024-04-13T10:50:13.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:13.249+0000 7f514dd6c700 1 -- 172.21.15.194:0/2069314752 wait complete. 2024-04-13T10:50:13.250 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:13 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/2069314752' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:14.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:14 smithi134 ceph-mon[39696]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:14.901 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:14.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:15.147 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:15.207 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:16.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:16 smithi134 ceph-mon[39696]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:16.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.974+0000 7fa99dc3b700 1 -- 172.21.15.194:0/1000393906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9980fecc0 msgr2=0x7fa9980ff0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:16.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.974+0000 7fa99dc3b700 1 --2- 172.21.15.194:0/1000393906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9980fecc0 0x7fa9980ff0d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa988009910 tx=0x7fa988009c20 comp rx=0 tx=0).stop 2024-04-13T10:50:16.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.974+0000 7fa99dc3b700 1 -- 172.21.15.194:0/1000393906 shutdown_connections 2024-04-13T10:50:16.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.974+0000 7fa99dc3b700 1 --2- 172.21.15.194:0/1000393906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9980fecc0 0x7fa9980ff0d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:16.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.974+0000 7fa99dc3b700 1 -- 172.21.15.194:0/1000393906 >> 172.21.15.194:0/1000393906 conn(0x7fa9980fa250 msgr2=0x7fa9980fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:16.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.974+0000 7fa99dc3b700 1 -- 172.21.15.194:0/1000393906 shutdown_connections 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.974+0000 7fa99dc3b700 1 -- 172.21.15.194:0/1000393906 wait complete. 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.975+0000 7fa99dc3b700 1 Processor -- start 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.975+0000 7fa99dc3b700 1 -- start start 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.975+0000 7fa99dc3b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9980fecc0 0x7fa998194e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.975+0000 7fa99dc3b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9981953b0 con 0x7fa9980fecc0 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.975+0000 7fa9977fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9980fecc0 0x7fa998194e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.975+0000 7fa9977fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9980fecc0 0x7fa998194e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:47722/0 (socket says 172.21.15.194:47722) 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.975+0000 7fa9977fe700 1 -- 172.21.15.194:0/4052411550 learned_addr learned my addr 172.21.15.194:0/4052411550 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.976+0000 7fa9977fe700 1 -- 172.21.15.194:0/4052411550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880095f0 con 0x7fa9980fecc0 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.976+0000 7fa9977fe700 1 --2- 172.21.15.194:0/4052411550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9980fecc0 0x7fa998194e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa988006010 tx=0x7fa9880057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.976+0000 7fa994ff9700 1 -- 172.21.15.194:0/4052411550 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa98801d070 con 0x7fa9980fecc0 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.976+0000 7fa99dc3b700 1 -- 172.21.15.194:0/4052411550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9981955b0 con 0x7fa9980fecc0 2024-04-13T10:50:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.976+0000 7fa994ff9700 1 -- 172.21.15.194:0/4052411550 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fa98800bdf0 con 0x7fa9980fecc0 2024-04-13T10:50:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.976+0000 7fa994ff9700 1 -- 172.21.15.194:0/4052411550 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa988022e50 con 0x7fa9980fecc0 2024-04-13T10:50:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.976+0000 7fa99dc3b700 1 -- 172.21.15.194:0/4052411550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa998195a50 con 0x7fa9980fecc0 2024-04-13T10:50:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.977+0000 7fa994ff9700 1 -- 172.21.15.194:0/4052411550 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fa988022700 con 0x7fa9980fecc0 2024-04-13T10:50:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.977+0000 7fa99dc3b700 1 -- 172.21.15.194:0/4052411550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99818ea70 con 0x7fa9980fecc0 2024-04-13T10:50:16.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.977+0000 7fa994ff9700 1 --2- 172.21.15.194:0/4052411550 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fa980038430 0x7fa98003a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:16.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.977+0000 7fa994ff9700 1 -- 172.21.15.194:0/4052411550 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa98804c360 con 0x7fa9980fecc0 2024-04-13T10:50:16.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.977+0000 7fa996ffd700 1 --2- 172.21.15.194:0/4052411550 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fa980038430 0x7fa98003a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:16.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.978+0000 7fa996ffd700 1 --2- 172.21.15.194:0/4052411550 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fa980038430 0x7fa98003a8e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa98c006fd0 tx=0x7fa98c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:16.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:16.982+0000 7fa994ff9700 1 -- 172.21.15.194:0/4052411550 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa98800b960 con 0x7fa9980fecc0 2024-04-13T10:50:17.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.252+0000 7fa99dc3b700 1 -- 172.21.15.194:0/4052411550 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa99802cc30 con 0x7fa9980fecc0 2024-04-13T10:50:17.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.253+0000 7fa994ff9700 1 -- 172.21.15.194:0/4052411550 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fa988027020 con 0x7fa9980fecc0 2024-04-13T10:50:17.254 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:17.254 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:17.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.255+0000 7fa99dc3b700 1 -- 172.21.15.194:0/4052411550 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fa980038430 msgr2=0x7fa98003a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:17.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.255+0000 7fa99dc3b700 1 --2- 172.21.15.194:0/4052411550 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fa980038430 0x7fa98003a8e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa98c006fd0 tx=0x7fa98c006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:17.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.255+0000 7fa99dc3b700 1 -- 172.21.15.194:0/4052411550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9980fecc0 msgr2=0x7fa998194e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:17.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.255+0000 7fa99dc3b700 1 --2- 172.21.15.194:0/4052411550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9980fecc0 0x7fa998194e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa988006010 tx=0x7fa9880057b0 comp rx=0 tx=0).stop 2024-04-13T10:50:17.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.255+0000 7fa99dc3b700 1 -- 172.21.15.194:0/4052411550 shutdown_connections 2024-04-13T10:50:17.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.255+0000 7fa99dc3b700 1 --2- 172.21.15.194:0/4052411550 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7fa980038430 0x7fa98003a8e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:17.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.255+0000 7fa99dc3b700 1 --2- 172.21.15.194:0/4052411550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9980fecc0 0x7fa998194e70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:17.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.255+0000 7fa99dc3b700 1 -- 172.21.15.194:0/4052411550 >> 172.21.15.194:0/4052411550 conn(0x7fa9980fa250 msgr2=0x7fa9981028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:17.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.255+0000 7fa99dc3b700 1 -- 172.21.15.194:0/4052411550 shutdown_connections 2024-04-13T10:50:17.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:17.255+0000 7fa99dc3b700 1 -- 172.21.15.194:0/4052411550 wait complete. 2024-04-13T10:50:17.257 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:17.362 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:17 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/4052411550' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:18.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:18 smithi134 ceph-mon[39696]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:18.957 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:18.957 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:19.202 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:19.267 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:20.590 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:20 smithi134 ceph-mon[39696]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:21.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.033+0000 7f026dba1700 1 -- 172.21.15.194:0/3819412479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02680fed30 msgr2=0x7f02680ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:21.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.033+0000 7f026dba1700 1 --2- 172.21.15.194:0/3819412479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02680fed30 0x7f02680ff140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f025c009910 tx=0x7f025c009c20 comp rx=0 tx=0).stop 2024-04-13T10:50:21.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.033+0000 7f026dba1700 1 -- 172.21.15.194:0/3819412479 shutdown_connections 2024-04-13T10:50:21.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.033+0000 7f026dba1700 1 --2- 172.21.15.194:0/3819412479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02680fed30 0x7f02680ff140 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:21.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.033+0000 7f026dba1700 1 -- 172.21.15.194:0/3819412479 >> 172.21.15.194:0/3819412479 conn(0x7f02680fa2e0 msgr2=0x7f02680fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:21.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.033+0000 7f026dba1700 1 -- 172.21.15.194:0/3819412479 shutdown_connections 2024-04-13T10:50:21.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.033+0000 7f026dba1700 1 -- 172.21.15.194:0/3819412479 wait complete. 2024-04-13T10:50:21.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.033+0000 7f026dba1700 1 Processor -- start 2024-04-13T10:50:21.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f026dba1700 1 -- start start 2024-04-13T10:50:21.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f026dba1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02680fed30 0x7f02680fc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f026dba1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680fc7b0 con 0x7f02680fed30 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f02677fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02680fed30 0x7f02680fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f02677fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02680fed30 0x7f02680fc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:47752/0 (socket says 172.21.15.194:47752) 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f02677fe700 1 -- 172.21.15.194:0/1028359134 learned_addr learned my addr 172.21.15.194:0/1028359134 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f02677fe700 1 -- 172.21.15.194:0/1028359134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0095f0 con 0x7f02680fed30 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f02677fe700 1 --2- 172.21.15.194:0/1028359134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02680fed30 0x7f02680fc270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f025c006010 tx=0x7f025c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f0264ff9700 1 -- 172.21.15.194:0/1028359134 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f025c01d070 con 0x7f02680fed30 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f026dba1700 1 -- 172.21.15.194:0/1028359134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02680fa8c0 con 0x7f02680fed30 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f0264ff9700 1 -- 172.21.15.194:0/1028359134 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f025c00bdf0 con 0x7f02680fed30 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.034+0000 7f0264ff9700 1 -- 172.21.15.194:0/1028359134 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f025c022e50 con 0x7f02680fed30 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.035+0000 7f026dba1700 1 -- 172.21.15.194:0/1028359134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02680fad60 con 0x7f02680fed30 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.035+0000 7f0264ff9700 1 -- 172.21.15.194:0/1028359134 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f025c00b960 con 0x7f02680fed30 2024-04-13T10:50:21.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.035+0000 7f026dba1700 1 -- 172.21.15.194:0/1028359134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0268062380 con 0x7f02680fed30 2024-04-13T10:50:21.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.035+0000 7f0264ff9700 1 --2- 172.21.15.194:0/1028359134 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f0250038440 0x7f025003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:21.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.035+0000 7f0264ff9700 1 -- 172.21.15.194:0/1028359134 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f025c04c400 con 0x7f02680fed30 2024-04-13T10:50:21.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.036+0000 7f0266ffd700 1 --2- 172.21.15.194:0/1028359134 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f0250038440 0x7f025003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:21.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.036+0000 7f0266ffd700 1 --2- 172.21.15.194:0/1028359134 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f0250038440 0x7f025003a8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0258006fd0 tx=0x7f0258006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:21.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.041+0000 7f0264ff9700 1 -- 172.21.15.194:0/1028359134 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f025c02acf0 con 0x7f02680fed30 2024-04-13T10:50:21.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.308+0000 7f026dba1700 1 -- 172.21.15.194:0/1028359134 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f026818e2c0 con 0x7f02680fed30 2024-04-13T10:50:21.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.308+0000 7f0264ff9700 1 -- 172.21.15.194:0/1028359134 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f025c027020 con 0x7f02680fed30 2024-04-13T10:50:21.309 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:21.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.310+0000 7f026dba1700 1 -- 172.21.15.194:0/1028359134 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f0250038440 msgr2=0x7f025003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:21.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.310+0000 7f026dba1700 1 --2- 172.21.15.194:0/1028359134 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f0250038440 0x7f025003a8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0258006fd0 tx=0x7f0258006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:21.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.310+0000 7f026dba1700 1 -- 172.21.15.194:0/1028359134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02680fed30 msgr2=0x7f02680fc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:21.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.310+0000 7f026dba1700 1 --2- 172.21.15.194:0/1028359134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02680fed30 0x7f02680fc270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f025c006010 tx=0x7f025c0057b0 comp rx=0 tx=0).stop 2024-04-13T10:50:21.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.311+0000 7f026dba1700 1 -- 172.21.15.194:0/1028359134 shutdown_connections 2024-04-13T10:50:21.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.311+0000 7f026dba1700 1 --2- 172.21.15.194:0/1028359134 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f0250038440 0x7f025003a8f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:21.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.311+0000 7f026dba1700 1 --2- 172.21.15.194:0/1028359134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02680fed30 0x7f02680fc270 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:21.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.311+0000 7f026dba1700 1 -- 172.21.15.194:0/1028359134 >> 172.21.15.194:0/1028359134 conn(0x7f02680fa2e0 msgr2=0x7f02680687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:21.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.311+0000 7f026dba1700 1 -- 172.21.15.194:0/1028359134 shutdown_connections 2024-04-13T10:50:21.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:21.311+0000 7f026dba1700 1 -- 172.21.15.194:0/1028359134 wait complete. 2024-04-13T10:50:21.312 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:22.089 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:21 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:22.089 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:21 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:22.089 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:21 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:22.089 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:21 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-13T10:50:22.089 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:21 smithi134 ceph-mon[39696]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:22.089 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:21 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/1028359134' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:23.092 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:23.092 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:23.111 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:22 smithi134 ceph-mon[39696]: from='mgr.14162 172.21.15.134:0/1324828466' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-13T10:50:23.112 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:22 smithi134 ceph-mon[39696]: mgrmap e14: smithi134.tmanda(active, since 72s) 2024-04-13T10:50:23.350 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:23.417 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:25.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.089+0000 7f2970171700 1 -- 172.21.15.194:0/585194202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29681008c0 msgr2=0x7f2968102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:25.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.089+0000 7f2970171700 1 --2- 172.21.15.194:0/585194202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29681008c0 0x7f2968102ca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f295800b0a0 tx=0x7f295800b3b0 comp rx=0 tx=0).stop 2024-04-13T10:50:25.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.089+0000 7f2970171700 1 -- 172.21.15.194:0/585194202 shutdown_connections 2024-04-13T10:50:25.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.089+0000 7f2970171700 1 --2- 172.21.15.194:0/585194202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29681008c0 0x7f2968102ca0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:25.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.089+0000 7f2970171700 1 -- 172.21.15.194:0/585194202 >> 172.21.15.194:0/585194202 conn(0x7f29680fa2e0 msgr2=0x7f29680fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:25.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.089+0000 7f2970171700 1 -- 172.21.15.194:0/585194202 shutdown_connections 2024-04-13T10:50:25.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.089+0000 7f2970171700 1 -- 172.21.15.194:0/585194202 wait complete. 2024-04-13T10:50:25.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.090+0000 7f2970171700 1 Processor -- start 2024-04-13T10:50:25.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.090+0000 7f2970171700 1 -- start start 2024-04-13T10:50:25.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.090+0000 7f2970171700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29681008c0 0x7f2968194e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.090+0000 7f2970171700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29681953b0 con 0x7f29681008c0 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.090+0000 7f296df0d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29681008c0 0x7f2968194e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.090+0000 7f296df0d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29681008c0 0x7f2968194e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:47760/0 (socket says 172.21.15.194:47760) 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.090+0000 7f296df0d700 1 -- 172.21.15.194:0/2753201583 learned_addr learned my addr 172.21.15.194:0/2753201583 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.090+0000 7f296df0d700 1 -- 172.21.15.194:0/2753201583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2958009d00 con 0x7f29681008c0 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.091+0000 7f296df0d700 1 --2- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29681008c0 0x7f2968194e70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29580062a0 tx=0x7f295800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.091+0000 7f2966ffd700 1 -- 172.21.15.194:0/2753201583 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f295800e040 con 0x7f29681008c0 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.091+0000 7f2966ffd700 1 -- 172.21.15.194:0/2753201583 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f2958012ad0 con 0x7f29681008c0 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.091+0000 7f2966ffd700 1 -- 172.21.15.194:0/2753201583 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f295801c890 con 0x7f29681008c0 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.091+0000 7f2970171700 1 -- 172.21.15.194:0/2753201583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29681955b0 con 0x7f29681008c0 2024-04-13T10:50:25.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.091+0000 7f2970171700 1 -- 172.21.15.194:0/2753201583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2968195a50 con 0x7f29681008c0 2024-04-13T10:50:25.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.092+0000 7f2966ffd700 1 -- 172.21.15.194:0/2753201583 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 14) v1 ==== 45155+0+0 (secure 0 0 0) 0x7f2958012c40 con 0x7f29681008c0 2024-04-13T10:50:25.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.092+0000 7f2970171700 1 -- 172.21.15.194:0/2753201583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296818e9d0 con 0x7f29681008c0 2024-04-13T10:50:25.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.092+0000 7f2966ffd700 1 --2- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f29500384e0 0x7f295003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:25.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.092+0000 7f2966ffd700 1 -- 172.21.15.194:0/2753201583 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f295804c620 con 0x7f29681008c0 2024-04-13T10:50:25.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.092+0000 7f296d70c700 1 -- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f29500384e0 msgr2=0x7f295003a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/2524753251 2024-04-13T10:50:25.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.092+0000 7f296d70c700 1 --2- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f29500384e0 0x7f295003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-13T10:50:25.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.097+0000 7f2966ffd700 1 -- 172.21.15.194:0/2753201583 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2958011390 con 0x7f29681008c0 2024-04-13T10:50:25.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.293+0000 7f296d70c700 1 -- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f29500384e0 msgr2=0x7f295003a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/2524753251 2024-04-13T10:50:25.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.293+0000 7f296d70c700 1 --2- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f29500384e0 0x7f295003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-13T10:50:25.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.363+0000 7f2970171700 1 -- 172.21.15.194:0/2753201583 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f296802cc30 con 0x7f29681008c0 2024-04-13T10:50:25.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.363+0000 7f2966ffd700 1 -- 172.21.15.194:0/2753201583 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f295801b360 con 0x7f29681008c0 2024-04-13T10:50:25.364 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:25.365 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:25.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.365+0000 7f2970171700 1 -- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f29500384e0 msgr2=0x7f295003a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-13T10:50:25.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.365+0000 7f2970171700 1 --2- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f29500384e0 0x7f295003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:25.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.365+0000 7f2970171700 1 -- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29681008c0 msgr2=0x7f2968194e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:25.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.365+0000 7f2970171700 1 --2- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29681008c0 0x7f2968194e70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29580062a0 tx=0x7f295800bd40 comp rx=0 tx=0).stop 2024-04-13T10:50:25.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.365+0000 7f2970171700 1 -- 172.21.15.194:0/2753201583 shutdown_connections 2024-04-13T10:50:25.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.365+0000 7f2970171700 1 --2- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:6800/2524753251,v1:172.21.15.134:6801/2524753251] conn(0x7f29500384e0 0x7f295003a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:25.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.365+0000 7f2970171700 1 --2- 172.21.15.194:0/2753201583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29681008c0 0x7f2968194e70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:25.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.365+0000 7f2970171700 1 -- 172.21.15.194:0/2753201583 >> 172.21.15.194:0/2753201583 conn(0x7f29680fa2e0 msgr2=0x7f29680faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:25.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.366+0000 7f2970171700 1 -- 172.21.15.194:0/2753201583 shutdown_connections 2024-04-13T10:50:25.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:25.366+0000 7f2970171700 1 -- 172.21.15.194:0/2753201583 wait complete. 2024-04-13T10:50:25.368 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:25 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/2753201583' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:27.116 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:27.116 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:27.375 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:27.440 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:28.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: Active manager daemon smithi134.tmanda restarted 2024-04-13T10:50:28.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: Activating manager daemon smithi134.tmanda 2024-04-13T10:50:28.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: osdmap e5: 0 total, 0 up, 0 in 2024-04-13T10:50:28.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: mgrmap e15: smithi134.tmanda(active, starting, since 0.00312643s) 2024-04-13T10:50:28.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:50:28.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr metadata", "who": "smithi134.tmanda", "id": "smithi134.tmanda"}]: dispatch 2024-04-13T10:50:28.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-13T10:50:28.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-13T10:50:28.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-13T10:50:28.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: Manager daemon smithi134.tmanda is now available 2024-04-13T10:50:28.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:50:28.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:50:29.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.196+0000 7f8394b28700 1 -- 172.21.15.194:0/2143435354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8390100960 msgr2=0x7f8390102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:29.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.196+0000 7f8394b28700 1 --2- 172.21.15.194:0/2143435354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8390100960 0x7f8390102d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8380009910 tx=0x7f8380009c20 comp rx=0 tx=0).stop 2024-04-13T10:50:29.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.196+0000 7f8394b28700 1 -- 172.21.15.194:0/2143435354 shutdown_connections 2024-04-13T10:50:29.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.196+0000 7f8394b28700 1 --2- 172.21.15.194:0/2143435354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8390100960 0x7f8390102d40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:29.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.196+0000 7f8394b28700 1 -- 172.21.15.194:0/2143435354 >> 172.21.15.194:0/2143435354 conn(0x7f83900fa2c0 msgr2=0x7f83900fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:29.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.196+0000 7f8394b28700 1 -- 172.21.15.194:0/2143435354 shutdown_connections 2024-04-13T10:50:29.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.196+0000 7f8394b28700 1 -- 172.21.15.194:0/2143435354 wait complete. 2024-04-13T10:50:29.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.197+0000 7f8394b28700 1 Processor -- start 2024-04-13T10:50:29.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.197+0000 7f8394b28700 1 -- start start 2024-04-13T10:50:29.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f8394b28700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8390100960 0x7f8390194eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:29.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f8394b28700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83901953f0 con 0x7f8390100960 2024-04-13T10:50:29.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f838e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8390100960 0x7f8390194eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:29.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f838e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8390100960 0x7f8390194eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:42374/0 (socket says 172.21.15.194:42374) 2024-04-13T10:50:29.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f838e59c700 1 -- 172.21.15.194:0/3714638126 learned_addr learned my addr 172.21.15.194:0/3714638126 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:29.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f838e59c700 1 -- 172.21.15.194:0/3714638126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83800095f0 con 0x7f8390100960 2024-04-13T10:50:29.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f838e59c700 1 --2- 172.21.15.194:0/3714638126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8390100960 0x7f8390194eb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8380004f40 tx=0x7f83800057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:29.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f837f7fe700 1 -- 172.21.15.194:0/3714638126 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f838001d070 con 0x7f8390100960 2024-04-13T10:50:29.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f837f7fe700 1 -- 172.21.15.194:0/3714638126 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f838000bdf0 con 0x7f8390100960 2024-04-13T10:50:29.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f8394b28700 1 -- 172.21.15.194:0/3714638126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83901955f0 con 0x7f8390100960 2024-04-13T10:50:29.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f837f7fe700 1 -- 172.21.15.194:0/3714638126 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8380022e00 con 0x7f8390100960 2024-04-13T10:50:29.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.198+0000 7f8394b28700 1 -- 172.21.15.194:0/3714638126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8390195a90 con 0x7f8390100960 2024-04-13T10:50:29.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.199+0000 7f8394b28700 1 -- 172.21.15.194:0/3714638126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839018e9d0 con 0x7f8390100960 2024-04-13T10:50:29.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.199+0000 7f837f7fe700 1 -- 172.21.15.194:0/3714638126 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) v1 ==== 44878+0+0 (secure 0 0 0) 0x7f838000f4b0 con 0x7f8390100960 2024-04-13T10:50:29.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.199+0000 7f837f7fe700 1 -- 172.21.15.194:0/3714638126 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f838004c0d0 con 0x7f8390100960 2024-04-13T10:50:29.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.204+0000 7f837f7fe700 1 -- 172.21.15.194:0/3714638126 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8380020bf0 con 0x7f8390100960 2024-04-13T10:50:29.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.276+0000 7f837f7fe700 1 -- 172.21.15.194:0/3714638126 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 16) v1 ==== 45005+0+0 (secure 0 0 0) 0x7f83800226c0 con 0x7f8390100960 2024-04-13T10:50:29.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.276+0000 7f837f7fe700 1 --2- 172.21.15.194:0/3714638126 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83780394f0 0x7f837803b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:29.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.277+0000 7f838dd9b700 1 --2- 172.21.15.194:0/3714638126 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83780394f0 0x7f837803b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:29.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.277+0000 7f838dd9b700 1 --2- 172.21.15.194:0/3714638126 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83780394f0 0x7f837803b8d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8384006fd0 tx=0x7f8384006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:29.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.493+0000 7f8394b28700 1 -- 172.21.15.194:0/3714638126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f839002cc30 con 0x7f8390100960 2024-04-13T10:50:29.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.494+0000 7f837f7fe700 1 -- 172.21.15.194:0/3714638126 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f8380027070 con 0x7f8390100960 2024-04-13T10:50:29.494 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:29.494 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:29.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.496+0000 7f8394b28700 1 -- 172.21.15.194:0/3714638126 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83780394f0 msgr2=0x7f837803b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:29.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.496+0000 7f8394b28700 1 --2- 172.21.15.194:0/3714638126 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83780394f0 0x7f837803b8d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8384006fd0 tx=0x7f8384006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:29.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.496+0000 7f8394b28700 1 -- 172.21.15.194:0/3714638126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8390100960 msgr2=0x7f8390194eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:29.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.496+0000 7f8394b28700 1 --2- 172.21.15.194:0/3714638126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8390100960 0x7f8390194eb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8380004f40 tx=0x7f83800057b0 comp rx=0 tx=0).stop 2024-04-13T10:50:29.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.496+0000 7f8394b28700 1 -- 172.21.15.194:0/3714638126 shutdown_connections 2024-04-13T10:50:29.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.496+0000 7f8394b28700 1 --2- 172.21.15.194:0/3714638126 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83780394f0 0x7f837803b8d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:29.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.496+0000 7f8394b28700 1 --2- 172.21.15.194:0/3714638126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8390100960 0x7f8390194eb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:29.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.496+0000 7f8394b28700 1 -- 172.21.15.194:0/3714638126 >> 172.21.15.194:0/3714638126 conn(0x7f83900fa2c0 msgr2=0x7f83900faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:29.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.496+0000 7f8394b28700 1 -- 172.21.15.194:0/3714638126 shutdown_connections 2024-04-13T10:50:29.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:29.496+0000 7f8394b28700 1 -- 172.21.15.194:0/3714638126 wait complete. 2024-04-13T10:50:29.498 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:29.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:29.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:50:29.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/mirror_snapshot_schedule"}]: dispatch 2024-04-13T10:50:29.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/trash_purge_schedule"}]: dispatch 2024-04-13T10:50:29.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:29.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:29 smithi134 ceph-mon[39696]: mgrmap e16: smithi134.tmanda(active, since 1.00529s) 2024-04-13T10:50:29.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:30.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:30 smithi134 ceph-mon[39696]: [13/Apr/2024:10:50:29] ENGINE Bus STARTING 2024-04-13T10:50:30.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:30 smithi134 ceph-mon[39696]: [13/Apr/2024:10:50:29] ENGINE Serving on https://172.21.15.134:7150 2024-04-13T10:50:30.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:30 smithi134 ceph-mon[39696]: [13/Apr/2024:10:50:29] ENGINE Serving on http://172.21.15.134:8765 2024-04-13T10:50:30.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:30 smithi134 ceph-mon[39696]: [13/Apr/2024:10:50:29] ENGINE Bus STARTED 2024-04-13T10:50:30.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:30 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/3714638126' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:30.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:30 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:31.199 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:31.199 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:31.430 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:31.820 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-13T10:50:32.512 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:32 smithi134 ceph-mon[39696]: mgrmap e17: smithi134.tmanda(active, since 2s) 2024-04-13T10:50:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:50:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:50:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:50:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:50:34.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.879+0000 7f203c3b0700 1 -- 172.21.15.194:0/1755652565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20340ffe40 msgr2=0x7f2034100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:34.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.879+0000 7f203c3b0700 1 --2- 172.21.15.194:0/1755652565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20340ffe40 0x7f2034100250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2030009910 tx=0x7f2030009c20 comp rx=0 tx=0).stop 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.879+0000 7f203c3b0700 1 -- 172.21.15.194:0/1755652565 shutdown_connections 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.879+0000 7f203c3b0700 1 --2- 172.21.15.194:0/1755652565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20340ffe40 0x7f2034100250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.879+0000 7f203c3b0700 1 -- 172.21.15.194:0/1755652565 >> 172.21.15.194:0/1755652565 conn(0x7f20340fb3f0 msgr2=0x7f20340fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.879+0000 7f203c3b0700 1 -- 172.21.15.194:0/1755652565 shutdown_connections 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.879+0000 7f203c3b0700 1 -- 172.21.15.194:0/1755652565 wait complete. 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.879+0000 7f203c3b0700 1 Processor -- start 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.879+0000 7f203c3b0700 1 -- start start 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.880+0000 7f203c3b0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20340ffe40 0x7f2034194ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.880+0000 7f203c3b0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2034195400 con 0x7f20340ffe40 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.880+0000 7f203a14c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20340ffe40 0x7f2034194ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.880+0000 7f203a14c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20340ffe40 0x7f2034194ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:42378/0 (socket says 172.21.15.194:42378) 2024-04-13T10:50:34.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.880+0000 7f203a14c700 1 -- 172.21.15.194:0/2818222562 learned_addr learned my addr 172.21.15.194:0/2818222562 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.880+0000 7f203a14c700 1 -- 172.21.15.194:0/2818222562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20300095f0 con 0x7f20340ffe40 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.880+0000 7f203a14c700 1 --2- 172.21.15.194:0/2818222562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20340ffe40 0x7f2034194ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2030004f40 tx=0x7f20300057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.880+0000 7f202b7fe700 1 -- 172.21.15.194:0/2818222562 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f203001d070 con 0x7f20340ffe40 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.880+0000 7f202b7fe700 1 -- 172.21.15.194:0/2818222562 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f203000bdf0 con 0x7f20340ffe40 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.880+0000 7f203c3b0700 1 -- 172.21.15.194:0/2818222562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2034195600 con 0x7f20340ffe40 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.881+0000 7f202b7fe700 1 -- 172.21.15.194:0/2818222562 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2030022e30 con 0x7f20340ffe40 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.881+0000 7f203c3b0700 1 -- 172.21.15.194:0/2818222562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2034195aa0 con 0x7f20340ffe40 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.881+0000 7f202b7fe700 1 -- 172.21.15.194:0/2818222562 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 45199+0+0 (secure 0 0 0) 0x7f203000f530 con 0x7f20340ffe40 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.881+0000 7f203c3b0700 1 -- 172.21.15.194:0/2818222562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203418e960 con 0x7f20340ffe40 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.881+0000 7f202b7fe700 1 --2- 172.21.15.194:0/2818222562 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2020038580 0x7f202003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.882+0000 7f202b7fe700 1 -- 172.21.15.194:0/2818222562 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f203004c6b0 con 0x7f20340ffe40 2024-04-13T10:50:34.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.882+0000 7f203994b700 1 --2- 172.21.15.194:0/2818222562 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2020038580 0x7f202003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:34.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.882+0000 7f203994b700 1 --2- 172.21.15.194:0/2818222562 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2020038580 0x7f202003aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2024006fd0 tx=0x7f2024006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:34.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:34.887+0000 7f202b7fe700 1 -- 172.21.15.194:0/2818222562 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f203002a950 con 0x7f20340ffe40 2024-04-13T10:50:35.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.177+0000 7f203c3b0700 1 -- 172.21.15.194:0/2818222562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f203402cc30 con 0x7f20340ffe40 2024-04-13T10:50:35.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.178+0000 7f202b7fe700 1 -- 172.21.15.194:0/2818222562 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f2030027020 con 0x7f20340ffe40 2024-04-13T10:50:35.178 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:35.178 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:35.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.180+0000 7f203c3b0700 1 -- 172.21.15.194:0/2818222562 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2020038580 msgr2=0x7f202003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:35.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.180+0000 7f203c3b0700 1 --2- 172.21.15.194:0/2818222562 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2020038580 0x7f202003aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2024006fd0 tx=0x7f2024006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:35.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.180+0000 7f203c3b0700 1 -- 172.21.15.194:0/2818222562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20340ffe40 msgr2=0x7f2034194ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:35.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.180+0000 7f203c3b0700 1 --2- 172.21.15.194:0/2818222562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20340ffe40 0x7f2034194ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2030004f40 tx=0x7f20300057b0 comp rx=0 tx=0).stop 2024-04-13T10:50:35.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.180+0000 7f203c3b0700 1 -- 172.21.15.194:0/2818222562 shutdown_connections 2024-04-13T10:50:35.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.180+0000 7f203c3b0700 1 --2- 172.21.15.194:0/2818222562 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2020038580 0x7f202003aa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:35.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.180+0000 7f203c3b0700 1 --2- 172.21.15.194:0/2818222562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20340ffe40 0x7f2034194ec0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:35.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.180+0000 7f203c3b0700 1 -- 172.21.15.194:0/2818222562 >> 172.21.15.194:0/2818222562 conn(0x7f20340fb3f0 msgr2=0x7f20340fc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:35.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.180+0000 7f203c3b0700 1 -- 172.21.15.194:0/2818222562 shutdown_connections 2024-04-13T10:50:35.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:35.180+0000 7f203c3b0700 1 -- 172.21.15.194:0/2818222562 wait complete. 2024-04-13T10:50:35.181 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:34 smithi134 ceph-mon[39696]: Updating smithi134:/etc/ceph/ceph.conf 2024-04-13T10:50:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:34 smithi134 ceph-mon[39696]: Updating smithi194:/etc/ceph/ceph.conf 2024-04-13T10:50:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:34 smithi134 ceph-mon[39696]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:50:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:34 smithi134 ceph-mon[39696]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:50:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:34 smithi134 ceph-mon[39696]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:50:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:34 smithi134 ceph-mon[39696]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:50:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:34 smithi134 ceph-mon[39696]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.client.admin.keyring 2024-04-13T10:50:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:34 smithi134 ceph-mon[39696]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.client.admin.keyring 2024-04-13T10:50:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:35 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:35 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:35 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:35 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:35 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:36.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:35 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi194", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-13T10:50:36.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:35 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi194", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-13T10:50:36.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:35 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:50:36.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:35 smithi134 ceph-mon[39696]: Deploying daemon ceph-exporter.smithi194 on smithi194 2024-04-13T10:50:36.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:35 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/2818222562' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:37.862 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:37.862 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:38.617 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:50:38.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:38.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:38.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:38.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:38.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-13T10:50:38.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-13T10:50:38.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:50:38.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:38 smithi134 ceph-mon[39696]: Deploying daemon crash.smithi194 on smithi194 2024-04-13T10:50:38.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:41.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.255+0000 7f74bc119700 1 -- 172.21.15.194:0/2076225869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b4104510 msgr2=0x7f74b41048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:41.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.255+0000 7f74bc119700 1 --2- 172.21.15.194:0/2076225869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b4104510 0x7f74b41048e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009910 tx=0x7f74a4009c20 comp rx=0 tx=0).stop 2024-04-13T10:50:41.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.255+0000 7f74bc119700 1 -- 172.21.15.194:0/2076225869 shutdown_connections 2024-04-13T10:50:41.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.255+0000 7f74bc119700 1 --2- 172.21.15.194:0/2076225869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b4104510 0x7f74b41048e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:41.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.255+0000 7f74bc119700 1 -- 172.21.15.194:0/2076225869 >> 172.21.15.194:0/2076225869 conn(0x7f74b4075780 msgr2=0x7f74b4075b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:41.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.255+0000 7f74bc119700 1 -- 172.21.15.194:0/2076225869 shutdown_connections 2024-04-13T10:50:41.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.255+0000 7f74bc119700 1 -- 172.21.15.194:0/2076225869 wait complete. 2024-04-13T10:50:41.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.256+0000 7f74bc119700 1 Processor -- start 2024-04-13T10:50:41.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.256+0000 7f74bc119700 1 -- start start 2024-04-13T10:50:41.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.256+0000 7f74bc119700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b4104510 0x7f74b4198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:41.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.256+0000 7f74bc119700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41992b0 con 0x7f74b4104510 2024-04-13T10:50:41.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.256+0000 7f74b9eb5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b4104510 0x7f74b4198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:41.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.256+0000 7f74b9eb5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b4104510 0x7f74b4198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:40154/0 (socket says 172.21.15.194:40154) 2024-04-13T10:50:41.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.256+0000 7f74b9eb5700 1 -- 172.21.15.194:0/251112443 learned_addr learned my addr 172.21.15.194:0/251112443 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:41.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.257+0000 7f74b9eb5700 1 -- 172.21.15.194:0/251112443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40095f0 con 0x7f74b4104510 2024-04-13T10:50:41.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.257+0000 7f74b9eb5700 1 --2- 172.21.15.194:0/251112443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b4104510 0x7f74b4198d70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f74a4004f40 tx=0x7f74a4005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:41.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.257+0000 7f74aaffd700 1 -- 172.21.15.194:0/251112443 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74a401d070 con 0x7f74b4104510 2024-04-13T10:50:41.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.257+0000 7f74aaffd700 1 -- 172.21.15.194:0/251112443 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f74a4005dc0 con 0x7f74b4104510 2024-04-13T10:50:41.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.257+0000 7f74bc119700 1 -- 172.21.15.194:0/251112443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b4199510 con 0x7f74b4104510 2024-04-13T10:50:41.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.257+0000 7f74aaffd700 1 -- 172.21.15.194:0/251112443 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74a4022d70 con 0x7f74b4104510 2024-04-13T10:50:41.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.257+0000 7f74bc119700 1 -- 172.21.15.194:0/251112443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b4194610 con 0x7f74b4104510 2024-04-13T10:50:41.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.258+0000 7f74bc119700 1 -- 172.21.15.194:0/251112443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b4062380 con 0x7f74b4104510 2024-04-13T10:50:41.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.258+0000 7f74aaffd700 1 -- 172.21.15.194:0/251112443 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 45199+0+0 (secure 0 0 0) 0x7f74a400b960 con 0x7f74b4104510 2024-04-13T10:50:41.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.258+0000 7f74aaffd700 1 --2- 172.21.15.194:0/251112443 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f74a0038580 0x7f74a003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:41.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.258+0000 7f74aaffd700 1 -- 172.21.15.194:0/251112443 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f74a404c600 con 0x7f74b4104510 2024-04-13T10:50:41.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.258+0000 7f74b96b4700 1 --2- 172.21.15.194:0/251112443 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f74a0038580 0x7f74a003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:41.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.259+0000 7f74b96b4700 1 --2- 172.21.15.194:0/251112443 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f74a0038580 0x7f74a003aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f74b0006fd0 tx=0x7f74b0006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:41.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.263+0000 7f74aaffd700 1 -- 172.21.15.194:0/251112443 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f74a402bba0 con 0x7f74b4104510 2024-04-13T10:50:41.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.575+0000 7f74bc119700 1 -- 172.21.15.194:0/251112443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f74b4195220 con 0x7f74b4104510 2024-04-13T10:50:41.576 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:41.576 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:41.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.575+0000 7f74aaffd700 1 -- 172.21.15.194:0/251112443 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f74a4027030 con 0x7f74b4104510 2024-04-13T10:50:41.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.578+0000 7f74bc119700 1 -- 172.21.15.194:0/251112443 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f74a0038580 msgr2=0x7f74a003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:41.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.578+0000 7f74bc119700 1 --2- 172.21.15.194:0/251112443 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f74a0038580 0x7f74a003aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f74b0006fd0 tx=0x7f74b0006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:41.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.578+0000 7f74bc119700 1 -- 172.21.15.194:0/251112443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b4104510 msgr2=0x7f74b4198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:41.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.578+0000 7f74bc119700 1 --2- 172.21.15.194:0/251112443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b4104510 0x7f74b4198d70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f74a4004f40 tx=0x7f74a4005020 comp rx=0 tx=0).stop 2024-04-13T10:50:41.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.578+0000 7f74bc119700 1 -- 172.21.15.194:0/251112443 shutdown_connections 2024-04-13T10:50:41.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.578+0000 7f74bc119700 1 --2- 172.21.15.194:0/251112443 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f74a0038580 0x7f74a003aa30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:41.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.578+0000 7f74bc119700 1 --2- 172.21.15.194:0/251112443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74b4104510 0x7f74b4198d70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:41.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.578+0000 7f74bc119700 1 -- 172.21.15.194:0/251112443 >> 172.21.15.194:0/251112443 conn(0x7f74b4075780 msgr2=0x7f74b40fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:41.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.578+0000 7f74bc119700 1 -- 172.21.15.194:0/251112443 shutdown_connections 2024-04-13T10:50:41.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:41.578+0000 7f74bc119700 1 -- 172.21.15.194:0/251112443 wait complete. 2024-04-13T10:50:41.578 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:42.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:42.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:42.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:42.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:42.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:41 smithi134 ceph-mon[39696]: Deploying daemon node-exporter.smithi194 on smithi194 2024-04-13T10:50:42.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:41 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/251112443' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:43.238 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:43.238 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:43.483 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:50:44.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:44 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:44.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:44 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:50:46.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.698+0000 7f778a941700 1 -- 172.21.15.194:0/3735153105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7784100f30 msgr2=0x7f7784101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:46.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.698+0000 7f778a941700 1 --2- 172.21.15.194:0/3735153105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7784100f30 0x7f7784101300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7774009910 tx=0x7f7774009c20 comp rx=0 tx=0).stop 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.698+0000 7f778a941700 1 -- 172.21.15.194:0/3735153105 shutdown_connections 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.698+0000 7f778a941700 1 --2- 172.21.15.194:0/3735153105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7784100f30 0x7f7784101300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.698+0000 7f778a941700 1 -- 172.21.15.194:0/3735153105 >> 172.21.15.194:0/3735153105 conn(0x7f7784074af0 msgr2=0x7f7784074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.699+0000 7f778a941700 1 -- 172.21.15.194:0/3735153105 shutdown_connections 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.699+0000 7f778a941700 1 -- 172.21.15.194:0/3735153105 wait complete. 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.699+0000 7f778a941700 1 Processor -- start 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.699+0000 7f778a941700 1 -- start start 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.699+0000 7f778a941700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7784100f30 0x7f77840fed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.699+0000 7f778a941700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7784100ce0 con 0x7f7784100f30 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.700+0000 7f7783fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7784100f30 0x7f77840fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.700+0000 7f7783fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7784100f30 0x7f77840fed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:44156/0 (socket says 172.21.15.194:44156) 2024-04-13T10:50:46.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.700+0000 7f7783fff700 1 -- 172.21.15.194:0/2184471785 learned_addr learned my addr 172.21.15.194:0/2184471785 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:46.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.700+0000 7f7783fff700 1 -- 172.21.15.194:0/2184471785 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740095f0 con 0x7f7784100f30 2024-04-13T10:50:46.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.700+0000 7f7783fff700 1 --2- 172.21.15.194:0/2184471785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7784100f30 0x7f77840fed60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7774004f40 tx=0x7f7774005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:46.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.700+0000 7f77817fa700 1 -- 172.21.15.194:0/2184471785 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f777401d070 con 0x7f7784100f30 2024-04-13T10:50:46.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.700+0000 7f778a941700 1 -- 172.21.15.194:0/2184471785 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77840ff2a0 con 0x7f7784100f30 2024-04-13T10:50:46.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.700+0000 7f77817fa700 1 -- 172.21.15.194:0/2184471785 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f7774005dc0 con 0x7f7784100f30 2024-04-13T10:50:46.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.700+0000 7f77817fa700 1 -- 172.21.15.194:0/2184471785 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7774022d70 con 0x7f7784100f30 2024-04-13T10:50:46.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.700+0000 7f778a941700 1 -- 172.21.15.194:0/2184471785 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77840ff720 con 0x7f7784100f30 2024-04-13T10:50:46.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.701+0000 7f77817fa700 1 -- 172.21.15.194:0/2184471785 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 45199+0+0 (secure 0 0 0) 0x7f777400b960 con 0x7f7784100f30 2024-04-13T10:50:46.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.701+0000 7f778a941700 1 -- 172.21.15.194:0/2184471785 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7784107610 con 0x7f7784100f30 2024-04-13T10:50:46.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.701+0000 7f77817fa700 1 --2- 172.21.15.194:0/2184471785 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f776c038580 0x7f776c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:46.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.701+0000 7f77817fa700 1 -- 172.21.15.194:0/2184471785 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f777404c4e0 con 0x7f7784100f30 2024-04-13T10:50:46.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.702+0000 7f77837fe700 1 --2- 172.21.15.194:0/2184471785 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f776c038580 0x7f776c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:46.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.702+0000 7f77837fe700 1 --2- 172.21.15.194:0/2184471785 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f776c038580 0x7f776c03aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7778006fd0 tx=0x7f7778006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:46.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.706+0000 7f77817fa700 1 -- 172.21.15.194:0/2184471785 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7774022600 con 0x7f7784100f30 2024-04-13T10:50:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.994+0000 7f778a941700 1 -- 172.21.15.194:0/2184471785 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f77840ff960 con 0x7f7784100f30 2024-04-13T10:50:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.994+0000 7f77817fa700 1 -- 172.21.15.194:0/2184471785 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f7774027020 con 0x7f7784100f30 2024-04-13T10:50:46.994 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:46.994 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:46.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.996+0000 7f778a941700 1 -- 172.21.15.194:0/2184471785 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f776c038580 msgr2=0x7f776c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:46.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.996+0000 7f778a941700 1 --2- 172.21.15.194:0/2184471785 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f776c038580 0x7f776c03aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7778006fd0 tx=0x7f7778006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:46.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.996+0000 7f778a941700 1 -- 172.21.15.194:0/2184471785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7784100f30 msgr2=0x7f77840fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:46.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.996+0000 7f778a941700 1 --2- 172.21.15.194:0/2184471785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7784100f30 0x7f77840fed60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7774004f40 tx=0x7f7774005020 comp rx=0 tx=0).stop 2024-04-13T10:50:46.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.997+0000 7f778a941700 1 -- 172.21.15.194:0/2184471785 shutdown_connections 2024-04-13T10:50:46.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.997+0000 7f778a941700 1 --2- 172.21.15.194:0/2184471785 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f776c038580 0x7f776c03aa30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:46.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.997+0000 7f778a941700 1 --2- 172.21.15.194:0/2184471785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7784100f30 0x7f77840fed60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:46.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.997+0000 7f778a941700 1 -- 172.21.15.194:0/2184471785 >> 172.21.15.194:0/2184471785 conn(0x7f7784074af0 msgr2=0x7f7784104750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:46.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.997+0000 7f778a941700 1 -- 172.21.15.194:0/2184471785 shutdown_connections 2024-04-13T10:50:46.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:46.997+0000 7f778a941700 1 -- 172.21.15.194:0/2184471785 wait complete. 2024-04-13T10:50:46.998 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:48.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:48.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.tcpynt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:50:48.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.tcpynt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-13T10:50:48.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T10:50:48.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:50:48.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:47 smithi134 ceph-mon[39696]: Deploying daemon mgr.smithi194.tcpynt on smithi194 2024-04-13T10:50:48.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:47 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/2184471785' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:48.655 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:48.655 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:49.113 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:50:49.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:49 smithi134 ceph-mon[39696]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:49.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:49 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:51.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.249+0000 7f3d721dd700 1 -- 172.21.15.194:0/1777827341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d6c0ffda0 msgr2=0x7f3d6c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:51.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.249+0000 7f3d721dd700 1 --2- 172.21.15.194:0/1777827341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d6c0ffda0 0x7f3d6c100170 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009910 tx=0x7f3d5c009c20 comp rx=0 tx=0).stop 2024-04-13T10:50:51.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.249+0000 7f3d721dd700 1 -- 172.21.15.194:0/1777827341 shutdown_connections 2024-04-13T10:50:51.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.249+0000 7f3d721dd700 1 --2- 172.21.15.194:0/1777827341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d6c0ffda0 0x7f3d6c100170 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:51.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.249+0000 7f3d721dd700 1 -- 172.21.15.194:0/1777827341 >> 172.21.15.194:0/1777827341 conn(0x7f3d6c075780 msgr2=0x7f3d6c075b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:51.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.249+0000 7f3d721dd700 1 -- 172.21.15.194:0/1777827341 shutdown_connections 2024-04-13T10:50:51.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.249+0000 7f3d721dd700 1 -- 172.21.15.194:0/1777827341 wait complete. 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.250+0000 7f3d721dd700 1 Processor -- start 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.250+0000 7f3d721dd700 1 -- start start 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.251+0000 7f3d721dd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d6c0ffda0 0x7f3d6c196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.251+0000 7f3d721dd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c196650 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.251+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d6c0ffda0 0x7f3d6c196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.251+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d6c0ffda0 0x7f3d6c196110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.194:44180/0 (socket says 172.21.15.194:44180) 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.251+0000 7f3d6b7fe700 1 -- 172.21.15.194:0/483118755 learned_addr learned my addr 172.21.15.194:0/483118755 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.251+0000 7f3d6b7fe700 1 -- 172.21.15.194:0/483118755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0095f0 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.252+0000 7f3d6b7fe700 1 --2- 172.21.15.194:0/483118755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d6c0ffda0 0x7f3d6c196110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c006010 tx=0x7f3d5c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.252+0000 7f3d68ff9700 1 -- 172.21.15.194:0/483118755 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d5c01d070 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.252+0000 7f3d68ff9700 1 -- 172.21.15.194:0/483118755 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f3d5c005dc0 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.252+0000 7f3d721dd700 1 -- 172.21.15.194:0/483118755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c196850 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.252+0000 7f3d68ff9700 1 -- 172.21.15.194:0/483118755 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d5c022d80 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.252+0000 7f3d721dd700 1 -- 172.21.15.194:0/483118755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c196c70 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.253+0000 7f3d68ff9700 1 -- 172.21.15.194:0/483118755 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 45199+0+0 (secure 0 0 0) 0x7f3d5c00f460 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.253+0000 7f3d721dd700 1 -- 172.21.15.194:0/483118755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c104300 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.253+0000 7f3d68ff9700 1 --2- 172.21.15.194:0/483118755 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3d54038620 0x7f3d5403aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:50:51.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.253+0000 7f3d68ff9700 1 -- 172.21.15.194:0/483118755 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f3d5c04d5b0 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.254+0000 7f3d6affd700 1 --2- 172.21.15.194:0/483118755 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3d54038620 0x7f3d5403aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:50:51.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.254+0000 7f3d6affd700 1 --2- 172.21.15.194:0/483118755 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3d54038620 0x7f3d5403aad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d60006fd0 tx=0x7f3d60006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:50:51.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.258+0000 7f3d68ff9700 1 -- 172.21.15.194:0/483118755 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3d5c020dd0 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.555+0000 7f3d721dd700 1 -- 172.21.15.194:0/483118755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3d6c0ff020 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.555+0000 7f3d68ff9700 1 -- 172.21.15.194:0/483118755 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f3d5c027030 con 0x7f3d6c0ffda0 2024-04-13T10:50:51.556 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:50:51.556 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:47:57.347988Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-13T10:50:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.557+0000 7f3d721dd700 1 -- 172.21.15.194:0/483118755 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3d54038620 msgr2=0x7f3d5403aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.557+0000 7f3d721dd700 1 --2- 172.21.15.194:0/483118755 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3d54038620 0x7f3d5403aad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d60006fd0 tx=0x7f3d60006e40 comp rx=0 tx=0).stop 2024-04-13T10:50:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.557+0000 7f3d721dd700 1 -- 172.21.15.194:0/483118755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d6c0ffda0 msgr2=0x7f3d6c196110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:50:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.557+0000 7f3d721dd700 1 --2- 172.21.15.194:0/483118755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d6c0ffda0 0x7f3d6c196110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c006010 tx=0x7f3d5c004ff0 comp rx=0 tx=0).stop 2024-04-13T10:50:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.558+0000 7f3d721dd700 1 -- 172.21.15.194:0/483118755 shutdown_connections 2024-04-13T10:50:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.558+0000 7f3d721dd700 1 --2- 172.21.15.194:0/483118755 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3d54038620 0x7f3d5403aad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.558+0000 7f3d721dd700 1 --2- 172.21.15.194:0/483118755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d6c0ffda0 0x7f3d6c196110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:50:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.558+0000 7f3d721dd700 1 -- 172.21.15.194:0/483118755 >> 172.21.15.194:0/483118755 conn(0x7f3d6c075780 msgr2=0x7f3d6c0fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:50:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.558+0000 7f3d721dd700 1 -- 172.21.15.194:0/483118755 shutdown_connections 2024-04-13T10:50:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:50:51.558+0000 7f3d721dd700 1 -- 172.21.15.194:0/483118755 wait complete. 2024-04-13T10:50:51.560 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-04-13T10:50:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:51 smithi134 ceph-mon[39696]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-13T10:50:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:50:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:51 smithi134 ceph-mon[39696]: Deploying daemon mon.smithi194 on smithi194 2024-04-13T10:50:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:51 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/483118755' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:50:53.156 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-13T10:50:53.156 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mon dump -f json 2024-04-13T10:50:54.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:53 smithi134 ceph-mon[39696]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:50:54.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:50:53 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:50:54.398 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi194/config 2024-04-13T10:50:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:50:55 smithi194 ceph-mon[46737]: expand_channel_meta expanded map: {default=debug} 2024-04-13T10:50:56.241 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:50:56 smithi194 bash[46674]: 2b211bf255cfbb2fb20d0c58672515fc92e6128c6cd444ca81ab729bc5a4bf1b 2024-04-13T10:50:56.241 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:50:56 smithi194 systemd[1]: Started Ceph mon.smithi194 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T10:51:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: mon.smithi134 calling monitor election 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/2801303479' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/crt"}]: dispatch 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: mon.smithi194 calling monitor election 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:51:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: mon.smithi134 is new leader, mons smithi134,smithi194 in quorum (ranks 0,1) 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: fsmap 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: osdmap e5: 0 total, 0 up, 0 in 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: mgrmap e17: smithi134.tmanda(active, since 32s) 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: Standby manager daemon smithi194.tcpynt started 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/2801303479' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: overall HEALTH_OK 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/2801303479' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/key"}]: dispatch 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/2801303479' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T10:51:00.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:00.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:00.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:00.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:51:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: mon.smithi134 calling monitor election 2024-04-13T10:51:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/2801303479' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/crt"}]: dispatch 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: mon.smithi194 calling monitor election 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: mon.smithi134 is new leader, mons smithi134,smithi194 in quorum (ranks 0,1) 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: fsmap 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: osdmap e5: 0 total, 0 up, 0 in 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: mgrmap e17: smithi134.tmanda(active, since 32s) 2024-04-13T10:51:00.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: Standby manager daemon smithi194.tcpynt started 2024-04-13T10:51:00.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/2801303479' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T10:51:00.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: overall HEALTH_OK 2024-04-13T10:51:00.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/2801303479' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/key"}]: dispatch 2024-04-13T10:51:00.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:00.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/2801303479' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T10:51:00.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:00.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:00.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:00.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:00.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.936+0000 7fecc696a700 1 -- 172.21.15.194:0/669574987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feca80035c0 msgr2=0x7feca8005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:00.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.936+0000 7fecc696a700 1 --2- 172.21.15.194:0/669574987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feca80035c0 0x7feca8005a40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fecc00684d0 tx=0x7fecb000fe60 comp rx=0 tx=0).stop 2024-04-13T10:51:00.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.936+0000 7fecc696a700 1 -- 172.21.15.194:0/669574987 shutdown_connections 2024-04-13T10:51:00.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.936+0000 7fecc696a700 1 --2- 172.21.15.194:0/669574987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feca80035c0 0x7feca8005a40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:00.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.936+0000 7fecc696a700 1 -- 172.21.15.194:0/669574987 >> 172.21.15.194:0/669574987 conn(0x7fecc0074c10 msgr2=0x7fecc0075010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:51:00.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.936+0000 7fecc696a700 1 -- 172.21.15.194:0/669574987 shutdown_connections 2024-04-13T10:51:00.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.936+0000 7fecc696a700 1 -- 172.21.15.194:0/669574987 wait complete. 2024-04-13T10:51:00.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.938+0000 7fecc696a700 1 Processor -- start 2024-04-13T10:51:00.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.938+0000 7fecc696a700 1 -- start start 2024-04-13T10:51:00.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.938+0000 7fecc696a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca80035c0 0x7fecc0197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:00.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.938+0000 7fecc696a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0197bc0 0x7fecc019af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:00.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.938+0000 7fecc696a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc01981d0 con 0x7fecc0197bc0 2024-04-13T10:51:00.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.938+0000 7fecc696a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc0198310 con 0x7feca80035c0 2024-04-13T10:51:00.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.938+0000 7fecbffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca80035c0 0x7fecc0197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.938+0000 7fecbffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca80035c0 0x7fecc0197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42000/0 (socket says 172.21.15.194:42000) 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.938+0000 7fecbffff700 1 -- 172.21.15.194:0/4263661905 learned_addr learned my addr 172.21.15.194:0/4263661905 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbffff700 1 -- 172.21.15.194:0/4263661905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca80035c0 msgr2=0x7fecc0197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbffff700 1 -- 172.21.15.194:0/4263661905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca80035c0 msgr2=0x7fecc0197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbffff700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca80035c0 0x7fecc0197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbf7fe700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0197bc0 0x7fecc019af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbffff700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca80035c0 0x7fecc0197680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbf7fe700 1 -- 172.21.15.194:0/4263661905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca80035c0 msgr2=0x7fecc0197680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbf7fe700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca80035c0 0x7fecc0197680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbf7fe700 1 -- 172.21.15.194:0/4263661905 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb000f8b0 con 0x7fecc0197bc0 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbf7fe700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0197bc0 0x7fecc019af80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fecb400b4d0 tx=0x7fecb400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbd7fa700 1 -- 172.21.15.194:0/4263661905 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecb4011800 con 0x7fecc0197bc0 2024-04-13T10:51:00.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbd7fa700 1 -- 172.21.15.194:0/4263661905 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fecb4011df0 con 0x7fecc0197bc0 2024-04-13T10:51:00.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecbd7fa700 1 -- 172.21.15.194:0/4263661905 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecb400f2e0 con 0x7fecc0197bc0 2024-04-13T10:51:00.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecc696a700 1 -- 172.21.15.194:0/4263661905 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc019b580 con 0x7fecc0197bc0 2024-04-13T10:51:00.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.939+0000 7fecc696a700 1 -- 172.21.15.194:0/4263661905 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc019bad0 con 0x7fecc0197bc0 2024-04-13T10:51:00.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.940+0000 7fecc696a700 1 -- 172.21.15.194:0/4263661905 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc0062380 con 0x7fecc0197bc0 2024-04-13T10:51:00.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.941+0000 7fecbd7fa700 1 -- 172.21.15.194:0/4263661905 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7fecb4010380 con 0x7fecc0197bc0 2024-04-13T10:51:00.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.941+0000 7fecbd7fa700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fecac06c750 0x7fecac06ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:00.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.941+0000 7fecbd7fa700 1 -- 172.21.15.194:0/4263661905 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fecb408a2a0 con 0x7fecc0197bc0 2024-04-13T10:51:00.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.941+0000 7fecbffff700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fecac06c750 0x7fecac06ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:51:00.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.942+0000 7fecbffff700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fecac06c750 0x7fecac06ec00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fecb000f880 tx=0x7fecb0001e70 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:51:00.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:00.946+0000 7fecbd7fa700 1 -- 172.21.15.194:0/4263661905 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fecb4055a60 con 0x7fecc0197bc0 2024-04-13T10:51:01.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.219+0000 7fecc696a700 1 -- 172.21.15.194:0/4263661905 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fecc019bd50 con 0x7fecc0197bc0 2024-04-13T10:51:01.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.220+0000 7fecbd7fa700 1 -- 172.21.15.194:0/4263661905 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1026 (secure 0 0 0) 0x7fecb4015420 con 0x7fecc0197bc0 2024-04-13T10:51:01.220 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-04-13T10:51:01.221 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","modified":"2024-04-13T10:50:55.335403Z","created":"2024-04-13T10:47:57.347988Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi194","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 -- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fecac06c750 msgr2=0x7fecac06ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fecac06c750 0x7fecac06ec00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fecb000f880 tx=0x7fecb0001e70 comp rx=0 tx=0).stop 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 -- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0197bc0 msgr2=0x7fecc019af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0197bc0 0x7fecc019af80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fecb400b4d0 tx=0x7fecb400b890 comp rx=0 tx=0).stop 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 -- 172.21.15.194:0/4263661905 shutdown_connections 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fecac06c750 0x7fecac06ec00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca80035c0 0x7fecc0197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 --2- 172.21.15.194:0/4263661905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc0197bc0 0x7fecc019af80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 -- 172.21.15.194:0/4263661905 >> 172.21.15.194:0/4263661905 conn(0x7fecc0074c10 msgr2=0x7fecc0190600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 -- 172.21.15.194:0/4263661905 shutdown_connections 2024-04-13T10:51:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:51:01.222+0000 7fecc696a700 1 -- 172.21.15.194:0/4263661905 wait complete. 2024-04-13T10:51:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2024-04-13T10:51:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:01 smithi194 ceph-mon[46737]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:01 smithi194 ceph-mon[46737]: mgrmap e18: smithi134.tmanda(active, since 32s), standbys: smithi194.tcpynt 2024-04-13T10:51:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:01 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr metadata", "who": "smithi194.tcpynt", "id": "smithi194.tcpynt"}]: dispatch 2024-04-13T10:51:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:01 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:51:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:01 smithi194 ceph-mon[46737]: from='client.? 172.21.15.194:0/4263661905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:51:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:01 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:01.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:01 smithi134 ceph-mon[39696]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:01.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:01 smithi134 ceph-mon[39696]: mgrmap e18: smithi134.tmanda(active, since 32s), standbys: smithi194.tcpynt 2024-04-13T10:51:01.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:01 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr metadata", "who": "smithi194.tcpynt", "id": "smithi194.tcpynt"}]: dispatch 2024-04-13T10:51:01.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:01 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:51:01.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:01 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/4263661905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-13T10:51:01.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:01 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:51:02.175 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-13T10:51:02.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph config generate-minimal-conf 2024-04-13T10:51:02.409 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:51:03.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:03 smithi134 ceph-mon[39696]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:03.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:03 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:03.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:03 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:03.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:03 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:03.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:03 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:51:03.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:03 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:03 smithi194 ceph-mon[46737]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:03 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:03 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:03 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:03 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:51:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:03 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.411+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/124953335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b580fec90 msgr2=0x7f4b580ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:04.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.411+0000 7f4b5c9ba700 1 --2- 172.21.15.134:0/124953335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b580fec90 0x7f4b580ff060 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009910 tx=0x7f4b48009c20 comp rx=0 tx=0).stop 2024-04-13T10:51:04.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.412+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/124953335 shutdown_connections 2024-04-13T10:51:04.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.412+0000 7f4b5c9ba700 1 --2- 172.21.15.134:0/124953335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b580fec90 0x7f4b580ff060 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.412+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/124953335 >> 172.21.15.134:0/124953335 conn(0x7f4b58075780 msgr2=0x7f4b58075b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.412+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/124953335 shutdown_connections 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.412+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/124953335 wait complete. 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.412+0000 7f4b5c9ba700 1 Processor -- start 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.412+0000 7f4b5c9ba700 1 -- start start 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b5c9ba700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b580fec90 0x7f4b58195330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b5c9ba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b58195870 0x7f4b58199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b5c9ba700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58195e80 con 0x7f4b58195870 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b5c9ba700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58195ff0 con 0x7f4b580fec90 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b55d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b58195870 0x7f4b58199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b55d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b58195870 0x7f4b58199ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49330/0 (socket says 172.21.15.134:49330) 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b55d9b700 1 -- 172.21.15.134:0/850329877 learned_addr learned my addr 172.21.15.134:0/850329877 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:51:04.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b55d9b700 1 -- 172.21.15.134:0/850329877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b580fec90 msgr2=0x7f4b58195330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b55d9b700 1 --2- 172.21.15.134:0/850329877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b580fec90 0x7f4b58195330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b55d9b700 1 -- 172.21.15.134:0/850329877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480095f0 con 0x7f4b58195870 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b55d9b700 1 --2- 172.21.15.134:0/850329877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b58195870 0x7f4b58199ce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00b730 tx=0x7f4b4c00baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b477fe700 1 -- 172.21.15.134:0/850329877 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b4c004200 con 0x7f4b58195870 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/850329877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5819a2e0 con 0x7f4b58195870 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b477fe700 1 -- 172.21.15.134:0/850329877 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f4b4c004360 con 0x7f4b58195870 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b477fe700 1 -- 172.21.15.134:0/850329877 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b4c011b90 con 0x7f4b58195870 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.413+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/850329877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5819a8b0 con 0x7f4b58195870 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.414+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/850329877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b58107510 con 0x7f4b58195870 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.415+0000 7f4b477fe700 1 -- 172.21.15.134:0/850329877 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f4b4c0036a0 con 0x7f4b58195870 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.415+0000 7f4b477fe700 1 --2- 172.21.15.134:0/850329877 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4b4006c760 0x7f4b4006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.415+0000 7f4b5659c700 1 --2- 172.21.15.134:0/850329877 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4b4006c760 0x7f4b4006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.415+0000 7f4b477fe700 1 -- 172.21.15.134:0/850329877 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4b4c08a380 con 0x7f4b58195870 2024-04-13T10:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.415+0000 7f4b5659c700 1 --2- 172.21.15.134:0/850329877 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4b4006c760 0x7f4b4006ec10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4b48006010 tx=0x7f4b4800b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:51:04.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.419+0000 7f4b477fe700 1 -- 172.21.15.134:0/850329877 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4b4c055b40 con 0x7f4b58195870 2024-04-13T10:51:04.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.612+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/850329877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4b58196730 con 0x7f4b58195870 2024-04-13T10:51:04.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.613+0000 7f4b477fe700 1 -- 172.21.15.134:0/850329877 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f4b4c089b40 con 0x7f4b58195870 2024-04-13T10:51:04.614 INFO:teuthology.orchestra.run.smithi134.stdout:# minimal ceph.conf for 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:51:04.614 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-04-13T10:51:04.614 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T10:51:04.614 INFO:teuthology.orchestra.run.smithi134.stdout: mon_host = [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-04-13T10:51:04.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/850329877 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4b4006c760 msgr2=0x7f4b4006ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:04.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 --2- 172.21.15.134:0/850329877 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4b4006c760 0x7f4b4006ec10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4b48006010 tx=0x7f4b4800b540 comp rx=0 tx=0).stop 2024-04-13T10:51:04.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/850329877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b58195870 msgr2=0x7f4b58199ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:04.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 --2- 172.21.15.134:0/850329877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b58195870 0x7f4b58199ce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00b730 tx=0x7f4b4c00baf0 comp rx=0 tx=0).stop 2024-04-13T10:51:04.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/850329877 shutdown_connections 2024-04-13T10:51:04.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 --2- 172.21.15.134:0/850329877 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4b4006c760 0x7f4b4006ec10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:04.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 --2- 172.21.15.134:0/850329877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b580fec90 0x7f4b58195330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:04.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 --2- 172.21.15.134:0/850329877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b58195870 0x7f4b58199ce0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:04.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/850329877 >> 172.21.15.134:0/850329877 conn(0x7f4b58075780 msgr2=0x7f4b58104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:51:04.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/850329877 shutdown_connections 2024-04-13T10:51:04.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:04.615+0000 7f4b5c9ba700 1 -- 172.21.15.134:0/850329877 wait complete. 2024-04-13T10:51:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: Updating smithi134:/etc/ceph/ceph.conf 2024-04-13T10:51:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: Updating smithi194:/etc/ceph/ceph.conf 2024-04-13T10:51:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:51:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:51:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: Reconfiguring mon.smithi134 (unknown last config time)... 2024-04-13T10:51:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-13T10:51:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-13T10:51:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: Reconfiguring daemon mon.smithi134 on smithi134 2024-04-13T10:51:04.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:04 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/850329877' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: Updating smithi134:/etc/ceph/ceph.conf 2024-04-13T10:51:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: Updating smithi194:/etc/ceph/ceph.conf 2024-04-13T10:51:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:51:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:51:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: Reconfiguring mon.smithi134 (unknown last config time)... 2024-04-13T10:51:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-13T10:51:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-13T10:51:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: Reconfiguring daemon mon.smithi134 on smithi134 2024-04-13T10:51:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:04 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/850329877' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:05 smithi134 ceph-mon[39696]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:05.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:05 smithi194 ceph-mon[46737]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:06.301 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-13T10:51:06.301 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:51:06.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-04-13T10:51:06.331 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:51:06.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:51:06.400 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:51:06.400 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.conf 2024-04-13T10:51:06.437 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:51:06.438 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:51:06.508 INFO:tasks.cephadm:Deploying OSDs... 2024-04-13T10:51:06.509 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:51:06.509 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-04-13T10:51:06.527 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-13T10:51:06.527 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-04-13T10:51:06.585 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-13T10:51:06.585 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T10:51:06.586 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 169153 Links: 1 2024-04-13T10:51:06.586 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T10:51:06.586 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T10:51:06.586 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-13 10:50:19.964242988 +0000 2024-04-13T10:51:06.586 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-13 10:43:38.421082309 +0000 2024-04-13T10:51:06.586 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-13 10:43:38.421082309 +0000 2024-04-13T10:51:06.586 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-13T10:51:06.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-13T10:51:06.651 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-13T10:51:06.651 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-13T10:51:06.651 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000198637 s, 2.6 MB/s 2024-04-13T10:51:06.652 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-13T10:51:06.712 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-04-13T10:51:06.771 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-13T10:51:06.771 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T10:51:06.771 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 170146 Links: 1 2024-04-13T10:51:06.771 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T10:51:06.772 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T10:51:06.772 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-13 10:50:19.965242965 +0000 2024-04-13T10:51:06.772 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-13 10:43:38.776074258 +0000 2024-04-13T10:51:06.772 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-13 10:43:38.776074258 +0000 2024-04-13T10:51:06.772 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-13T10:51:06.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-13T10:51:06.839 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-13T10:51:06.839 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-13T10:51:06.839 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000215011 s, 2.4 MB/s 2024-04-13T10:51:06.839 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-13T10:51:06.898 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-04-13T10:51:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:06 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:06 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:06 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.tmanda", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:51:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:06 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T10:51:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:06 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-13T10:51:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T10:51:06.952 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 167513 Links: 1 2024-04-13T10:51:06.952 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T10:51:06.952 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T10:51:06.952 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-13 10:50:19.965242965 +0000 2024-04-13T10:51:06.952 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-13 10:43:39.123066388 +0000 2024-04-13T10:51:06.952 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-13 10:43:39.123066388 +0000 2024-04-13T10:51:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-13T10:51:06.952 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-13T10:51:07.018 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-13T10:51:07.018 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-13T10:51:07.018 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000164958 s, 3.1 MB/s 2024-04-13T10:51:07.019 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-13T10:51:07.078 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-04-13T10:51:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-13T10:51:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T10:51:07.136 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 167592 Links: 1 2024-04-13T10:51:07.136 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T10:51:07.136 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T10:51:07.137 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-13 10:50:19.965242965 +0000 2024-04-13T10:51:07.137 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-13 10:43:39.471058495 +0000 2024-04-13T10:51:07.137 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-13 10:43:39.471058495 +0000 2024-04-13T10:51:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-13T10:51:07.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-13T10:51:07.202 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-13T10:51:07.203 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-13T10:51:07.203 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000227816 s, 2.2 MB/s 2024-04-13T10:51:07.203 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-13T10:51:07.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:06 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:07.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:06 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:07.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:06 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.tmanda", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:51:07.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:06 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T10:51:07.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:06 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:07.262 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:51:07.262 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-04-13T10:51:07.284 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-13T10:51:07.285 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-04-13T10:51:07.347 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-13T10:51:07.347 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T10:51:07.347 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 162646 Links: 1 2024-04-13T10:51:07.347 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T10:51:07.347 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T10:51:07.347 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-13 10:50:54.608874174 +0000 2024-04-13T10:51:07.347 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-13 10:43:30.261389578 +0000 2024-04-13T10:51:07.347 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-13 10:43:30.261389578 +0000 2024-04-13T10:51:07.347 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-04-13T10:51:07.348 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-13T10:51:07.419 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-13T10:51:07.419 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-13T10:51:07.419 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000346976 s, 1.5 MB/s 2024-04-13T10:51:07.420 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-13T10:51:07.483 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-04-13T10:51:07.544 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-13T10:51:07.545 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T10:51:07.545 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 168491 Links: 1 2024-04-13T10:51:07.545 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T10:51:07.545 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T10:51:07.545 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-13 10:50:54.608874174 +0000 2024-04-13T10:51:07.545 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-13 10:43:30.593382870 +0000 2024-04-13T10:51:07.545 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-13 10:43:30.593382870 +0000 2024-04-13T10:51:07.545 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-04-13T10:51:07.545 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-13T10:51:07.613 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-13T10:51:07.613 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-13T10:51:07.613 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000319885 s, 1.6 MB/s 2024-04-13T10:51:07.615 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-13T10:51:07.675 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-04-13T10:51:07.733 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-13T10:51:07.733 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T10:51:07.733 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 168555 Links: 1 2024-04-13T10:51:07.734 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T10:51:07.734 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T10:51:07.734 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-13 10:50:54.608874174 +0000 2024-04-13T10:51:07.734 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-13 10:43:30.943375799 +0000 2024-04-13T10:51:07.734 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-13 10:43:30.943375799 +0000 2024-04-13T10:51:07.734 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-04-13T10:51:07.734 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-13T10:51:07.801 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-13T10:51:07.801 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-13T10:51:07.801 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.00018703 s, 2.7 MB/s 2024-04-13T10:51:07.802 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-13T10:51:07.863 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-04-13T10:51:07.922 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-13T10:51:07.923 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T10:51:07.923 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 168596 Links: 1 2024-04-13T10:51:07.923 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T10:51:07.923 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T10:51:07.923 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-04-13 10:50:54.608874174 +0000 2024-04-13T10:51:07.924 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-13 10:43:31.266369273 +0000 2024-04-13T10:51:07.924 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-13 10:43:31.266369273 +0000 2024-04-13T10:51:07.924 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-04-13T10:51:07.924 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-13T10:51:07.989 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-04-13T10:51:07.989 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-04-13T10:51:07.990 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000218581 s, 2.3 MB/s 2024-04-13T10:51:07.991 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-13T10:51:08.050 INFO:tasks.cephadm:Deploying osd.0 on smithi134 with /dev/vg_nvme/lv_4... 2024-04-13T10:51:08.050 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-13T10:51:08.077 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:07 smithi134 ceph-mon[39696]: Reconfiguring mgr.smithi134.tmanda (unknown last config time)... 2024-04-13T10:51:08.077 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:07 smithi134 ceph-mon[39696]: Reconfiguring daemon mgr.smithi134.tmanda on smithi134 2024-04-13T10:51:08.077 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:07 smithi134 ceph-mon[39696]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:07 smithi194 ceph-mon[46737]: Reconfiguring mgr.smithi134.tmanda (unknown last config time)... 2024-04-13T10:51:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:07 smithi194 ceph-mon[46737]: Reconfiguring daemon mgr.smithi134.tmanda on smithi134 2024-04-13T10:51:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:07 smithi194 ceph-mon[46737]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:08.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:08 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:08.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:08 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:08.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:08 smithi134 ceph-mon[39696]: Reconfiguring ceph-exporter.smithi134 (monmap changed)... 2024-04-13T10:51:08.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:08 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-13T10:51:08.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:08 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:08 smithi134 ceph-mon[39696]: Reconfiguring daemon ceph-exporter.smithi134 on smithi134 2024-04-13T10:51:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:08 smithi134 ceph-mon[39696]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:08.935 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:51:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:08 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:08 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:08 smithi194 ceph-mon[46737]: Reconfiguring ceph-exporter.smithi134 (monmap changed)... 2024-04-13T10:51:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:08 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-13T10:51:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:08 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:09.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:08 smithi194 ceph-mon[46737]: Reconfiguring daemon ceph-exporter.smithi134 on smithi134 2024-04-13T10:51:09.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:08 smithi194 ceph-mon[46737]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:10 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:10 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:10 smithi194 ceph-mon[46737]: Reconfiguring crash.smithi134 (monmap changed)... 2024-04-13T10:51:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:10 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-13T10:51:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:10 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:10 smithi194 ceph-mon[46737]: Reconfiguring daemon crash.smithi134 on smithi134 2024-04-13T10:51:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:10 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:10 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:10 smithi134 ceph-mon[39696]: Reconfiguring crash.smithi134 (monmap changed)... 2024-04-13T10:51:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:10 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-13T10:51:11.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:10 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:11.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:10 smithi134 ceph-mon[39696]: Reconfiguring daemon crash.smithi134 on smithi134 2024-04-13T10:51:12.002 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-13T10:51:12.002 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-13T10:51:12.002 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-04-13T10:51:12.002 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-04-13T10:51:12.003 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127048 s, 825 MB/s 2024-04-13T10:51:12.003 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-04-13T10:51:12.040 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:11 smithi134 ceph-mon[39696]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:12.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:11 smithi194 ceph-mon[46737]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:12.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-04-13T10:51:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:13 smithi134 ceph-mon[39696]: Reconfiguring alertmanager.smithi134 (dependencies changed)... 2024-04-13T10:51:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:13 smithi134 ceph-mon[39696]: Reconfiguring daemon alertmanager.smithi134 on smithi134 2024-04-13T10:51:13.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:13 smithi134 ceph-mon[39696]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:13 smithi194 ceph-mon[46737]: Reconfiguring alertmanager.smithi134 (dependencies changed)... 2024-04-13T10:51:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:13 smithi194 ceph-mon[46737]: Reconfiguring daemon alertmanager.smithi134 on smithi134 2024-04-13T10:51:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:13 smithi194 ceph-mon[46737]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:13.794 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:51:14.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:14 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:51:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:14 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:51:15.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:15 smithi134 ceph-mon[39696]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:15 smithi194 ceph-mon[46737]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:17.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.379+0000 7f72f388c700 1 -- 172.21.15.134:0/928070531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ec100280 msgr2=0x7f72ec1006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:17.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.379+0000 7f72f388c700 1 --2- 172.21.15.134:0/928070531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ec100280 0x7f72ec1006d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009910 tx=0x7f72e8009c20 comp rx=0 tx=0).stop 2024-04-13T10:51:17.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.379+0000 7f72f388c700 1 -- 172.21.15.134:0/928070531 shutdown_connections 2024-04-13T10:51:17.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.379+0000 7f72f388c700 1 --2- 172.21.15.134:0/928070531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ec100280 0x7f72ec1006d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:17.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.379+0000 7f72f388c700 1 --2- 172.21.15.134:0/928070531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72ec0ff080 0x7f72ec0ff490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:17.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.379+0000 7f72f388c700 1 -- 172.21.15.134:0/928070531 >> 172.21.15.134:0/928070531 conn(0x7f72ec0fa630 msgr2=0x7f72ec0fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:51:17.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.379+0000 7f72f388c700 1 -- 172.21.15.134:0/928070531 shutdown_connections 2024-04-13T10:51:17.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.379+0000 7f72f388c700 1 -- 172.21.15.134:0/928070531 wait complete. 2024-04-13T10:51:17.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f388c700 1 Processor -- start 2024-04-13T10:51:17.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f388c700 1 -- start start 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f388c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72ec0ff080 0x7f72ec1958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f388c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ec100280 0x7f72ec195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f388c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec196420 con 0x7f72ec100280 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f388c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec196560 con 0x7f72ec0ff080 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f0e27700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ec100280 0x7f72ec195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f0e27700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ec100280 0x7f72ec195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33928/0 (socket says 172.21.15.134:33928) 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f0e27700 1 -- 172.21.15.134:0/3147724912 learned_addr learned my addr 172.21.15.134:0/3147724912 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f1628700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72ec0ff080 0x7f72ec1958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f0e27700 1 -- 172.21.15.134:0/3147724912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72ec0ff080 msgr2=0x7f72ec1958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f0e27700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72ec0ff080 0x7f72ec1958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f0e27700 1 -- 172.21.15.134:0/3147724912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e80095f0 con 0x7f72ec100280 2024-04-13T10:51:17.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f1628700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72ec0ff080 0x7f72ec1958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.380+0000 7f72f0e27700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ec100280 0x7f72ec195e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72e800bd70 tx=0x7f72e800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.381+0000 7f72e27fc700 1 -- 172.21.15.134:0/3147724912 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e801d070 con 0x7f72ec100280 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.381+0000 7f72e27fc700 1 -- 172.21.15.134:0/3147724912 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f72e800f460 con 0x7f72ec100280 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.381+0000 7f72f388c700 1 -- 172.21.15.134:0/3147724912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec19afb0 con 0x7f72ec100280 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.381+0000 7f72e27fc700 1 -- 172.21.15.134:0/3147724912 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e8021640 con 0x7f72ec100280 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.381+0000 7f72f388c700 1 -- 172.21.15.134:0/3147724912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec19b4f0 con 0x7f72ec100280 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.382+0000 7f72f388c700 1 -- 172.21.15.134:0/3147724912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ec107a90 con 0x7f72ec100280 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.382+0000 7f72e27fc700 1 -- 172.21.15.134:0/3147724912 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f72e800f940 con 0x7f72ec100280 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.382+0000 7f72e27fc700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f72d806c600 0x7f72d806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.382+0000 7f72f1628700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f72d806c600 0x7f72d806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.382+0000 7f72e27fc700 1 -- 172.21.15.134:0/3147724912 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f72e808b9a0 con 0x7f72ec100280 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.383+0000 7f72f1628700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f72d806c600 0x7f72d806eab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72dc005950 tx=0x7f72dc0058e0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:51:17.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.387+0000 7f72e27fc700 1 -- 172.21.15.134:0/3147724912 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f72e805ac70 con 0x7f72ec100280 2024-04-13T10:51:17.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:17 smithi134 ceph-mon[39696]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:17.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:17.595+0000 7f72f388c700 1 -- 172.21.15.134:0/3147724912 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f72ec069400 con 0x7f72d806c600 2024-04-13T10:51:17.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:17 smithi194 ceph-mon[46737]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:18.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:18 smithi134 ceph-mon[39696]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:51:18.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:18 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:51:18.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:18 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:51:18.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:18 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:18 smithi194 ceph-mon[46737]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:51:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:18 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:51:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:18 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:51:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:18 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:19 smithi134 ceph-mon[39696]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:19 smithi194 ceph-mon[46737]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:21 smithi134 ceph-mon[39696]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:21 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:21.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:21 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:21.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:21 smithi134 ceph-mon[39696]: Reconfiguring grafana.smithi134 (dependencies changed)... 2024-04-13T10:51:21.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:21 smithi134 ceph-mon[39696]: Reconfiguring daemon grafana.smithi134 on smithi134 2024-04-13T10:51:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:21 smithi194 ceph-mon[46737]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:21 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:21 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:21 smithi194 ceph-mon[46737]: Reconfiguring grafana.smithi134 (dependencies changed)... 2024-04-13T10:51:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:21 smithi194 ceph-mon[46737]: Reconfiguring daemon grafana.smithi134 on smithi134 2024-04-13T10:51:22.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:22 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/578168544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02af0f03-a267-4906-8417-d15189c8da92"}]: dispatch 2024-04-13T10:51:22.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:22 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/578168544' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02af0f03-a267-4906-8417-d15189c8da92"}]': finished 2024-04-13T10:51:22.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:22 smithi134 ceph-mon[39696]: osdmap e6: 1 total, 0 up, 1 in 2024-04-13T10:51:22.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:22 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:51:22.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:22 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/901698632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:51:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:22 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/578168544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02af0f03-a267-4906-8417-d15189c8da92"}]: dispatch 2024-04-13T10:51:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:22 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/578168544' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02af0f03-a267-4906-8417-d15189c8da92"}]': finished 2024-04-13T10:51:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:22 smithi194 ceph-mon[46737]: osdmap e6: 1 total, 0 up, 1 in 2024-04-13T10:51:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:22 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:51:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:22 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/901698632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:51:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:23 smithi194 ceph-mon[46737]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:24.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:23 smithi134 ceph-mon[39696]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:25.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:25 smithi134 ceph-mon[39696]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:25 smithi194 ceph-mon[46737]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:27.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:27 smithi134 ceph-mon[39696]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:27 smithi194 ceph-mon[46737]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:29.500 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:29 smithi134 ceph-mon[39696]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:29.500 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:51:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:29 smithi194 ceph-mon[46737]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:29 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:51:31.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:31 smithi134 ceph-mon[39696]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:31 smithi194 ceph-mon[46737]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:32.807 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:32 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:32.807 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:32 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:32.807 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:32 smithi134 ceph-mon[39696]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-04-13T10:51:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:32 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:32 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:32 smithi194 ceph-mon[46737]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-04-13T10:51:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:33 smithi194 ceph-mon[46737]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-04-13T10:51:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:33 smithi194 ceph-mon[46737]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:33 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-13T10:51:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:33 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:34.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:33 smithi134 ceph-mon[39696]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-04-13T10:51:34.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:33 smithi134 ceph-mon[39696]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:34.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-13T10:51:34.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:33 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:34 smithi194 ceph-mon[46737]: Deploying daemon osd.0 on smithi134 2024-04-13T10:51:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:34 smithi134 ceph-mon[39696]: Deploying daemon osd.0 on smithi134 2024-04-13T10:51:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:35 smithi194 ceph-mon[46737]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:35 smithi134 ceph-mon[39696]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:37.545 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:37 smithi194 ceph-mon[46737]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:37.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:37 smithi134 ceph-mon[39696]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:38 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:38 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:38 smithi194 ceph-mon[46737]: Reconfiguring ceph-exporter.smithi194 (monmap changed)... 2024-04-13T10:51:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:38 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi194", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-13T10:51:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:38 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:38 smithi194 ceph-mon[46737]: Reconfiguring daemon ceph-exporter.smithi194 on smithi194 2024-04-13T10:51:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:38 smithi194 ceph-mon[46737]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:39.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:39.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:39.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:38 smithi134 ceph-mon[39696]: Reconfiguring ceph-exporter.smithi194 (monmap changed)... 2024-04-13T10:51:39.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi194", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-13T10:51:39.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:38 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:39.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:38 smithi134 ceph-mon[39696]: Reconfiguring daemon ceph-exporter.smithi194 on smithi194 2024-04-13T10:51:39.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:38 smithi134 ceph-mon[39696]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:40.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:40 smithi134 ceph-mon[39696]: Reconfiguring crash.smithi194 (monmap changed)... 2024-04-13T10:51:40.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-13T10:51:40.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:40.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:40 smithi134 ceph-mon[39696]: Reconfiguring daemon crash.smithi194 on smithi194 2024-04-13T10:51:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:40 smithi194 ceph-mon[46737]: Reconfiguring crash.smithi194 (monmap changed)... 2024-04-13T10:51:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-13T10:51:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:40.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:40 smithi194 ceph-mon[46737]: Reconfiguring daemon crash.smithi194 on smithi194 2024-04-13T10:51:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:41 smithi134 ceph-mon[39696]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:41.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:41.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.tcpynt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:51:41.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T10:51:41.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:41.833 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:41 smithi194 ceph-mon[46737]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:41.833 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:41 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:41.833 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:41 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:41.833 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:41 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.tcpynt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:51:41.834 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:41 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T10:51:41.834 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:41 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:42.671 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:42 smithi194 ceph-mon[46737]: Reconfiguring mgr.smithi194.tcpynt (monmap changed)... 2024-04-13T10:51:42.671 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:42 smithi194 ceph-mon[46737]: Reconfiguring daemon mgr.smithi194.tcpynt on smithi194 2024-04-13T10:51:42.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:42 smithi134 ceph-mon[39696]: Reconfiguring mgr.smithi194.tcpynt (monmap changed)... 2024-04-13T10:51:42.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:42 smithi134 ceph-mon[39696]: Reconfiguring daemon mgr.smithi194.tcpynt on smithi194 2024-04-13T10:51:43.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:43.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:43.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:43.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: Reconfiguring mon.smithi194 (monmap changed)... 2024-04-13T10:51:43.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-13T10:51:43.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-13T10:51:43.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:43.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: Reconfiguring daemon mon.smithi194 on smithi194 2024-04-13T10:51:43.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:43.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:43.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:51:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: Reconfiguring mon.smithi194 (monmap changed)... 2024-04-13T10:51:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-13T10:51:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-13T10:51:43.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:43.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: Reconfiguring daemon mon.smithi194 on smithi194 2024-04-13T10:51:43.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:43.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:43.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:51:45.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:45.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:45.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:45.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-04-13T10:51:45.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-04-13T10:51:45.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:45.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:51:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-13T10:51:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-13T10:51:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-04-13T10:51:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-04-13T10:51:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-13T10:51:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-13T10:51:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-04-13T10:51:45.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-04-13T10:51:45.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:45.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:51:45.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:51:45.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-04-13T10:51:45.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-04-13T10:51:45.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:45.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:51:46.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.875+0000 7f72e27fc700 1 -- 172.21.15.134:0/3147724912 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f72ec069400 con 0x7f72d806c600 2024-04-13T10:51:46.877 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 0 on host 'smithi134' 2024-04-13T10:51:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 -- 172.21.15.134:0/3147724912 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f72d806c600 msgr2=0x7f72d806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f72d806c600 0x7f72d806eab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f72dc005950 tx=0x7f72dc0058e0 comp rx=0 tx=0).stop 2024-04-13T10:51:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 -- 172.21.15.134:0/3147724912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ec100280 msgr2=0x7f72ec195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ec100280 0x7f72ec195e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72e800bd70 tx=0x7f72e800be50 comp rx=0 tx=0).stop 2024-04-13T10:51:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 -- 172.21.15.134:0/3147724912 shutdown_connections 2024-04-13T10:51:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f72d806c600 0x7f72d806eab0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:46.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72ec0ff080 0x7f72ec1958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 --2- 172.21.15.134:0/3147724912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ec100280 0x7f72ec195e00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 -- 172.21.15.134:0/3147724912 >> 172.21.15.134:0/3147724912 conn(0x7f72ec0fa630 msgr2=0x7f72ec068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:51:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 -- 172.21.15.134:0/3147724912 shutdown_connections 2024-04-13T10:51:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:46.879+0000 7f72f388c700 1 -- 172.21.15.134:0/3147724912 wait complete. 2024-04-13T10:51:47.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:47 smithi134 ceph-mon[39696]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:47.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:47.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:47.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:47.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:47.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:47 smithi134 ceph-mon[39696]: from='osd.0 [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-13T10:51:47.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:47 smithi134 ceph-mon[39696]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-13T10:51:47.572 DEBUG:teuthology.orchestra.run.smithi134:osd.0> sudo journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.0.service 2024-04-13T10:51:47.575 INFO:tasks.cephadm:Deploying osd.1 on smithi134 with /dev/vg_nvme/lv_3... 2024-04-13T10:51:47.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-13T10:51:47.606 INFO:journalctl@ceph.osd.0.smithi134.stdout:-- Logs begin at Sat 2024-04-13 10:37:50 UTC. -- 2024-04-13T10:51:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:47 smithi194 ceph-mon[46737]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:47 smithi194 ceph-mon[46737]: from='osd.0 [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-13T10:51:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:47 smithi194 ceph-mon[46737]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-13T10:51:48.360 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:51:48.934 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 10:51:48 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[57973]: 2024-04-13T10:51:48.842+0000 7f86d0894700 -1 osd.0 0 waiting for initial osdmap 2024-04-13T10:51:48.934 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 10:51:48 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[57973]: 2024-04-13T10:51:48.845+0000 7f86cc689700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T10:51:48.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:48 smithi134 ceph-mon[39696]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-13T10:51:48.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:48 smithi134 ceph-mon[39696]: osdmap e7: 1 total, 0 up, 1 in 2024-04-13T10:51:48.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:48 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:51:48.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:48 smithi134 ceph-mon[39696]: from='osd.0 [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T10:51:48.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:48 smithi134 ceph-mon[39696]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T10:51:48.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:48 smithi134 ceph-mon[39696]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:48 smithi194 ceph-mon[46737]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-13T10:51:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:48 smithi194 ceph-mon[46737]: osdmap e7: 1 total, 0 up, 1 in 2024-04-13T10:51:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:48 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:51:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:48 smithi194 ceph-mon[46737]: from='osd.0 [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T10:51:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:48 smithi194 ceph-mon[46737]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T10:51:49.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:48 smithi194 ceph-mon[46737]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:50.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:49 smithi134 ceph-mon[39696]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-04-13T10:51:50.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:49 smithi134 ceph-mon[39696]: osdmap e8: 1 total, 0 up, 1 in 2024-04-13T10:51:50.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:49 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:51:50.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:49 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:51:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:49 smithi194 ceph-mon[46737]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-04-13T10:51:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:49 smithi194 ceph-mon[46737]: osdmap e8: 1 total, 0 up, 1 in 2024-04-13T10:51:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:49 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:51:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:49 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:51:51.120 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-13T10:51:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-13T10:51:51.121 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-04-13T10:51:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-04-13T10:51:51.121 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110072 s, 953 MB/s 2024-04-13T10:51:51.121 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-04-13T10:51:51.159 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:50 smithi134 ceph-mon[39696]: purged_snaps scrub starts 2024-04-13T10:51:51.159 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:50 smithi134 ceph-mon[39696]: purged_snaps scrub ok 2024-04-13T10:51:51.159 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:50 smithi134 ceph-mon[39696]: osd.0 [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195] boot 2024-04-13T10:51:51.159 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:50 smithi134 ceph-mon[39696]: osdmap e9: 1 total, 1 up, 1 in 2024-04-13T10:51:51.160 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:50 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:51:51.160 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:50 smithi134 ceph-mon[39696]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:51.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:50 smithi194 ceph-mon[46737]: purged_snaps scrub starts 2024-04-13T10:51:51.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:50 smithi194 ceph-mon[46737]: purged_snaps scrub ok 2024-04-13T10:51:51.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:50 smithi194 ceph-mon[46737]: osd.0 [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195] boot 2024-04-13T10:51:51.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:50 smithi194 ceph-mon[46737]: osdmap e9: 1 total, 1 up, 1 in 2024-04-13T10:51:51.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:50 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:51:51.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:50 smithi194 ceph-mon[46737]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-13T10:51:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:51 smithi134 ceph-mon[39696]: osdmap e10: 1 total, 1 up, 1 in 2024-04-13T10:51:52.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-04-13T10:51:52.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:51 smithi194 ceph-mon[46737]: osdmap e10: 1 total, 1 up, 1 in 2024-04-13T10:51:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:51:53.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:52 smithi134 ceph-mon[39696]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:51:53.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:52 smithi194 ceph-mon[46737]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:51:54.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:54.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:54.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:55.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.986+0000 7f84aaea0700 1 -- 172.21.15.134:0/436329702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a4103560 msgr2=0x7f84a4105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.986+0000 7f84aaea0700 1 --2- 172.21.15.134:0/436329702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a4103560 0x7f84a4105940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8490009910 tx=0x7f8490009c20 comp rx=0 tx=0).stop 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.986+0000 7f84aaea0700 1 -- 172.21.15.134:0/436329702 shutdown_connections 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.986+0000 7f84aaea0700 1 --2- 172.21.15.134:0/436329702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a4103560 0x7f84a4105940 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.986+0000 7f84aaea0700 1 --2- 172.21.15.134:0/436329702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84a4100c40 0x7f84a4103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.986+0000 7f84aaea0700 1 -- 172.21.15.134:0/436329702 >> 172.21.15.134:0/436329702 conn(0x7f84a40fa5e0 msgr2=0x7f84a40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.986+0000 7f84aaea0700 1 -- 172.21.15.134:0/436329702 shutdown_connections 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.986+0000 7f84aaea0700 1 -- 172.21.15.134:0/436329702 wait complete. 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.987+0000 7f84aaea0700 1 Processor -- start 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.987+0000 7f84aaea0700 1 -- start start 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.987+0000 7f84aaea0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a4100c40 0x7f84a4195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.987+0000 7f84aaea0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84a4103560 0x7f84a4195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:55.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.987+0000 7f84aaea0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a41963d0 con 0x7f84a4100c40 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.987+0000 7f84aaea0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a4196510 con 0x7f84a4103560 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84a8c3c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a4100c40 0x7f84a4195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84a8c3c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a4100c40 0x7f84a4195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36522/0 (socket says 172.21.15.134:36522) 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84a8c3c700 1 -- 172.21.15.134:0/3236085235 learned_addr learned my addr 172.21.15.134:0/3236085235 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84a8c3c700 1 -- 172.21.15.134:0/3236085235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84a4103560 msgr2=0x7f84a4195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84a8c3c700 1 --2- 172.21.15.134:0/3236085235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84a4103560 0x7f84a4195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84a8c3c700 1 -- 172.21.15.134:0/3236085235 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900095f0 con 0x7f84a4100c40 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84a8c3c700 1 --2- 172.21.15.134:0/3236085235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a4100c40 0x7f84a4195870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f849800d900 tx=0x7f849800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84a1ffb700 1 -- 172.21.15.134:0/3236085235 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84980041f0 con 0x7f84a4100c40 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84a1ffb700 1 -- 172.21.15.134:0/3236085235 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f8498004cc0 con 0x7f84a4100c40 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84aaea0700 1 -- 172.21.15.134:0/3236085235 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a419afc0 con 0x7f84a4100c40 2024-04-13T10:51:55.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84a1ffb700 1 -- 172.21.15.134:0/3236085235 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84980056d0 con 0x7f84a4100c40 2024-04-13T10:51:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.988+0000 7f84aaea0700 1 -- 172.21.15.134:0/3236085235 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a419b4b0 con 0x7f84a4100c40 2024-04-13T10:51:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.989+0000 7f84aaea0700 1 -- 172.21.15.134:0/3236085235 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a418fa30 con 0x7f84a4100c40 2024-04-13T10:51:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.990+0000 7f84a1ffb700 1 -- 172.21.15.134:0/3236085235 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f8498004750 con 0x7f84a4100c40 2024-04-13T10:51:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.990+0000 7f84a1ffb700 1 --2- 172.21.15.134:0/3236085235 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f849406c590 0x7f849406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:51:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.990+0000 7f84a1ffb700 1 -- 172.21.15.134:0/3236085235 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f849808ac80 con 0x7f84a4100c40 2024-04-13T10:51:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.990+0000 7f84a3fff700 1 --2- 172.21.15.134:0/3236085235 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f849406c590 0x7f849406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:51:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.990+0000 7f84a3fff700 1 --2- 172.21.15.134:0/3236085235 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f849406c590 0x7f849406ea40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f849000b5c0 tx=0x7f8490005fd0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:51:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:54.995+0000 7f84a1ffb700 1 -- 172.21.15.134:0/3236085235 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8498059c70 con 0x7f84a4100c40 2024-04-13T10:51:55.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:51:55.207+0000 7f84aaea0700 1 -- 172.21.15.134:0/3236085235 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f84a4061190 con 0x7f849406c590 2024-04-13T10:51:55.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:55 smithi134 ceph-mon[39696]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:51:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:55 smithi194 ceph-mon[46737]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:51:56.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:56 smithi134 ceph-mon[39696]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:51:56.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:56 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:51:56.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:56 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:51:56.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:56 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:56 smithi194 ceph-mon[46737]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:51:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:56 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:51:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:56 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:51:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:56 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:57.569 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:57 smithi194 ceph-mon[46737]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:51:57.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:57 smithi134 ceph-mon[39696]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:51:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:51:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: Detected new or changed devices on smithi134 2024-04-13T10:51:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:51:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:51:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: Adjusting osd_memory_target on smithi134 to 11874M 2024-04-13T10:51:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:51:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:51:59 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:51:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: Detected new or changed devices on smithi134 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: Adjusting osd_memory_target on smithi134 to 11874M 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:51:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:51:59 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:52:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:00 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3240801269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce202f5e-9c58-4cd6-b85b-1422131948d4"}]: dispatch 2024-04-13T10:52:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:00 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3240801269' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce202f5e-9c58-4cd6-b85b-1422131948d4"}]': finished 2024-04-13T10:52:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:00 smithi134 ceph-mon[39696]: osdmap e11: 2 total, 1 up, 2 in 2024-04-13T10:52:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:00 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:52:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:00 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1311620050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:52:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:00 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3240801269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce202f5e-9c58-4cd6-b85b-1422131948d4"}]: dispatch 2024-04-13T10:52:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:00 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3240801269' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce202f5e-9c58-4cd6-b85b-1422131948d4"}]': finished 2024-04-13T10:52:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:00 smithi194 ceph-mon[46737]: osdmap e11: 2 total, 1 up, 2 in 2024-04-13T10:52:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:00 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:52:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:00 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/1311620050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:52:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:01 smithi134 ceph-mon[39696]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:01 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:01 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:02.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:01 smithi194 ceph-mon[46737]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:02.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:01 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:02.003 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:01 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:03.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:03 smithi134 ceph-mon[39696]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:03.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:03 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:03.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:03 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:03.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:03 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:03.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:03 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:52:03.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:03 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:03 smithi194 ceph-mon[46737]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:03 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:03 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:03 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:03 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:52:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:03 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:05.831 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:05 smithi134 ceph-mon[39696]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:05.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:05 smithi194 ceph-mon[46737]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:07.582 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:07 smithi194 ceph-mon[46737]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:07 smithi134 ceph-mon[39696]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:08.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:08 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-13T10:52:08.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:08 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:08.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:08 smithi134 ceph-mon[39696]: Deploying daemon osd.1 on smithi134 2024-04-13T10:52:08.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:08 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-13T10:52:08.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:08 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:08.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:08 smithi194 ceph-mon[46737]: Deploying daemon osd.1 on smithi134 2024-04-13T10:52:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:09 smithi134 ceph-mon[39696]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:09 smithi194 ceph-mon[46737]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:11.584 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:11 smithi134 ceph-mon[39696]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:11 smithi194 ceph-mon[46737]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:13.663 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:13 smithi194 ceph-mon[46737]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:13.663 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:13.663 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:13.663 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:52:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:13 smithi134 ceph-mon[39696]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:52:14.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:14 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:52:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:14 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:52:15.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:15 smithi134 ceph-mon[39696]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:15.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:15 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:15.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:15 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:15.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:15 smithi194 ceph-mon[46737]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:15.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:15 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:15.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:15 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:17.568 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:17 smithi134 ceph-mon[39696]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:17.568 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:17 smithi134 ceph-mon[39696]: from='osd.1 [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-13T10:52:17.594 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:17 smithi194 ceph-mon[46737]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:17.595 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:17 smithi194 ceph-mon[46737]: from='osd.1 [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-13T10:52:17.869 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 1 on host 'smithi134' 2024-04-13T10:52:17.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.868+0000 7f84a1ffb700 1 -- 172.21.15.134:0/3236085235 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f84a4061190 con 0x7f849406c590 2024-04-13T10:52:17.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 -- 172.21.15.134:0/3236085235 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f849406c590 msgr2=0x7f849406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:52:17.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 --2- 172.21.15.134:0/3236085235 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f849406c590 0x7f849406ea40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f849000b5c0 tx=0x7f8490005fd0 comp rx=0 tx=0).stop 2024-04-13T10:52:17.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 -- 172.21.15.134:0/3236085235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a4100c40 msgr2=0x7f84a4195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:52:17.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 --2- 172.21.15.134:0/3236085235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a4100c40 0x7f84a4195870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f849800d900 tx=0x7f849800dcc0 comp rx=0 tx=0).stop 2024-04-13T10:52:17.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 -- 172.21.15.134:0/3236085235 shutdown_connections 2024-04-13T10:52:17.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 --2- 172.21.15.134:0/3236085235 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f849406c590 0x7f849406ea40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:17.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 --2- 172.21.15.134:0/3236085235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84a4100c40 0x7f84a4195870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:17.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 --2- 172.21.15.134:0/3236085235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84a4103560 0x7f84a4195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:17.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 -- 172.21.15.134:0/3236085235 >> 172.21.15.134:0/3236085235 conn(0x7f84a40fa5e0 msgr2=0x7f84a40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:52:17.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 -- 172.21.15.134:0/3236085235 shutdown_connections 2024-04-13T10:52:17.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:17.871+0000 7f84aaea0700 1 -- 172.21.15.134:0/3236085235 wait complete. 2024-04-13T10:52:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:18 smithi134 ceph-mon[39696]: from='osd.1 [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-13T10:52:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:18 smithi134 ceph-mon[39696]: osdmap e12: 2 total, 1 up, 2 in 2024-04-13T10:52:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:18 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:52:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:18 smithi134 ceph-mon[39696]: from='osd.1 [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T10:52:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:18 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:18.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:18 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:18 smithi194 ceph-mon[46737]: from='osd.1 [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-13T10:52:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:18 smithi194 ceph-mon[46737]: osdmap e12: 2 total, 1 up, 2 in 2024-04-13T10:52:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:18 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:52:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:18 smithi194 ceph-mon[46737]: from='osd.1 [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T10:52:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:18 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:18 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:18.900 DEBUG:teuthology.orchestra.run.smithi134:osd.1> sudo journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.1.service 2024-04-13T10:52:18.903 INFO:tasks.cephadm:Deploying osd.2 on smithi134 with /dev/vg_nvme/lv_2... 2024-04-13T10:52:18.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-13T10:52:18.934 INFO:journalctl@ceph.osd.1.smithi134.stdout:-- Logs begin at Sat 2024-04-13 10:37:50 UTC. -- 2024-04-13T10:52:19.676 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:52:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:19 smithi134 ceph-mon[39696]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:19 smithi134 ceph-mon[39696]: from='osd.1 [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-04-13T10:52:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:19 smithi134 ceph-mon[39696]: osdmap e13: 2 total, 1 up, 2 in 2024-04-13T10:52:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:52:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:52:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:19 smithi194 ceph-mon[46737]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:19 smithi194 ceph-mon[46737]: from='osd.1 [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-04-13T10:52:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:19 smithi194 ceph-mon[46737]: osdmap e13: 2 total, 1 up, 2 in 2024-04-13T10:52:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:52:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:52:20.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:20 smithi134 ceph-mon[39696]: purged_snaps scrub starts 2024-04-13T10:52:20.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:20 smithi134 ceph-mon[39696]: purged_snaps scrub ok 2024-04-13T10:52:20.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:20 smithi134 ceph-mon[39696]: osd.1 [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333] boot 2024-04-13T10:52:20.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:20 smithi134 ceph-mon[39696]: osdmap e14: 2 total, 2 up, 2 in 2024-04-13T10:52:20.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:20 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:52:20.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:20 smithi194 ceph-mon[46737]: purged_snaps scrub starts 2024-04-13T10:52:20.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:20 smithi194 ceph-mon[46737]: purged_snaps scrub ok 2024-04-13T10:52:20.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:20 smithi194 ceph-mon[46737]: osd.1 [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333] boot 2024-04-13T10:52:20.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:20 smithi194 ceph-mon[46737]: osdmap e14: 2 total, 2 up, 2 in 2024-04-13T10:52:20.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:20 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:52:21.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:21 smithi134 ceph-mon[39696]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:21.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:21 smithi134 ceph-mon[39696]: osdmap e15: 2 total, 2 up, 2 in 2024-04-13T10:52:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:21 smithi194 ceph-mon[46737]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-13T10:52:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:21 smithi194 ceph-mon[46737]: osdmap e15: 2 total, 2 up, 2 in 2024-04-13T10:52:22.570 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-13T10:52:22.570 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-13T10:52:22.571 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-04-13T10:52:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-04-13T10:52:22.571 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109355 s, 959 MB/s 2024-04-13T10:52:22.571 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-04-13T10:52:22.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:22 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:22.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:22 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:22 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:22 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:23 smithi134 ceph-mon[39696]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:23 smithi194 ceph-mon[46737]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:24.133 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-04-13T10:52:24.730 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:52:25.917 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:25 smithi134 ceph-mon[39696]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:25 smithi194 ceph-mon[46737]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:27.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.272+0000 7f0e06c6e700 1 -- 172.21.15.134:0/48747550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e001013f0 msgr2=0x7f0e00101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:52:27.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.272+0000 7f0e06c6e700 1 --2- 172.21.15.134:0/48747550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e001013f0 0x7f0e00101840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009910 tx=0x7f0dec009c20 comp rx=0 tx=0).stop 2024-04-13T10:52:27.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.272+0000 7f0e06c6e700 1 -- 172.21.15.134:0/48747550 shutdown_connections 2024-04-13T10:52:27.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.272+0000 7f0e06c6e700 1 --2- 172.21.15.134:0/48747550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e001013f0 0x7f0e00101840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:27.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.272+0000 7f0e06c6e700 1 --2- 172.21.15.134:0/48747550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e000fe410 0x7f0e000fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:27.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.272+0000 7f0e06c6e700 1 -- 172.21.15.134:0/48747550 >> 172.21.15.134:0/48747550 conn(0x7f0e000f9d80 msgr2=0x7f0e000fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:52:27.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.272+0000 7f0e06c6e700 1 -- 172.21.15.134:0/48747550 shutdown_connections 2024-04-13T10:52:27.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.272+0000 7f0e06c6e700 1 -- 172.21.15.134:0/48747550 wait complete. 2024-04-13T10:52:27.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0e06c6e700 1 Processor -- start 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0e06c6e700 1 -- start start 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0e06c6e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e000fe410 0x7f0e00100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0e06c6e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e001013f0 0x7f0e000ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0e06c6e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000ff8e0 con 0x7f0e001013f0 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0e06c6e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000ffa20 con 0x7f0e000fe410 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0dfffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e001013f0 0x7f0e000ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0dfffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e001013f0 0x7f0e000ff3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39184/0 (socket says 172.21.15.134:39184) 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0dfffff700 1 -- 172.21.15.134:0/1434337130 learned_addr learned my addr 172.21.15.134:0/1434337130 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0e04a0a700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e000fe410 0x7f0e00100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0dfffff700 1 -- 172.21.15.134:0/1434337130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e000fe410 msgr2=0x7f0e00100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0dfffff700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e000fe410 0x7f0e00100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:27.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0dfffff700 1 -- 172.21.15.134:0/1434337130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec0095f0 con 0x7f0e001013f0 2024-04-13T10:52:27.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0dfffff700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e001013f0 0x7f0e000ff3a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0dec006010 tx=0x7f0dec00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:52:27.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.273+0000 7f0dfdffb700 1 -- 172.21.15.134:0/1434337130 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dec01d070 con 0x7f0e001013f0 2024-04-13T10:52:27.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.274+0000 7f0e06c6e700 1 -- 172.21.15.134:0/1434337130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e000ffca0 con 0x7f0e001013f0 2024-04-13T10:52:27.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.274+0000 7f0dfdffb700 1 -- 172.21.15.134:0/1434337130 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f0dec00f460 con 0x7f0e001013f0 2024-04-13T10:52:27.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.274+0000 7f0dfdffb700 1 -- 172.21.15.134:0/1434337130 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dec021640 con 0x7f0e001013f0 2024-04-13T10:52:27.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.274+0000 7f0e06c6e700 1 -- 172.21.15.134:0/1434337130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e00100190 con 0x7f0e001013f0 2024-04-13T10:52:27.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.275+0000 7f0e06c6e700 1 -- 172.21.15.134:0/1434337130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e00108b50 con 0x7f0e001013f0 2024-04-13T10:52:27.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.275+0000 7f0dfdffb700 1 -- 172.21.15.134:0/1434337130 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f0dec00f9b0 con 0x7f0e001013f0 2024-04-13T10:52:27.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.276+0000 7f0dfdffb700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0df006c650 0x7f0df006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:52:27.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.276+0000 7f0e04a0a700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0df006c650 0x7f0df006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:52:27.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.276+0000 7f0dfdffb700 1 -- 172.21.15.134:0/1434337130 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f0dec08be70 con 0x7f0e001013f0 2024-04-13T10:52:27.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.276+0000 7f0e04a0a700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0df006c650 0x7f0df006eb00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0e000681d0 tx=0x7f0df400b410 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:52:27.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.280+0000 7f0dfdffb700 1 -- 172.21.15.134:0/1434337130 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0dec05ac10 con 0x7f0e001013f0 2024-04-13T10:52:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: Detected new or changed devices on smithi134 2024-04-13T10:52:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:52:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:52:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: Adjusting osd_memory_target on smithi134 to 5937M 2024-04-13T10:52:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:27.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:52:27.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:27.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:27.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:27 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:52:27.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:27.482+0000 7f0e06c6e700 1 -- 172.21.15.134:0/1434337130 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e00105d40 con 0x7f0df006c650 2024-04-13T10:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: Detected new or changed devices on smithi134 2024-04-13T10:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: Adjusting osd_memory_target on smithi134 to 5937M 2024-04-13T10:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:52:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:27.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:27.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:27 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:52:28.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:28 smithi134 ceph-mon[39696]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:52:28.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:52:28.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:52:28.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:28 smithi194 ceph-mon[46737]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:52:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:28 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:52:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:28 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:52:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:28 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:29.635 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:29 smithi134 ceph-mon[39696]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:29.635 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:29.635 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:29.635 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:52:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:29 smithi194 ceph-mon[46737]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:29 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:29 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:29 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:52:31.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:31 smithi134 ceph-mon[39696]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:31 smithi194 ceph-mon[46737]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:32.612 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:32 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/2648399581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a2fef79-8403-416e-9037-079ddb080611"}]: dispatch 2024-04-13T10:52:32.613 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:32 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/2648399581' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a2fef79-8403-416e-9037-079ddb080611"}]': finished 2024-04-13T10:52:32.613 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:32 smithi194 ceph-mon[46737]: osdmap e16: 3 total, 2 up, 3 in 2024-04-13T10:52:32.613 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:32 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:32.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:32 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2648399581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a2fef79-8403-416e-9037-079ddb080611"}]: dispatch 2024-04-13T10:52:32.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:32 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2648399581' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a2fef79-8403-416e-9037-079ddb080611"}]': finished 2024-04-13T10:52:32.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:32 smithi134 ceph-mon[39696]: osdmap e16: 3 total, 2 up, 3 in 2024-04-13T10:52:32.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:32 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:33.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:33 smithi134 ceph-mon[39696]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:33.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:33 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3531351840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:52:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:33 smithi194 ceph-mon[46737]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:33 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3531351840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:52:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:34 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:34 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:34 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:34 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:52:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:34 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:34 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:34 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:34 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:34 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:52:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:34 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:35 smithi194 ceph-mon[46737]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:35 smithi134 ceph-mon[39696]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:37 smithi194 ceph-mon[46737]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:38.066 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:37 smithi134 ceph-mon[39696]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:39 smithi194 ceph-mon[46737]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:39 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-13T10:52:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:39 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:40.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:39 smithi134 ceph-mon[39696]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:40.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:39 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-13T10:52:40.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:39 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:41.079 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:40 smithi134 ceph-mon[39696]: Deploying daemon osd.2 on smithi134 2024-04-13T10:52:41.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:40 smithi194 ceph-mon[46737]: Deploying daemon osd.2 on smithi134 2024-04-13T10:52:42.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:41 smithi134 ceph-mon[39696]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:42.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:41 smithi194 ceph-mon[46737]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:43.791 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:43 smithi134 ceph-mon[39696]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:43.791 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:52:44.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:43 smithi194 ceph-mon[46737]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:44.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:52:46.083 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:45 smithi134 ceph-mon[39696]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:46.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:46.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:46.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:52:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:45 smithi194 ceph-mon[46737]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:52:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:47 smithi194 ceph-mon[46737]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:47 smithi134 ceph-mon[39696]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:49.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.701+0000 7f0dfdffb700 1 -- 172.21.15.134:0/1434337130 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0e00105d40 con 0x7f0df006c650 2024-04-13T10:52:49.702 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 2 on host 'smithi134' 2024-04-13T10:52:49.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 -- 172.21.15.134:0/1434337130 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0df006c650 msgr2=0x7f0df006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:52:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0df006c650 0x7f0df006eb00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0e000681d0 tx=0x7f0df400b410 comp rx=0 tx=0).stop 2024-04-13T10:52:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 -- 172.21.15.134:0/1434337130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e001013f0 msgr2=0x7f0e000ff3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:52:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e001013f0 0x7f0e000ff3a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0dec006010 tx=0x7f0dec00bd70 comp rx=0 tx=0).stop 2024-04-13T10:52:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 -- 172.21.15.134:0/1434337130 shutdown_connections 2024-04-13T10:52:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0df006c650 0x7f0df006eb00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e000fe410 0x7f0e00100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 --2- 172.21.15.134:0/1434337130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e001013f0 0x7f0e000ff3a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 -- 172.21.15.134:0/1434337130 >> 172.21.15.134:0/1434337130 conn(0x7f0e000f9d80 msgr2=0x7f0e00104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:52:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 -- 172.21.15.134:0/1434337130 shutdown_connections 2024-04-13T10:52:49.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:52:49.704+0000 7f0e06c6e700 1 -- 172.21.15.134:0/1434337130 wait complete. 2024-04-13T10:52:49.924 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:49 smithi134 ceph-mon[39696]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:49.924 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:49 smithi134 ceph-mon[39696]: from='osd.2 [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-13T10:52:49.924 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:49 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:49.924 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:49 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:49 smithi194 ceph-mon[46737]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:49 smithi194 ceph-mon[46737]: from='osd.2 [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-13T10:52:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:49 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:49 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:51.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:50 smithi134 ceph-mon[39696]: from='osd.2 [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-13T10:52:51.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:50 smithi134 ceph-mon[39696]: osdmap e17: 3 total, 2 up, 3 in 2024-04-13T10:52:51.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:50 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:51.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:50 smithi134 ceph-mon[39696]: from='osd.2 [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T10:52:51.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:50 smithi134 ceph-mon[39696]: from='osd.2 [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-04-13T10:52:51.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:50 smithi134 ceph-mon[39696]: osdmap e18: 3 total, 2 up, 3 in 2024-04-13T10:52:51.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:50 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:51.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:50 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:51.057 DEBUG:teuthology.orchestra.run.smithi134:osd.2> sudo journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.2.service 2024-04-13T10:52:51.060 INFO:tasks.cephadm:Deploying osd.3 on smithi194 with /dev/vg_nvme/lv_4... 2024-04-13T10:52:51.060 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-13T10:52:51.089 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:50 smithi194 ceph-mon[46737]: from='osd.2 [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-13T10:52:51.089 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:50 smithi194 ceph-mon[46737]: osdmap e17: 3 total, 2 up, 3 in 2024-04-13T10:52:51.089 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:50 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:51.090 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:50 smithi194 ceph-mon[46737]: from='osd.2 [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T10:52:51.090 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:50 smithi194 ceph-mon[46737]: from='osd.2 [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-04-13T10:52:51.090 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:50 smithi194 ceph-mon[46737]: osdmap e18: 3 total, 2 up, 3 in 2024-04-13T10:52:51.090 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:50 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:51.090 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:50 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:51.092 INFO:journalctl@ceph.osd.2.smithi134.stdout:-- Logs begin at Sat 2024-04-13 10:37:50 UTC. -- 2024-04-13T10:52:51.296 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi194/config 2024-04-13T10:52:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:51 smithi134 ceph-mon[39696]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:52.187 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:51 smithi194 ceph-mon[46737]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:52.188 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:51 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:52.960 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:52 smithi194 ceph-mon[46737]: purged_snaps scrub starts 2024-04-13T10:52:52.960 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:52 smithi194 ceph-mon[46737]: purged_snaps scrub ok 2024-04-13T10:52:52.960 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:52 smithi194 ceph-mon[46737]: osd.2 [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169] boot 2024-04-13T10:52:52.960 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:52 smithi194 ceph-mon[46737]: osdmap e19: 3 total, 3 up, 3 in 2024-04-13T10:52:52.960 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:52.961 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-13T10:52:53.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:52 smithi134 ceph-mon[39696]: purged_snaps scrub starts 2024-04-13T10:52:53.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:52 smithi134 ceph-mon[39696]: purged_snaps scrub ok 2024-04-13T10:52:53.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:52 smithi134 ceph-mon[39696]: osd.2 [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169] boot 2024-04-13T10:52:53.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:52 smithi134 ceph-mon[39696]: osdmap e19: 3 total, 3 up, 3 in 2024-04-13T10:52:53.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:52:53.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-13T10:52:53.495 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-13T10:52:53.496 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-13T10:52:53.496 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-04-13T10:52:53.496 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-04-13T10:52:53.496 INFO:teuthology.orchestra.run.smithi194.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111158 s, 943 MB/s 2024-04-13T10:52:53.496 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 2024-04-13T10:52:53.496 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-04-13T10:52:54.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:53 smithi134 ceph-mon[39696]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:54.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:53 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-13T10:52:54.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:53 smithi134 ceph-mon[39696]: osdmap e20: 3 total, 3 up, 3 in 2024-04-13T10:52:54.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:53 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-13T10:52:54.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:53 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:54.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:53 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:54.185 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:53 smithi194 ceph-mon[46737]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-13T10:52:54.185 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:53 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-13T10:52:54.185 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:53 smithi194 ceph-mon[46737]: osdmap e20: 3 total, 3 up, 3 in 2024-04-13T10:52:54.185 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:53 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-13T10:52:54.185 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:53 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:54.185 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:53 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:54.205 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_4 2024-04-13T10:52:54.466 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi194/config 2024-04-13T10:52:54.588 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72924]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-13T10:52:54.588 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72924]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-13T10:52:54.588 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72924]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-13T10:52:54.588 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72924]: pam_unix(sudo:session): session closed for user root 2024-04-13T10:52:54.857 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-13T10:52:54.857 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:54 smithi134 ceph-mon[39696]: osdmap e21: 3 total, 3 up, 3 in 2024-04-13T10:52:54.857 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:54.857 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72951]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-13T10:52:54.857 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72951]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-13T10:52:54.857 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72951]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-13T10:52:54.857 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72951]: pam_unix(sudo:session): session closed for user root 2024-04-13T10:52:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-13T10:52:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:54 smithi194 ceph-mon[46737]: osdmap e21: 3 total, 3 up, 3 in 2024-04-13T10:52:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:55.114 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72972]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-13T10:52:55.114 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72972]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-13T10:52:55.114 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72972]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-13T10:52:55.114 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 10:52:54 smithi134 sudo[72972]: pam_unix(sudo:session): session closed for user root 2024-04-13T10:52:55.377 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[72987]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-13T10:52:55.378 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[72987]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-13T10:52:55.378 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[72987]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-13T10:52:55.378 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[72987]: pam_unix(sudo:session): session closed for user root 2024-04-13T10:52:55.378 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73562]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-13T10:52:55.378 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73562]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-13T10:52:55.378 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73562]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-13T10:52:55.378 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73562]: pam_unix(sudo:session): session closed for user root 2024-04-13T10:52:55.684 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73584]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-13T10:52:55.684 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73584]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-13T10:52:55.684 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73584]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-13T10:52:55.684 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73584]: pam_unix(sudo:session): session closed for user root 2024-04-13T10:52:56.060 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73587]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-13T10:52:56.060 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73587]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-13T10:52:56.060 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73587]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-13T10:52:56.060 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:55 smithi134 sudo[73587]: pam_unix(sudo:session): session closed for user root 2024-04-13T10:52:56.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 -- 172.21.15.194:0/1289378420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac40ff050 msgr2=0x7f3ac40ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:52:56.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 --2- 172.21.15.194:0/1289378420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac40ff050 0x7f3ac40ff460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009870 tx=0x7f3ab4009b80 comp rx=0 tx=0).stop 2024-04-13T10:52:56.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 -- 172.21.15.194:0/1289378420 shutdown_connections 2024-04-13T10:52:56.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 --2- 172.21.15.194:0/1289378420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ac4100250 0x7f3ac41006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:56.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 --2- 172.21.15.194:0/1289378420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac40ff050 0x7f3ac40ff460 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:56.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 -- 172.21.15.194:0/1289378420 >> 172.21.15.194:0/1289378420 conn(0x7f3ac40fa5e0 msgr2=0x7f3ac40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:52:56.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 -- 172.21.15.194:0/1289378420 shutdown_connections 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 -- 172.21.15.194:0/1289378420 wait complete. 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 Processor -- start 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 -- start start 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac40ff050 0x7f3ac41947d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ac4100250 0x7f3ac4194d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4195330 con 0x7f3ac40ff050 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.288+0000 7f3aca196700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4195470 con 0x7f3ac4100250 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.289+0000 7f3abbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ac4100250 0x7f3ac4194d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.289+0000 7f3abbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ac4100250 0x7f3ac4194d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37814/0 (socket says 172.21.15.194:37814) 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.289+0000 7f3abbfff700 1 -- 172.21.15.194:0/4073665605 learned_addr learned my addr 172.21.15.194:0/4073665605 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.289+0000 7f3ac37fe700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac40ff050 0x7f3ac41947d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.289+0000 7f3abbfff700 1 -- 172.21.15.194:0/4073665605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac40ff050 msgr2=0x7f3ac41947d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:52:56.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.289+0000 7f3abbfff700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac40ff050 0x7f3ac41947d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:52:56.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.289+0000 7f3abbfff700 1 -- 172.21.15.194:0/4073665605 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab4009520 con 0x7f3ac4100250 2024-04-13T10:52:56.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.289+0000 7f3abbfff700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ac4100250 0x7f3ac4194d10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00e940 tx=0x7f3aac00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:52:56.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:56 smithi134 sudo[73592]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-13T10:52:56.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:56 smithi134 sudo[73592]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-13T10:52:56.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:56 smithi134 sudo[73592]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-13T10:52:56.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:56 smithi134 sudo[73592]: pam_unix(sudo:session): session closed for user root 2024-04-13T10:52:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.607+0000 7f3ac17fa700 1 -- 172.21.15.194:0/4073665605 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3aac004a00 con 0x7f3ac4100250 2024-04-13T10:52:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.607+0000 7f3ac17fa700 1 -- 172.21.15.194:0/4073665605 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f3aac00c7c0 con 0x7f3ac4100250 2024-04-13T10:52:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.607+0000 7f3aca196700 1 -- 172.21.15.194:0/4073665605 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac4199f20 con 0x7f3ac4100250 2024-04-13T10:52:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.607+0000 7f3ac17fa700 1 -- 172.21.15.194:0/4073665605 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3aac005480 con 0x7f3ac4100250 2024-04-13T10:52:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.607+0000 7f3aca196700 1 -- 172.21.15.194:0/4073665605 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac419a4c0 con 0x7f3ac4100250 2024-04-13T10:52:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.609+0000 7f3aca196700 1 -- 172.21.15.194:0/4073665605 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac4107a60 con 0x7f3ac4100250 2024-04-13T10:52:56.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.612+0000 7f3ac17fa700 1 -- 172.21.15.194:0/4073665605 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f3aac00c930 con 0x7f3ac4100250 2024-04-13T10:52:56.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.612+0000 7f3ac17fa700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3ab006c680 0x7f3ab006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:52:56.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.612+0000 7f3ac17fa700 1 -- 172.21.15.194:0/4073665605 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3232+0+0 (secure 0 0 0) 0x7f3aac014070 con 0x7f3ac4100250 2024-04-13T10:52:56.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.612+0000 7f3ac37fe700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3ab006c680 0x7f3ab006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:52:56.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.613+0000 7f3ac37fe700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3ab006c680 0x7f3ab006eb30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009840 tx=0x7f3ab4019040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:52:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.616+0000 7f3ac17fa700 1 -- 172.21.15.194:0/4073665605 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3aac059fa0 con 0x7f3ac4100250 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 sudo[50921]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 sudo[50921]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 sudo[50921]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 sudo[50921]: pam_unix(sudo:session): session closed for user root 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 sudo[50924]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 sudo[50924]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 sudo[50924]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 sudo[50924]: pam_unix(sudo:session): session closed for user root 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 ceph-mon[46737]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 ceph-mon[46737]: osdmap e22: 3 total, 3 up, 3 in 2024-04-13T10:52:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:56 smithi194 ceph-mon[46737]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-13T10:52:56.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:52:56.837+0000 7f3aca196700 1 -- 172.21.15.194:0/4073665605 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ac4104ba0 con 0x7f3ab006c680 2024-04-13T10:52:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:56 smithi134 ceph-mon[39696]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:52:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:56 smithi134 ceph-mon[39696]: osdmap e22: 3 total, 3 up, 3 in 2024-04-13T10:52:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:56 smithi134 ceph-mon[39696]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-13T10:52:57.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-13T10:52:57.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:52:57.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:52:57.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-13T10:52:57.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: Detected new or changed devices on smithi134 2024-04-13T10:52:57.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: mgrmap e19: smithi134.tmanda(active, since 2m), standbys: smithi194.tcpynt 2024-04-13T10:52:57.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:52:57.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:52:57.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:52:57.618 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: Adjusting osd_memory_target on smithi134 to 3958M 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:52:57.619 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:52:57.620 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:52:57.620 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: Detected new or changed devices on smithi134 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: mgrmap e19: smithi134.tmanda(active, since 2m), standbys: smithi194.tcpynt 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:52:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:52:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: Adjusting osd_memory_target on smithi134 to 3958M 2024-04-13T10:52:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:52:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:52:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:52:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:52:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:52:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:52:58.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:58 smithi134 ceph-mon[39696]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:52:58.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:58 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:52:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:58 smithi194 ceph-mon[46737]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:52:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:58 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:52:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:59 smithi134 ceph-mon[39696]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:52:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:59 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/42976181' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44c0411c-d9e0-4d23-b97d-f613b89943a6"}]: dispatch 2024-04-13T10:52:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:59 smithi134 ceph-mon[39696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44c0411c-d9e0-4d23-b97d-f613b89943a6"}]: dispatch 2024-04-13T10:52:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:59 smithi134 ceph-mon[39696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44c0411c-d9e0-4d23-b97d-f613b89943a6"}]': finished 2024-04-13T10:52:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:59 smithi134 ceph-mon[39696]: osdmap e23: 4 total, 3 up, 4 in 2024-04-13T10:52:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:52:59 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:52:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:59 smithi194 ceph-mon[46737]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:52:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:59 smithi194 ceph-mon[46737]: from='client.? 172.21.15.194:0/42976181' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44c0411c-d9e0-4d23-b97d-f613b89943a6"}]: dispatch 2024-04-13T10:52:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:59 smithi194 ceph-mon[46737]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44c0411c-d9e0-4d23-b97d-f613b89943a6"}]: dispatch 2024-04-13T10:52:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:59 smithi194 ceph-mon[46737]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44c0411c-d9e0-4d23-b97d-f613b89943a6"}]': finished 2024-04-13T10:52:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:59 smithi194 ceph-mon[46737]: osdmap e23: 4 total, 3 up, 4 in 2024-04-13T10:52:59.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:52:59 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:53:00.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:00 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/765257334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:53:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:00 smithi194 ceph-mon[46737]: from='client.? 172.21.15.194:0/765257334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:53:01.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:01 smithi134 ceph-mon[39696]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:53:01.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:01 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:01.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:01 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:01.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:01 smithi194 ceph-mon[46737]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:53:01.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:01 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:01.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:01 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:02.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:02 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:02.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:02 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:53:02.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:02 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:02.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:02 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:02.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:02 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:53:02.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:02 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:03.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:03 smithi134 ceph-mon[39696]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-13T10:53:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:03 smithi194 ceph-mon[46737]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-13T10:53:05.902 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:05 smithi194 ceph-mon[46737]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-13T10:53:06.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:05 smithi134 ceph-mon[39696]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-13T10:53:07.906 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:07 smithi194 ceph-mon[46737]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-13T10:53:07.906 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:07 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-13T10:53:07.906 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:07 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:08.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:07 smithi134 ceph-mon[39696]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-13T10:53:08.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:07 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-13T10:53:08.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:07 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:08 smithi194 ceph-mon[46737]: Deploying daemon osd.3 on smithi194 2024-04-13T10:53:09.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:08 smithi134 ceph-mon[39696]: Deploying daemon osd.3 on smithi194 2024-04-13T10:53:09.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:09 smithi194 ceph-mon[46737]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-13T10:53:10.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:09 smithi134 ceph-mon[39696]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-13T10:53:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:11 smithi194 ceph-mon[46737]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 72 KiB/s wr, 5 op/s 2024-04-13T10:53:12.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:11 smithi134 ceph-mon[39696]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 72 KiB/s wr, 5 op/s 2024-04-13T10:53:13.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:13 smithi134 ceph-mon[39696]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-13T10:53:13.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:13.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:13.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:53:13.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:53:13.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:13 smithi194 ceph-mon[46737]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-13T10:53:13.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:13.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:13.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:53:13.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:53:15.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:15 smithi134 ceph-mon[39696]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:53:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:15 smithi194 ceph-mon[46737]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:53:16.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.803+0000 7f3ac17fa700 1 -- 172.21.15.194:0/4073665605 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3ac4104ba0 con 0x7f3ab006c680 2024-04-13T10:53:16.804 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 3 on host 'smithi194' 2024-04-13T10:53:16.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 -- 172.21.15.194:0/4073665605 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3ab006c680 msgr2=0x7f3ab006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:53:16.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3ab006c680 0x7f3ab006eb30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009840 tx=0x7f3ab4019040 comp rx=0 tx=0).stop 2024-04-13T10:53:16.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 -- 172.21.15.194:0/4073665605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ac4100250 msgr2=0x7f3ac4194d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:53:16.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ac4100250 0x7f3ac4194d10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00e940 tx=0x7f3aac00ec50 comp rx=0 tx=0).stop 2024-04-13T10:53:16.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 -- 172.21.15.194:0/4073665605 shutdown_connections 2024-04-13T10:53:16.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3ab006c680 0x7f3ab006eb30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:16.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ac40ff050 0x7f3ac41947d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:16.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 --2- 172.21.15.194:0/4073665605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ac4100250 0x7f3ac4194d10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:16.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 -- 172.21.15.194:0/4073665605 >> 172.21.15.194:0/4073665605 conn(0x7f3ac40fa5e0 msgr2=0x7f3ac4103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:53:16.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 -- 172.21.15.194:0/4073665605 shutdown_connections 2024-04-13T10:53:16.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:16.805+0000 7f3aca196700 1 -- 172.21.15.194:0/4073665605 wait complete. 2024-04-13T10:53:17.457 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:17 smithi194 ceph-mon[46737]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:53:17.457 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:17 smithi194 ceph-mon[46737]: from='osd.3 [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-13T10:53:17.457 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:17 smithi194 ceph-mon[46737]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-13T10:53:17.457 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:17 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:17.457 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:17 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:17.457 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:17 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:17.457 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:17 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:17.478 DEBUG:teuthology.orchestra.run.smithi194:osd.3> sudo journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.3.service 2024-04-13T10:53:17.480 INFO:tasks.cephadm:Deploying osd.4 on smithi194 with /dev/vg_nvme/lv_3... 2024-04-13T10:53:17.480 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-13T10:53:17.512 INFO:journalctl@ceph.osd.3.smithi194.stdout:-- Logs begin at Sat 2024-04-13 10:37:46 UTC. -- 2024-04-13T10:53:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:17 smithi134 ceph-mon[39696]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:53:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:17 smithi134 ceph-mon[39696]: from='osd.3 [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-13T10:53:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:17 smithi134 ceph-mon[39696]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-13T10:53:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:17 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:17 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:17 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:17 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:18.360 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi194/config 2024-04-13T10:53:18.594 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 10:53:18 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[53643]: 2024-04-13T10:53:18.323+0000 7f888bb9c700 -1 osd.3 0 waiting for initial osdmap 2024-04-13T10:53:18.594 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 10:53:18 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[53643]: 2024-04-13T10:53:18.329+0000 7f8887190700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T10:53:18.594 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:18 smithi194 ceph-mon[46737]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-13T10:53:18.594 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:18 smithi194 ceph-mon[46737]: osdmap e24: 4 total, 3 up, 4 in 2024-04-13T10:53:18.594 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:18 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:53:18.594 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:18 smithi194 ceph-mon[46737]: from='osd.3 [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:53:18.594 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:18 smithi194 ceph-mon[46737]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:53:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:18 smithi134 ceph-mon[39696]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-13T10:53:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:18 smithi134 ceph-mon[39696]: osdmap e24: 4 total, 3 up, 4 in 2024-04-13T10:53:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:18 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:53:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:18 smithi134 ceph-mon[39696]: from='osd.3 [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:53:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:18 smithi134 ceph-mon[39696]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:53:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:19 smithi134 ceph-mon[39696]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:53:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:19 smithi134 ceph-mon[39696]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-04-13T10:53:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:19 smithi134 ceph-mon[39696]: osdmap e25: 4 total, 3 up, 4 in 2024-04-13T10:53:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:53:19.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:53:19.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:19 smithi134 ceph-mon[39696]: osd.3 [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117] boot 2024-04-13T10:53:19.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:19 smithi134 ceph-mon[39696]: osdmap e26: 4 total, 4 up, 4 in 2024-04-13T10:53:19.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:53:19.743 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:19 smithi194 ceph-mon[46737]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-04-13T10:53:19.743 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:19 smithi194 ceph-mon[46737]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-04-13T10:53:19.743 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:19 smithi194 ceph-mon[46737]: osdmap e25: 4 total, 3 up, 4 in 2024-04-13T10:53:19.743 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:53:19.743 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:53:19.743 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:19 smithi194 ceph-mon[46737]: osd.3 [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117] boot 2024-04-13T10:53:19.744 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:19 smithi194 ceph-mon[46737]: osdmap e26: 4 total, 4 up, 4 in 2024-04-13T10:53:19.744 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:53:20.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:20 smithi134 ceph-mon[39696]: purged_snaps scrub starts 2024-04-13T10:53:20.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:20 smithi134 ceph-mon[39696]: purged_snaps scrub ok 2024-04-13T10:53:20.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:20 smithi134 ceph-mon[39696]: osdmap e27: 4 total, 4 up, 4 in 2024-04-13T10:53:20.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:20 smithi194 ceph-mon[46737]: purged_snaps scrub starts 2024-04-13T10:53:20.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:20 smithi194 ceph-mon[46737]: purged_snaps scrub ok 2024-04-13T10:53:20.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:20 smithi194 ceph-mon[46737]: osdmap e27: 4 total, 4 up, 4 in 2024-04-13T10:53:21.504 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-13T10:53:21.504 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-13T10:53:21.504 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-04-13T10:53:21.504 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-04-13T10:53:21.504 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115528 s, 908 MB/s 2024-04-13T10:53:21.504 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-04-13T10:53:21.626 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:21 smithi194 ceph-mon[46737]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:21.626 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:21 smithi194 ceph-mon[46737]: osdmap e28: 4 total, 4 up, 4 in 2024-04-13T10:53:21.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:21 smithi134 ceph-mon[39696]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:21.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:21 smithi134 ceph-mon[39696]: osdmap e28: 4 total, 4 up, 4 in 2024-04-13T10:53:22.613 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_3 2024-04-13T10:53:22.835 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi194/config 2024-04-13T10:53:23.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: Detected new or changed devices on smithi194 2024-04-13T10:53:23.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:23.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: Adjusting osd_memory_target on smithi194 to 14946M 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:23 smithi134 ceph-mon[39696]: osdmap e29: 4 total, 4 up, 4 in 2024-04-13T10:53:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: Detected new or changed devices on smithi194 2024-04-13T10:53:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:53:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: Adjusting osd_memory_target on smithi194 to 14946M 2024-04-13T10:53:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:53:23.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:23.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:53:23.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:23.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:53:23.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:23.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:23.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:23 smithi194 ceph-mon[46737]: osdmap e29: 4 total, 4 up, 4 in 2024-04-13T10:53:24.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:24 smithi194 ceph-mon[46737]: osdmap e30: 4 total, 4 up, 4 in 2024-04-13T10:53:24.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:24 smithi134 ceph-mon[39696]: osdmap e30: 4 total, 4 up, 4 in 2024-04-13T10:53:24.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.798+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1378503715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6180ff050 msgr2=0x7fa6180ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:53:24.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.798+0000 7fa61e8ac700 1 --2- 172.21.15.194:0/1378503715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6180ff050 0x7fa6180ff460 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa600009910 tx=0x7fa600009c20 comp rx=0 tx=0).stop 2024-04-13T10:53:24.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.798+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1378503715 shutdown_connections 2024-04-13T10:53:24.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.798+0000 7fa61e8ac700 1 --2- 172.21.15.194:0/1378503715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa618100250 0x7fa6181006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:24.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.798+0000 7fa61e8ac700 1 --2- 172.21.15.194:0/1378503715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6180ff050 0x7fa6180ff460 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:24.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.798+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1378503715 >> 172.21.15.194:0/1378503715 conn(0x7fa6180fa600 msgr2=0x7fa6180fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:53:24.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.798+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1378503715 shutdown_connections 2024-04-13T10:53:24.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.798+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1378503715 wait complete. 2024-04-13T10:53:24.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.798+0000 7fa61e8ac700 1 Processor -- start 2024-04-13T10:53:24.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.798+0000 7fa61e8ac700 1 -- start start 2024-04-13T10:53:24.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa61e8ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6180ff050 0x7fa6180697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:53:24.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa61e8ac700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100250 0x7fa61819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:53:24.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa61e8ac700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa618196480 con 0x7fa6180ff050 2024-04-13T10:53:24.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa61e8ac700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61819cf50 con 0x7fa618100250 2024-04-13T10:53:24.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa6177fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100250 0x7fa61819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:53:24.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa6177fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100250 0x7fa61819ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:39924/0 (socket says 172.21.15.194:39924) 2024-04-13T10:53:24.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa6177fe700 1 -- 172.21.15.194:0/1168705559 learned_addr learned my addr 172.21.15.194:0/1168705559 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:53:24.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa617fff700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6180ff050 0x7fa6180697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa6177fe700 1 -- 172.21.15.194:0/1168705559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6180ff050 msgr2=0x7fa6180697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa6177fe700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6180ff050 0x7fa6180697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa6177fe700 1 -- 172.21.15.194:0/1168705559 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6000095f0 con 0x7fa618100250 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa6177fe700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100250 0x7fa61819ca10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa60800d8d0 tx=0x7fa60800dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa6157fa700 1 -- 172.21.15.194:0/1168705559 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6080098a0 con 0x7fa618100250 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa6157fa700 1 -- 172.21.15.194:0/1168705559 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fa608009e90 con 0x7fa618100250 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1168705559 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61819d200 con 0x7fa618100250 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa6157fa700 1 -- 172.21.15.194:0/1168705559 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa60800f5f0 con 0x7fa618100250 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.799+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1168705559 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61819d7d0 con 0x7fa618100250 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.800+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1168705559 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa618107a60 con 0x7fa618100250 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.801+0000 7fa6157fa700 1 -- 172.21.15.194:0/1168705559 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fa608010460 con 0x7fa618100250 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.801+0000 7fa6157fa700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa60406c680 0x7fa60406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.801+0000 7fa6157fa700 1 -- 172.21.15.194:0/1168705559 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3774+0+0 (secure 0 0 0) 0x7fa60808afc0 con 0x7fa618100250 2024-04-13T10:53:24.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.801+0000 7fa617fff700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa60406c680 0x7fa60406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:53:24.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.802+0000 7fa617fff700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa60406c680 0x7fa60406eb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa60000bf80 tx=0x7fa60000b560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:53:24.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:24.806+0000 7fa6157fa700 1 -- 172.21.15.194:0/1168705559 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa608059850 con 0x7fa618100250 2024-04-13T10:53:25.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:25.002+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1168705559 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa618104ba0 con 0x7fa60406c680 2024-04-13T10:53:25.598 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:25 smithi194 ceph-mon[46737]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:25.598 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:25 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:53:25.598 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:25 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:53:25.598 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:25 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:25 smithi134 ceph-mon[39696]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:25 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:53:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:25 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:53:25.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:25 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:26.659 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:26 smithi194 ceph-mon[46737]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:53:26.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:26 smithi134 ceph-mon[39696]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:53:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:27 smithi134 ceph-mon[39696]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-13T10:53:27.718 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:27 smithi194 ceph-mon[46737]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-13T10:53:28.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:28 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/3943629060' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91533b98-bd92-4d8e-afa6-59c396f95799"}]: dispatch 2024-04-13T10:53:28.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:28 smithi134 ceph-mon[39696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91533b98-bd92-4d8e-afa6-59c396f95799"}]: dispatch 2024-04-13T10:53:28.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:28 smithi134 ceph-mon[39696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91533b98-bd92-4d8e-afa6-59c396f95799"}]': finished 2024-04-13T10:53:28.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:28 smithi134 ceph-mon[39696]: osdmap e31: 5 total, 4 up, 5 in 2024-04-13T10:53:28.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:28 smithi194 ceph-mon[46737]: from='client.? 172.21.15.194:0/3943629060' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91533b98-bd92-4d8e-afa6-59c396f95799"}]: dispatch 2024-04-13T10:53:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:28 smithi194 ceph-mon[46737]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91533b98-bd92-4d8e-afa6-59c396f95799"}]: dispatch 2024-04-13T10:53:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:28 smithi194 ceph-mon[46737]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91533b98-bd92-4d8e-afa6-59c396f95799"}]': finished 2024-04-13T10:53:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:28 smithi194 ceph-mon[46737]: osdmap e31: 5 total, 4 up, 5 in 2024-04-13T10:53:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:28 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:29.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:29 smithi134 ceph-mon[39696]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-13T10:53:29.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:29 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:53:29.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:29 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/1218787304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:53:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:29 smithi194 ceph-mon[46737]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-13T10:53:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:29 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:53:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:29 smithi194 ceph-mon[46737]: from='client.? 172.21.15.194:0/1218787304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:53:31.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:31 smithi134 ceph-mon[39696]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-13T10:53:31.696 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:31 smithi194 ceph-mon[46737]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-13T10:53:33.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:33 smithi134 ceph-mon[39696]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-13T10:53:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:33 smithi194 ceph-mon[46737]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-13T10:53:35.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:35 smithi134 ceph-mon[39696]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-13T10:53:35.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:35 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-13T10:53:35.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:35 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:35.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:35 smithi194 ceph-mon[46737]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-13T10:53:35.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:35 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-13T10:53:35.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:35 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:36 smithi194 ceph-mon[46737]: Deploying daemon osd.4 on smithi194 2024-04-13T10:53:36.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:36 smithi134 ceph-mon[39696]: Deploying daemon osd.4 on smithi194 2024-04-13T10:53:37.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:37 smithi134 ceph-mon[39696]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:37.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:37 smithi194 ceph-mon[46737]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:39.677 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:39 smithi194 ceph-mon[46737]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:39.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:39 smithi134 ceph-mon[39696]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:41 smithi134 ceph-mon[39696]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:41 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:53:41.692 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:41 smithi194 ceph-mon[46737]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:41.692 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:41 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:41.692 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:41 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:41.692 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:41 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:53:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:43 smithi134 ceph-mon[39696]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:53:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:43 smithi194 ceph-mon[46737]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:53:44.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.872+0000 7fa6157fa700 1 -- 172.21.15.194:0/1168705559 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa618104ba0 con 0x7fa60406c680 2024-04-13T10:53:44.873 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 4 on host 'smithi194' 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1168705559 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa60406c680 msgr2=0x7fa60406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa60406c680 0x7fa60406eb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa60000bf80 tx=0x7fa60000b560 comp rx=0 tx=0).stop 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1168705559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100250 msgr2=0x7fa61819ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100250 0x7fa61819ca10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa60800d8d0 tx=0x7fa60800dbe0 comp rx=0 tx=0).stop 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1168705559 shutdown_connections 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa60406c680 0x7fa60406eb30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6180ff050 0x7fa6180697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 --2- 172.21.15.194:0/1168705559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa618100250 0x7fa61819ca10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1168705559 >> 172.21.15.194:0/1168705559 conn(0x7fa6180fa600 msgr2=0x7fa618103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1168705559 shutdown_connections 2024-04-13T10:53:44.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:44.875+0000 7fa61e8ac700 1 -- 172.21.15.194:0/1168705559 wait complete. 2024-04-13T10:53:45.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:45 smithi134 ceph-mon[39696]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:45.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:45.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:45.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:45 smithi134 ceph-mon[39696]: from='osd.4 [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-13T10:53:45.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:45 smithi134 ceph-mon[39696]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-13T10:53:45.711 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:45 smithi194 ceph-mon[46737]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:45.711 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:45.712 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:45.712 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:45 smithi194 ceph-mon[46737]: from='osd.4 [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-13T10:53:45.712 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:45 smithi194 ceph-mon[46737]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-13T10:53:46.072 DEBUG:teuthology.orchestra.run.smithi194:osd.4> sudo journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.4.service 2024-04-13T10:53:46.075 INFO:tasks.cephadm:Deploying osd.5 on smithi194 with /dev/vg_nvme/lv_2... 2024-04-13T10:53:46.075 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-13T10:53:46.109 INFO:journalctl@ceph.osd.4.smithi194.stdout:-- Logs begin at Sat 2024-04-13 10:37:46 UTC. -- 2024-04-13T10:53:46.347 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi194/config 2024-04-13T10:53:46.881 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:46 smithi194 ceph-mon[46737]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-13T10:53:46.881 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:46 smithi194 ceph-mon[46737]: osdmap e32: 5 total, 4 up, 5 in 2024-04-13T10:53:46.881 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:46 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:46.881 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:46 smithi194 ceph-mon[46737]: from='osd.4 [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:53:46.881 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:46 smithi194 ceph-mon[46737]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:53:46.881 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:46 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:46.881 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:46 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:46.881 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:46 smithi194 ceph-mon[46737]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:46 smithi134 ceph-mon[39696]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-13T10:53:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:46 smithi134 ceph-mon[39696]: osdmap e32: 5 total, 4 up, 5 in 2024-04-13T10:53:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:46 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:46 smithi134 ceph-mon[39696]: from='osd.4 [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:53:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:46 smithi134 ceph-mon[39696]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:53:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:46 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:47.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:46 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:47.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:46 smithi134 ceph-mon[39696]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:47.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 10:53:46 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[59176]: 2024-04-13T10:53:46.880+0000 7fde0ab4d700 -1 osd.4 0 waiting for initial osdmap 2024-04-13T10:53:47.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 10:53:46 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[59176]: 2024-04-13T10:53:46.886+0000 7fde07143700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T10:53:48.078 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:47 smithi194 ceph-mon[46737]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-04-13T10:53:48.078 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:47 smithi194 ceph-mon[46737]: osdmap e33: 5 total, 4 up, 5 in 2024-04-13T10:53:48.078 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:48.078 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:47 smithi134 ceph-mon[39696]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-04-13T10:53:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:47 smithi134 ceph-mon[39696]: osdmap e33: 5 total, 4 up, 5 in 2024-04-13T10:53:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:49.103 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:48 smithi194 ceph-mon[46737]: purged_snaps scrub starts 2024-04-13T10:53:49.104 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:48 smithi194 ceph-mon[46737]: purged_snaps scrub ok 2024-04-13T10:53:49.104 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:48 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:49.104 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:48 smithi194 ceph-mon[46737]: osd.4 [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930] boot 2024-04-13T10:53:49.104 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:48 smithi194 ceph-mon[46737]: osdmap e34: 5 total, 5 up, 5 in 2024-04-13T10:53:49.104 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:48 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:49.104 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:48 smithi194 ceph-mon[46737]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:48 smithi134 ceph-mon[39696]: purged_snaps scrub starts 2024-04-13T10:53:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:48 smithi134 ceph-mon[39696]: purged_snaps scrub ok 2024-04-13T10:53:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:48 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:48 smithi134 ceph-mon[39696]: osd.4 [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930] boot 2024-04-13T10:53:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:48 smithi134 ceph-mon[39696]: osdmap e34: 5 total, 5 up, 5 in 2024-04-13T10:53:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:48 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:53:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:48 smithi134 ceph-mon[39696]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-04-13T10:53:49.901 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-13T10:53:49.901 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-13T10:53:49.901 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-04-13T10:53:49.901 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-04-13T10:53:49.901 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112971 s, 928 MB/s 2024-04-13T10:53:49.901 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-04-13T10:53:50.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:49 smithi134 ceph-mon[39696]: osdmap e35: 5 total, 5 up, 5 in 2024-04-13T10:53:50.217 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:49 smithi194 ceph-mon[46737]: osdmap e35: 5 total, 5 up, 5 in 2024-04-13T10:53:50.868 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_2 2024-04-13T10:53:51.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:50 smithi134 ceph-mon[39696]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:53:51.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:50 smithi194 ceph-mon[46737]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:53:51.441 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi194/config 2024-04-13T10:53:52.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: Detected new or changed devices on smithi194 2024-04-13T10:53:52.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:52.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:52.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:53:52.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:53:52.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: Adjusting osd_memory_target on smithi194 to 7473M 2024-04-13T10:53:52.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:52.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:52.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:53:52.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:52.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:53:52.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:52.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:53:52.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:52.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: Detected new or changed devices on smithi194 2024-04-13T10:53:52.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:52.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:52.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:53:52.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:53:52.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: Adjusting osd_memory_target on smithi194 to 7473M 2024-04-13T10:53:52.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:52.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:52.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:53:52.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:52.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:53:52.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:52.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:53:52.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:53:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.346+0000 7f83fae31700 1 -- 172.21.15.194:0/2155759312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f4100170 msgr2=0x7f83f4100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:53:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.346+0000 7f83fae31700 1 --2- 172.21.15.194:0/2155759312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f4100170 0x7f83f4100580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009910 tx=0x7f83e8009c20 comp rx=0 tx=0).stop 2024-04-13T10:53:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.346+0000 7f83fae31700 1 -- 172.21.15.194:0/2155759312 shutdown_connections 2024-04-13T10:53:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.346+0000 7f83fae31700 1 --2- 172.21.15.194:0/2155759312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f4101370 0x7f83f41017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.346+0000 7f83fae31700 1 --2- 172.21.15.194:0/2155759312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f4100170 0x7f83f4100580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.346+0000 7f83fae31700 1 -- 172.21.15.194:0/2155759312 >> 172.21.15.194:0/2155759312 conn(0x7f83f40fb720 msgr2=0x7f83f40fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:53:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.346+0000 7f83fae31700 1 -- 172.21.15.194:0/2155759312 shutdown_connections 2024-04-13T10:53:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.346+0000 7f83fae31700 1 -- 172.21.15.194:0/2155759312 wait complete. 2024-04-13T10:53:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83fae31700 1 Processor -- start 2024-04-13T10:53:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83fae31700 1 -- start start 2024-04-13T10:53:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83fae31700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f4100170 0x7f83f41958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83fae31700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f4101370 0x7f83f4195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83fae31700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4196400 con 0x7f83f4100170 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83fae31700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4196540 con 0x7f83f4101370 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f4101370 0x7f83f4195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f4101370 0x7f83f4195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:43942/0 (socket says 172.21.15.194:43942) 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f3fff700 1 -- 172.21.15.194:0/444624940 learned_addr learned my addr 172.21.15.194:0/444624940 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f8bcd700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f4100170 0x7f83f41958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f3fff700 1 -- 172.21.15.194:0/444624940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f4100170 msgr2=0x7f83f41958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f3fff700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f4100170 0x7f83f41958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f3fff700 1 -- 172.21.15.194:0/444624940 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e80095f0 con 0x7f83f4101370 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f3fff700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f4101370 0x7f83f4195de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f83e000d8d0 tx=0x7f83e000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f1ffb700 1 -- 172.21.15.194:0/444624940 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83e0009940 con 0x7f83f4101370 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f1ffb700 1 -- 172.21.15.194:0/444624940 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f83e0010460 con 0x7f83f4101370 2024-04-13T10:53:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83fae31700 1 -- 172.21.15.194:0/444624940 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f419aff0 con 0x7f83f4101370 2024-04-13T10:53:53.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.347+0000 7f83f1ffb700 1 -- 172.21.15.194:0/444624940 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83e000f5f0 con 0x7f83f4101370 2024-04-13T10:53:53.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.348+0000 7f83fae31700 1 -- 172.21.15.194:0/444624940 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f419b590 con 0x7f83f4101370 2024-04-13T10:53:53.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.349+0000 7f83fae31700 1 -- 172.21.15.194:0/444624940 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f4108b80 con 0x7f83f4101370 2024-04-13T10:53:53.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.349+0000 7f83f1ffb700 1 -- 172.21.15.194:0/444624940 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f83e00105d0 con 0x7f83f4101370 2024-04-13T10:53:53.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.349+0000 7f83f1ffb700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83e406c680 0x7f83e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:53:53.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.349+0000 7f83f1ffb700 1 -- 172.21.15.194:0/444624940 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f83e008b3d0 con 0x7f83f4101370 2024-04-13T10:53:53.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.350+0000 7f83f8bcd700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83e406c680 0x7f83e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:53:53.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.350+0000 7f83f8bcd700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83e406c680 0x7f83e406eb30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f83e8006010 tx=0x7f83e8005a90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:53:53.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.354+0000 7f83f1ffb700 1 -- 172.21.15.194:0/444624940 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f83e0059a30 con 0x7f83f4101370 2024-04-13T10:53:53.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:53:53.551+0000 7f83fae31700 1 -- 172.21.15.194:0/444624940 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f83f4105cc0 con 0x7f83e406c680 2024-04-13T10:53:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:53 smithi134 ceph-mon[39696]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:53:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:53 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:53:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:53 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:53:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:53 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:53 smithi194 ceph-mon[46737]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:53:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:53 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-13T10:53:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:53 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-13T10:53:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:53 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:53:54.719 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:54 smithi194 ceph-mon[46737]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:53:54.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:54 smithi134 ceph-mon[39696]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:53:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:55 smithi194 ceph-mon[46737]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:53:55.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:55 smithi134 ceph-mon[39696]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:53:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:56 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/2760823091' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e198b03-2011-435c-afd8-16d8521b9991"}]: dispatch 2024-04-13T10:53:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:56 smithi134 ceph-mon[39696]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e198b03-2011-435c-afd8-16d8521b9991"}]: dispatch 2024-04-13T10:53:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:56 smithi134 ceph-mon[39696]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e198b03-2011-435c-afd8-16d8521b9991"}]': finished 2024-04-13T10:53:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:56 smithi134 ceph-mon[39696]: osdmap e36: 6 total, 5 up, 6 in 2024-04-13T10:53:56.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:56 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:53:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:56 smithi194 ceph-mon[46737]: from='client.? 172.21.15.194:0/2760823091' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e198b03-2011-435c-afd8-16d8521b9991"}]: dispatch 2024-04-13T10:53:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:56 smithi194 ceph-mon[46737]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e198b03-2011-435c-afd8-16d8521b9991"}]: dispatch 2024-04-13T10:53:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:56 smithi194 ceph-mon[46737]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e198b03-2011-435c-afd8-16d8521b9991"}]': finished 2024-04-13T10:53:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:56 smithi194 ceph-mon[46737]: osdmap e36: 6 total, 5 up, 6 in 2024-04-13T10:53:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:56 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:53:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:57 smithi134 ceph-mon[39696]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:53:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:57 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/138179013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:53:57.857 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:57 smithi194 ceph-mon[46737]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:53:57.858 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:57 smithi194 ceph-mon[46737]: from='client.? 172.21.15.194:0/138179013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-13T10:53:58.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:58 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:53:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:58 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:53:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:53:59 smithi134 ceph-mon[39696]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:53:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:53:59 smithi194 ceph-mon[46737]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:01.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:01 smithi134 ceph-mon[39696]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:01.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:01 smithi194 ceph-mon[46737]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:03.920 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:03 smithi194 ceph-mon[46737]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:03.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:03 smithi134 ceph-mon[39696]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-13T10:54:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:54:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-13T10:54:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:54:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:05 smithi194 ceph-mon[46737]: Deploying daemon osd.5 on smithi194 2024-04-13T10:54:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:05 smithi194 ceph-mon[46737]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:05 smithi134 ceph-mon[39696]: Deploying daemon osd.5 on smithi194 2024-04-13T10:54:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:05 smithi134 ceph-mon[39696]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:07 smithi134 ceph-mon[39696]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:07.876 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:07 smithi194 ceph-mon[46737]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:09.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:09 smithi134 ceph-mon[39696]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:09.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:09 smithi194 ceph-mon[46737]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:10 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:10 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:10 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:54:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:10 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:10 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:10 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:54:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:11 smithi194 ceph-mon[46737]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:12.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:11 smithi134 ceph-mon[39696]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:13.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:13 smithi194 ceph-mon[46737]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:13.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:54:13.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:13 smithi194 ceph-mon[46737]: from='osd.5 [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-13T10:54:13.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:13 smithi194 ceph-mon[46737]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-13T10:54:14.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:13 smithi134 ceph-mon[39696]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:14.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:54:14.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:13 smithi134 ceph-mon[39696]: from='osd.5 [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-13T10:54:14.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:13 smithi134 ceph-mon[39696]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-13T10:54:14.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.521+0000 7f83f1ffb700 1 -- 172.21.15.194:0/444624940 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f83f4105cc0 con 0x7f83e406c680 2024-04-13T10:54:14.523 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 5 on host 'smithi194' 2024-04-13T10:54:14.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 -- 172.21.15.194:0/444624940 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83e406c680 msgr2=0x7f83e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:14.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83e406c680 0x7f83e406eb30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f83e8006010 tx=0x7f83e8005a90 comp rx=0 tx=0).stop 2024-04-13T10:54:14.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 -- 172.21.15.194:0/444624940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f4101370 msgr2=0x7f83f4195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:14.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f4101370 0x7f83f4195de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f83e000d8d0 tx=0x7f83e000dc90 comp rx=0 tx=0).stop 2024-04-13T10:54:14.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 -- 172.21.15.194:0/444624940 shutdown_connections 2024-04-13T10:54:14.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f83e406c680 0x7f83e406eb30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:14.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83f4100170 0x7f83f41958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:14.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 --2- 172.21.15.194:0/444624940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f4101370 0x7f83f4195de0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:14.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 -- 172.21.15.194:0/444624940 >> 172.21.15.194:0/444624940 conn(0x7f83f40fb720 msgr2=0x7f83f41045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:14.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 -- 172.21.15.194:0/444624940 shutdown_connections 2024-04-13T10:54:14.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:14.524+0000 7f83fae31700 1 -- 172.21.15.194:0/444624940 wait complete. 2024-04-13T10:54:15.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:14 smithi134 ceph-mon[39696]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-13T10:54:15.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:14 smithi134 ceph-mon[39696]: osdmap e37: 6 total, 5 up, 6 in 2024-04-13T10:54:15.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:14 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:54:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:14 smithi134 ceph-mon[39696]: from='osd.5 [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:54:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:14 smithi134 ceph-mon[39696]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:54:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:14 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:14 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:15.228 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:14 smithi194 ceph-mon[46737]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-13T10:54:15.228 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:14 smithi194 ceph-mon[46737]: osdmap e37: 6 total, 5 up, 6 in 2024-04-13T10:54:15.228 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:14 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:54:15.228 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:14 smithi194 ceph-mon[46737]: from='osd.5 [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:54:15.228 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:14 smithi194 ceph-mon[46737]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T10:54:15.228 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:14 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:15.228 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:14 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:15.249 DEBUG:teuthology.orchestra.run.smithi194:osd.5> sudo journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.5.service 2024-04-13T10:54:15.251 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-13T10:54:15.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd stat -f json 2024-04-13T10:54:15.282 INFO:journalctl@ceph.osd.5.smithi194.stdout:-- Logs begin at Sat 2024-04-13 10:37:46 UTC. -- 2024-04-13T10:54:15.494 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:16.061 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:15 smithi134 ceph-mon[39696]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:16.062 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:15 smithi134 ceph-mon[39696]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-04-13T10:54:16.062 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:15 smithi134 ceph-mon[39696]: osdmap e38: 6 total, 5 up, 6 in 2024-04-13T10:54:16.062 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:15 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:54:16.062 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:15 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:54:16.062 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:15 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:16.062 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:15 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:16.210 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:15 smithi194 ceph-mon[46737]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:16.210 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:15 smithi194 ceph-mon[46737]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-04-13T10:54:16.210 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:15 smithi194 ceph-mon[46737]: osdmap e38: 6 total, 5 up, 6 in 2024-04-13T10:54:16.210 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:15 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:54:16.210 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:15 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:54:16.210 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:15 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:16.210 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:15 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:17.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:16 smithi134 ceph-mon[39696]: purged_snaps scrub starts 2024-04-13T10:54:17.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:16 smithi134 ceph-mon[39696]: purged_snaps scrub ok 2024-04-13T10:54:17.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:16 smithi134 ceph-mon[39696]: osd.5 [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628] boot 2024-04-13T10:54:17.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:16 smithi134 ceph-mon[39696]: osdmap e39: 6 total, 6 up, 6 in 2024-04-13T10:54:17.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:16 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:54:17.195 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:16 smithi194 ceph-mon[46737]: purged_snaps scrub starts 2024-04-13T10:54:17.195 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:16 smithi194 ceph-mon[46737]: purged_snaps scrub ok 2024-04-13T10:54:17.195 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:16 smithi194 ceph-mon[46737]: osd.5 [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628] boot 2024-04-13T10:54:17.195 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:16 smithi194 ceph-mon[46737]: osdmap e39: 6 total, 6 up, 6 in 2024-04-13T10:54:17.195 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:16 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:54:17.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.580+0000 7ff337355700 1 -- 172.21.15.134:0/245962419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff330100250 msgr2=0x7ff3301006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:17.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.580+0000 7ff337355700 1 --2- 172.21.15.134:0/245962419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff330100250 0x7ff3301006a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff32c009910 tx=0x7ff32c009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:17.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.580+0000 7ff337355700 1 -- 172.21.15.134:0/245962419 shutdown_connections 2024-04-13T10:54:17.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.580+0000 7ff337355700 1 --2- 172.21.15.134:0/245962419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff330100250 0x7ff3301006a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:17.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.580+0000 7ff337355700 1 --2- 172.21.15.134:0/245962419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3300ff050 0x7ff3300ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:17.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.580+0000 7ff337355700 1 -- 172.21.15.134:0/245962419 >> 172.21.15.134:0/245962419 conn(0x7ff3300fa5e0 msgr2=0x7ff3300fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:17.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.580+0000 7ff337355700 1 -- 172.21.15.134:0/245962419 shutdown_connections 2024-04-13T10:54:17.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.580+0000 7ff337355700 1 -- 172.21.15.134:0/245962419 wait complete. 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff337355700 1 Processor -- start 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff337355700 1 -- start start 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff337355700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3300ff050 0x7ff330195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff337355700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff330100250 0x7ff330195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff337355700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3301963f0 con 0x7ff3300ff050 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff337355700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff330196530 con 0x7ff330100250 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff3350f1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3300ff050 0x7ff330195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff3350f1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3300ff050 0x7ff330195890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47446/0 (socket says 172.21.15.134:47446) 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff3350f1700 1 -- 172.21.15.134:0/644914128 learned_addr learned my addr 172.21.15.134:0/644914128 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff3348f0700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff330100250 0x7ff330195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff3350f1700 1 -- 172.21.15.134:0/644914128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff330100250 msgr2=0x7ff330195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:17.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff3350f1700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff330100250 0x7ff330195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:17.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff3350f1700 1 -- 172.21.15.134:0/644914128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c0095f0 con 0x7ff3300ff050 2024-04-13T10:54:17.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff3350f1700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3300ff050 0x7ff330195890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff32000d900 tx=0x7ff32000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:17.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.581+0000 7ff3267fc700 1 -- 172.21.15.134:0/644914128 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3200041f0 con 0x7ff3300ff050 2024-04-13T10:54:17.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.582+0000 7ff337355700 1 -- 172.21.15.134:0/644914128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33019afe0 con 0x7ff3300ff050 2024-04-13T10:54:17.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.582+0000 7ff3267fc700 1 -- 172.21.15.134:0/644914128 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7ff320004350 con 0x7ff3300ff050 2024-04-13T10:54:17.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.582+0000 7ff3267fc700 1 -- 172.21.15.134:0/644914128 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff320003bf0 con 0x7ff3300ff050 2024-04-13T10:54:17.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.582+0000 7ff337355700 1 -- 172.21.15.134:0/644914128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33019b520 con 0x7ff3300ff050 2024-04-13T10:54:17.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.583+0000 7ff337355700 1 -- 172.21.15.134:0/644914128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff330107a60 con 0x7ff3300ff050 2024-04-13T10:54:17.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.583+0000 7ff3267fc700 1 -- 172.21.15.134:0/644914128 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ff320009730 con 0x7ff3300ff050 2024-04-13T10:54:17.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.583+0000 7ff3267fc700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff31c06c680 0x7ff31c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:17.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.583+0000 7ff3267fc700 1 -- 172.21.15.134:0/644914128 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff32008b500 con 0x7ff3300ff050 2024-04-13T10:54:17.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.583+0000 7ff3348f0700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff31c06c680 0x7ff31c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:17.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.584+0000 7ff3348f0700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff31c06c680 0x7ff31c06eb30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff32c006010 tx=0x7ff32c00b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:17.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.588+0000 7ff3267fc700 1 -- 172.21.15.134:0/644914128 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff3200599b0 con 0x7ff3300ff050 2024-04-13T10:54:17.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.776+0000 7ff337355700 1 -- 172.21.15.134:0/644914128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff330107c20 con 0x7ff3300ff050 2024-04-13T10:54:17.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.777+0000 7ff3267fc700 1 -- 172.21.15.134:0/644914128 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7ff320059540 con 0x7ff3300ff050 2024-04-13T10:54:17.778 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 -- 172.21.15.134:0/644914128 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff31c06c680 msgr2=0x7ff31c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff31c06c680 0x7ff31c06eb30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff32c006010 tx=0x7ff32c00b540 comp rx=0 tx=0).stop 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 -- 172.21.15.134:0/644914128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3300ff050 msgr2=0x7ff330195890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3300ff050 0x7ff330195890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff32000d900 tx=0x7ff32000dc10 comp rx=0 tx=0).stop 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 -- 172.21.15.134:0/644914128 shutdown_connections 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff31c06c680 0x7ff31c06eb30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3300ff050 0x7ff330195890 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 --2- 172.21.15.134:0/644914128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff330100250 0x7ff330195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 -- 172.21.15.134:0/644914128 >> 172.21.15.134:0/644914128 conn(0x7ff3300fa5e0 msgr2=0x7ff3300683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 -- 172.21.15.134:0/644914128 shutdown_connections 2024-04-13T10:54:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:17.779+0000 7ff337355700 1 -- 172.21.15.134:0/644914128 wait complete. 2024-04-13T10:54:18.095 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:17 smithi134 ceph-mon[39696]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:18.095 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:17 smithi134 ceph-mon[39696]: osdmap e40: 6 total, 6 up, 6 in 2024-04-13T10:54:18.095 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:17 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/644914128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-13T10:54:18.200 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:17 smithi194 ceph-mon[46737]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-04-13T10:54:18.200 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:17 smithi194 ceph-mon[46737]: osdmap e40: 6 total, 6 up, 6 in 2024-04-13T10:54:18.200 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:17 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/644914128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-13T10:54:18.479 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1713005655,"num_in_osds":6,"osd_in_since":1713005636,"num_remapped_pgs":0} 2024-04-13T10:54:18.480 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd dump --format=json 2024-04-13T10:54:18.705 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:20.072 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:20.072 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:54:20.073 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:20.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:54:20.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:54:20.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.348+0000 7f8455bb8700 1 -- 172.21.15.134:0/1291631555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84501003b0 msgr2=0x7f8450100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:20.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.348+0000 7f8455bb8700 1 --2- 172.21.15.134:0/1291631555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84501003b0 0x7f8450100780 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8448009910 tx=0x7f8448009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:20.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.348+0000 7f8455bb8700 1 -- 172.21.15.134:0/1291631555 shutdown_connections 2024-04-13T10:54:20.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.348+0000 7f8455bb8700 1 --2- 172.21.15.134:0/1291631555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8450100d50 0x7f8450104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:20.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.348+0000 7f8455bb8700 1 --2- 172.21.15.134:0/1291631555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84501003b0 0x7f8450100780 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:20.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.348+0000 7f8455bb8700 1 -- 172.21.15.134:0/1291631555 >> 172.21.15.134:0/1291631555 conn(0x7f84500fbc30 msgr2=0x7f84500fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:20.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.348+0000 7f8455bb8700 1 -- 172.21.15.134:0/1291631555 shutdown_connections 2024-04-13T10:54:20.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.348+0000 7f8455bb8700 1 -- 172.21.15.134:0/1291631555 wait complete. 2024-04-13T10:54:20.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.349+0000 7f8455bb8700 1 Processor -- start 2024-04-13T10:54:20.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.349+0000 7f8455bb8700 1 -- start start 2024-04-13T10:54:20.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.349+0000 7f8455bb8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501003b0 0x7f8450073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:20.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.349+0000 7f8455bb8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8450100d50 0x7f8450073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.349+0000 7f8455bb8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8450073ad0 con 0x7f8450100d50 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.349+0000 7f8455bb8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8450073c10 con 0x7f84501003b0 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.349+0000 7f844effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8450100d50 0x7f8450073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.349+0000 7f844effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8450100d50 0x7f8450073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50624/0 (socket says 172.21.15.134:50624) 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.349+0000 7f844effd700 1 -- 172.21.15.134:0/3162382019 learned_addr learned my addr 172.21.15.134:0/3162382019 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.349+0000 7f844f7fe700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501003b0 0x7f8450073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.350+0000 7f844effd700 1 -- 172.21.15.134:0/3162382019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501003b0 msgr2=0x7f8450073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.350+0000 7f844effd700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501003b0 0x7f8450073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.350+0000 7f844effd700 1 -- 172.21.15.134:0/3162382019 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84480095f0 con 0x7f8450100d50 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.350+0000 7f844effd700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8450100d50 0x7f8450073590 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f844400b480 tx=0x7f844400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.350+0000 7f844cff9700 1 -- 172.21.15.134:0/3162382019 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8444011800 con 0x7f8450100d50 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.350+0000 7f8455bb8700 1 -- 172.21.15.134:0/3162382019 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84501a1f30 con 0x7f8450100d50 2024-04-13T10:54:20.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.350+0000 7f844cff9700 1 -- 172.21.15.134:0/3162382019 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f8444011df0 con 0x7f8450100d50 2024-04-13T10:54:20.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.350+0000 7f844cff9700 1 -- 172.21.15.134:0/3162382019 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8444010e30 con 0x7f8450100d50 2024-04-13T10:54:20.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.350+0000 7f8455bb8700 1 -- 172.21.15.134:0/3162382019 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84501a2340 con 0x7f8450100d50 2024-04-13T10:54:20.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.351+0000 7f8455bb8700 1 -- 172.21.15.134:0/3162382019 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84501086c0 con 0x7f8450100d50 2024-04-13T10:54:20.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.352+0000 7f844cff9700 1 -- 172.21.15.134:0/3162382019 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f8444011960 con 0x7f8450100d50 2024-04-13T10:54:20.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.352+0000 7f844cff9700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f843806c680 0x7f843806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:20.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.352+0000 7f844cff9700 1 -- 172.21.15.134:0/3162382019 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f844408b4a0 con 0x7f8450100d50 2024-04-13T10:54:20.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.352+0000 7f844f7fe700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f843806c680 0x7f843806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:20.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.352+0000 7f844f7fe700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f843806c680 0x7f843806eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8448006010 tx=0x7f844801a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:20.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.356+0000 7f844cff9700 1 -- 172.21.15.134:0/3162382019 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8444055f40 con 0x7f8450100d50 2024-04-13T10:54:20.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.546+0000 7f8455bb8700 1 -- 172.21.15.134:0/3162382019 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f845004ea50 con 0x7f8450100d50 2024-04-13T10:54:20.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.547+0000 7f844cff9700 1 -- 172.21.15.134:0/3162382019 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11387 (secure 0 0 0) 0x7f8444059560 con 0x7f8450100d50 2024-04-13T10:54:20.548 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:54:20.548 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":40,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","created":"2024-04-13T10:48:00.547311+0000","modified":"2024-04-13T10:54:17.317571+0000","last_up_change":"2024-04-13T10:54:15.809542+0000","last_in_change":"2024-04-13T10:53:56.134815+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T10:52:52.594710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02af0f03-a267-4906-8417-d15189c8da92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6803","nonce":1676110195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6805","nonce":1676110195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6809","nonce":1676110195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6807","nonce":1676110195}]},"public_addr":"172.21.15.134:6803/1676110195","cluster_addr":"172.21.15.134:6805/1676110195","heartbeat_back_addr":"172.21.15.134:6809/1676110195","heartbeat_front_addr":"172.21.15.134:6807/1676110195","state":["exists","up"]},{"osd":1,"uuid":"ce202f5e-9c58-4cd6-b85b-1422131948d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6811","nonce":3488984333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6813","nonce":3488984333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6817","nonce":3488984333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6815","nonce":3488984333}]},"public_addr":"172.21.15.134:6811/3488984333","cluster_addr":"172.21.15.134:6813/3488984333","heartbeat_back_addr":"172.21.15.134:6817/3488984333","heartbeat_front_addr":"172.21.15.134:6815/3488984333","state":["exists","up"]},{"osd":2,"uuid":"7a2fef79-8403-416e-9037-079ddb080611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6819","nonce":768398169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6821","nonce":768398169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6825","nonce":768398169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6823","nonce":768398169}]},"public_addr":"172.21.15.134:6819/768398169","cluster_addr":"172.21.15.134:6821/768398169","heartbeat_back_addr":"172.21.15.134:6825/768398169","heartbeat_front_addr":"172.21.15.134:6823/768398169","state":["exists","up"]},{"osd":3,"uuid":"44c0411c-d9e0-4d23-b97d-f613b89943a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6801","nonce":3197529117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6803","nonce":3197529117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6807","nonce":3197529117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6805","nonce":3197529117}]},"public_addr":"172.21.15.194:6801/3197529117","cluster_addr":"172.21.15.194:6803/3197529117","heartbeat_back_addr":"172.21.15.194:6807/3197529117","heartbeat_front_addr":"172.21.15.194:6805/3197529117","state":["exists","up"]},{"osd":4,"uuid":"91533b98-bd92-4d8e-afa6-59c396f95799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6809","nonce":3191948930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6811","nonce":3191948930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6815","nonce":3191948930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6813","nonce":3191948930}]},"public_addr":"172.21.15.194:6809/3191948930","cluster_addr":"172.21.15.194:6811/3191948930","heartbeat_back_addr":"172.21.15.194:6815/3191948930","heartbeat_front_addr":"172.21.15.194:6813/3191948930","state":["exists","up"]},{"osd":5,"uuid":"3e198b03-2011-435c-afd8-16d8521b9991","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6817","nonce":1929560628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6819","nonce":1929560628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6823","nonce":1929560628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6821","nonce":1929560628}]},"public_addr":"172.21.15.194:6817/1929560628","cluster_addr":"172.21.15.194:6819/1929560628","heartbeat_back_addr":"172.21.15.194:6823/1929560628","heartbeat_front_addr":"172.21.15.194:6821/1929560628","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:51:48.117416+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:17.805248+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:49.973117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:17.604636+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:46.014087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:54:14.654274+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:0/323045534":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/3055528347":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6800/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6801/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/2590154845":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/565739211":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/4116995009":"2024-04-14T10:49:08.875132+0000","172.21.15.134:6801/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/2783735336":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6801/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/1090834434":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6800/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/471716030":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/3885996389":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6800/1656434316":"2024-04-14T10:49:08.875132+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T10:54:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 -- 172.21.15.134:0/3162382019 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f843806c680 msgr2=0x7f843806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f843806c680 0x7f843806eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8448006010 tx=0x7f844801a040 comp rx=0 tx=0).stop 2024-04-13T10:54:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 -- 172.21.15.134:0/3162382019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8450100d50 msgr2=0x7f8450073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8450100d50 0x7f8450073590 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f844400b480 tx=0x7f844400b790 comp rx=0 tx=0).stop 2024-04-13T10:54:20.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 -- 172.21.15.134:0/3162382019 shutdown_connections 2024-04-13T10:54:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f843806c680 0x7f843806eb30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84501003b0 0x7f8450073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 --2- 172.21.15.134:0/3162382019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8450100d50 0x7f8450073590 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 -- 172.21.15.134:0/3162382019 >> 172.21.15.134:0/3162382019 conn(0x7f84500fbc30 msgr2=0x7f84500fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 -- 172.21.15.134:0/3162382019 shutdown_connections 2024-04-13T10:54:20.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:20.549+0000 7f8455bb8700 1 -- 172.21.15.134:0/3162382019 wait complete. 2024-04-13T10:54:21.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:20 smithi134 ceph-mon[39696]: Detected new or changed devices on smithi194 2024-04-13T10:54:21.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:20 smithi134 ceph-mon[39696]: Adjusting osd_memory_target on smithi194 to 4982M 2024-04-13T10:54:21.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:20 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3162382019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T10:54:21.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:20 smithi194 ceph-mon[46737]: Detected new or changed devices on smithi194 2024-04-13T10:54:21.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:20 smithi194 ceph-mon[46737]: Adjusting osd_memory_target on smithi194 to 4982M 2024-04-13T10:54:21.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:20 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3162382019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T10:54:21.399 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T10:52:52.594710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T10:54:21.399 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-13T10:54:21.625 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:22.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:21 smithi134 ceph-mon[39696]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:22.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:21 smithi194 ceph-mon[46737]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.424+0000 7faf195d2700 1 -- 172.21.15.134:0/801416481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf140ff310 msgr2=0x7faf140ff6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.424+0000 7faf195d2700 1 --2- 172.21.15.134:0/801416481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf140ff310 0x7faf140ff6e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf08009910 tx=0x7faf08009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.424+0000 7faf195d2700 1 -- 172.21.15.134:0/801416481 shutdown_connections 2024-04-13T10:54:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.424+0000 7faf195d2700 1 --2- 172.21.15.134:0/801416481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ffcb0 0x7faf14103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.424+0000 7faf195d2700 1 --2- 172.21.15.134:0/801416481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf140ff310 0x7faf140ff6e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.424+0000 7faf195d2700 1 -- 172.21.15.134:0/801416481 >> 172.21.15.134:0/801416481 conn(0x7faf140fabb0 msgr2=0x7faf140fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.424+0000 7faf195d2700 1 -- 172.21.15.134:0/801416481 shutdown_connections 2024-04-13T10:54:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.424+0000 7faf195d2700 1 -- 172.21.15.134:0/801416481 wait complete. 2024-04-13T10:54:23.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf195d2700 1 Processor -- start 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf195d2700 1 -- start start 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf195d2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf140ff310 0x7faf14196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf195d2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ffcb0 0x7faf14197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf195d2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf14197670 con 0x7faf140ff310 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf195d2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf141977b0 con 0x7faf140ffcb0 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf12ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf140ff310 0x7faf14196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf12ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf140ff310 0x7faf14196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50646/0 (socket says 172.21.15.134:50646) 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf12ffd700 1 -- 172.21.15.134:0/1203424315 learned_addr learned my addr 172.21.15.134:0/1203424315 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf127fc700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ffcb0 0x7faf14197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf12ffd700 1 -- 172.21.15.134:0/1203424315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ffcb0 msgr2=0x7faf14197050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf12ffd700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ffcb0 0x7faf14197050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf12ffd700 1 -- 172.21.15.134:0/1203424315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf080095f0 con 0x7faf140ff310 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf127fc700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ffcb0 0x7faf14197050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T10:54:23.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.425+0000 7faf12ffd700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf140ff310 0x7faf14196b10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf08006010 tx=0x7faf0800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:23.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.426+0000 7faefbfff700 1 -- 172.21.15.134:0/1203424315 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf0801d070 con 0x7faf140ff310 2024-04-13T10:54:23.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.426+0000 7faefbfff700 1 -- 172.21.15.134:0/1203424315 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7faf0800f460 con 0x7faf140ff310 2024-04-13T10:54:23.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.426+0000 7faefbfff700 1 -- 172.21.15.134:0/1203424315 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf08021620 con 0x7faf140ff310 2024-04-13T10:54:23.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.426+0000 7faf195d2700 1 -- 172.21.15.134:0/1203424315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1419fb80 con 0x7faf140ff310 2024-04-13T10:54:23.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.426+0000 7faf195d2700 1 -- 172.21.15.134:0/1203424315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1419ff90 con 0x7faf140ff310 2024-04-13T10:54:23.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.427+0000 7faf195d2700 1 -- 172.21.15.134:0/1203424315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf14107620 con 0x7faf140ff310 2024-04-13T10:54:23.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.427+0000 7faefbfff700 1 -- 172.21.15.134:0/1203424315 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7faf0800fa40 con 0x7faf140ff310 2024-04-13T10:54:23.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.427+0000 7faefbfff700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faefc06c680 0x7faefc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:23.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.427+0000 7faefbfff700 1 -- 172.21.15.134:0/1203424315 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7faf0808c6c0 con 0x7faf140ff310 2024-04-13T10:54:23.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.427+0000 7faf127fc700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faefc06c680 0x7faefc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:23.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.428+0000 7faf127fc700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faefc06c680 0x7faefc06eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf04005950 tx=0x7faf040058e0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:23.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.432+0000 7faefbfff700 1 -- 172.21.15.134:0/1203424315 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faf08057160 con 0x7faf140ff310 2024-04-13T10:54:23.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.620+0000 7faf195d2700 1 -- 172.21.15.134:0/1203424315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf14069430 con 0x7faf140ff310 2024-04-13T10:54:23.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.621+0000 7faefbfff700 1 -- 172.21.15.134:0/1203424315 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf0805a780 con 0x7faf140ff310 2024-04-13T10:54:23.622 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-04-13T10:54:23.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.622+0000 7faf195d2700 1 -- 172.21.15.134:0/1203424315 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faefc06c680 msgr2=0x7faefc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:23.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.622+0000 7faf195d2700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faefc06c680 0x7faefc06eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf04005950 tx=0x7faf040058e0 comp rx=0 tx=0).stop 2024-04-13T10:54:23.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.623+0000 7faf195d2700 1 -- 172.21.15.134:0/1203424315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf140ff310 msgr2=0x7faf14196b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:23.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.623+0000 7faf195d2700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf140ff310 0x7faf14196b10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf08006010 tx=0x7faf0800be20 comp rx=0 tx=0).stop 2024-04-13T10:54:23.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.623+0000 7faf195d2700 1 -- 172.21.15.134:0/1203424315 shutdown_connections 2024-04-13T10:54:23.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.623+0000 7faf195d2700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faefc06c680 0x7faefc06eb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:23.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.623+0000 7faf195d2700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf140ff310 0x7faf14196b10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:23.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.623+0000 7faf195d2700 1 --2- 172.21.15.134:0/1203424315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf140ffcb0 0x7faf14197050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:23.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.623+0000 7faf195d2700 1 -- 172.21.15.134:0/1203424315 >> 172.21.15.134:0/1203424315 conn(0x7faf140fabb0 msgr2=0x7faf140fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:23.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.623+0000 7faf195d2700 1 -- 172.21.15.134:0/1203424315 shutdown_connections 2024-04-13T10:54:23.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:23.623+0000 7faf195d2700 1 -- 172.21.15.134:0/1203424315 wait complete. 2024-04-13T10:54:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:23 smithi134 ceph-mon[39696]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:23 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1203424315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-13T10:54:24.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:23 smithi194 ceph-mon[46737]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:24.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:23 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/1203424315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-13T10:54:24.448 INFO:tasks.cephadm:Setting up client nodes... 2024-04-13T10:54:24.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-13T10:54:24.675 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:25.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:25 smithi134 ceph-mon[39696]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:25 smithi194 ceph-mon[46737]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:26.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.617+0000 7fb2a7717700 1 -- 172.21.15.134:0/153172112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00ff050 msgr2=0x7fb2a00ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:26.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.617+0000 7fb2a7717700 1 --2- 172.21.15.134:0/153172112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00ff050 0x7fb2a00ff460 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009910 tx=0x7fb29c009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:26.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.617+0000 7fb2a7717700 1 -- 172.21.15.134:0/153172112 shutdown_connections 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.617+0000 7fb2a7717700 1 --2- 172.21.15.134:0/153172112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2a0100250 0x7fb2a01006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.617+0000 7fb2a7717700 1 --2- 172.21.15.134:0/153172112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a00ff050 0x7fb2a00ff460 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.617+0000 7fb2a7717700 1 -- 172.21.15.134:0/153172112 >> 172.21.15.134:0/153172112 conn(0x7fb2a00fa600 msgr2=0x7fb2a00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a7717700 1 -- 172.21.15.134:0/153172112 shutdown_connections 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a7717700 1 -- 172.21.15.134:0/153172112 wait complete. 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a7717700 1 Processor -- start 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a7717700 1 -- start start 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a7717700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2a00ff050 0x7fb2a01948c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a7717700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a0100250 0x7fb2a0194e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a7717700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0195420 con 0x7fb2a0100250 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a7717700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0195560 con 0x7fb2a00ff050 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a4cb2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a0100250 0x7fb2a0194e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a4cb2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a0100250 0x7fb2a0194e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50668/0 (socket says 172.21.15.134:50668) 2024-04-13T10:54:26.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.618+0000 7fb2a4cb2700 1 -- 172.21.15.134:0/3184719314 learned_addr learned my addr 172.21.15.134:0/3184719314 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.619+0000 7fb2a54b3700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2a00ff050 0x7fb2a01948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.619+0000 7fb2a4cb2700 1 -- 172.21.15.134:0/3184719314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2a00ff050 msgr2=0x7fb2a01948c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.619+0000 7fb2a4cb2700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2a00ff050 0x7fb2a01948c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.619+0000 7fb2a4cb2700 1 -- 172.21.15.134:0/3184719314 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c0095f0 con 0x7fb2a0100250 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.619+0000 7fb2a4cb2700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a0100250 0x7fb2a0194e00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb29000d960 tx=0x7fb29000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.619+0000 7fb2967fc700 1 -- 172.21.15.134:0/3184719314 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb29000ec20 con 0x7fb2a0100250 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.619+0000 7fb2967fc700 1 -- 172.21.15.134:0/3184719314 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fb29000ed80 con 0x7fb2a0100250 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.619+0000 7fb2a7717700 1 -- 172.21.15.134:0/3184719314 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a0068cc0 con 0x7fb2a0100250 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.619+0000 7fb2967fc700 1 -- 172.21.15.134:0/3184719314 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb290014700 con 0x7fb2a0100250 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.619+0000 7fb2a7717700 1 -- 172.21.15.134:0/3184719314 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a0069290 con 0x7fb2a0100250 2024-04-13T10:54:26.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.620+0000 7fb2a7717700 1 -- 172.21.15.134:0/3184719314 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a0107ae0 con 0x7fb2a0100250 2024-04-13T10:54:26.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.620+0000 7fb2967fc700 1 -- 172.21.15.134:0/3184719314 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fb290016440 con 0x7fb2a0100250 2024-04-13T10:54:26.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.621+0000 7fb2967fc700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb28c06c680 0x7fb28c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:26.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.621+0000 7fb2967fc700 1 -- 172.21.15.134:0/3184719314 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb29008ce70 con 0x7fb2a0100250 2024-04-13T10:54:26.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.621+0000 7fb2a54b3700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb28c06c680 0x7fb28c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:26.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.621+0000 7fb2a54b3700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb28c06c680 0x7fb28c06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0059d0 tx=0x7fb29c005960 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:26.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.625+0000 7fb2967fc700 1 -- 172.21.15.134:0/3184719314 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb290050720 con 0x7fb2a0100250 2024-04-13T10:54:26.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.897+0000 7fb2a7717700 1 -- 172.21.15.134:0/3184719314 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb2a0107ca0 con 0x7fb2a0100250 2024-04-13T10:54:26.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.901+0000 7fb2967fc700 1 -- 172.21.15.134:0/3184719314 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb29001b050 con 0x7fb2a0100250 2024-04-13T10:54:26.901 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-04-13T10:54:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBiZBpm6l2TNRAAXqbH/MyeB9Xj1UdNBNONgQ== 2024-04-13T10:54:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 -- 172.21.15.134:0/3184719314 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb28c06c680 msgr2=0x7fb28c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb28c06c680 0x7fb28c06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0059d0 tx=0x7fb29c005960 comp rx=0 tx=0).stop 2024-04-13T10:54:26.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 -- 172.21.15.134:0/3184719314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a0100250 msgr2=0x7fb2a0194e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a0100250 0x7fb2a0194e00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb29000d960 tx=0x7fb29000dd20 comp rx=0 tx=0).stop 2024-04-13T10:54:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 -- 172.21.15.134:0/3184719314 shutdown_connections 2024-04-13T10:54:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb28c06c680 0x7fb28c06eb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2a00ff050 0x7fb2a01948c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 --2- 172.21.15.134:0/3184719314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2a0100250 0x7fb2a0194e00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 -- 172.21.15.134:0/3184719314 >> 172.21.15.134:0/3184719314 conn(0x7fb2a00fa600 msgr2=0x7fb2a0103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 -- 172.21.15.134:0/3184719314 shutdown_connections 2024-04-13T10:54:26.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:26.903+0000 7fb2a7717700 1 -- 172.21.15.134:0/3184719314 wait complete. 2024-04-13T10:54:27.743 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:54:27.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-13T10:54:27.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-13T10:54:27.785 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-13T10:54:28.026 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi194/config 2024-04-13T10:54:28.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:27 smithi134 ceph-mon[39696]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:28.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:27 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3184719314' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-13T10:54:28.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:27 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3184719314' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-13T10:54:28.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:27 smithi194 ceph-mon[46737]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:28.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:27 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3184719314' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-13T10:54:28.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:27 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3184719314' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-13T10:54:29.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:54:29.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:28 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:54:29.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.861+0000 7fcb6efe1700 1 -- 172.21.15.194:0/236215875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb68100c40 msgr2=0x7fcb68103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:29.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.861+0000 7fcb6efe1700 1 --2- 172.21.15.194:0/236215875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb68100c40 0x7fcb68103020 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009910 tx=0x7fcb5c009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:29.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.861+0000 7fcb6efe1700 1 -- 172.21.15.194:0/236215875 shutdown_connections 2024-04-13T10:54:29.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.861+0000 7fcb6efe1700 1 --2- 172.21.15.194:0/236215875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb68103560 0x7fcb68105940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:29.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.861+0000 7fcb6efe1700 1 --2- 172.21.15.194:0/236215875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb68100c40 0x7fcb68103020 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:29.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.861+0000 7fcb6efe1700 1 -- 172.21.15.194:0/236215875 >> 172.21.15.194:0/236215875 conn(0x7fcb680fa5e0 msgr2=0x7fcb680fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:29.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.861+0000 7fcb6efe1700 1 -- 172.21.15.194:0/236215875 shutdown_connections 2024-04-13T10:54:29.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.861+0000 7fcb6efe1700 1 -- 172.21.15.194:0/236215875 wait complete. 2024-04-13T10:54:29.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.861+0000 7fcb6efe1700 1 Processor -- start 2024-04-13T10:54:29.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.861+0000 7fcb6efe1700 1 -- start start 2024-04-13T10:54:29.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6efe1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb68100c40 0x7fcb68195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:29.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6efe1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb68103560 0x7fcb68195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:29.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6efe1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb681963d0 con 0x7fcb68103560 2024-04-13T10:54:29.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6efe1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb68196510 con 0x7fcb68100c40 2024-04-13T10:54:29.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6cd7d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb68100c40 0x7fcb68195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:29.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6cd7d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb68100c40 0x7fcb68195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49822/0 (socket says 172.21.15.194:49822) 2024-04-13T10:54:29.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6cd7d700 1 -- 172.21.15.194:0/1339774367 learned_addr learned my addr 172.21.15.194:0/1339774367 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-04-13T10:54:29.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb67fff700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb68103560 0x7fcb68195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:29.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6cd7d700 1 -- 172.21.15.194:0/1339774367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb68103560 msgr2=0x7fcb68195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:29.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6cd7d700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb68103560 0x7fcb68195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:29.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6cd7d700 1 -- 172.21.15.194:0/1339774367 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c0095f0 con 0x7fcb68100c40 2024-04-13T10:54:29.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6cd7d700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb68100c40 0x7fcb68195870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00bd70 tx=0x7fcb5c00bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:29.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb65ffb700 1 -- 172.21.15.194:0/1339774367 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5c01d070 con 0x7fcb68100c40 2024-04-13T10:54:29.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb65ffb700 1 -- 172.21.15.194:0/1339774367 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fcb5c00f460 con 0x7fcb68100c40 2024-04-13T10:54:29.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb65ffb700 1 -- 172.21.15.194:0/1339774367 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5c021640 con 0x7fcb68100c40 2024-04-13T10:54:29.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.862+0000 7fcb6efe1700 1 -- 172.21.15.194:0/1339774367 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6819af60 con 0x7fcb68100c40 2024-04-13T10:54:29.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.863+0000 7fcb6efe1700 1 -- 172.21.15.194:0/1339774367 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6819b450 con 0x7fcb68100c40 2024-04-13T10:54:29.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.864+0000 7fcb6efe1700 1 -- 172.21.15.194:0/1339774367 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6818fa30 con 0x7fcb68100c40 2024-04-13T10:54:29.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.864+0000 7fcb65ffb700 1 -- 172.21.15.194:0/1339774367 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fcb5c00fa20 con 0x7fcb68100c40 2024-04-13T10:54:29.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.864+0000 7fcb65ffb700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcb5806c680 0x7fcb5806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:29.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.865+0000 7fcb65ffb700 1 -- 172.21.15.194:0/1339774367 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fcb5c08c670 con 0x7fcb68100c40 2024-04-13T10:54:29.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.865+0000 7fcb67fff700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcb5806c680 0x7fcb5806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:29.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.865+0000 7fcb67fff700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcb5806c680 0x7fcb5806eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcb54005950 tx=0x7fcb5400b410 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:29.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:29.869+0000 7fcb65ffb700 1 -- 172.21.15.194:0/1339774367 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcb5c05aba0 con 0x7fcb68100c40 2024-04-13T10:54:30.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.133+0000 7fcb6efe1700 1 -- 172.21.15.194:0/1339774367 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fcb6802cc30 con 0x7fcb68100c40 2024-04-13T10:54:30.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.141+0000 7fcb65ffb700 1 -- 172.21.15.194:0/1339774367 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fcb5c05a730 con 0x7fcb68100c40 2024-04-13T10:54:30.141 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2024-04-13T10:54:30.142 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBmZBpmFOAgCBAAnF7nVC2j0Dx01pwelzsv3A== 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 -- 172.21.15.194:0/1339774367 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcb5806c680 msgr2=0x7fcb5806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcb5806c680 0x7fcb5806eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcb54005950 tx=0x7fcb5400b410 comp rx=0 tx=0).stop 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 -- 172.21.15.194:0/1339774367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb68100c40 msgr2=0x7fcb68195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb68100c40 0x7fcb68195870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00bd70 tx=0x7fcb5c00bda0 comp rx=0 tx=0).stop 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 -- 172.21.15.194:0/1339774367 shutdown_connections 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcb5806c680 0x7fcb5806eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb68100c40 0x7fcb68195870 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 --2- 172.21.15.194:0/1339774367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb68103560 0x7fcb68195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 -- 172.21.15.194:0/1339774367 >> 172.21.15.194:0/1339774367 conn(0x7fcb680fa5e0 msgr2=0x7fcb680fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 -- 172.21.15.194:0/1339774367 shutdown_connections 2024-04-13T10:54:30.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-04-13T10:54:30.143+0000 7fcb6efe1700 1 -- 172.21.15.194:0/1339774367 wait complete. 2024-04-13T10:54:30.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:29 smithi194 ceph-mon[46737]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:30.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:29 smithi134 ceph-mon[39696]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:30.875 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:54:30.875 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-13T10:54:30.875 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-13T10:54:30.915 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-13T10:54:30.915 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-13T10:54:30.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph mgr dump --format=json 2024-04-13T10:54:31.152 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:31.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:30 smithi134 ceph-mon[39696]: from='client.? 172.21.15.194:0/1339774367' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-13T10:54:31.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:30 smithi134 ceph-mon[39696]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-13T10:54:31.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:30 smithi134 ceph-mon[39696]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-13T10:54:31.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:30 smithi134 ceph-mon[39696]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:31.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:30 smithi194 ceph-mon[46737]: from='client.? 172.21.15.194:0/1339774367' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-13T10:54:31.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:30 smithi194 ceph-mon[46737]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-13T10:54:31.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:30 smithi194 ceph-mon[46737]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-13T10:54:31.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:30 smithi194 ceph-mon[46737]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:33.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.046+0000 7fdb2198d700 1 -- 172.21.15.134:0/304350972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103860 msgr2=0x7fdb1c103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.046+0000 7fdb2198d700 1 --2- 172.21.15.134:0/304350972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103860 0x7fdb1c103c30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000aa20 tx=0x7fdb1000ad30 comp rx=0 tx=0).stop 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.046+0000 7fdb2198d700 1 -- 172.21.15.134:0/304350972 shutdown_connections 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.046+0000 7fdb2198d700 1 --2- 172.21.15.134:0/304350972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb1c0ff320 0x7fdb1c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.046+0000 7fdb2198d700 1 --2- 172.21.15.134:0/304350972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103860 0x7fdb1c103c30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.046+0000 7fdb2198d700 1 -- 172.21.15.134:0/304350972 >> 172.21.15.134:0/304350972 conn(0x7fdb1c0748b0 msgr2=0x7fdb1c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.046+0000 7fdb2198d700 1 -- 172.21.15.134:0/304350972 shutdown_connections 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.046+0000 7fdb2198d700 1 -- 172.21.15.134:0/304350972 wait complete. 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.047+0000 7fdb2198d700 1 Processor -- start 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.047+0000 7fdb2198d700 1 -- start start 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.047+0000 7fdb2198d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb1c0ff320 0x7fdb1c19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.047+0000 7fdb2198d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103860 0x7fdb1c19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.047+0000 7fdb2198d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c19c550 con 0x7fdb1c103860 2024-04-13T10:54:33.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.047+0000 7fdb2198d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c195a00 con 0x7fdb1c0ff320 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.047+0000 7fdb1a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103860 0x7fdb1c19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.047+0000 7fdb1a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103860 0x7fdb1c19bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60312/0 (socket says 172.21.15.134:60312) 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.047+0000 7fdb1a7fc700 1 -- 172.21.15.134:0/2638132327 learned_addr learned my addr 172.21.15.134:0/2638132327 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.047+0000 7fdb1affd700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb1c0ff320 0x7fdb1c19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.048+0000 7fdb1a7fc700 1 -- 172.21.15.134:0/2638132327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb1c0ff320 msgr2=0x7fdb1c19b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.048+0000 7fdb1a7fc700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb1c0ff320 0x7fdb1c19b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.048+0000 7fdb1a7fc700 1 -- 172.21.15.134:0/2638132327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1000a700 con 0x7fdb1c103860 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.048+0000 7fdb1a7fc700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103860 0x7fdb1c19bec0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00d8d0 tx=0x7fdb0c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.048+0000 7fdb2098b700 1 -- 172.21.15.134:0/2638132327 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0c0098a0 con 0x7fdb1c103860 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.048+0000 7fdb2098b700 1 -- 172.21.15.134:0/2638132327 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fdb0c009e90 con 0x7fdb1c103860 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.048+0000 7fdb2198d700 1 -- 172.21.15.134:0/2638132327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c195ce0 con 0x7fdb1c103860 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.048+0000 7fdb2098b700 1 -- 172.21.15.134:0/2638132327 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0c00f5f0 con 0x7fdb1c103860 2024-04-13T10:54:33.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.048+0000 7fdb2198d700 1 -- 172.21.15.134:0/2638132327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c1962b0 con 0x7fdb1c103860 2024-04-13T10:54:33.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.049+0000 7fdb2198d700 1 -- 172.21.15.134:0/2638132327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c108e30 con 0x7fdb1c103860 2024-04-13T10:54:33.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.050+0000 7fdb2098b700 1 -- 172.21.15.134:0/2638132327 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fdb0c010460 con 0x7fdb1c103860 2024-04-13T10:54:33.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.050+0000 7fdb2098b700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fdb0406c680 0x7fdb0406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:33.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.050+0000 7fdb2098b700 1 -- 172.21.15.134:0/2638132327 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fdb0c08b410 con 0x7fdb1c103860 2024-04-13T10:54:33.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.050+0000 7fdb1affd700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fdb0406c680 0x7fdb0406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:33.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.050+0000 7fdb1affd700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fdb0406c680 0x7fdb0406eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000afd0 tx=0x7fdb10005a90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:33.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.054+0000 7fdb2098b700 1 -- 172.21.15.134:0/2638132327 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdb0c0598c0 con 0x7fdb1c103860 2024-04-13T10:54:33.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.297+0000 7fdb2198d700 1 -- 172.21.15.134:0/2638132327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdb1c04ea50 con 0x7fdb1c103860 2024-04-13T10:54:33.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.300+0000 7fdb2098b700 1 -- 172.21.15.134:0/2638132327 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172864 (secure 0 0 0) 0x7fdb0c010710 con 0x7fdb1c103860 2024-04-13T10:54:33.303 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:54:33.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 -- 172.21.15.134:0/2638132327 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fdb0406c680 msgr2=0x7fdb0406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:33.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fdb0406c680 0x7fdb0406eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000afd0 tx=0x7fdb10005a90 comp rx=0 tx=0).stop 2024-04-13T10:54:33.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 -- 172.21.15.134:0/2638132327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103860 msgr2=0x7fdb1c19bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:33.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103860 0x7fdb1c19bec0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00d8d0 tx=0x7fdb0c00dbe0 comp rx=0 tx=0).stop 2024-04-13T10:54:33.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 -- 172.21.15.134:0/2638132327 shutdown_connections 2024-04-13T10:54:33.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fdb0406c680 0x7fdb0406eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:33.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb1c0ff320 0x7fdb1c19b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:33.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 --2- 172.21.15.134:0/2638132327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103860 0x7fdb1c19bec0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:33.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 -- 172.21.15.134:0/2638132327 >> 172.21.15.134:0/2638132327 conn(0x7fdb1c0748b0 msgr2=0x7fdb1c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:33.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 -- 172.21.15.134:0/2638132327 shutdown_connections 2024-04-13T10:54:33.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:33.303+0000 7fdb2198d700 1 -- 172.21.15.134:0/2638132327 wait complete. 2024-04-13T10:54:33.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:33 smithi194 ceph-mon[46737]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:33.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:33 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/2638132327' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-13T10:54:33.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:33 smithi134 ceph-mon[39696]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:33.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:33 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2638132327' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-13T10:54:34.148 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":19,"active_gid":14215,"active_name":"smithi134.tmanda","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2958657378},{"type":"v1","addr":"172.21.15.134:6801","nonce":2958657378}]},"active_addr":"172.21.15.134:6801/2958657378","active_change":"2024-04-13T10:50:28.273264+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14234,"name":"smithi194.tcpynt","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.134:8443/","prometheus":"http://172.21.15.134:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":4115016009}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1977594888}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1158318696}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3281134012}]}]} 2024-04-13T10:54:34.152 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-13T10:54:34.152 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-13T10:54:34.153 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd dump --format=json 2024-04-13T10:54:34.382 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:35.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:35 smithi134 ceph-mon[39696]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:35.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:35 smithi194 ceph-mon[46737]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:36.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.252+0000 7feeefbbc700 1 -- 172.21.15.134:0/30062086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee80ffc60 msgr2=0x7feee8103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:36.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.252+0000 7feeefbbc700 1 --2- 172.21.15.134:0/30062086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee80ffc60 0x7feee8103c30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feed8009910 tx=0x7feed8009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.252+0000 7feeefbbc700 1 -- 172.21.15.134:0/30062086 shutdown_connections 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.252+0000 7feeefbbc700 1 --2- 172.21.15.134:0/30062086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee80ffc60 0x7feee8103c30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.252+0000 7feeefbbc700 1 --2- 172.21.15.134:0/30062086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ff2c0 0x7feee80ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.252+0000 7feeefbbc700 1 -- 172.21.15.134:0/30062086 >> 172.21.15.134:0/30062086 conn(0x7feee80fab80 msgr2=0x7feee80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.252+0000 7feeefbbc700 1 -- 172.21.15.134:0/30062086 shutdown_connections 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.252+0000 7feeefbbc700 1 -- 172.21.15.134:0/30062086 wait complete. 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.252+0000 7feeefbbc700 1 Processor -- start 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.252+0000 7feeefbbc700 1 -- start start 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeefbbc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee80ff2c0 0x7feee8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeefbbc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ffc60 0x7feee81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeefbbc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee8198ac0 con 0x7feee80ff2c0 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeefbbc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee819c7e0 con 0x7feee80ffc60 2024-04-13T10:54:36.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeed958700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee80ff2c0 0x7feee8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeed958700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee80ff2c0 0x7feee8197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60326/0 (socket says 172.21.15.134:60326) 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeed958700 1 -- 172.21.15.134:0/2096587893 learned_addr learned my addr 172.21.15.134:0/2096587893 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeed157700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ffc60 0x7feee81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeed958700 1 -- 172.21.15.134:0/2096587893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ffc60 msgr2=0x7feee81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeed958700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ffc60 0x7feee81983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeed958700 1 -- 172.21.15.134:0/2096587893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed80095f0 con 0x7feee80ff2c0 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeed958700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee80ff2c0 0x7feee8197ea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feee400d900 tx=0x7feee400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feedeffd700 1 -- 172.21.15.134:0/2096587893 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee40041f0 con 0x7feee80ff2c0 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeefbbc700 1 -- 172.21.15.134:0/2096587893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee819cac0 con 0x7feee80ff2c0 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feedeffd700 1 -- 172.21.15.134:0/2096587893 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7feee4004cc0 con 0x7feee80ff2c0 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feedeffd700 1 -- 172.21.15.134:0/2096587893 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee4005660 con 0x7feee80ff2c0 2024-04-13T10:54:36.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.253+0000 7feeefbbc700 1 -- 172.21.15.134:0/2096587893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee819d010 con 0x7feee80ff2c0 2024-04-13T10:54:36.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.254+0000 7feeefbbc700 1 -- 172.21.15.134:0/2096587893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee804ea50 con 0x7feee80ff2c0 2024-04-13T10:54:36.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.255+0000 7feedeffd700 1 -- 172.21.15.134:0/2096587893 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7feee4004750 con 0x7feee80ff2c0 2024-04-13T10:54:36.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.255+0000 7feedeffd700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7feed406c680 0x7feed406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:36.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.255+0000 7feeed157700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7feed406c680 0x7feed406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:36.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.255+0000 7feedeffd700 1 -- 172.21.15.134:0/2096587893 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7feee408b3c0 con 0x7feee80ff2c0 2024-04-13T10:54:36.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.256+0000 7feeed157700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7feed406c680 0x7feed406eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feee8199450 tx=0x7feed801a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:36.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.259+0000 7feedeffd700 1 -- 172.21.15.134:0/2096587893 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7feee4055de0 con 0x7feee80ff2c0 2024-04-13T10:54:36.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.451+0000 7feeefbbc700 1 -- 172.21.15.134:0/2096587893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feee819d370 con 0x7feee80ff2c0 2024-04-13T10:54:36.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.452+0000 7feedeffd700 1 -- 172.21.15.134:0/2096587893 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11387 (secure 0 0 0) 0x7feee4059400 con 0x7feee80ff2c0 2024-04-13T10:54:36.453 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:54:36.453 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":40,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","created":"2024-04-13T10:48:00.547311+0000","modified":"2024-04-13T10:54:17.317571+0000","last_up_change":"2024-04-13T10:54:15.809542+0000","last_in_change":"2024-04-13T10:53:56.134815+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T10:52:52.594710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02af0f03-a267-4906-8417-d15189c8da92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6803","nonce":1676110195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6805","nonce":1676110195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6809","nonce":1676110195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6807","nonce":1676110195}]},"public_addr":"172.21.15.134:6803/1676110195","cluster_addr":"172.21.15.134:6805/1676110195","heartbeat_back_addr":"172.21.15.134:6809/1676110195","heartbeat_front_addr":"172.21.15.134:6807/1676110195","state":["exists","up"]},{"osd":1,"uuid":"ce202f5e-9c58-4cd6-b85b-1422131948d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6811","nonce":3488984333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6813","nonce":3488984333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6817","nonce":3488984333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6815","nonce":3488984333}]},"public_addr":"172.21.15.134:6811/3488984333","cluster_addr":"172.21.15.134:6813/3488984333","heartbeat_back_addr":"172.21.15.134:6817/3488984333","heartbeat_front_addr":"172.21.15.134:6815/3488984333","state":["exists","up"]},{"osd":2,"uuid":"7a2fef79-8403-416e-9037-079ddb080611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6819","nonce":768398169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6821","nonce":768398169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6825","nonce":768398169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6823","nonce":768398169}]},"public_addr":"172.21.15.134:6819/768398169","cluster_addr":"172.21.15.134:6821/768398169","heartbeat_back_addr":"172.21.15.134:6825/768398169","heartbeat_front_addr":"172.21.15.134:6823/768398169","state":["exists","up"]},{"osd":3,"uuid":"44c0411c-d9e0-4d23-b97d-f613b89943a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6801","nonce":3197529117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6803","nonce":3197529117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6807","nonce":3197529117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6805","nonce":3197529117}]},"public_addr":"172.21.15.194:6801/3197529117","cluster_addr":"172.21.15.194:6803/3197529117","heartbeat_back_addr":"172.21.15.194:6807/3197529117","heartbeat_front_addr":"172.21.15.194:6805/3197529117","state":["exists","up"]},{"osd":4,"uuid":"91533b98-bd92-4d8e-afa6-59c396f95799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6809","nonce":3191948930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6811","nonce":3191948930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6815","nonce":3191948930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6813","nonce":3191948930}]},"public_addr":"172.21.15.194:6809/3191948930","cluster_addr":"172.21.15.194:6811/3191948930","heartbeat_back_addr":"172.21.15.194:6815/3191948930","heartbeat_front_addr":"172.21.15.194:6813/3191948930","state":["exists","up"]},{"osd":5,"uuid":"3e198b03-2011-435c-afd8-16d8521b9991","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6817","nonce":1929560628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6819","nonce":1929560628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6823","nonce":1929560628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6821","nonce":1929560628}]},"public_addr":"172.21.15.194:6817/1929560628","cluster_addr":"172.21.15.194:6819/1929560628","heartbeat_back_addr":"172.21.15.194:6823/1929560628","heartbeat_front_addr":"172.21.15.194:6821/1929560628","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:51:48.117416+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:17.805248+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:49.973117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:17.604636+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:46.014087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:54:14.654274+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:0/323045534":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/3055528347":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6800/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6801/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/2590154845":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/565739211":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/4116995009":"2024-04-14T10:49:08.875132+0000","172.21.15.134:6801/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/2783735336":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6801/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/1090834434":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6800/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/471716030":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/3885996389":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6800/1656434316":"2024-04-14T10:49:08.875132+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 -- 172.21.15.134:0/2096587893 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7feed406c680 msgr2=0x7feed406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7feed406c680 0x7feed406eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feee8199450 tx=0x7feed801a040 comp rx=0 tx=0).stop 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 -- 172.21.15.134:0/2096587893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee80ff2c0 msgr2=0x7feee8197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee80ff2c0 0x7feee8197ea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feee400d900 tx=0x7feee400dc10 comp rx=0 tx=0).stop 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 -- 172.21.15.134:0/2096587893 shutdown_connections 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7feed406c680 0x7feed406eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee80ff2c0 0x7feee8197ea0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 --2- 172.21.15.134:0/2096587893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feee80ffc60 0x7feee81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 -- 172.21.15.134:0/2096587893 >> 172.21.15.134:0/2096587893 conn(0x7feee80fab80 msgr2=0x7feee8069570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 -- 172.21.15.134:0/2096587893 shutdown_connections 2024-04-13T10:54:36.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:36.454+0000 7feeefbbc700 1 -- 172.21.15.134:0/2096587893 wait complete. 2024-04-13T10:54:37.131 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-13T10:54:37.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd dump --format=json 2024-04-13T10:54:37.360 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:37.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:37 smithi134 ceph-mon[39696]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:37.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:37 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2096587893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T10:54:37.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:37 smithi194 ceph-mon[46737]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:37.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:37 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/2096587893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T10:54:39.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.414+0000 7f4e568e4700 1 -- 172.21.15.134:0/2658482650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50068630 msgr2=0x7f4e50068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:39.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.414+0000 7f4e568e4700 1 --2- 172.21.15.134:0/2658482650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50068630 0x7f4e50068a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009910 tx=0x7f4e40009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:39.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.414+0000 7f4e568e4700 1 -- 172.21.15.134:0/2658482650 shutdown_connections 2024-04-13T10:54:39.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.414+0000 7f4e568e4700 1 --2- 172.21.15.134:0/2658482650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50068fd0 0x7f4e50104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.414+0000 7f4e568e4700 1 --2- 172.21.15.134:0/2658482650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50068630 0x7f4e50068a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.414+0000 7f4e568e4700 1 -- 172.21.15.134:0/2658482650 >> 172.21.15.134:0/2658482650 conn(0x7f4e50074f50 msgr2=0x7f4e50075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.414+0000 7f4e568e4700 1 -- 172.21.15.134:0/2658482650 shutdown_connections 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.414+0000 7f4e568e4700 1 -- 172.21.15.134:0/2658482650 wait complete. 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.415+0000 7f4e568e4700 1 Processor -- start 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.415+0000 7f4e568e4700 1 -- start start 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.415+0000 7f4e568e4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50068630 0x7f4e500ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.415+0000 7f4e568e4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50068fd0 0x7f4e500ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.415+0000 7f4e568e4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e500ffc80 con 0x7f4e50068fd0 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.415+0000 7f4e568e4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e500ffdc0 con 0x7f4e50068630 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.415+0000 7f4e4f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50068fd0 0x7f4e500ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.415+0000 7f4e4f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50068fd0 0x7f4e500ff740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50266/0 (socket says 172.21.15.134:50266) 2024-04-13T10:54:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.415+0000 7f4e4f7fe700 1 -- 172.21.15.134:0/3703724774 learned_addr learned my addr 172.21.15.134:0/3703724774 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.416+0000 7f4e4ffff700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50068630 0x7f4e500ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.416+0000 7f4e4f7fe700 1 -- 172.21.15.134:0/3703724774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50068630 msgr2=0x7f4e500ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.416+0000 7f4e4f7fe700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50068630 0x7f4e500ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.416+0000 7f4e4f7fe700 1 -- 172.21.15.134:0/3703724774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e400095f0 con 0x7f4e50068fd0 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.416+0000 7f4e4f7fe700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50068fd0 0x7f4e500ff740 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400c8f0 tx=0x7f4e4400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.416+0000 7f4e4d7fa700 1 -- 172.21.15.134:0/3703724774 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e440078a0 con 0x7f4e50068fd0 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.416+0000 7f4e568e4700 1 -- 172.21.15.134:0/3703724774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e501a1f10 con 0x7f4e50068fd0 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.416+0000 7f4e4d7fa700 1 -- 172.21.15.134:0/3703724774 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f4e44007e90 con 0x7f4e50068fd0 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.416+0000 7f4e4d7fa700 1 -- 172.21.15.134:0/3703724774 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e44018630 con 0x7f4e50068fd0 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.416+0000 7f4e568e4700 1 -- 172.21.15.134:0/3703724774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e501a2320 con 0x7f4e50068fd0 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.417+0000 7f4e568e4700 1 -- 172.21.15.134:0/3703724774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e501086f0 con 0x7f4e50068fd0 2024-04-13T10:54:39.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.418+0000 7f4e4d7fa700 1 -- 172.21.15.134:0/3703724774 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f4e4400f450 con 0x7f4e50068fd0 2024-04-13T10:54:39.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.418+0000 7f4e4d7fa700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4e3806c680 0x7f4e3806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:39.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.418+0000 7f4e4d7fa700 1 -- 172.21.15.134:0/3703724774 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4e4408b4a0 con 0x7f4e50068fd0 2024-04-13T10:54:39.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.418+0000 7f4e4ffff700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4e3806c680 0x7f4e3806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:39.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.418+0000 7f4e4ffff700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4e3806c680 0x7f4e3806eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e40006010 tx=0x7f4e4001a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:39.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.423+0000 7f4e4d7fa700 1 -- 172.21.15.134:0/3703724774 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4e44055ec0 con 0x7f4e50068fd0 2024-04-13T10:54:39.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:39 smithi134 ceph-mon[39696]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:39.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.614+0000 7f4e568e4700 1 -- 172.21.15.134:0/3703724774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e5004ea50 con 0x7f4e50068fd0 2024-04-13T10:54:39.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.615+0000 7f4e4d7fa700 1 -- 172.21.15.134:0/3703724774 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11387 (secure 0 0 0) 0x7f4e440594e0 con 0x7f4e50068fd0 2024-04-13T10:54:39.615 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:54:39.615 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":40,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","created":"2024-04-13T10:48:00.547311+0000","modified":"2024-04-13T10:54:17.317571+0000","last_up_change":"2024-04-13T10:54:15.809542+0000","last_in_change":"2024-04-13T10:53:56.134815+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T10:52:52.594710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02af0f03-a267-4906-8417-d15189c8da92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6803","nonce":1676110195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6805","nonce":1676110195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6809","nonce":1676110195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6807","nonce":1676110195}]},"public_addr":"172.21.15.134:6803/1676110195","cluster_addr":"172.21.15.134:6805/1676110195","heartbeat_back_addr":"172.21.15.134:6809/1676110195","heartbeat_front_addr":"172.21.15.134:6807/1676110195","state":["exists","up"]},{"osd":1,"uuid":"ce202f5e-9c58-4cd6-b85b-1422131948d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6811","nonce":3488984333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6813","nonce":3488984333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6817","nonce":3488984333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6815","nonce":3488984333}]},"public_addr":"172.21.15.134:6811/3488984333","cluster_addr":"172.21.15.134:6813/3488984333","heartbeat_back_addr":"172.21.15.134:6817/3488984333","heartbeat_front_addr":"172.21.15.134:6815/3488984333","state":["exists","up"]},{"osd":2,"uuid":"7a2fef79-8403-416e-9037-079ddb080611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6819","nonce":768398169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6821","nonce":768398169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6825","nonce":768398169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6823","nonce":768398169}]},"public_addr":"172.21.15.134:6819/768398169","cluster_addr":"172.21.15.134:6821/768398169","heartbeat_back_addr":"172.21.15.134:6825/768398169","heartbeat_front_addr":"172.21.15.134:6823/768398169","state":["exists","up"]},{"osd":3,"uuid":"44c0411c-d9e0-4d23-b97d-f613b89943a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6801","nonce":3197529117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6803","nonce":3197529117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6807","nonce":3197529117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6805","nonce":3197529117}]},"public_addr":"172.21.15.194:6801/3197529117","cluster_addr":"172.21.15.194:6803/3197529117","heartbeat_back_addr":"172.21.15.194:6807/3197529117","heartbeat_front_addr":"172.21.15.194:6805/3197529117","state":["exists","up"]},{"osd":4,"uuid":"91533b98-bd92-4d8e-afa6-59c396f95799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6809","nonce":3191948930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6811","nonce":3191948930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6815","nonce":3191948930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6813","nonce":3191948930}]},"public_addr":"172.21.15.194:6809/3191948930","cluster_addr":"172.21.15.194:6811/3191948930","heartbeat_back_addr":"172.21.15.194:6815/3191948930","heartbeat_front_addr":"172.21.15.194:6813/3191948930","state":["exists","up"]},{"osd":5,"uuid":"3e198b03-2011-435c-afd8-16d8521b9991","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6817","nonce":1929560628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6819","nonce":1929560628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6823","nonce":1929560628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6821","nonce":1929560628}]},"public_addr":"172.21.15.194:6817/1929560628","cluster_addr":"172.21.15.194:6819/1929560628","heartbeat_back_addr":"172.21.15.194:6823/1929560628","heartbeat_front_addr":"172.21.15.194:6821/1929560628","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:51:48.117416+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:17.805248+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:49.973117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:17.604636+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:46.014087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:54:14.654274+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:0/323045534":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/3055528347":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6800/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6801/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/2590154845":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/565739211":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/4116995009":"2024-04-14T10:49:08.875132+0000","172.21.15.134:6801/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/2783735336":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6801/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/1090834434":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6800/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/471716030":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/3885996389":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6800/1656434316":"2024-04-14T10:49:08.875132+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T10:54:39.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 -- 172.21.15.134:0/3703724774 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4e3806c680 msgr2=0x7f4e3806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:39.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4e3806c680 0x7f4e3806eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e40006010 tx=0x7f4e4001a040 comp rx=0 tx=0).stop 2024-04-13T10:54:39.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 -- 172.21.15.134:0/3703724774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50068fd0 msgr2=0x7f4e500ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:39.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50068fd0 0x7f4e500ff740 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400c8f0 tx=0x7f4e4400cc00 comp rx=0 tx=0).stop 2024-04-13T10:54:39.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 -- 172.21.15.134:0/3703724774 shutdown_connections 2024-04-13T10:54:39.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f4e3806c680 0x7f4e3806eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:39.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e50068630 0x7f4e500ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:39.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 --2- 172.21.15.134:0/3703724774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50068fd0 0x7f4e500ff740 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:39.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 -- 172.21.15.134:0/3703724774 >> 172.21.15.134:0/3703724774 conn(0x7f4e50074f50 msgr2=0x7f4e500fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:39.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 -- 172.21.15.134:0/3703724774 shutdown_connections 2024-04-13T10:54:39.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:39.617+0000 7f4e568e4700 1 -- 172.21.15.134:0/3703724774 wait complete. 2024-04-13T10:54:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:39 smithi194 ceph-mon[46737]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:40.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:40 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3703724774' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T10:54:40.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-13T10:54:40.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-13T10:54:40.663 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-13T10:54:40.663 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-13T10:54:40.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-13T10:54:40.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-13T10:54:40.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:40 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3703724774' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T10:54:41.026 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:41.030 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:41.314 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:41.320 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:41.320 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:41.584 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:41 smithi134 ceph-mon[39696]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:41 smithi194 ceph-mon[46737]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:43.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:43 smithi194 ceph-mon[46737]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:43 smithi134 ceph-mon[39696]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:43.756 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:44.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:44 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:54:44.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:44 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:54:45.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:45 smithi134 ceph-mon[39696]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:45 smithi194 ceph-mon[46737]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:47.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:47 smithi134 ceph-mon[39696]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:47 smithi194 ceph-mon[46737]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:48.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.319+0000 7faf08863700 1 -- 172.21.15.134:0/1125500406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf04100e00 msgr2=0x7faf04104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:48.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.319+0000 7faf08863700 1 --2- 172.21.15.134:0/1125500406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf04100e00 0x7faf04104dd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faef8009910 tx=0x7faef8009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:48.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.319+0000 7faf08863700 1 -- 172.21.15.134:0/1125500406 shutdown_connections 2024-04-13T10:54:48.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.319+0000 7faf08863700 1 --2- 172.21.15.134:0/1125500406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf04100e00 0x7faf04104dd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:48.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.319+0000 7faf08863700 1 --2- 172.21.15.134:0/1125500406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf04100460 0x7faf04100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:48.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.319+0000 7faf08863700 1 -- 172.21.15.134:0/1125500406 >> 172.21.15.134:0/1125500406 conn(0x7faf040fbd00 msgr2=0x7faf040fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:48.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.319+0000 7faf08863700 1 -- 172.21.15.134:0/1125500406 shutdown_connections 2024-04-13T10:54:48.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.319+0000 7faf08863700 1 -- 172.21.15.134:0/1125500406 wait complete. 2024-04-13T10:54:48.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.320+0000 7faf08863700 1 Processor -- start 2024-04-13T10:54:48.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.320+0000 7faf08863700 1 -- start start 2024-04-13T10:54:48.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.320+0000 7faf08863700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf04100460 0x7faf04195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:48.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.320+0000 7faf08863700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf04100e00 0x7faf04196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:48.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.320+0000 7faf08863700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf04196a20 con 0x7faf04100e00 2024-04-13T10:54:48.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.320+0000 7faf08863700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0419a7b0 con 0x7faf04100460 2024-04-13T10:54:48.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.320+0000 7faf01d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf04100e00 0x7faf04196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:48.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.320+0000 7faf01d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf04100e00 0x7faf04196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50282/0 (socket says 172.21.15.134:50282) 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.320+0000 7faf01d9b700 1 -- 172.21.15.134:0/2326587050 learned_addr learned my addr 172.21.15.134:0/2326587050 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.321+0000 7faf0259c700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf04100460 0x7faf04195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.321+0000 7faf01d9b700 1 -- 172.21.15.134:0/2326587050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf04100460 msgr2=0x7faf04195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.321+0000 7faf01d9b700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf04100460 0x7faf04195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.321+0000 7faf01d9b700 1 -- 172.21.15.134:0/2326587050 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef80095f0 con 0x7faf04100e00 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.321+0000 7faf01d9b700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf04100e00 0x7faf04196340 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faef80092e0 tx=0x7faef800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.321+0000 7faef37fe700 1 -- 172.21.15.134:0/2326587050 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faef801d070 con 0x7faf04100e00 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.321+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0419aa30 con 0x7faf04100e00 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.321+0000 7faef37fe700 1 -- 172.21.15.134:0/2326587050 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7faef800f460 con 0x7faf04100e00 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.321+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0419af20 con 0x7faf04100e00 2024-04-13T10:54:48.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.321+0000 7faef37fe700 1 -- 172.21.15.134:0/2326587050 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faef8021600 con 0x7faf04100e00 2024-04-13T10:54:48.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.322+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf0410d510 con 0x7faf04100e00 2024-04-13T10:54:48.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.323+0000 7faef37fe700 1 -- 172.21.15.134:0/2326587050 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7faef800f5d0 con 0x7faf04100e00 2024-04-13T10:54:48.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.323+0000 7faef37fe700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faeec06c680 0x7faeec06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:48.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.324+0000 7faef37fe700 1 -- 172.21.15.134:0/2326587050 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7faef808cff0 con 0x7faf04100e00 2024-04-13T10:54:48.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.324+0000 7faf0259c700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faeec06c680 0x7faeec06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:48.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.324+0000 7faef37fe700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333] conn(0x7faeec072350 0x7faeec074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:48.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.324+0000 7faef37fe700 1 -- 172.21.15.134:0/2326587050 --> [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faeec074e10 con 0x7faeec072350 2024-04-13T10:54:48.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.324+0000 7faef37fe700 1 -- 172.21.15.134:0/2326587050 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7faef808d3b0 con 0x7faf04100e00 2024-04-13T10:54:48.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.324+0000 7faf02d9d700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333] conn(0x7faeec072350 0x7faeec074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:48.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.324+0000 7faf0259c700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faeec06c680 0x7faeec06eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faef4006fd0 tx=0x7faef4008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:48.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.324+0000 7faf02d9d700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333] conn(0x7faeec072350 0x7faeec074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:48.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.325+0000 7faef37fe700 1 -- 172.21.15.134:0/2326587050 <== osd.1 v2:172.21.15.134:6810/3488984333 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faeec074e10 con 0x7faeec072350 2024-04-13T10:54:48.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.340+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 --> [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf0404ea50 con 0x7faeec072350 2024-04-13T10:54:48.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.340+0000 7faef37fe700 1 -- 172.21.15.134:0/2326587050 <== osd.1 v2:172.21.15.134:6810/3488984333 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faf0404ea50 con 0x7faeec072350 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333] conn(0x7faeec072350 msgr2=0x7faeec074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333] conn(0x7faeec072350 0x7faeec074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faeec06c680 msgr2=0x7faeec06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faeec06c680 0x7faeec06eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faef4006fd0 tx=0x7faef4008040 comp rx=0 tx=0).stop 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf04100e00 msgr2=0x7faf04196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf04100e00 0x7faf04196340 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faef80092e0 tx=0x7faef800be20 comp rx=0 tx=0).stop 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 shutdown_connections 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6810/3488984333,v1:172.21.15.134:6811/3488984333] conn(0x7faeec072350 0x7faeec074760 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7faeec06c680 0x7faeec06eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf04100460 0x7faf04195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 --2- 172.21.15.134:0/2326587050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf04100e00 0x7faf04196340 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:48.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 >> 172.21.15.134:0/2326587050 conn(0x7faf040fbd00 msgr2=0x7faf040fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:48.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 shutdown_connections 2024-04-13T10:54:48.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.341+0000 7faf08863700 1 -- 172.21.15.134:0/2326587050 wait complete. 2024-04-13T10:54:49.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.573+0000 7f1fe584b700 1 -- 172.21.15.134:0/510322945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fe00ffb80 msgr2=0x7f1fe010a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:49.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.573+0000 7f1fe584b700 1 --2- 172.21.15.134:0/510322945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fe00ffb80 0x7f1fe010a5f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009910 tx=0x7f1fd4009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:49.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.573+0000 7f1fe584b700 1 -- 172.21.15.134:0/510322945 shutdown_connections 2024-04-13T10:54:49.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.573+0000 7f1fe584b700 1 --2- 172.21.15.134:0/510322945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fe00ffb80 0x7f1fe010a5f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:49.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.573+0000 7f1fe584b700 1 --2- 172.21.15.134:0/510322945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00ff270 0x7f1fe00ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:49.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.573+0000 7f1fe584b700 1 -- 172.21.15.134:0/510322945 >> 172.21.15.134:0/510322945 conn(0x7f1fe0074850 msgr2=0x7f1fe0074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:49.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.573+0000 7f1fe584b700 1 -- 172.21.15.134:0/510322945 shutdown_connections 2024-04-13T10:54:49.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.573+0000 7f1fe584b700 1 -- 172.21.15.134:0/510322945 wait complete. 2024-04-13T10:54:49.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.574+0000 7f1fe584b700 1 Processor -- start 2024-04-13T10:54:49.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.574+0000 7f1fe584b700 1 -- start start 2024-04-13T10:54:49.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.574+0000 7f1fe584b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fe00ff270 0x7f1fe019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:49.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.574+0000 7f1fe584b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00ffb80 0x7f1fe019bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:49.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.574+0000 7f1fe584b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe019c630 con 0x7f1fe00ff270 2024-04-13T10:54:49.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.574+0000 7f1fe584b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe0195ae0 con 0x7f1fe00ffb80 2024-04-13T10:54:49.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.574+0000 7f1fdeffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fe00ff270 0x7f1fe019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:49.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.574+0000 7f1fdeffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fe00ff270 0x7f1fe019ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50394/0 (socket says 172.21.15.134:50394) 2024-04-13T10:54:49.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.574+0000 7f1fdeffd700 1 -- 172.21.15.134:0/4148629585 learned_addr learned my addr 172.21.15.134:0/4148629585 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:49.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.575+0000 7f1fde7fc700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00ffb80 0x7f1fe019bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:49.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.575+0000 7f1fdeffd700 1 -- 172.21.15.134:0/4148629585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00ffb80 msgr2=0x7f1fe019bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:49.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.575+0000 7f1fdeffd700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00ffb80 0x7f1fe019bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:49.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.575+0000 7f1fdeffd700 1 -- 172.21.15.134:0/4148629585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd40095f0 con 0x7f1fe00ff270 2024-04-13T10:54:49.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.575+0000 7f1fdeffd700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fe00ff270 0x7f1fe019ba60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000d8d0 tx=0x7f1fd000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:49.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.575+0000 7f1fe4849700 1 -- 172.21.15.134:0/4148629585 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd00098a0 con 0x7f1fe00ff270 2024-04-13T10:54:49.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.575+0000 7f1fe4849700 1 -- 172.21.15.134:0/4148629585 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f1fd0009e90 con 0x7f1fe00ff270 2024-04-13T10:54:49.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.575+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe0195dc0 con 0x7f1fe00ff270 2024-04-13T10:54:49.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.575+0000 7f1fe4849700 1 -- 172.21.15.134:0/4148629585 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd000f5f0 con 0x7f1fe00ff270 2024-04-13T10:54:49.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.575+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe0196310 con 0x7f1fe00ff270 2024-04-13T10:54:49.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.576+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fe010d5f0 con 0x7f1fe00ff270 2024-04-13T10:54:49.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.576+0000 7f1fe4849700 1 -- 172.21.15.134:0/4148629585 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f1fd0010460 con 0x7f1fe00ff270 2024-04-13T10:54:49.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.577+0000 7f1fe4849700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc806c680 0x7f1fc806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:49.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.577+0000 7f1fe4849700 1 -- 172.21.15.134:0/4148629585 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1fd008b2f0 con 0x7f1fe00ff270 2024-04-13T10:54:49.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.577+0000 7f1fde7fc700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc806c680 0x7f1fc806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:49.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.577+0000 7f1fe4849700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628] conn(0x7f1fc8072350 0x7f1fc8074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:49.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.577+0000 7f1fe4849700 1 -- 172.21.15.134:0/4148629585 --> [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fc8074e10 con 0x7f1fc8072350 2024-04-13T10:54:49.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.577+0000 7f1fe4849700 1 -- 172.21.15.134:0/4148629585 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fd008d9c0 con 0x7f1fe00ff270 2024-04-13T10:54:49.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.577+0000 7f1fde7fc700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc806c680 0x7f1fc806eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00fdda0 tx=0x7f1fd401a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:49.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.577+0000 7f1fdf7fe700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628] conn(0x7f1fc8072350 0x7f1fc8074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:49.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.578+0000 7f1fdf7fe700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628] conn(0x7f1fc8072350 0x7f1fc8074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:49.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.578+0000 7f1fe4849700 1 -- 172.21.15.134:0/4148629585 <== osd.5 v2:172.21.15.194:6816/1929560628 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1fc8074e10 con 0x7f1fc8072350 2024-04-13T10:54:49.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.594+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 --> [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1fe01967c0 con 0x7f1fc8072350 2024-04-13T10:54:49.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.594+0000 7f1fe4849700 1 -- 172.21.15.134:0/4148629585 <== osd.5 v2:172.21.15.194:6816/1929560628 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1fe01967c0 con 0x7f1fc8072350 2024-04-13T10:54:49.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 >> [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628] conn(0x7f1fc8072350 msgr2=0x7f1fc8074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:49.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628] conn(0x7f1fc8072350 0x7f1fc8074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:49.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc806c680 msgr2=0x7f1fc806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:49.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc806c680 0x7f1fc806eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00fdda0 tx=0x7f1fd401a040 comp rx=0 tx=0).stop 2024-04-13T10:54:49.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fe00ff270 msgr2=0x7f1fe019ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:49.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fe00ff270 0x7f1fe019ba60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000d8d0 tx=0x7f1fd000dbe0 comp rx=0 tx=0).stop 2024-04-13T10:54:49.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 shutdown_connections 2024-04-13T10:54:49.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.194:6816/1929560628,v1:172.21.15.194:6817/1929560628] conn(0x7f1fc8072350 0x7f1fc8074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:49.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc806c680 0x7f1fc806eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:49.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fe00ff270 0x7f1fe019ba60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:49.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 --2- 172.21.15.134:0/4148629585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fe00ffb80 0x7f1fe019bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:49.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 >> 172.21.15.134:0/4148629585 conn(0x7f1fe0074850 msgr2=0x7f1fe0104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:49.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 shutdown_connections 2024-04-13T10:54:49.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:49.595+0000 7f1fe584b700 1 -- 172.21.15.134:0/4148629585 wait complete. 2024-04-13T10:54:49.614 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:49 smithi134 ceph-mon[39696]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:49.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:49 smithi194 ceph-mon[46737]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.958+0000 7f954f403700 1 -- 172.21.15.134:0/1671461013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9548100dd0 msgr2=0x7f9548104da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.958+0000 7f954f403700 1 --2- 172.21.15.134:0/1671461013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9548100dd0 0x7f9548104da0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9538009910 tx=0x7f9538009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 -- 172.21.15.134:0/1671461013 shutdown_connections 2024-04-13T10:54:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 --2- 172.21.15.134:0/1671461013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9548100dd0 0x7f9548104da0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 --2- 172.21.15.134:0/1671461013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9548100430 0x7f9548100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 -- 172.21.15.134:0/1671461013 >> 172.21.15.134:0/1671461013 conn(0x7f95480fbcf0 msgr2=0x7f95480fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 -- 172.21.15.134:0/1671461013 shutdown_connections 2024-04-13T10:54:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 -- 172.21.15.134:0/1671461013 wait complete. 2024-04-13T10:54:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 Processor -- start 2024-04-13T10:54:50.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 -- start start 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9548100430 0x7f954819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9548100dd0 0x7f954819bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954819c620 con 0x7f9548100430 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.959+0000 7f954f403700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548195ad0 con 0x7f9548100dd0 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f954d19f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9548100430 0x7f954819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f954d19f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9548100430 0x7f954819ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50294/0 (socket says 172.21.15.134:50294) 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f954d19f700 1 -- 172.21.15.134:0/2093934784 learned_addr learned my addr 172.21.15.134:0/2093934784 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f954d19f700 1 -- 172.21.15.134:0/2093934784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9548100dd0 msgr2=0x7f954819bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f954d19f700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9548100dd0 0x7f954819bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f954d19f700 1 -- 172.21.15.134:0/2093934784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95380095f0 con 0x7f9548100430 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f954d19f700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9548100430 0x7f954819ba50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f954400d8d0 tx=0x7f954400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f953e7fc700 1 -- 172.21.15.134:0/2093934784 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9544009940 con 0x7f9548100430 2024-04-13T10:54:50.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f953e7fc700 1 -- 172.21.15.134:0/2093934784 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f9544010460 con 0x7f9548100430 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9548195db0 con 0x7f9548100430 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f953e7fc700 1 -- 172.21.15.134:0/2093934784 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954400f5f0 con 0x7f9548100430 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.960+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9548196300 con 0x7f9548100430 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.961+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f954810d4e0 con 0x7f9548100430 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.962+0000 7f953e7fc700 1 -- 172.21.15.134:0/2093934784 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f95440105d0 con 0x7f9548100430 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.962+0000 7f953e7fc700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f953406c680 0x7f953406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.962+0000 7f954c99e700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f953406c680 0x7f953406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.962+0000 7f953e7fc700 1 -- 172.21.15.134:0/2093934784 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f954408b580 con 0x7f9548100430 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.962+0000 7f953e7fc700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195] conn(0x7f9534072350 0x7f9534074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.962+0000 7f953e7fc700 1 -- 172.21.15.134:0/2093934784 --> [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9534074e10 con 0x7f9534072350 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.962+0000 7f953e7fc700 1 -- 172.21.15.134:0/2093934784 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f954408dc50 con 0x7f9548100430 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.962+0000 7f954d9a0700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195] conn(0x7f9534072350 0x7f9534074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:50.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.962+0000 7f954c99e700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f953406c680 0x7f953406eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f953800b5c0 tx=0x7f9538005960 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.962+0000 7f954d9a0700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195] conn(0x7f9534072350 0x7f9534074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.963+0000 7f953e7fc700 1 -- 172.21.15.134:0/2093934784 <== osd.0 v2:172.21.15.134:6802/1676110195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9534074e10 con 0x7f9534072350 2024-04-13T10:54:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 --> [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9548196760 con 0x7f9534072350 2024-04-13T10:54:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f953e7fc700 1 -- 172.21.15.134:0/2093934784 <== osd.0 v2:172.21.15.134:6802/1676110195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9548196760 con 0x7f9534072350 2024-04-13T10:54:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195] conn(0x7f9534072350 msgr2=0x7f9534074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195] conn(0x7f9534072350 0x7f9534074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f953406c680 msgr2=0x7f953406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:50.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f953406c680 0x7f953406eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f953800b5c0 tx=0x7f9538005960 comp rx=0 tx=0).stop 2024-04-13T10:54:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9548100430 msgr2=0x7f954819ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9548100430 0x7f954819ba50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f954400d8d0 tx=0x7f954400dc90 comp rx=0 tx=0).stop 2024-04-13T10:54:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 shutdown_connections 2024-04-13T10:54:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f953406c680 0x7f953406eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:6802/1676110195,v1:172.21.15.134:6803/1676110195] conn(0x7f9534072350 0x7f9534074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9548100430 0x7f954819ba50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 --2- 172.21.15.134:0/2093934784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9548100dd0 0x7f954819bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 >> 172.21.15.134:0/2093934784 conn(0x7f95480fbcf0 msgr2=0x7f95480fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 shutdown_connections 2024-04-13T10:54:50.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:48.979+0000 7f954f403700 1 -- 172.21.15.134:0/2093934784 wait complete. 2024-04-13T10:54:50.825 INFO:teuthology.orchestra.run.smithi134.stdout:167503724553 2024-04-13T10:54:50.826 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-13T10:54:51.344 INFO:teuthology.orchestra.run.smithi134.stdout:60129542176 2024-04-13T10:54:51.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-13T10:54:51.370 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:51 smithi134 ceph-mon[39696]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:51.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:51 smithi194 ceph-mon[46737]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:51.808 INFO:teuthology.orchestra.run.smithi134.stdout:38654705703 2024-04-13T10:54:51.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-13T10:54:51.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 -- 172.21.15.134:0/3726080458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62c100460 msgr2=0x7fd62c100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:51.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 --2- 172.21.15.134:0/3726080458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62c100460 0x7fd62c100830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd620009910 tx=0x7fd620009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 -- 172.21.15.134:0/3726080458 shutdown_connections 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 --2- 172.21.15.134:0/3726080458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd62c100e00 0x7fd62c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 --2- 172.21.15.134:0/3726080458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62c100460 0x7fd62c100830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 -- 172.21.15.134:0/3726080458 >> 172.21.15.134:0/3726080458 conn(0x7fd62c0fbd00 msgr2=0x7fd62c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 -- 172.21.15.134:0/3726080458 shutdown_connections 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 -- 172.21.15.134:0/3726080458 wait complete. 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 Processor -- start 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 -- start start 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd62c100460 0x7fd62c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62c100e00 0x7fd62c19c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c19c6a0 con 0x7fd62c100e00 2024-04-13T10:54:51.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.073+0000 7fd632ac3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c195b50 con 0x7fd62c100460 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd62bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62c100e00 0x7fd62c19c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd62bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62c100e00 0x7fd62c19c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50410/0 (socket says 172.21.15.134:50410) 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd62bfff700 1 -- 172.21.15.134:0/4279122439 learned_addr learned my addr 172.21.15.134:0/4279122439 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd63085f700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd62c100460 0x7fd62c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd62bfff700 1 -- 172.21.15.134:0/4279122439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd62c100460 msgr2=0x7fd62c19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd62bfff700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd62c100460 0x7fd62c19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd62bfff700 1 -- 172.21.15.134:0/4279122439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6200095f0 con 0x7fd62c100e00 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd63085f700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd62c100460 0x7fd62c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd62bfff700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62c100e00 0x7fd62c19c010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c8f0 tx=0x7fd61800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd629ffb700 1 -- 172.21.15.134:0/4279122439 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd618007a50 con 0x7fd62c100e00 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd629ffb700 1 -- 172.21.15.134:0/4279122439 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fd618007bb0 con 0x7fd62c100e00 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c195e30 con 0x7fd62c100e00 2024-04-13T10:54:51.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd629ffb700 1 -- 172.21.15.134:0/4279122439 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd61800fea0 con 0x7fd62c100e00 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.074+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c196380 con 0x7fd62c100e00 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.075+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd62c10d4b0 con 0x7fd62c100e00 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.076+0000 7fd629ffb700 1 -- 172.21.15.134:0/4279122439 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fd618007d20 con 0x7fd62c100e00 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.076+0000 7fd629ffb700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd61c06c680 0x7fd61c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.076+0000 7fd629ffb700 1 -- 172.21.15.134:0/4279122439 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd61808b500 con 0x7fd62c100e00 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.076+0000 7fd63085f700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd61c06c680 0x7fd61c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.076+0000 7fd629ffb700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169] conn(0x7fd61c072350 0x7fd61c074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.076+0000 7fd629ffb700 1 -- 172.21.15.134:0/4279122439 --> [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd61c074e10 con 0x7fd61c072350 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.076+0000 7fd629ffb700 1 -- 172.21.15.134:0/4279122439 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd61808dbd0 con 0x7fd62c100e00 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.076+0000 7fd631060700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169] conn(0x7fd61c072350 0x7fd61c074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.076+0000 7fd63085f700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd61c06c680 0x7fd61c06eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd62000b5c0 tx=0x7fd620005960 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.077+0000 7fd631060700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169] conn(0x7fd61c072350 0x7fd61c074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:51.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.077+0000 7fd629ffb700 1 -- 172.21.15.134:0/4279122439 <== osd.2 v2:172.21.15.134:6818/768398169 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd61c074e10 con 0x7fd61c072350 2024-04-13T10:54:51.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.092+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 --> [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd62c04ea50 con 0x7fd61c072350 2024-04-13T10:54:51.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd629ffb700 1 -- 172.21.15.134:0/4279122439 <== osd.2 v2:172.21.15.134:6818/768398169 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd62c04ea50 con 0x7fd61c072350 2024-04-13T10:54:51.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169] conn(0x7fd61c072350 msgr2=0x7fd61c074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:51.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169] conn(0x7fd61c072350 0x7fd61c074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:51.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd61c06c680 msgr2=0x7fd61c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:51.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd61c06c680 0x7fd61c06eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd62000b5c0 tx=0x7fd620005960 comp rx=0 tx=0).stop 2024-04-13T10:54:51.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62c100e00 msgr2=0x7fd62c19c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:51.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62c100e00 0x7fd62c19c010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c8f0 tx=0x7fd61800ccb0 comp rx=0 tx=0).stop 2024-04-13T10:54:51.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 shutdown_connections 2024-04-13T10:54:51.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6818/768398169,v1:172.21.15.134:6819/768398169] conn(0x7fd61c072350 0x7fd61c074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:51.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd61c06c680 0x7fd61c06eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:51.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd62c100460 0x7fd62c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:51.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 --2- 172.21.15.134:0/4279122439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd62c100e00 0x7fd62c19c010 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:51.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 >> 172.21.15.134:0/4279122439 conn(0x7fd62c0fbd00 msgr2=0x7fd62c0fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:51.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 shutdown_connections 2024-04-13T10:54:51.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:51.093+0000 7fd632ac3700 1 -- 172.21.15.134:0/4279122439 wait complete. 2024-04-13T10:54:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.599+0000 7f15010fd700 1 -- 172.21.15.134:0/1535410040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc100400 msgr2=0x7f14fc1007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.599+0000 7f15010fd700 1 --2- 172.21.15.134:0/1535410040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc100400 0x7f14fc1007d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009910 tx=0x7f14f0009c20 comp rx=0 tx=0).stop 2024-04-13T10:54:52.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.599+0000 7f15010fd700 1 -- 172.21.15.134:0/1535410040 shutdown_connections 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.599+0000 7f15010fd700 1 --2- 172.21.15.134:0/1535410040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14fc100da0 0x7f14fc104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.599+0000 7f15010fd700 1 --2- 172.21.15.134:0/1535410040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc100400 0x7f14fc1007d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.599+0000 7f15010fd700 1 -- 172.21.15.134:0/1535410040 >> 172.21.15.134:0/1535410040 conn(0x7f14fc0fbca0 msgr2=0x7f14fc0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.599+0000 7f15010fd700 1 -- 172.21.15.134:0/1535410040 shutdown_connections 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.599+0000 7f15010fd700 1 -- 172.21.15.134:0/1535410040 wait complete. 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f15010fd700 1 Processor -- start 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f15010fd700 1 -- start start 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f15010fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc100400 0x7f14fc073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f15010fd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14fc100da0 0x7f14fc073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f15010fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc073ad0 con 0x7f14fc100400 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f15010fd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc073c10 con 0x7f14fc100da0 2024-04-13T10:54:52.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f14fad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc100400 0x7f14fc073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f14fad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc100400 0x7f14fc073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50436/0 (socket says 172.21.15.134:50436) 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f14fad9d700 1 -- 172.21.15.134:0/2571960091 learned_addr learned my addr 172.21.15.134:0/2571960091 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f14fa59c700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14fc100da0 0x7f14fc073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f14fad9d700 1 -- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14fc100da0 msgr2=0x7f14fc073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f14fad9d700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14fc100da0 0x7f14fc073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f14fad9d700 1 -- 172.21.15.134:0/2571960091 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f00095f0 con 0x7f14fc100400 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f14fa59c700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14fc100da0 0x7f14fc073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.600+0000 7f14fad9d700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc100400 0x7f14fc073050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14f0006010 tx=0x7f14f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.601+0000 7f14e3fff700 1 -- 172.21.15.134:0/2571960091 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14f001d070 con 0x7f14fc100400 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.601+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc073e90 con 0x7f14fc100400 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.601+0000 7f14e3fff700 1 -- 172.21.15.134:0/2571960091 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f14f000f460 con 0x7f14fc100400 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.601+0000 7f14e3fff700 1 -- 172.21.15.134:0/2571960091 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14f0021640 con 0x7f14fc100400 2024-04-13T10:54:52.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.601+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc1a2250 con 0x7f14fc100400 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.602+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14fc10d510 con 0x7f14fc100400 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.602+0000 7f14e3fff700 1 -- 172.21.15.134:0/2571960091 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f14f000fa60 con 0x7f14fc100400 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.602+0000 7f14e3fff700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f14e406c680 0x7f14e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.603+0000 7f14fa59c700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f14e406c680 0x7f14e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.603+0000 7f14e3fff700 1 -- 172.21.15.134:0/2571960091 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f14f008c8d0 con 0x7f14fc100400 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.603+0000 7f14e3fff700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117] conn(0x7f14e4072350 0x7f14e4074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.603+0000 7f14e3fff700 1 -- 172.21.15.134:0/2571960091 --> [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14e4074e10 con 0x7f14e4072350 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.603+0000 7f14e3fff700 1 -- 172.21.15.134:0/2571960091 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14f00912a0 con 0x7f14fc100400 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.603+0000 7f14fb59e700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117] conn(0x7f14e4072350 0x7f14e4074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.603+0000 7f14fa59c700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f14e406c680 0x7f14e406eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f14fc074840 tx=0x7f14ec008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.603+0000 7f14fb59e700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117] conn(0x7f14e4072350 0x7f14e4074760 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:52.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.604+0000 7f14e3fff700 1 -- 172.21.15.134:0/2571960091 <== osd.3 v2:172.21.15.194:6800/3197529117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f14e4074e10 con 0x7f14e4072350 2024-04-13T10:54:52.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.619+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 --> [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14fc04ea50 con 0x7f14e4072350 2024-04-13T10:54:52.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f14e3fff700 1 -- 172.21.15.134:0/2571960091 <== osd.3 v2:172.21.15.194:6800/3197529117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f14fc04ea50 con 0x7f14e4072350 2024-04-13T10:54:52.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117] conn(0x7f14e4072350 msgr2=0x7f14e4074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:52.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117] conn(0x7f14e4072350 0x7f14e4074760 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:52.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f14e406c680 msgr2=0x7f14e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:52.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f14e406c680 0x7f14e406eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f14fc074840 tx=0x7f14ec008040 comp rx=0 tx=0).stop 2024-04-13T10:54:52.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc100400 msgr2=0x7f14fc073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:52.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc100400 0x7f14fc073050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14f0006010 tx=0x7f14f000be20 comp rx=0 tx=0).stop 2024-04-13T10:54:52.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 shutdown_connections 2024-04-13T10:54:52.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:6800/3197529117,v1:172.21.15.194:6801/3197529117] conn(0x7f14e4072350 0x7f14e4074760 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:52.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f14e406c680 0x7f14e406eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:52.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc100400 0x7f14fc073050 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:52.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 --2- 172.21.15.134:0/2571960091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14fc100da0 0x7f14fc073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:52.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.620+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 >> 172.21.15.134:0/2571960091 conn(0x7f14fc0fbca0 msgr2=0x7f14fc0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:52.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.621+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 shutdown_connections 2024-04-13T10:54:52.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:52.621+0000 7f15010fd700 1 -- 172.21.15.134:0/2571960091 wait complete. 2024-04-13T10:54:52.788 INFO:teuthology.orchestra.run.smithi134.stdout:81604378651 2024-04-13T10:54:52.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-13T10:54:53.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:53 smithi134 ceph-mon[39696]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:53.482 INFO:teuthology.orchestra.run.smithi134.stdout:111669149717 2024-04-13T10:54:53.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-13T10:54:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:53 smithi194 ceph-mon[46737]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:53.956 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:54.244 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:54.245 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:54.245 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:54:55.562 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:55 smithi134 ceph-mon[39696]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:55 smithi194 ceph-mon[46737]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:57.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:57 smithi134 ceph-mon[39696]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:57.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:57 smithi194 ceph-mon[46737]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:57.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.873+0000 7f7902558700 1 -- 172.21.15.134:0/174307653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc104790 msgr2=0x7f78fc104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:57.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.873+0000 7f7902558700 1 --2- 172.21.15.134:0/174307653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc104790 0x7f78fc104b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00aa20 tx=0x7f78ec00ad30 comp rx=0 tx=0).stop 2024-04-13T10:54:57.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.873+0000 7f7902558700 1 -- 172.21.15.134:0/174307653 shutdown_connections 2024-04-13T10:54:57.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.873+0000 7f7902558700 1 --2- 172.21.15.134:0/174307653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78fc103450 0x7f78fc1038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:57.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.873+0000 7f7902558700 1 --2- 172.21.15.134:0/174307653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc104790 0x7f78fc104b60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:57.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.873+0000 7f7902558700 1 -- 172.21.15.134:0/174307653 >> 172.21.15.134:0/174307653 conn(0x7f78fc074850 msgr2=0x7f78fc074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:57.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.874+0000 7f7902558700 1 -- 172.21.15.134:0/174307653 shutdown_connections 2024-04-13T10:54:57.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.874+0000 7f7902558700 1 -- 172.21.15.134:0/174307653 wait complete. 2024-04-13T10:54:57.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.874+0000 7f7902558700 1 Processor -- start 2024-04-13T10:54:57.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.874+0000 7f7902558700 1 -- start start 2024-04-13T10:54:57.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f7902558700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc103450 0x7f78fc1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f7902558700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78fc104790 0x7f78fc199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f7902558700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc19a300 con 0x7f78fc103450 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f7902558700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc193840 con 0x7f78fc104790 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f78fbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc103450 0x7f78fc1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f78fbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc103450 0x7f78fc1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50462/0 (socket says 172.21.15.134:50462) 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f78fbfff700 1 -- 172.21.15.134:0/1134082767 learned_addr learned my addr 172.21.15.134:0/1134082767 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f78fb7fe700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78fc104790 0x7f78fc199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f78fbfff700 1 -- 172.21.15.134:0/1134082767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78fc104790 msgr2=0x7f78fc199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f78fbfff700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78fc104790 0x7f78fc199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f78fbfff700 1 -- 172.21.15.134:0/1134082767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec00a700 con 0x7f78fc103450 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.875+0000 7f78fbfff700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc103450 0x7f78fc1997c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f78ec006010 tx=0x7f78ec0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.876+0000 7f78f97fa700 1 -- 172.21.15.134:0/1134082767 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78ec004d60 con 0x7f78fc103450 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.876+0000 7f7902558700 1 -- 172.21.15.134:0/1134082767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc193ac0 con 0x7f78fc103450 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.876+0000 7f78f97fa700 1 -- 172.21.15.134:0/1134082767 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f78ec00e8e0 con 0x7f78fc103450 2024-04-13T10:54:57.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.876+0000 7f78f97fa700 1 -- 172.21.15.134:0/1134082767 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78ec0268d0 con 0x7f78fc103450 2024-04-13T10:54:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.876+0000 7f7902558700 1 -- 172.21.15.134:0/1134082767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc194030 con 0x7f78fc103450 2024-04-13T10:54:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.877+0000 7f7902558700 1 -- 172.21.15.134:0/1134082767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc0fda10 con 0x7f78fc103450 2024-04-13T10:54:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.877+0000 7f78f97fa700 1 -- 172.21.15.134:0/1134082767 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f78ec00ea50 con 0x7f78fc103450 2024-04-13T10:54:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.878+0000 7f78f97fa700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f78e406c680 0x7f78e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.878+0000 7f78f97fa700 1 -- 172.21.15.134:0/1134082767 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f78ec012070 con 0x7f78fc103450 2024-04-13T10:54:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.878+0000 7f78fb7fe700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f78e406c680 0x7f78e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.878+0000 7f78fb7fe700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f78e406c680 0x7f78e406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f78fc074f10 tx=0x7f78f000a380 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:57.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:57.882+0000 7f78f97fa700 1 -- 172.21.15.134:0/1134082767 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f78ec05dba0 con 0x7f78fc103450 2024-04-13T10:54:58.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.078+0000 7f7902558700 1 -- 172.21.15.134:0/1134082767 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78fc194250 con 0x7f78fc103450 2024-04-13T10:54:58.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.078+0000 7f78f97fa700 1 -- 172.21.15.134:0/1134082767 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78ec05d730 con 0x7f78fc103450 2024-04-13T10:54:58.079 INFO:teuthology.orchestra.run.smithi134.stdout:81604378652 2024-04-13T10:54:58.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 -- 172.21.15.134:0/1134082767 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f78e406c680 msgr2=0x7f78e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:58.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f78e406c680 0x7f78e406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f78fc074f10 tx=0x7f78f000a380 comp rx=0 tx=0).stop 2024-04-13T10:54:58.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 -- 172.21.15.134:0/1134082767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc103450 msgr2=0x7f78fc1997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:58.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc103450 0x7f78fc1997c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f78ec006010 tx=0x7f78ec0046b0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 -- 172.21.15.134:0/1134082767 shutdown_connections 2024-04-13T10:54:58.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f78e406c680 0x7f78e406eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78fc103450 0x7f78fc1997c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 --2- 172.21.15.134:0/1134082767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78fc104790 0x7f78fc199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 -- 172.21.15.134:0/1134082767 >> 172.21.15.134:0/1134082767 conn(0x7f78fc074850 msgr2=0x7f78fc1023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:58.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 -- 172.21.15.134:0/1134082767 shutdown_connections 2024-04-13T10:54:58.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:58.081+0000 7f7902558700 1 -- 172.21.15.134:0/1134082767 wait complete. 2024-04-13T10:54:58.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.767+0000 7f9ffc592700 1 -- 172.21.15.134:0/4281681043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ff40ff390 msgr2=0x7f9ff40ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:58.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.767+0000 7f9ffc592700 1 --2- 172.21.15.134:0/4281681043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ff40ff390 0x7f9ff40ff760 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400b0a0 tx=0x7f9fe400b3b0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.768+0000 7f9ffc592700 1 -- 172.21.15.134:0/4281681043 shutdown_connections 2024-04-13T10:54:58.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.768+0000 7f9ffc592700 1 --2- 172.21.15.134:0/4281681043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff40ffd30 0x7f9ff4103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.768+0000 7f9ffc592700 1 --2- 172.21.15.134:0/4281681043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ff40ff390 0x7f9ff40ff760 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.768+0000 7f9ffc592700 1 -- 172.21.15.134:0/4281681043 >> 172.21.15.134:0/4281681043 conn(0x7f9ff4074f50 msgr2=0x7f9ff4075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:58.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.768+0000 7f9ffc592700 1 -- 172.21.15.134:0/4281681043 shutdown_connections 2024-04-13T10:54:58.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.768+0000 7f9ffc592700 1 -- 172.21.15.134:0/4281681043 wait complete. 2024-04-13T10:54:58.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.768+0000 7f9ffc592700 1 Processor -- start 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.768+0000 7f9ffc592700 1 -- start start 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffc592700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ff40ff390 0x7f9ff419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffc592700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff40ffd30 0x7f9ff419ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffc592700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff419b450 con 0x7f9ff40ff390 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffc592700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4194990 con 0x7f9ff40ffd30 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffa32e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ff40ff390 0x7f9ff419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffa32e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ff40ff390 0x7f9ff419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50452/0 (socket says 172.21.15.134:50452) 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffa32e700 1 -- 172.21.15.134:0/3647073815 learned_addr learned my addr 172.21.15.134:0/3647073815 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ff9b2d700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff40ffd30 0x7f9ff419ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffa32e700 1 -- 172.21.15.134:0/3647073815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff40ffd30 msgr2=0x7f9ff419ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffa32e700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff40ffd30 0x7f9ff419ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffa32e700 1 -- 172.21.15.134:0/3647073815 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4009d00 con 0x7f9ff40ff390 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffa32e700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ff40ff390 0x7f9ff419a910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4000f80 tx=0x7f9fe400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:58.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ff37fe700 1 -- 172.21.15.134:0/3647073815 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fe400e040 con 0x7f9ff40ff390 2024-04-13T10:54:58.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff4194c10 con 0x7f9ff40ff390 2024-04-13T10:54:58.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ff37fe700 1 -- 172.21.15.134:0/3647073815 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f9fe4003de0 con 0x7f9ff40ff390 2024-04-13T10:54:58.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ff37fe700 1 -- 172.21.15.134:0/3647073815 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fe401d7c0 con 0x7f9ff40ff390 2024-04-13T10:54:58.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.769+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff4195100 con 0x7f9ff40ff390 2024-04-13T10:54:58.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.770+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ff410c410 con 0x7f9ff40ff390 2024-04-13T10:54:58.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.771+0000 7f9ff37fe700 1 -- 172.21.15.134:0/3647073815 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f9fe4019070 con 0x7f9ff40ff390 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.771+0000 7f9ff37fe700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9fdc06c680 0x7f9fdc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.771+0000 7f9ff9b2d700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9fdc06c680 0x7f9fdc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.771+0000 7f9ff37fe700 1 -- 172.21.15.134:0/3647073815 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9fe408cc10 con 0x7f9ff40ff390 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.771+0000 7f9ff37fe700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930] conn(0x7f9fdc072350 0x7f9fdc074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.771+0000 7f9ff37fe700 1 -- 172.21.15.134:0/3647073815 --> [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9fdc074e10 con 0x7f9fdc072350 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.771+0000 7f9ff37fe700 1 -- 172.21.15.134:0/3647073815 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fe4092070 con 0x7f9ff40ff390 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.771+0000 7f9ff9b2d700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9fdc06c680 0x7f9fdc06eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8005ea0 tx=0x7f9fe8005e30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.771+0000 7f9ffab2f700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930] conn(0x7f9fdc072350 0x7f9fdc074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.772+0000 7f9ffab2f700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930] conn(0x7f9fdc072350 0x7f9fdc074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.773+0000 7f9ff37fe700 1 -- 172.21.15.134:0/3647073815 <== osd.4 v2:172.21.15.194:6808/3191948930 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9fdc074e10 con 0x7f9fdc072350 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.788+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 --> [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ff4195560 con 0x7f9fdc072350 2024-04-13T10:54:58.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ff37fe700 1 -- 172.21.15.134:0/3647073815 <== osd.4 v2:172.21.15.194:6808/3191948930 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9ff4195560 con 0x7f9fdc072350 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 >> [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930] conn(0x7f9fdc072350 msgr2=0x7f9fdc074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930] conn(0x7f9fdc072350 0x7f9fdc074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9fdc06c680 msgr2=0x7f9fdc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9fdc06c680 0x7f9fdc06eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8005ea0 tx=0x7f9fe8005e30 comp rx=0 tx=0).stop 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ff40ff390 msgr2=0x7f9ff419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ff40ff390 0x7f9ff419a910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4000f80 tx=0x7f9fe400bdc0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 shutdown_connections 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9fdc06c680 0x7f9fdc06eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.194:6808/3191948930,v1:172.21.15.194:6809/3191948930] conn(0x7f9fdc072350 0x7f9fdc074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ff40ff390 0x7f9ff419a910 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 --2- 172.21.15.134:0/3647073815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ff40ffd30 0x7f9ff419ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:54:58.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 >> 172.21.15.134:0/3647073815 conn(0x7f9ff4074f50 msgr2=0x7f9ff40fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:54:58.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 shutdown_connections 2024-04-13T10:54:58.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:54:56.789+0000 7f9ffc592700 1 -- 172.21.15.134:0/3647073815 wait complete. 2024-04-13T10:54:58.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:58 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1134082767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-13T10:54:58.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:58 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:54:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:58 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/1134082767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-13T10:54:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:58 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:54:59.234 INFO:teuthology.orchestra.run.smithi134.stdout:146028888081 2024-04-13T10:54:59.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-13T10:54:59.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:54:59 smithi134 ceph-mon[39696]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:54:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:54:59 smithi194 ceph-mon[46737]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:00.506 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:01.119 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378651 got 81604378652 for osd.2 2024-04-13T10:55:01.119 DEBUG:teuthology.parallel:result is None 2024-04-13T10:55:01.623 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:01 smithi134 ceph-mon[39696]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:01 smithi194 ceph-mon[46737]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:02.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.102+0000 7f330c97c700 1 -- 172.21.15.134:0/1314245993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3308100e00 msgr2=0x7f3308104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:02.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.102+0000 7f330c97c700 1 --2- 172.21.15.134:0/1314245993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3308100e00 0x7f3308104dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009910 tx=0x7f32fc009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:02.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.103+0000 7f330c97c700 1 -- 172.21.15.134:0/1314245993 shutdown_connections 2024-04-13T10:55:02.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.103+0000 7f330c97c700 1 --2- 172.21.15.134:0/1314245993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3308100e00 0x7f3308104dd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.103+0000 7f330c97c700 1 --2- 172.21.15.134:0/1314245993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3308100460 0x7f3308100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.103+0000 7f330c97c700 1 -- 172.21.15.134:0/1314245993 >> 172.21.15.134:0/1314245993 conn(0x7f33080fbd00 msgr2=0x7f33080fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:02.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.103+0000 7f330c97c700 1 -- 172.21.15.134:0/1314245993 shutdown_connections 2024-04-13T10:55:02.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.103+0000 7f330c97c700 1 -- 172.21.15.134:0/1314245993 wait complete. 2024-04-13T10:55:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.103+0000 7f330c97c700 1 Processor -- start 2024-04-13T10:55:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.103+0000 7f330c97c700 1 -- start start 2024-04-13T10:55:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f330c97c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3308100460 0x7f330819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f330c97c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3308100e00 0x7f330819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f330c97c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330819c680 con 0x7f3308100e00 2024-04-13T10:55:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f330c97c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3308195b30 con 0x7f3308100460 2024-04-13T10:55:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f3305d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3308100e00 0x7f330819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:02.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f3305d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3308100e00 0x7f330819bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33474/0 (socket says 172.21.15.134:33474) 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f3305d9b700 1 -- 172.21.15.134:0/2638593968 learned_addr learned my addr 172.21.15.134:0/2638593968 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f330659c700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3308100460 0x7f330819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f3305d9b700 1 -- 172.21.15.134:0/2638593968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3308100460 msgr2=0x7f330819bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f3305d9b700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3308100460 0x7f330819bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f3305d9b700 1 -- 172.21.15.134:0/2638593968 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc0095f0 con 0x7f3308100e00 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f330659c700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3308100460 0x7f330819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f3305d9b700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3308100e00 0x7f330819bff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0092e0 tx=0x7f32fc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f32f77fe700 1 -- 172.21.15.134:0/2638593968 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32fc01d070 con 0x7f3308100e00 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f32f77fe700 1 -- 172.21.15.134:0/2638593968 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f32fc00f460 con 0x7f3308100e00 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f330c97c700 1 -- 172.21.15.134:0/2638593968 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3308195db0 con 0x7f3308100e00 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f32f77fe700 1 -- 172.21.15.134:0/2638593968 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32fc021600 con 0x7f3308100e00 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.104+0000 7f330c97c700 1 -- 172.21.15.134:0/2638593968 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33081962a0 con 0x7f3308100e00 2024-04-13T10:55:02.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.105+0000 7f330c97c700 1 -- 172.21.15.134:0/2638593968 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33081087d0 con 0x7f3308100e00 2024-04-13T10:55:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.106+0000 7f32f77fe700 1 -- 172.21.15.134:0/2638593968 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f32fc00f5d0 con 0x7f3308100e00 2024-04-13T10:55:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.106+0000 7f32f77fe700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f32f006c680 0x7f32f006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.106+0000 7f32f77fe700 1 -- 172.21.15.134:0/2638593968 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f32fc08c800 con 0x7f3308100e00 2024-04-13T10:55:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.106+0000 7f330659c700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f32f006c680 0x7f32f006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:02.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.106+0000 7f330659c700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f32f006c680 0x7f32f006eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32f8005950 tx=0x7f32f8005f50 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:02.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.111+0000 7f32f77fe700 1 -- 172.21.15.134:0/2638593968 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f32fc05acb0 con 0x7f3308100e00 2024-04-13T10:55:02.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.303+0000 7f330c97c700 1 -- 172.21.15.134:0/2638593968 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f330802cc30 con 0x7f3308100e00 2024-04-13T10:55:02.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.303+0000 7f32f77fe700 1 -- 172.21.15.134:0/2638593968 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f32fc060090 con 0x7f3308100e00 2024-04-13T10:55:02.304 INFO:teuthology.orchestra.run.smithi134.stdout:38654705705 2024-04-13T10:55:02.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 -- 172.21.15.134:0/2638593968 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f32f006c680 msgr2=0x7f32f006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:02.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f32f006c680 0x7f32f006eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32f8005950 tx=0x7f32f8005f50 comp rx=0 tx=0).stop 2024-04-13T10:55:02.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 -- 172.21.15.134:0/2638593968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3308100e00 msgr2=0x7f330819bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:02.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3308100e00 0x7f330819bff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0092e0 tx=0x7f32fc00be20 comp rx=0 tx=0).stop 2024-04-13T10:55:02.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 -- 172.21.15.134:0/2638593968 shutdown_connections 2024-04-13T10:55:02.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f32f006c680 0x7f32f006eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3308100460 0x7f330819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 --2- 172.21.15.134:0/2638593968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3308100e00 0x7f330819bff0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 -- 172.21.15.134:0/2638593968 >> 172.21.15.134:0/2638593968 conn(0x7f33080fbd00 msgr2=0x7f33080fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:02.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 -- 172.21.15.134:0/2638593968 shutdown_connections 2024-04-13T10:55:02.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.306+0000 7f330c97c700 1 -- 172.21.15.134:0/2638593968 wait complete. 2024-04-13T10:55:02.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:02 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2638593968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-13T10:55:02.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.715+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3447131160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f8068fd0 msgr2=0x7fa2f8104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.715+0000 7fa2ffc80700 1 --2- 172.21.15.134:0/3447131160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f8068fd0 0x7fa2f8104df0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009910 tx=0x7fa2e8009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.715+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3447131160 shutdown_connections 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.715+0000 7fa2ffc80700 1 --2- 172.21.15.134:0/3447131160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f8068fd0 0x7fa2f8104df0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.715+0000 7fa2ffc80700 1 --2- 172.21.15.134:0/3447131160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f8068630 0x7fa2f8068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.715+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3447131160 >> 172.21.15.134:0/3447131160 conn(0x7fa2f8074f50 msgr2=0x7fa2f8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.715+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3447131160 shutdown_connections 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.715+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3447131160 wait complete. 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2ffc80700 1 Processor -- start 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2ffc80700 1 -- start start 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2ffc80700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f8068630 0x7fa2f8195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2ffc80700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f8068fd0 0x7fa2f81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2ffc80700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81969c0 con 0x7fa2f8068630 2024-04-13T10:55:02.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2ffc80700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f819a750 con 0x7fa2f8068fd0 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2fda1c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f8068630 0x7fa2f8195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2fda1c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f8068630 0x7fa2f8195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33504/0 (socket says 172.21.15.134:33504) 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2fda1c700 1 -- 172.21.15.134:0/3673600384 learned_addr learned my addr 172.21.15.134:0/3673600384 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2fd21b700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f8068fd0 0x7fa2f81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2fda1c700 1 -- 172.21.15.134:0/3673600384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f8068fd0 msgr2=0x7fa2f81962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2fda1c700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f8068fd0 0x7fa2f81962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2fda1c700 1 -- 172.21.15.134:0/3673600384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80095f0 con 0x7fa2f8068630 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2fda1c700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f8068630 0x7fa2f8195da0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400b4b0 tx=0x7fa2f400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2eeffd700 1 -- 172.21.15.134:0/3673600384 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f4011800 con 0x7fa2f8068630 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2eeffd700 1 -- 172.21.15.134:0/3673600384 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fa2f4011df0 con 0x7fa2f8068630 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3673600384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f819aa30 con 0x7fa2f8068630 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2eeffd700 1 -- 172.21.15.134:0/3673600384 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f4010e40 con 0x7fa2f8068630 2024-04-13T10:55:02.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.716+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3673600384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f819af80 con 0x7fa2f8068630 2024-04-13T10:55:02.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.717+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3673600384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f81086d0 con 0x7fa2f8068630 2024-04-13T10:55:02.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.718+0000 7fa2eeffd700 1 -- 172.21.15.134:0/3673600384 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fa2f4010380 con 0x7fa2f8068630 2024-04-13T10:55:02.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.718+0000 7fa2eeffd700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa2e406c630 0x7fa2e406eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:02.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.718+0000 7fa2eeffd700 1 -- 172.21.15.134:0/3673600384 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa2f408b120 con 0x7fa2f8068630 2024-04-13T10:55:02.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.718+0000 7fa2fd21b700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa2e406c630 0x7fa2e406eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:02.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.719+0000 7fa2fd21b700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa2e406c630 0x7fa2e406eae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2f81973c0 tx=0x7fa2e801a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:02.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.723+0000 7fa2eeffd700 1 -- 172.21.15.134:0/3673600384 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa2f4055b40 con 0x7fa2f8068630 2024-04-13T10:55:02.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:02 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/2638593968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-13T10:55:02.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.915+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3673600384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa2f804ea50 con 0x7fa2f8068630 2024-04-13T10:55:02.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.916+0000 7fa2eeffd700 1 -- 172.21.15.134:0/3673600384 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2f4059160 con 0x7fa2f8068630 2024-04-13T10:55:02.917 INFO:teuthology.orchestra.run.smithi134.stdout:167503724556 2024-04-13T10:55:02.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3673600384 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa2e406c630 msgr2=0x7fa2e406eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:02.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa2e406c630 0x7fa2e406eae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2f81973c0 tx=0x7fa2e801a040 comp rx=0 tx=0).stop 2024-04-13T10:55:02.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3673600384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f8068630 msgr2=0x7fa2f8195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:02.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f8068630 0x7fa2f8195da0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400b4b0 tx=0x7fa2f400b870 comp rx=0 tx=0).stop 2024-04-13T10:55:02.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3673600384 shutdown_connections 2024-04-13T10:55:02.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fa2e406c630 0x7fa2e406eae0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2f8068630 0x7fa2f8195da0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 --2- 172.21.15.134:0/3673600384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f8068fd0 0x7fa2f81962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:02.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3673600384 >> 172.21.15.134:0/3673600384 conn(0x7fa2f8074f50 msgr2=0x7fa2f80fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:02.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3673600384 shutdown_connections 2024-04-13T10:55:02.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:02.918+0000 7fa2ffc80700 1 -- 172.21.15.134:0/3673600384 wait complete. 2024-04-13T10:55:03.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:03 smithi134 ceph-mon[39696]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:03.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:03 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3673600384' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-13T10:55:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:03 smithi194 ceph-mon[46737]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:03 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3673600384' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-13T10:55:04.454 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724553 got 167503724556 for osd.5 2024-04-13T10:55:04.454 DEBUG:teuthology.parallel:result is None 2024-04-13T10:55:04.764 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705703 got 38654705705 for osd.0 2024-04-13T10:55:04.764 DEBUG:teuthology.parallel:result is None 2024-04-13T10:55:05.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.163+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2815683382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040ffc60 msgr2=0x7f5a04103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:05.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.163+0000 7f5a0bb3b700 1 --2- 172.21.15.134:0/2815683382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040ffc60 0x7f5a04103c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009910 tx=0x7f59f4009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:05.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.163+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2815683382 shutdown_connections 2024-04-13T10:55:05.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.163+0000 7f5a0bb3b700 1 --2- 172.21.15.134:0/2815683382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040ffc60 0x7f5a04103c30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.163+0000 7f5a0bb3b700 1 --2- 172.21.15.134:0/2815683382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a040ff2c0 0x7f5a040ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.163+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2815683382 >> 172.21.15.134:0/2815683382 conn(0x7f5a040fab80 msgr2=0x7f5a040fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:05.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.163+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2815683382 shutdown_connections 2024-04-13T10:55:05.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.163+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2815683382 wait complete. 2024-04-13T10:55:05.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.163+0000 7f5a0bb3b700 1 Processor -- start 2024-04-13T10:55:05.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.163+0000 7f5a0bb3b700 1 -- start start 2024-04-13T10:55:05.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a0bb3b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a040ff2c0 0x7f5a04196c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:05.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a0bb3b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040ffc60 0x7f5a04197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:05.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a0bb3b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a04197760 con 0x7f5a040ffc60 2024-04-13T10:55:05.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a0bb3b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a041978a0 con 0x7f5a040ff2c0 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a090d6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040ffc60 0x7f5a04197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a090d6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040ffc60 0x7f5a04197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33530/0 (socket says 172.21.15.134:33530) 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a090d6700 1 -- 172.21.15.134:0/2169964042 learned_addr learned my addr 172.21.15.134:0/2169964042 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a098d7700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a040ff2c0 0x7f5a04196c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a090d6700 1 -- 172.21.15.134:0/2169964042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a040ff2c0 msgr2=0x7f5a04196c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a090d6700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a040ff2c0 0x7f5a04196c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a090d6700 1 -- 172.21.15.134:0/2169964042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f40095f0 con 0x7f5a040ffc60 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a098d7700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a040ff2c0 0x7f5a04196c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a090d6700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040ffc60 0x7f5a04197140 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f59f400bda0 tx=0x7f59f400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f59faffd700 1 -- 172.21.15.134:0/2169964042 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59f401d070 con 0x7f5a040ffc60 2024-04-13T10:55:05.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f59faffd700 1 -- 172.21.15.134:0/2169964042 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f59f400f460 con 0x7f5a040ffc60 2024-04-13T10:55:05.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2169964042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0419fc70 con 0x7f5a040ffc60 2024-04-13T10:55:05.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f59faffd700 1 -- 172.21.15.134:0/2169964042 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59f4021640 con 0x7f5a040ffc60 2024-04-13T10:55:05.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.164+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2169964042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a041a0080 con 0x7f5a040ffc60 2024-04-13T10:55:05.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.165+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2169964042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a04107580 con 0x7f5a040ffc60 2024-04-13T10:55:05.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.166+0000 7f59faffd700 1 -- 172.21.15.134:0/2169964042 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f59f400f9b0 con 0x7f5a040ffc60 2024-04-13T10:55:05.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.166+0000 7f59faffd700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f59f006c680 0x7f59f006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:05.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.167+0000 7f59faffd700 1 -- 172.21.15.134:0/2169964042 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f59f408c810 con 0x7f5a040ffc60 2024-04-13T10:55:05.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.167+0000 7f5a098d7700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f59f006c680 0x7f59f006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:05.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.167+0000 7f5a098d7700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f59f006c680 0x7f59f006eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59fc007900 tx=0x7f59fc008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:05.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.171+0000 7f59faffd700 1 -- 172.21.15.134:0/2169964042 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f59f4057230 con 0x7f5a040ffc60 2024-04-13T10:55:05.245 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:05.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.351+0000 7f1a87a71700 1 -- 172.21.15.134:0/2344383188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a80068630 msgr2=0x7f1a80068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.351+0000 7f1a87a71700 1 --2- 172.21.15.134:0/2344383188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a80068630 0x7f1a80068a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009910 tx=0x7f1a7c009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.351+0000 7f1a87a71700 1 -- 172.21.15.134:0/2344383188 shutdown_connections 2024-04-13T10:55:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.351+0000 7f1a87a71700 1 --2- 172.21.15.134:0/2344383188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a80068fd0 0x7f1a80104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.351+0000 7f1a87a71700 1 --2- 172.21.15.134:0/2344383188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a80068630 0x7f1a80068a00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.351+0000 7f1a87a71700 1 -- 172.21.15.134:0/2344383188 >> 172.21.15.134:0/2344383188 conn(0x7f1a80074f50 msgr2=0x7f1a80075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.352+0000 7f1a87a71700 1 -- 172.21.15.134:0/2344383188 shutdown_connections 2024-04-13T10:55:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.352+0000 7f1a87a71700 1 -- 172.21.15.134:0/2344383188 wait complete. 2024-04-13T10:55:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.352+0000 7f1a87a71700 1 Processor -- start 2024-04-13T10:55:05.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.352+0000 7f1a87a71700 1 -- start start 2024-04-13T10:55:05.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.352+0000 7f1a87a71700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a80068630 0x7f1a80197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:05.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.352+0000 7f1a87a71700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a80068fd0 0x7f1a80198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:05.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.352+0000 7f1a87a71700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a80198a60 con 0x7f1a80068630 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.352+0000 7f1a87a71700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8019c7f0 con 0x7f1a80068fd0 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.352+0000 7f1a8580d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a80068630 0x7f1a80197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a8580d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a80068630 0x7f1a80197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33558/0 (socket says 172.21.15.134:33558) 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a8580d700 1 -- 172.21.15.134:0/1205395318 learned_addr learned my addr 172.21.15.134:0/1205395318 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a8500c700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a80068fd0 0x7f1a80198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a8580d700 1 -- 172.21.15.134:0/1205395318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a80068fd0 msgr2=0x7f1a80198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a8580d700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a80068fd0 0x7f1a80198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a8580d700 1 -- 172.21.15.134:0/1205395318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c0095f0 con 0x7f1a80068630 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a8580d700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a80068630 0x7f1a80197e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c006010 tx=0x7f1a7c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a76ffd700 1 -- 172.21.15.134:0/1205395318 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7c01d070 con 0x7f1a80068630 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a87a71700 1 -- 172.21.15.134:0/1205395318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8019ca70 con 0x7f1a80068630 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a76ffd700 1 -- 172.21.15.134:0/1205395318 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f1a7c005710 con 0x7f1a80068630 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a76ffd700 1 -- 172.21.15.134:0/1205395318 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7c00fdc0 con 0x7f1a80068630 2024-04-13T10:55:05.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.353+0000 7f1a87a71700 1 -- 172.21.15.134:0/1205395318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8019cf60 con 0x7f1a80068630 2024-04-13T10:55:05.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.354+0000 7f1a87a71700 1 -- 172.21.15.134:0/1205395318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a80104570 con 0x7f1a80068630 2024-04-13T10:55:05.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.355+0000 7f1a76ffd700 1 -- 172.21.15.134:0/1205395318 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f1a7c00f5f0 con 0x7f1a80068630 2024-04-13T10:55:05.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.355+0000 7f1a76ffd700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a6c06c680 0x7f1a6c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:05.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.355+0000 7f1a76ffd700 1 -- 172.21.15.134:0/1205395318 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1a7c08c650 con 0x7f1a80068630 2024-04-13T10:55:05.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.355+0000 7f1a8500c700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a6c06c680 0x7f1a6c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:05.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.355+0000 7f1a8500c700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a6c06c680 0x7f1a6c06eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1a80199460 tx=0x7f1a7000b410 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:05.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.360+0000 7f1a76ffd700 1 -- 172.21.15.134:0/1205395318 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1a7c057070 con 0x7f1a80068630 2024-04-13T10:55:05.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.375+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2169964042 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a0404ea50 con 0x7f5a040ffc60 2024-04-13T10:55:05.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.378+0000 7f59faffd700 1 -- 172.21.15.134:0/2169964042 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59f405a850 con 0x7f5a040ffc60 2024-04-13T10:55:05.378 INFO:teuthology.orchestra.run.smithi134.stdout:60129542179 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2169964042 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f59f006c680 msgr2=0x7f59f006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f59f006c680 0x7f59f006eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59fc007900 tx=0x7f59fc008040 comp rx=0 tx=0).stop 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2169964042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040ffc60 msgr2=0x7f5a04197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040ffc60 0x7f5a04197140 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f59f400bda0 tx=0x7f59f400be80 comp rx=0 tx=0).stop 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2169964042 shutdown_connections 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f59f006c680 0x7f59f006eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a040ff2c0 0x7f5a04196c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 --2- 172.21.15.134:0/2169964042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040ffc60 0x7f5a04197140 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2169964042 >> 172.21.15.134:0/2169964042 conn(0x7f5a040fab80 msgr2=0x7f5a040fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2169964042 shutdown_connections 2024-04-13T10:55:05.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.380+0000 7f5a0bb3b700 1 -- 172.21.15.134:0/2169964042 wait complete. 2024-04-13T10:55:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.563+0000 7f1a87a71700 1 -- 172.21.15.134:0/1205395318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a8002ccf0 con 0x7f1a80068630 2024-04-13T10:55:05.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.564+0000 7f1a76ffd700 1 -- 172.21.15.134:0/1205395318 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a7c05a690 con 0x7f1a80068630 2024-04-13T10:55:05.564 INFO:teuthology.orchestra.run.smithi134.stdout:111669149719 2024-04-13T10:55:05.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 -- 172.21.15.134:0/1205395318 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a6c06c680 msgr2=0x7f1a6c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:05.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a6c06c680 0x7f1a6c06eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1a80199460 tx=0x7f1a7000b410 comp rx=0 tx=0).stop 2024-04-13T10:55:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 -- 172.21.15.134:0/1205395318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a80068630 msgr2=0x7f1a80197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a80068630 0x7f1a80197e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c006010 tx=0x7f1a7c00bd70 comp rx=0 tx=0).stop 2024-04-13T10:55:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 -- 172.21.15.134:0/1205395318 shutdown_connections 2024-04-13T10:55:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a6c06c680 0x7f1a6c06eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a80068630 0x7f1a80197e40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 --2- 172.21.15.134:0/1205395318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a80068fd0 0x7f1a80198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 -- 172.21.15.134:0/1205395318 >> 172.21.15.134:0/1205395318 conn(0x7f1a80074f50 msgr2=0x7f1a800fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 -- 172.21.15.134:0/1205395318 shutdown_connections 2024-04-13T10:55:05.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:05.566+0000 7f1a87a71700 1 -- 172.21.15.134:0/1205395318 wait complete. 2024-04-13T10:55:05.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:05 smithi134 ceph-mon[39696]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:05 smithi194 ceph-mon[46737]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:06.364 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149717 got 111669149719 for osd.3 2024-04-13T10:55:06.365 DEBUG:teuthology.parallel:result is None 2024-04-13T10:55:06.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:06 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2169964042' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-13T10:55:06.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:06 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1205395318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-13T10:55:06.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:06 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/2169964042' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-13T10:55:06.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:06 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/1205395318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-13T10:55:07.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:07 smithi134 ceph-mon[39696]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:07.489 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542176 got 60129542179 for osd.1 2024-04-13T10:55:07.489 DEBUG:teuthology.parallel:result is None 2024-04-13T10:55:07.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:07 smithi194 ceph-mon[46737]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:08.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.531+0000 7fb9cf160700 1 -- 172.21.15.134:0/680676983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ffd30 msgr2=0x7fb9c8103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:08.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.531+0000 7fb9cf160700 1 --2- 172.21.15.134:0/680676983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ffd30 0x7fb9c8103ce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009910 tx=0x7fb9b4009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:08.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 -- 172.21.15.134:0/680676983 shutdown_connections 2024-04-13T10:55:08.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 --2- 172.21.15.134:0/680676983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ffd30 0x7fb9c8103ce0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 --2- 172.21.15.134:0/680676983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9c80ff390 0x7fb9c80ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 -- 172.21.15.134:0/680676983 >> 172.21.15.134:0/680676983 conn(0x7fb9c8074f50 msgr2=0x7fb9c8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 -- 172.21.15.134:0/680676983 shutdown_connections 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 -- 172.21.15.134:0/680676983 wait complete. 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 Processor -- start 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 -- start start 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9c80ff390 0x7fb9c819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ffd30 0x7fb9c819bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c819c5c0 con 0x7fb9c80ffd30 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9cf160700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8195a70 con 0x7fb9c80ff390 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.532+0000 7fb9c7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ffd30 0x7fb9c819bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:08.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9c7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ffd30 0x7fb9c819bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33572/0 (socket says 172.21.15.134:33572) 2024-04-13T10:55:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9c7fff700 1 -- 172.21.15.134:0/3209210166 learned_addr learned my addr 172.21.15.134:0/3209210166 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9c7fff700 1 -- 172.21.15.134:0/3209210166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9c80ff390 msgr2=0x7fb9c819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9c7fff700 1 --2- 172.21.15.134:0/3209210166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9c80ff390 0x7fb9c819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9c7fff700 1 -- 172.21.15.134:0/3209210166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b40095f0 con 0x7fb9c80ffd30 2024-04-13T10:55:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9c7fff700 1 --2- 172.21.15.134:0/3209210166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ffd30 0x7fb9c819bf30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400bda0 tx=0x7fb9b400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9c5ffb700 1 -- 172.21.15.134:0/3209210166 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9b401d070 con 0x7fb9c80ffd30 2024-04-13T10:55:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9c5ffb700 1 -- 172.21.15.134:0/3209210166 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fb9b400f460 con 0x7fb9c80ffd30 2024-04-13T10:55:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9cf160700 1 -- 172.21.15.134:0/3209210166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c8195cf0 con 0x7fb9c80ffd30 2024-04-13T10:55:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9c5ffb700 1 -- 172.21.15.134:0/3209210166 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9b4021640 con 0x7fb9c80ffd30 2024-04-13T10:55:08.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.533+0000 7fb9cf160700 1 -- 172.21.15.134:0/3209210166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c81961e0 con 0x7fb9c80ffd30 2024-04-13T10:55:08.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.534+0000 7fb9cf160700 1 -- 172.21.15.134:0/3209210166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c804ea50 con 0x7fb9c80ffd30 2024-04-13T10:55:08.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.535+0000 7fb9c5ffb700 1 -- 172.21.15.134:0/3209210166 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fb9b400fa20 con 0x7fb9c80ffd30 2024-04-13T10:55:08.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.535+0000 7fb9c5ffb700 1 --2- 172.21.15.134:0/3209210166 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb9b806c680 0x7fb9b806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:08.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.535+0000 7fb9ccefc700 1 --2- 172.21.15.134:0/3209210166 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb9b806c680 0x7fb9b806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:08.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.535+0000 7fb9c5ffb700 1 -- 172.21.15.134:0/3209210166 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb9b408c740 con 0x7fb9c80ffd30 2024-04-13T10:55:08.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.535+0000 7fb9ccefc700 1 --2- 172.21.15.134:0/3209210166 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb9b806c680 0x7fb9b806eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc005950 tx=0x7fb9bc0058e0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:08.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.540+0000 7fb9c5ffb700 1 -- 172.21.15.134:0/3209210166 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb9b405abf0 con 0x7fb9c80ffd30 2024-04-13T10:55:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.730+0000 7fb9cf160700 1 -- 172.21.15.134:0/3209210166 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb9c81965c0 con 0x7fb9c80ffd30 2024-04-13T10:55:08.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.730+0000 7fb9c5ffb700 1 -- 172.21.15.134:0/3209210166 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9b405a780 con 0x7fb9c80ffd30 2024-04-13T10:55:08.731 INFO:teuthology.orchestra.run.smithi134.stdout:146028888083 2024-04-13T10:55:08.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.732+0000 7fb9cf160700 1 -- 172.21.15.134:0/3209210166 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb9b806c680 msgr2=0x7fb9b806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:08.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.732+0000 7fb9cf160700 1 --2- 172.21.15.134:0/3209210166 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb9b806c680 0x7fb9b806eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc005950 tx=0x7fb9bc0058e0 comp rx=0 tx=0).stop 2024-04-13T10:55:08.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.733+0000 7fb9cf160700 1 -- 172.21.15.134:0/3209210166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ffd30 msgr2=0x7fb9c819bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:08.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.733+0000 7fb9cf160700 1 --2- 172.21.15.134:0/3209210166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ffd30 0x7fb9c819bf30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400bda0 tx=0x7fb9b400be80 comp rx=0 tx=0).stop 2024-04-13T10:55:08.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.733+0000 7fb9cf160700 1 -- 172.21.15.134:0/3209210166 shutdown_connections 2024-04-13T10:55:08.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.733+0000 7fb9cf160700 1 --2- 172.21.15.134:0/3209210166 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fb9b806c680 0x7fb9b806eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:08.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.733+0000 7fb9cf160700 1 --2- 172.21.15.134:0/3209210166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9c80ff390 0x7fb9c819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:08.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.733+0000 7fb9cf160700 1 --2- 172.21.15.134:0/3209210166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9c80ffd30 0x7fb9c819bf30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:08.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.733+0000 7fb9cf160700 1 -- 172.21.15.134:0/3209210166 >> 172.21.15.134:0/3209210166 conn(0x7fb9c8074f50 msgr2=0x7fb9c81037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:08.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.733+0000 7fb9cf160700 1 -- 172.21.15.134:0/3209210166 shutdown_connections 2024-04-13T10:55:08.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:08.733+0000 7fb9cf160700 1 -- 172.21.15.134:0/3209210166 wait complete. 2024-04-13T10:55:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:09 smithi134 ceph-mon[39696]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:09 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3209210166' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-13T10:55:09.504 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888081 got 146028888083 for osd.4 2024-04-13T10:55:09.505 DEBUG:teuthology.parallel:result is None 2024-04-13T10:55:09.505 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-13T10:55:09.505 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph pg dump --format=json 2024-04-13T10:55:09.734 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:09 smithi194 ceph-mon[46737]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:09 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3209210166' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-13T10:55:11.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:11 smithi134 ceph-mon[39696]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:11.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.719+0000 7f7feef1a700 1 -- 172.21.15.134:0/945959672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe80ffc30 msgr2=0x7f7fe810a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:11.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.719+0000 7f7feef1a700 1 --2- 172.21.15.134:0/945959672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe80ffc30 0x7f7fe810a6a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4009940 tx=0x7f7fd4009c50 comp rx=0 tx=0).stop 2024-04-13T10:55:11.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.719+0000 7f7feef1a700 1 -- 172.21.15.134:0/945959672 shutdown_connections 2024-04-13T10:55:11.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.719+0000 7f7feef1a700 1 --2- 172.21.15.134:0/945959672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe80ffc30 0x7f7fe810a6a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:11.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.719+0000 7f7feef1a700 1 --2- 172.21.15.134:0/945959672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80ff320 0x7f7fe80ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:11.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.719+0000 7f7feef1a700 1 -- 172.21.15.134:0/945959672 >> 172.21.15.134:0/945959672 conn(0x7f7fe80748b0 msgr2=0x7f7fe8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:11.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.719+0000 7f7feef1a700 1 -- 172.21.15.134:0/945959672 shutdown_connections 2024-04-13T10:55:11.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.719+0000 7f7feef1a700 1 -- 172.21.15.134:0/945959672 wait complete. 2024-04-13T10:55:11.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.720+0000 7f7feef1a700 1 Processor -- start 2024-04-13T10:55:11.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.720+0000 7f7feef1a700 1 -- start start 2024-04-13T10:55:11.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.720+0000 7f7feef1a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80ff320 0x7f7fe8100500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:11.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.720+0000 7f7feef1a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe80ffc30 0x7f7fe8100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:11.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.720+0000 7f7feef1a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8100f80 con 0x7f7fe80ffc30 2024-04-13T10:55:11.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.720+0000 7f7feef1a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe81010c0 con 0x7f7fe80ff320 2024-04-13T10:55:11.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7fe7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe80ffc30 0x7f7fe8100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7fe7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe80ffc30 0x7f7fe8100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41822/0 (socket says 172.21.15.134:41822) 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7fe7fff700 1 -- 172.21.15.134:0/2553389691 learned_addr learned my addr 172.21.15.134:0/2553389691 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7fe7fff700 1 -- 172.21.15.134:0/2553389691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80ff320 msgr2=0x7f7fe8100500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7fe7fff700 1 --2- 172.21.15.134:0/2553389691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80ff320 0x7f7fe8100500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7fe7fff700 1 -- 172.21.15.134:0/2553389691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40095f0 con 0x7f7fe80ffc30 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7fe7fff700 1 --2- 172.21.15.134:0/2553389691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe80ffc30 0x7f7fe8100a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400b7d0 tx=0x7f7fd40056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7fe5ffb700 1 -- 172.21.15.134:0/2553389691 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd401d070 con 0x7f7fe80ffc30 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7fe5ffb700 1 -- 172.21.15.134:0/2553389691 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f7fd400f460 con 0x7f7fe80ffc30 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7feef1a700 1 -- 172.21.15.134:0/2553389691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe81a1e80 con 0x7f7fe80ffc30 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7fe5ffb700 1 -- 172.21.15.134:0/2553389691 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd4021640 con 0x7f7fe80ffc30 2024-04-13T10:55:11.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.721+0000 7f7feef1a700 1 -- 172.21.15.134:0/2553389691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe81a2290 con 0x7f7fe80ffc30 2024-04-13T10:55:11.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.722+0000 7f7feef1a700 1 -- 172.21.15.134:0/2553389691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe8107da0 con 0x7f7fe80ffc30 2024-04-13T10:55:11.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.723+0000 7f7fe5ffb700 1 -- 172.21.15.134:0/2553389691 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f7fd400fa40 con 0x7f7fe80ffc30 2024-04-13T10:55:11.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.723+0000 7f7fe5ffb700 1 --2- 172.21.15.134:0/2553389691 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f7fd806c680 0x7f7fd806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:11.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.723+0000 7f7fe5ffb700 1 -- 172.21.15.134:0/2553389691 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7fd408ceb0 con 0x7f7fe80ffc30 2024-04-13T10:55:11.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.723+0000 7f7feccb6700 1 --2- 172.21.15.134:0/2553389691 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f7fd806c680 0x7f7fd806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:11.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.724+0000 7f7feccb6700 1 --2- 172.21.15.134:0/2553389691 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f7fd806c680 0x7f7fd806eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0097b0 tx=0x7f7fdc006d20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:11.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.727+0000 7f7fe5ffb700 1 -- 172.21.15.134:0/2553389691 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7fd40578b0 con 0x7f7fe80ffc30 2024-04-13T10:55:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:11 smithi194 ceph-mon[46737]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:11.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.915+0000 7f7feef1a700 1 -- 172.21.15.134:0/2553389691 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fe802cca0 con 0x7f7fd806c680 2024-04-13T10:55:11.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.916+0000 7f7fe5ffb700 1 -- 172.21.15.134:0/2553389691 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27897 (secure 0 0 0) 0x7f7fe802cca0 con 0x7f7fd806c680 2024-04-13T10:55:11.917 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:55:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 -- 172.21.15.134:0/2553389691 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f7fd806c680 msgr2=0x7f7fd806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 --2- 172.21.15.134:0/2553389691 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f7fd806c680 0x7f7fd806eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0097b0 tx=0x7f7fdc006d20 comp rx=0 tx=0).stop 2024-04-13T10:55:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 -- 172.21.15.134:0/2553389691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe80ffc30 msgr2=0x7f7fe8100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 --2- 172.21.15.134:0/2553389691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe80ffc30 0x7f7fe8100a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400b7d0 tx=0x7f7fd40056a0 comp rx=0 tx=0).stop 2024-04-13T10:55:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 -- 172.21.15.134:0/2553389691 shutdown_connections 2024-04-13T10:55:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 --2- 172.21.15.134:0/2553389691 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f7fd806c680 0x7f7fd806eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 --2- 172.21.15.134:0/2553389691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fe80ff320 0x7f7fe8100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 --2- 172.21.15.134:0/2553389691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe80ffc30 0x7f7fe8100a40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 -- 172.21.15.134:0/2553389691 >> 172.21.15.134:0/2553389691 conn(0x7f7fe80748b0 msgr2=0x7f7fe8104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:11.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 -- 172.21.15.134:0/2553389691 shutdown_connections 2024-04-13T10:55:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:11.918+0000 7f7feef1a700 1 -- 172.21.15.134:0/2553389691 wait complete. 2024-04-13T10:55:11.920 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-04-13T10:55:12.603 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-04-13T10:55:10.325829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002170"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-13T10:54:16.266533+0000","last_change":"2024-04-13T10:53:47.885863+0000","last_active":"2024-04-13T10:54:16.266533+0000","last_peered":"2024-04-13T10:54:16.266533+0000","last_clean":"2024-04-13T10:54:16.266533+0000","last_became_active":"2024-04-13T10:53:47.885591+0000","last_became_peered":"2024-04-13T10:53:47.885591+0000","last_unstale":"2024-04-13T10:54:16.266533+0000","last_undegraded":"2024-04-13T10:54:16.266533+0000","last_fullsized":"2024-04-13T10:54:16.266533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T10:52:52.794685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T10:52:52.794685+0000","last_clean_scrub_stamp":"2024-04-13T10:52:52.794685+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:28:51.513272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 13 10:54:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.503}]},{"osd":1,"last update":"Sat Apr 13 10:54:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Apr 13 10:54:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.47199999999999998}]},{"osd":3,"last update":"Sat Apr 13 10:54:53 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.436},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149721,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.5},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55200000000000005}]},{"osd":1,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.622}]},{"osd":4,"last update":"Sat Apr 13 10:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.36699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378655,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 13 10:54:54 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33900000000000002,"15min":0.34100000000000003},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.317},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46899999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.374}]},{"osd":1,"last update":"Sat Apr 13 10:54:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36499999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.44800000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.376,"15min":0.379},"min":{"1min":0.27000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.48699999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.34699999999999998}]},{"osd":3,"last update":"Sat Apr 13 10:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.434},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Apr 13 10:54:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.31,"15min":0.30399999999999999},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.437,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.312,"15min":0.30399999999999999},"min":{"1min":0.24299999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Apr 13 10:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34899999999999998,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46300000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.315},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Apr 13 10:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.318,"15min":0.312},"min":{"1min":0.27000000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.318},"min":{"1min":0.23799999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Apr 13 10:54:54 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.24199999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38,"15min":0.38500000000000001},"min":{"1min":0.252,"5min":0.19,"15min":0.19},"max":{"1min":0.45400000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.47199999999999998}]},{"osd":3,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.81200000000000006}]},{"osd":4,"last update":"Sat Apr 13 10:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T10:55:12.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph pg dump --format=json 2024-04-13T10:55:12.829 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:13.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:13 smithi134 ceph-mon[39696]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-13T10:55:13.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:13 smithi134 ceph-mon[39696]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:13.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:55:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:13 smithi194 ceph-mon[46737]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-13T10:55:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:13 smithi194 ceph-mon[46737]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:55:14.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.665+0000 7f91fed83700 1 -- 172.21.15.134:0/358860135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f8100d70 msgr2=0x7f91f8104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:14.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.665+0000 7f91fed83700 1 --2- 172.21.15.134:0/358860135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f8100d70 0x7f91f8104d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009910 tx=0x7f91e4009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:14.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.665+0000 7f91fed83700 1 -- 172.21.15.134:0/358860135 shutdown_connections 2024-04-13T10:55:14.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.665+0000 7f91fed83700 1 --2- 172.21.15.134:0/358860135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f8100d70 0x7f91f8104d40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:14.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.665+0000 7f91fed83700 1 --2- 172.21.15.134:0/358860135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91f81003d0 0x7f91f81007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:14.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.665+0000 7f91fed83700 1 -- 172.21.15.134:0/358860135 >> 172.21.15.134:0/358860135 conn(0x7f91f80fbc50 msgr2=0x7f91f80fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:14.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.665+0000 7f91fed83700 1 -- 172.21.15.134:0/358860135 shutdown_connections 2024-04-13T10:55:14.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.665+0000 7f91fed83700 1 -- 172.21.15.134:0/358860135 wait complete. 2024-04-13T10:55:14.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.666+0000 7f91fed83700 1 Processor -- start 2024-04-13T10:55:14.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.666+0000 7f91fed83700 1 -- start start 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91fed83700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91f81003d0 0x7f91f819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91fed83700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f8100d70 0x7f91f819bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91fed83700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f819c630 con 0x7f91f8100d70 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91fed83700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8195ae0 con 0x7f91f81003d0 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91f7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f8100d70 0x7f91f819bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91f7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f8100d70 0x7f91f819bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41828/0 (socket says 172.21.15.134:41828) 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91f7fff700 1 -- 172.21.15.134:0/229263062 learned_addr learned my addr 172.21.15.134:0/229263062 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91fcb1f700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91f81003d0 0x7f91f819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91f7fff700 1 -- 172.21.15.134:0/229263062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91f81003d0 msgr2=0x7f91f819ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91f7fff700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91f81003d0 0x7f91f819ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91f7fff700 1 -- 172.21.15.134:0/229263062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40095f0 con 0x7f91f8100d70 2024-04-13T10:55:14.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91f7fff700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f8100d70 0x7f91f819bfa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005f50 tx=0x7f91e400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:14.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91f5ffb700 1 -- 172.21.15.134:0/229263062 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e401d070 con 0x7f91f8100d70 2024-04-13T10:55:14.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91f5ffb700 1 -- 172.21.15.134:0/229263062 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f91e400f460 con 0x7f91f8100d70 2024-04-13T10:55:14.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91fed83700 1 -- 172.21.15.134:0/229263062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f8195d60 con 0x7f91f8100d70 2024-04-13T10:55:14.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.667+0000 7f91f5ffb700 1 -- 172.21.15.134:0/229263062 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e4021640 con 0x7f91f8100d70 2024-04-13T10:55:14.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.668+0000 7f91fed83700 1 -- 172.21.15.134:0/229263062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f8196250 con 0x7f91f8100d70 2024-04-13T10:55:14.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.668+0000 7f91fed83700 1 -- 172.21.15.134:0/229263062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f8108740 con 0x7f91f8100d70 2024-04-13T10:55:14.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.669+0000 7f91f5ffb700 1 -- 172.21.15.134:0/229263062 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f91e400f9e0 con 0x7f91f8100d70 2024-04-13T10:55:14.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.669+0000 7f91f5ffb700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91e806c680 0x7f91e806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:14.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.669+0000 7f91f5ffb700 1 -- 172.21.15.134:0/229263062 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f91e408c860 con 0x7f91f8100d70 2024-04-13T10:55:14.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.669+0000 7f91fcb1f700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91e806c680 0x7f91e806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:14.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.670+0000 7f91fcb1f700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91e806c680 0x7f91e806eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91ec005fd0 tx=0x7f91ec00a560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:14.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.674+0000 7f91f5ffb700 1 -- 172.21.15.134:0/229263062 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f91e405ad10 con 0x7f91f8100d70 2024-04-13T10:55:14.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.865+0000 7f91fed83700 1 -- 172.21.15.134:0/229263062 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91f802ccf0 con 0x7f91e806c680 2024-04-13T10:55:14.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.866+0000 7f91f5ffb700 1 -- 172.21.15.134:0/229263062 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27925 (secure 0 0 0) 0x7f91f802ccf0 con 0x7f91e806c680 2024-04-13T10:55:14.867 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:55:14.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 -- 172.21.15.134:0/229263062 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91e806c680 msgr2=0x7f91e806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:14.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91e806c680 0x7f91e806eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91ec005fd0 tx=0x7f91ec00a560 comp rx=0 tx=0).stop 2024-04-13T10:55:14.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 -- 172.21.15.134:0/229263062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f8100d70 msgr2=0x7f91f819bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:14.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f8100d70 0x7f91f819bfa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005f50 tx=0x7f91e400be20 comp rx=0 tx=0).stop 2024-04-13T10:55:14.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 -- 172.21.15.134:0/229263062 shutdown_connections 2024-04-13T10:55:14.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91e806c680 0x7f91e806eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:14.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91f81003d0 0x7f91f819ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:14.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 --2- 172.21.15.134:0/229263062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91f8100d70 0x7f91f819bfa0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:14.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 -- 172.21.15.134:0/229263062 >> 172.21.15.134:0/229263062 conn(0x7f91f80fbc50 msgr2=0x7f91f80fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:14.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 -- 172.21.15.134:0/229263062 shutdown_connections 2024-04-13T10:55:14.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:14.868+0000 7f91fed83700 1 -- 172.21.15.134:0/229263062 wait complete. 2024-04-13T10:55:14.871 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-04-13T10:55:15.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:15 smithi134 ceph-mon[39696]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:15.592 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-04-13T10:55:14.326642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002338"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-13T10:54:16.266533+0000","last_change":"2024-04-13T10:53:47.885863+0000","last_active":"2024-04-13T10:54:16.266533+0000","last_peered":"2024-04-13T10:54:16.266533+0000","last_clean":"2024-04-13T10:54:16.266533+0000","last_became_active":"2024-04-13T10:53:47.885591+0000","last_became_peered":"2024-04-13T10:53:47.885591+0000","last_unstale":"2024-04-13T10:54:16.266533+0000","last_undegraded":"2024-04-13T10:54:16.266533+0000","last_fullsized":"2024-04-13T10:54:16.266533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T10:52:52.794685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T10:52:52.794685+0000","last_clean_scrub_stamp":"2024-04-13T10:52:52.794685+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:28:51.513272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888085,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 13 10:54:53 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.437},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Apr 13 10:54:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.57099999999999995}]},{"osd":2,"last update":"Sat Apr 13 10:54:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.42999999999999999}]},{"osd":3,"last update":"Sat Apr 13 10:54:53 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]}]},{"osd":3,"up_from":26,"seq":111669149721,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.5},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.55200000000000005}]},{"osd":1,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.622}]},{"osd":4,"last update":"Sat Apr 13 10:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.36699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378656,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 13 10:54:54 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33900000000000002,"15min":0.34100000000000003},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46899999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.27200000000000002}]},{"osd":1,"last update":"Sat Apr 13 10:54:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36499999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.44800000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.254},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.376,"15min":0.379},"min":{"1min":0.27000000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.48699999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Apr 13 10:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.45300000000000001}]},{"osd":4,"last update":"Sat Apr 13 10:54:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.31,"15min":0.30399999999999999},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.437,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.312,"15min":0.30399999999999999},"min":{"1min":0.24299999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Apr 13 10:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34899999999999998,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46300000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Apr 13 10:54:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.496},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.318,"15min":0.312},"min":{"1min":0.27000000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.318},"min":{"1min":0.23799999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Apr 13 10:54:54 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.24199999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38,"15min":0.38500000000000001},"min":{"1min":0.252,"5min":0.19,"15min":0.19},"max":{"1min":0.45400000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.47199999999999998}]},{"osd":3,"last update":"Sat Apr 13 10:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.81200000000000006}]},{"osd":4,"last update":"Sat Apr 13 10:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T10:55:15.594 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-13T10:55:15.594 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-13T10:55:15.594 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-13T10:55:15.594 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph health --format=json 2024-04-13T10:55:15.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:15 smithi194 ceph-mon[46737]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:15.821 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:16.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:16 smithi134 ceph-mon[39696]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-13T10:55:16.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:16 smithi194 ceph-mon[46737]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-13T10:55:17.528 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:17 smithi134 ceph-mon[39696]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:17.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:17 smithi194 ceph-mon[46737]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:17.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.807+0000 7f0d34b84700 1 -- 172.21.15.134:0/1549471289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d300ffd30 msgr2=0x7f0d30103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.807+0000 7f0d34b84700 1 --2- 172.21.15.134:0/1549471289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d300ffd30 0x7f0d30103ce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009910 tx=0x7f0d18009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.807+0000 7f0d34b84700 1 -- 172.21.15.134:0/1549471289 shutdown_connections 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.807+0000 7f0d34b84700 1 --2- 172.21.15.134:0/1549471289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d300ffd30 0x7f0d30103ce0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.807+0000 7f0d34b84700 1 --2- 172.21.15.134:0/1549471289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d300ff390 0x7f0d300ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.807+0000 7f0d34b84700 1 -- 172.21.15.134:0/1549471289 >> 172.21.15.134:0/1549471289 conn(0x7f0d30074f50 msgr2=0x7f0d30075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.807+0000 7f0d34b84700 1 -- 172.21.15.134:0/1549471289 shutdown_connections 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.807+0000 7f0d34b84700 1 -- 172.21.15.134:0/1549471289 wait complete. 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d34b84700 1 Processor -- start 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d34b84700 1 -- start start 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d34b84700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d300ff390 0x7f0d30100d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:17.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d34b84700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d300ffd30 0x7f0d301012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d34b84700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d30101800 con 0x7f0d300ffd30 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d34b84700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d30101940 con 0x7f0d300ff390 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d2dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d300ffd30 0x7f0d301012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d2dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d300ffd30 0x7f0d301012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41854/0 (socket says 172.21.15.134:41854) 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d2dd9b700 1 -- 172.21.15.134:0/4248418298 learned_addr learned my addr 172.21.15.134:0/4248418298 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d2e59c700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d300ff390 0x7f0d30100d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d2dd9b700 1 -- 172.21.15.134:0/4248418298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d300ff390 msgr2=0x7f0d30100d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d2dd9b700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d300ff390 0x7f0d30100d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d2dd9b700 1 -- 172.21.15.134:0/4248418298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d180095f0 con 0x7f0d300ffd30 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.808+0000 7f0d2dd9b700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d300ffd30 0x7f0d301012c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d180092e0 tx=0x7f0d1800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.809+0000 7f0d277fe700 1 -- 172.21.15.134:0/4248418298 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d1801d070 con 0x7f0d300ffd30 2024-04-13T10:55:17.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.809+0000 7f0d34b84700 1 -- 172.21.15.134:0/4248418298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d30101bc0 con 0x7f0d300ffd30 2024-04-13T10:55:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.809+0000 7f0d277fe700 1 -- 172.21.15.134:0/4248418298 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f0d1800f460 con 0x7f0d300ffd30 2024-04-13T10:55:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.809+0000 7f0d277fe700 1 -- 172.21.15.134:0/4248418298 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d18021620 con 0x7f0d300ffd30 2024-04-13T10:55:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.809+0000 7f0d34b84700 1 -- 172.21.15.134:0/4248418298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d301a2280 con 0x7f0d300ffd30 2024-04-13T10:55:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.810+0000 7f0d34b84700 1 -- 172.21.15.134:0/4248418298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3004ea50 con 0x7f0d300ffd30 2024-04-13T10:55:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.810+0000 7f0d277fe700 1 -- 172.21.15.134:0/4248418298 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f0d1800f5d0 con 0x7f0d300ffd30 2024-04-13T10:55:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.811+0000 7f0d277fe700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0d1c06c680 0x7f0d1c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.811+0000 7f0d2e59c700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0d1c06c680 0x7f0d1c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.811+0000 7f0d277fe700 1 -- 172.21.15.134:0/4248418298 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0d1808c6f0 con 0x7f0d300ffd30 2024-04-13T10:55:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.811+0000 7f0d2e59c700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0d1c06c680 0x7f0d1c06eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009a10 tx=0x7f0d20009190 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:17.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:17.815+0000 7f0d277fe700 1 -- 172.21.15.134:0/4248418298 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0d18057110 con 0x7f0d300ffd30 2024-04-13T10:55:18.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.049+0000 7f0d34b84700 1 -- 172.21.15.134:0/4248418298 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0d301022b0 con 0x7f0d300ffd30 2024-04-13T10:55:18.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.049+0000 7f0d277fe700 1 -- 172.21.15.134:0/4248418298 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0d1805a730 con 0x7f0d300ffd30 2024-04-13T10:55:18.050 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:55:18.050 INFO:teuthology.orchestra.run.smithi134.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-13T10:55:18.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 -- 172.21.15.134:0/4248418298 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0d1c06c680 msgr2=0x7f0d1c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:18.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0d1c06c680 0x7f0d1c06eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009a10 tx=0x7f0d20009190 comp rx=0 tx=0).stop 2024-04-13T10:55:18.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 -- 172.21.15.134:0/4248418298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d300ffd30 msgr2=0x7f0d301012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:18.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d300ffd30 0x7f0d301012c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d180092e0 tx=0x7f0d1800bd70 comp rx=0 tx=0).stop 2024-04-13T10:55:18.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 -- 172.21.15.134:0/4248418298 shutdown_connections 2024-04-13T10:55:18.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f0d1c06c680 0x7f0d1c06eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:18.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d300ff390 0x7f0d30100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:18.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 --2- 172.21.15.134:0/4248418298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d300ffd30 0x7f0d301012c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:18.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 -- 172.21.15.134:0/4248418298 >> 172.21.15.134:0/4248418298 conn(0x7f0d30074f50 msgr2=0x7f0d300fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:18.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 -- 172.21.15.134:0/4248418298 shutdown_connections 2024-04-13T10:55:18.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:18.051+0000 7f0d34b84700 1 -- 172.21.15.134:0/4248418298 wait complete. 2024-04-13T10:55:18.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:18 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/4248418298' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-13T10:55:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:18 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/4248418298' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-13T10:55:18.775 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-13T10:55:18.775 INFO:tasks.cephadm:Setup complete, yielding 2024-04-13T10:55:18.776 INFO:teuthology.run_tasks:Running task print... 2024-04-13T10:55:18.784 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-04-13T10:55:18.784 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-13T10:55:18.857 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T10:55:18.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-13T10:55:19.088 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:19.677 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:19 smithi134 ceph-mon[39696]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:19.677 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:19 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:55:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:19 smithi194 ceph-mon[46737]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:19 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:55:20.503 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:20 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:20.503 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:20 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:55:20.503 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:20 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:20.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:20 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:20.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:20 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:55:20.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:20 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.982+0000 7f3bac385700 1 -- 172.21.15.134:0/2601181784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba40ff050 msgr2=0x7f3ba40ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.982+0000 7f3bac385700 1 --2- 172.21.15.134:0/2601181784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba40ff050 0x7f3ba40ff460 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0009910 tx=0x7f3ba0009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 -- 172.21.15.134:0/2601181784 shutdown_connections 2024-04-13T10:55:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 --2- 172.21.15.134:0/2601181784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ba4100250 0x7f3ba41006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 --2- 172.21.15.134:0/2601181784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba40ff050 0x7f3ba40ff460 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 -- 172.21.15.134:0/2601181784 >> 172.21.15.134:0/2601181784 conn(0x7f3ba40fa5e0 msgr2=0x7f3ba40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 -- 172.21.15.134:0/2601181784 shutdown_connections 2024-04-13T10:55:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 -- 172.21.15.134:0/2601181784 wait complete. 2024-04-13T10:55:20.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 Processor -- start 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 -- start start 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba40ff050 0x7f3ba41958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ba4100250 0x7f3ba4195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4196410 con 0x7f3ba40ff050 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3bac385700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4196550 con 0x7f3ba4100250 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3baa121700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba40ff050 0x7f3ba41958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3baa121700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba40ff050 0x7f3ba41958b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35240/0 (socket says 172.21.15.134:35240) 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.983+0000 7f3baa121700 1 -- 172.21.15.134:0/4160682851 learned_addr learned my addr 172.21.15.134:0/4160682851 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.984+0000 7f3ba9920700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ba4100250 0x7f3ba4195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.984+0000 7f3baa121700 1 -- 172.21.15.134:0/4160682851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ba4100250 msgr2=0x7f3ba4195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.984+0000 7f3baa121700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ba4100250 0x7f3ba4195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.984+0000 7f3baa121700 1 -- 172.21.15.134:0/4160682851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba00095f0 con 0x7f3ba40ff050 2024-04-13T10:55:20.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.984+0000 7f3baa121700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba40ff050 0x7f3ba41958b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000bda0 tx=0x7f3ba000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:20.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.984+0000 7f3b9b7fe700 1 -- 172.21.15.134:0/4160682851 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba001d070 con 0x7f3ba40ff050 2024-04-13T10:55:20.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.984+0000 7f3b9b7fe700 1 -- 172.21.15.134:0/4160682851 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f3ba0022470 con 0x7f3ba40ff050 2024-04-13T10:55:20.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.984+0000 7f3bac385700 1 -- 172.21.15.134:0/4160682851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba419afa0 con 0x7f3ba40ff050 2024-04-13T10:55:20.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.984+0000 7f3b9b7fe700 1 -- 172.21.15.134:0/4160682851 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba000f670 con 0x7f3ba40ff050 2024-04-13T10:55:20.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.984+0000 7f3bac385700 1 -- 172.21.15.134:0/4160682851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba419b490 con 0x7f3ba40ff050 2024-04-13T10:55:20.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.985+0000 7f3bac385700 1 -- 172.21.15.134:0/4160682851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba4107a60 con 0x7f3ba40ff050 2024-04-13T10:55:20.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.985+0000 7f3b9b7fe700 1 -- 172.21.15.134:0/4160682851 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f3ba0022a50 con 0x7f3ba40ff050 2024-04-13T10:55:20.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.986+0000 7f3b9b7fe700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3b9006c680 0x7f3b9006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:20.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.986+0000 7f3b9b7fe700 1 -- 172.21.15.134:0/4160682851 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3ba008cb80 con 0x7f3ba40ff050 2024-04-13T10:55:20.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.986+0000 7f3ba9920700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3b9006c680 0x7f3b9006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:20.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.986+0000 7f3ba9920700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3b9006c680 0x7f3b9006eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3b94005fd0 tx=0x7f3b9400a560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:20.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:20.990+0000 7f3b9b7fe700 1 -- 172.21.15.134:0/4160682851 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3ba005b0e0 con 0x7f3ba40ff050 2024-04-13T10:55:21.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.182+0000 7f3bac385700 1 -- 172.21.15.134:0/4160682851 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f3ba4107c50 con 0x7f3ba40ff050 2024-04-13T10:55:21.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.186+0000 7f3b9b7fe700 1 -- 172.21.15.134:0/4160682851 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3ba005ac70 con 0x7f3ba40ff050 2024-04-13T10:55:21.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 -- 172.21.15.134:0/4160682851 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3b9006c680 msgr2=0x7f3b9006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:21.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3b9006c680 0x7f3b9006eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3b94005fd0 tx=0x7f3b9400a560 comp rx=0 tx=0).stop 2024-04-13T10:55:21.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 -- 172.21.15.134:0/4160682851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba40ff050 msgr2=0x7f3ba41958b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba40ff050 0x7f3ba41958b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000bda0 tx=0x7f3ba000be80 comp rx=0 tx=0).stop 2024-04-13T10:55:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 -- 172.21.15.134:0/4160682851 shutdown_connections 2024-04-13T10:55:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3b9006c680 0x7f3b9006eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ba40ff050 0x7f3ba41958b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 --2- 172.21.15.134:0/4160682851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ba4100250 0x7f3ba4195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 -- 172.21.15.134:0/4160682851 >> 172.21.15.134:0/4160682851 conn(0x7f3ba40fa5e0 msgr2=0x7f3ba40683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 -- 172.21.15.134:0/4160682851 shutdown_connections 2024-04-13T10:55:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:21.189+0000 7f3bac385700 1 -- 172.21.15.134:0/4160682851 wait complete. 2024-04-13T10:55:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:21 smithi134 ceph-mon[39696]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:21 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/4160682851' entity='client.admin' 2024-04-13T10:55:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:21 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:55:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:21 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:21 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:55:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:21 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:21 smithi194 ceph-mon[46737]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:21 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/4160682851' entity='client.admin' 2024-04-13T10:55:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:21 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:55:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:21 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:21 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:55:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:21 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:22.080 INFO:teuthology.run_tasks:Running task print... 2024-04-13T10:55:22.090 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-13T10:55:22.090 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-13T10:55:22.131 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T10:55:22.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph orch status' 2024-04-13T10:55:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:23 smithi194 ceph-mon[46737]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:23.890 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:23 smithi134 ceph-mon[39696]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:24.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.116+0000 7f37339c3700 1 -- 172.21.15.134:0/1044778283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f372c0ff050 msgr2=0x7f372c0ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:24.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.116+0000 7f37339c3700 1 --2- 172.21.15.134:0/1044778283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f372c0ff050 0x7f372c0ff460 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f371c009910 tx=0x7f371c009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:24.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.116+0000 7f37339c3700 1 -- 172.21.15.134:0/1044778283 shutdown_connections 2024-04-13T10:55:24.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.116+0000 7f37339c3700 1 --2- 172.21.15.134:0/1044778283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f372c100250 0x7f372c1006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:24.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.116+0000 7f37339c3700 1 --2- 172.21.15.134:0/1044778283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f372c0ff050 0x7f372c0ff460 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:24.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.116+0000 7f37339c3700 1 -- 172.21.15.134:0/1044778283 >> 172.21.15.134:0/1044778283 conn(0x7f372c0fa5e0 msgr2=0x7f372c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:24.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.116+0000 7f37339c3700 1 -- 172.21.15.134:0/1044778283 shutdown_connections 2024-04-13T10:55:24.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.116+0000 7f37339c3700 1 -- 172.21.15.134:0/1044778283 wait complete. 2024-04-13T10:55:24.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.117+0000 7f37339c3700 1 Processor -- start 2024-04-13T10:55:24.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.117+0000 7f37339c3700 1 -- start start 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.117+0000 7f37339c3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f372c0ff050 0x7f372c1948e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.117+0000 7f37339c3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f372c100250 0x7f372c194e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.117+0000 7f37339c3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c195440 con 0x7f372c0ff050 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.117+0000 7f37339c3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c195580 con 0x7f372c100250 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.117+0000 7f373175f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f372c0ff050 0x7f372c1948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.117+0000 7f373175f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f372c0ff050 0x7f372c1948e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35262/0 (socket says 172.21.15.134:35262) 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.117+0000 7f373175f700 1 -- 172.21.15.134:0/1368758757 learned_addr learned my addr 172.21.15.134:0/1368758757 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.118+0000 7f373175f700 1 -- 172.21.15.134:0/1368758757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f372c100250 msgr2=0x7f372c194e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.118+0000 7f373175f700 1 --2- 172.21.15.134:0/1368758757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f372c100250 0x7f372c194e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.118+0000 7f373175f700 1 -- 172.21.15.134:0/1368758757 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c0095f0 con 0x7f372c0ff050 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.118+0000 7f373175f700 1 --2- 172.21.15.134:0/1368758757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f372c0ff050 0x7f372c1948e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f371c00bda0 tx=0x7f371c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.118+0000 7f37227fc700 1 -- 172.21.15.134:0/1368758757 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c01d070 con 0x7f372c0ff050 2024-04-13T10:55:24.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.118+0000 7f37227fc700 1 -- 172.21.15.134:0/1368758757 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f371c022470 con 0x7f372c0ff050 2024-04-13T10:55:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.118+0000 7f37339c3700 1 -- 172.21.15.134:0/1368758757 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c199fd0 con 0x7f372c0ff050 2024-04-13T10:55:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.118+0000 7f37227fc700 1 -- 172.21.15.134:0/1368758757 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c00f690 con 0x7f372c0ff050 2024-04-13T10:55:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.118+0000 7f37339c3700 1 -- 172.21.15.134:0/1368758757 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c19a4f0 con 0x7f372c0ff050 2024-04-13T10:55:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.119+0000 7f37339c3700 1 -- 172.21.15.134:0/1368758757 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c107ae0 con 0x7f372c0ff050 2024-04-13T10:55:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.119+0000 7f37227fc700 1 -- 172.21.15.134:0/1368758757 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f371c0229c0 con 0x7f372c0ff050 2024-04-13T10:55:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.120+0000 7f37227fc700 1 --2- 172.21.15.134:0/1368758757 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f371806c680 0x7f371806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.120+0000 7f37227fc700 1 -- 172.21.15.134:0/1368758757 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f371c08cc10 con 0x7f372c0ff050 2024-04-13T10:55:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.120+0000 7f3730f5e700 1 --2- 172.21.15.134:0/1368758757 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f371806c680 0x7f371806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.120+0000 7f3730f5e700 1 --2- 172.21.15.134:0/1368758757 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f371806c680 0x7f371806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37280097b0 tx=0x7f3728006d20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.124+0000 7f37227fc700 1 -- 172.21.15.134:0/1368758757 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f371c05b170 con 0x7f372c0ff050 2024-04-13T10:55:24.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.330+0000 7f37339c3700 1 -- 172.21.15.134:0/1368758757 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f372c104ba0 con 0x7f371806c680 2024-04-13T10:55:24.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.331+0000 7f37227fc700 1 -- 172.21.15.134:0/1368758757 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f372c104ba0 con 0x7f371806c680 2024-04-13T10:55:24.331 INFO:teuthology.orchestra.run.smithi134.stdout:Backend: cephadm 2024-04-13T10:55:24.331 INFO:teuthology.orchestra.run.smithi134.stdout:Available: Yes 2024-04-13T10:55:24.332 INFO:teuthology.orchestra.run.smithi134.stdout:Paused: No 2024-04-13T10:55:24.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 -- 172.21.15.134:0/1368758757 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f371806c680 msgr2=0x7f371806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:24.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 --2- 172.21.15.134:0/1368758757 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f371806c680 0x7f371806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37280097b0 tx=0x7f3728006d20 comp rx=0 tx=0).stop 2024-04-13T10:55:24.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 -- 172.21.15.134:0/1368758757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f372c0ff050 msgr2=0x7f372c1948e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:24.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 --2- 172.21.15.134:0/1368758757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f372c0ff050 0x7f372c1948e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f371c00bda0 tx=0x7f371c00be80 comp rx=0 tx=0).stop 2024-04-13T10:55:24.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 -- 172.21.15.134:0/1368758757 shutdown_connections 2024-04-13T10:55:24.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 --2- 172.21.15.134:0/1368758757 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f371806c680 0x7f371806eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:24.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 --2- 172.21.15.134:0/1368758757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f372c0ff050 0x7f372c1948e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:24.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 --2- 172.21.15.134:0/1368758757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f372c100250 0x7f372c194e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:24.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 -- 172.21.15.134:0/1368758757 >> 172.21.15.134:0/1368758757 conn(0x7f372c0fa5e0 msgr2=0x7f372c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:24.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 -- 172.21.15.134:0/1368758757 shutdown_connections 2024-04-13T10:55:24.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:24.333+0000 7f37339c3700 1 -- 172.21.15.134:0/1368758757 wait complete. 2024-04-13T10:55:25.110 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-13T10:55:25.344 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:25.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:25 smithi134 ceph-mon[39696]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:25.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:25 smithi134 ceph-mon[39696]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:25 smithi194 ceph-mon[46737]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:25 smithi194 ceph-mon[46737]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.006+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2500325319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b00ff050 msgr2=0x7ff1b00ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.006+0000 7ff1b4eb5700 1 --2- 172.21.15.134:0/2500325319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b00ff050 0x7ff1b00ff460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009910 tx=0x7ff1a4009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.006+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2500325319 shutdown_connections 2024-04-13T10:55:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.006+0000 7ff1b4eb5700 1 --2- 172.21.15.134:0/2500325319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1b0100250 0x7ff1b01006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.006+0000 7ff1b4eb5700 1 --2- 172.21.15.134:0/2500325319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b00ff050 0x7ff1b00ff460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.006+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2500325319 >> 172.21.15.134:0/2500325319 conn(0x7ff1b00fa5e0 msgr2=0x7ff1b00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.006+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2500325319 shutdown_connections 2024-04-13T10:55:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.006+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2500325319 wait complete. 2024-04-13T10:55:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.007+0000 7ff1b4eb5700 1 Processor -- start 2024-04-13T10:55:27.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.007+0000 7ff1b4eb5700 1 -- start start 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.007+0000 7ff1b4eb5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b00ff050 0x7ff1b0102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.007+0000 7ff1b4eb5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1b0100250 0x7ff1b0101630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.007+0000 7ff1b4eb5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b0101b70 con 0x7ff1b00ff050 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.007+0000 7ff1b4eb5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b0101cb0 con 0x7ff1b0100250 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.007+0000 7ff1ae59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b00ff050 0x7ff1b0102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.007+0000 7ff1ae59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b00ff050 0x7ff1b0102fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35286/0 (socket says 172.21.15.134:35286) 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.007+0000 7ff1ae59c700 1 -- 172.21.15.134:0/2122955665 learned_addr learned my addr 172.21.15.134:0/2122955665 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.008+0000 7ff1add9b700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1b0100250 0x7ff1b0101630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.008+0000 7ff1ae59c700 1 -- 172.21.15.134:0/2122955665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1b0100250 msgr2=0x7ff1b0101630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.008+0000 7ff1ae59c700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1b0100250 0x7ff1b0101630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.008+0000 7ff1ae59c700 1 -- 172.21.15.134:0/2122955665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40095f0 con 0x7ff1b00ff050 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.008+0000 7ff1ae59c700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b00ff050 0x7ff1b0102fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400bda0 tx=0x7ff1a400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.008+0000 7ff19f7fe700 1 -- 172.21.15.134:0/2122955665 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a401d070 con 0x7ff1b00ff050 2024-04-13T10:55:27.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.008+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2122955665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b0101f30 con 0x7ff1b00ff050 2024-04-13T10:55:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.008+0000 7ff19f7fe700 1 -- 172.21.15.134:0/2122955665 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7ff1a4022470 con 0x7ff1b00ff050 2024-04-13T10:55:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.008+0000 7ff19f7fe700 1 -- 172.21.15.134:0/2122955665 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a400f690 con 0x7ff1b00ff050 2024-04-13T10:55:27.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.008+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2122955665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b0102420 con 0x7ff1b00ff050 2024-04-13T10:55:27.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.009+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2122955665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b0107ae0 con 0x7ff1b00ff050 2024-04-13T10:55:27.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.009+0000 7ff19f7fe700 1 -- 172.21.15.134:0/2122955665 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ff1a40229c0 con 0x7ff1b00ff050 2024-04-13T10:55:27.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.010+0000 7ff19f7fe700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff19806c680 0x7ff19806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:27.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.010+0000 7ff19f7fe700 1 -- 172.21.15.134:0/2122955665 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff1a408cc40 con 0x7ff1b00ff050 2024-04-13T10:55:27.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.010+0000 7ff1add9b700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff19806c680 0x7ff19806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:27.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.010+0000 7ff1add9b700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff19806c680 0x7ff19806eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0006fd0 tx=0x7ff1a0008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:27.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.014+0000 7ff19f7fe700 1 -- 172.21.15.134:0/2122955665 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff1a405b1a0 con 0x7ff1b00ff050 2024-04-13T10:55:27.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.210+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2122955665 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1b0068ae0 con 0x7ff19806c680 2024-04-13T10:55:27.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.219+0000 7ff19f7fe700 1 -- 172.21.15.134:0/2122955665 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2860 (secure 0 0 0) 0x7ff1b0068ae0 con 0x7ff19806c680 2024-04-13T10:55:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T10:55:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (4m) 2m ago 5m 24.8M - 0.25.0 c8568f914cd2 8d2cf34cad2a 2024-04-13T10:55:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (6m) 2m ago 5m 6991k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T10:55:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (4m) 71s ago 4m 6929k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T10:55:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (5m) 2m ago 5m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T10:55:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (4m) 71s ago 4m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T10:55:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (3m) 2m ago 5m 80.0M - 9.4.7 954c08fa6188 1038718f4fd4 2024-04-13T10:55:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:9283,8765,8443 running (7m) 2m ago 7m 478M - 18.2.0 dc2bc1663786 3b88cc824ec3 2024-04-13T10:55:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (4m) 71s ago 4m 436M - 18.2.0 dc2bc1663786 810301983f71 2024-04-13T10:55:27.220 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (7m) 2m ago 7m 44.6M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T10:55:27.221 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (4m) 71s ago 4m 40.6M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T10:55:27.221 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 2m ago 5m 16.0M - 1.5.0 0da6a335fe13 da23f14cbdef 2024-04-13T10:55:27.221 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (4m) 71s ago 4m 17.7M - 1.5.0 0da6a335fe13 242da19a461b 2024-04-13T10:55:27.221 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (3m) 2m ago 3m 41.3M 3958M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T10:55:27.221 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (3m) 2m ago 3m 39.1M 3958M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T10:55:27.221 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (2m) 2m ago 2m 40.0M 3958M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T10:55:27.221 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (2m) 71s ago 2m 41.0M 4982M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T10:55:27.221 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (106s) 71s ago 106s 38.9M 4982M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T10:55:27.221 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (78s) 71s ago 77s 13.8M 4982M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T10:55:27.221 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 2m ago 5m 39.2M - 2.43.0 a07b618ecd1d a5240fafbf97 2024-04-13T10:55:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2122955665 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff19806c680 msgr2=0x7ff19806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff19806c680 0x7ff19806eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0006fd0 tx=0x7ff1a0008040 comp rx=0 tx=0).stop 2024-04-13T10:55:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2122955665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b00ff050 msgr2=0x7ff1b0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b00ff050 0x7ff1b0102fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400bda0 tx=0x7ff1a400be80 comp rx=0 tx=0).stop 2024-04-13T10:55:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2122955665 shutdown_connections 2024-04-13T10:55:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff19806c680 0x7ff19806eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1b00ff050 0x7ff1b0102fe0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 --2- 172.21.15.134:0/2122955665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1b0100250 0x7ff1b0101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2122955665 >> 172.21.15.134:0/2122955665 conn(0x7ff1b00fa5e0 msgr2=0x7ff1b00683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2122955665 shutdown_connections 2024-04-13T10:55:27.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:27.221+0000 7ff1b4eb5700 1 -- 172.21.15.134:0/2122955665 wait complete. 2024-04-13T10:55:27.904 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:27 smithi134 ceph-mon[39696]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:27.926 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-13T10:55:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:27 smithi194 ceph-mon[46737]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:28.155 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:28.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:28 smithi134 ceph-mon[39696]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:28.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:55:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:28 smithi194 ceph-mon[46737]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:28 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:55:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:29 smithi134 ceph-mon[39696]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:29.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:29 smithi194 ceph-mon[46737]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:30.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.008+0000 7f026374f700 1 -- 172.21.15.134:0/2143484923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c100250 msgr2=0x7f025c1006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:30.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.008+0000 7f026374f700 1 --2- 172.21.15.134:0/2143484923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c100250 0x7f025c1006a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f024c009910 tx=0x7f024c009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:30.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.008+0000 7f026374f700 1 -- 172.21.15.134:0/2143484923 shutdown_connections 2024-04-13T10:55:30.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.008+0000 7f026374f700 1 --2- 172.21.15.134:0/2143484923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c100250 0x7f025c1006a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:30.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.008+0000 7f026374f700 1 --2- 172.21.15.134:0/2143484923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f025c0ff050 0x7f025c0ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.008+0000 7f026374f700 1 -- 172.21.15.134:0/2143484923 >> 172.21.15.134:0/2143484923 conn(0x7f025c0fa5e0 msgr2=0x7f025c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.008+0000 7f026374f700 1 -- 172.21.15.134:0/2143484923 shutdown_connections 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.008+0000 7f026374f700 1 -- 172.21.15.134:0/2143484923 wait complete. 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f026374f700 1 Processor -- start 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f026374f700 1 -- start start 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f026374f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0ff050 0x7f025c1947a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f026374f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f025c100250 0x7f025c194ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f026374f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c195270 con 0x7f025c0ff050 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f026374f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c1953b0 con 0x7f025c100250 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f02614eb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0ff050 0x7f025c1947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f02614eb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0ff050 0x7f025c1947a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34218/0 (socket says 172.21.15.134:34218) 2024-04-13T10:55:30.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f02614eb700 1 -- 172.21.15.134:0/708624634 learned_addr learned my addr 172.21.15.134:0/708624634 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:30.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f0260cea700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f025c100250 0x7f025c194ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:30.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f02614eb700 1 -- 172.21.15.134:0/708624634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f025c100250 msgr2=0x7f025c194ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:30.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f02614eb700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f025c100250 0x7f025c194ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:30.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f02614eb700 1 -- 172.21.15.134:0/708624634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0095f0 con 0x7f025c0ff050 2024-04-13T10:55:30.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f02614eb700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0ff050 0x7f025c1947a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f025800c910 tx=0x7f025800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:30.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f02527fc700 1 -- 172.21.15.134:0/708624634 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02580041f0 con 0x7f025c0ff050 2024-04-13T10:55:30.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f026374f700 1 -- 172.21.15.134:0/708624634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c199e70 con 0x7f025c0ff050 2024-04-13T10:55:30.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f02527fc700 1 -- 172.21.15.134:0/708624634 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f0258007d90 con 0x7f025c0ff050 2024-04-13T10:55:30.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f02527fc700 1 -- 172.21.15.134:0/708624634 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0258003cf0 con 0x7f025c0ff050 2024-04-13T10:55:30.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.009+0000 7f026374f700 1 -- 172.21.15.134:0/708624634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c19a3b0 con 0x7f025c0ff050 2024-04-13T10:55:30.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.010+0000 7f026374f700 1 -- 172.21.15.134:0/708624634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c107a60 con 0x7f025c0ff050 2024-04-13T10:55:30.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.011+0000 7f02527fc700 1 -- 172.21.15.134:0/708624634 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f0258007900 con 0x7f025c0ff050 2024-04-13T10:55:30.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.011+0000 7f02527fc700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f024806c680 0x7f024806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:30.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.011+0000 7f02527fc700 1 -- 172.21.15.134:0/708624634 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f025808b250 con 0x7f025c0ff050 2024-04-13T10:55:30.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.011+0000 7f0260cea700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f024806c680 0x7f024806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:30.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.012+0000 7f0260cea700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f024806c680 0x7f024806eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f024c00b5c0 tx=0x7f024c005960 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:30.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.016+0000 7f02527fc700 1 -- 172.21.15.134:0/708624634 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0258059700 con 0x7f025c0ff050 2024-04-13T10:55:30.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.212+0000 7f026374f700 1 -- 172.21.15.134:0/708624634 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f025c104ba0 con 0x7f024806c680 2024-04-13T10:55:30.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.217+0000 7f02527fc700 1 -- 172.21.15.134:0/708624634 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1310 (secure 0 0 0) 0x7f025c104ba0 con 0x7f024806c680 2024-04-13T10:55:30.216 INFO:teuthology.orchestra.run.smithi134.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-13T10:55:30.216 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-04-13T10:55:30.216 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter 2/2 2m ago 6m * 2024-04-13T10:55:30.216 INFO:teuthology.orchestra.run.smithi134.stdout:crash 2/2 2m ago 6m * 2024-04-13T10:55:30.216 INFO:teuthology.orchestra.run.smithi134.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-04-13T10:55:30.217 INFO:teuthology.orchestra.run.smithi134.stdout:mgr 2/2 2m ago 6m count:2 2024-04-13T10:55:30.217 INFO:teuthology.orchestra.run.smithi134.stdout:mon 2/2 2m ago 5m smithi134:172.21.15.134=smithi134;smithi194:172.21.15.194=smithi194;count:2 2024-04-13T10:55:30.217 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-04-13T10:55:30.217 INFO:teuthology.orchestra.run.smithi134.stdout:osd 6 2m ago - 2024-04-13T10:55:30.217 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-04-13T10:55:30.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 -- 172.21.15.134:0/708624634 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f024806c680 msgr2=0x7f024806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:30.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f024806c680 0x7f024806eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f024c00b5c0 tx=0x7f024c005960 comp rx=0 tx=0).stop 2024-04-13T10:55:30.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 -- 172.21.15.134:0/708624634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0ff050 msgr2=0x7f025c1947a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:30.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0ff050 0x7f025c1947a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f025800c910 tx=0x7f025800ccd0 comp rx=0 tx=0).stop 2024-04-13T10:55:30.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 -- 172.21.15.134:0/708624634 shutdown_connections 2024-04-13T10:55:30.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f024806c680 0x7f024806eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:30.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0ff050 0x7f025c1947a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:30.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 --2- 172.21.15.134:0/708624634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f025c100250 0x7f025c194ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:30.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 -- 172.21.15.134:0/708624634 >> 172.21.15.134:0/708624634 conn(0x7f025c0fa5e0 msgr2=0x7f025c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:30.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 -- 172.21.15.134:0/708624634 shutdown_connections 2024-04-13T10:55:30.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:30.219+0000 7f026374f700 1 -- 172.21.15.134:0/708624634 wait complete. 2024-04-13T10:55:30.988 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-13T10:55:31.213 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:31.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:31 smithi134 ceph-mon[39696]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:31.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:31 smithi134 ceph-mon[39696]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:31 smithi194 ceph-mon[46737]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:31 smithi194 ceph-mon[46737]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:32.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.988+0000 7f79a15ae700 1 -- 172.21.15.134:0/2895705374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c0fe480 msgr2=0x7f799c0fe890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:32.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.988+0000 7f79a15ae700 1 --2- 172.21.15.134:0/2895705374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c0fe480 0x7f799c0fe890 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7990009910 tx=0x7f7990009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:32.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.988+0000 7f79a15ae700 1 -- 172.21.15.134:0/2895705374 shutdown_connections 2024-04-13T10:55:32.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.988+0000 7f79a15ae700 1 --2- 172.21.15.134:0/2895705374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c101460 0x7f799c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:32.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.988+0000 7f79a15ae700 1 --2- 172.21.15.134:0/2895705374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c0fe480 0x7f799c0fe890 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:32.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.988+0000 7f79a15ae700 1 -- 172.21.15.134:0/2895705374 >> 172.21.15.134:0/2895705374 conn(0x7f799c0f9dd0 msgr2=0x7f799c0fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:32.990 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.988+0000 7f79a15ae700 1 -- 172.21.15.134:0/2895705374 shutdown_connections 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.989+0000 7f79a15ae700 1 -- 172.21.15.134:0/2895705374 wait complete. 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.989+0000 7f79a15ae700 1 Processor -- start 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.989+0000 7f79a15ae700 1 -- start start 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.989+0000 7f79a15ae700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c0fe480 0x7f799c100dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.989+0000 7f79a15ae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c101460 0x7f799c0ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.989+0000 7f79a15ae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0ff950 con 0x7f799c101460 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.989+0000 7f79a15ae700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0ffa90 con 0x7f799c0fe480 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.989+0000 7f799a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c101460 0x7f799c0ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f799a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c101460 0x7f799c0ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34238/0 (socket says 172.21.15.134:34238) 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f799a7fc700 1 -- 172.21.15.134:0/1126751775 learned_addr learned my addr 172.21.15.134:0/1126751775 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f799affd700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c0fe480 0x7f799c100dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f799a7fc700 1 -- 172.21.15.134:0/1126751775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c0fe480 msgr2=0x7f799c100dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f799a7fc700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c0fe480 0x7f799c100dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:32.991 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f799a7fc700 1 -- 172.21.15.134:0/1126751775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79900095f0 con 0x7f799c101460 2024-04-13T10:55:32.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f799affd700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c0fe480 0x7f799c100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T10:55:32.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f799a7fc700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c101460 0x7f799c0ff410 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b4b0 tx=0x7f798c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:32.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f7983fff700 1 -- 172.21.15.134:0/1126751775 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798c011800 con 0x7f799c101460 2024-04-13T10:55:32.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f7983fff700 1 -- 172.21.15.134:0/1126751775 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f798c011df0 con 0x7f799c101460 2024-04-13T10:55:32.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f79a15ae700 1 -- 172.21.15.134:0/1126751775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c0ffd70 con 0x7f799c101460 2024-04-13T10:55:32.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f7983fff700 1 -- 172.21.15.134:0/1126751775 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798c010e40 con 0x7f799c101460 2024-04-13T10:55:32.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.990+0000 7f79a15ae700 1 -- 172.21.15.134:0/1126751775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c19dad0 con 0x7f799c101460 2024-04-13T10:55:32.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.991+0000 7f79a15ae700 1 -- 172.21.15.134:0/1126751775 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c108c40 con 0x7f799c101460 2024-04-13T10:55:32.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.992+0000 7f7983fff700 1 -- 172.21.15.134:0/1126751775 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f798c010380 con 0x7f799c101460 2024-04-13T10:55:32.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.992+0000 7f7983fff700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f798406c630 0x7f798406eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:32.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.992+0000 7f799affd700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f798406c630 0x7f798406eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:32.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.992+0000 7f7983fff700 1 -- 172.21.15.134:0/1126751775 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f798c08b120 con 0x7f799c101460 2024-04-13T10:55:32.993 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.992+0000 7f799affd700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f798406c630 0x7f798406eae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f799000b5c0 tx=0x7f7990005e20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:32.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:32.996+0000 7f7983fff700 1 -- 172.21.15.134:0/1126751775 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f798c0595d0 con 0x7f799c101460 2024-04-13T10:55:33.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.191+0000 7f79a15ae700 1 -- 172.21.15.134:0/1126751775 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f799c105db0 con 0x7f798406c630 2024-04-13T10:55:33.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.192+0000 7f7983fff700 1 -- 172.21.15.134:0/1126751775 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f799c105db0 con 0x7f798406c630 2024-04-13T10:55:33.192 INFO:teuthology.orchestra.run.smithi134.stdout:HOST ADDR LABELS STATUS 2024-04-13T10:55:33.192 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134 172.21.15.134 2024-04-13T10:55:33.192 INFO:teuthology.orchestra.run.smithi134.stdout:smithi194 172.21.15.194 2024-04-13T10:55:33.192 INFO:teuthology.orchestra.run.smithi134.stdout:2 hosts in cluster 2024-04-13T10:55:33.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 -- 172.21.15.134:0/1126751775 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f798406c630 msgr2=0x7f798406eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:33.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f798406c630 0x7f798406eae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f799000b5c0 tx=0x7f7990005e20 comp rx=0 tx=0).stop 2024-04-13T10:55:33.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 -- 172.21.15.134:0/1126751775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c101460 msgr2=0x7f799c0ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:33.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c101460 0x7f799c0ff410 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b4b0 tx=0x7f798c00b870 comp rx=0 tx=0).stop 2024-04-13T10:55:33.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 -- 172.21.15.134:0/1126751775 shutdown_connections 2024-04-13T10:55:33.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f798406c630 0x7f798406eae0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:33.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c0fe480 0x7f799c100dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:33.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 --2- 172.21.15.134:0/1126751775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c101460 0x7f799c0ff410 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:33.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 -- 172.21.15.134:0/1126751775 >> 172.21.15.134:0/1126751775 conn(0x7f799c0f9dd0 msgr2=0x7f799c104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:33.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 -- 172.21.15.134:0/1126751775 shutdown_connections 2024-04-13T10:55:33.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:33.194+0000 7f79a15ae700 1 -- 172.21.15.134:0/1126751775 wait complete. 2024-04-13T10:55:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:33 smithi134 ceph-mon[39696]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:33.975 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-13T10:55:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:33 smithi194 ceph-mon[46737]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:34.202 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:34.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:34 smithi134 ceph-mon[39696]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:34.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:34 smithi194 ceph-mon[46737]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:35.720 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:35 smithi134 ceph-mon[39696]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:35.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.951+0000 7f9749d0b700 1 -- 172.21.15.134:0/303522402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97440ff320 msgr2=0x7f97440ff770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.951+0000 7f9749d0b700 1 --2- 172.21.15.134:0/303522402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97440ff320 0x7f97440ff770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9734009910 tx=0x7f9734009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.951+0000 7f9749d0b700 1 -- 172.21.15.134:0/303522402 shutdown_connections 2024-04-13T10:55:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.951+0000 7f9749d0b700 1 --2- 172.21.15.134:0/303522402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97440ff320 0x7f97440ff770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.951+0000 7f9749d0b700 1 --2- 172.21.15.134:0/303522402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97441005e0 0x7f97441009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.951+0000 7f9749d0b700 1 -- 172.21.15.134:0/303522402 >> 172.21.15.134:0/303522402 conn(0x7f97440f9d80 msgr2=0x7f97440fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.951+0000 7f9749d0b700 1 -- 172.21.15.134:0/303522402 shutdown_connections 2024-04-13T10:55:35.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.951+0000 7f9749d0b700 1 -- 172.21.15.134:0/303522402 wait complete. 2024-04-13T10:55:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.951+0000 7f9749d0b700 1 Processor -- start 2024-04-13T10:55:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f9749d0b700 1 -- start start 2024-04-13T10:55:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f9749d0b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97440ff320 0x7f97440fed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f9749d0b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97441005e0 0x7f974419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f9749d0b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974419ab30 con 0x7f97440ff320 2024-04-13T10:55:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f9749d0b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974419ac70 con 0x7f97441005e0 2024-04-13T10:55:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f97437fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97440ff320 0x7f97440fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:35.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f97437fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97440ff320 0x7f97440fed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34242/0 (socket says 172.21.15.134:34242) 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f97437fe700 1 -- 172.21.15.134:0/3202300636 learned_addr learned my addr 172.21.15.134:0/3202300636 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f9742ffd700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97441005e0 0x7f974419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f97437fe700 1 -- 172.21.15.134:0/3202300636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97441005e0 msgr2=0x7f974419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f97437fe700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97441005e0 0x7f974419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f97437fe700 1 -- 172.21.15.134:0/3202300636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97340095f0 con 0x7f97440ff320 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f97437fe700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97440ff320 0x7f97440fed70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f973800c910 tx=0x7f973800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f9740ff9700 1 -- 172.21.15.134:0/3202300636 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97380041f0 con 0x7f97440ff320 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f9740ff9700 1 -- 172.21.15.134:0/3202300636 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f973800ce60 con 0x7f97440ff320 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f9740ff9700 1 -- 172.21.15.134:0/3202300636 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9738003c90 con 0x7f97440ff320 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.952+0000 7f9749d0b700 1 -- 172.21.15.134:0/3202300636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974419af50 con 0x7f97440ff320 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.953+0000 7f9749d0b700 1 -- 172.21.15.134:0/3202300636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974419b4f0 con 0x7f97440ff320 2024-04-13T10:55:35.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.953+0000 7f9749d0b700 1 -- 172.21.15.134:0/3202300636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9744107a50 con 0x7f97440ff320 2024-04-13T10:55:35.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.954+0000 7f9740ff9700 1 -- 172.21.15.134:0/3202300636 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f9738007900 con 0x7f97440ff320 2024-04-13T10:55:35.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.954+0000 7f9740ff9700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f972c06c680 0x7f972c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:35.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.954+0000 7f9742ffd700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f972c06c680 0x7f972c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:35.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.954+0000 7f9740ff9700 1 -- 172.21.15.134:0/3202300636 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f973808b0a0 con 0x7f97440ff320 2024-04-13T10:55:35.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.955+0000 7f9742ffd700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f972c06c680 0x7f972c06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f97440ff2f0 tx=0x7f973400b560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:35.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:35.959+0000 7f9740ff9700 1 -- 172.21.15.134:0/3202300636 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f97380595d0 con 0x7f97440ff320 2024-04-13T10:55:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:35 smithi194 ceph-mon[46737]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:36.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.154+0000 7f9749d0b700 1 -- 172.21.15.134:0/3202300636 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9744104c80 con 0x7f972c06c680 2024-04-13T10:55:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.155+0000 7f9740ff9700 1 -- 172.21.15.134:0/3202300636 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f9744104c80 con 0x7f972c06c680 2024-04-13T10:55:36.155 INFO:teuthology.orchestra.run.smithi134.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-13T10:55:36.155 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 2m ago LVM detected, locked 2024-04-13T10:55:36.155 INFO:teuthology.orchestra.run.smithi134.stdout:smithi194 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6240002A400BGN 372G No 77s ago LVM detected, locked 2024-04-13T10:55:36.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 -- 172.21.15.134:0/3202300636 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f972c06c680 msgr2=0x7f972c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:36.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f972c06c680 0x7f972c06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f97440ff2f0 tx=0x7f973400b560 comp rx=0 tx=0).stop 2024-04-13T10:55:36.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 -- 172.21.15.134:0/3202300636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97440ff320 msgr2=0x7f97440fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97440ff320 0x7f97440fed70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f973800c910 tx=0x7f973800cc20 comp rx=0 tx=0).stop 2024-04-13T10:55:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 -- 172.21.15.134:0/3202300636 shutdown_connections 2024-04-13T10:55:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f972c06c680 0x7f972c06eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97440ff320 0x7f97440fed70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 --2- 172.21.15.134:0/3202300636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97441005e0 0x7f974419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 -- 172.21.15.134:0/3202300636 >> 172.21.15.134:0/3202300636 conn(0x7f97440f9d80 msgr2=0x7f9744103560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 -- 172.21.15.134:0/3202300636 shutdown_connections 2024-04-13T10:55:36.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:36.158+0000 7f9749d0b700 1 -- 172.21.15.134:0/3202300636 wait complete. 2024-04-13T10:55:36.864 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-13T10:55:36.874 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T10:55:36.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-13T10:55:37.102 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:37.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:37 smithi134 ceph-mon[39696]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:37.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:37 smithi134 ceph-mon[39696]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:37 smithi194 ceph-mon[46737]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:37 smithi194 ceph-mon[46737]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:38.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.933+0000 7fe7c4f05700 1 -- 172.21.15.134:0/2698838308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0100250 msgr2=0x7fe7c01006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:38.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.933+0000 7fe7c4f05700 1 --2- 172.21.15.134:0/2698838308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0100250 0x7fe7c01006a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009910 tx=0x7fe7b4009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:38.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.933+0000 7fe7c4f05700 1 -- 172.21.15.134:0/2698838308 shutdown_connections 2024-04-13T10:55:38.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.933+0000 7fe7c4f05700 1 --2- 172.21.15.134:0/2698838308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0100250 0x7fe7c01006a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:38.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.933+0000 7fe7c4f05700 1 --2- 172.21.15.134:0/2698838308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c00ff050 0x7fe7c00ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:38.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.933+0000 7fe7c4f05700 1 -- 172.21.15.134:0/2698838308 >> 172.21.15.134:0/2698838308 conn(0x7fe7c00fa5e0 msgr2=0x7fe7c00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:38.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.933+0000 7fe7c4f05700 1 -- 172.21.15.134:0/2698838308 shutdown_connections 2024-04-13T10:55:38.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.933+0000 7fe7c4f05700 1 -- 172.21.15.134:0/2698838308 wait complete. 2024-04-13T10:55:38.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.934+0000 7fe7c4f05700 1 Processor -- start 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.934+0000 7fe7c4f05700 1 -- start start 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.934+0000 7fe7c4f05700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c00ff050 0x7fe7c01959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.934+0000 7fe7c4f05700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0100250 0x7fe7c0195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.934+0000 7fe7c4f05700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0196500 con 0x7fe7c0100250 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.934+0000 7fe7c4f05700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0196640 con 0x7fe7c00ff050 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.934+0000 7fe7bdd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0100250 0x7fe7c0195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.934+0000 7fe7bdd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0100250 0x7fe7c0195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34254/0 (socket says 172.21.15.134:34254) 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.934+0000 7fe7bdd9b700 1 -- 172.21.15.134:0/4250731431 learned_addr learned my addr 172.21.15.134:0/4250731431 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7bdd9b700 1 -- 172.21.15.134:0/4250731431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c00ff050 msgr2=0x7fe7c01959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7be59c700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c00ff050 0x7fe7c01959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:38.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7bdd9b700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c00ff050 0x7fe7c01959a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:38.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7bdd9b700 1 -- 172.21.15.134:0/4250731431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40095f0 con 0x7fe7c0100250 2024-04-13T10:55:38.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7be59c700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c00ff050 0x7fe7c01959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T10:55:38.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7bdd9b700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0100250 0x7fe7c0195ee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4006010 tx=0x7fe7b400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:38.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7af7fe700 1 -- 172.21.15.134:0/4250731431 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7b401d070 con 0x7fe7c0100250 2024-04-13T10:55:38.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7af7fe700 1 -- 172.21.15.134:0/4250731431 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fe7b4022470 con 0x7fe7c0100250 2024-04-13T10:55:38.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7c4f05700 1 -- 172.21.15.134:0/4250731431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c019b090 con 0x7fe7c0100250 2024-04-13T10:55:38.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7af7fe700 1 -- 172.21.15.134:0/4250731431 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7b400f690 con 0x7fe7c0100250 2024-04-13T10:55:38.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.935+0000 7fe7c4f05700 1 -- 172.21.15.134:0/4250731431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c019b600 con 0x7fe7c0100250 2024-04-13T10:55:38.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.936+0000 7fe7c4f05700 1 -- 172.21.15.134:0/4250731431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c0107b00 con 0x7fe7c0100250 2024-04-13T10:55:38.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.936+0000 7fe7af7fe700 1 -- 172.21.15.134:0/4250731431 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fe7b4022980 con 0x7fe7c0100250 2024-04-13T10:55:38.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.937+0000 7fe7af7fe700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe7a806c680 0x7fe7a806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:38.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.937+0000 7fe7af7fe700 1 -- 172.21.15.134:0/4250731431 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe7b408cc30 con 0x7fe7c0100250 2024-04-13T10:55:38.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.937+0000 7fe7be59c700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe7a806c680 0x7fe7a806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:38.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.937+0000 7fe7be59c700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe7a806c680 0x7fe7a806eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7c01000b0 tx=0x7fe7b0008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:38.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:38.941+0000 7fe7af7fe700 1 -- 172.21.15.134:0/4250731431 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe7b405b0e0 con 0x7fe7c0100250 2024-04-13T10:55:39.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:39.156+0000 7fe7c4f05700 1 -- 172.21.15.134:0/4250731431 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7c0068ae0 con 0x7fe7a806c680 2024-04-13T10:55:40.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:39 smithi134 ceph-mon[39696]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:40.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:39 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-13T10:55:40.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:39 smithi194 ceph-mon[46737]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:40.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:39 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-13T10:55:40.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.696+0000 7fe7af7fe700 1 -- 172.21.15.134:0/4250731431 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe7c0068ae0 con 0x7fe7a806c680 2024-04-13T10:55:40.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 -- 172.21.15.134:0/4250731431 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe7a806c680 msgr2=0x7fe7a806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe7a806c680 0x7fe7a806eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7c01000b0 tx=0x7fe7b0008040 comp rx=0 tx=0).stop 2024-04-13T10:55:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 -- 172.21.15.134:0/4250731431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0100250 msgr2=0x7fe7c0195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0100250 0x7fe7c0195ee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4006010 tx=0x7fe7b400be20 comp rx=0 tx=0).stop 2024-04-13T10:55:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 -- 172.21.15.134:0/4250731431 shutdown_connections 2024-04-13T10:55:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe7a806c680 0x7fe7a806eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c00ff050 0x7fe7c01959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 --2- 172.21.15.134:0/4250731431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7c0100250 0x7fe7c0195ee0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 -- 172.21.15.134:0/4250731431 >> 172.21.15.134:0/4250731431 conn(0x7fe7c00fa5e0 msgr2=0x7fe7c00683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 -- 172.21.15.134:0/4250731431 shutdown_connections 2024-04-13T10:55:40.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:40.699+0000 7fe7c4f05700 1 -- 172.21.15.134:0/4250731431 wait complete. 2024-04-13T10:55:40.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134[39673]: 2024-04-13T10:55:40.673+0000 7f3ca6aa7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T10:55:40.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:40.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-13T10:55:40.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: osdmap e41: 6 total, 6 up, 6 in 2024-04-13T10:55:40.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-13T10:55:40.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: pgmap v185: 33 pgs: 7 creating+peering, 1 active+clean, 25 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: osdmap e42: 6 total, 6 up, 6 in 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: osdmap e43: 6 total, 6 up, 6 in 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: fsmap cephfs:0 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: Saving service mds.cephfs spec with placement count:4 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:40.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.hxpcfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T10:55:40.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.hxpcfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-13T10:55:40.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:40.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:40 smithi134 ceph-mon[39696]: Deploying daemon mds.cephfs.smithi134.hxpcfx on smithi134 2024-04-13T10:55:41.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:55:41.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-13T10:55:41.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: osdmap e41: 6 total, 6 up, 6 in 2024-04-13T10:55:41.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-13T10:55:41.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: pgmap v185: 33 pgs: 7 creating+peering, 1 active+clean, 25 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:41.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-13T10:55:41.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: osdmap e42: 6 total, 6 up, 6 in 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: osdmap e43: 6 total, 6 up, 6 in 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: fsmap cephfs:0 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: Saving service mds.cephfs spec with placement count:4 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.hxpcfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T10:55:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.hxpcfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-13T10:55:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:40 smithi194 ceph-mon[46737]: Deploying daemon mds.cephfs.smithi134.hxpcfx on smithi134 2024-04-13T10:55:41.949 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-13T10:55:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:42 smithi194 ceph-mon[46737]: osdmap e44: 6 total, 6 up, 6 in 2024-04-13T10:55:43.116 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:42 smithi134 ceph-mon[39696]: osdmap e44: 6 total, 6 up, 6 in 2024-04-13T10:55:43.205 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:43.986 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:43 smithi134 ceph-mon[39696]: pgmap v189: 65 pgs: 13 creating+peering, 17 active+clean, 35 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:43.987 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:43 smithi134 ceph-mon[39696]: osdmap e45: 6 total, 6 up, 6 in 2024-04-13T10:55:43.987 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:43.987 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:55:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:43 smithi194 ceph-mon[46737]: pgmap v189: 65 pgs: 13 creating+peering, 17 active+clean, 35 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:43 smithi194 ceph-mon[46737]: osdmap e45: 6 total, 6 up, 6 in 2024-04-13T10:55:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:55:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.465+0000 7f91db06f700 1 -- 172.21.15.134:0/3912683086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91d4100250 msgr2=0x7f91d41006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.465+0000 7f91db06f700 1 --2- 172.21.15.134:0/3912683086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91d4100250 0x7f91d41006a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009910 tx=0x7f91c0009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.465+0000 7f91db06f700 1 -- 172.21.15.134:0/3912683086 shutdown_connections 2024-04-13T10:55:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.465+0000 7f91db06f700 1 --2- 172.21.15.134:0/3912683086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91d4100250 0x7f91d41006a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.465+0000 7f91db06f700 1 --2- 172.21.15.134:0/3912683086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91d40ff050 0x7f91d40ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.465+0000 7f91db06f700 1 -- 172.21.15.134:0/3912683086 >> 172.21.15.134:0/3912683086 conn(0x7f91d40fa5e0 msgr2=0x7f91d40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.465+0000 7f91db06f700 1 -- 172.21.15.134:0/3912683086 shutdown_connections 2024-04-13T10:55:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91db06f700 1 -- 172.21.15.134:0/3912683086 wait complete. 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91db06f700 1 Processor -- start 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91db06f700 1 -- start start 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91db06f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91d40ff050 0x7f91d4102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91db06f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91d4100250 0x7f91d4101630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91db06f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4101b70 con 0x7f91d4100250 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91db06f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4101cb0 con 0x7f91d40ff050 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91d3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91d4100250 0x7f91d4101630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91d3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91d4100250 0x7f91d4101630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60332/0 (socket says 172.21.15.134:60332) 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91d3fff700 1 -- 172.21.15.134:0/3242715488 learned_addr learned my addr 172.21.15.134:0/3242715488 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.466+0000 7f91d8e0b700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91d40ff050 0x7f91d4102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.467+0000 7f91d3fff700 1 -- 172.21.15.134:0/3242715488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91d40ff050 msgr2=0x7f91d4102fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.467+0000 7f91d3fff700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91d40ff050 0x7f91d4102fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.467+0000 7f91d3fff700 1 -- 172.21.15.134:0/3242715488 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00095f0 con 0x7f91d4100250 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.467+0000 7f91d3fff700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91d4100250 0x7f91d4101630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f91c0006010 tx=0x7f91c000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.467+0000 7f91d1ffb700 1 -- 172.21.15.134:0/3242715488 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c001d070 con 0x7f91d4100250 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.467+0000 7f91d1ffb700 1 -- 172.21.15.134:0/3242715488 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f91c000f460 con 0x7f91d4100250 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.467+0000 7f91db06f700 1 -- 172.21.15.134:0/3242715488 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d4101f30 con 0x7f91d4100250 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.467+0000 7f91d1ffb700 1 -- 172.21.15.134:0/3242715488 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c0021640 con 0x7f91d4100250 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.467+0000 7f91db06f700 1 -- 172.21.15.134:0/3242715488 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d4102420 con 0x7f91d4100250 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.468+0000 7f91db06f700 1 -- 172.21.15.134:0/3242715488 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d4107a60 con 0x7f91d4100250 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.468+0000 7f91d1ffb700 1 -- 172.21.15.134:0/3242715488 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f91c000f9b0 con 0x7f91d4100250 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.469+0000 7f91d1ffb700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91c406c680 0x7f91c406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.469+0000 7f91d1ffb700 1 -- 172.21.15.134:0/3242715488 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f91c008cad0 con 0x7f91d4100250 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.469+0000 7f91d8e0b700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91c406c680 0x7f91c406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:45.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.469+0000 7f91d8e0b700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91c406c680 0x7f91c406eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f91d41000b0 tx=0x7f91c800b410 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:45.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.473+0000 7f91d1ffb700 1 -- 172.21.15.134:0/3242715488 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f91c005ac40 con 0x7f91d4100250 2024-04-13T10:55:45.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.709+0000 7f91db06f700 1 -- 172.21.15.134:0/3242715488 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f91d419dd30 con 0x7f91d4100250 2024-04-13T10:55:45.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.710+0000 7f91d1ffb700 1 -- 172.21.15.134:0/3242715488 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 5 v5) v1 ==== 75+0+1264 (secure 0 0 0) 0x7f91c005a7d0 con 0x7f91d4100250 2024-04-13T10:55:45.710 INFO:teuthology.orchestra.run.smithi134.stdout:e5 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 5 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T10:55:45.696549+0000 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T10:55:45.711 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 0 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14476} 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T10:55:45.712 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T10:55:45.713 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-04-13T10:55:45.713 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T10:55:45.713 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T10:55:45.713 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 0 2024-04-13T10:55:45.713 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:14476} state up:active seq 2 addr [v2:172.21.15.134:6826/3726339659,v1:172.21.15.134:6827/3726339659] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T10:55:45.713 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:55:45.713 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:55:45.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 -- 172.21.15.134:0/3242715488 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91c406c680 msgr2=0x7f91c406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91c406c680 0x7f91c406eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f91d41000b0 tx=0x7f91c800b410 comp rx=0 tx=0).stop 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 -- 172.21.15.134:0/3242715488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91d4100250 msgr2=0x7f91d4101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91d4100250 0x7f91d4101630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f91c0006010 tx=0x7f91c000bd70 comp rx=0 tx=0).stop 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 -- 172.21.15.134:0/3242715488 shutdown_connections 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f91c406c680 0x7f91c406eb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91d40ff050 0x7f91d4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 --2- 172.21.15.134:0/3242715488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91d4100250 0x7f91d4101630 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 -- 172.21.15.134:0/3242715488 >> 172.21.15.134:0/3242715488 conn(0x7f91d40fa5e0 msgr2=0x7f91d40683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 -- 172.21.15.134:0/3242715488 shutdown_connections 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:45.712+0000 7f91db06f700 1 -- 172.21.15.134:0/3242715488 wait complete. 2024-04-13T10:55:45.714 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 5 2024-04-13T10:55:45.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: pgmap v191: 65 pgs: 13 creating+peering, 32 active+clean, 20 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:45.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:45.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:45.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:45.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.wnddvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T10:55:45.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.wnddvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-13T10:55:45.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:45.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: Deploying daemon mds.cephfs.smithi194.wnddvg on smithi194 2024-04-13T10:55:45.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.134:6826/3726339659,v1:172.21.15.134:6827/3726339659] up:boot 2024-04-13T10:55:45.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: daemon mds.cephfs.smithi134.hxpcfx assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-13T10:55:45.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-13T10:55:45.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-13T10:55:45.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: Cluster is now healthy 2024-04-13T10:55:45.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: fsmap cephfs:0 1 up:standby 2024-04-13T10:55:45.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T10:55:45.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:creating} 2024-04-13T10:55:45.745 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:45 smithi134 ceph-mon[39696]: daemon mds.cephfs.smithi134.hxpcfx is now active in filesystem cephfs as rank 0 2024-04-13T10:55:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: pgmap v191: 65 pgs: 13 creating+peering, 32 active+clean, 20 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:55:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.wnddvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T10:55:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.wnddvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-13T10:55:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: Deploying daemon mds.cephfs.smithi194.wnddvg on smithi194 2024-04-13T10:55:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.134:6826/3726339659,v1:172.21.15.134:6827/3726339659] up:boot 2024-04-13T10:55:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: daemon mds.cephfs.smithi134.hxpcfx assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-13T10:55:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-13T10:55:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-13T10:55:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: Cluster is now healthy 2024-04-13T10:55:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: fsmap cephfs:0 1 up:standby 2024-04-13T10:55:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T10:55:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:creating} 2024-04-13T10:55:45.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:45 smithi194 ceph-mon[46737]: daemon mds.cephfs.smithi134.hxpcfx is now active in filesystem cephfs as rank 0 2024-04-13T10:55:46.397 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-13T10:55:46.406 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T10:55:46.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-13T10:55:46.634 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:46 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.134:6826/3726339659,v1:172.21.15.134:6827/3726339659] up:active 2024-04-13T10:55:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:46 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 2024-04-13T10:55:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:46 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3242715488' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T10:55:47.143 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:46 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.134:6826/3726339659,v1:172.21.15.134:6827/3726339659] up:active 2024-04-13T10:55:47.144 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:46 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 2024-04-13T10:55:47.144 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:46 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3242715488' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T10:55:47.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:47 smithi134 ceph-mon[39696]: pgmap v192: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s wr, 2 op/s 2024-04-13T10:55:47.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:47.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:47.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:47.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.kachce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T10:55:47.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.kachce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-13T10:55:47.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:47 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:47 smithi194 ceph-mon[46737]: pgmap v192: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s wr, 2 op/s 2024-04-13T10:55:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.kachce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T10:55:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.kachce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-13T10:55:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:47 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:48.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:48 smithi134 ceph-mon[39696]: Deploying daemon mds.cephfs.smithi134.kachce on smithi134 2024-04-13T10:55:48.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:48 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] up:boot 2024-04-13T10:55:48.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:48 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby 2024-04-13T10:55:48.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:48 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.wnddvg"}]: dispatch 2024-04-13T10:55:48.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:48 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby 2024-04-13T10:55:49.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:48 smithi194 ceph-mon[46737]: Deploying daemon mds.cephfs.smithi134.kachce on smithi134 2024-04-13T10:55:49.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:48 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] up:boot 2024-04-13T10:55:49.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:48 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby 2024-04-13T10:55:49.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:48 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.wnddvg"}]: dispatch 2024-04-13T10:55:49.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:48 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby 2024-04-13T10:55:49.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.830+0000 7f587d68d700 1 -- 172.21.15.134:0/2018643589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5878101370 msgr2=0x7f58781017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:49.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.830+0000 7f587d68d700 1 --2- 172.21.15.134:0/2018643589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5878101370 0x7f58781017c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5868009910 tx=0x7f5868009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:49.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.830+0000 7f587d68d700 1 -- 172.21.15.134:0/2018643589 shutdown_connections 2024-04-13T10:55:49.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.830+0000 7f587d68d700 1 --2- 172.21.15.134:0/2018643589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5878101370 0x7f58781017c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:49.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.830+0000 7f587d68d700 1 --2- 172.21.15.134:0/2018643589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5878100170 0x7f5878100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:49.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.830+0000 7f587d68d700 1 -- 172.21.15.134:0/2018643589 >> 172.21.15.134:0/2018643589 conn(0x7f58780fb6e0 msgr2=0x7f58780fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:49.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.830+0000 7f587d68d700 1 -- 172.21.15.134:0/2018643589 shutdown_connections 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.830+0000 7f587d68d700 1 -- 172.21.15.134:0/2018643589 wait complete. 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f587d68d700 1 Processor -- start 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f587d68d700 1 -- start start 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f587d68d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5878100170 0x7f5878197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f587d68d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5878101370 0x7f5878197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f587d68d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878198610 con 0x7f5878101370 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f587d68d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878198750 con 0x7f5878100170 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f58767fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5878101370 0x7f5878197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f58767fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5878101370 0x7f5878197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60352/0 (socket says 172.21.15.134:60352) 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f58767fc700 1 -- 172.21.15.134:0/1996410972 learned_addr learned my addr 172.21.15.134:0/1996410972 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f5876ffd700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5878100170 0x7f5878197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f58767fc700 1 -- 172.21.15.134:0/1996410972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5878100170 msgr2=0x7f5878197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f58767fc700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5878100170 0x7f5878197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:49.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f58767fc700 1 -- 172.21.15.134:0/1996410972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680095f0 con 0x7f5878101370 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.831+0000 7f58767fc700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5878101370 0x7f5878197ff0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f586800bde0 tx=0x7f586800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.832+0000 7f586ffff700 1 -- 172.21.15.134:0/1996410972 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f586801d070 con 0x7f5878101370 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.832+0000 7f586ffff700 1 -- 172.21.15.134:0/1996410972 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f5868005dc0 con 0x7f5878101370 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.832+0000 7f587d68d700 1 -- 172.21.15.134:0/1996410972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587819d1a0 con 0x7f5878101370 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.832+0000 7f586ffff700 1 -- 172.21.15.134:0/1996410972 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5868003b10 con 0x7f5878101370 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.832+0000 7f587d68d700 1 -- 172.21.15.134:0/1996410972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587819d6b0 con 0x7f5878101370 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.833+0000 7f587d68d700 1 -- 172.21.15.134:0/1996410972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5878105450 con 0x7f5878101370 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.833+0000 7f586ffff700 1 -- 172.21.15.134:0/1996410972 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f58680048e0 con 0x7f5878101370 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.833+0000 7f586ffff700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f586406c680 0x7f586406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.833+0000 7f586ffff700 1 -- 172.21.15.134:0/1996410972 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f586808cff0 con 0x7f5878101370 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.834+0000 7f5876ffd700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f586406c680 0x7f586406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.834+0000 7f5876ffd700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f586406c680 0x7f586406eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58781011d0 tx=0x7f5860009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:49.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:48.838+0000 7f586ffff700 1 -- 172.21.15.134:0/1996410972 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f586805b160 con 0x7f5878101370 2024-04-13T10:55:49.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.070+0000 7f587d68d700 1 -- 172.21.15.134:0/1996410972 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f587802d0c0 con 0x7f5878101370 2024-04-13T10:55:49.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.726+0000 7f586ffff700 1 -- 172.21.15.134:0/1996410972 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f586805acf0 con 0x7f5878101370 2024-04-13T10:55:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.729+0000 7f587d68d700 1 -- 172.21.15.134:0/1996410972 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f586406c680 msgr2=0x7f586406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.729+0000 7f587d68d700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f586406c680 0x7f586406eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58781011d0 tx=0x7f5860009260 comp rx=0 tx=0).stop 2024-04-13T10:55:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.729+0000 7f587d68d700 1 -- 172.21.15.134:0/1996410972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5878101370 msgr2=0x7f5878197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.729+0000 7f587d68d700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5878101370 0x7f5878197ff0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f586800bde0 tx=0x7f586800bec0 comp rx=0 tx=0).stop 2024-04-13T10:55:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.729+0000 7f587d68d700 1 -- 172.21.15.134:0/1996410972 shutdown_connections 2024-04-13T10:55:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.729+0000 7f587d68d700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f586406c680 0x7f586406eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.729+0000 7f587d68d700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5878100170 0x7f5878197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.729+0000 7f587d68d700 1 --2- 172.21.15.134:0/1996410972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5878101370 0x7f5878197ff0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.729+0000 7f587d68d700 1 -- 172.21.15.134:0/1996410972 >> 172.21.15.134:0/1996410972 conn(0x7f58780fb6e0 msgr2=0x7f5878102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.730+0000 7f587d68d700 1 -- 172.21.15.134:0/1996410972 shutdown_connections 2024-04-13T10:55:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:49.730+0000 7f587d68d700 1 -- 172.21.15.134:0/1996410972 wait complete. 2024-04-13T10:55:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:49 smithi194 ceph-mon[46737]: pgmap v193: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 3 op/s 2024-04-13T10:55:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:49 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/1996410972' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-13T10:55:50.028 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:49 smithi134 ceph-mon[39696]: pgmap v193: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 3 op/s 2024-04-13T10:55:50.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:49 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1996410972' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-13T10:55:50.466 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-13T10:55:50.476 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T10:55:50.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-04-13T10:55:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:50 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/1996410972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-13T10:55:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:50 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby 2024-04-13T10:55:51.040 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:50 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1996410972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-13T10:55:51.041 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:50 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby 2024-04-13T10:55:51.154 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:51.982 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:51 smithi194 ceph-mon[46737]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-04-13T10:55:51.983 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:51 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:51.983 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:51 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:51.983 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:51 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:51.983 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:51 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.svyrny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T10:55:51.983 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:51 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.svyrny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-13T10:55:51.983 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:51 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:52.143 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:51 smithi134 ceph-mon[39696]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-04-13T10:55:52.144 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:52.144 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:52.144 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:52.144 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.svyrny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T10:55:52.144 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.svyrny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-13T10:55:52.144 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:55:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:52 smithi194 ceph-mon[46737]: Deploying daemon mds.cephfs.smithi194.svyrny on smithi194 2024-04-13T10:55:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:52 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] up:boot 2024-04-13T10:55:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:52 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 2 up:standby 2024-04-13T10:55:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.kachce"}]: dispatch 2024-04-13T10:55:53.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.091+0000 7f1fe25d2700 1 -- 172.21.15.134:0/223335184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc103500 msgr2=0x7f1fdc1058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:53.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.091+0000 7f1fe25d2700 1 --2- 172.21.15.134:0/223335184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc103500 0x7f1fdc1058e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009910 tx=0x7f1fcc009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:53.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.091+0000 7f1fe25d2700 1 -- 172.21.15.134:0/223335184 shutdown_connections 2024-04-13T10:55:53.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.091+0000 7f1fe25d2700 1 --2- 172.21.15.134:0/223335184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc103500 0x7f1fdc1058e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:53.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.091+0000 7f1fe25d2700 1 --2- 172.21.15.134:0/223335184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fdc100be0 0x7f1fdc102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:53.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.091+0000 7f1fe25d2700 1 -- 172.21.15.134:0/223335184 >> 172.21.15.134:0/223335184 conn(0x7f1fdc0fa5e0 msgr2=0x7f1fdc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:53.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.091+0000 7f1fe25d2700 1 -- 172.21.15.134:0/223335184 shutdown_connections 2024-04-13T10:55:53.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.091+0000 7f1fe25d2700 1 -- 172.21.15.134:0/223335184 wait complete. 2024-04-13T10:55:53.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fe25d2700 1 Processor -- start 2024-04-13T10:55:53.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fe25d2700 1 -- start start 2024-04-13T10:55:53.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fe25d2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc100be0 0x7f1fdc195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:53.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fe25d2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fdc103500 0x7f1fdc195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:53.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fe25d2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1963c0 con 0x7f1fdc100be0 2024-04-13T10:55:53.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fe25d2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc196500 con 0x7f1fdc103500 2024-04-13T10:55:53.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fdbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc100be0 0x7f1fdc195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:53.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fdbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc100be0 0x7f1fdc195860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50902/0 (socket says 172.21.15.134:50902) 2024-04-13T10:55:53.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fdbfff700 1 -- 172.21.15.134:0/4049682622 learned_addr learned my addr 172.21.15.134:0/4049682622 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:53.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fdb7fe700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fdc103500 0x7f1fdc195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:53.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fdbfff700 1 -- 172.21.15.134:0/4049682622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fdc103500 msgr2=0x7f1fdc195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:53.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fdbfff700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fdc103500 0x7f1fdc195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:53.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fdbfff700 1 -- 172.21.15.134:0/4049682622 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc0095f0 con 0x7f1fdc100be0 2024-04-13T10:55:53.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.092+0000 7f1fdbfff700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc100be0 0x7f1fdc195860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000e920 tx=0x7f1fd000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:53.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.093+0000 7f1fd97fa700 1 -- 172.21.15.134:0/4049682622 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd000c9d0 con 0x7f1fdc100be0 2024-04-13T10:55:53.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.093+0000 7f1fd97fa700 1 -- 172.21.15.134:0/4049682622 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f1fd0010430 con 0x7f1fdc100be0 2024-04-13T10:55:53.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.093+0000 7f1fe25d2700 1 -- 172.21.15.134:0/4049682622 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc19afb0 con 0x7f1fdc100be0 2024-04-13T10:55:53.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.093+0000 7f1fd97fa700 1 -- 172.21.15.134:0/4049682622 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd0018630 con 0x7f1fdc100be0 2024-04-13T10:55:53.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.093+0000 7f1fe25d2700 1 -- 172.21.15.134:0/4049682622 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc19b4f0 con 0x7f1fdc100be0 2024-04-13T10:55:53.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.094+0000 7f1fe25d2700 1 -- 172.21.15.134:0/4049682622 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc18fa30 con 0x7f1fdc100be0 2024-04-13T10:55:53.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.094+0000 7f1fd97fa700 1 -- 172.21.15.134:0/4049682622 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f1fd00105a0 con 0x7f1fdc100be0 2024-04-13T10:55:53.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.094+0000 7f1fd97fa700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc406c680 0x7f1fc406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:53.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.095+0000 7f1fdb7fe700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc406c680 0x7f1fc406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:53.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.095+0000 7f1fd97fa700 1 -- 172.21.15.134:0/4049682622 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f1fd0014070 con 0x7f1fdc100be0 2024-04-13T10:55:53.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.095+0000 7f1fdb7fe700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc406c680 0x7f1fc406eb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009fd0 tx=0x7f1fcc00b5a0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:53.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.099+0000 7f1fd97fa700 1 -- 172.21.15.134:0/4049682622 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1fd0051720 con 0x7f1fdc100be0 2024-04-13T10:55:53.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:52 smithi134 ceph-mon[39696]: Deploying daemon mds.cephfs.smithi194.svyrny on smithi194 2024-04-13T10:55:53.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:52 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] up:boot 2024-04-13T10:55:53.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:52 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 2 up:standby 2024-04-13T10:55:53.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.kachce"}]: dispatch 2024-04-13T10:55:53.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.331+0000 7f1fe25d2700 1 -- 172.21.15.134:0/4049682622 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f1fdc02cc30 con 0x7f1fdc100be0 2024-04-13T10:55:53.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.748+0000 7f1fd97fa700 1 -- 172.21.15.134:0/4049682622 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7f1fd008de60 con 0x7f1fdc100be0 2024-04-13T10:55:53.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 -- 172.21.15.134:0/4049682622 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc406c680 msgr2=0x7f1fc406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:53.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc406c680 0x7f1fc406eb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009fd0 tx=0x7f1fcc00b5a0 comp rx=0 tx=0).stop 2024-04-13T10:55:53.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 -- 172.21.15.134:0/4049682622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc100be0 msgr2=0x7f1fdc195860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:53.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc100be0 0x7f1fdc195860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000e920 tx=0x7f1fd000ec30 comp rx=0 tx=0).stop 2024-04-13T10:55:53.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 -- 172.21.15.134:0/4049682622 shutdown_connections 2024-04-13T10:55:53.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1fc406c680 0x7f1fc406eb30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:53.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fdc100be0 0x7f1fdc195860 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:53.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 --2- 172.21.15.134:0/4049682622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fdc103500 0x7f1fdc195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:53.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 -- 172.21.15.134:0/4049682622 >> 172.21.15.134:0/4049682622 conn(0x7f1fdc0fa5e0 msgr2=0x7f1fdc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:53.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 -- 172.21.15.134:0/4049682622 shutdown_connections 2024-04-13T10:55:53.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:53.751+0000 7f1fe25d2700 1 -- 172.21.15.134:0/4049682622 wait complete. 2024-04-13T10:55:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:53 smithi194 ceph-mon[46737]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-13T10:55:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:53 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/4049682622' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-13T10:55:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:53 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:54.159 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:53 smithi134 ceph-mon[39696]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-13T10:55:54.159 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:53 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/4049682622' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-13T10:55:54.159 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:53 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:54.456 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-13T10:55:54.465 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T10:55:54.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-04-13T10:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/4049682622' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-13T10:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.194:6826/1752721932,v1:172.21.15.194:6827/1752721932] up:boot 2024-04-13T10:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 3 up:standby 2024-04-13T10:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T10:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T10:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:54.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:54.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:54.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:54.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:54 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:55:55.057 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/4049682622' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-13T10:55:55.057 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.194:6826/1752721932,v1:172.21.15.194:6827/1752721932] up:boot 2024-04-13T10:55:55.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 3 up:standby 2024-04-13T10:55:55.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T10:55:55.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T10:55:55.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:55.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:55.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:55.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:55.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:55.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:54 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:55:55.456 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:55:56.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:55 smithi134 ceph-mon[39696]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 87 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-13T10:55:56.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:55 smithi194 ceph-mon[46737]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 87 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-13T10:55:57.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] up:standby 2024-04-13T10:55:57.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] up:standby 2024-04-13T10:55:57.058 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: Dropping low affinity standby-replay daemon mds.cephfs.smithi194.svyrny in favor of higher affinity standby. 2024-04-13T10:55:57.059 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T10:55:57.059 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: Dropping low affinity active daemon mds.cephfs.smithi134.hxpcfx in favor of higher affinity standby. 2024-04-13T10:55:57.059 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: Replacing daemon mds.cephfs.smithi134.hxpcfx as rank 0 with standby daemon mds.cephfs.smithi134.kachce 2024-04-13T10:55:57.059 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-13T10:55:57.059 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby-replay 1 up:standby 2024-04-13T10:55:57.059 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: osdmap e46: 6 total, 6 up, 6 in 2024-04-13T10:55:57.059 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: fsmap cephfs:1/1 {0=cephfs.smithi134.kachce=up:replay} 1 up:standby 2024-04-13T10:55:57.059 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:57.059 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:56 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:57.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] up:standby 2024-04-13T10:55:57.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] up:standby 2024-04-13T10:55:57.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: Dropping low affinity standby-replay daemon mds.cephfs.smithi194.svyrny in favor of higher affinity standby. 2024-04-13T10:55:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T10:55:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: Dropping low affinity active daemon mds.cephfs.smithi134.hxpcfx in favor of higher affinity standby. 2024-04-13T10:55:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: Replacing daemon mds.cephfs.smithi134.hxpcfx as rank 0 with standby daemon mds.cephfs.smithi134.kachce 2024-04-13T10:55:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-13T10:55:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby-replay 1 up:standby 2024-04-13T10:55:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: osdmap e46: 6 total, 6 up, 6 in 2024-04-13T10:55:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: fsmap cephfs:1/1 {0=cephfs.smithi134.kachce=up:replay} 1 up:standby 2024-04-13T10:55:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:56 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:57.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.321+0000 7fef92cc4700 1 -- 172.21.15.134:0/330563121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef8c0ffa40 msgr2=0x7fef8c0ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:57.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.321+0000 7fef92cc4700 1 --2- 172.21.15.134:0/330563121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef8c0ffa40 0x7fef8c0ffe90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fef78009910 tx=0x7fef78009c20 comp rx=0 tx=0).stop 2024-04-13T10:55:57.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.321+0000 7fef92cc4700 1 -- 172.21.15.134:0/330563121 shutdown_connections 2024-04-13T10:55:57.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.321+0000 7fef92cc4700 1 --2- 172.21.15.134:0/330563121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef8c0ffa40 0x7fef8c0ffe90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:57.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.321+0000 7fef92cc4700 1 --2- 172.21.15.134:0/330563121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8c0fe840 0x7fef8c0fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:57.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.321+0000 7fef92cc4700 1 -- 172.21.15.134:0/330563121 >> 172.21.15.134:0/330563121 conn(0x7fef8c0f9dd0 msgr2=0x7fef8c0fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:57.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.321+0000 7fef92cc4700 1 -- 172.21.15.134:0/330563121 shutdown_connections 2024-04-13T10:55:57.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.321+0000 7fef92cc4700 1 -- 172.21.15.134:0/330563121 wait complete. 2024-04-13T10:55:57.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef92cc4700 1 Processor -- start 2024-04-13T10:55:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef92cc4700 1 -- start start 2024-04-13T10:55:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef92cc4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef8c0fe840 0x7fef8c103890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef92cc4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8c0ffa40 0x7fef8c101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef92cc4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c102470 con 0x7fef8c0fe840 2024-04-13T10:55:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef92cc4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c1025b0 con 0x7fef8c0ffa40 2024-04-13T10:55:57.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef90a60700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef8c0fe840 0x7fef8c103890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef90a60700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef8c0fe840 0x7fef8c103890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50932/0 (socket says 172.21.15.134:50932) 2024-04-13T10:55:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef90a60700 1 -- 172.21.15.134:0/3803138015 learned_addr learned my addr 172.21.15.134:0/3803138015 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:55:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef8bfff700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8c0ffa40 0x7fef8c101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef90a60700 1 -- 172.21.15.134:0/3803138015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8c0ffa40 msgr2=0x7fef8c101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.322+0000 7fef90a60700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8c0ffa40 0x7fef8c101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.323+0000 7fef90a60700 1 -- 172.21.15.134:0/3803138015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef780095f0 con 0x7fef8c0fe840 2024-04-13T10:55:57.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.323+0000 7fef90a60700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef8c0fe840 0x7fef8c103890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fef8000d900 tx=0x7fef8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.323+0000 7fef89ffb700 1 -- 172.21.15.134:0/3803138015 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef800041f0 con 0x7fef8c0fe840 2024-04-13T10:55:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.323+0000 7fef89ffb700 1 -- 172.21.15.134:0/3803138015 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fef80004350 con 0x7fef8c0fe840 2024-04-13T10:55:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.323+0000 7fef92cc4700 1 -- 172.21.15.134:0/3803138015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c102890 con 0x7fef8c0fe840 2024-04-13T10:55:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.323+0000 7fef89ffb700 1 -- 172.21.15.134:0/3803138015 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef80003cf0 con 0x7fef8c0fe840 2024-04-13T10:55:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.323+0000 7fef92cc4700 1 -- 172.21.15.134:0/3803138015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c19d9a0 con 0x7fef8c0fe840 2024-04-13T10:55:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.324+0000 7fef92cc4700 1 -- 172.21.15.134:0/3803138015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c190140 con 0x7fef8c0fe840 2024-04-13T10:55:57.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.324+0000 7fef89ffb700 1 -- 172.21.15.134:0/3803138015 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fef80009730 con 0x7fef8c0fe840 2024-04-13T10:55:57.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.325+0000 7fef89ffb700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef7c06c680 0x7fef7c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:55:57.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.325+0000 7fef89ffb700 1 -- 172.21.15.134:0/3803138015 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fef8008b9f0 con 0x7fef8c0fe840 2024-04-13T10:55:57.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.325+0000 7fef8bfff700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef7c06c680 0x7fef7c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:55:57.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.325+0000 7fef8bfff700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef7c06c680 0x7fef7c06eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef7800b5c0 tx=0x7fef78005a90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:55:57.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.329+0000 7fef89ffb700 1 -- 172.21.15.134:0/3803138015 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fef8008de60 con 0x7fef8c0fe840 2024-04-13T10:55:57.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.564+0000 7fef92cc4700 1 -- 172.21.15.134:0/3803138015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef8c02d090 con 0x7fef8c0fe840 2024-04-13T10:55:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.853+0000 7fef89ffb700 1 -- 172.21.15.134:0/3803138015 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v16) v1 ==== 168+0+0 (secure 0 0 0) 0x7fef80059b80 con 0x7fef8c0fe840 2024-04-13T10:55:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.855+0000 7fef92cc4700 1 -- 172.21.15.134:0/3803138015 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef7c06c680 msgr2=0x7fef7c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.856+0000 7fef92cc4700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef7c06c680 0x7fef7c06eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fef7800b5c0 tx=0x7fef78005a90 comp rx=0 tx=0).stop 2024-04-13T10:55:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.856+0000 7fef92cc4700 1 -- 172.21.15.134:0/3803138015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef8c0fe840 msgr2=0x7fef8c103890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:55:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.856+0000 7fef92cc4700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef8c0fe840 0x7fef8c103890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fef8000d900 tx=0x7fef8000dcc0 comp rx=0 tx=0).stop 2024-04-13T10:55:57.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.856+0000 7fef92cc4700 1 -- 172.21.15.134:0/3803138015 shutdown_connections 2024-04-13T10:55:57.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.856+0000 7fef92cc4700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef7c06c680 0x7fef7c06eb30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:57.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.856+0000 7fef92cc4700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef8c0fe840 0x7fef8c103890 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:57.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.856+0000 7fef92cc4700 1 --2- 172.21.15.134:0/3803138015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8c0ffa40 0x7fef8c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:55:57.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.856+0000 7fef92cc4700 1 -- 172.21.15.134:0/3803138015 >> 172.21.15.134:0/3803138015 conn(0x7fef8c0f9dd0 msgr2=0x7fef8c103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:55:57.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.856+0000 7fef92cc4700 1 -- 172.21.15.134:0/3803138015 shutdown_connections 2024-04-13T10:55:57.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:55:57.856+0000 7fef92cc4700 1 -- 172.21.15.134:0/3803138015 wait complete. 2024-04-13T10:55:57.857 INFO:teuthology.orchestra.run.smithi134.stderr:inline data enabled 2024-04-13T10:55:57.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:57 smithi134 ceph-mon[39696]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-13T10:55:57.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:57 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] up:boot 2024-04-13T10:55:57.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:57 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] up:boot 2024-04-13T10:55:57.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:57 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] up:reconnect 2024-04-13T10:55:57.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:57 smithi134 ceph-mon[39696]: fsmap cephfs:1/1 {0=cephfs.smithi134.kachce=up:reconnect} 3 up:standby 2024-04-13T10:55:57.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T10:55:57.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T10:55:57.884 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:57 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3803138015' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-13T10:55:58.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:57 smithi194 ceph-mon[46737]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-13T10:55:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:57 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] up:boot 2024-04-13T10:55:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:57 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] up:boot 2024-04-13T10:55:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:57 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] up:reconnect 2024-04-13T10:55:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:57 smithi194 ceph-mon[46737]: fsmap cephfs:1/1 {0=cephfs.smithi134.kachce=up:reconnect} 3 up:standby 2024-04-13T10:55:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T10:55:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T10:55:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:57 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3803138015' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-13T10:55:58.879 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-13T10:55:58.888 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T10:55:58.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-13T10:55:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:58 smithi134 ceph-mon[39696]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-04-13T10:55:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:58 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] up:rejoin 2024-04-13T10:55:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:58 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3803138015' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-04-13T10:55:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:58 smithi134 ceph-mon[39696]: fsmap cephfs:1/1 {0=cephfs.smithi134.kachce=up:rejoin} 3 up:standby 2024-04-13T10:55:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:58 smithi134 ceph-mon[39696]: daemon mds.cephfs.smithi134.kachce is now active in filesystem cephfs as rank 0 2024-04-13T10:55:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:58 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:59.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:58 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:55:59.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:58 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:59.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:58 smithi194 ceph-mon[46737]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-04-13T10:55:59.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:58 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] up:rejoin 2024-04-13T10:55:59.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:58 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3803138015' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-04-13T10:55:59.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:58 smithi194 ceph-mon[46737]: fsmap cephfs:1/1 {0=cephfs.smithi134.kachce=up:rejoin} 3 up:standby 2024-04-13T10:55:59.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:58 smithi194 ceph-mon[46737]: daemon mds.cephfs.smithi134.kachce is now active in filesystem cephfs as rank 0 2024-04-13T10:55:59.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:58 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:59.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:58 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:55:59.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:58 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:55:59.633 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:56:00.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:59 smithi134 ceph-mon[39696]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 409 B/s wr, 2 op/s 2024-04-13T10:56:00.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:59 smithi134 ceph-mon[39696]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-13T10:56:00.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:59 smithi134 ceph-mon[39696]: mds.? [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] up:active 2024-04-13T10:56:00.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:59 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 3 up:standby 2024-04-13T10:56:00.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:55:59 smithi134 ceph-mon[39696]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T10:56:00.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:59 smithi194 ceph-mon[46737]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 409 B/s wr, 2 op/s 2024-04-13T10:56:00.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:59 smithi194 ceph-mon[46737]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-13T10:56:00.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:59 smithi194 ceph-mon[46737]: mds.? [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] up:active 2024-04-13T10:56:00.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:59 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 3 up:standby 2024-04-13T10:56:00.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:55:59 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T10:56:02.023 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:01 smithi134 ceph-mon[39696]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 6 op/s 2024-04-13T10:56:02.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:01 smithi194 ceph-mon[46737]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 6 op/s 2024-04-13T10:56:02.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.521+0000 7f48ba8fd700 1 -- 172.21.15.134:0/116119302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b41013f0 msgr2=0x7f48b4101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:02.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.521+0000 7f48ba8fd700 1 --2- 172.21.15.134:0/116119302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b41013f0 0x7f48b4101840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009910 tx=0x7f48a8009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:02.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.521+0000 7f48ba8fd700 1 -- 172.21.15.134:0/116119302 shutdown_connections 2024-04-13T10:56:02.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.521+0000 7f48ba8fd700 1 --2- 172.21.15.134:0/116119302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b41013f0 0x7f48b4101840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:02.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.521+0000 7f48ba8fd700 1 --2- 172.21.15.134:0/116119302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b40fe410 0x7f48b40fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:02.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.521+0000 7f48ba8fd700 1 -- 172.21.15.134:0/116119302 >> 172.21.15.134:0/116119302 conn(0x7f48b40f9d80 msgr2=0x7f48b40fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:02.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.521+0000 7f48ba8fd700 1 -- 172.21.15.134:0/116119302 shutdown_connections 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.521+0000 7f48ba8fd700 1 -- 172.21.15.134:0/116119302 wait complete. 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.522+0000 7f48ba8fd700 1 Processor -- start 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.522+0000 7f48ba8fd700 1 -- start start 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48ba8fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b40fe410 0x7f48b4195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48ba8fd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b41013f0 0x7f48b4195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48ba8fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b41963d0 con 0x7f48b40fe410 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48ba8fd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4196510 con 0x7f48b41013f0 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48b3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b40fe410 0x7f48b4195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48b3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b40fe410 0x7f48b4195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52138/0 (socket says 172.21.15.134:52138) 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48b3fff700 1 -- 172.21.15.134:0/192332339 learned_addr learned my addr 172.21.15.134:0/192332339 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48b3fff700 1 -- 172.21.15.134:0/192332339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b41013f0 msgr2=0x7f48b4195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48b3fff700 1 --2- 172.21.15.134:0/192332339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b41013f0 0x7f48b4195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:02.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48b3fff700 1 -- 172.21.15.134:0/192332339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80095f0 con 0x7f48b40fe410 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48b3fff700 1 --2- 172.21.15.134:0/192332339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b40fe410 0x7f48b4195870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f48a400d900 tx=0x7f48a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48b17fa700 1 -- 172.21.15.134:0/192332339 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a40041f0 con 0x7f48b40fe410 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48b17fa700 1 -- 172.21.15.134:0/192332339 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f48a4004350 con 0x7f48b40fe410 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48ba8fd700 1 -- 172.21.15.134:0/192332339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b419afc0 con 0x7f48b40fe410 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48b17fa700 1 -- 172.21.15.134:0/192332339 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a4003cf0 con 0x7f48b40fe410 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.523+0000 7f48ba8fd700 1 -- 172.21.15.134:0/192332339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b419b530 con 0x7f48b40fe410 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.524+0000 7f48ba8fd700 1 -- 172.21.15.134:0/192332339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b4108b50 con 0x7f48b40fe410 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.525+0000 7f48b17fa700 1 -- 172.21.15.134:0/192332339 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f48a4009730 con 0x7f48b40fe410 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.525+0000 7f48b17fa700 1 --2- 172.21.15.134:0/192332339 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f489c06c680 0x7f489c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.525+0000 7f48b17fa700 1 -- 172.21.15.134:0/192332339 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f48a408bac0 con 0x7f48b40fe410 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.525+0000 7f48b37fe700 1 --2- 172.21.15.134:0/192332339 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f489c06c680 0x7f489c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.526+0000 7f48b37fe700 1 --2- 172.21.15.134:0/192332339 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f489c06c680 0x7f489c06eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48a800b5c0 tx=0x7f48a8005960 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:02.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.530+0000 7f48b17fa700 1 -- 172.21.15.134:0/192332339 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f48a4059bd0 con 0x7f48b40fe410 2024-04-13T10:56:02.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.773+0000 7f48ba8fd700 1 -- 172.21.15.134:0/192332339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f48b419bbd0 con 0x7f48b40fe410 2024-04-13T10:56:02.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.773+0000 7f48b17fa700 1 -- 172.21.15.134:0/192332339 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1859 (secure 0 0 0) 0x7f48a4059760 con 0x7f48b40fe410 2024-04-13T10:56:02.774 INFO:teuthology.orchestra.run.smithi134.stdout:e18 2024-04-13T10:56:02.774 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T10:56:02.774 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 18 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T10:55:58.861624+0000 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T10:56:02.775 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14492} 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T10:56:02.776 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T10:56:02.777 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T10:56:02.777 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T10:56:02.777 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T10:56:02.777 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T10:56:02.777 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T10:56:02.777 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T10:56:02.777 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T10:56:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:56:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:56:02.778 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T10:56:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:56:02.778 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T10:56:02.778 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T10:56:02.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.775+0000 7f48ba8fd700 1 -- 172.21.15.134:0/192332339 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f489c06c680 msgr2=0x7f489c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:02.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.775+0000 7f48ba8fd700 1 --2- 172.21.15.134:0/192332339 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f489c06c680 0x7f489c06eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48a800b5c0 tx=0x7f48a8005960 comp rx=0 tx=0).stop 2024-04-13T10:56:02.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.775+0000 7f48ba8fd700 1 -- 172.21.15.134:0/192332339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b40fe410 msgr2=0x7f48b4195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:02.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.775+0000 7f48ba8fd700 1 --2- 172.21.15.134:0/192332339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b40fe410 0x7f48b4195870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f48a400d900 tx=0x7f48a400dcc0 comp rx=0 tx=0).stop 2024-04-13T10:56:02.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.776+0000 7f48ba8fd700 1 -- 172.21.15.134:0/192332339 shutdown_connections 2024-04-13T10:56:02.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.776+0000 7f48ba8fd700 1 --2- 172.21.15.134:0/192332339 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f489c06c680 0x7f489c06eb30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:02.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.776+0000 7f48ba8fd700 1 --2- 172.21.15.134:0/192332339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b40fe410 0x7f48b4195870 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:02.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.776+0000 7f48ba8fd700 1 --2- 172.21.15.134:0/192332339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b41013f0 0x7f48b4195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:02.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.776+0000 7f48ba8fd700 1 -- 172.21.15.134:0/192332339 >> 172.21.15.134:0/192332339 conn(0x7f48b40f9d80 msgr2=0x7f48b4104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:02.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.776+0000 7f48ba8fd700 1 -- 172.21.15.134:0/192332339 shutdown_connections 2024-04-13T10:56:02.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:02.776+0000 7f48ba8fd700 1 -- 172.21.15.134:0/192332339 wait complete. 2024-04-13T10:56:02.780 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T10:56:03.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:02 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/192332339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T10:56:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:02 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/192332339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T10:56:03.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-13T10:56:03.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:03 smithi134 ceph-mon[39696]: pgmap v201: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.4 KiB/s rd, 7 op/s 2024-04-13T10:56:03.947 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:56:04.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:03 smithi194 ceph-mon[46737]: pgmap v201: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.4 KiB/s rd, 7 op/s 2024-04-13T10:56:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:56:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:56:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:04 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:56:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:04 smithi194 ceph-mon[46737]: pgmap v202: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 10 op/s 2024-04-13T10:56:05.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:05.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:05.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:56:05.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:56:05.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:05.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:04 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:56:05.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:04 smithi134 ceph-mon[39696]: pgmap v202: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 10 op/s 2024-04-13T10:56:06.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.392+0000 7f37a21fd700 1 -- 172.21.15.134:0/1174765855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c100280 msgr2=0x7f379c1006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.392+0000 7f37a21fd700 1 --2- 172.21.15.134:0/1174765855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c100280 0x7f379c1006d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f378c009910 tx=0x7f378c009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.392+0000 7f37a21fd700 1 -- 172.21.15.134:0/1174765855 shutdown_connections 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.392+0000 7f37a21fd700 1 --2- 172.21.15.134:0/1174765855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c100280 0x7f379c1006d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.392+0000 7f37a21fd700 1 --2- 172.21.15.134:0/1174765855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0ff080 0x7f379c0ff490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.392+0000 7f37a21fd700 1 -- 172.21.15.134:0/1174765855 >> 172.21.15.134:0/1174765855 conn(0x7f379c0fa630 msgr2=0x7f379c0fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.392+0000 7f37a21fd700 1 -- 172.21.15.134:0/1174765855 shutdown_connections 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.392+0000 7f37a21fd700 1 -- 172.21.15.134:0/1174765855 wait complete. 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f37a21fd700 1 Processor -- start 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f37a21fd700 1 -- start start 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f37a21fd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0ff080 0x7f379c069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f37a21fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c100280 0x7f379c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f37a21fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c19ab50 con 0x7f379c100280 2024-04-13T10:56:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f37a21fd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c19ac90 con 0x7f379c0ff080 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f379affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c100280 0x7f379c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f379affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c100280 0x7f379c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52148/0 (socket says 172.21.15.134:52148) 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f379affd700 1 -- 172.21.15.134:0/3945715066 learned_addr learned my addr 172.21.15.134:0/3945715066 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f379b7fe700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0ff080 0x7f379c069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f379affd700 1 -- 172.21.15.134:0/3945715066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0ff080 msgr2=0x7f379c069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f379affd700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0ff080 0x7f379c069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.393+0000 7f379affd700 1 -- 172.21.15.134:0/3945715066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0095f0 con 0x7f379c100280 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.394+0000 7f379affd700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c100280 0x7f379c19a610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f378c006010 tx=0x7f378c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.394+0000 7f3798ff9700 1 -- 172.21.15.134:0/3945715066 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f378c01d070 con 0x7f379c100280 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.394+0000 7f3798ff9700 1 -- 172.21.15.134:0/3945715066 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f378c00f460 con 0x7f379c100280 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.394+0000 7f37a21fd700 1 -- 172.21.15.134:0/3945715066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c19af10 con 0x7f379c100280 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.394+0000 7f3798ff9700 1 -- 172.21.15.134:0/3945715066 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f378c021640 con 0x7f379c100280 2024-04-13T10:56:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.394+0000 7f37a21fd700 1 -- 172.21.15.134:0/3945715066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c19b450 con 0x7f379c100280 2024-04-13T10:56:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.395+0000 7f37a21fd700 1 -- 172.21.15.134:0/3945715066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379c107a90 con 0x7f379c100280 2024-04-13T10:56:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.395+0000 7f3798ff9700 1 -- 172.21.15.134:0/3945715066 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f378c00f5d0 con 0x7f379c100280 2024-04-13T10:56:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.395+0000 7f3798ff9700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f378406c680 0x7f378406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.396+0000 7f3798ff9700 1 -- 172.21.15.134:0/3945715066 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f378c08cb20 con 0x7f379c100280 2024-04-13T10:56:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.396+0000 7f379b7fe700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f378406c680 0x7f378406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:06.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.396+0000 7f379b7fe700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f378406c680 0x7f378406eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f379c1000e0 tx=0x7f379000a3b0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:06.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.400+0000 7f3798ff9700 1 -- 172.21.15.134:0/3945715066 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f378c05acb0 con 0x7f379c100280 2024-04-13T10:56:06.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.632+0000 7f37a21fd700 1 -- 172.21.15.134:0/3945715066 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f379c19bce0 con 0x7f379c100280 2024-04-13T10:56:06.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.633+0000 7f3798ff9700 1 -- 172.21.15.134:0/3945715066 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4759 (secure 0 0 0) 0x7f378c060090 con 0x7f379c100280 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 -- 172.21.15.134:0/3945715066 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f378406c680 msgr2=0x7f378406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f378406c680 0x7f378406eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f379c1000e0 tx=0x7f379000a3b0 comp rx=0 tx=0).stop 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 -- 172.21.15.134:0/3945715066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c100280 msgr2=0x7f379c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c100280 0x7f379c19a610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f378c006010 tx=0x7f378c00bd70 comp rx=0 tx=0).stop 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 -- 172.21.15.134:0/3945715066 shutdown_connections 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f378406c680 0x7f378406eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f379c0ff080 0x7f379c069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 --2- 172.21.15.134:0/3945715066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f379c100280 0x7f379c19a610 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 -- 172.21.15.134:0/3945715066 >> 172.21.15.134:0/3945715066 conn(0x7f379c0fa630 msgr2=0x7f379c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 -- 172.21.15.134:0/3945715066 shutdown_connections 2024-04-13T10:56:06.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:06.635+0000 7f37a21fd700 1 -- 172.21.15.134:0/3945715066 wait complete. 2024-04-13T10:56:06.637 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T10:56:06.647 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T10:56:07.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:07 smithi134 ceph-mon[39696]: pgmap v203: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-13T10:56:07.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:07 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:07.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:07 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:07.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:07 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3945715066' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-13T10:56:07.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-13T10:56:07.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:07 smithi194 ceph-mon[46737]: pgmap v203: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-13T10:56:07.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:07 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:07.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:07 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:07.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:07 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3945715066' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-13T10:56:08.176 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:56:09.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:09 smithi134 ceph-mon[39696]: pgmap v204: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-13T10:56:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:09 smithi194 ceph-mon[46737]: pgmap v204: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-13T10:56:11.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.121+0000 7f37dedeb700 1 -- 172.21.15.134:0/2937976457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8100250 msgr2=0x7f37d81006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:11.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.121+0000 7f37dedeb700 1 --2- 172.21.15.134:0/2937976457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8100250 0x7f37d81006a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009910 tx=0x7f37c4009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:11.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.121+0000 7f37dedeb700 1 -- 172.21.15.134:0/2937976457 shutdown_connections 2024-04-13T10:56:11.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.121+0000 7f37dedeb700 1 --2- 172.21.15.134:0/2937976457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8100250 0x7f37d81006a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:11.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.121+0000 7f37dedeb700 1 --2- 172.21.15.134:0/2937976457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37d80ff050 0x7f37d80ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:11.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.121+0000 7f37dedeb700 1 -- 172.21.15.134:0/2937976457 >> 172.21.15.134:0/2937976457 conn(0x7f37d80fa5e0 msgr2=0x7f37d80fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:11.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.121+0000 7f37dedeb700 1 -- 172.21.15.134:0/2937976457 shutdown_connections 2024-04-13T10:56:11.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.121+0000 7f37dedeb700 1 -- 172.21.15.134:0/2937976457 wait complete. 2024-04-13T10:56:11.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37dedeb700 1 Processor -- start 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37dedeb700 1 -- start start 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37dedeb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37d80ff050 0x7f37d8068f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37dedeb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8100250 0x7f37d819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37dedeb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d8196560 con 0x7f37d8100250 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37dedeb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d819d030 con 0x7f37d80ff050 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37d7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8100250 0x7f37d819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37d7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8100250 0x7f37d819caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34340/0 (socket says 172.21.15.134:34340) 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37d7fff700 1 -- 172.21.15.134:0/2684806399 learned_addr learned my addr 172.21.15.134:0/2684806399 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37dcb87700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37d80ff050 0x7f37d8068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37d7fff700 1 -- 172.21.15.134:0/2684806399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37d80ff050 msgr2=0x7f37d8068f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37d7fff700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37d80ff050 0x7f37d8068f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37d7fff700 1 -- 172.21.15.134:0/2684806399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c40095f0 con 0x7f37d8100250 2024-04-13T10:56:11.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37d7fff700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8100250 0x7f37d819caf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f37c4006010 tx=0x7f37c400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37d5ffb700 1 -- 172.21.15.134:0/2684806399 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37c401d070 con 0x7f37d8100250 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37d5ffb700 1 -- 172.21.15.134:0/2684806399 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f37c400f460 con 0x7f37d8100250 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.122+0000 7f37dedeb700 1 -- 172.21.15.134:0/2684806399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d819d2b0 con 0x7f37d8100250 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.123+0000 7f37d5ffb700 1 -- 172.21.15.134:0/2684806399 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37c4021640 con 0x7f37d8100250 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.123+0000 7f37dedeb700 1 -- 172.21.15.134:0/2684806399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d819d820 con 0x7f37d8100250 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.124+0000 7f37dedeb700 1 -- 172.21.15.134:0/2684806399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d8107b00 con 0x7f37d8100250 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.124+0000 7f37d5ffb700 1 -- 172.21.15.134:0/2684806399 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f37c400f9b0 con 0x7f37d8100250 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.124+0000 7f37d5ffb700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f37c806c680 0x7f37c806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.124+0000 7f37d5ffb700 1 -- 172.21.15.134:0/2684806399 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f37c408cbf0 con 0x7f37d8100250 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.125+0000 7f37dcb87700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f37c806c680 0x7f37c806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.125+0000 7f37dcb87700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f37c806c680 0x7f37c806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f37d81000b0 tx=0x7f37cc009190 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:11.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.129+0000 7f37d5ffb700 1 -- 172.21.15.134:0/2684806399 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f37c405ad00 con 0x7f37d8100250 2024-04-13T10:56:11.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.408+0000 7f37dedeb700 1 -- 172.21.15.134:0/2684806399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f37d8107cf0 con 0x7f37d8100250 2024-04-13T10:56:11.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.408+0000 7f37d5ffb700 1 -- 172.21.15.134:0/2684806399 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) v1 ==== 78+0+83 (secure 0 0 0) 0x7f37c405a890 con 0x7f37d8100250 2024-04-13T10:56:11.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 -- 172.21.15.134:0/2684806399 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f37c806c680 msgr2=0x7f37c806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:11.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f37c806c680 0x7f37c806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f37d81000b0 tx=0x7f37cc009190 comp rx=0 tx=0).stop 2024-04-13T10:56:11.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 -- 172.21.15.134:0/2684806399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8100250 msgr2=0x7f37d819caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:11.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8100250 0x7f37d819caf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f37c4006010 tx=0x7f37c400bd70 comp rx=0 tx=0).stop 2024-04-13T10:56:11.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 -- 172.21.15.134:0/2684806399 shutdown_connections 2024-04-13T10:56:11.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f37c806c680 0x7f37c806eb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:11.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37d80ff050 0x7f37d8068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:11.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 --2- 172.21.15.134:0/2684806399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d8100250 0x7f37d819caf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:11.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 -- 172.21.15.134:0/2684806399 >> 172.21.15.134:0/2684806399 conn(0x7f37d80fa5e0 msgr2=0x7f37d8103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:11.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 -- 172.21.15.134:0/2684806399 shutdown_connections 2024-04-13T10:56:11.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:11.410+0000 7f37dedeb700 1 -- 172.21.15.134:0/2684806399 wait complete. 2024-04-13T10:56:11.421 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T10:56:11.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:11 smithi134 ceph-mon[39696]: pgmap v205: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-13T10:56:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:11 smithi194 ceph-mon[46737]: pgmap v205: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-13T10:56:12.268 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-13T10:56:12.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T10:56:12.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.647+0000 7f3943ad4700 1 -- 172.21.15.134:0/309434374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f393c0fefa0 msgr2=0x7f393c0ff3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:12.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.647+0000 7f3943ad4700 1 --2- 172.21.15.134:0/309434374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f393c0fefa0 0x7f393c0ff3b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f392c009910 tx=0x7f392c009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:12.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.647+0000 7f3943ad4700 1 -- 172.21.15.134:0/309434374 shutdown_connections 2024-04-13T10:56:12.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.647+0000 7f3943ad4700 1 --2- 172.21.15.134:0/309434374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c100190 0x7f393c1005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:12.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.647+0000 7f3943ad4700 1 --2- 172.21.15.134:0/309434374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f393c0fefa0 0x7f393c0ff3b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:12.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.647+0000 7f3943ad4700 1 -- 172.21.15.134:0/309434374 >> 172.21.15.134:0/309434374 conn(0x7f393c0fa500 msgr2=0x7f393c0fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:12.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.647+0000 7f3943ad4700 1 -- 172.21.15.134:0/309434374 shutdown_connections 2024-04-13T10:56:12.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.647+0000 7f3943ad4700 1 -- 172.21.15.134:0/309434374 wait complete. 2024-04-13T10:56:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.647+0000 7f3943ad4700 1 Processor -- start 2024-04-13T10:56:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3943ad4700 1 -- start start 2024-04-13T10:56:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3943ad4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f393c0fefa0 0x7f393c194610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3943ad4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c100190 0x7f393c194b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3943ad4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c195170 con 0x7f393c0fefa0 2024-04-13T10:56:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3943ad4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c1952b0 con 0x7f393c100190 2024-04-13T10:56:12.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3941870700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f393c0fefa0 0x7f393c194610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:12.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3941870700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f393c0fefa0 0x7f393c194610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34350/0 (socket says 172.21.15.134:34350) 2024-04-13T10:56:12.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3941870700 1 -- 172.21.15.134:0/758658244 learned_addr learned my addr 172.21.15.134:0/758658244 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:12.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f394106f700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c100190 0x7f393c194b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:12.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3941870700 1 -- 172.21.15.134:0/758658244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c100190 msgr2=0x7f393c194b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:12.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3941870700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c100190 0x7f393c194b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:12.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3941870700 1 -- 172.21.15.134:0/758658244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c0095f0 con 0x7f393c0fefa0 2024-04-13T10:56:12.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3941870700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f393c0fefa0 0x7f393c194610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f392c00bda0 tx=0x7f392c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:12.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3932ffd700 1 -- 172.21.15.134:0/758658244 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f392c01d070 con 0x7f393c0fefa0 2024-04-13T10:56:12.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3932ffd700 1 -- 172.21.15.134:0/758658244 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f392c022470 con 0x7f393c0fefa0 2024-04-13T10:56:12.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3932ffd700 1 -- 172.21.15.134:0/758658244 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f392c00f690 con 0x7f393c0fefa0 2024-04-13T10:56:12.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3943ad4700 1 -- 172.21.15.134:0/758658244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c199cf0 con 0x7f393c0fefa0 2024-04-13T10:56:12.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.648+0000 7f3943ad4700 1 -- 172.21.15.134:0/758658244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c19a220 con 0x7f393c0fefa0 2024-04-13T10:56:12.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.649+0000 7f3943ad4700 1 -- 172.21.15.134:0/758658244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c1079a0 con 0x7f393c0fefa0 2024-04-13T10:56:12.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.650+0000 7f3932ffd700 1 -- 172.21.15.134:0/758658244 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f392c0229c0 con 0x7f393c0fefa0 2024-04-13T10:56:12.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.650+0000 7f3932ffd700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f392806c740 0x7f392806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:12.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.650+0000 7f3932ffd700 1 -- 172.21.15.134:0/758658244 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f392c08cf10 con 0x7f393c0fefa0 2024-04-13T10:56:12.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.650+0000 7f394106f700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f392806c740 0x7f392806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:12.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.651+0000 7f394106f700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f392806c740 0x7f392806ebf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3938005fd0 tx=0x7f393800a560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:12.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.656+0000 7f3932ffd700 1 -- 172.21.15.134:0/758658244 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f392c05b0d0 con 0x7f393c0fefa0 2024-04-13T10:56:12.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:12 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2684806399' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-13T10:56:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:12 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/2684806399' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-13T10:56:12.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.849+0000 7f3943ad4700 1 -- 172.21.15.134:0/758658244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f393c19a860 con 0x7f393c0fefa0 2024-04-13T10:56:12.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.850+0000 7f3932ffd700 1 -- 172.21.15.134:0/758658244 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15182 (secure 0 0 0) 0x7f392c05ac60 con 0x7f393c0fefa0 2024-04-13T10:56:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:56:12.851 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":46,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","created":"2024-04-13T10:48:00.547311+0000","modified":"2024-04-13T10:55:55.830837+0000","last_up_change":"2024-04-13T10:54:15.809542+0000","last_in_change":"2024-04-13T10:53:56.134815+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T10:52:52.594710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-13T10:55:39.381684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-13T10:55:39.903105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02af0f03-a267-4906-8417-d15189c8da92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6803","nonce":1676110195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6805","nonce":1676110195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6809","nonce":1676110195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1676110195},{"type":"v1","addr":"172.21.15.134:6807","nonce":1676110195}]},"public_addr":"172.21.15.134:6803/1676110195","cluster_addr":"172.21.15.134:6805/1676110195","heartbeat_back_addr":"172.21.15.134:6809/1676110195","heartbeat_front_addr":"172.21.15.134:6807/1676110195","state":["exists","up"]},{"osd":1,"uuid":"ce202f5e-9c58-4cd6-b85b-1422131948d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6811","nonce":3488984333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6813","nonce":3488984333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6817","nonce":3488984333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3488984333},{"type":"v1","addr":"172.21.15.134:6815","nonce":3488984333}]},"public_addr":"172.21.15.134:6811/3488984333","cluster_addr":"172.21.15.134:6813/3488984333","heartbeat_back_addr":"172.21.15.134:6817/3488984333","heartbeat_front_addr":"172.21.15.134:6815/3488984333","state":["exists","up"]},{"osd":2,"uuid":"7a2fef79-8403-416e-9037-079ddb080611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6819","nonce":768398169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6821","nonce":768398169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6825","nonce":768398169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":768398169},{"type":"v1","addr":"172.21.15.134:6823","nonce":768398169}]},"public_addr":"172.21.15.134:6819/768398169","cluster_addr":"172.21.15.134:6821/768398169","heartbeat_back_addr":"172.21.15.134:6825/768398169","heartbeat_front_addr":"172.21.15.134:6823/768398169","state":["exists","up"]},{"osd":3,"uuid":"44c0411c-d9e0-4d23-b97d-f613b89943a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6801","nonce":3197529117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6803","nonce":3197529117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6807","nonce":3197529117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3197529117},{"type":"v1","addr":"172.21.15.194:6805","nonce":3197529117}]},"public_addr":"172.21.15.194:6801/3197529117","cluster_addr":"172.21.15.194:6803/3197529117","heartbeat_back_addr":"172.21.15.194:6807/3197529117","heartbeat_front_addr":"172.21.15.194:6805/3197529117","state":["exists","up"]},{"osd":4,"uuid":"91533b98-bd92-4d8e-afa6-59c396f95799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6809","nonce":3191948930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6811","nonce":3191948930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6815","nonce":3191948930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3191948930},{"type":"v1","addr":"172.21.15.194:6813","nonce":3191948930}]},"public_addr":"172.21.15.194:6809/3191948930","cluster_addr":"172.21.15.194:6811/3191948930","heartbeat_back_addr":"172.21.15.194:6815/3191948930","heartbeat_front_addr":"172.21.15.194:6813/3191948930","state":["exists","up"]},{"osd":5,"uuid":"3e198b03-2011-435c-afd8-16d8521b9991","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6817","nonce":1929560628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6819","nonce":1929560628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6823","nonce":1929560628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1929560628},{"type":"v1","addr":"172.21.15.194:6821","nonce":1929560628}]},"public_addr":"172.21.15.194:6817/1929560628","cluster_addr":"172.21.15.194:6819/1929560628","heartbeat_back_addr":"172.21.15.194:6823/1929560628","heartbeat_front_addr":"172.21.15.194:6821/1929560628","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:51:48.117416+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:17.805248+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:49.973117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:17.604636+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:46.014087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:54:14.654274+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6800/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/3885996389":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6800/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6826/3726339659":"2024-04-14T10:55:55.830791+0000","172.21.15.134:6827/3726339659":"2024-04-14T10:55:55.830791+0000","172.21.15.134:0/2783735336":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6801/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/1090834434":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/4116995009":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/565739211":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/2590154845":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/471716030":"2024-04-14T10:49:08.875132+0000","172.21.15.134:6801/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6800/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/3055528347":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6801/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/323045534":"2024-04-14T10:50:28.273144+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 -- 172.21.15.134:0/758658244 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f392806c740 msgr2=0x7f392806ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f392806c740 0x7f392806ebf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3938005fd0 tx=0x7f393800a560 comp rx=0 tx=0).stop 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 -- 172.21.15.134:0/758658244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f393c0fefa0 msgr2=0x7f393c194610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f393c0fefa0 0x7f393c194610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f392c00bda0 tx=0x7f392c00be80 comp rx=0 tx=0).stop 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 -- 172.21.15.134:0/758658244 shutdown_connections 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f392806c740 0x7f392806ebf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f393c0fefa0 0x7f393c194610 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 --2- 172.21.15.134:0/758658244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f393c100190 0x7f393c194b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 -- 172.21.15.134:0/758658244 >> 172.21.15.134:0/758658244 conn(0x7f393c0fa500 msgr2=0x7f393c1033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 -- 172.21.15.134:0/758658244 shutdown_connections 2024-04-13T10:56:12.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.852+0000 7f3943ad4700 1 -- 172.21.15.134:0/758658244 wait complete. 2024-04-13T10:56:12.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T10:52:52.594710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-13T10:55:39.381684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-13T10:55:39.903105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T10:56:12.867 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T10:56:13.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.998+0000 7f1226e54700 1 -- 172.21.15.134:0/2845981419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1220100170 msgr2=0x7f12201005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.998+0000 7f1226e54700 1 --2- 172.21.15.134:0/2845981419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1220100170 0x7f12201005c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1208009910 tx=0x7f1208009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:13.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.998+0000 7f1226e54700 1 -- 172.21.15.134:0/2845981419 shutdown_connections 2024-04-13T10:56:13.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.998+0000 7f1226e54700 1 --2- 172.21.15.134:0/2845981419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1220100170 0x7f12201005c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.998+0000 7f1226e54700 1 --2- 172.21.15.134:0/2845981419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12200fef80 0x7f12200ff390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.998+0000 7f1226e54700 1 -- 172.21.15.134:0/2845981419 >> 172.21.15.134:0/2845981419 conn(0x7f12200fa500 msgr2=0x7f12200fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:13.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.998+0000 7f1226e54700 1 -- 172.21.15.134:0/2845981419 shutdown_connections 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.998+0000 7f1226e54700 1 -- 172.21.15.134:0/2845981419 wait complete. 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1226e54700 1 Processor -- start 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1226e54700 1 -- start start 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1226e54700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12200fef80 0x7f12201957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1226e54700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1220100170 0x7f1220195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1226e54700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1220196330 con 0x7f12200fef80 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1226e54700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1220196470 con 0x7f1220100170 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1224bf0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12200fef80 0x7f12201957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1224bf0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12200fef80 0x7f12201957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34362/0 (socket says 172.21.15.134:34362) 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1224bf0700 1 -- 172.21.15.134:0/4223224564 learned_addr learned my addr 172.21.15.134:0/4223224564 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:13.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f121ffff700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1220100170 0x7f1220195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:13.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1224bf0700 1 -- 172.21.15.134:0/4223224564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1220100170 msgr2=0x7f1220195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1224bf0700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1220100170 0x7f1220195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1224bf0700 1 -- 172.21.15.134:0/4223224564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080095f0 con 0x7f12200fef80 2024-04-13T10:56:13.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f1224bf0700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12200fef80 0x7f12201957d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1218007e90 tx=0x7f121800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:13.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f121dffb700 1 -- 172.21.15.134:0/4223224564 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1218017070 con 0x7f12200fef80 2024-04-13T10:56:13.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:12.999+0000 7f121dffb700 1 -- 172.21.15.134:0/4223224564 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f121800f040 con 0x7f12200fef80 2024-04-13T10:56:13.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.000+0000 7f121dffb700 1 -- 172.21.15.134:0/4223224564 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1218004780 con 0x7f12200fef80 2024-04-13T10:56:13.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.000+0000 7f1226e54700 1 -- 172.21.15.134:0/4223224564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122019af10 con 0x7f12200fef80 2024-04-13T10:56:13.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.000+0000 7f1226e54700 1 -- 172.21.15.134:0/4223224564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122019b460 con 0x7f12200fef80 2024-04-13T10:56:13.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.001+0000 7f1226e54700 1 -- 172.21.15.134:0/4223224564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1220107980 con 0x7f12200fef80 2024-04-13T10:56:13.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.001+0000 7f121dffb700 1 -- 172.21.15.134:0/4223224564 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f1218003a00 con 0x7f12200fef80 2024-04-13T10:56:13.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.001+0000 7f121dffb700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f120c06c680 0x7f120c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:13.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.001+0000 7f121dffb700 1 -- 172.21.15.134:0/4223224564 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f121808b340 con 0x7f12200fef80 2024-04-13T10:56:13.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.001+0000 7f121ffff700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f120c06c680 0x7f120c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:13.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.002+0000 7f121ffff700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f120c06c680 0x7f120c06eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1208006010 tx=0x7f120800b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:13.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.007+0000 7f121dffb700 1 -- 172.21.15.134:0/4223224564 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1218059450 con 0x7f12200fef80 2024-04-13T10:56:13.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.200+0000 7f1226e54700 1 -- 172.21.15.134:0/4223224564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f122019bd50 con 0x7f12200fef80 2024-04-13T10:56:13.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.201+0000 7f121dffb700 1 -- 172.21.15.134:0/4223224564 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1218058fe0 con 0x7f12200fef80 2024-04-13T10:56:13.202 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 -- 172.21.15.134:0/4223224564 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f120c06c680 msgr2=0x7f120c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f120c06c680 0x7f120c06eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1208006010 tx=0x7f120800b540 comp rx=0 tx=0).stop 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 -- 172.21.15.134:0/4223224564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12200fef80 msgr2=0x7f12201957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12200fef80 0x7f12201957d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1218007e90 tx=0x7f121800d3b0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 -- 172.21.15.134:0/4223224564 shutdown_connections 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f120c06c680 0x7f120c06eb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12200fef80 0x7f12201957d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 --2- 172.21.15.134:0/4223224564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1220100170 0x7f1220195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 -- 172.21.15.134:0/4223224564 >> 172.21.15.134:0/4223224564 conn(0x7f12200fa500 msgr2=0x7f1220067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 -- 172.21.15.134:0/4223224564 shutdown_connections 2024-04-13T10:56:13.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.203+0000 7f1226e54700 1 -- 172.21.15.134:0/4223224564 wait complete. 2024-04-13T10:56:13.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-13T10:56:13.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.340+0000 7fef679af700 1 -- 172.21.15.134:0/2328929422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef600ff240 msgr2=0x7fef600ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.340+0000 7fef679af700 1 --2- 172.21.15.134:0/2328929422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef600ff240 0x7fef600ff690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009910 tx=0x7fef5c009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:13.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.340+0000 7fef679af700 1 -- 172.21.15.134:0/2328929422 shutdown_connections 2024-04-13T10:56:13.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.340+0000 7fef679af700 1 --2- 172.21.15.134:0/2328929422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef600ff240 0x7fef600ff690 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.340+0000 7fef679af700 1 --2- 172.21.15.134:0/2328929422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef60100510 0x7fef60100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.340+0000 7fef679af700 1 -- 172.21.15.134:0/2328929422 >> 172.21.15.134:0/2328929422 conn(0x7fef600f9c60 msgr2=0x7fef600fc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.340+0000 7fef679af700 1 -- 172.21.15.134:0/2328929422 shutdown_connections 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.340+0000 7fef679af700 1 -- 172.21.15.134:0/2328929422 wait complete. 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef679af700 1 Processor -- start 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef679af700 1 -- start start 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef679af700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef600ff240 0x7fef60195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef679af700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef60100510 0x7fef60195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef679af700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef60196380 con 0x7fef60100510 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef679af700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef601964c0 con 0x7fef600ff240 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef64f4a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef60100510 0x7fef60195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef64f4a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef60100510 0x7fef60195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34388/0 (socket says 172.21.15.134:34388) 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef64f4a700 1 -- 172.21.15.134:0/1650538466 learned_addr learned my addr 172.21.15.134:0/1650538466 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:13.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef6574b700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef600ff240 0x7fef60195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:13.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef64f4a700 1 -- 172.21.15.134:0/1650538466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef600ff240 msgr2=0x7fef60195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef64f4a700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef600ff240 0x7fef60195820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.341+0000 7fef64f4a700 1 -- 172.21.15.134:0/1650538466 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0095f0 con 0x7fef60100510 2024-04-13T10:56:13.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.342+0000 7fef64f4a700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef60100510 0x7fef60195d60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b5c0 tx=0x7fef5c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:13.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.342+0000 7fef567fc700 1 -- 172.21.15.134:0/1650538466 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef5c01d070 con 0x7fef60100510 2024-04-13T10:56:13.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.342+0000 7fef567fc700 1 -- 172.21.15.134:0/1650538466 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fef5c00f460 con 0x7fef60100510 2024-04-13T10:56:13.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.342+0000 7fef567fc700 1 -- 172.21.15.134:0/1650538466 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef5c021640 con 0x7fef60100510 2024-04-13T10:56:13.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.342+0000 7fef679af700 1 -- 172.21.15.134:0/1650538466 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6019af00 con 0x7fef60100510 2024-04-13T10:56:13.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.342+0000 7fef679af700 1 -- 172.21.15.134:0/1650538466 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6019b400 con 0x7fef60100510 2024-04-13T10:56:13.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.343+0000 7fef679af700 1 -- 172.21.15.134:0/1650538466 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef60107990 con 0x7fef60100510 2024-04-13T10:56:13.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.343+0000 7fef567fc700 1 -- 172.21.15.134:0/1650538466 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fef5c00fa20 con 0x7fef60100510 2024-04-13T10:56:13.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.344+0000 7fef567fc700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef4c06c680 0x7fef4c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:13.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.344+0000 7fef567fc700 1 -- 172.21.15.134:0/1650538466 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fef5c08cff0 con 0x7fef60100510 2024-04-13T10:56:13.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.344+0000 7fef6574b700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef4c06c680 0x7fef4c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:13.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.344+0000 7fef6574b700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef4c06c680 0x7fef4c06eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fef50005950 tx=0x7fef500058e0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:13.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.348+0000 7fef567fc700 1 -- 172.21.15.134:0/1650538466 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fef5c05b120 con 0x7fef60100510 2024-04-13T10:56:13.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.561+0000 7fef679af700 1 -- 172.21.15.134:0/1650538466 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fef6019ba40 con 0x7fef60100510 2024-04-13T10:56:13.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.562+0000 7fef567fc700 1 -- 172.21.15.134:0/1650538466 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fef5c05acb0 con 0x7fef60100510 2024-04-13T10:56:13.561 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-04-13T10:56:13.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 -- 172.21.15.134:0/1650538466 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef4c06c680 msgr2=0x7fef4c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef4c06c680 0x7fef4c06eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fef50005950 tx=0x7fef500058e0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 -- 172.21.15.134:0/1650538466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef60100510 msgr2=0x7fef60195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef60100510 0x7fef60195d60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b5c0 tx=0x7fef5c00be20 comp rx=0 tx=0).stop 2024-04-13T10:56:13.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 -- 172.21.15.134:0/1650538466 shutdown_connections 2024-04-13T10:56:13.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fef4c06c680 0x7fef4c06eb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef600ff240 0x7fef60195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 --2- 172.21.15.134:0/1650538466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef60100510 0x7fef60195d60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 -- 172.21.15.134:0/1650538466 >> 172.21.15.134:0/1650538466 conn(0x7fef600f9c60 msgr2=0x7fef600fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:13.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 -- 172.21.15.134:0/1650538466 shutdown_connections 2024-04-13T10:56:13.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.564+0000 7fef679af700 1 -- 172.21.15.134:0/1650538466 wait complete. 2024-04-13T10:56:13.576 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:13 smithi134 ceph-mon[39696]: pgmap v206: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-13T10:56:13.576 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:13 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/758658244' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T10:56:13.577 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:13 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/4223224564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-13T10:56:13.577 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:13.577 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:56:13.578 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-13T10:56:13.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.713+0000 7fafd9465700 1 -- 172.21.15.134:0/1929252536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd4103170 msgr2=0x7fafd41055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.713+0000 7fafd9465700 1 --2- 172.21.15.134:0/1929252536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd4103170 0x7fafd41055f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009910 tx=0x7fafc8009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:13.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.713+0000 7fafd9465700 1 -- 172.21.15.134:0/1929252536 shutdown_connections 2024-04-13T10:56:13.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.713+0000 7fafd9465700 1 --2- 172.21.15.134:0/1929252536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd4103170 0x7fafd41055f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.713+0000 7fafd9465700 1 --2- 172.21.15.134:0/1929252536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd4069af0 0x7fafd4102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.713+0000 7fafd9465700 1 -- 172.21.15.134:0/1929252536 >> 172.21.15.134:0/1929252536 conn(0x7fafd40fa5c0 msgr2=0x7fafd40fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:13.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.713+0000 7fafd9465700 1 -- 172.21.15.134:0/1929252536 shutdown_connections 2024-04-13T10:56:13.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.713+0000 7fafd9465700 1 -- 172.21.15.134:0/1929252536 wait complete. 2024-04-13T10:56:13.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.714+0000 7fafd9465700 1 Processor -- start 2024-04-13T10:56:13.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.714+0000 7fafd9465700 1 -- start start 2024-04-13T10:56:13.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.714+0000 7fafd9465700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd4069af0 0x7fafd4195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:13.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.714+0000 7fafd9465700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd4103170 0x7fafd4195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:13.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd9465700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4196390 con 0x7fafd4069af0 2024-04-13T10:56:13.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd9465700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd41964d0 con 0x7fafd4103170 2024-04-13T10:56:13.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd4069af0 0x7fafd4195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd4069af0 0x7fafd4195830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34406/0 (socket says 172.21.15.134:34406) 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd2ffd700 1 -- 172.21.15.134:0/1178226138 learned_addr learned my addr 172.21.15.134:0/1178226138 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd27fc700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd4103170 0x7fafd4195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd2ffd700 1 -- 172.21.15.134:0/1178226138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd4103170 msgr2=0x7fafd4195d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd2ffd700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd4103170 0x7fafd4195d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd2ffd700 1 -- 172.21.15.134:0/1178226138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc80095f0 con 0x7fafd4069af0 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd2ffd700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd4069af0 0x7fafd4195830 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fafc400e8f0 tx=0x7fafc400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafbbfff700 1 -- 172.21.15.134:0/1178226138 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafc4009790 con 0x7fafd4069af0 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd9465700 1 -- 172.21.15.134:0/1178226138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd419af70 con 0x7fafd4069af0 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafbbfff700 1 -- 172.21.15.134:0/1178226138 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fafc4004e90 con 0x7fafd4069af0 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafd9465700 1 -- 172.21.15.134:0/1178226138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd419b4c0 con 0x7fafd4069af0 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.715+0000 7fafbbfff700 1 -- 172.21.15.134:0/1178226138 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafc40054d0 con 0x7fafd4069af0 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.716+0000 7fafd9465700 1 -- 172.21.15.134:0/1178226138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc0005310 con 0x7fafd4069af0 2024-04-13T10:56:13.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.717+0000 7fafbbfff700 1 -- 172.21.15.134:0/1178226138 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fafc400cc80 con 0x7fafd4069af0 2024-04-13T10:56:13.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.717+0000 7fafbbfff700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fafbc06c680 0x7fafbc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:13.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.717+0000 7fafbbfff700 1 -- 172.21.15.134:0/1178226138 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fafc4014070 con 0x7fafd4069af0 2024-04-13T10:56:13.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.717+0000 7fafd27fc700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fafbc06c680 0x7fafbc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:13.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.718+0000 7fafd27fc700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fafbc06c680 0x7fafbc06eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009fd0 tx=0x7fafc800b5a0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:13.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.722+0000 7fafbbfff700 1 -- 172.21.15.134:0/1178226138 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fafc4059df0 con 0x7fafd4069af0 2024-04-13T10:56:13.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:13 smithi194 ceph-mon[46737]: pgmap v206: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-13T10:56:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:13 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/758658244' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T10:56:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:13 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/4223224564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-13T10:56:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:56:13.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.915+0000 7fafd9465700 1 -- 172.21.15.134:0/1178226138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fafc0005f60 con 0x7fafd4069af0 2024-04-13T10:56:13.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.915+0000 7fafbbfff700 1 -- 172.21.15.134:0/1178226138 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fafc4059980 con 0x7fafd4069af0 2024-04-13T10:56:13.915 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-04-13T10:56:13.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.917+0000 7fafd9465700 1 -- 172.21.15.134:0/1178226138 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fafbc06c680 msgr2=0x7fafbc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.917+0000 7fafd9465700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fafbc06c680 0x7fafbc06eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009fd0 tx=0x7fafc800b5a0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.917+0000 7fafd9465700 1 -- 172.21.15.134:0/1178226138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd4069af0 msgr2=0x7fafd4195830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:13.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.917+0000 7fafd9465700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd4069af0 0x7fafd4195830 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fafc400e8f0 tx=0x7fafc400ec00 comp rx=0 tx=0).stop 2024-04-13T10:56:13.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.917+0000 7fafd9465700 1 -- 172.21.15.134:0/1178226138 shutdown_connections 2024-04-13T10:56:13.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.917+0000 7fafd9465700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fafbc06c680 0x7fafbc06eb30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.918+0000 7fafd9465700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd4069af0 0x7fafd4195830 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.918+0000 7fafd9465700 1 --2- 172.21.15.134:0/1178226138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafd4103170 0x7fafd4195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:13.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.918+0000 7fafd9465700 1 -- 172.21.15.134:0/1178226138 >> 172.21.15.134:0/1178226138 conn(0x7fafd40fa5c0 msgr2=0x7fafd40fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:13.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.918+0000 7fafd9465700 1 -- 172.21.15.134:0/1178226138 shutdown_connections 2024-04-13T10:56:13.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:13.918+0000 7fafd9465700 1 -- 172.21.15.134:0/1178226138 wait complete. 2024-04-13T10:56:13.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T10:56:14.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.051+0000 7f2aaa26c700 1 -- 172.21.15.134:0/3818555650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa4100090 msgr2=0x7f2aa41004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:14.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.051+0000 7f2aaa26c700 1 --2- 172.21.15.134:0/3818555650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa4100090 0x7f2aa41004a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009910 tx=0x7f2a94009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:14.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.051+0000 7f2aaa26c700 1 -- 172.21.15.134:0/3818555650 shutdown_connections 2024-04-13T10:56:14.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.051+0000 7f2aaa26c700 1 --2- 172.21.15.134:0/3818555650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4101280 0x7f2aa41016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:14.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.051+0000 7f2aaa26c700 1 --2- 172.21.15.134:0/3818555650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa4100090 0x7f2aa41004a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:14.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.051+0000 7f2aaa26c700 1 -- 172.21.15.134:0/3818555650 >> 172.21.15.134:0/3818555650 conn(0x7f2aa40fb610 msgr2=0x7f2aa40fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:14.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.051+0000 7f2aaa26c700 1 -- 172.21.15.134:0/3818555650 shutdown_connections 2024-04-13T10:56:14.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.051+0000 7f2aaa26c700 1 -- 172.21.15.134:0/3818555650 wait complete. 2024-04-13T10:56:14.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.052+0000 7f2aaa26c700 1 Processor -- start 2024-04-13T10:56:14.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.052+0000 7f2aaa26c700 1 -- start start 2024-04-13T10:56:14.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.052+0000 7f2aaa26c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4100090 0x7f2aa4195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:14.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.052+0000 7f2aaa26c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa4101280 0x7f2aa4195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:14.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.052+0000 7f2aaa26c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4196260 con 0x7f2aa4101280 2024-04-13T10:56:14.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.052+0000 7f2aaa26c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa41963a0 con 0x7f2aa4100090 2024-04-13T10:56:14.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa4101280 0x7f2aa4195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:14.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa4101280 0x7f2aa4195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34424/0 (socket says 172.21.15.134:34424) 2024-04-13T10:56:14.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa37fe700 1 -- 172.21.15.134:0/2085418302 learned_addr learned my addr 172.21.15.134:0/2085418302 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa3fff700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4100090 0x7f2aa4195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa37fe700 1 -- 172.21.15.134:0/2085418302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4100090 msgr2=0x7f2aa4195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa37fe700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4100090 0x7f2aa4195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa37fe700 1 -- 172.21.15.134:0/2085418302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a940095f0 con 0x7f2aa4101280 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa37fe700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa4101280 0x7f2aa4195c40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800c8a0 tx=0x7f2a9800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa17fa700 1 -- 172.21.15.134:0/2085418302 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a9800cea0 con 0x7f2aa4101280 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa17fa700 1 -- 172.21.15.134:0/2085418302 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f2a98004830 con 0x7f2aa4101280 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aaa26c700 1 -- 172.21.15.134:0/2085418302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa419ae40 con 0x7f2aa4101280 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aa17fa700 1 -- 172.21.15.134:0/2085418302 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a98005540 con 0x7f2aa4101280 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.053+0000 7f2aaa26c700 1 -- 172.21.15.134:0/2085418302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa419b3f0 con 0x7f2aa4101280 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.054+0000 7f2aaa26c700 1 -- 172.21.15.134:0/2085418302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa4108a90 con 0x7f2aa4101280 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.055+0000 7f2aa17fa700 1 -- 172.21.15.134:0/2085418302 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f2a980049a0 con 0x7f2aa4101280 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.055+0000 7f2aa17fa700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2a8c06c740 0x7f2a8c06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:14.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.055+0000 7f2aa17fa700 1 -- 172.21.15.134:0/2085418302 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2a9808b4a0 con 0x7f2aa4101280 2024-04-13T10:56:14.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.055+0000 7f2aa3fff700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2a8c06c740 0x7f2a8c06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:14.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.056+0000 7f2aa3fff700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2a8c06c740 0x7f2a8c06ebf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a94006010 tx=0x7f2a94005920 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:14.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.059+0000 7f2aa17fa700 1 -- 172.21.15.134:0/2085418302 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2a98059630 con 0x7f2aa4101280 2024-04-13T10:56:14.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.290+0000 7f2aaa26c700 1 -- 172.21.15.134:0/2085418302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2aa4108c50 con 0x7f2aa4101280 2024-04-13T10:56:14.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.290+0000 7f2aa17fa700 1 -- 172.21.15.134:0/2085418302 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4759 (secure 0 0 0) 0x7f2a980591c0 con 0x7f2aa4101280 2024-04-13T10:56:14.290 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T10:56:14.290 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/3497839686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3497839686},{"type":"v1","addr":"172.21.15.194:6825","nonce":3497839686}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T10:55:58.861624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14492":{"gid":14492,"name":"cephfs.smithi134.kachce","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6829/3278328584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3278328584},{"type":"v1","addr":"172.21.15.134:6829","nonce":3278328584}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14508":{"gid":14508,"name":"cephfs.smithi134.hxpcfx","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6827/2714299924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2714299924},{"type":"v1","addr":"172.21.15.134:6827","nonce":2714299924}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T10:56:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.292+0000 7f2aaa26c700 1 -- 172.21.15.134:0/2085418302 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2a8c06c740 msgr2=0x7f2a8c06ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.292+0000 7f2aaa26c700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2a8c06c740 0x7f2a8c06ebf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a94006010 tx=0x7f2a94005920 comp rx=0 tx=0).stop 2024-04-13T10:56:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.292+0000 7f2aaa26c700 1 -- 172.21.15.134:0/2085418302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa4101280 msgr2=0x7f2aa4195c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.292+0000 7f2aaa26c700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa4101280 0x7f2aa4195c40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800c8a0 tx=0x7f2a9800cc60 comp rx=0 tx=0).stop 2024-04-13T10:56:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.292+0000 7f2aaa26c700 1 -- 172.21.15.134:0/2085418302 shutdown_connections 2024-04-13T10:56:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.292+0000 7f2aaa26c700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f2a8c06c740 0x7f2a8c06ebf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.292+0000 7f2aaa26c700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4100090 0x7f2aa4195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:14.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.292+0000 7f2aaa26c700 1 --2- 172.21.15.134:0/2085418302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa4101280 0x7f2aa4195c40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:14.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.293+0000 7f2aaa26c700 1 -- 172.21.15.134:0/2085418302 >> 172.21.15.134:0/2085418302 conn(0x7f2aa40fb610 msgr2=0x7f2aa40fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:14.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.293+0000 7f2aaa26c700 1 -- 172.21.15.134:0/2085418302 shutdown_connections 2024-04-13T10:56:14.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:14.293+0000 7f2aaa26c700 1 -- 172.21.15.134:0/2085418302 wait complete. 2024-04-13T10:56:14.293 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T10:56:14.305 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 1, 'flags': 50} 2024-04-13T10:56:14.305 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-13T10:56:14.429 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-13T10:56:14.429 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-13T10:56:14.429 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-13T10:56:14.429 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-13T10:56:14.429 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-13T10:56:14.429 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-13T10:56:14.429 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-13T10:56:14.429 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-13T10:56:14.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:14.430 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-04-13T10:56:14.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:14.454 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-04-13T10:56:14.531 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-04-13T10:56:14.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T10:56:14.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:14.533 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-13T10:56:14.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:14.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-04-13T10:56:14.617 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:14 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1650538466' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-13T10:56:14.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:14 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:14.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:14 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:14.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:14 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:56:14.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:14 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:56:14.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:14 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:14.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:14 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1178226138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-13T10:56:14.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:14 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2085418302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-13T10:56:14.623 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-04-13T10:56:14.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T10:56:14.624 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-13T10:56:14.624 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph fs ls 2024-04-13T10:56:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:14 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/1650538466' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-13T10:56:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:14 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:14 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:14 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:56:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:14 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:56:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:14 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:56:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:14 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/1178226138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-13T10:56:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:14 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/2085418302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-13T10:56:14.889 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:56:15.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:15 smithi134 ceph-mon[39696]: pgmap v207: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-13T10:56:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:15 smithi194 ceph-mon[46737]: pgmap v207: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.813+0000 7fe8a73f3700 1 -- 172.21.15.134:0/1024118791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8a01003a0 msgr2=0x7fe8a0100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.813+0000 7fe8a73f3700 1 --2- 172.21.15.134:0/1024118791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8a01003a0 0x7fe8a0100770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe894009910 tx=0x7fe894009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.813+0000 7fe8a73f3700 1 -- 172.21.15.134:0/1024118791 shutdown_connections 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.813+0000 7fe8a73f3700 1 --2- 172.21.15.134:0/1024118791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a0100cb0 0x7fe8a0109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.813+0000 7fe8a73f3700 1 --2- 172.21.15.134:0/1024118791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8a01003a0 0x7fe8a0100770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.813+0000 7fe8a73f3700 1 -- 172.21.15.134:0/1024118791 >> 172.21.15.134:0/1024118791 conn(0x7fe8a0074850 msgr2=0x7fe8a0074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.814+0000 7fe8a73f3700 1 -- 172.21.15.134:0/1024118791 shutdown_connections 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.814+0000 7fe8a73f3700 1 -- 172.21.15.134:0/1024118791 wait complete. 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.814+0000 7fe8a73f3700 1 Processor -- start 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.814+0000 7fe8a73f3700 1 -- start start 2024-04-13T10:56:16.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.814+0000 7fe8a73f3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a01003a0 0x7fe8a0196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.814+0000 7fe8a73f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8a0100cb0 0x7fe8a01970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.814+0000 7fe8a73f3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a01976f0 con 0x7fe8a0100cb0 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.814+0000 7fe8a73f3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0197860 con 0x7fe8a01003a0 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.814+0000 7fe8a498e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8a0100cb0 0x7fe8a01970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.814+0000 7fe8a498e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8a0100cb0 0x7fe8a01970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34440/0 (socket says 172.21.15.134:34440) 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8a498e700 1 -- 172.21.15.134:0/990136828 learned_addr learned my addr 172.21.15.134:0/990136828 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8a518f700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a01003a0 0x7fe8a0196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8a498e700 1 -- 172.21.15.134:0/990136828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a01003a0 msgr2=0x7fe8a0196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8a498e700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a01003a0 0x7fe8a0196b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8a498e700 1 -- 172.21.15.134:0/990136828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940095f0 con 0x7fe8a0100cb0 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8a498e700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8a0100cb0 0x7fe8a01970d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00b4b0 tx=0x7fe89c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8927fc700 1 -- 172.21.15.134:0/990136828 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89c011800 con 0x7fe8a0100cb0 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8a73f3700 1 -- 172.21.15.134:0/990136828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a019fc00 con 0x7fe8a0100cb0 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8927fc700 1 -- 172.21.15.134:0/990136828 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fe89c011df0 con 0x7fe8a0100cb0 2024-04-13T10:56:16.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8927fc700 1 -- 172.21.15.134:0/990136828 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89c010e50 con 0x7fe8a0100cb0 2024-04-13T10:56:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.815+0000 7fe8a73f3700 1 -- 172.21.15.134:0/990136828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a01a00f0 con 0x7fe8a0100cb0 2024-04-13T10:56:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.816+0000 7fe8a73f3700 1 -- 172.21.15.134:0/990136828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a0106b10 con 0x7fe8a0100cb0 2024-04-13T10:56:16.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.816+0000 7fe8927fc700 1 -- 172.21.15.134:0/990136828 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fe89c010380 con 0x7fe8a0100cb0 2024-04-13T10:56:16.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.817+0000 7fe8927fc700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe88c06c680 0x7fe88c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:16.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.817+0000 7fe8927fc700 1 -- 172.21.15.134:0/990136828 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe89c08b3a0 con 0x7fe8a0100cb0 2024-04-13T10:56:16.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.817+0000 7fe8a518f700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe88c06c680 0x7fe88c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:16.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.817+0000 7fe8a518f700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe88c06c680 0x7fe88c06eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe894006010 tx=0x7fe89401a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:16.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:16.821+0000 7fe8927fc700 1 -- 172.21.15.134:0/990136828 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe89c055a20 con 0x7fe8a0100cb0 2024-04-13T10:56:17.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.055+0000 7fe8a73f3700 1 -- 172.21.15.134:0/990136828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe8a004ea50 con 0x7fe8a0100cb0 2024-04-13T10:56:17.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.056+0000 7fe8927fc700 1 -- 172.21.15.134:0/990136828 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7fe89c059040 con 0x7fe8a0100cb0 2024-04-13T10:56:17.056 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-13T10:56:17.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 -- 172.21.15.134:0/990136828 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe88c06c680 msgr2=0x7fe88c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:17.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe88c06c680 0x7fe88c06eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe894006010 tx=0x7fe89401a040 comp rx=0 tx=0).stop 2024-04-13T10:56:17.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 -- 172.21.15.134:0/990136828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8a0100cb0 msgr2=0x7fe8a01970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:17.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8a0100cb0 0x7fe8a01970d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00b4b0 tx=0x7fe89c00b7c0 comp rx=0 tx=0).stop 2024-04-13T10:56:17.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 -- 172.21.15.134:0/990136828 shutdown_connections 2024-04-13T10:56:17.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe88c06c680 0x7fe88c06eb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:17.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8a01003a0 0x7fe8a0196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:17.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 --2- 172.21.15.134:0/990136828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8a0100cb0 0x7fe8a01970d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:17.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 -- 172.21.15.134:0/990136828 >> 172.21.15.134:0/990136828 conn(0x7fe8a0074850 msgr2=0x7fe8a0103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:17.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 -- 172.21.15.134:0/990136828 shutdown_connections 2024-04-13T10:56:17.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:17.058+0000 7fe8a73f3700 1 -- 172.21.15.134:0/990136828 wait complete. 2024-04-13T10:56:17.915 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:17 smithi134 ceph-mon[39696]: pgmap v208: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-13T10:56:17.915 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:17 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/990136828' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-13T10:56:17.934 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-13T10:56:17.934 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-13T10:56:17.934 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-04-13T10:56:17.934 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-13T10:56:17.934 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-13T10:56:17.934 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-13T10:56:17.935 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-13T10:56:17.935 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-13T10:56:17.935 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-13T10:56:17.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:17.935 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-04-13T10:56:17.955 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T10:56:17.955 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T10:56:17.955 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T10:56:17.955 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-13T10:56:17.955 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-04-13T10:56:17.955 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-13T10:56:17.955 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T10:56:17.955 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-04-13T10:56:17.955 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-04-13T10:56:17.955 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T10:56:17.956 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-04-13T10:56:17.956 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-04-13T10:56:17.956 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T10:56:17.956 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-04-13T10:56:17.956 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-13T10:56:17.956 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-04-13T10:56:17.956 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-13T10:56:17.956 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42107sec preferred_lft 42107sec 2024-04-13T10:56:17.956 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-04-13T10:56:17.956 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-13T10:56:17.957 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-13T10:56:17.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:17.957 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-04-13T10:56:17.957 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-13T10:56:17.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-04-13T10:56:17.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-04-13T10:56:17.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-04-13T10:56:17.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-13T10:56:17.957 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-13T10:56:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:17 smithi194 ceph-mon[46737]: pgmap v208: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-13T10:56:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:17 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/990136828' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-13T10:56:18.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:18.114 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-13T10:56:18.142 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-13T10:56:18.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:18.144 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-04-13T10:56:18.222 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-04-13T10:56:18.223 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-13T10:56:18.223 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-13T10:56:18.223 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-13T10:56:18.223 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-13T10:56:18.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:18.224 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-04-13T10:56:18.224 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-13T10:56:18.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-13T10:56:18.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-13T10:56:18.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-13T10:56:18.225 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-13T10:56:18.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:18.524 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-13T10:56:18.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:18.543 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-04-13T10:56:18.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:18.600 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-04-13T10:56:18.600 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-13T10:56:18.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-13T10:56:18.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-13T10:56:18.600 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-13T10:56:18.696 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-13T10:56:18.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:18.696 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-04-13T10:56:18.696 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-13T10:56:18.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-13T10:56:18.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-13T10:56:18.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-13T10:56:18.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-13T10:56:18.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-13T10:56:18.696 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-13T10:56:18.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:18.910 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-04-13T10:56:18.910 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-13T10:56:18.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-04-13T10:56:18.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-04-13T10:56:18.911 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-13T10:56:19.007 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-13T10:56:19.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T10:56:19.008 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-13T10:56:19.026 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-13T10:56:19.027 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T10:56:19.027 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-13T10:56:19.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-04-13T10:56:19.154 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-13T10:56:19.154 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-13T10:56:19.221 INFO:teuthology.orchestra.run.smithi134.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-13T10:56:19.222 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-13T10:56:19.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:19.222 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-04-13T10:56:19.280 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-13T10:56:19.280 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-13T10:56:19.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-04-13T10:56:19.349 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-13T10:56:19.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-13T10:56:19.416 INFO:teuthology.orchestra.run.smithi134.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-13T10:56:19.417 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-13T10:56:19.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:19.418 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-04-13T10:56:19.431 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi134.stderr:2024-04-13T10:56:19.431+0000 7f0786d255c0 -1 init, newargv = 0x564019939d50 newargc=15 2024-04-13T10:56:19.431 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi134.stderr:ceph-fuse[86231]: starting ceph client 2024-04-13T10:56:19.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi134.stderr:ceph-fuse[86231]: starting fuse 2024-04-13T10:56:19.449 INFO:teuthology.orchestra.run.smithi134.stdout:173 2024-04-13T10:56:19.449 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [173] 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> import glob 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> import re 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> import os 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> import subprocess 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> def _find_admin_socket(client_name): 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> files = glob.glob(asok_path) 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> 2024-04-13T10:56:19.450 DEBUG:teuthology.orchestra.run.smithi134:> # Given a non-glob path, it better be there 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> if "*" not in asok_path: 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> assert(len(files) == 1) 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> return files[0] 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> for f in files: 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> contents = proc_f.read() 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> if mountpoint in contents: 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> return f 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> print(_find_admin_socket("client.0")) 2024-04-13T10:56:19.451 DEBUG:teuthology.orchestra.run.smithi134:> ' 2024-04-13T10:56:19.573 INFO:teuthology.orchestra.run.smithi134.stdout:/var/run/ceph/ceph-client.0.86231.asok 2024-04-13T10:56:19.755 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.86231.asok 2024-04-13T10:56:19.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:19.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.86231.asok status 2024-04-13T10:56:19.820 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:19 smithi134 ceph-mon[39696]: pgmap v209: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:56:19.914 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:56:19.914 INFO:teuthology.orchestra.run.smithi134.stdout: "metadata": { 2024-04-13T10:56:19.914 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-04-13T10:56:19.914 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "entity_id": "0", 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "hostname": "smithi134", 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "pid": "86231", 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "root": "/" 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "dentry_count": 0, 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "dentry_pinned_count": 0, 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 14552, 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "inst": { 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "name": { 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client", 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: "num": 14552 2024-04-13T10:56:19.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": { 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "192.168.0.1:0", 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1312131006 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": { 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "192.168.0.1:0", 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 1312131006 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "inst_str": "client.14552 192.168.0.1:0/1312131006", 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "addr_str": "192.168.0.1:0/1312131006", 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "inode_count": 1, 2024-04-13T10:56:19.916 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_epoch": 18, 2024-04-13T10:56:19.917 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_epoch": 46, 2024-04-13T10:56:19.917 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_epoch_barrier": 0, 2024-04-13T10:56:19.917 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklisted": false, 2024-04-13T10:56:19.917 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs" 2024-04-13T10:56:19.917 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:56:19.925 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- ceph fs ls 2024-04-13T10:56:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:19 smithi194 ceph-mon[46737]: pgmap v209: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:56:20.191 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:56:21.873 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:21 smithi134 ceph-mon[39696]: pgmap v210: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:56:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:21 smithi194 ceph-mon[46737]: pgmap v210: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:56:22.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.099+0000 7f9e60e7c700 1 -- 172.21.15.134:0/3442766993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e5c0ff2c0 msgr2=0x7f9e5c0ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.099+0000 7f9e60e7c700 1 --2- 172.21.15.134:0/3442766993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e5c0ff2c0 0x7f9e5c0ff690 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400b0a0 tx=0x7f9e5400b3b0 comp rx=0 tx=0).stop 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.099+0000 7f9e60e7c700 1 -- 172.21.15.134:0/3442766993 shutdown_connections 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.099+0000 7f9e60e7c700 1 --2- 172.21.15.134:0/3442766993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.099+0000 7f9e60e7c700 1 --2- 172.21.15.134:0/3442766993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e5c0ff2c0 0x7f9e5c0ff690 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.099+0000 7f9e60e7c700 1 -- 172.21.15.134:0/3442766993 >> 172.21.15.134:0/3442766993 conn(0x7f9e5c0fab80 msgr2=0x7f9e5c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.099+0000 7f9e60e7c700 1 -- 172.21.15.134:0/3442766993 shutdown_connections 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.099+0000 7f9e60e7c700 1 -- 172.21.15.134:0/3442766993 wait complete. 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e60e7c700 1 Processor -- start 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e60e7c700 1 -- start start 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e60e7c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e5c0ff2c0 0x7f9e5c195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:22.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e60e7c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e60e7c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c1969f0 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e60e7c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c19a780 con 0x7f9e5c0ffc60 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e5a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e5c0ff2c0 0x7f9e5c195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e5a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e5c0ff2c0 0x7f9e5c195dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41066/0 (socket says 172.21.15.134:41066) 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e5a59c700 1 -- 172.21.15.134:0/4173308323 learned_addr learned my addr 172.21.15.134:0/4173308323 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e59d9b700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e5a59c700 1 -- 172.21.15.134:0/4173308323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e5c0ffc60 msgr2=0x7f9e5c196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e5a59c700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e5a59c700 1 -- 172.21.15.134:0/4173308323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54009d00 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.100+0000 7f9e5a59c700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e5c0ff2c0 0x7f9e5c195dd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9e54000f80 tx=0x7f9e5400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.101+0000 7f9e4b7fe700 1 -- 172.21.15.134:0/4173308323 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e5400e040 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.101+0000 7f9e60e7c700 1 -- 172.21.15.134:0/4173308323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5c19aa00 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.101+0000 7f9e4b7fe700 1 -- 172.21.15.134:0/4173308323 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f9e54003de0 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.101+0000 7f9e4b7fe700 1 -- 172.21.15.134:0/4173308323 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e5401d7c0 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.101+0000 7f9e60e7c700 1 -- 172.21.15.134:0/4173308323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5c19aef0 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.102+0000 7f9e60e7c700 1 -- 172.21.15.134:0/4173308323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5c04ea50 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.102+0000 7f9e4b7fe700 1 -- 172.21.15.134:0/4173308323 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f9e54019070 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.102+0000 7f9e4b7fe700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9e4406c680 0x7f9e4406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:22.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.103+0000 7f9e59d9b700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9e4406c680 0x7f9e4406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:22.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.103+0000 7f9e4b7fe700 1 -- 172.21.15.134:0/4173308323 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9e5408cfa0 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.103+0000 7f9e59d9b700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9e4406c680 0x7f9e4406eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e50006fd0 tx=0x7f9e50008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:22.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.107+0000 7f9e4b7fe700 1 -- 172.21.15.134:0/4173308323 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9e54057620 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.337+0000 7f9e60e7c700 1 -- 172.21.15.134:0/4173308323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e5c19b210 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.338+0000 7f9e4b7fe700 1 -- 172.21.15.134:0/4173308323 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7f9e5405ac40 con 0x7f9e5c0ff2c0 2024-04-13T10:56:22.339 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-13T10:56:22.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 -- 172.21.15.134:0/4173308323 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9e4406c680 msgr2=0x7f9e4406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:22.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9e4406c680 0x7f9e4406eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e50006fd0 tx=0x7f9e50008040 comp rx=0 tx=0).stop 2024-04-13T10:56:22.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 -- 172.21.15.134:0/4173308323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e5c0ff2c0 msgr2=0x7f9e5c195dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:22.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e5c0ff2c0 0x7f9e5c195dd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9e54000f80 tx=0x7f9e5400bdc0 comp rx=0 tx=0).stop 2024-04-13T10:56:22.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 -- 172.21.15.134:0/4173308323 shutdown_connections 2024-04-13T10:56:22.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f9e4406c680 0x7f9e4406eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:22.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e5c0ff2c0 0x7f9e5c195dd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:22.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 --2- 172.21.15.134:0/4173308323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:22.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 -- 172.21.15.134:0/4173308323 >> 172.21.15.134:0/4173308323 conn(0x7f9e5c0fab80 msgr2=0x7f9e5c0fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:22.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 -- 172.21.15.134:0/4173308323 shutdown_connections 2024-04-13T10:56:22.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:22.340+0000 7f9e60e7c700 1 -- 172.21.15.134:0/4173308323 wait complete. 2024-04-13T10:56:22.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:22 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/4173308323' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-13T10:56:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:22 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/4173308323' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-13T10:56:23.140 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-13T10:56:23.140 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-13T10:56:23.140 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-04-13T10:56:23.140 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-13T10:56:23.140 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-13T10:56:23.140 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-13T10:56:23.140 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-13T10:56:23.140 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-13T10:56:23.140 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-13T10:56:23.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:23.141 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-04-13T10:56:23.166 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T10:56:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T10:56:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T10:56:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-13T10:56:23.166 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42097sec preferred_lft 42097sec 2024-04-13T10:56:23.167 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2024-04-13T10:56:23.168 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-04-13T10:56:23.168 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-13T10:56:23.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:23.168 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-13T10:56:23.168 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-13T10:56:23.168 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add name ceph-brx type bridge 2024-04-13T10:56:23.168 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr flush dev ceph-brx 2024-04-13T10:56:23.168 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set ceph-brx up 2024-04-13T10:56:23.168 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-13T10:56:23.169 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-13T10:56:23.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:23.345 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-13T10:56:23.372 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-04-13T10:56:23.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:23.374 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-04-13T10:56:23.454 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-04-13T10:56:23.454 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-13T10:56:23.454 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-13T10:56:23.454 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-13T10:56:23.455 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-13T10:56:23.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:23.455 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-13T10:56:23.455 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-13T10:56:23.455 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-13T10:56:23.455 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-13T10:56:23.455 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-13T10:56:23.455 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-13T10:56:23.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:23.734 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-04-13T10:56:23.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:23.752 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2024-04-13T10:56:23.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:23.810 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-13T10:56:23.810 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-13T10:56:23.810 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-13T10:56:23.810 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-13T10:56:23.810 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-13T10:56:23.889 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:23 smithi194 ceph-mon[46737]: pgmap v211: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:56:23.906 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-13T10:56:23.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:23.906 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-13T10:56:23.906 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-13T10:56:23.906 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-13T10:56:23.906 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-13T10:56:23.906 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-13T10:56:23.906 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-13T10:56:23.907 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-13T10:56:23.907 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-13T10:56:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:23 smithi134 ceph-mon[39696]: pgmap v211: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:56:24.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:24.150 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-04-13T10:56:24.150 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-04-13T10:56:24.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-04-13T10:56:24.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.0 master ceph-brx 2024-04-13T10:56:24.150 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-04-13T10:56:24.247 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-13T10:56:24.247 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T10:56:24.247 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-13T10:56:24.265 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-13T10:56:24.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T10:56:24.266 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-13T10:56:24.323 DEBUG:teuthology.orchestra.run.smithi194:> sudo modprobe fuse 2024-04-13T10:56:24.391 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-13T10:56:24.391 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-13T10:56:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-13T10:56:24.459 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-13T10:56:24.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:24.459 DEBUG:teuthology.orchestra.run.smithi194:> ls /sys/fs/fuse/connections 2024-04-13T10:56:24.517 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-13T10:56:24.517 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-13T10:56:24.560 DEBUG:teuthology.orchestra.run.smithi194:> sudo modprobe fuse 2024-04-13T10:56:24.588 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-13T10:56:24.588 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-13T10:56:24.655 INFO:teuthology.orchestra.run.smithi194.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-13T10:56:24.656 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-13T10:56:24.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:24.656 DEBUG:teuthology.orchestra.run.smithi194:> ls /sys/fs/fuse/connections 2024-04-13T10:56:24.661 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi194.stderr:2024-04-13T10:56:24.661+0000 7fa544d095c0 -1 init, newargv = 0x55e59899ae70 newargc=15 2024-04-13T10:56:24.661 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi194.stderr:ceph-fuse[69968]: starting ceph client 2024-04-13T10:56:24.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi194.stderr:ceph-fuse[69968]: starting fuse 2024-04-13T10:56:24.679 INFO:teuthology.orchestra.run.smithi194.stdout:137 2024-04-13T10:56:24.679 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [137] 2024-04-13T10:56:24.679 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> import glob 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> import re 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> import os 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> import subprocess 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> def _find_admin_socket(client_name): 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> files = glob.glob(asok_path) 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> # Given a non-glob path, it better be there 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> if "*" not in asok_path: 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> assert(len(files) == 1) 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> return files[0] 2024-04-13T10:56:24.680 DEBUG:teuthology.orchestra.run.smithi194:> 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> for f in files: 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> contents = proc_f.read() 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> if mountpoint in contents: 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> return f 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> print(_find_admin_socket("client.1")) 2024-04-13T10:56:24.681 DEBUG:teuthology.orchestra.run.smithi194:> ' 2024-04-13T10:56:24.802 INFO:teuthology.orchestra.run.smithi194.stdout:/var/run/ceph/ceph-client.1.69968.asok 2024-04-13T10:56:24.984 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.69968.asok 2024-04-13T10:56:24.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:24.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.69968.asok status 2024-04-13T10:56:25.141 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-04-13T10:56:25.141 INFO:teuthology.orchestra.run.smithi194.stdout: "metadata": { 2024-04-13T10:56:25.141 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "entity_id": "1", 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "hostname": "smithi194", 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "pid": "69968", 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "root": "/" 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "dentry_count": 0, 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "dentry_pinned_count": 0, 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "id": 24309, 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "inst": { 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "name": { 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "client", 2024-04-13T10:56:25.142 INFO:teuthology.orchestra.run.smithi194.stdout: "num": 24309 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": { 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "v1", 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": "192.168.0.1:0", 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "nonce": 2362139874 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": { 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "v1", 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": "192.168.0.1:0", 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "nonce": 2362139874 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "inst_str": "client.24309 192.168.0.1:0/2362139874", 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "addr_str": "192.168.0.1:0/2362139874", 2024-04-13T10:56:25.143 INFO:teuthology.orchestra.run.smithi194.stdout: "inode_count": 1, 2024-04-13T10:56:25.144 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_epoch": 18, 2024-04-13T10:56:25.144 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_epoch": 46, 2024-04-13T10:56:25.144 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_epoch_barrier": 0, 2024-04-13T10:56:25.144 INFO:teuthology.orchestra.run.smithi194.stdout: "blocklisted": false, 2024-04-13T10:56:25.144 INFO:teuthology.orchestra.run.smithi194.stdout: "fs_name": "cephfs" 2024-04-13T10:56:25.144 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-04-13T10:56:25.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:25.152 DEBUG:teuthology.orchestra.run.smithi134:> stat --file-system '--printf=%T 2024-04-13T10:56:25.152 DEBUG:teuthology.orchestra.run.smithi134:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-13T10:56:25.181 INFO:teuthology.orchestra.run.smithi134.stdout:fuseblk 2024-04-13T10:56:25.181 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-13T10:56:25.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:25.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-13T10:56:25.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:25.257 DEBUG:teuthology.orchestra.run.smithi194:> stat --file-system '--printf=%T 2024-04-13T10:56:25.257 DEBUG:teuthology.orchestra.run.smithi194:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-13T10:56:25.275 INFO:teuthology.orchestra.run.smithi194.stdout:fuseblk 2024-04-13T10:56:25.275 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-13T10:56:25.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T10:56:25.275 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-13T10:56:25.345 INFO:teuthology.run_tasks:Running task print... 2024-04-13T10:56:25.356 INFO:teuthology.task.print:**** done client 2024-04-13T10:56:25.356 INFO:teuthology.run_tasks:Running task parallel... 2024-04-13T10:56:25.402 INFO:teuthology.task.parallel:starting parallel... 2024-04-13T10:56:25.403 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-13T10:56:25.403 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-13T10:56:25.404 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T10:56:25.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-13T10:56:25.404 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-13T10:56:25.404 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-13T10:56:25.437 INFO:tasks.workunit:Pulling workunits from ref d540ebaca6b131a1dd560e7f69e024b133bbaa42 2024-04-13T10:56:25.438 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-13T10:56:25.438 INFO:tasks.workunit:timeout=3h 2024-04-13T10:56:25.438 INFO:tasks.workunit:cleanup=True 2024-04-13T10:56:25.438 DEBUG:teuthology.orchestra.run.smithi134:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-13T10:56:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-13T10:56:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-13T10:56:25.458 INFO:teuthology.orchestra.run.smithi134.stdout:Device: adh/173d Inode: 1 Links: 2 2024-04-13T10:56:25.458 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T10:56:25.458 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-13T10:56:25.458 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-13T10:56:25.459 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-13 10:55:44.699287923 +0000 2024-04-13T10:56:25.459 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-13 10:56:25.254838469 +0000 2024-04-13T10:56:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-13T10:56:25.459 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-13T10:56:25.459 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-13T10:56:25.531 DEBUG:teuthology.orchestra.run.smithi194:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-13T10:56:25.551 INFO:teuthology.orchestra.run.smithi194.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-13T10:56:25.551 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-13T10:56:25.551 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 89h/137d Inode: 1 Links: 3 2024-04-13T10:56:25.551 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T10:56:25.551 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-13T10:56:25.551 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-13T10:56:25.551 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-04-13 10:56:25.525454877 +0000 2024-04-13T10:56:25.551 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-04-13 10:56:25.525454877 +0000 2024-04-13T10:56:25.551 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-04-13T10:56:25.551 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-13T10:56:25.552 DEBUG:teuthology.orchestra.run.smithi194:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-13T10:56:25.624 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d540ebaca6b131a1dd560e7f69e024b133bbaa42 2024-04-13T10:56:25.624 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout d540ebaca6b131a1dd560e7f69e024b133bbaa42 2024-04-13T10:56:25.643 INFO:tasks.workunit.client.0.smithi134.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-13T10:56:25.673 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:56:25.682 INFO:tasks.workunit.client.1.smithi194.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-13T10:56:25.869 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:25 smithi134 ceph-mon[39696]: pgmap v212: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-13T10:56:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:25 smithi194 ceph-mon[46737]: pgmap v212: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-13T10:56:27.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.648+0000 7fcd31663700 1 -- 172.21.15.134:0/3978953508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd2c101370 msgr2=0x7fcd2c1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:27.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.648+0000 7fcd31663700 1 --2- 172.21.15.134:0/3978953508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd2c101370 0x7fcd2c1017c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009910 tx=0x7fcd1c009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:27.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.648+0000 7fcd31663700 1 -- 172.21.15.134:0/3978953508 shutdown_connections 2024-04-13T10:56:27.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.648+0000 7fcd31663700 1 --2- 172.21.15.134:0/3978953508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd2c101370 0x7fcd2c1017c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:27.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.648+0000 7fcd31663700 1 --2- 172.21.15.134:0/3978953508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c100170 0x7fcd2c100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:27.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.648+0000 7fcd31663700 1 -- 172.21.15.134:0/3978953508 >> 172.21.15.134:0/3978953508 conn(0x7fcd2c0fb720 msgr2=0x7fcd2c0fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:27.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.648+0000 7fcd31663700 1 -- 172.21.15.134:0/3978953508 shutdown_connections 2024-04-13T10:56:27.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.648+0000 7fcd31663700 1 -- 172.21.15.134:0/3978953508 wait complete. 2024-04-13T10:56:27.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd31663700 1 Processor -- start 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd31663700 1 -- start start 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd31663700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd2c100170 0x7fcd2c195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd31663700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c196020 0x7fcd2c19b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd31663700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c196520 con 0x7fcd2c100170 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd31663700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c196690 con 0x7fcd2c196020 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd2affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd2c100170 0x7fcd2c195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd2affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd2c100170 0x7fcd2c195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41098/0 (socket says 172.21.15.134:41098) 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd2affd700 1 -- 172.21.15.134:0/310486959 learned_addr learned my addr 172.21.15.134:0/310486959 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd2affd700 1 -- 172.21.15.134:0/310486959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c196020 msgr2=0x7fcd2c19b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd2affd700 1 --2- 172.21.15.134:0/310486959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c196020 0x7fcd2c19b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:27.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.649+0000 7fcd2affd700 1 -- 172.21.15.134:0/310486959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c0095f0 con 0x7fcd2c100170 2024-04-13T10:56:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.650+0000 7fcd2affd700 1 --2- 172.21.15.134:0/310486959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd2c100170 0x7fcd2c195ae0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000d900 tx=0x7fcd2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.650+0000 7fcd13fff700 1 -- 172.21.15.134:0/310486959 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd2000b920 con 0x7fcd2c100170 2024-04-13T10:56:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.650+0000 7fcd31663700 1 -- 172.21.15.134:0/310486959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c19b630 con 0x7fcd2c100170 2024-04-13T10:56:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.650+0000 7fcd13fff700 1 -- 172.21.15.134:0/310486959 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fcd20010460 con 0x7fcd2c100170 2024-04-13T10:56:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.650+0000 7fcd13fff700 1 -- 172.21.15.134:0/310486959 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd2000f5d0 con 0x7fcd2c100170 2024-04-13T10:56:27.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.650+0000 7fcd31663700 1 -- 172.21.15.134:0/310486959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c19bb50 con 0x7fcd2c100170 2024-04-13T10:56:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.651+0000 7fcd31663700 1 -- 172.21.15.134:0/310486959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c108b80 con 0x7fcd2c100170 2024-04-13T10:56:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.651+0000 7fcd13fff700 1 -- 172.21.15.134:0/310486959 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fcd200105d0 con 0x7fcd2c100170 2024-04-13T10:56:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.652+0000 7fcd13fff700 1 --2- 172.21.15.134:0/310486959 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcd1406c680 0x7fcd1406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.652+0000 7fcd13fff700 1 -- 172.21.15.134:0/310486959 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fcd2008b800 con 0x7fcd2c100170 2024-04-13T10:56:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.652+0000 7fcd2a7fc700 1 --2- 172.21.15.134:0/310486959 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcd1406c680 0x7fcd1406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:27.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.652+0000 7fcd2a7fc700 1 --2- 172.21.15.134:0/310486959 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcd1406c680 0x7fcd1406eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00b5c0 tx=0x7fcd1c005fd0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:27.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.656+0000 7fcd13fff700 1 -- 172.21.15.134:0/310486959 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcd20059910 con 0x7fcd2c100170 2024-04-13T10:56:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.854+0000 7fcd31663700 1 -- 172.21.15.134:0/310486959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fcd2c108d40 con 0x7fcd2c100170 2024-04-13T10:56:27.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.854+0000 7fcd13fff700 1 -- 172.21.15.134:0/310486959 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fcd200594a0 con 0x7fcd2c100170 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 -- 172.21.15.134:0/310486959 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcd1406c680 msgr2=0x7fcd1406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 --2- 172.21.15.134:0/310486959 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcd1406c680 0x7fcd1406eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00b5c0 tx=0x7fcd1c005fd0 comp rx=0 tx=0).stop 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 -- 172.21.15.134:0/310486959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd2c100170 msgr2=0x7fcd2c195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 --2- 172.21.15.134:0/310486959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd2c100170 0x7fcd2c195ae0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000d900 tx=0x7fcd2000dcc0 comp rx=0 tx=0).stop 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 -- 172.21.15.134:0/310486959 shutdown_connections 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 --2- 172.21.15.134:0/310486959 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fcd1406c680 0x7fcd1406eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 --2- 172.21.15.134:0/310486959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd2c100170 0x7fcd2c195ae0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 --2- 172.21.15.134:0/310486959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd2c196020 0x7fcd2c19b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 -- 172.21.15.134:0/310486959 >> 172.21.15.134:0/310486959 conn(0x7fcd2c0fb720 msgr2=0x7fcd2c1045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 -- 172.21.15.134:0/310486959 shutdown_connections 2024-04-13T10:56:27.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:27.856+0000 7fcd31663700 1 -- 172.21.15.134:0/310486959 wait complete. 2024-04-13T10:56:27.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:27 smithi134 ceph-mon[39696]: pgmap v213: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-13T10:56:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:27 smithi194 ceph-mon[46737]: pgmap v213: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-13T10:56:28.731 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-13T10:56:28.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:56:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:56:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:28 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:56:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:29 smithi134 ceph-mon[39696]: pgmap v214: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-13T10:56:29.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:29 smithi194 ceph-mon[46737]: pgmap v214: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-13T10:56:30.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 -- 172.21.15.134:0/686118301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97c40ff050 msgr2=0x7f97c40ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:30.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 --2- 172.21.15.134:0/686118301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97c40ff050 0x7f97c40ff460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009910 tx=0x7f97b8009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:30.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 -- 172.21.15.134:0/686118301 shutdown_connections 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 --2- 172.21.15.134:0/686118301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97c4100250 0x7f97c41006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 --2- 172.21.15.134:0/686118301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97c40ff050 0x7f97c40ff460 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 -- 172.21.15.134:0/686118301 >> 172.21.15.134:0/686118301 conn(0x7f97c40fa600 msgr2=0x7f97c40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 -- 172.21.15.134:0/686118301 shutdown_connections 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 -- 172.21.15.134:0/686118301 wait complete. 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 Processor -- start 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 -- start start 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97c40ff050 0x7f97c41947b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97c4100250 0x7f97c4194cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4195310 con 0x7f97c40ff050 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97cacb0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4195450 con 0x7f97c4100250 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97c8a4c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97c40ff050 0x7f97c41947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:30.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97c8a4c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97c40ff050 0x7f97c41947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33768/0 (socket says 172.21.15.134:33768) 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.917+0000 7f97c8a4c700 1 -- 172.21.15.134:0/2216912926 learned_addr learned my addr 172.21.15.134:0/2216912926 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.918+0000 7f97c8a4c700 1 -- 172.21.15.134:0/2216912926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97c4100250 msgr2=0x7f97c4194cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.918+0000 7f97c8a4c700 1 --2- 172.21.15.134:0/2216912926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97c4100250 0x7f97c4194cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.918+0000 7f97c8a4c700 1 -- 172.21.15.134:0/2216912926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b80095f0 con 0x7f97c40ff050 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.918+0000 7f97c8a4c700 1 --2- 172.21.15.134:0/2216912926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97c40ff050 0x7f97c41947b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f97b800bda0 tx=0x7f97b800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.918+0000 7f97c1ffb700 1 -- 172.21.15.134:0/2216912926 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b801d070 con 0x7f97c40ff050 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.918+0000 7f97c1ffb700 1 -- 172.21.15.134:0/2216912926 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f97b8022470 con 0x7f97c40ff050 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.918+0000 7f97cacb0700 1 -- 172.21.15.134:0/2216912926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c4199ea0 con 0x7f97c40ff050 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.918+0000 7f97c1ffb700 1 -- 172.21.15.134:0/2216912926 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b800f690 con 0x7f97c40ff050 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.918+0000 7f97cacb0700 1 -- 172.21.15.134:0/2216912926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c419a3c0 con 0x7f97c40ff050 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.919+0000 7f97cacb0700 1 -- 172.21.15.134:0/2216912926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c4107a60 con 0x7f97c40ff050 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.920+0000 7f97c1ffb700 1 -- 172.21.15.134:0/2216912926 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f97b80229c0 con 0x7f97c40ff050 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.920+0000 7f97c1ffb700 1 --2- 172.21.15.134:0/2216912926 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f97b406c680 0x7f97b406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.920+0000 7f97c1ffb700 1 -- 172.21.15.134:0/2216912926 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f97b808cfb0 con 0x7f97c40ff050 2024-04-13T10:56:30.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.920+0000 7f97c3fff700 1 --2- 172.21.15.134:0/2216912926 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f97b406c680 0x7f97b406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:30.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.920+0000 7f97c3fff700 1 --2- 172.21.15.134:0/2216912926 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f97b406c680 0x7f97b406eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f97b000a990 tx=0x7f97b0005c80 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:30.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:30.925+0000 7f97c1ffb700 1 -- 172.21.15.134:0/2216912926 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f97b805b170 con 0x7f97c40ff050 2024-04-13T10:56:31.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.114+0000 7f97cacb0700 1 -- 172.21.15.134:0/2216912926 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f97c4107c50 con 0x7f97c40ff050 2024-04-13T10:56:31.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.114+0000 7f97c1ffb700 1 -- 172.21.15.134:0/2216912926 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f97b805ad00 con 0x7f97c40ff050 2024-04-13T10:56:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 -- 172.21.15.134:0/2216912926 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f97b406c680 msgr2=0x7f97b406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 --2- 172.21.15.134:0/2216912926 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f97b406c680 0x7f97b406eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f97b000a990 tx=0x7f97b0005c80 comp rx=0 tx=0).stop 2024-04-13T10:56:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 -- 172.21.15.134:0/2216912926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97c40ff050 msgr2=0x7f97c41947b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 --2- 172.21.15.134:0/2216912926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97c40ff050 0x7f97c41947b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f97b800bda0 tx=0x7f97b800be80 comp rx=0 tx=0).stop 2024-04-13T10:56:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 -- 172.21.15.134:0/2216912926 shutdown_connections 2024-04-13T10:56:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 --2- 172.21.15.134:0/2216912926 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f97b406c680 0x7f97b406eb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 --2- 172.21.15.134:0/2216912926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97c40ff050 0x7f97c41947b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 --2- 172.21.15.134:0/2216912926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97c4100250 0x7f97c4194cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 -- 172.21.15.134:0/2216912926 >> 172.21.15.134:0/2216912926 conn(0x7f97c40fa600 msgr2=0x7f97c4103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:31.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 -- 172.21.15.134:0/2216912926 shutdown_connections 2024-04-13T10:56:31.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:31.116+0000 7f97cacb0700 1 -- 172.21.15.134:0/2216912926 wait complete. 2024-04-13T10:56:31.793 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:31 smithi134 ceph-mon[39696]: pgmap v215: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-13T10:56:31.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-13T10:56:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:31 smithi194 ceph-mon[46737]: pgmap v215: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-13T10:56:32.042 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:56:33.807 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:33 smithi134 ceph-mon[39696]: pgmap v216: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-13T10:56:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:33 smithi194 ceph-mon[46737]: pgmap v216: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-13T10:56:34.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.067+0000 7ff5646ac700 1 -- 172.21.15.134:0/2842632138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff55c1013f0 msgr2=0x7ff55c101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:34.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.067+0000 7ff5646ac700 1 --2- 172.21.15.134:0/2842632138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff55c1013f0 0x7ff55c101840 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff558009910 tx=0x7ff558009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:34.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.067+0000 7ff5646ac700 1 -- 172.21.15.134:0/2842632138 shutdown_connections 2024-04-13T10:56:34.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.067+0000 7ff5646ac700 1 --2- 172.21.15.134:0/2842632138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff55c1013f0 0x7ff55c101840 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:34.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.067+0000 7ff5646ac700 1 --2- 172.21.15.134:0/2842632138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff55c0fe410 0x7ff55c0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:34.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.067+0000 7ff5646ac700 1 -- 172.21.15.134:0/2842632138 >> 172.21.15.134:0/2842632138 conn(0x7ff55c0f9d80 msgr2=0x7ff55c0fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:34.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.067+0000 7ff5646ac700 1 -- 172.21.15.134:0/2842632138 shutdown_connections 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.067+0000 7ff5646ac700 1 -- 172.21.15.134:0/2842632138 wait complete. 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.068+0000 7ff5646ac700 1 Processor -- start 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.068+0000 7ff5646ac700 1 -- start start 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.068+0000 7ff5646ac700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff55c0fe410 0x7ff55c195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.068+0000 7ff5646ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff55c1013f0 0x7ff55c195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.068+0000 7ff5646ac700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c1963d0 con 0x7ff55c1013f0 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.068+0000 7ff5646ac700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c196510 con 0x7ff55c0fe410 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.068+0000 7ff561c47700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff55c1013f0 0x7ff55c195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.068+0000 7ff561c47700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff55c1013f0 0x7ff55c195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33788/0 (socket says 172.21.15.134:33788) 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.068+0000 7ff561c47700 1 -- 172.21.15.134:0/2681412923 learned_addr learned my addr 172.21.15.134:0/2681412923 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.069+0000 7ff561c47700 1 -- 172.21.15.134:0/2681412923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff55c0fe410 msgr2=0x7ff55c195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:34.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.069+0000 7ff561c47700 1 --2- 172.21.15.134:0/2681412923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff55c0fe410 0x7ff55c195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.069+0000 7ff561c47700 1 -- 172.21.15.134:0/2681412923 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580095f0 con 0x7ff55c1013f0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.069+0000 7ff561c47700 1 --2- 172.21.15.134:0/2681412923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff55c1013f0 0x7ff55c195db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff558006010 tx=0x7ff55800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.069+0000 7ff5537fe700 1 -- 172.21.15.134:0/2681412923 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff55801d070 con 0x7ff55c1013f0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.069+0000 7ff5537fe700 1 -- 172.21.15.134:0/2681412923 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7ff55800f460 con 0x7ff55c1013f0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.069+0000 7ff5646ac700 1 -- 172.21.15.134:0/2681412923 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c19af60 con 0x7ff55c1013f0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.069+0000 7ff5537fe700 1 -- 172.21.15.134:0/2681412923 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff558021640 con 0x7ff55c1013f0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.069+0000 7ff5646ac700 1 -- 172.21.15.134:0/2681412923 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c19b4a0 con 0x7ff55c1013f0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.070+0000 7ff5646ac700 1 -- 172.21.15.134:0/2681412923 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c108b50 con 0x7ff55c1013f0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.070+0000 7ff5537fe700 1 -- 172.21.15.134:0/2681412923 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ff55800f940 con 0x7ff55c1013f0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.071+0000 7ff5537fe700 1 --2- 172.21.15.134:0/2681412923 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff54806c680 0x7ff54806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.071+0000 7ff5537fe700 1 -- 172.21.15.134:0/2681412923 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff55808cc00 con 0x7ff55c1013f0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.071+0000 7ff562448700 1 --2- 172.21.15.134:0/2681412923 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff54806c680 0x7ff54806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:34.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.071+0000 7ff562448700 1 --2- 172.21.15.134:0/2681412923 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff54806c680 0x7ff54806eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0681d0 tx=0x7ff54c009470 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:34.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.075+0000 7ff5537fe700 1 -- 172.21.15.134:0/2681412923 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff558092020 con 0x7ff55c1013f0 2024-04-13T10:56:34.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.263+0000 7ff5646ac700 1 -- 172.21.15.134:0/2681412923 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7ff55c108d10 con 0x7ff55c1013f0 2024-04-13T10:56:34.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.263+0000 7ff5537fe700 1 -- 172.21.15.134:0/2681412923 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7ff55805ad10 con 0x7ff55c1013f0 2024-04-13T10:56:34.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 -- 172.21.15.134:0/2681412923 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff54806c680 msgr2=0x7ff54806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:34.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 --2- 172.21.15.134:0/2681412923 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff54806c680 0x7ff54806eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0681d0 tx=0x7ff54c009470 comp rx=0 tx=0).stop 2024-04-13T10:56:34.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 -- 172.21.15.134:0/2681412923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff55c1013f0 msgr2=0x7ff55c195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:34.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 --2- 172.21.15.134:0/2681412923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff55c1013f0 0x7ff55c195db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff558006010 tx=0x7ff55800be20 comp rx=0 tx=0).stop 2024-04-13T10:56:34.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 -- 172.21.15.134:0/2681412923 shutdown_connections 2024-04-13T10:56:34.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 --2- 172.21.15.134:0/2681412923 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7ff54806c680 0x7ff54806eb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:34.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 --2- 172.21.15.134:0/2681412923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff55c0fe410 0x7ff55c195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:34.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 --2- 172.21.15.134:0/2681412923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff55c1013f0 0x7ff55c195db0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:34.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 -- 172.21.15.134:0/2681412923 >> 172.21.15.134:0/2681412923 conn(0x7ff55c0f9d80 msgr2=0x7ff55c104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:34.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 -- 172.21.15.134:0/2681412923 shutdown_connections 2024-04-13T10:56:34.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:34.266+0000 7ff5646ac700 1 -- 172.21.15.134:0/2681412923 wait complete. 2024-04-13T10:56:35.143 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-04-13T10:56:35.369 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:56:35.906 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:35 smithi134 ceph-mon[39696]: pgmap v217: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 938 B/s wr, 3 op/s 2024-04-13T10:56:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:35 smithi194 ceph-mon[46737]: pgmap v217: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 938 B/s wr, 3 op/s 2024-04-13T10:56:37.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.321+0000 7f9328ebb700 1 -- 172.21.15.134:0/1788419839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9324101370 msgr2=0x7f93241017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:37.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.321+0000 7f9328ebb700 1 --2- 172.21.15.134:0/1788419839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9324101370 0x7f93241017c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9314009910 tx=0x7f9314009c20 comp rx=0 tx=0).stop 2024-04-13T10:56:37.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.321+0000 7f9328ebb700 1 -- 172.21.15.134:0/1788419839 shutdown_connections 2024-04-13T10:56:37.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.321+0000 7f9328ebb700 1 --2- 172.21.15.134:0/1788419839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9324101370 0x7f93241017c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:37.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.321+0000 7f9328ebb700 1 --2- 172.21.15.134:0/1788419839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9324100170 0x7f9324100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:37.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.321+0000 7f9328ebb700 1 -- 172.21.15.134:0/1788419839 >> 172.21.15.134:0/1788419839 conn(0x7f93240fb720 msgr2=0x7f93240fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:56:37.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.322+0000 7f9328ebb700 1 -- 172.21.15.134:0/1788419839 shutdown_connections 2024-04-13T10:56:37.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.322+0000 7f9328ebb700 1 -- 172.21.15.134:0/1788419839 wait complete. 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.322+0000 7f9328ebb700 1 Processor -- start 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.322+0000 7f9328ebb700 1 -- start start 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.322+0000 7f9328ebb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9324100170 0x7f93241958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.322+0000 7f9328ebb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9324101370 0x7f9324195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.322+0000 7f9328ebb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9324196400 con 0x7f9324100170 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.322+0000 7f9328ebb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9324196540 con 0x7f9324101370 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f932259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9324100170 0x7f93241958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f932259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9324100170 0x7f93241958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33810/0 (socket says 172.21.15.134:33810) 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f932259c700 1 -- 172.21.15.134:0/3217800525 learned_addr learned my addr 172.21.15.134:0/3217800525 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f9321d9b700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9324101370 0x7f9324195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f932259c700 1 -- 172.21.15.134:0/3217800525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9324101370 msgr2=0x7f9324195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f932259c700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9324101370 0x7f9324195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f932259c700 1 -- 172.21.15.134:0/3217800525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93140095f0 con 0x7f9324100170 2024-04-13T10:56:37.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f932259c700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9324100170 0x7f93241958a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f931800d900 tx=0x7f931800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:37.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f93137fe700 1 -- 172.21.15.134:0/3217800525 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93180041f0 con 0x7f9324100170 2024-04-13T10:56:37.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f93137fe700 1 -- 172.21.15.134:0/3217800525 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f9318004350 con 0x7f9324100170 2024-04-13T10:56:37.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f9328ebb700 1 -- 172.21.15.134:0/3217800525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932419aff0 con 0x7f9324100170 2024-04-13T10:56:37.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f93137fe700 1 -- 172.21.15.134:0/3217800525 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9318003cf0 con 0x7f9324100170 2024-04-13T10:56:37.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.323+0000 7f9328ebb700 1 -- 172.21.15.134:0/3217800525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932419b530 con 0x7f9324100170 2024-04-13T10:56:37.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.324+0000 7f9328ebb700 1 -- 172.21.15.134:0/3217800525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9324108b80 con 0x7f9324100170 2024-04-13T10:56:37.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.325+0000 7f93137fe700 1 -- 172.21.15.134:0/3217800525 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f9318009730 con 0x7f9324100170 2024-04-13T10:56:37.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.325+0000 7f93137fe700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f930c06c680 0x7f930c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:56:37.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.325+0000 7f9321d9b700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f930c06c680 0x7f930c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:56:37.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.325+0000 7f93137fe700 1 -- 172.21.15.134:0/3217800525 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f931808ba10 con 0x7f9324100170 2024-04-13T10:56:37.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.326+0000 7f9321d9b700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f930c06c680 0x7f930c06eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f931400b5c0 tx=0x7f9314005960 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:56:37.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.330+0000 7f93137fe700 1 -- 172.21.15.134:0/3217800525 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9318059ba0 con 0x7f9324100170 2024-04-13T10:56:37.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:56:37.537+0000 7f9328ebb700 1 -- 172.21.15.134:0/3217800525 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f9324105cc0 con 0x7f930c06c680 2024-04-13T10:56:37.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:37 smithi134 ceph-mon[39696]: pgmap v218: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-04-13T10:56:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:37 smithi194 ceph-mon[46737]: pgmap v218: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-04-13T10:56:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:38 smithi194 ceph-mon[46737]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:56:39.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:38 smithi134 ceph-mon[39696]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:56:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:39 smithi194 ceph-mon[46737]: pgmap v219: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-04-13T10:56:40.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:39 smithi134 ceph-mon[39696]: pgmap v219: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-04-13T10:56:41.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:41 smithi194 ceph-mon[46737]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-13T10:56:42.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:41 smithi134 ceph-mon[39696]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-04-13T10:56:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:43 smithi194 ceph-mon[46737]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-13T10:56:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:56:44.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:43 smithi134 ceph-mon[39696]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-13T10:56:44.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:56:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:45 smithi134 ceph-mon[39696]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-13T10:56:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:45 smithi194 ceph-mon[46737]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-13T10:56:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:47 smithi194 ceph-mon[46737]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-04-13T10:56:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:47 smithi134 ceph-mon[39696]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-04-13T10:56:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:49 smithi194 ceph-mon[46737]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-13T10:56:50.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:49 smithi134 ceph-mon[39696]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-13T10:56:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:51 smithi194 ceph-mon[46737]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-04-13T10:56:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:51 smithi134 ceph-mon[39696]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-04-13T10:56:53.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:53 smithi194 ceph-mon[46737]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:56:54.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:53 smithi134 ceph-mon[39696]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:56:55.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:55 smithi134 ceph-mon[39696]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:56:55.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:55 smithi194 ceph-mon[46737]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:56:57.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:57 smithi194 ceph-mon[46737]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:56:58.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:57 smithi134 ceph-mon[39696]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:56:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:58 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:56:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:58 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:56:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:56:59 smithi194 ceph-mon[46737]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:00.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:56:59 smithi134 ceph-mon[39696]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:01.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:01 smithi194 ceph-mon[46737]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:02.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:01 smithi134 ceph-mon[39696]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:03 smithi194 ceph-mon[46737]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:04.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:03 smithi134 ceph-mon[39696]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:05.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:05 smithi194 ceph-mon[46737]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:06.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:05 smithi134 ceph-mon[39696]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:07.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:07 smithi134 ceph-mon[39696]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:07.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:07 smithi194 ceph-mon[46737]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:08.551 INFO:teuthology.orchestra.run.smithi134.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:57:08.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.550+0000 7f93137fe700 1 -- 172.21.15.134:0/3217800525 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f9324105cc0 con 0x7f930c06c680 2024-04-13T10:57:08.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 -- 172.21.15.134:0/3217800525 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f930c06c680 msgr2=0x7f930c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:08.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f930c06c680 0x7f930c06eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f931400b5c0 tx=0x7f9314005960 comp rx=0 tx=0).stop 2024-04-13T10:57:08.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 -- 172.21.15.134:0/3217800525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9324100170 msgr2=0x7f93241958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:08.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9324100170 0x7f93241958a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f931800d900 tx=0x7f931800dcc0 comp rx=0 tx=0).stop 2024-04-13T10:57:08.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 -- 172.21.15.134:0/3217800525 shutdown_connections 2024-04-13T10:57:08.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f930c06c680 0x7f930c06eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:08.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9324100170 0x7f93241958a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:08.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 --2- 172.21.15.134:0/3217800525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9324101370 0x7f9324195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:08.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 -- 172.21.15.134:0/3217800525 >> 172.21.15.134:0/3217800525 conn(0x7f93240fb720 msgr2=0x7f93241045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:08.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 -- 172.21.15.134:0/3217800525 shutdown_connections 2024-04-13T10:57:08.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:08.552+0000 7f9328ebb700 1 -- 172.21.15.134:0/3217800525 wait complete. 2024-04-13T10:57:09.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-04-13T10:57:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:09 smithi194 ceph-mon[46737]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:09 smithi194 ceph-mon[46737]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:57:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:09 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:09 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:57:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:09 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:57:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:09 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:57:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:09 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:09.814 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:09 smithi134 ceph-mon[39696]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:09.814 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:09 smithi134 ceph-mon[39696]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:57:09.814 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:09 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:09.814 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:09 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:57:09.814 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:09 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:57:09.814 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:09 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:57:09.815 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:09 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:10.224 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T10:57:10.818 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:10 smithi134 ceph-mon[39696]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:57:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:10 smithi194 ceph-mon[46737]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c 2024-04-13T10:57:11.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:11 smithi134 ceph-mon[39696]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:11.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:11 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:11.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:11 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:57:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:11 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:11 smithi194 ceph-mon[46737]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:11 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:11 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:57:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:11 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:12.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.769+0000 7fe3887d6700 1 -- 172.21.15.134:0/2443140196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3800ff050 msgr2=0x7fe3800ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:12.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.769+0000 7fe3887d6700 1 --2- 172.21.15.134:0/2443140196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3800ff050 0x7fe3800ff460 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009910 tx=0x7fe37c009c20 comp rx=0 tx=0).stop 2024-04-13T10:57:12.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.770+0000 7fe3887d6700 1 -- 172.21.15.134:0/2443140196 shutdown_connections 2024-04-13T10:57:12.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.770+0000 7fe3887d6700 1 --2- 172.21.15.134:0/2443140196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe380100250 0x7fe3801006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:12.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.770+0000 7fe3887d6700 1 --2- 172.21.15.134:0/2443140196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3800ff050 0x7fe3800ff460 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:12.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.770+0000 7fe3887d6700 1 -- 172.21.15.134:0/2443140196 >> 172.21.15.134:0/2443140196 conn(0x7fe3800fa5e0 msgr2=0x7fe3800fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.770+0000 7fe3887d6700 1 -- 172.21.15.134:0/2443140196 shutdown_connections 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.770+0000 7fe3887d6700 1 -- 172.21.15.134:0/2443140196 wait complete. 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.770+0000 7fe3887d6700 1 Processor -- start 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.770+0000 7fe3887d6700 1 -- start start 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe3887d6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3800ff050 0x7fe3801958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe3887d6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe380100250 0x7fe380195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe3887d6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe380196410 con 0x7fe3800ff050 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe3887d6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe380196550 con 0x7fe380100250 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe385d71700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe380100250 0x7fe380195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe385d71700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe380100250 0x7fe380195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.134:60532/0 (socket says 172.21.15.134:60532) 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe385d71700 1 -- 172.21.15.134:0/3553136440 learned_addr learned my addr 172.21.15.134:0/3553136440 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:57:12.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe386572700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3800ff050 0x7fe3801958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe385d71700 1 -- 172.21.15.134:0/3553136440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3800ff050 msgr2=0x7fe3801958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe385d71700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3800ff050 0x7fe3801958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe385d71700 1 -- 172.21.15.134:0/3553136440 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c0095f0 con 0x7fe380100250 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.771+0000 7fe385d71700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe380100250 0x7fe380195df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe37000e920 tx=0x7fe37000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.772+0000 7fe3777fe700 1 -- 172.21.15.134:0/3553136440 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe370009790 con 0x7fe380100250 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.772+0000 7fe3887d6700 1 -- 172.21.15.134:0/3553136440 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38019b000 con 0x7fe380100250 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.772+0000 7fe3777fe700 1 -- 172.21.15.134:0/3553136440 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fe37000cba0 con 0x7fe380100250 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.772+0000 7fe3777fe700 1 -- 172.21.15.134:0/3553136440 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe370018650 con 0x7fe380100250 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.772+0000 7fe3887d6700 1 -- 172.21.15.134:0/3553136440 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38019b5a0 con 0x7fe380100250 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.773+0000 7fe3887d6700 1 -- 172.21.15.134:0/3553136440 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe380107a60 con 0x7fe380100250 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.774+0000 7fe3777fe700 1 -- 172.21.15.134:0/3553136440 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fe37000cd10 con 0x7fe380100250 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.774+0000 7fe3777fe700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe36c06c680 0x7fe36c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.774+0000 7fe3777fe700 1 -- 172.21.15.134:0/3553136440 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe370014070 con 0x7fe380100250 2024-04-13T10:57:12.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.774+0000 7fe386572700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe36c06c680 0x7fe36c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:12.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.775+0000 7fe386572700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe36c06c680 0x7fe36c06eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00b600 tx=0x7fe37c009f70 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:12.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:12.782+0000 7fe3777fe700 1 -- 172.21.15.134:0/3553136440 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe370059dc0 con 0x7fe380100250 2024-04-13T10:57:12.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:12 smithi134 ceph-mon[39696]: Upgrade: Target is version 18.2.2-1173-g5108bc67 (reef) 2024-04-13T10:57:12.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:12 smithi134 ceph-mon[39696]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39, digests ['quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39'] 2024-04-13T10:57:12.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:12 smithi134 ceph-mon[39696]: Upgrade: Need to upgrade myself (mgr.smithi134.tmanda) 2024-04-13T10:57:12.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:12 smithi134 ceph-mon[39696]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39 on smithi194 2024-04-13T10:57:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:12 smithi194 ceph-mon[46737]: Upgrade: Target is version 18.2.2-1173-g5108bc67 (reef) 2024-04-13T10:57:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:12 smithi194 ceph-mon[46737]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39, digests ['quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39'] 2024-04-13T10:57:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:12 smithi194 ceph-mon[46737]: Upgrade: Need to upgrade myself (mgr.smithi134.tmanda) 2024-04-13T10:57:12.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:12 smithi194 ceph-mon[46737]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39 on smithi194 2024-04-13T10:57:13.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.073+0000 7fe3887d6700 1 -- 172.21.15.134:0/3553136440 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe380068ae0 con 0x7fe36c06c680 2024-04-13T10:57:13.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.074+0000 7fe3777fe700 1 -- 172.21.15.134:0/3553136440 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fe380068ae0 con 0x7fe36c06c680 2024-04-13T10:57:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 -- 172.21.15.134:0/3553136440 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe36c06c680 msgr2=0x7fe36c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe36c06c680 0x7fe36c06eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00b600 tx=0x7fe37c009f70 comp rx=0 tx=0).stop 2024-04-13T10:57:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 -- 172.21.15.134:0/3553136440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe380100250 msgr2=0x7fe380195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe380100250 0x7fe380195df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe37000e920 tx=0x7fe37000ece0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 -- 172.21.15.134:0/3553136440 shutdown_connections 2024-04-13T10:57:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fe36c06c680 0x7fe36c06eb30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3800ff050 0x7fe3801958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 --2- 172.21.15.134:0/3553136440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe380100250 0x7fe380195df0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 -- 172.21.15.134:0/3553136440 >> 172.21.15.134:0/3553136440 conn(0x7fe3800fa5e0 msgr2=0x7fe3800683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:13.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 -- 172.21.15.134:0/3553136440 shutdown_connections 2024-04-13T10:57:13.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.077+0000 7fe3887d6700 1 -- 172.21.15.134:0/3553136440 wait complete. 2024-04-13T10:57:13.089 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T10:57:13.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.196+0000 7f715983a700 1 -- 172.21.15.134:0/2162456565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71540ff070 msgr2=0x7f71540ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:13.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.196+0000 7f715983a700 1 --2- 172.21.15.134:0/2162456565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71540ff070 0x7f71540ff480 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7144009910 tx=0x7f7144009c20 comp rx=0 tx=0).stop 2024-04-13T10:57:13.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.196+0000 7f715983a700 1 -- 172.21.15.134:0/2162456565 shutdown_connections 2024-04-13T10:57:13.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.196+0000 7f715983a700 1 --2- 172.21.15.134:0/2162456565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7154100270 0x7f71541006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.196+0000 7f715983a700 1 --2- 172.21.15.134:0/2162456565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71540ff070 0x7f71540ff480 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.196+0000 7f715983a700 1 -- 172.21.15.134:0/2162456565 >> 172.21.15.134:0/2162456565 conn(0x7f71540fa600 msgr2=0x7f71540fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:13.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.196+0000 7f715983a700 1 -- 172.21.15.134:0/2162456565 shutdown_connections 2024-04-13T10:57:13.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.196+0000 7f715983a700 1 -- 172.21.15.134:0/2162456565 wait complete. 2024-04-13T10:57:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.197+0000 7f715983a700 1 Processor -- start 2024-04-13T10:57:13.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.197+0000 7f715983a700 1 -- start start 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.197+0000 7f715983a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71540ff070 0x7f7154069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.197+0000 7f715983a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7154100270 0x7f715419ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.197+0000 7f715983a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71541964b0 con 0x7f7154100270 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.197+0000 7f715983a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715419cf80 con 0x7f71540ff070 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.197+0000 7f71527fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7154100270 0x7f715419ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.197+0000 7f71527fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7154100270 0x7f715419ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59332/0 (socket says 172.21.15.134:59332) 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.197+0000 7f71527fc700 1 -- 172.21.15.134:0/468003841 learned_addr learned my addr 172.21.15.134:0/468003841 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.197+0000 7f7152ffd700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71540ff070 0x7f7154069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.198+0000 7f71527fc700 1 -- 172.21.15.134:0/468003841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71540ff070 msgr2=0x7f7154069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.198+0000 7f71527fc700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71540ff070 0x7f7154069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.198+0000 7f71527fc700 1 -- 172.21.15.134:0/468003841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440095f0 con 0x7f7154100270 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.198+0000 7f7152ffd700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71540ff070 0x7f7154069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T10:57:13.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.198+0000 7f71527fc700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7154100270 0x7f715419ca40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f714800e970 tx=0x7f714800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.198+0000 7f7158838700 1 -- 172.21.15.134:0/468003841 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f714800cba0 con 0x7f7154100270 2024-04-13T10:57:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.198+0000 7f7158838700 1 -- 172.21.15.134:0/468003841 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f714800eec0 con 0x7f7154100270 2024-04-13T10:57:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.198+0000 7f715983a700 1 -- 172.21.15.134:0/468003841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715419d230 con 0x7f7154100270 2024-04-13T10:57:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.198+0000 7f715983a700 1 -- 172.21.15.134:0/468003841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715419d800 con 0x7f7154100270 2024-04-13T10:57:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.198+0000 7f7158838700 1 -- 172.21.15.134:0/468003841 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7148005630 con 0x7f7154100270 2024-04-13T10:57:13.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.199+0000 7f715983a700 1 -- 172.21.15.134:0/468003841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7154107aa0 con 0x7f7154100270 2024-04-13T10:57:13.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.200+0000 7f7158838700 1 -- 172.21.15.134:0/468003841 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f714800cd00 con 0x7f7154100270 2024-04-13T10:57:13.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.201+0000 7f7158838700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f713c06c680 0x7f713c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:13.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.201+0000 7f7158838700 1 -- 172.21.15.134:0/468003841 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7148014070 con 0x7f7154100270 2024-04-13T10:57:13.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.206+0000 7f7152ffd700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f713c06c680 0x7f713c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:13.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.206+0000 7f7152ffd700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f713c06c680 0x7f713c06eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7144009fd0 tx=0x7f714400b5a0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:13.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.208+0000 7f7158838700 1 -- 172.21.15.134:0/468003841 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7148059dd0 con 0x7f7154100270 2024-04-13T10:57:13.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.512+0000 7f715983a700 1 -- 172.21.15.134:0/468003841 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7154104bc0 con 0x7f713c06c680 2024-04-13T10:57:13.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.514+0000 7f7158838700 1 -- 172.21.15.134:0/468003841 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f7154104bc0 con 0x7f713c06c680 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.516+0000 7f715983a700 1 -- 172.21.15.134:0/468003841 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f713c06c680 msgr2=0x7f713c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.516+0000 7f715983a700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f713c06c680 0x7f713c06eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7144009fd0 tx=0x7f714400b5a0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.516+0000 7f715983a700 1 -- 172.21.15.134:0/468003841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7154100270 msgr2=0x7f715419ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.516+0000 7f715983a700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7154100270 0x7f715419ca40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f714800e970 tx=0x7f714800ec80 comp rx=0 tx=0).stop 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.516+0000 7f715983a700 1 -- 172.21.15.134:0/468003841 shutdown_connections 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.516+0000 7f715983a700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f713c06c680 0x7f713c06eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.516+0000 7f715983a700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71540ff070 0x7f7154069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.516+0000 7f715983a700 1 --2- 172.21.15.134:0/468003841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7154100270 0x7f715419ca40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.516+0000 7f715983a700 1 -- 172.21.15.134:0/468003841 >> 172.21.15.134:0/468003841 conn(0x7f71540fa600 msgr2=0x7f71541034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.517+0000 7f715983a700 1 -- 172.21.15.134:0/468003841 shutdown_connections 2024-04-13T10:57:13.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.517+0000 7f715983a700 1 -- 172.21.15.134:0/468003841 wait complete. 2024-04-13T10:57:13.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.630+0000 7f3c588b4700 1 -- 172.21.15.134:0/4040389868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c54100290 msgr2=0x7f3c541006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:13.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.630+0000 7f3c588b4700 1 --2- 172.21.15.134:0/4040389868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c54100290 0x7f3c541006e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009910 tx=0x7f3c48009c20 comp rx=0 tx=0).stop 2024-04-13T10:57:13.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.630+0000 7f3c588b4700 1 -- 172.21.15.134:0/4040389868 shutdown_connections 2024-04-13T10:57:13.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.630+0000 7f3c588b4700 1 --2- 172.21.15.134:0/4040389868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c54100290 0x7f3c541006e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.630+0000 7f3c588b4700 1 --2- 172.21.15.134:0/4040389868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c540ff090 0x7f3c540ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.630+0000 7f3c588b4700 1 -- 172.21.15.134:0/4040389868 >> 172.21.15.134:0/4040389868 conn(0x7f3c540fa620 msgr2=0x7f3c540fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:13.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.631+0000 7f3c588b4700 1 -- 172.21.15.134:0/4040389868 shutdown_connections 2024-04-13T10:57:13.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.631+0000 7f3c588b4700 1 -- 172.21.15.134:0/4040389868 wait complete. 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.631+0000 7f3c588b4700 1 Processor -- start 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.631+0000 7f3c588b4700 1 -- start start 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c588b4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540ff090 0x7f3c54193690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c588b4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c54100290 0x7f3c54193bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c588b4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541941f0 con 0x7f3c540ff090 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c588b4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c54194330 con 0x7f3c54100290 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c5259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540ff090 0x7f3c54193690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c5259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540ff090 0x7f3c54193690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59358/0 (socket says 172.21.15.134:59358) 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c5259c700 1 -- 172.21.15.134:0/3681754450 learned_addr learned my addr 172.21.15.134:0/3681754450 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c51d9b700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c54100290 0x7f3c54193bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c5259c700 1 -- 172.21.15.134:0/3681754450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c54100290 msgr2=0x7f3c54193bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c5259c700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c54100290 0x7f3c54193bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c5259c700 1 -- 172.21.15.134:0/3681754450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480095f0 con 0x7f3c540ff090 2024-04-13T10:57:13.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c5259c700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540ff090 0x7f3c54193690 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400e8f0 tx=0x7f3c4400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:13.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.632+0000 7f3c437fe700 1 -- 172.21.15.134:0/3681754450 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c44009790 con 0x7f3c540ff090 2024-04-13T10:57:13.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.633+0000 7f3c437fe700 1 -- 172.21.15.134:0/3681754450 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f3c4400c810 con 0x7f3c540ff090 2024-04-13T10:57:13.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.633+0000 7f3c437fe700 1 -- 172.21.15.134:0/3681754450 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c44003c20 con 0x7f3c540ff090 2024-04-13T10:57:13.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.633+0000 7f3c588b4700 1 -- 172.21.15.134:0/3681754450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c54198de0 con 0x7f3c540ff090 2024-04-13T10:57:13.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.633+0000 7f3c588b4700 1 -- 172.21.15.134:0/3681754450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c541993b0 con 0x7f3c540ff090 2024-04-13T10:57:13.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.634+0000 7f3c588b4700 1 -- 172.21.15.134:0/3681754450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c54107aa0 con 0x7f3c540ff090 2024-04-13T10:57:13.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.635+0000 7f3c437fe700 1 -- 172.21.15.134:0/3681754450 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f3c4400c980 con 0x7f3c540ff090 2024-04-13T10:57:13.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.635+0000 7f3c437fe700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3c3c06c680 0x7f3c3c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:13.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.636+0000 7f3c437fe700 1 -- 172.21.15.134:0/3681754450 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3c44014070 con 0x7f3c540ff090 2024-04-13T10:57:13.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.636+0000 7f3c51d9b700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3c3c06c680 0x7f3c3c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:13.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.636+0000 7f3c51d9b700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3c3c06c680 0x7f3c3c06eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009fd0 tx=0x7f3c4800b5a0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:13.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.643+0000 7f3c437fe700 1 -- 172.21.15.134:0/3681754450 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3c44059db0 con 0x7f3c540ff090 2024-04-13T10:57:13.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.892+0000 7f3c588b4700 1 -- 172.21.15.134:0/3681754450 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c54069440 con 0x7f3c3c06c680 2024-04-13T10:57:13.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.907+0000 7f3c437fe700 1 -- 172.21.15.134:0/3681754450 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f3c54069440 con 0x7f3c3c06c680 2024-04-13T10:57:13.909 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T10:57:13.909 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (5m) 60s ago 7m 24.8M - 0.25.0 c8568f914cd2 8d2cf34cad2a 2024-04-13T10:57:13.909 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (7m) 60s ago 7m 7440k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T10:57:13.909 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (6m) 67s ago 6m 7172k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T10:57:13.909 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (7m) 60s ago 7m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T10:57:13.909 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (6m) 67s ago 6m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T10:57:13.909 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (5m) 60s ago 7m 86.9M - 9.4.7 954c08fa6188 1038718f4fd4 2024-04-13T10:57:13.909 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (90s) 60s ago 89s 12.5M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T10:57:13.909 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (83s) 60s ago 82s 15.6M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (80s) 67s ago 80s 11.5M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (87s) 67s ago 86s 15.6M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:9283,8765,8443 running (9m) 60s ago 9m 487M - 18.2.0 dc2bc1663786 3b88cc824ec3 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (6m) 67s ago 6m 437M - 18.2.0 dc2bc1663786 810301983f71 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (9m) 60s ago 9m 44.3M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (6m) 67s ago 6m 36.1M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 60s ago 7m 15.5M - 1.5.0 0da6a335fe13 da23f14cbdef 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (6m) 67s ago 6m 18.2M - 1.5.0 0da6a335fe13 242da19a461b 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (5m) 60s ago 5m 48.2M 3958M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (5m) 60s ago 5m 47.7M 3958M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (4m) 60s ago 4m 46.7M 3958M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (4m) 67s ago 4m 46.1M 4982M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (3m) 67s ago 3m 44.6M 4982M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T10:57:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (3m) 67s ago 3m 45.9M 4982M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T10:57:13.911 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 60s ago 6m 61.6M - 2.43.0 a07b618ecd1d a5240fafbf97 2024-04-13T10:57:13.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 -- 172.21.15.134:0/3681754450 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3c3c06c680 msgr2=0x7f3c3c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:13.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3c3c06c680 0x7f3c3c06eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009fd0 tx=0x7f3c4800b5a0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 -- 172.21.15.134:0/3681754450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540ff090 msgr2=0x7f3c54193690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:13.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540ff090 0x7f3c54193690 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400e8f0 tx=0x7f3c4400ec00 comp rx=0 tx=0).stop 2024-04-13T10:57:13.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 -- 172.21.15.134:0/3681754450 shutdown_connections 2024-04-13T10:57:13.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f3c3c06c680 0x7f3c3c06eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c540ff090 0x7f3c54193690 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 --2- 172.21.15.134:0/3681754450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c54100290 0x7f3c54193bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:13.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 -- 172.21.15.134:0/3681754450 >> 172.21.15.134:0/3681754450 conn(0x7f3c540fa620 msgr2=0x7f3c54068d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:13.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 -- 172.21.15.134:0/3681754450 shutdown_connections 2024-04-13T10:57:13.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:13.909+0000 7f3c588b4700 1 -- 172.21.15.134:0/3681754450 wait complete. 2024-04-13T10:57:13.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:13 smithi134 ceph-mon[39696]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:13.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:13 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:57:13.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:13 smithi194 ceph-mon[46737]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:13.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:13 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:57:14.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.017+0000 7fd0500cc700 1 -- 172.21.15.134:0/3678878783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0480fe410 msgr2=0x7fd0480fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:14.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.017+0000 7fd0500cc700 1 --2- 172.21.15.134:0/3678878783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0480fe410 0x7fd0480fe820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd044009910 tx=0x7fd044009c20 comp rx=0 tx=0).stop 2024-04-13T10:57:14.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.017+0000 7fd0500cc700 1 -- 172.21.15.134:0/3678878783 shutdown_connections 2024-04-13T10:57:14.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.017+0000 7fd0500cc700 1 --2- 172.21.15.134:0/3678878783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0480ff180 0x7fd0480ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.017+0000 7fd0500cc700 1 --2- 172.21.15.134:0/3678878783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0480fe410 0x7fd0480fe820 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.017+0000 7fd0500cc700 1 -- 172.21.15.134:0/3678878783 >> 172.21.15.134:0/3678878783 conn(0x7fd0480f9d80 msgr2=0x7fd0480fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:14.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.017+0000 7fd0500cc700 1 -- 172.21.15.134:0/3678878783 shutdown_connections 2024-04-13T10:57:14.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.017+0000 7fd0500cc700 1 -- 172.21.15.134:0/3678878783 wait complete. 2024-04-13T10:57:14.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd0500cc700 1 Processor -- start 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd0500cc700 1 -- start start 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd0500cc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0480fe410 0x7fd04819bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd0500cc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0480ff180 0x7fd04819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd0500cc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04819caf0 con 0x7fd0480fe410 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd0500cc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04819cc30 con 0x7fd0480ff180 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd04de68700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0480fe410 0x7fd04819bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd04de68700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0480fe410 0x7fd04819bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59370/0 (socket says 172.21.15.134:59370) 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd04de68700 1 -- 172.21.15.134:0/250264474 learned_addr learned my addr 172.21.15.134:0/250264474 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd04de68700 1 -- 172.21.15.134:0/250264474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0480ff180 msgr2=0x7fd04819c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd04de68700 1 --2- 172.21.15.134:0/250264474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0480ff180 0x7fd04819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.018+0000 7fd04de68700 1 -- 172.21.15.134:0/250264474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0440095f0 con 0x7fd0480fe410 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.019+0000 7fd04de68700 1 --2- 172.21.15.134:0/250264474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0480fe410 0x7fd04819bf90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd044006010 tx=0x7fd04400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.019+0000 7fd03effd700 1 -- 172.21.15.134:0/250264474 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd04401d070 con 0x7fd0480fe410 2024-04-13T10:57:14.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.019+0000 7fd03effd700 1 -- 172.21.15.134:0/250264474 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fd044022470 con 0x7fd0480fe410 2024-04-13T10:57:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.019+0000 7fd03effd700 1 -- 172.21.15.134:0/250264474 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd04400f690 con 0x7fd0480fe410 2024-04-13T10:57:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.019+0000 7fd0500cc700 1 -- 172.21.15.134:0/250264474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0481a1680 con 0x7fd0480fe410 2024-04-13T10:57:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.019+0000 7fd0500cc700 1 -- 172.21.15.134:0/250264474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0481a1bf0 con 0x7fd0480fe410 2024-04-13T10:57:14.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.020+0000 7fd0500cc700 1 -- 172.21.15.134:0/250264474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04810f1e0 con 0x7fd0480fe410 2024-04-13T10:57:14.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.022+0000 7fd03effd700 1 -- 172.21.15.134:0/250264474 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fd044022980 con 0x7fd0480fe410 2024-04-13T10:57:14.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.022+0000 7fd03effd700 1 --2- 172.21.15.134:0/250264474 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd03406c6d0 0x7fd03406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:14.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.023+0000 7fd03effd700 1 -- 172.21.15.134:0/250264474 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd04408d710 con 0x7fd0480fe410 2024-04-13T10:57:14.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.023+0000 7fd04d667700 1 --2- 172.21.15.134:0/250264474 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd03406c6d0 0x7fd03406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:14.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.023+0000 7fd04d667700 1 --2- 172.21.15.134:0/250264474 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd03406c6d0 0x7fd03406eb80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd0380097b0 tx=0x7fd038006d20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.029+0000 7fd03effd700 1 -- 172.21.15.134:0/250264474 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd04405b880 con 0x7fd0480fe410 2024-04-13T10:57:14.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.385+0000 7fd0500cc700 1 -- 172.21.15.134:0/250264474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0481a2710 con 0x7fd0480fe410 2024-04-13T10:57:14.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.385+0000 7fd03effd700 1 -- 172.21.15.134:0/250264474 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fd04405b410 con 0x7fd0480fe410 2024-04-13T10:57:14.386 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:57:14.386 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T10:57:14.386 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T10:57:14.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:57:14.386 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T10:57:14.386 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T10:57:14.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:57:14.387 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T10:57:14.387 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T10:57:14.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:57:14.387 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T10:57:14.387 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T10:57:14.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:57:14.387 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T10:57:14.387 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-04-13T10:57:14.387 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T10:57:14.387 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:57:14.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 -- 172.21.15.134:0/250264474 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd03406c6d0 msgr2=0x7fd03406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 --2- 172.21.15.134:0/250264474 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd03406c6d0 0x7fd03406eb80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd0380097b0 tx=0x7fd038006d20 comp rx=0 tx=0).stop 2024-04-13T10:57:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 -- 172.21.15.134:0/250264474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0480fe410 msgr2=0x7fd04819bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 --2- 172.21.15.134:0/250264474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0480fe410 0x7fd04819bf90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd044006010 tx=0x7fd04400be20 comp rx=0 tx=0).stop 2024-04-13T10:57:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 -- 172.21.15.134:0/250264474 shutdown_connections 2024-04-13T10:57:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 --2- 172.21.15.134:0/250264474 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7fd03406c6d0 0x7fd03406eb80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 --2- 172.21.15.134:0/250264474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0480fe410 0x7fd04819bf90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 --2- 172.21.15.134:0/250264474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0480ff180 0x7fd04819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 -- 172.21.15.134:0/250264474 >> 172.21.15.134:0/250264474 conn(0x7fd0480f9d80 msgr2=0x7fd0481023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 -- 172.21.15.134:0/250264474 shutdown_connections 2024-04-13T10:57:14.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.388+0000 7fd0500cc700 1 -- 172.21.15.134:0/250264474 wait complete. 2024-04-13T10:57:14.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.502+0000 7f363432c700 1 -- 172.21.15.134:0/289838105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f362c0ff080 msgr2=0x7f362c0ff490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:14.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.502+0000 7f363432c700 1 --2- 172.21.15.134:0/289838105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f362c0ff080 0x7f362c0ff490 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3628009910 tx=0x7f3628009c20 comp rx=0 tx=0).stop 2024-04-13T10:57:14.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.503+0000 7f363432c700 1 -- 172.21.15.134:0/289838105 shutdown_connections 2024-04-13T10:57:14.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.503+0000 7f363432c700 1 --2- 172.21.15.134:0/289838105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f362c100280 0x7f362c1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.503+0000 7f363432c700 1 --2- 172.21.15.134:0/289838105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f362c0ff080 0x7f362c0ff490 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.503+0000 7f363432c700 1 -- 172.21.15.134:0/289838105 >> 172.21.15.134:0/289838105 conn(0x7f362c0fa630 msgr2=0x7f362c0fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:14.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.503+0000 7f363432c700 1 -- 172.21.15.134:0/289838105 shutdown_connections 2024-04-13T10:57:14.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.503+0000 7f363432c700 1 -- 172.21.15.134:0/289838105 wait complete. 2024-04-13T10:57:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.503+0000 7f363432c700 1 Processor -- start 2024-04-13T10:57:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.503+0000 7f363432c700 1 -- start start 2024-04-13T10:57:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f363432c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f362c0ff080 0x7f362c1958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f363432c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f362c100280 0x7f362c195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f363432c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c196410 con 0x7f362c100280 2024-04-13T10:57:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f363432c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c196550 con 0x7f362c0ff080 2024-04-13T10:57:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f36318c7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f362c100280 0x7f362c195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f36318c7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f362c100280 0x7f362c195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59392/0 (socket says 172.21.15.134:59392) 2024-04-13T10:57:14.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f36318c7700 1 -- 172.21.15.134:0/1959525081 learned_addr learned my addr 172.21.15.134:0/1959525081 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:57:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f36320c8700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f362c0ff080 0x7f362c1958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f36318c7700 1 -- 172.21.15.134:0/1959525081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f362c0ff080 msgr2=0x7f362c1958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f36318c7700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f362c0ff080 0x7f362c1958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f36318c7700 1 -- 172.21.15.134:0/1959525081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280095f0 con 0x7f362c100280 2024-04-13T10:57:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.504+0000 7f36318c7700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f362c100280 0x7f362c195df0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f361c00e920 tx=0x7f361c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.505+0000 7f36237fe700 1 -- 172.21.15.134:0/1959525081 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361c00c9d0 con 0x7f362c100280 2024-04-13T10:57:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.505+0000 7f36237fe700 1 -- 172.21.15.134:0/1959525081 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f361c010430 con 0x7f362c100280 2024-04-13T10:57:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.505+0000 7f36237fe700 1 -- 172.21.15.134:0/1959525081 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361c018630 con 0x7f362c100280 2024-04-13T10:57:14.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.505+0000 7f363432c700 1 -- 172.21.15.134:0/1959525081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c19b000 con 0x7f362c100280 2024-04-13T10:57:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.505+0000 7f363432c700 1 -- 172.21.15.134:0/1959525081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c19b5a0 con 0x7f362c100280 2024-04-13T10:57:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.506+0000 7f363432c700 1 -- 172.21.15.134:0/1959525081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c108b90 con 0x7f362c100280 2024-04-13T10:57:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.507+0000 7f36237fe700 1 -- 172.21.15.134:0/1959525081 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f361c0105a0 con 0x7f362c100280 2024-04-13T10:57:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.507+0000 7f36237fe700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f361806c6d0 0x7f361806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:14.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.507+0000 7f36237fe700 1 -- 172.21.15.134:0/1959525081 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f361c014070 con 0x7f362c100280 2024-04-13T10:57:14.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.507+0000 7f36320c8700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f361806c6d0 0x7f361806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:14.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.508+0000 7f36320c8700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f361806c6d0 0x7f361806eb80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3628009fd0 tx=0x7f362800b5a0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:14.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.512+0000 7f36237fe700 1 -- 172.21.15.134:0/1959525081 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f361c051720 con 0x7f362c100280 2024-04-13T10:57:14.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.743+0000 7f363432c700 1 -- 172.21.15.134:0/1959525081 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f362c104bd0 con 0x7f361806c6d0 2024-04-13T10:57:14.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.744+0000 7f36237fe700 1 -- 172.21.15.134:0/1959525081 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f362c104bd0 con 0x7f361806c6d0 2024-04-13T10:57:14.745 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:57:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T10:57:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T10:57:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-13T10:57:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-04-13T10:57:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "0/2 daemons upgraded", 2024-04-13T10:57:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39 image on host smithi194", 2024-04-13T10:57:14.745 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T10:57:14.745 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:57:14.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 -- 172.21.15.134:0/1959525081 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f361806c6d0 msgr2=0x7f361806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:14.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f361806c6d0 0x7f361806eb80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3628009fd0 tx=0x7f362800b5a0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 -- 172.21.15.134:0/1959525081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f362c100280 msgr2=0x7f362c195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:14.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f362c100280 0x7f362c195df0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f361c00e920 tx=0x7f361c00ec30 comp rx=0 tx=0).stop 2024-04-13T10:57:14.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 -- 172.21.15.134:0/1959525081 shutdown_connections 2024-04-13T10:57:14.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f361806c6d0 0x7f361806eb80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f362c0ff080 0x7f362c1958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 --2- 172.21.15.134:0/1959525081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f362c100280 0x7f362c195df0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:14.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 -- 172.21.15.134:0/1959525081 >> 172.21.15.134:0/1959525081 conn(0x7f362c0fa630 msgr2=0x7f362c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 -- 172.21.15.134:0/1959525081 shutdown_connections 2024-04-13T10:57:14.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:14.747+0000 7f363432c700 1 -- 172.21.15.134:0/1959525081 wait complete. 2024-04-13T10:57:14.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:14 smithi194 ceph-mon[46737]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:14.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:14 smithi194 ceph-mon[46737]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:14.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:14 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/250264474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:57:14.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:14 smithi134 ceph-mon[39696]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:14.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:14 smithi134 ceph-mon[39696]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:14.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:14 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/250264474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:57:15.859 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:15 smithi134 ceph-mon[39696]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:15.859 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:15 smithi134 ceph-mon[39696]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:15.859 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:15 smithi134 ceph-mon[39696]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:15 smithi194 ceph-mon[46737]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:15 smithi194 ceph-mon[46737]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:15 smithi194 ceph-mon[46737]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:17 smithi134 ceph-mon[39696]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:17 smithi194 ceph-mon[46737]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:19.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:19 smithi134 ceph-mon[39696]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:19 smithi194 ceph-mon[46737]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:21 smithi134 ceph-mon[39696]: pgmap v240: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:21 smithi194 ceph-mon[46737]: pgmap v240: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:23 smithi134 ceph-mon[39696]: pgmap v241: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:24.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:23 smithi194 ceph-mon[46737]: pgmap v241: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:25.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:25 smithi134 ceph-mon[39696]: pgmap v242: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:25 smithi194 ceph-mon[46737]: pgmap v242: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:27 smithi134 ceph-mon[39696]: pgmap v243: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:27 smithi194 ceph-mon[46737]: pgmap v243: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T10:57:28.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:28 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:57:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:28 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:57:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:29 smithi134 ceph-mon[39696]: pgmap v244: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-13T10:57:29.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:29 smithi194 ceph-mon[46737]: pgmap v244: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-13T10:57:31.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:31 smithi134 ceph-mon[39696]: pgmap v245: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:31 smithi194 ceph-mon[46737]: pgmap v245: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:33 smithi134 ceph-mon[39696]: pgmap v246: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-13T10:57:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:33 smithi194 ceph-mon[46737]: pgmap v246: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-13T10:57:35.033 INFO:tasks.workunit.client.0.smithi134.stderr:Updating files: 90% (11347/12473) Updating files: 91% (11351/12473) Updating files: 92% (11476/12473) Updating files: 93% (11600/12473) Updating files: 94% (11725/12473) Updating files: 95% (11850/12473) Updating files: 96% (11975/12473) Updating files: 97% (12099/12473) Updating files: 98% (12224/12473) Updating files: 99% (12349/12473) Updating files: 100% (12473/12473) Updating files: 100% (12473/12473), done. 2024-04-13T10:57:35.467 INFO:tasks.workunit.client.0.smithi134.stderr:Note: switching to 'd540ebaca6b131a1dd560e7f69e024b133bbaa42'. 2024-04-13T10:57:35.467 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-04-13T10:57:35.467 INFO:tasks.workunit.client.0.smithi134.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-13T10:57:35.467 INFO:tasks.workunit.client.0.smithi134.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-13T10:57:35.467 INFO:tasks.workunit.client.0.smithi134.stderr:state without impacting any branches by switching back to a branch. 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr: git switch -c 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr:Or undo this operation with: 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr: git switch - 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-04-13T10:57:35.468 INFO:tasks.workunit.client.0.smithi134.stderr:HEAD is now at d540ebaca6b Merge pull request #56672 from batrick/wip-65294-reef 2024-04-13T10:57:35.474 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-13T10:57:35.580 INFO:tasks.workunit.client.0.smithi134.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-13T10:57:35.582 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-13T10:57:35.582 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-13T10:57:35.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:35 smithi134 ceph-mon[39696]: pgmap v247: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:35 smithi194 ceph-mon[46737]: pgmap v247: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T10:57:37.176 INFO:tasks.workunit.client.1.smithi194.stderr:Updating files: 79% (9932/12473) Updating files: 80% (9979/12473) Updating files: 81% (10104/12473) Updating files: 82% (10228/12473) Updating files: 83% (10353/12473) Updating files: 84% (10478/12473) Updating files: 85% (10603/12473) Updating files: 86% (10727/12473) Updating files: 87% (10852/12473) Updating files: 88% (10977/12473) Updating files: 89% (11101/12473) Updating files: 90% (11226/12473) Updating files: 91% (11351/12473) Updating files: 92% (11476/12473) Updating files: 93% (11600/12473) Updating files: 94% (11725/12473) Updating files: 95% (11850/12473) Updating files: 96% (11975/12473) Updating files: 97% (12099/12473) Updating files: 98% (12224/12473) Updating files: 99% (12349/12473) Updating files: 100% (12473/12473) Updating files: 100% (12473/12473), done. 2024-04-13T10:57:37.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:37 smithi134 ceph-mon[39696]: pgmap v248: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-13T10:57:37.699 INFO:tasks.workunit.client.1.smithi194.stderr:Note: switching to 'd540ebaca6b131a1dd560e7f69e024b133bbaa42'. 2024-04-13T10:57:37.700 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-04-13T10:57:37.700 INFO:tasks.workunit.client.1.smithi194.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-13T10:57:37.700 INFO:tasks.workunit.client.1.smithi194.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-13T10:57:37.700 INFO:tasks.workunit.client.1.smithi194.stderr:state without impacting any branches by switching back to a branch. 2024-04-13T10:57:37.700 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-04-13T10:57:37.700 INFO:tasks.workunit.client.1.smithi194.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-13T10:57:37.700 INFO:tasks.workunit.client.1.smithi194.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-13T10:57:37.700 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-04-13T10:57:37.700 INFO:tasks.workunit.client.1.smithi194.stderr: git switch -c 2024-04-13T10:57:37.700 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-04-13T10:57:37.701 INFO:tasks.workunit.client.1.smithi194.stderr:Or undo this operation with: 2024-04-13T10:57:37.701 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-04-13T10:57:37.701 INFO:tasks.workunit.client.1.smithi194.stderr: git switch - 2024-04-13T10:57:37.701 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-04-13T10:57:37.701 INFO:tasks.workunit.client.1.smithi194.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-13T10:57:37.701 INFO:tasks.workunit.client.1.smithi194.stderr: 2024-04-13T10:57:37.701 INFO:tasks.workunit.client.1.smithi194.stderr:HEAD is now at d540ebaca6b Merge pull request #56672 from batrick/wip-65294-reef 2024-04-13T10:57:37.706 DEBUG:teuthology.orchestra.run.smithi194:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-13T10:57:37.773 INFO:tasks.workunit.client.1.smithi194.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-13T10:57:37.775 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-13T10:57:37.775 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-13T10:57:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:37 smithi194 ceph-mon[46737]: pgmap v248: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-13T10:57:38.294 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-13T10:57:38.348 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-13T10:57:38.386 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-13T10:57:38.388 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-13T10:57:38.388 INFO:tasks.workunit.client.1.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-13T10:57:38.426 INFO:tasks.workunit.client.1.smithi194.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-13T10:57:38.429 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-04-13T10:57:38.429 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-13T10:57:38.489 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-13T10:57:38.491 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-13T10:57:38.492 DEBUG:teuthology.orchestra.run.smithi194:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-13T10:57:38.560 INFO:tasks.workunit.client.1.smithi194.stderr:+ mkdir -p fsstress 2024-04-13T10:57:38.563 INFO:tasks.workunit.client.1.smithi194.stderr:+ pushd fsstress 2024-04-13T10:57:38.564 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-13T10:57:38.565 INFO:tasks.workunit.client.1.smithi194.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-13T10:57:39.478 INFO:tasks.workunit.client.1.smithi194.stderr:+ tar xzf ltp-full.tgz 2024-04-13T10:57:39.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:39 smithi134 ceph-mon[39696]: pgmap v249: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-13T10:57:39.963 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-13T10:57:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:39 smithi194 ceph-mon[46737]: pgmap v249: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-13T10:57:40.117 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-13T10:57:40.216 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-13T10:57:40.217 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-13T10:57:40.217 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-13T10:57:40.310 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-13T10:57:40.314 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T10:57:40.314 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-13T10:57:40.333 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-13T10:57:40.335 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-13T10:57:40.335 DEBUG:teuthology.orchestra.run.smithi134:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-13T10:57:40.464 INFO:tasks.workunit.client.0.smithi134.stderr:+ mkdir -p fsstress 2024-04-13T10:57:40.467 INFO:tasks.workunit.client.0.smithi134.stderr:+ pushd fsstress 2024-04-13T10:57:40.468 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-13T10:57:40.468 INFO:tasks.workunit.client.0.smithi134.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-13T10:57:41.328 INFO:tasks.workunit.client.0.smithi134.stderr:+ tar xzf ltp-full.tgz 2024-04-13T10:57:41.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:41 smithi134 ceph-mon[39696]: pgmap v250: 65 pgs: 65 active+clean; 6.9 MiB data, 166 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 544 KiB/s wr, 4 op/s 2024-04-13T10:57:41.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:41 smithi194 ceph-mon[46737]: pgmap v250: 65 pgs: 65 active+clean; 6.9 MiB data, 166 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 544 KiB/s wr, 4 op/s 2024-04-13T10:57:43.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:43 smithi134 ceph-mon[39696]: pgmap v251: 65 pgs: 65 active+clean; 16 MiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1.3 MiB/s wr, 16 op/s 2024-04-13T10:57:43.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:43 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:57:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:43 smithi194 ceph-mon[46737]: pgmap v251: 65 pgs: 65 active+clean; 16 MiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1.3 MiB/s wr, 16 op/s 2024-04-13T10:57:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:43 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:57:44.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.892+0000 7efc178f2700 1 -- 172.21.15.134:0/1630090958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc100ff050 msgr2=0x7efc100ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:44.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.892+0000 7efc178f2700 1 --2- 172.21.15.134:0/1630090958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc100ff050 0x7efc100ff460 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009910 tx=0x7efc0c009c20 comp rx=0 tx=0).stop 2024-04-13T10:57:44.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.892+0000 7efc178f2700 1 -- 172.21.15.134:0/1630090958 shutdown_connections 2024-04-13T10:57:44.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.892+0000 7efc178f2700 1 --2- 172.21.15.134:0/1630090958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc10100250 0x7efc101006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:44.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.892+0000 7efc178f2700 1 --2- 172.21.15.134:0/1630090958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc100ff050 0x7efc100ff460 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:44.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.892+0000 7efc178f2700 1 -- 172.21.15.134:0/1630090958 >> 172.21.15.134:0/1630090958 conn(0x7efc100fa600 msgr2=0x7efc100fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:44.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.892+0000 7efc178f2700 1 -- 172.21.15.134:0/1630090958 shutdown_connections 2024-04-13T10:57:44.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.892+0000 7efc178f2700 1 -- 172.21.15.134:0/1630090958 wait complete. 2024-04-13T10:57:44.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc178f2700 1 Processor -- start 2024-04-13T10:57:44.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc178f2700 1 -- start start 2024-04-13T10:57:44.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc178f2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc100ff050 0x7efc10193670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:44.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc178f2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc10100250 0x7efc10193bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:44.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc178f2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc101941d0 con 0x7efc10100250 2024-04-13T10:57:44.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc178f2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc10194310 con 0x7efc100ff050 2024-04-13T10:57:44.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc14e8d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc10100250 0x7efc10193bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:44.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc14e8d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc10100250 0x7efc10193bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41080/0 (socket says 172.21.15.134:41080) 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc14e8d700 1 -- 172.21.15.134:0/4232147301 learned_addr learned my addr 172.21.15.134:0/4232147301 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc1568e700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc100ff050 0x7efc10193670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc14e8d700 1 -- 172.21.15.134:0/4232147301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc100ff050 msgr2=0x7efc10193670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc14e8d700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc100ff050 0x7efc10193670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.893+0000 7efc14e8d700 1 -- 172.21.15.134:0/4232147301 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0095f0 con 0x7efc10100250 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.894+0000 7efc14e8d700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc10100250 0x7efc10193bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efc0000e920 tx=0x7efc0000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.894+0000 7efc067fc700 1 -- 172.21.15.134:0/4232147301 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc0000c9d0 con 0x7efc10100250 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.894+0000 7efc178f2700 1 -- 172.21.15.134:0/4232147301 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc10198dc0 con 0x7efc10100250 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.894+0000 7efc067fc700 1 -- 172.21.15.134:0/4232147301 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7efc00010430 con 0x7efc10100250 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.894+0000 7efc067fc700 1 -- 172.21.15.134:0/4232147301 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc00018630 con 0x7efc10100250 2024-04-13T10:57:44.895 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.894+0000 7efc178f2700 1 -- 172.21.15.134:0/4232147301 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc10199360 con 0x7efc10100250 2024-04-13T10:57:44.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.895+0000 7efc178f2700 1 -- 172.21.15.134:0/4232147301 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc10106950 con 0x7efc10100250 2024-04-13T10:57:44.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.896+0000 7efc067fc700 1 -- 172.21.15.134:0/4232147301 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7efc000105a0 con 0x7efc10100250 2024-04-13T10:57:44.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.896+0000 7efc067fc700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7efbfc06c6d0 0x7efbfc06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:44.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.897+0000 7efc1568e700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7efbfc06c6d0 0x7efbfc06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:44.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.897+0000 7efc067fc700 1 -- 172.21.15.134:0/4232147301 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7efc00014070 con 0x7efc10100250 2024-04-13T10:57:44.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.897+0000 7efc1568e700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7efbfc06c6d0 0x7efbfc06eb80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efc0c006010 tx=0x7efc0c000bc0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:44.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:44.905+0000 7efc067fc700 1 -- 172.21.15.134:0/4232147301 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efc00051720 con 0x7efc10100250 2024-04-13T10:57:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:44 smithi194 ceph-mon[46737]: Upgrade: Updating mgr.smithi194.tcpynt 2024-04-13T10:57:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:44 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:44 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.tcpynt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:57:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:44 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T10:57:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:44 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:57:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:44 smithi194 ceph-mon[46737]: Deploying daemon mgr.smithi194.tcpynt on smithi194 2024-04-13T10:57:45.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:44 smithi134 ceph-mon[39696]: Upgrade: Updating mgr.smithi194.tcpynt 2024-04-13T10:57:45.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:44 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:45.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:44 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.tcpynt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:57:45.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:44 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T10:57:45.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:44 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:57:45.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:44 smithi134 ceph-mon[39696]: Deploying daemon mgr.smithi194.tcpynt on smithi194 2024-04-13T10:57:45.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.219+0000 7efc178f2700 1 -- 172.21.15.134:0/4232147301 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efc10104ba0 con 0x7efbfc06c6d0 2024-04-13T10:57:45.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.221+0000 7efc067fc700 1 -- 172.21.15.134:0/4232147301 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7efc10104ba0 con 0x7efbfc06c6d0 2024-04-13T10:57:45.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 -- 172.21.15.134:0/4232147301 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7efbfc06c6d0 msgr2=0x7efbfc06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:45.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7efbfc06c6d0 0x7efbfc06eb80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efc0c006010 tx=0x7efc0c000bc0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 -- 172.21.15.134:0/4232147301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc10100250 msgr2=0x7efc10193bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:45.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc10100250 0x7efc10193bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efc0000e920 tx=0x7efc0000ec30 comp rx=0 tx=0).stop 2024-04-13T10:57:45.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 -- 172.21.15.134:0/4232147301 shutdown_connections 2024-04-13T10:57:45.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7efbfc06c6d0 0x7efbfc06eb80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc100ff050 0x7efc10193670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 --2- 172.21.15.134:0/4232147301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc10100250 0x7efc10193bb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 -- 172.21.15.134:0/4232147301 >> 172.21.15.134:0/4232147301 conn(0x7efc100fa600 msgr2=0x7efc10103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:45.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 -- 172.21.15.134:0/4232147301 shutdown_connections 2024-04-13T10:57:45.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.224+0000 7efc178f2700 1 -- 172.21.15.134:0/4232147301 wait complete. 2024-04-13T10:57:45.235 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T10:57:45.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.373+0000 7f1a68594700 1 -- 172.21.15.134:0/1047784590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a60103500 msgr2=0x7f1a601058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:45.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.373+0000 7f1a68594700 1 --2- 172.21.15.134:0/1047784590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a60103500 0x7f1a601058e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009910 tx=0x7f1a50009c20 comp rx=0 tx=0).stop 2024-04-13T10:57:45.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.373+0000 7f1a68594700 1 -- 172.21.15.134:0/1047784590 shutdown_connections 2024-04-13T10:57:45.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.373+0000 7f1a68594700 1 --2- 172.21.15.134:0/1047784590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a60103500 0x7f1a601058e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.373+0000 7f1a68594700 1 --2- 172.21.15.134:0/1047784590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a60100be0 0x7f1a60102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.373+0000 7f1a68594700 1 -- 172.21.15.134:0/1047784590 >> 172.21.15.134:0/1047784590 conn(0x7f1a600fa5e0 msgr2=0x7f1a600fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:45.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.374+0000 7f1a68594700 1 -- 172.21.15.134:0/1047784590 shutdown_connections 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.374+0000 7f1a68594700 1 -- 172.21.15.134:0/1047784590 wait complete. 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.374+0000 7f1a68594700 1 Processor -- start 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.374+0000 7f1a68594700 1 -- start start 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a68594700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a60100be0 0x7f1a60195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a68594700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a60103500 0x7f1a60195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a68594700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a601964c0 con 0x7f1a60100be0 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a68594700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a60196600 con 0x7f1a60103500 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a66330700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a60100be0 0x7f1a60195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a66330700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a60100be0 0x7f1a60195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41098/0 (socket says 172.21.15.134:41098) 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a66330700 1 -- 172.21.15.134:0/1756455805 learned_addr learned my addr 172.21.15.134:0/1756455805 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a65b2f700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a60103500 0x7f1a60195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:45.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a66330700 1 -- 172.21.15.134:0/1756455805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a60103500 msgr2=0x7f1a60195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:45.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a66330700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a60103500 0x7f1a60195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.375+0000 7f1a66330700 1 -- 172.21.15.134:0/1756455805 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500095f0 con 0x7f1a60100be0 2024-04-13T10:57:45.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.376+0000 7f1a66330700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a60100be0 0x7f1a60195960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00b4b0 tx=0x7f1a5c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:45.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.376+0000 7f1a577fe700 1 -- 172.21.15.134:0/1756455805 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c011800 con 0x7f1a60100be0 2024-04-13T10:57:45.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.376+0000 7f1a68594700 1 -- 172.21.15.134:0/1756455805 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6019b0b0 con 0x7f1a60100be0 2024-04-13T10:57:45.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.376+0000 7f1a68594700 1 -- 172.21.15.134:0/1756455805 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6019b680 con 0x7f1a60100be0 2024-04-13T10:57:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.377+0000 7f1a577fe700 1 -- 172.21.15.134:0/1756455805 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f1a5c011df0 con 0x7f1a60100be0 2024-04-13T10:57:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.377+0000 7f1a577fe700 1 -- 172.21.15.134:0/1756455805 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c01ae70 con 0x7f1a60100be0 2024-04-13T10:57:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.378+0000 7f1a557fa700 1 -- 172.21.15.134:0/1756455805 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a44005320 con 0x7f1a60100be0 2024-04-13T10:57:45.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.378+0000 7f1a577fe700 1 -- 172.21.15.134:0/1756455805 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f1a5c0193b0 con 0x7f1a60100be0 2024-04-13T10:57:45.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.378+0000 7f1a577fe700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a4c06c680 0x7f1a4c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:45.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.379+0000 7f1a577fe700 1 -- 172.21.15.134:0/1756455805 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1a5c08b330 con 0x7f1a60100be0 2024-04-13T10:57:45.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.379+0000 7f1a65b2f700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a4c06c680 0x7f1a4c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:45.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.379+0000 7f1a65b2f700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a4c06c680 0x7f1a4c06eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a50006010 tx=0x7f1a5000b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:45.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.384+0000 7f1a577fe700 1 -- 172.21.15.134:0/1756455805 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1a5c05a450 con 0x7f1a60100be0 2024-04-13T10:57:45.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.691+0000 7f1a557fa700 1 -- 172.21.15.134:0/1756455805 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a44000bf0 con 0x7f1a4c06c680 2024-04-13T10:57:45.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.692+0000 7f1a577fe700 1 -- 172.21.15.134:0/1756455805 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f1a44000bf0 con 0x7f1a4c06c680 2024-04-13T10:57:45.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 -- 172.21.15.134:0/1756455805 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a4c06c680 msgr2=0x7f1a4c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:45.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a4c06c680 0x7f1a4c06eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a50006010 tx=0x7f1a5000b540 comp rx=0 tx=0).stop 2024-04-13T10:57:45.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 -- 172.21.15.134:0/1756455805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a60100be0 msgr2=0x7f1a60195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:45.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a60100be0 0x7f1a60195960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00b4b0 tx=0x7f1a5c00b7c0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 -- 172.21.15.134:0/1756455805 shutdown_connections 2024-04-13T10:57:45.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f1a4c06c680 0x7f1a4c06eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a60100be0 0x7f1a60195960 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 --2- 172.21.15.134:0/1756455805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a60103500 0x7f1a60195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 -- 172.21.15.134:0/1756455805 >> 172.21.15.134:0/1756455805 conn(0x7f1a600fa5e0 msgr2=0x7f1a600fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:45.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 -- 172.21.15.134:0/1756455805 shutdown_connections 2024-04-13T10:57:45.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.695+0000 7f1a557fa700 1 -- 172.21.15.134:0/1756455805 wait complete. 2024-04-13T10:57:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.818+0000 7f941865e700 1 -- 172.21.15.134:0/2432239538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9410100150 msgr2=0x7f9410100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.818+0000 7f941865e700 1 --2- 172.21.15.134:0/2432239538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9410100150 0x7f9410100560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f940c009910 tx=0x7f940c009c20 comp rx=0 tx=0).stop 2024-04-13T10:57:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.818+0000 7f941865e700 1 -- 172.21.15.134:0/2432239538 shutdown_connections 2024-04-13T10:57:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.818+0000 7f941865e700 1 --2- 172.21.15.134:0/2432239538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9410101350 0x7f94101017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.818+0000 7f941865e700 1 --2- 172.21.15.134:0/2432239538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9410100150 0x7f9410100560 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.818+0000 7f941865e700 1 -- 172.21.15.134:0/2432239538 >> 172.21.15.134:0/2432239538 conn(0x7f94100fb6e0 msgr2=0x7f94100fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.818+0000 7f941865e700 1 -- 172.21.15.134:0/2432239538 shutdown_connections 2024-04-13T10:57:45.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.819+0000 7f941865e700 1 -- 172.21.15.134:0/2432239538 wait complete. 2024-04-13T10:57:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.819+0000 7f941865e700 1 Processor -- start 2024-04-13T10:57:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.819+0000 7f941865e700 1 -- start start 2024-04-13T10:57:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.819+0000 7f941865e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9410100150 0x7f94101958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.819+0000 7f941865e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9410101350 0x7f9410195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.819+0000 7f941865e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9410196410 con 0x7f9410100150 2024-04-13T10:57:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f941865e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9410196550 con 0x7f9410101350 2024-04-13T10:57:45.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f94163fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9410100150 0x7f94101958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f94163fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9410100150 0x7f94101958b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41114/0 (socket says 172.21.15.134:41114) 2024-04-13T10:57:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f94163fa700 1 -- 172.21.15.134:0/547131853 learned_addr learned my addr 172.21.15.134:0/547131853 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:57:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f9415bf9700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9410101350 0x7f9410195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f94163fa700 1 -- 172.21.15.134:0/547131853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9410101350 msgr2=0x7f9410195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f94163fa700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9410101350 0x7f9410195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f94163fa700 1 -- 172.21.15.134:0/547131853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c0095f0 con 0x7f9410100150 2024-04-13T10:57:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f94163fa700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9410100150 0x7f94101958b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f940c000c00 tx=0x7f940c00bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f94077fe700 1 -- 172.21.15.134:0/547131853 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f940c01d070 con 0x7f9410100150 2024-04-13T10:57:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f94077fe700 1 -- 172.21.15.134:0/547131853 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f940c005710 con 0x7f9410100150 2024-04-13T10:57:45.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f941865e700 1 -- 172.21.15.134:0/547131853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941019afa0 con 0x7f9410100150 2024-04-13T10:57:45.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f94077fe700 1 -- 172.21.15.134:0/547131853 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f940c0039c0 con 0x7f9410100150 2024-04-13T10:57:45.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.820+0000 7f941865e700 1 -- 172.21.15.134:0/547131853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941019b430 con 0x7f9410100150 2024-04-13T10:57:45.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.821+0000 7f941865e700 1 -- 172.21.15.134:0/547131853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9410108b60 con 0x7f9410100150 2024-04-13T10:57:45.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.822+0000 7f94077fe700 1 -- 172.21.15.134:0/547131853 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f940c0041f0 con 0x7f9410100150 2024-04-13T10:57:45.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.823+0000 7f94077fe700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f93fc06c680 0x7f93fc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:45.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.823+0000 7f94077fe700 1 -- 172.21.15.134:0/547131853 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f940c08cf40 con 0x7f9410100150 2024-04-13T10:57:45.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.823+0000 7f9415bf9700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f93fc06c680 0x7f93fc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:45.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.823+0000 7f9415bf9700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f93fc06c680 0x7f93fc06eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9400009c60 tx=0x7f9400009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:45.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:45.829+0000 7f94077fe700 1 -- 172.21.15.134:0/547131853 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f940c0bf720 con 0x7f9410100150 2024-04-13T10:57:46.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.141+0000 7f941865e700 1 -- 172.21.15.134:0/547131853 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9410105ca0 con 0x7f93fc06c680 2024-04-13T10:57:46.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.158+0000 7f94077fe700 1 -- 172.21.15.134:0/547131853 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f9410105ca0 con 0x7f93fc06c680 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 92s ago 8m 24.8M - 0.25.0 c8568f914cd2 8d2cf34cad2a 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (8m) 92s ago 8m 7440k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (7m) 99s ago 7m 7172k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (8m) 92s ago 8m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (7m) 99s ago 7m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (6m) 92s ago 7m 86.9M - 9.4.7 954c08fa6188 1038718f4fd4 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (2m) 92s ago 2m 12.5M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (115s) 92s ago 115s 15.6M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (113s) 99s ago 112s 11.5M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (119s) 99s ago 119s 15.6M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T10:57:46.158 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:9283,8765,8443 running (9m) 92s ago 9m 487M - 18.2.0 dc2bc1663786 3b88cc824ec3 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (6m) 99s ago 6m 437M - 18.2.0 dc2bc1663786 810301983f71 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (9m) 92s ago 9m 44.3M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (6m) 99s ago 6m 36.1M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (8m) 92s ago 8m 15.5M - 1.5.0 0da6a335fe13 da23f14cbdef 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (7m) 99s ago 6m 18.2M - 1.5.0 0da6a335fe13 242da19a461b 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (6m) 92s ago 6m 48.2M 3958M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (5m) 92s ago 5m 47.7M 3958M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (5m) 92s ago 5m 46.7M 3958M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (4m) 99s ago 4m 46.1M 4982M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (4m) 99s ago 4m 44.6M 4982M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (3m) 99s ago 3m 45.9M 4982M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T10:57:46.159 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 92s ago 7m 61.6M - 2.43.0 a07b618ecd1d a5240fafbf97 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 -- 172.21.15.134:0/547131853 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f93fc06c680 msgr2=0x7f93fc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f93fc06c680 0x7f93fc06eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9400009c60 tx=0x7f9400009260 comp rx=0 tx=0).stop 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 -- 172.21.15.134:0/547131853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9410100150 msgr2=0x7f94101958b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9410100150 0x7f94101958b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f940c000c00 tx=0x7f940c00bde0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 -- 172.21.15.134:0/547131853 shutdown_connections 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f93fc06c680 0x7f93fc06eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9410100150 0x7f94101958b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 --2- 172.21.15.134:0/547131853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9410101350 0x7f9410195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 -- 172.21.15.134:0/547131853 >> 172.21.15.134:0/547131853 conn(0x7f94100fb6e0 msgr2=0x7f9410104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 -- 172.21.15.134:0/547131853 shutdown_connections 2024-04-13T10:57:46.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.161+0000 7f941865e700 1 -- 172.21.15.134:0/547131853 wait complete. 2024-04-13T10:57:46.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:45 smithi134 ceph-mon[39696]: pgmap v252: 65 pgs: 65 active+clean; 24 MiB data, 213 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 2.0 MiB/s wr, 46 op/s 2024-04-13T10:57:46.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:45 smithi194 ceph-mon[46737]: pgmap v252: 65 pgs: 65 active+clean; 24 MiB data, 213 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 2.0 MiB/s wr, 46 op/s 2024-04-13T10:57:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.306+0000 7f55d0d03700 1 -- 172.21.15.134:0/1292483816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55cc0ff050 msgr2=0x7f55cc0ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.306+0000 7f55d0d03700 1 --2- 172.21.15.134:0/1292483816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55cc0ff050 0x7f55cc0ff460 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00b0a0 tx=0x7f55bc00b3b0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.308+0000 7f55d0d03700 1 -- 172.21.15.134:0/1292483816 shutdown_connections 2024-04-13T10:57:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.308+0000 7f55d0d03700 1 --2- 172.21.15.134:0/1292483816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55cc100250 0x7f55cc1006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.308+0000 7f55d0d03700 1 --2- 172.21.15.134:0/1292483816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55cc0ff050 0x7f55cc0ff460 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.308+0000 7f55d0d03700 1 -- 172.21.15.134:0/1292483816 >> 172.21.15.134:0/1292483816 conn(0x7f55cc0fa5e0 msgr2=0x7f55cc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.312+0000 7f55d0d03700 1 -- 172.21.15.134:0/1292483816 shutdown_connections 2024-04-13T10:57:46.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.312+0000 7f55d0d03700 1 -- 172.21.15.134:0/1292483816 wait complete. 2024-04-13T10:57:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.313+0000 7f55d0d03700 1 Processor -- start 2024-04-13T10:57:46.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.313+0000 7f55d0d03700 1 -- start start 2024-04-13T10:57:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.313+0000 7f55d0d03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55cc0ff050 0x7f55cc1959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.313+0000 7f55d0d03700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55cc100250 0x7f55cc195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.313+0000 7f55d0d03700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc196540 con 0x7f55cc0ff050 2024-04-13T10:57:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.313+0000 7f55d0d03700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc196680 con 0x7f55cc100250 2024-04-13T10:57:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.314+0000 7f55c9d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55cc100250 0x7f55cc195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.314+0000 7f55ca59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55cc0ff050 0x7f55cc1959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.314+0000 7f55c9d9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55cc100250 0x7f55cc195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.134:45076/0 (socket says 172.21.15.134:45076) 2024-04-13T10:57:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.314+0000 7f55ca59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55cc0ff050 0x7f55cc1959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41132/0 (socket says 172.21.15.134:41132) 2024-04-13T10:57:46.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.314+0000 7f55c9d9b700 1 -- 172.21.15.134:0/3574471121 learned_addr learned my addr 172.21.15.134:0/3574471121 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:57:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.314+0000 7f55c9d9b700 1 -- 172.21.15.134:0/3574471121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55cc0ff050 msgr2=0x7f55cc1959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:46.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.314+0000 7f55c9d9b700 1 --2- 172.21.15.134:0/3574471121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55cc0ff050 0x7f55cc1959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.314+0000 7f55c9d9b700 1 -- 172.21.15.134:0/3574471121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc009d00 con 0x7f55cc100250 2024-04-13T10:57:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.314+0000 7f55c9d9b700 1 --2- 172.21.15.134:0/3574471121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55cc100250 0x7f55cc195f20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55c000b4b0 tx=0x7f55c000b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.314+0000 7f55bb7fe700 1 -- 172.21.15.134:0/3574471121 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c0011800 con 0x7f55cc100250 2024-04-13T10:57:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.315+0000 7f55d0d03700 1 -- 172.21.15.134:0/3574471121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc105630 con 0x7f55cc100250 2024-04-13T10:57:46.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.315+0000 7f55d0d03700 1 -- 172.21.15.134:0/3574471121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc105c00 con 0x7f55cc100250 2024-04-13T10:57:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.316+0000 7f55bb7fe700 1 -- 172.21.15.134:0/3574471121 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f55c0011df0 con 0x7f55cc100250 2024-04-13T10:57:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.316+0000 7f55bb7fe700 1 -- 172.21.15.134:0/3574471121 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c0010e50 con 0x7f55cc100250 2024-04-13T10:57:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.316+0000 7f55bb7fe700 1 -- 172.21.15.134:0/3574471121 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f55c001a480 con 0x7f55cc100250 2024-04-13T10:57:46.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.317+0000 7f55d0d03700 1 -- 172.21.15.134:0/3574471121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55cc108be0 con 0x7f55cc100250 2024-04-13T10:57:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.317+0000 7f55bb7fe700 1 --2- 172.21.15.134:0/3574471121 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f55b406c680 0x7f55b406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.317+0000 7f55bb7fe700 1 -- 172.21.15.134:0/3574471121 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f55c008c340 con 0x7f55cc100250 2024-04-13T10:57:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.317+0000 7f55ca59c700 1 --2- 172.21.15.134:0/3574471121 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f55b406c680 0x7f55b406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:46.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.318+0000 7f55ca59c700 1 --2- 172.21.15.134:0/3574471121 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f55b406c680 0x7f55b406eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009fd0 tx=0x7f55bc0060c0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:46.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.323+0000 7f55bb7fe700 1 -- 172.21.15.134:0/3574471121 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f55c005a4d0 con 0x7f55cc100250 2024-04-13T10:57:46.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.769+0000 7f55d0d03700 1 -- 172.21.15.134:0/3574471121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f55cc1067f0 con 0x7f55cc100250 2024-04-13T10:57:46.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.770+0000 7f55bb7fe700 1 -- 172.21.15.134:0/3574471121 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f55c005a060 con 0x7f55cc100250 2024-04-13T10:57:46.771 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:57:46.771 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T10:57:46.771 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T10:57:46.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-04-13T10:57:46.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T10:57:46.773 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:57:46.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 -- 172.21.15.134:0/3574471121 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f55b406c680 msgr2=0x7f55b406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:46.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 --2- 172.21.15.134:0/3574471121 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f55b406c680 0x7f55b406eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009fd0 tx=0x7f55bc0060c0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 -- 172.21.15.134:0/3574471121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55cc100250 msgr2=0x7f55cc195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:46.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 --2- 172.21.15.134:0/3574471121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55cc100250 0x7f55cc195f20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55c000b4b0 tx=0x7f55c000b7c0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 -- 172.21.15.134:0/3574471121 shutdown_connections 2024-04-13T10:57:46.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 --2- 172.21.15.134:0/3574471121 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f55b406c680 0x7f55b406eb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 --2- 172.21.15.134:0/3574471121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55cc0ff050 0x7f55cc1959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 --2- 172.21.15.134:0/3574471121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55cc100250 0x7f55cc195f20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 -- 172.21.15.134:0/3574471121 >> 172.21.15.134:0/3574471121 conn(0x7f55cc0fa5e0 msgr2=0x7f55cc103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:46.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 -- 172.21.15.134:0/3574471121 shutdown_connections 2024-04-13T10:57:46.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.772+0000 7f55d0d03700 1 -- 172.21.15.134:0/3574471121 wait complete. 2024-04-13T10:57:46.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.903+0000 7f852fe71700 1 -- 172.21.15.134:0/2840236284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8528100290 msgr2=0x7f8528100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:46.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.903+0000 7f852fe71700 1 --2- 172.21.15.134:0/2840236284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8528100290 0x7f8528100700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8518009910 tx=0x7f8518009c20 comp rx=0 tx=0).stop 2024-04-13T10:57:46.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.903+0000 7f852fe71700 1 -- 172.21.15.134:0/2840236284 shutdown_connections 2024-04-13T10:57:46.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.903+0000 7f852fe71700 1 --2- 172.21.15.134:0/2840236284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8528100290 0x7f8528100700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.903+0000 7f852fe71700 1 --2- 172.21.15.134:0/2840236284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85280ff570 0x7f85280ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.903+0000 7f852fe71700 1 -- 172.21.15.134:0/2840236284 >> 172.21.15.134:0/2840236284 conn(0x7f85280f9d80 msgr2=0x7f85280fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:46.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.903+0000 7f852fe71700 1 -- 172.21.15.134:0/2840236284 shutdown_connections 2024-04-13T10:57:46.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.903+0000 7f852fe71700 1 -- 172.21.15.134:0/2840236284 wait complete. 2024-04-13T10:57:46.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.904+0000 7f852fe71700 1 Processor -- start 2024-04-13T10:57:46.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.904+0000 7f852fe71700 1 -- start start 2024-04-13T10:57:46.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.904+0000 7f852fe71700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85280ff570 0x7f85280fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:46.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.904+0000 7f852fe71700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8528100290 0x7f852819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:46.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.904+0000 7f852fe71700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528194390 con 0x7f85280ff570 2024-04-13T10:57:46.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.904+0000 7f852fe71700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281944d0 con 0x7f8528100290 2024-04-13T10:57:46.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.904+0000 7f852dc0d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85280ff570 0x7f85280fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:46.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.904+0000 7f852dc0d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85280ff570 0x7f85280fec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41146/0 (socket says 172.21.15.134:41146) 2024-04-13T10:57:46.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.904+0000 7f852dc0d700 1 -- 172.21.15.134:0/2609252620 learned_addr learned my addr 172.21.15.134:0/2609252620 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.904+0000 7f852d40c700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8528100290 0x7f852819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.905+0000 7f852dc0d700 1 -- 172.21.15.134:0/2609252620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8528100290 msgr2=0x7f852819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.905+0000 7f852dc0d700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8528100290 0x7f852819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.905+0000 7f852dc0d700 1 -- 172.21.15.134:0/2609252620 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85180095f0 con 0x7f85280ff570 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.905+0000 7f852d40c700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8528100290 0x7f852819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.905+0000 7f852dc0d700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85280ff570 0x7f85280fec90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f852400e8f0 tx=0x7f852400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.905+0000 7f851effd700 1 -- 172.21.15.134:0/2609252620 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8524009790 con 0x7f85280ff570 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.905+0000 7f851effd700 1 -- 172.21.15.134:0/2609252620 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f852400c810 con 0x7f85280ff570 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.905+0000 7f851effd700 1 -- 172.21.15.134:0/2609252620 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8524003c20 con 0x7f85280ff570 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.905+0000 7f852fe71700 1 -- 172.21.15.134:0/2609252620 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85281947b0 con 0x7f85280ff570 2024-04-13T10:57:46.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.905+0000 7f852fe71700 1 -- 172.21.15.134:0/2609252620 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8528194d80 con 0x7f85280ff570 2024-04-13T10:57:46.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.906+0000 7f852fe71700 1 -- 172.21.15.134:0/2609252620 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8528107a80 con 0x7f85280ff570 2024-04-13T10:57:46.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.907+0000 7f851effd700 1 -- 172.21.15.134:0/2609252620 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f852400c980 con 0x7f85280ff570 2024-04-13T10:57:46.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.907+0000 7f851effd700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f851406c680 0x7f851406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:57:46.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.907+0000 7f851effd700 1 -- 172.21.15.134:0/2609252620 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8524014070 con 0x7f85280ff570 2024-04-13T10:57:46.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.912+0000 7f852d40c700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f851406c680 0x7f851406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:57:46.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.912+0000 7f852d40c700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f851406c680 0x7f851406eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8518009fd0 tx=0x7f851800b5a0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:57:46.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:46.916+0000 7f851effd700 1 -- 172.21.15.134:0/2609252620 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8524059db0 con 0x7f85280ff570 2024-04-13T10:57:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:46 smithi194 ceph-mon[46737]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:46 smithi194 ceph-mon[46737]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:46 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3574471121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:57:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:46 smithi134 ceph-mon[39696]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:46 smithi134 ceph-mon[39696]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:46 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3574471121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:57:47.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.191+0000 7f852fe71700 1 -- 172.21.15.134:0/2609252620 --> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8528104be0 con 0x7f851406c680 2024-04-13T10:57:47.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.192+0000 7f851effd700 1 -- 172.21.15.134:0/2609252620 <== mgr.14215 v2:172.21.15.134:6800/2958657378 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f8528104be0 con 0x7f851406c680 2024-04-13T10:57:47.192 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:57:47.192 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T10:57:47.192 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T10:57:47.192 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-13T10:57:47.192 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-04-13T10:57:47.192 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "0/2 daemons upgraded", 2024-04-13T10:57:47.192 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mgr daemons", 2024-04-13T10:57:47.192 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T10:57:47.192 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:57:47.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 -- 172.21.15.134:0/2609252620 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f851406c680 msgr2=0x7f851406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:47.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f851406c680 0x7f851406eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8518009fd0 tx=0x7f851800b5a0 comp rx=0 tx=0).stop 2024-04-13T10:57:47.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 -- 172.21.15.134:0/2609252620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85280ff570 msgr2=0x7f85280fec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:57:47.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85280ff570 0x7f85280fec90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f852400e8f0 tx=0x7f852400ec00 comp rx=0 tx=0).stop 2024-04-13T10:57:47.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 -- 172.21.15.134:0/2609252620 shutdown_connections 2024-04-13T10:57:47.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.134:6800/2958657378,v1:172.21.15.134:6801/2958657378] conn(0x7f851406c680 0x7f851406eb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:47.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85280ff570 0x7f85280fec90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:47.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 --2- 172.21.15.134:0/2609252620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8528100290 0x7f852819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:57:47.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 -- 172.21.15.134:0/2609252620 >> 172.21.15.134:0/2609252620 conn(0x7f85280f9d80 msgr2=0x7f85281034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:57:47.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 -- 172.21.15.134:0/2609252620 shutdown_connections 2024-04-13T10:57:47.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:57:47.195+0000 7f852fe71700 1 -- 172.21.15.134:0/2609252620 wait complete. 2024-04-13T10:57:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:47 smithi194 ceph-mon[46737]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:47 smithi194 ceph-mon[46737]: pgmap v253: 65 pgs: 65 active+clean; 32 MiB data, 250 MiB used, 536 GiB / 536 GiB avail; 539 KiB/s rd, 2.7 MiB/s wr, 77 op/s 2024-04-13T10:57:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:47 smithi134 ceph-mon[39696]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:47 smithi134 ceph-mon[39696]: pgmap v253: 65 pgs: 65 active+clean; 32 MiB data, 250 MiB used, 536 GiB / 536 GiB avail; 539 KiB/s rd, 2.7 MiB/s wr, 77 op/s 2024-04-13T10:57:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:48 smithi194 ceph-mon[46737]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:48 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:48 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:48 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:57:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:48 smithi134 ceph-mon[39696]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:57:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:48 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:48 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:48 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:57:50.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:49 smithi134 ceph-mon[39696]: pgmap v254: 65 pgs: 65 active+clean; 33 MiB data, 273 MiB used, 536 GiB / 536 GiB avail; 539 KiB/s rd, 2.8 MiB/s wr, 104 op/s 2024-04-13T10:57:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:49 smithi194 ceph-mon[46737]: pgmap v254: 65 pgs: 65 active+clean; 33 MiB data, 273 MiB used, 536 GiB / 536 GiB avail; 539 KiB/s rd, 2.8 MiB/s wr, 104 op/s 2024-04-13T10:57:52.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:51 smithi194 ceph-mon[46737]: pgmap v255: 65 pgs: 65 active+clean; 41 MiB data, 299 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 136 op/s 2024-04-13T10:57:52.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:51 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:52.160 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:51 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:51 smithi134 ceph-mon[39696]: pgmap v255: 65 pgs: 65 active+clean; 41 MiB data, 299 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 136 op/s 2024-04-13T10:57:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:51 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:53.068 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:53.068 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:52 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:53.068 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:52 smithi194 ceph-mon[46737]: pgmap v256: 65 pgs: 65 active+clean; 48 MiB data, 329 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 158 op/s 2024-04-13T10:57:53.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:53.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:52 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:53.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:52 smithi134 ceph-mon[39696]: pgmap v256: 65 pgs: 65 active+clean; 48 MiB data, 329 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 158 op/s 2024-04-13T10:57:55.673 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:55 smithi194 ceph-mon[46737]: pgmap v257: 65 pgs: 65 active+clean; 69 MiB data, 371 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 183 op/s 2024-04-13T10:57:55.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:55 smithi134 ceph-mon[39696]: pgmap v257: 65 pgs: 65 active+clean; 69 MiB data, 371 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 183 op/s 2024-04-13T10:57:56.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:56 smithi134 ceph-mon[39696]: Standby manager daemon smithi194.tcpynt restarted 2024-04-13T10:57:56.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:56 smithi134 ceph-mon[39696]: Standby manager daemon smithi194.tcpynt started 2024-04-13T10:57:56.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:56 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/crt"}]: dispatch 2024-04-13T10:57:56.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:56 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T10:57:56.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:56 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/key"}]: dispatch 2024-04-13T10:57:56.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:56 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T10:57:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:56 smithi194 ceph-mon[46737]: Standby manager daemon smithi194.tcpynt restarted 2024-04-13T10:57:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:56 smithi194 ceph-mon[46737]: Standby manager daemon smithi194.tcpynt started 2024-04-13T10:57:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:56 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/crt"}]: dispatch 2024-04-13T10:57:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:56 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T10:57:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:56 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/key"}]: dispatch 2024-04-13T10:57:56.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:56 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T10:57:57.453 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:57 smithi194 ceph-mon[46737]: pgmap v258: 65 pgs: 65 active+clean; 75 MiB data, 403 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 184 op/s 2024-04-13T10:57:57.453 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:57 smithi194 ceph-mon[46737]: mgrmap e20: smithi134.tmanda(active, since 7m), standbys: smithi194.tcpynt 2024-04-13T10:57:57.453 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:57.453 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:57.453 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:57:57.454 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:57:57.454 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:57.454 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:57 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:57:57.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:57 smithi134 ceph-mon[39696]: pgmap v258: 65 pgs: 65 active+clean; 75 MiB data, 403 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 184 op/s 2024-04-13T10:57:57.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:57 smithi134 ceph-mon[39696]: mgrmap e20: smithi134.tmanda(active, since 7m), standbys: smithi194.tcpynt 2024-04-13T10:57:57.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:57.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:57.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:57:57.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:57:57.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' 2024-04-13T10:57:57.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:57 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:57:58.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr fail", "who": "smithi134.tmanda"}]: dispatch 2024-04-13T10:57:58.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: osdmap e47: 6 total, 6 up, 6 in 2024-04-13T10:57:58.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "mgr fail", "who": "smithi134.tmanda"}]': finished 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: mgrmap e21: smithi194.tcpynt(active, starting, since 0.00579496s) 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.kachce"}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.wnddvg"}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mgr metadata", "who": "smithi194.tcpynt", "id": "smithi194.tcpynt"}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:57:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: Manager daemon smithi194.tcpynt is now available 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.tcpynt/mirror_snapshot_schedule"}]: dispatch 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.tcpynt/mirror_snapshot_schedule"}]: dispatch 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.tcpynt/trash_purge_schedule"}]: dispatch 2024-04-13T10:57:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:58 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.tcpynt/trash_purge_schedule"}]: dispatch 2024-04-13T10:57:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr fail", "who": "smithi134.tmanda"}]: dispatch 2024-04-13T10:57:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: osdmap e47: 6 total, 6 up, 6 in 2024-04-13T10:57:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.14215 172.21.15.134:0/2272452001' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "mgr fail", "who": "smithi134.tmanda"}]': finished 2024-04-13T10:57:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: mgrmap e21: smithi194.tcpynt(active, starting, since 0.00579496s) 2024-04-13T10:57:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:57:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:57:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.kachce"}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.wnddvg"}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mgr metadata", "who": "smithi194.tcpynt", "id": "smithi194.tcpynt"}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-13T10:57:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: Manager daemon smithi194.tcpynt is now available 2024-04-13T10:57:58.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:57:58.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:57:58.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.tcpynt/mirror_snapshot_schedule"}]: dispatch 2024-04-13T10:57:58.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.tcpynt/mirror_snapshot_schedule"}]: dispatch 2024-04-13T10:57:58.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.tcpynt/trash_purge_schedule"}]: dispatch 2024-04-13T10:57:58.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:58 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi194.tcpynt/trash_purge_schedule"}]: dispatch 2024-04-13T10:57:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:59 smithi134 ceph-mon[39696]: [13/Apr/2024:10:57:57] ENGINE Bus STARTING 2024-04-13T10:57:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:59 smithi134 ceph-mon[39696]: Deploying cephadm binary to smithi194 2024-04-13T10:57:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:59 smithi134 ceph-mon[39696]: Deploying cephadm binary to smithi134 2024-04-13T10:57:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:59 smithi134 ceph-mon[39696]: [13/Apr/2024:10:57:58] ENGINE Serving on http://172.21.15.194:8765 2024-04-13T10:57:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:59 smithi134 ceph-mon[39696]: [13/Apr/2024:10:57:58] ENGINE Serving on https://172.21.15.194:7150 2024-04-13T10:57:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:59 smithi134 ceph-mon[39696]: [13/Apr/2024:10:57:58] ENGINE Bus STARTED 2024-04-13T10:57:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:59 smithi134 ceph-mon[39696]: mgrmap e22: smithi194.tcpynt(active, since 1.00853s) 2024-04-13T10:57:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:57:59 smithi134 ceph-mon[39696]: pgmap v3: 65 pgs: 65 active+clean; 94 MiB data, 485 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:59 smithi194 ceph-mon[46737]: [13/Apr/2024:10:57:57] ENGINE Bus STARTING 2024-04-13T10:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:59 smithi194 ceph-mon[46737]: Deploying cephadm binary to smithi194 2024-04-13T10:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:59 smithi194 ceph-mon[46737]: Deploying cephadm binary to smithi134 2024-04-13T10:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:59 smithi194 ceph-mon[46737]: [13/Apr/2024:10:57:58] ENGINE Serving on http://172.21.15.194:8765 2024-04-13T10:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:59 smithi194 ceph-mon[46737]: [13/Apr/2024:10:57:58] ENGINE Serving on https://172.21.15.194:7150 2024-04-13T10:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:59 smithi194 ceph-mon[46737]: [13/Apr/2024:10:57:58] ENGINE Bus STARTED 2024-04-13T10:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:59 smithi194 ceph-mon[46737]: mgrmap e22: smithi194.tcpynt(active, since 1.00853s) 2024-04-13T10:57:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:57:59 smithi194 ceph-mon[46737]: pgmap v3: 65 pgs: 65 active+clean; 94 MiB data, 485 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:58:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:00 smithi194 ceph-mon[46737]: pgmap v4: 65 pgs: 65 active+clean; 94 MiB data, 485 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:58:00.792 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:00 smithi134 ceph-mon[39696]: pgmap v4: 65 pgs: 65 active+clean; 94 MiB data, 485 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:58:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:01 smithi134 ceph-mon[39696]: mgrmap e23: smithi194.tcpynt(active, since 3s) 2024-04-13T10:58:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:01 smithi194 ceph-mon[46737]: mgrmap e23: smithi194.tcpynt(active, since 3s) 2024-04-13T10:58:02.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:02 smithi134 ceph-mon[39696]: pgmap v5: 65 pgs: 65 active+clean; 94 MiB data, 485 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:58:02.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:02 smithi194 ceph-mon[46737]: pgmap v5: 65 pgs: 65 active+clean; 94 MiB data, 485 MiB used, 536 GiB / 536 GiB avail 2024-04-13T10:58:04.600 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:04 smithi134 ceph-mon[39696]: pgmap v6: 65 pgs: 65 active+clean; 94 MiB data, 494 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 73 KiB/s wr, 14 op/s 2024-04-13T10:58:04.600 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:04 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:04.600 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:04 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:04 smithi194 ceph-mon[46737]: pgmap v6: 65 pgs: 65 active+clean; 94 MiB data, 494 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 73 KiB/s wr, 14 op/s 2024-04-13T10:58:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:04 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:04.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:04 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:05.916 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:05 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:05.916 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:05 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:05.916 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:05 smithi134 ceph-mon[39696]: pgmap v7: 65 pgs: 65 active+clean; 107 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 105 op/s 2024-04-13T10:58:05.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:05 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:05.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:05 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:05.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:05 smithi194 ceph-mon[46737]: pgmap v7: 65 pgs: 65 active+clean; 107 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 105 op/s 2024-04-13T10:58:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:06 smithi194 ceph-mon[46737]: Standby manager daemon smithi134.tmanda started 2024-04-13T10:58:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:06 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.134:0/598081029' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.tmanda/crt"}]: dispatch 2024-04-13T10:58:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:06 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.134:0/598081029' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T10:58:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:06 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.134:0/598081029' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.tmanda/key"}]: dispatch 2024-04-13T10:58:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:06 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.134:0/598081029' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T10:58:07.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:06 smithi134 ceph-mon[39696]: Standby manager daemon smithi134.tmanda started 2024-04-13T10:58:07.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:06 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.134:0/598081029' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.tmanda/crt"}]: dispatch 2024-04-13T10:58:07.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:06 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.134:0/598081029' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T10:58:07.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:06 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.134:0/598081029' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.tmanda/key"}]: dispatch 2024-04-13T10:58:07.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:06 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.134:0/598081029' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T10:58:08.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:07 smithi134 ceph-mon[39696]: mgrmap e24: smithi194.tcpynt(active, since 9s), standbys: smithi134.tmanda 2024-04-13T10:58:08.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:07 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mgr metadata", "who": "smithi134.tmanda", "id": "smithi134.tmanda"}]: dispatch 2024-04-13T10:58:08.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:07 smithi134 ceph-mon[39696]: pgmap v8: 65 pgs: 65 active+clean; 107 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 81 op/s 2024-04-13T10:58:08.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:07 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:08.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:07 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:08.247 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:07 smithi194 ceph-mon[46737]: mgrmap e24: smithi194.tcpynt(active, since 9s), standbys: smithi134.tmanda 2024-04-13T10:58:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:07 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mgr metadata", "who": "smithi134.tmanda", "id": "smithi134.tmanda"}]: dispatch 2024-04-13T10:58:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:07 smithi194 ceph-mon[46737]: pgmap v8: 65 pgs: 65 active+clean; 107 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 81 op/s 2024-04-13T10:58:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:07 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:07 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:09.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:09 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:09.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:09 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:09.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:09 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:09 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:09 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:09 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:09 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:09 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:09 smithi134 ceph-mon[39696]: Adjusting osd_memory_target on smithi134 to 1227M 2024-04-13T10:58:09.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:09 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:09 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:09 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:09 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:09 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:09 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:09 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:09 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:09 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:09 smithi194 ceph-mon[46737]: Adjusting osd_memory_target on smithi134 to 1227M 2024-04-13T10:58:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:09 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:10 smithi194 ceph-mon[46737]: pgmap v9: 65 pgs: 65 active+clean; 122 MiB data, 589 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 145 op/s 2024-04-13T10:58:10.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:10 smithi134 ceph-mon[39696]: pgmap v9: 65 pgs: 65 active+clean; 122 MiB data, 589 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 145 op/s 2024-04-13T10:58:12.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:12 smithi134 ceph-mon[39696]: pgmap v10: 65 pgs: 65 active+clean; 122 MiB data, 589 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 132 op/s 2024-04-13T10:58:12.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:12 smithi194 ceph-mon[46737]: pgmap v10: 65 pgs: 65 active+clean; 122 MiB data, 589 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 132 op/s 2024-04-13T10:58:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:13 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:58:13.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:13 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:58:14.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:14 smithi134 ceph-mon[39696]: pgmap v11: 65 pgs: 65 active+clean; 124 MiB data, 605 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 149 op/s 2024-04-13T10:58:14.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:14 smithi194 ceph-mon[46737]: pgmap v11: 65 pgs: 65 active+clean; 124 MiB data, 605 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 149 op/s 2024-04-13T10:58:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: pgmap v12: 65 pgs: 65 active+clean; 147 MiB data, 679 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 260 op/s 2024-04-13T10:58:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:16.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:58:16.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:16 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: pgmap v12: 65 pgs: 65 active+clean; 147 MiB data, 679 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 260 op/s 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:58:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:16 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:58:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.323+0000 7f50ea40b700 1 -- 172.21.15.134:0/3719036355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ff050 msgr2=0x7f50e40ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.323+0000 7f50ea40b700 1 --2- 172.21.15.134:0/3719036355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ff050 0x7f50e40ff460 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009910 tx=0x7f50d4009c20 comp rx=0 tx=0).stop 2024-04-13T10:58:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.323+0000 7f50ea40b700 1 -- 172.21.15.134:0/3719036355 shutdown_connections 2024-04-13T10:58:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.323+0000 7f50ea40b700 1 --2- 172.21.15.134:0/3719036355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e4100250 0x7f50e41006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.323+0000 7f50ea40b700 1 --2- 172.21.15.134:0/3719036355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ff050 0x7f50e40ff460 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.323+0000 7f50ea40b700 1 -- 172.21.15.134:0/3719036355 >> 172.21.15.134:0/3719036355 conn(0x7f50e40fa5e0 msgr2=0x7f50e40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.323+0000 7f50ea40b700 1 -- 172.21.15.134:0/3719036355 shutdown_connections 2024-04-13T10:58:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.323+0000 7f50ea40b700 1 -- 172.21.15.134:0/3719036355 wait complete. 2024-04-13T10:58:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.324+0000 7f50ea40b700 1 Processor -- start 2024-04-13T10:58:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.324+0000 7f50ea40b700 1 -- start start 2024-04-13T10:58:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.324+0000 7f50ea40b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ff050 0x7f50e41958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.324+0000 7f50ea40b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e4100250 0x7f50e4195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.324+0000 7f50ea40b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4196410 con 0x7f50e4100250 2024-04-13T10:58:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.324+0000 7f50ea40b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4196550 con 0x7f50e40ff050 2024-04-13T10:58:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.324+0000 7f50e37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e4100250 0x7f50e4195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.324+0000 7f50e37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e4100250 0x7f50e4195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53894/0 (socket says 172.21.15.134:53894) 2024-04-13T10:58:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.324+0000 7f50e37fe700 1 -- 172.21.15.134:0/445716914 learned_addr learned my addr 172.21.15.134:0/445716914 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:58:17.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.324+0000 7f50e3fff700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ff050 0x7f50e41958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:17.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.325+0000 7f50e37fe700 1 -- 172.21.15.134:0/445716914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ff050 msgr2=0x7f50e41958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:17.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.325+0000 7f50e37fe700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ff050 0x7f50e41958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:17.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.325+0000 7f50e37fe700 1 -- 172.21.15.134:0/445716914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40095f0 con 0x7f50e4100250 2024-04-13T10:58:17.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.325+0000 7f50e37fe700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e4100250 0x7f50e4195df0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f50d800e920 tx=0x7f50d800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:17.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.325+0000 7f50e17fa700 1 -- 172.21.15.134:0/445716914 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50d800c9d0 con 0x7f50e4100250 2024-04-13T10:58:17.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.325+0000 7f50e17fa700 1 -- 172.21.15.134:0/445716914 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f50d8010430 con 0x7f50e4100250 2024-04-13T10:58:17.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.325+0000 7f50ea40b700 1 -- 172.21.15.134:0/445716914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e419b000 con 0x7f50e4100250 2024-04-13T10:58:17.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.325+0000 7f50e17fa700 1 -- 172.21.15.134:0/445716914 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50d8018630 con 0x7f50e4100250 2024-04-13T10:58:17.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.325+0000 7f50ea40b700 1 -- 172.21.15.134:0/445716914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e419b5a0 con 0x7f50e4100250 2024-04-13T10:58:17.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.326+0000 7f50ea40b700 1 -- 172.21.15.134:0/445716914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e4107a60 con 0x7f50e4100250 2024-04-13T10:58:17.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.327+0000 7f50e17fa700 1 -- 172.21.15.134:0/445716914 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 90482+0+0 (secure 0 0 0) 0x7f50d80105a0 con 0x7f50e4100250 2024-04-13T10:58:17.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.327+0000 7f50e17fa700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f50cc06caf0 0x7f50cc06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:17.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.327+0000 7f50e17fa700 1 -- 172.21.15.134:0/445716914 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f50d8014070 con 0x7f50e4100250 2024-04-13T10:58:17.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.328+0000 7f50e3fff700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f50cc06caf0 0x7f50cc06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:17.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.328+0000 7f50e3fff700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f50cc06caf0 0x7f50cc06efa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009fd0 tx=0x7f50d4005fb0 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:17.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.332+0000 7f50e17fa700 1 -- 172.21.15.134:0/445716914 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f50d8052990 con 0x7f50e4100250 2024-04-13T10:58:17.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.618+0000 7f50ea40b700 1 -- 172.21.15.134:0/445716914 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50e4068ae0 con 0x7f50cc06caf0 2024-04-13T10:58:17.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.620+0000 7f50e17fa700 1 -- 172.21.15.134:0/445716914 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f50e4068ae0 con 0x7f50cc06caf0 2024-04-13T10:58:17.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 -- 172.21.15.134:0/445716914 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f50cc06caf0 msgr2=0x7f50cc06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f50cc06caf0 0x7f50cc06efa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009fd0 tx=0x7f50d4005fb0 comp rx=0 tx=0).stop 2024-04-13T10:58:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 -- 172.21.15.134:0/445716914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e4100250 msgr2=0x7f50e4195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e4100250 0x7f50e4195df0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f50d800e920 tx=0x7f50d800ec30 comp rx=0 tx=0).stop 2024-04-13T10:58:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 -- 172.21.15.134:0/445716914 shutdown_connections 2024-04-13T10:58:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f50cc06caf0 0x7f50cc06efa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ff050 0x7f50e41958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 --2- 172.21.15.134:0/445716914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e4100250 0x7f50e4195df0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 -- 172.21.15.134:0/445716914 >> 172.21.15.134:0/445716914 conn(0x7f50e40fa5e0 msgr2=0x7f50e40683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 -- 172.21.15.134:0/445716914 shutdown_connections 2024-04-13T10:58:17.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.623+0000 7f50ea40b700 1 -- 172.21.15.134:0/445716914 wait complete. 2024-04-13T10:58:17.636 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T10:58:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: Adjusting osd_memory_target on smithi194 to 2251M 2024-04-13T10:58:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: Updating smithi134:/etc/ceph/ceph.conf 2024-04-13T10:58:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: Updating smithi194:/etc/ceph/ceph.conf 2024-04-13T10:58:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:58:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:58:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:58:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:17 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:17.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.768+0000 7f697e6c2700 1 -- 172.21.15.134:0/3619566147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69780ff050 msgr2=0x7f69780ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:17.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.768+0000 7f697e6c2700 1 --2- 172.21.15.134:0/3619566147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69780ff050 0x7f69780ff460 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6968009910 tx=0x7f6968009c20 comp rx=0 tx=0).stop 2024-04-13T10:58:17.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.768+0000 7f697e6c2700 1 -- 172.21.15.134:0/3619566147 shutdown_connections 2024-04-13T10:58:17.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.768+0000 7f697e6c2700 1 --2- 172.21.15.134:0/3619566147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6978100250 0x7f69781006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:17.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.768+0000 7f697e6c2700 1 --2- 172.21.15.134:0/3619566147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69780ff050 0x7f69780ff460 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:17.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.768+0000 7f697e6c2700 1 -- 172.21.15.134:0/3619566147 >> 172.21.15.134:0/3619566147 conn(0x7f69780fa5e0 msgr2=0x7f69780fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:17.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.768+0000 7f697e6c2700 1 -- 172.21.15.134:0/3619566147 shutdown_connections 2024-04-13T10:58:17.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.768+0000 7f697e6c2700 1 -- 172.21.15.134:0/3619566147 wait complete. 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.769+0000 7f697e6c2700 1 Processor -- start 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.769+0000 7f697e6c2700 1 -- start start 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.769+0000 7f697e6c2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69780ff050 0x7f6978068f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.769+0000 7f697e6c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978100250 0x7f697819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.769+0000 7f697e6c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697819abe0 con 0x7f6978100250 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.769+0000 7f697e6c2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697819ad50 con 0x7f69780ff050 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f69777fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978100250 0x7f697819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f69777fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978100250 0x7f697819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53904/0 (socket says 172.21.15.134:53904) 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f69777fe700 1 -- 172.21.15.134:0/3717445586 learned_addr learned my addr 172.21.15.134:0/3717445586 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f6977fff700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69780ff050 0x7f6978068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f69777fe700 1 -- 172.21.15.134:0/3717445586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69780ff050 msgr2=0x7f6978068f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f69777fe700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69780ff050 0x7f6978068f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f69777fe700 1 -- 172.21.15.134:0/3717445586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69680095f0 con 0x7f6978100250 2024-04-13T10:58:17.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f69777fe700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978100250 0x7f697819a610 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f696c00e920 tx=0x7f696c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:17.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f69757fa700 1 -- 172.21.15.134:0/3717445586 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696c00c9d0 con 0x7f6978100250 2024-04-13T10:58:17.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f697e6c2700 1 -- 172.21.15.134:0/3717445586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697819b030 con 0x7f6978100250 2024-04-13T10:58:17.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.770+0000 7f697e6c2700 1 -- 172.21.15.134:0/3717445586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697819b5d0 con 0x7f6978100250 2024-04-13T10:58:17.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.771+0000 7f69757fa700 1 -- 172.21.15.134:0/3717445586 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f696c010430 con 0x7f6978100250 2024-04-13T10:58:17.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.771+0000 7f69757fa700 1 -- 172.21.15.134:0/3717445586 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696c018630 con 0x7f6978100250 2024-04-13T10:58:17.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.772+0000 7f697e6c2700 1 -- 172.21.15.134:0/3717445586 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6964005320 con 0x7f6978100250 2024-04-13T10:58:17.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.773+0000 7f69757fa700 1 -- 172.21.15.134:0/3717445586 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 90482+0+0 (secure 0 0 0) 0x7f696c00cb30 con 0x7f6978100250 2024-04-13T10:58:17.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.773+0000 7f69757fa700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f696006caf0 0x7f696006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:17.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.773+0000 7f69757fa700 1 -- 172.21.15.134:0/3717445586 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f696c014070 con 0x7f6978100250 2024-04-13T10:58:17.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.773+0000 7f6977fff700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f696006caf0 0x7f696006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:17.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.774+0000 7f6977fff700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f696006caf0 0x7f696006efa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f696800b600 tx=0x7f6968005fd0 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:17.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:17.780+0000 7f69757fa700 1 -- 172.21.15.134:0/3717445586 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f696c05a470 con 0x7f6978100250 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: Adjusting osd_memory_target on smithi194 to 2251M 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: Updating smithi134:/etc/ceph/ceph.conf 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: Updating smithi194:/etc/ceph/ceph.conf 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:17 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:18.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.101+0000 7f697e6c2700 1 -- 172.21.15.134:0/3717445586 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6964000bf0 con 0x7f696006caf0 2024-04-13T10:58:18.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.102+0000 7f69757fa700 1 -- 172.21.15.134:0/3717445586 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f6964000bf0 con 0x7f696006caf0 2024-04-13T10:58:18.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 -- 172.21.15.134:0/3717445586 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f696006caf0 msgr2=0x7f696006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:18.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f696006caf0 0x7f696006efa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f696800b600 tx=0x7f6968005fd0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 -- 172.21.15.134:0/3717445586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978100250 msgr2=0x7f697819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:18.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978100250 0x7f697819a610 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f696c00e920 tx=0x7f696c00ec30 comp rx=0 tx=0).stop 2024-04-13T10:58:18.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 -- 172.21.15.134:0/3717445586 shutdown_connections 2024-04-13T10:58:18.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f696006caf0 0x7f696006efa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69780ff050 0x7f6978068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 --2- 172.21.15.134:0/3717445586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6978100250 0x7f697819a610 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 -- 172.21.15.134:0/3717445586 >> 172.21.15.134:0/3717445586 conn(0x7f69780fa5e0 msgr2=0x7f6978103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:18.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 -- 172.21.15.134:0/3717445586 shutdown_connections 2024-04-13T10:58:18.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.105+0000 7f697e6c2700 1 -- 172.21.15.134:0/3717445586 wait complete. 2024-04-13T10:58:18.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.255+0000 7f3fe75b8700 1 -- 172.21.15.134:0/4233932723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe0100250 msgr2=0x7f3fe01006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:18.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.255+0000 7f3fe75b8700 1 --2- 172.21.15.134:0/4233932723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe0100250 0x7f3fe01006a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009910 tx=0x7f3fd0009c20 comp rx=0 tx=0).stop 2024-04-13T10:58:18.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.255+0000 7f3fe75b8700 1 -- 172.21.15.134:0/4233932723 shutdown_connections 2024-04-13T10:58:18.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.255+0000 7f3fe75b8700 1 --2- 172.21.15.134:0/4233932723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe0100250 0x7f3fe01006a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.255+0000 7f3fe75b8700 1 --2- 172.21.15.134:0/4233932723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fe00ff050 0x7f3fe00ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.255+0000 7f3fe75b8700 1 -- 172.21.15.134:0/4233932723 >> 172.21.15.134:0/4233932723 conn(0x7f3fe00fa600 msgr2=0x7f3fe00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:18.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.255+0000 7f3fe75b8700 1 -- 172.21.15.134:0/4233932723 shutdown_connections 2024-04-13T10:58:18.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.255+0000 7f3fe75b8700 1 -- 172.21.15.134:0/4233932723 wait complete. 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe75b8700 1 Processor -- start 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe75b8700 1 -- start start 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe75b8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fe00ff050 0x7f3fe00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe75b8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe0100250 0x7f3fe019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe75b8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe019abb0 con 0x7f3fe0100250 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe75b8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe019ad20 con 0x7f3fe00ff050 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe5354700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fe00ff050 0x7f3fe00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe4b53700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe0100250 0x7f3fe019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe5354700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fe00ff050 0x7f3fe00697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.134:48214/0 (socket says 172.21.15.134:48214) 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe5354700 1 -- 172.21.15.134:0/2201755108 learned_addr learned my addr 172.21.15.134:0/2201755108 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe4b53700 1 -- 172.21.15.134:0/2201755108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fe00ff050 msgr2=0x7f3fe00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:18.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe4b53700 1 --2- 172.21.15.134:0/2201755108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fe00ff050 0x7f3fe00697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.256+0000 7f3fe4b53700 1 -- 172.21.15.134:0/2201755108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00095f0 con 0x7f3fe0100250 2024-04-13T10:58:18.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.257+0000 7f3fe4b53700 1 --2- 172.21.15.134:0/2201755108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe0100250 0x7f3fe019a5e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0000c00 tx=0x7f3fd000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:18.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.257+0000 7f3fd67fc700 1 -- 172.21.15.134:0/2201755108 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fd001d070 con 0x7f3fe0100250 2024-04-13T10:58:18.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.257+0000 7f3fe75b8700 1 -- 172.21.15.134:0/2201755108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe019afa0 con 0x7f3fe0100250 2024-04-13T10:58:18.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.257+0000 7f3fd67fc700 1 -- 172.21.15.134:0/2201755108 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f3fd0005710 con 0x7f3fe0100250 2024-04-13T10:58:18.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.257+0000 7f3fd67fc700 1 -- 172.21.15.134:0/2201755108 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fd0003980 con 0x7f3fe0100250 2024-04-13T10:58:18.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.257+0000 7f3fe75b8700 1 -- 172.21.15.134:0/2201755108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe019b480 con 0x7f3fe0100250 2024-04-13T10:58:18.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.258+0000 7f3fe75b8700 1 -- 172.21.15.134:0/2201755108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe0107ad0 con 0x7f3fe0100250 2024-04-13T10:58:18.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.259+0000 7f3fd67fc700 1 -- 172.21.15.134:0/2201755108 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 90482+0+0 (secure 0 0 0) 0x7f3fd0004ac0 con 0x7f3fe0100250 2024-04-13T10:58:18.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.259+0000 7f3fd67fc700 1 --2- 172.21.15.134:0/2201755108 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f3fcc06caf0 0x7f3fcc06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:18.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.259+0000 7f3fd67fc700 1 -- 172.21.15.134:0/2201755108 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f3fd008d490 con 0x7f3fe0100250 2024-04-13T10:58:18.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.259+0000 7f3fe5354700 1 --2- 172.21.15.134:0/2201755108 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f3fcc06caf0 0x7f3fcc06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:18.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.260+0000 7f3fe5354700 1 --2- 172.21.15.134:0/2201755108 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f3fcc06caf0 0x7f3fcc06efa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800f5e0 tx=0x7f3fd800b040 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:18.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.264+0000 7f3fd67fc700 1 -- 172.21.15.134:0/2201755108 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f3fd005af70 con 0x7f3fe0100250 2024-04-13T10:58:18.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.516+0000 7f3fe75b8700 1 -- 172.21.15.134:0/2201755108 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fe0104ba0 con 0x7f3fcc06caf0 2024-04-13T10:58:18.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.527+0000 7f3fd67fc700 1 -- 172.21.15.134:0/2201755108 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3fe0104ba0 con 0x7f3fcc06caf0 2024-04-13T10:58:18.528 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T10:58:18.528 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 11s ago 8m 24.8M - 0.25.0 c8568f914cd2 8d2cf34cad2a 2024-04-13T10:58:18.528 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (8m) 11s ago 8m 7734k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T10:58:18.528 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (7m) 14s ago 7m 7356k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T10:58:18.528 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (8m) 11s ago 8m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T10:58:18.528 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (7m) 14s ago 7m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T10:58:18.528 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (6m) 11s ago 8m 87.2M - 9.4.7 954c08fa6188 1038718f4fd4 2024-04-13T10:58:18.528 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (2m) 11s ago 2m 98.9M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (2m) 11s ago 2m 123M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (2m) 14s ago 2m 13.0M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (2m) 14s ago 2m 16.8M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:9283,8765,8443 running (10m) 11s ago 10m 155M - 18.2.0 dc2bc1663786 3b88cc824ec3 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (31s) 14s ago 7m 480M - 18.2.2-1173-g5108bc67 3464fd31103e 870bcc3bd872 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (10m) 11s ago 10m 48.8M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (7m) 14s ago 7m 40.5M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (8m) 11s ago 8m 15.5M - 1.5.0 0da6a335fe13 da23f14cbdef 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (7m) 14s ago 7m 18.2M - 1.5.0 0da6a335fe13 242da19a461b 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (6m) 11s ago 6m 71.9M 1227M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (6m) 11s ago 6m 70.6M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (5m) 11s ago 5m 66.4M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (5m) 14s ago 5m 73.6M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T10:58:18.529 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (4m) 14s ago 4m 68.9M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T10:58:18.530 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (4m) 14s ago 4m 71.7M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T10:58:18.530 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 11s ago 7m 63.7M - 2.43.0 a07b618ecd1d a5240fafbf97 2024-04-13T10:58:18.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 -- 172.21.15.134:0/2201755108 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f3fcc06caf0 msgr2=0x7f3fcc06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:18.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 --2- 172.21.15.134:0/2201755108 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f3fcc06caf0 0x7f3fcc06efa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800f5e0 tx=0x7f3fd800b040 comp rx=0 tx=0).stop 2024-04-13T10:58:18.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 -- 172.21.15.134:0/2201755108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe0100250 msgr2=0x7f3fe019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:18.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 --2- 172.21.15.134:0/2201755108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe0100250 0x7f3fe019a5e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0000c00 tx=0x7f3fd000bde0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 -- 172.21.15.134:0/2201755108 shutdown_connections 2024-04-13T10:58:18.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 --2- 172.21.15.134:0/2201755108 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f3fcc06caf0 0x7f3fcc06efa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 --2- 172.21.15.134:0/2201755108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fe00ff050 0x7f3fe00697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 --2- 172.21.15.134:0/2201755108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe0100250 0x7f3fe019a5e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 -- 172.21.15.134:0/2201755108 >> 172.21.15.134:0/2201755108 conn(0x7f3fe00fa600 msgr2=0x7f3fe0103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:18.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 -- 172.21.15.134:0/2201755108 shutdown_connections 2024-04-13T10:58:18.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.530+0000 7f3fe75b8700 1 -- 172.21.15.134:0/2201755108 wait complete. 2024-04-13T10:58:18.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.668+0000 7f2829fd0700 1 -- 172.21.15.134:0/1005475362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28240fe430 msgr2=0x7f28240fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:18.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.668+0000 7f2829fd0700 1 --2- 172.21.15.134:0/1005475362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28240fe430 0x7f28240fe840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2814009910 tx=0x7f2814009c20 comp rx=0 tx=0).stop 2024-04-13T10:58:18.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.668+0000 7f2829fd0700 1 -- 172.21.15.134:0/1005475362 shutdown_connections 2024-04-13T10:58:18.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.668+0000 7f2829fd0700 1 --2- 172.21.15.134:0/1005475362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28241014b0 0x7f2824101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.668+0000 7f2829fd0700 1 --2- 172.21.15.134:0/1005475362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28240fe430 0x7f28240fe840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.668+0000 7f2829fd0700 1 -- 172.21.15.134:0/1005475362 >> 172.21.15.134:0/1005475362 conn(0x7f28240f9d80 msgr2=0x7f28240fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:18.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.668+0000 7f2829fd0700 1 -- 172.21.15.134:0/1005475362 shutdown_connections 2024-04-13T10:58:18.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.668+0000 7f2829fd0700 1 -- 172.21.15.134:0/1005475362 wait complete. 2024-04-13T10:58:18.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.669+0000 7f2829fd0700 1 Processor -- start 2024-04-13T10:58:18.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.670+0000 7f2829fd0700 1 -- start start 2024-04-13T10:58:18.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.670+0000 7f2829fd0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28240fe430 0x7f2824195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:18.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.670+0000 7f2829fd0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28241014b0 0x7f2824195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:18.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.670+0000 7f2829fd0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28241965d0 con 0x7f28241014b0 2024-04-13T10:58:18.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.670+0000 7f2829fd0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2824196710 con 0x7f28240fe430 2024-04-13T10:58:18.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.670+0000 7f28237fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28240fe430 0x7f2824195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:18.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.670+0000 7f28237fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28240fe430 0x7f2824195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.134:48220/0 (socket says 172.21.15.134:48220) 2024-04-13T10:58:18.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.670+0000 7f28237fe700 1 -- 172.21.15.134:0/707694093 learned_addr learned my addr 172.21.15.134:0/707694093 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:58:18.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.671+0000 7f28237fe700 1 -- 172.21.15.134:0/707694093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28241014b0 msgr2=0x7f2824195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:18.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.671+0000 7f28237fe700 1 --2- 172.21.15.134:0/707694093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28241014b0 0x7f2824195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:18.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.671+0000 7f28237fe700 1 -- 172.21.15.134:0/707694093 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28140095f0 con 0x7f28240fe430 2024-04-13T10:58:18.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.671+0000 7f28237fe700 1 --2- 172.21.15.134:0/707694093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28240fe430 0x7f2824195a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f281400bd70 tx=0x7f281400be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:18.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.671+0000 7f2820ff9700 1 -- 172.21.15.134:0/707694093 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f281401d070 con 0x7f28240fe430 2024-04-13T10:58:18.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.671+0000 7f2820ff9700 1 -- 172.21.15.134:0/707694093 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f281400f460 con 0x7f28240fe430 2024-04-13T10:58:18.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.671+0000 7f2820ff9700 1 -- 172.21.15.134:0/707694093 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2814021640 con 0x7f28240fe430 2024-04-13T10:58:18.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.671+0000 7f2829fd0700 1 -- 172.21.15.134:0/707694093 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282419b160 con 0x7f28240fe430 2024-04-13T10:58:18.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.671+0000 7f2829fd0700 1 -- 172.21.15.134:0/707694093 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282419b650 con 0x7f28240fe430 2024-04-13T10:58:18.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.672+0000 7f2829fd0700 1 -- 172.21.15.134:0/707694093 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2824108bd0 con 0x7f28240fe430 2024-04-13T10:58:18.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.673+0000 7f2820ff9700 1 -- 172.21.15.134:0/707694093 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 24) v1 ==== 90482+0+0 (secure 0 0 0) 0x7f2814003a60 con 0x7f28240fe430 2024-04-13T10:58:18.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.673+0000 7f2820ff9700 1 --2- 172.21.15.134:0/707694093 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f280c06cb30 0x7f280c06efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:18.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.674+0000 7f2820ff9700 1 -- 172.21.15.134:0/707694093 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f281408d440 con 0x7f28240fe430 2024-04-13T10:58:18.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.674+0000 7f2822ffd700 1 --2- 172.21.15.134:0/707694093 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f280c06cb30 0x7f280c06efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:18.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.674+0000 7f2822ffd700 1 --2- 172.21.15.134:0/707694093 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f280c06cb30 0x7f280c06efe0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f28180097b0 tx=0x7f2818006d20 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:18.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:18.679+0000 7f2820ff9700 1 -- 172.21.15.134:0/707694093 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f281405ae80 con 0x7f28240fe430 2024-04-13T10:58:18.854 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:18 smithi134 ceph-mon[39696]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:58:18.855 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:18 smithi134 ceph-mon[39696]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.client.admin.keyring 2024-04-13T10:58:18.855 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:18 smithi134 ceph-mon[39696]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.client.admin.keyring 2024-04-13T10:58:18.855 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:18 smithi134 ceph-mon[39696]: pgmap v13: 65 pgs: 65 active+clean; 147 MiB data, 679 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-04-13T10:58:18.855 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:18 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:18.855 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:18 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:18.855 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:18 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:18.856 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:18 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:18.856 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:18 smithi134 ceph-mon[39696]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-04-13T10:58:18.856 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:18 smithi134 ceph-mon[39696]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:18 smithi194 ceph-mon[46737]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:58:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:18 smithi194 ceph-mon[46737]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.client.admin.keyring 2024-04-13T10:58:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:18 smithi194 ceph-mon[46737]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.client.admin.keyring 2024-04-13T10:58:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:18 smithi194 ceph-mon[46737]: pgmap v13: 65 pgs: 65 active+clean; 147 MiB data, 679 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-04-13T10:58:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:18 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:18 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:18 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:18 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:18 smithi194 ceph-mon[46737]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-04-13T10:58:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:18 smithi194 ceph-mon[46737]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:19.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.105+0000 7f2829fd0700 1 -- 172.21.15.134:0/707694093 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f282419bd50 con 0x7f28240fe430 2024-04-13T10:58:19.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.105+0000 7f2820ff9700 1 -- 172.21.15.134:0/707694093 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7f281405aa10 con 0x7f28240fe430 2024-04-13T10:58:19.108 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:58:19.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T10:58:19.108 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T10:58:19.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:58:19.108 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T10:58:19.108 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-04-13T10:58:19.108 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 1 2024-04-13T10:58:19.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:58:19.108 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T10:58:19.108 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T10:58:19.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:58:19.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T10:58:19.109 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T10:58:19.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:58:19.109 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T10:58:19.109 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-04-13T10:58:19.109 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 1 2024-04-13T10:58:19.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T10:58:19.109 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.108+0000 7f2829fd0700 1 -- 172.21.15.134:0/707694093 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f280c06cb30 msgr2=0x7f280c06efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.108+0000 7f2829fd0700 1 --2- 172.21.15.134:0/707694093 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f280c06cb30 0x7f280c06efe0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f28180097b0 tx=0x7f2818006d20 comp rx=0 tx=0).stop 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.108+0000 7f2829fd0700 1 -- 172.21.15.134:0/707694093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28240fe430 msgr2=0x7f2824195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.108+0000 7f2829fd0700 1 --2- 172.21.15.134:0/707694093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28240fe430 0x7f2824195a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f281400bd70 tx=0x7f281400be50 comp rx=0 tx=0).stop 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.109+0000 7f2829fd0700 1 -- 172.21.15.134:0/707694093 shutdown_connections 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.109+0000 7f2829fd0700 1 --2- 172.21.15.134:0/707694093 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f280c06cb30 0x7f280c06efe0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.109+0000 7f2829fd0700 1 --2- 172.21.15.134:0/707694093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28240fe430 0x7f2824195a70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.109+0000 7f2829fd0700 1 --2- 172.21.15.134:0/707694093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28241014b0 0x7f2824195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.109+0000 7f2829fd0700 1 -- 172.21.15.134:0/707694093 >> 172.21.15.134:0/707694093 conn(0x7f28240f9d80 msgr2=0x7f28241046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.109+0000 7f2829fd0700 1 -- 172.21.15.134:0/707694093 shutdown_connections 2024-04-13T10:58:19.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.109+0000 7f2829fd0700 1 -- 172.21.15.134:0/707694093 wait complete. 2024-04-13T10:58:19.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.239+0000 7f871eafe700 1 -- 172.21.15.134:0/2563350627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8718100be0 msgr2=0x7f8718102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.239+0000 7f871eafe700 1 --2- 172.21.15.134:0/2563350627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8718100be0 0x7f8718102fc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f870c009910 tx=0x7f870c009c20 comp rx=0 tx=0).stop 2024-04-13T10:58:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.240+0000 7f871eafe700 1 -- 172.21.15.134:0/2563350627 shutdown_connections 2024-04-13T10:58:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.240+0000 7f871eafe700 1 --2- 172.21.15.134:0/2563350627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8718103500 0x7f87181058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.240+0000 7f871eafe700 1 --2- 172.21.15.134:0/2563350627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8718100be0 0x7f8718102fc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.240+0000 7f871eafe700 1 -- 172.21.15.134:0/2563350627 >> 172.21.15.134:0/2563350627 conn(0x7f87180fa5e0 msgr2=0x7f87180fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.240+0000 7f871eafe700 1 -- 172.21.15.134:0/2563350627 shutdown_connections 2024-04-13T10:58:19.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.240+0000 7f871eafe700 1 -- 172.21.15.134:0/2563350627 wait complete. 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871eafe700 1 Processor -- start 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871eafe700 1 -- start start 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871eafe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8718100be0 0x7f8718197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871eafe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8718103500 0x7f8718197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871eafe700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87181985c0 con 0x7f8718100be0 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871eafe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8718198700 con 0x7f8718103500 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871c89a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8718100be0 0x7f8718197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871c89a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8718100be0 0x7f8718197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53980/0 (socket says 172.21.15.134:53980) 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871c89a700 1 -- 172.21.15.134:0/1303094173 learned_addr learned my addr 172.21.15.134:0/1303094173 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871c89a700 1 -- 172.21.15.134:0/1303094173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8718103500 msgr2=0x7f8718197fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871c89a700 1 --2- 172.21.15.134:0/1303094173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8718103500 0x7f8718197fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:19.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.241+0000 7f871c89a700 1 -- 172.21.15.134:0/1303094173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0095f0 con 0x7f8718100be0 2024-04-13T10:58:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.242+0000 7f871c89a700 1 --2- 172.21.15.134:0/1303094173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8718100be0 0x7f8718197a60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f870c00bd70 tx=0x7f870c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.242+0000 7f8715ffb700 1 -- 172.21.15.134:0/1303094173 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870c01d070 con 0x7f8718100be0 2024-04-13T10:58:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.242+0000 7f871eafe700 1 -- 172.21.15.134:0/1303094173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871819d150 con 0x7f8718100be0 2024-04-13T10:58:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.242+0000 7f8715ffb700 1 -- 172.21.15.134:0/1303094173 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f870c00f460 con 0x7f8718100be0 2024-04-13T10:58:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.242+0000 7f8715ffb700 1 -- 172.21.15.134:0/1303094173 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870c021640 con 0x7f8718100be0 2024-04-13T10:58:19.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.242+0000 7f871eafe700 1 -- 172.21.15.134:0/1303094173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871819d6c0 con 0x7f8718100be0 2024-04-13T10:58:19.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.243+0000 7f8715ffb700 1 -- 172.21.15.134:0/1303094173 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 90482+0+0 (secure 0 0 0) 0x7f870c00f960 con 0x7f8718100be0 2024-04-13T10:58:19.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.244+0000 7f8715ffb700 1 --2- 172.21.15.134:0/1303094173 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f870806caf0 0x7f870806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:19.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.244+0000 7f8715ffb700 1 -- 172.21.15.134:0/1303094173 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f870c08d440 con 0x7f8718100be0 2024-04-13T10:58:19.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.244+0000 7f871eafe700 1 -- 172.21.15.134:0/1303094173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87180fc1c0 con 0x7f8718100be0 2024-04-13T10:58:19.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.244+0000 7f8717fff700 1 --2- 172.21.15.134:0/1303094173 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f870806caf0 0x7f870806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:19.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.244+0000 7f8717fff700 1 --2- 172.21.15.134:0/1303094173 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f870806caf0 0x7f870806efa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f870400ba10 tx=0x7f870400b3f0 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:19.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.250+0000 7f8715ffb700 1 -- 172.21.15.134:0/1303094173 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f870c05af20 con 0x7f8718100be0 2024-04-13T10:58:19.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.573+0000 7f871eafe700 1 -- 172.21.15.134:0/1303094173 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8718061190 con 0x7f870806caf0 2024-04-13T10:58:19.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.574+0000 7f8715ffb700 1 -- 172.21.15.134:0/1303094173 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f8718061190 con 0x7f870806caf0 2024-04-13T10:58:19.575 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:58:19.575 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T10:58:19.575 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T10:58:19.575 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-13T10:58:19.575 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-04-13T10:58:19.575 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "1/2 daemons upgraded", 2024-04-13T10:58:19.575 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-04-13T10:58:19.575 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T10:58:19.575 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:58:19.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 -- 172.21.15.134:0/1303094173 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f870806caf0 msgr2=0x7f870806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:19.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 --2- 172.21.15.134:0/1303094173 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f870806caf0 0x7f870806efa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f870400ba10 tx=0x7f870400b3f0 comp rx=0 tx=0).stop 2024-04-13T10:58:19.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 -- 172.21.15.134:0/1303094173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8718100be0 msgr2=0x7f8718197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:19.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 --2- 172.21.15.134:0/1303094173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8718100be0 0x7f8718197a60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f870c00bd70 tx=0x7f870c00be50 comp rx=0 tx=0).stop 2024-04-13T10:58:19.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 -- 172.21.15.134:0/1303094173 shutdown_connections 2024-04-13T10:58:19.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 --2- 172.21.15.134:0/1303094173 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f870806caf0 0x7f870806efa0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:19.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 --2- 172.21.15.134:0/1303094173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8718100be0 0x7f8718197a60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:19.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 --2- 172.21.15.134:0/1303094173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8718103500 0x7f8718197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:19.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 -- 172.21.15.134:0/1303094173 >> 172.21.15.134:0/1303094173 conn(0x7f87180fa5e0 msgr2=0x7f8718104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:19.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 -- 172.21.15.134:0/1303094173 shutdown_connections 2024-04-13T10:58:19.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:19.577+0000 7f871eafe700 1 -- 172.21.15.134:0/1303094173 wait complete. 2024-04-13T10:58:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:19 smithi134 ceph-mon[39696]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-04-13T10:58:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:19 smithi134 ceph-mon[39696]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:19 smithi134 ceph-mon[39696]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:19 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/707694093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:58:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:19 smithi194 ceph-mon[46737]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-04-13T10:58:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:19 smithi194 ceph-mon[46737]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:19 smithi194 ceph-mon[46737]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:19 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/707694093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:58:20.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:20 smithi134 ceph-mon[39696]: pgmap v14: 65 pgs: 65 active+clean; 165 MiB data, 762 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 334 op/s 2024-04-13T10:58:20.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:20 smithi134 ceph-mon[39696]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:20.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:20 smithi194 ceph-mon[46737]: pgmap v14: 65 pgs: 65 active+clean; 165 MiB data, 762 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 5.0 MiB/s wr, 334 op/s 2024-04-13T10:58:20.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:20 smithi194 ceph-mon[46737]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:22.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:22 smithi134 ceph-mon[39696]: pgmap v15: 65 pgs: 65 active+clean; 165 MiB data, 762 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 262 op/s 2024-04-13T10:58:22.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:22 smithi194 ceph-mon[46737]: pgmap v15: 65 pgs: 65 active+clean; 165 MiB data, 762 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 262 op/s 2024-04-13T10:58:24.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:24 smithi134 ceph-mon[39696]: pgmap v16: 65 pgs: 65 active+clean; 170 MiB data, 755 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 287 op/s 2024-04-13T10:58:24.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:24 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:24.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:24 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:24.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:24 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:58:24.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:24 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:58:24.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:24 smithi194 ceph-mon[46737]: pgmap v16: 65 pgs: 65 active+clean; 170 MiB data, 755 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 287 op/s 2024-04-13T10:58:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:24 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:24 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:24 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:58:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:24 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:58:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:25 smithi134 ceph-mon[39696]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:58:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:25 smithi134 ceph-mon[39696]: Upgrade: Need to upgrade myself (mgr.smithi194.tcpynt) 2024-04-13T10:58:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:25 smithi134 ceph-mon[39696]: Upgrade: Need to upgrade myself (mgr.smithi194.tcpynt) 2024-04-13T10:58:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:25 smithi194 ceph-mon[46737]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:58:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:25 smithi194 ceph-mon[46737]: Upgrade: Need to upgrade myself (mgr.smithi194.tcpynt) 2024-04-13T10:58:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:25 smithi194 ceph-mon[46737]: Upgrade: Need to upgrade myself (mgr.smithi194.tcpynt) 2024-04-13T10:58:26.873 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:26 smithi134 ceph-mon[39696]: pgmap v17: 65 pgs: 65 active+clean; 182 MiB data, 764 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 446 op/s 2024-04-13T10:58:26.873 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:26 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:26.874 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:26 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.tmanda", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:58:26.874 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:26 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.tmanda", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:58:26.874 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:26 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T10:58:26.874 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:26 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:58:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:26 smithi194 ceph-mon[46737]: pgmap v17: 65 pgs: 65 active+clean; 182 MiB data, 764 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 446 op/s 2024-04-13T10:58:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:26 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:26 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.tmanda", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:58:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:26 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.tmanda", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T10:58:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:26 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T10:58:26.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:26 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:58:27.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:27 smithi134 ceph-mon[39696]: Upgrade: Updating mgr.smithi134.tmanda 2024-04-13T10:58:27.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:27 smithi134 ceph-mon[39696]: Deploying daemon mgr.smithi134.tmanda on smithi134 2024-04-13T10:58:27.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:27 smithi194 ceph-mon[46737]: Upgrade: Updating mgr.smithi134.tmanda 2024-04-13T10:58:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:27 smithi194 ceph-mon[46737]: Deploying daemon mgr.smithi134.tmanda on smithi134 2024-04-13T10:58:28.019 INFO:tasks.workunit.client.1.smithi194.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-13T10:58:28.024 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-13T10:58:28.025 INFO:tasks.workunit.client.1.smithi194.stderr:+ make 2024-04-13T10:58:28.553 INFO:tasks.workunit.client.1.smithi194.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-13T10:58:28.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:28 smithi134 ceph-mon[39696]: pgmap v18: 65 pgs: 65 active+clean; 182 MiB data, 764 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 329 op/s 2024-04-13T10:58:28.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:28 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:58:28.964 INFO:tasks.workunit.client.1.smithi194.stderr:++ readlink -f fsstress 2024-04-13T10:58:28.966 INFO:tasks.workunit.client.1.smithi194.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-13T10:58:28.966 INFO:tasks.workunit.client.1.smithi194.stderr:+ popd 2024-04-13T10:58:28.967 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-13T10:58:28.967 INFO:tasks.workunit.client.1.smithi194.stderr:+ popd 2024-04-13T10:58:28.968 INFO:tasks.workunit.client.1.smithi194.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-13T10:58:28.968 INFO:tasks.workunit.client.1.smithi194.stderr:++ mktemp -d -p . 2024-04-13T10:58:28.971 INFO:tasks.workunit.client.1.smithi194.stderr:+ T=./tmp.RfMdsL6l8w 2024-04-13T10:58:28.971 INFO:tasks.workunit.client.1.smithi194.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.RfMdsL6l8w -l 1 -n 1000 -p 10 -v 2024-04-13T10:58:28.974 INFO:tasks.workunit.client.1.smithi194.stdout:seed = 1712621532 2024-04-13T10:58:28.978 INFO:tasks.workunit.client.1.smithi194.stdout:0/0: truncate - no filename 2024-04-13T10:58:28.978 INFO:tasks.workunit.client.1.smithi194.stdout:0/1: write - no filename 2024-04-13T10:58:28.978 INFO:tasks.workunit.client.1.smithi194.stdout:0/2: dwrite - no filename 2024-04-13T10:58:28.979 INFO:tasks.workunit.client.1.smithi194.stdout:1/0: chown . 7636454 1 2024-04-13T10:58:28.979 INFO:tasks.workunit.client.1.smithi194.stdout:1/1: rename - no filename 2024-04-13T10:58:28.979 INFO:tasks.workunit.client.1.smithi194.stdout:1/2: dread - no filename 2024-04-13T10:58:28.979 INFO:tasks.workunit.client.1.smithi194.stdout:1/3: write - no filename 2024-04-13T10:58:28.980 INFO:tasks.workunit.client.1.smithi194.stdout:0/3: mknod c0 0 2024-04-13T10:58:28.980 INFO:tasks.workunit.client.1.smithi194.stdout:0/4: dwrite - no filename 2024-04-13T10:58:28.980 INFO:tasks.workunit.client.1.smithi194.stdout:0/5: dread - no filename 2024-04-13T10:58:28.981 INFO:tasks.workunit.client.1.smithi194.stdout:2/0: dwrite - no filename 2024-04-13T10:58:28.981 INFO:tasks.workunit.client.1.smithi194.stdout:2/1: write - no filename 2024-04-13T10:58:28.981 INFO:tasks.workunit.client.1.smithi194.stdout:2/2: rename - no filename 2024-04-13T10:58:28.981 INFO:tasks.workunit.client.1.smithi194.stdout:2/3: dwrite - no filename 2024-04-13T10:58:28.981 INFO:tasks.workunit.client.1.smithi194.stdout:0/6: creat f1 x:0 0 0 2024-04-13T10:58:28.982 INFO:tasks.workunit.client.1.smithi194.stdout:1/4: creat f0 x:0 0 0 2024-04-13T10:58:28.982 INFO:tasks.workunit.client.1.smithi194.stdout:1/5: rmdir - no directory 2024-04-13T10:58:28.984 INFO:tasks.workunit.client.1.smithi194.stdout:0/7: unlink c0 0 2024-04-13T10:58:28.984 INFO:tasks.workunit.client.1.smithi194.stdout:0/8: chown f1 11132 1 2024-04-13T10:58:28.984 INFO:tasks.workunit.client.1.smithi194.stdout:0/9: rmdir - no directory 2024-04-13T10:58:28.985 INFO:tasks.workunit.client.1.smithi194.stdout:0/10: chown f1 58731 1 2024-04-13T10:58:28.985 INFO:tasks.workunit.client.1.smithi194.stdout:0/11: truncate f1 316056 0 2024-04-13T10:58:28.985 INFO:tasks.workunit.client.1.smithi194.stdout:2/4: symlink l0 0 2024-04-13T10:58:28.985 INFO:tasks.workunit.client.1.smithi194.stdout:2/5: dread - no filename 2024-04-13T10:58:28.986 INFO:tasks.workunit.client.1.smithi194.stdout:2/6: chown l0 14305 1 2024-04-13T10:58:28.986 INFO:tasks.workunit.client.1.smithi194.stdout:2/7: stat l0 0 2024-04-13T10:58:28.986 INFO:tasks.workunit.client.1.smithi194.stdout:2/8: truncate - no filename 2024-04-13T10:58:28.988 INFO:tasks.workunit.client.1.smithi194.stdout:1/6: link f0 f1 0 2024-04-13T10:58:28.988 INFO:tasks.workunit.client.1.smithi194.stdout:1/7: chown f0 236847 1 2024-04-13T10:58:28.989 INFO:tasks.workunit.client.1.smithi194.stdout:2/9: mknod c1 0 2024-04-13T10:58:28.989 INFO:tasks.workunit.client.1.smithi194.stdout:2/10: rmdir - no directory 2024-04-13T10:58:28.989 INFO:tasks.workunit.client.1.smithi194.stdout:3/0: getdents . 0 2024-04-13T10:58:28.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/0: dwrite - no filename 2024-04-13T10:58:28.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/1: chown . 635 1 2024-04-13T10:58:28.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/2: fsync - no filename 2024-04-13T10:58:28.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/3: write - no filename 2024-04-13T10:58:28.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/4: dwrite - no filename 2024-04-13T10:58:28.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/5: rename - no filename 2024-04-13T10:58:28.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/6: chown . 1050436997 1 2024-04-13T10:58:28.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/7: truncate - no filename 2024-04-13T10:58:28.992 INFO:tasks.workunit.client.1.smithi194.stdout:0/12: link f1 f2 0 2024-04-13T10:58:28.993 INFO:tasks.workunit.client.1.smithi194.stdout:2/11: mkdir d2 0 2024-04-13T10:58:28.994 INFO:tasks.workunit.client.1.smithi194.stdout:4/0: symlink l0 0 2024-04-13T10:58:28.995 INFO:tasks.workunit.client.1.smithi194.stdout:4/1: chown l0 638054209 1 2024-04-13T10:58:28.995 INFO:tasks.workunit.client.1.smithi194.stdout:4/2: write - no filename 2024-04-13T10:58:28.995 INFO:tasks.workunit.client.1.smithi194.stdout:4/3: chown l0 120028 1 2024-04-13T10:58:28.995 INFO:tasks.workunit.client.1.smithi194.stdout:4/4: dwrite - no filename 2024-04-13T10:58:28.996 INFO:tasks.workunit.client.1.smithi194.stdout:0/13: creat f3 x:0 0 0 2024-04-13T10:58:28.996 INFO:tasks.workunit.client.1.smithi194.stdout:0/14: rmdir - no directory 2024-04-13T10:58:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:28 smithi194 ceph-mon[46737]: pgmap v18: 65 pgs: 65 active+clean; 182 MiB data, 764 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 329 op/s 2024-04-13T10:58:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:28 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:58:28.998 INFO:tasks.workunit.client.1.smithi194.stdout:3/1: creat f0 x:0 0 0 2024-04-13T10:58:28.999 INFO:tasks.workunit.client.1.smithi194.stdout:4/5: mknod c1 0 2024-04-13T10:58:28.999 INFO:tasks.workunit.client.1.smithi194.stdout:4/6: dread - no filename 2024-04-13T10:58:29.000 INFO:tasks.workunit.client.1.smithi194.stdout:0/15: symlink l4 0 2024-04-13T10:58:29.001 INFO:tasks.workunit.client.1.smithi194.stdout:2/12: mkdir d2/d3 0 2024-04-13T10:58:29.002 INFO:tasks.workunit.client.1.smithi194.stdout:3/2: symlink l1 0 2024-04-13T10:58:29.002 INFO:tasks.workunit.client.1.smithi194.stdout:3/3: rmdir - no directory 2024-04-13T10:58:29.003 INFO:tasks.workunit.client.1.smithi194.stdout:3/4: dread - f0 zero size 2024-04-13T10:58:29.003 INFO:tasks.workunit.client.1.smithi194.stdout:4/7: mkdir d2 0 2024-04-13T10:58:29.003 INFO:tasks.workunit.client.1.smithi194.stdout:4/8: dread - no filename 2024-04-13T10:58:29.003 INFO:tasks.workunit.client.1.smithi194.stdout:6/0: getdents . 0 2024-04-13T10:58:29.007 INFO:tasks.workunit.client.1.smithi194.stdout:2/13: symlink d2/l4 0 2024-04-13T10:58:29.009 INFO:tasks.workunit.client.1.smithi194.stdout:3/5: unlink f0 0 2024-04-13T10:58:29.009 INFO:tasks.workunit.client.1.smithi194.stdout:3/6: readlink l1 0 2024-04-13T10:58:29.011 INFO:tasks.workunit.client.1.smithi194.stdout:7/0: creat f0 x:0 0 0 2024-04-13T10:58:29.013 INFO:tasks.workunit.client.1.smithi194.stdout:9/0: dwrite - no filename 2024-04-13T10:58:29.014 INFO:tasks.workunit.client.1.smithi194.stdout:9/1: fsync - no filename 2024-04-13T10:58:29.014 INFO:tasks.workunit.client.1.smithi194.stdout:9/2: dread - no filename 2024-04-13T10:58:29.015 INFO:tasks.workunit.client.1.smithi194.stdout:0/16: link f2 f5 0 2024-04-13T10:58:29.015 INFO:tasks.workunit.client.1.smithi194.stdout:0/17: readlink l4 0 2024-04-13T10:58:29.016 INFO:tasks.workunit.client.1.smithi194.stdout:2/14: mkdir d2/d5 0 2024-04-13T10:58:29.019 INFO:tasks.workunit.client.1.smithi194.stdout:4/9: symlink d2/l3 0 2024-04-13T10:58:29.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/7: unlink l1 0 2024-04-13T10:58:29.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/8: dread - no filename 2024-04-13T10:58:29.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/9: write - no filename 2024-04-13T10:58:29.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/10: dread - no filename 2024-04-13T10:58:29.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/11: link - no file 2024-04-13T10:58:29.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/12: chown . 504756089 1 2024-04-13T10:58:29.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/13: write - no filename 2024-04-13T10:58:29.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/14: rename - no filename 2024-04-13T10:58:29.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/15: unlink - no file 2024-04-13T10:58:29.021 INFO:tasks.workunit.client.1.smithi194.stdout:3/16: write - no filename 2024-04-13T10:58:29.021 INFO:tasks.workunit.client.1.smithi194.stdout:3/17: dread - no filename 2024-04-13T10:58:29.021 INFO:tasks.workunit.client.1.smithi194.stdout:6/1: mkdir d0 0 2024-04-13T10:58:29.021 INFO:tasks.workunit.client.1.smithi194.stdout:6/2: dread - no filename 2024-04-13T10:58:29.021 INFO:tasks.workunit.client.1.smithi194.stdout:6/3: rename d0 to d0/d1 22 2024-04-13T10:58:29.021 INFO:tasks.workunit.client.1.smithi194.stdout:6/4: chown d0 520401668 1 2024-04-13T10:58:29.022 INFO:tasks.workunit.client.1.smithi194.stdout:6/5: write - no filename 2024-04-13T10:58:29.022 INFO:tasks.workunit.client.1.smithi194.stdout:6/6: dwrite - no filename 2024-04-13T10:58:29.022 INFO:tasks.workunit.client.1.smithi194.stdout:6/7: write - no filename 2024-04-13T10:58:29.023 INFO:tasks.workunit.client.1.smithi194.stdout:8/0: creat f0 x:0 0 0 2024-04-13T10:58:29.025 INFO:tasks.workunit.client.1.smithi194.stdout:2/15: creat d2/f6 x:0 0 0 2024-04-13T10:58:29.027 INFO:tasks.workunit.client.1.smithi194.stdout:4/10: creat d2/f4 x:0 0 0 2024-04-13T10:58:29.028 INFO:tasks.workunit.client.1.smithi194.stdout:4/11: write d2/f4 [582063,63128] 0 2024-04-13T10:58:29.028 INFO:tasks.workunit.client.1.smithi194.stdout:3/18: mkdir d2 0 2024-04-13T10:58:29.028 INFO:tasks.workunit.client.1.smithi194.stdout:3/19: write - no filename 2024-04-13T10:58:29.029 INFO:tasks.workunit.client.1.smithi194.stdout:3/20: fsync - no filename 2024-04-13T10:58:29.030 INFO:tasks.workunit.client.1.smithi194.stdout:8/1: creat f1 x:0 0 0 2024-04-13T10:58:29.030 INFO:tasks.workunit.client.1.smithi194.stdout:8/2: dread - f1 zero size 2024-04-13T10:58:29.032 INFO:tasks.workunit.client.1.smithi194.stdout:9/3: mkdir d0 0 2024-04-13T10:58:29.032 INFO:tasks.workunit.client.1.smithi194.stdout:9/4: link - no file 2024-04-13T10:58:29.033 INFO:tasks.workunit.client.1.smithi194.stdout:2/16: symlink d2/l7 0 2024-04-13T10:58:29.034 INFO:tasks.workunit.client.1.smithi194.stdout:4/12: mknod d2/c5 0 2024-04-13T10:58:29.034 INFO:tasks.workunit.client.1.smithi194.stdout:4/13: stat l0 0 2024-04-13T10:58:29.034 INFO:tasks.workunit.client.1.smithi194.stdout:4/14: fdatasync d2/f4 0 2024-04-13T10:58:29.036 INFO:tasks.workunit.client.1.smithi194.stdout:6/8: creat d0/f2 x:0 0 0 2024-04-13T10:58:29.037 INFO:tasks.workunit.client.1.smithi194.stdout:8/3: rename f1 to f2 0 2024-04-13T10:58:29.038 INFO:tasks.workunit.client.1.smithi194.stdout:8/4: chown f0 3055695 1 2024-04-13T10:58:29.038 INFO:tasks.workunit.client.1.smithi194.stdout:8/5: truncate f0 872559 0 2024-04-13T10:58:29.040 INFO:tasks.workunit.client.1.smithi194.stdout:4/15: creat d2/f6 x:0 0 0 2024-04-13T10:58:29.042 INFO:tasks.workunit.client.1.smithi194.stdout:3/21: mkdir d2/d3 0 2024-04-13T10:58:29.042 INFO:tasks.workunit.client.1.smithi194.stdout:3/22: link - no file 2024-04-13T10:58:29.043 INFO:tasks.workunit.client.1.smithi194.stdout:6/9: unlink d0/f2 0 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/10: write - no filename 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/11: link - no file 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/12: link - no file 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/13: write - no filename 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/14: dwrite - no filename 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/15: dread - no filename 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/16: dread - no filename 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/17: truncate - no filename 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/18: stat d0 0 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/19: unlink - no file 2024-04-13T10:58:29.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/20: unlink - no file 2024-04-13T10:58:29.045 INFO:tasks.workunit.client.1.smithi194.stdout:6/21: rename d0 to d0/d3 22 2024-04-13T10:58:29.045 INFO:tasks.workunit.client.1.smithi194.stdout:6/22: dwrite - no filename 2024-04-13T10:58:29.045 INFO:tasks.workunit.client.1.smithi194.stdout:6/23: dwrite - no filename 2024-04-13T10:58:29.045 INFO:tasks.workunit.client.1.smithi194.stdout:9/5: mknod d0/c1 0 2024-04-13T10:58:29.045 INFO:tasks.workunit.client.1.smithi194.stdout:2/17: mknod d2/d5/c8 0 2024-04-13T10:58:29.046 INFO:tasks.workunit.client.1.smithi194.stdout:8/6: symlink l3 0 2024-04-13T10:58:29.047 INFO:tasks.workunit.client.1.smithi194.stdout:4/16: mknod d2/c7 0 2024-04-13T10:58:29.048 INFO:tasks.workunit.client.1.smithi194.stdout:4/17: dread - d2/f6 zero size 2024-04-13T10:58:29.049 INFO:tasks.workunit.client.1.smithi194.stdout:6/24: creat d0/f4 x:0 0 0 2024-04-13T10:58:29.050 INFO:tasks.workunit.client.1.smithi194.stdout:9/6: creat d0/f2 x:0 0 0 2024-04-13T10:58:29.051 INFO:tasks.workunit.client.1.smithi194.stdout:2/18: rename d2/f6 to d2/d5/f9 0 2024-04-13T10:58:29.053 INFO:tasks.workunit.client.1.smithi194.stdout:8/7: rename f0 to f4 0 2024-04-13T10:58:29.054 INFO:tasks.workunit.client.1.smithi194.stdout:8/8: stat f4 0 2024-04-13T10:58:29.060 INFO:tasks.workunit.client.1.smithi194.stdout:4/18: link l0 d2/l8 0 2024-04-13T10:58:29.060 INFO:tasks.workunit.client.1.smithi194.stdout:6/25: dwrite d0/f4 [0,4194304] 0 2024-04-13T10:58:29.064 INFO:tasks.workunit.client.1.smithi194.stdout:9/7: dwrite d0/f2 [0,4194304] 0 2024-04-13T10:58:29.071 INFO:tasks.workunit.client.1.smithi194.stdout:9/8: creat d0/f3 x:0 0 0 2024-04-13T10:58:29.084 INFO:tasks.workunit.client.1.smithi194.stdout:4/19: dwrite d2/f6 [0,4194304] 0 2024-04-13T10:58:29.086 INFO:tasks.workunit.client.1.smithi194.stdout:8/9: dwrite f2 [0,4194304] 0 2024-04-13T10:58:29.088 INFO:tasks.workunit.client.1.smithi194.stdout:9/9: dwrite d0/f2 [0,4194304] 0 2024-04-13T10:58:29.089 INFO:tasks.workunit.client.1.smithi194.stdout:8/10: write f2 [2879181,18476] 0 2024-04-13T10:58:29.090 INFO:tasks.workunit.client.1.smithi194.stdout:8/11: chown l3 100606060 1 2024-04-13T10:58:29.091 INFO:tasks.workunit.client.1.smithi194.stdout:4/20: chown l0 28 1 2024-04-13T10:58:29.096 INFO:tasks.workunit.client.1.smithi194.stdout:4/21: dread d2/f4 [0,4194304] 0 2024-04-13T10:58:29.104 INFO:tasks.workunit.client.1.smithi194.stdout:4/22: dwrite d2/f4 [0,4194304] 0 2024-04-13T10:58:29.109 INFO:tasks.workunit.client.1.smithi194.stdout:4/23: dread d2/f4 [0,4194304] 0 2024-04-13T10:58:29.109 INFO:tasks.workunit.client.1.smithi194.stdout:4/24: readlink d2/l3 0 2024-04-13T10:58:29.110 INFO:tasks.workunit.client.1.smithi194.stdout:4/25: read d2/f6 [2799343,47822] 0 2024-04-13T10:58:29.113 INFO:tasks.workunit.client.1.smithi194.stdout:4/26: symlink d2/l9 0 2024-04-13T10:58:29.114 INFO:tasks.workunit.client.1.smithi194.stdout:9/10: fdatasync d0/f2 0 2024-04-13T10:58:29.121 INFO:tasks.workunit.client.1.smithi194.stdout:4/27: dwrite d2/f4 [0,4194304] 0 2024-04-13T10:58:29.125 INFO:tasks.workunit.client.1.smithi194.stdout:4/28: dread d2/f4 [0,4194304] 0 2024-04-13T10:58:29.125 INFO:tasks.workunit.client.1.smithi194.stdout:4/29: chown d2/l3 6 1 2024-04-13T10:58:29.305 INFO:tasks.workunit.client.1.smithi194.stdout:1/8: fsync f1 0 2024-04-13T10:58:29.315 INFO:tasks.workunit.client.1.smithi194.stdout:1/9: dwrite f1 [0,4194304] 0 2024-04-13T10:58:29.318 INFO:tasks.workunit.client.1.smithi194.stdout:1/10: creat f2 x:0 0 0 2024-04-13T10:58:29.325 INFO:tasks.workunit.client.1.smithi194.stdout:1/11: dwrite f2 [0,4194304] 0 2024-04-13T10:58:29.332 INFO:tasks.workunit.client.1.smithi194.stdout:1/12: symlink l3 0 2024-04-13T10:58:29.332 INFO:tasks.workunit.client.1.smithi194.stdout:7/1: fsync f0 0 2024-04-13T10:58:29.337 INFO:tasks.workunit.client.1.smithi194.stdout:7/2: mkdir d1 0 2024-04-13T10:58:29.338 INFO:tasks.workunit.client.1.smithi194.stdout:1/13: dwrite f2 [0,4194304] 0 2024-04-13T10:58:29.338 INFO:tasks.workunit.client.1.smithi194.stdout:1/14: stat f1 0 2024-04-13T10:58:29.343 INFO:tasks.workunit.client.1.smithi194.stdout:7/3: getdents d1 0 2024-04-13T10:58:29.343 INFO:tasks.workunit.client.1.smithi194.stdout:7/4: rename d1 to d1/d2 22 2024-04-13T10:58:29.351 INFO:tasks.workunit.client.1.smithi194.stdout:7/5: creat d1/f3 x:0 0 0 2024-04-13T10:58:29.357 INFO:tasks.workunit.client.1.smithi194.stdout:7/6: dwrite f0 [0,4194304] 0 2024-04-13T10:58:29.362 INFO:tasks.workunit.client.1.smithi194.stdout:6/26: getdents d0 0 2024-04-13T10:58:29.364 INFO:tasks.workunit.client.1.smithi194.stdout:2/19: getdents d2 0 2024-04-13T10:58:29.365 INFO:tasks.workunit.client.1.smithi194.stdout:2/20: chown d2/d5/c8 80144 1 2024-04-13T10:58:29.370 INFO:tasks.workunit.client.1.smithi194.stdout:2/21: mknod d2/d5/ca 0 2024-04-13T10:58:29.375 INFO:tasks.workunit.client.1.smithi194.stdout:6/27: dwrite d0/f4 [4194304,4194304] 0 2024-04-13T10:58:29.376 INFO:tasks.workunit.client.1.smithi194.stdout:4/30: write d2/f6 [4403268,38829] 0 2024-04-13T10:58:29.380 INFO:tasks.workunit.client.1.smithi194.stdout:6/28: rename d0/f4 to d0/f5 0 2024-04-13T10:58:29.381 INFO:tasks.workunit.client.1.smithi194.stdout:6/29: read d0/f5 [5282239,125492] 0 2024-04-13T10:58:29.385 INFO:tasks.workunit.client.1.smithi194.stdout:8/12: truncate f2 1280351 0 2024-04-13T10:58:29.385 INFO:tasks.workunit.client.1.smithi194.stdout:8/13: readlink l3 0 2024-04-13T10:58:29.387 INFO:tasks.workunit.client.1.smithi194.stdout:6/30: symlink d0/l6 0 2024-04-13T10:58:29.387 INFO:tasks.workunit.client.1.smithi194.stdout:6/31: stat d0/f5 0 2024-04-13T10:58:29.390 INFO:tasks.workunit.client.1.smithi194.stdout:6/32: dread d0/f5 [4194304,4194304] 0 2024-04-13T10:58:29.393 INFO:tasks.workunit.client.1.smithi194.stdout:8/14: rename f4 to f5 0 2024-04-13T10:58:29.396 INFO:tasks.workunit.client.1.smithi194.stdout:4/31: getdents d2 0 2024-04-13T10:58:29.484 INFO:tasks.workunit.client.1.smithi194.stdout:1/15: getdents . 0 2024-04-13T10:58:29.484 INFO:tasks.workunit.client.1.smithi194.stdout:1/16: write f0 [3829159,15106] 0 2024-04-13T10:58:29.490 INFO:tasks.workunit.client.1.smithi194.stdout:1/17: dwrite f0 [4194304,4194304] 0 2024-04-13T10:58:29.504 INFO:tasks.workunit.client.1.smithi194.stdout:1/18: fdatasync f0 0 2024-04-13T10:58:29.510 INFO:tasks.workunit.client.1.smithi194.stdout:7/7: dwrite f0 [4194304,4194304] 0 2024-04-13T10:58:29.512 INFO:tasks.workunit.client.1.smithi194.stdout:7/8: write f0 [6976833,65682] 0 2024-04-13T10:58:29.516 INFO:tasks.workunit.client.1.smithi194.stdout:6/33: dwrite d0/f5 [8388608,4194304] 0 2024-04-13T10:58:29.532 INFO:tasks.workunit.client.1.smithi194.stdout:8/15: getdents . 0 2024-04-13T10:58:29.532 INFO:tasks.workunit.client.1.smithi194.stdout:8/16: rmdir - no directory 2024-04-13T10:58:29.532 INFO:tasks.workunit.client.1.smithi194.stdout:8/17: readlink l3 0 2024-04-13T10:58:29.684 INFO:tasks.workunit.client.1.smithi194.stdout:1/19: mknod c4 0 2024-04-13T10:58:29.684 INFO:tasks.workunit.client.1.smithi194.stdout:1/20: readlink l3 0 2024-04-13T10:58:29.685 INFO:tasks.workunit.client.1.smithi194.stdout:7/9: symlink d1/l4 0 2024-04-13T10:58:29.686 INFO:tasks.workunit.client.1.smithi194.stdout:7/10: truncate d1/f3 1021736 0 2024-04-13T10:58:29.686 INFO:tasks.workunit.client.1.smithi194.stdout:8/18: mkdir d6 0 2024-04-13T10:58:29.689 INFO:tasks.workunit.client.1.smithi194.stdout:7/11: dread f0 [0,4194304] 0 2024-04-13T10:58:29.695 INFO:tasks.workunit.client.1.smithi194.stdout:1/21: link f1 f5 0 2024-04-13T10:58:29.696 INFO:tasks.workunit.client.1.smithi194.stdout:7/12: dwrite d1/f3 [0,4194304] 0 2024-04-13T10:58:29.699 INFO:tasks.workunit.client.1.smithi194.stdout:1/22: dread f1 [4194304,4194304] 0 2024-04-13T10:58:29.699 INFO:tasks.workunit.client.1.smithi194.stdout:8/19: creat d6/f7 x:0 0 0 2024-04-13T10:58:29.706 INFO:tasks.workunit.client.1.smithi194.stdout:7/13: rename f0 to d1/f5 0 2024-04-13T10:58:29.709 INFO:tasks.workunit.client.1.smithi194.stdout:1/23: creat f6 x:0 0 0 2024-04-13T10:58:29.709 INFO:tasks.workunit.client.1.smithi194.stdout:1/24: read f0 [2321822,71846] 0 2024-04-13T10:58:29.710 INFO:tasks.workunit.client.1.smithi194.stdout:8/20: creat d6/f8 x:0 0 0 2024-04-13T10:58:29.712 INFO:tasks.workunit.client.1.smithi194.stdout:8/21: dread f5 [0,4194304] 0 2024-04-13T10:58:29.714 INFO:tasks.workunit.client.1.smithi194.stdout:1/25: mknod c7 0 2024-04-13T10:58:29.714 INFO:tasks.workunit.client.1.smithi194.stdout:7/14: fsync d1/f3 0 2024-04-13T10:58:29.721 INFO:tasks.workunit.client.1.smithi194.stdout:1/26: dwrite f0 [0,4194304] 0 2024-04-13T10:58:29.724 INFO:tasks.workunit.client.1.smithi194.stdout:1/27: mknod c8 0 2024-04-13T10:58:29.725 INFO:tasks.workunit.client.1.smithi194.stdout:1/28: creat f9 x:0 0 0 2024-04-13T10:58:29.725 INFO:tasks.workunit.client.1.smithi194.stdout:1/29: chown f0 7455381 1 2024-04-13T10:58:29.869 INFO:tasks.workunit.client.1.smithi194.stdout:6/34: truncate d0/f5 6618897 0 2024-04-13T10:58:29.881 INFO:tasks.workunit.client.1.smithi194.stdout:1/30: getdents . 0 2024-04-13T10:58:29.883 INFO:tasks.workunit.client.1.smithi194.stdout:1/31: creat fa x:0 0 0 2024-04-13T10:58:29.884 INFO:tasks.workunit.client.1.smithi194.stdout:1/32: fsync f6 0 2024-04-13T10:58:29.886 INFO:tasks.workunit.client.1.smithi194.stdout:1/33: dread f2 [0,4194304] 0 2024-04-13T10:58:29.892 INFO:tasks.workunit.client.1.smithi194.stdout:1/34: dwrite f6 [0,4194304] 0 2024-04-13T10:58:29.895 INFO:tasks.workunit.client.1.smithi194.stdout:1/35: dread f2 [0,4194304] 0 2024-04-13T10:58:29.897 INFO:tasks.workunit.client.1.smithi194.stdout:1/36: unlink fa 0 2024-04-13T10:58:29.917 INFO:tasks.workunit.client.1.smithi194.stdout:1/37: truncate f1 335949 0 2024-04-13T10:58:29.923 INFO:tasks.workunit.client.1.smithi194.stdout:6/35: dwrite d0/f5 [4194304,4194304] 0 2024-04-13T10:58:29.929 INFO:tasks.workunit.client.1.smithi194.stdout:1/38: dwrite f5 [0,4194304] 0 2024-04-13T10:58:29.934 INFO:tasks.workunit.client.1.smithi194.stdout:1/39: rename f9 to fb 0 2024-04-13T10:58:30.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:30 smithi134 ceph-mon[39696]: pgmap v19: 65 pgs: 65 active+clean; 212 MiB data, 840 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 475 op/s 2024-04-13T10:58:30.730 INFO:tasks.workunit.client.0.smithi134.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-13T10:58:30.734 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-13T10:58:30.734 INFO:tasks.workunit.client.0.smithi134.stderr:+ make 2024-04-13T10:58:30.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:30 smithi194 ceph-mon[46737]: pgmap v19: 65 pgs: 65 active+clean; 212 MiB data, 840 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 475 op/s 2024-04-13T10:58:30.856 INFO:tasks.workunit.client.0.smithi134.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-13T10:58:31.338 INFO:tasks.workunit.client.0.smithi134.stderr:++ readlink -f fsstress 2024-04-13T10:58:31.339 INFO:tasks.workunit.client.0.smithi134.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-13T10:58:31.339 INFO:tasks.workunit.client.0.smithi134.stderr:+ popd 2024-04-13T10:58:31.340 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-13T10:58:31.340 INFO:tasks.workunit.client.0.smithi134.stderr:+ popd 2024-04-13T10:58:31.340 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-13T10:58:31.341 INFO:tasks.workunit.client.0.smithi134.stderr:++ mktemp -d -p . 2024-04-13T10:58:31.343 INFO:tasks.workunit.client.0.smithi134.stderr:+ T=./tmp.Wq2SlnTEou 2024-04-13T10:58:31.343 INFO:tasks.workunit.client.0.smithi134.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Wq2SlnTEou -l 1 -n 1000 -p 10 -v 2024-04-13T10:58:31.345 INFO:tasks.workunit.client.0.smithi134.stdout:seed = 1713319495 2024-04-13T10:58:31.362 INFO:tasks.workunit.client.0.smithi134.stdout:0/0: link - no file 2024-04-13T10:58:31.362 INFO:tasks.workunit.client.0.smithi134.stdout:0/1: write - no filename 2024-04-13T10:58:31.362 INFO:tasks.workunit.client.0.smithi134.stdout:0/2: dread - no filename 2024-04-13T10:58:31.451 INFO:tasks.workunit.client.0.smithi134.stdout:1/0: stat - no entries 2024-04-13T10:58:31.453 INFO:tasks.workunit.client.0.smithi134.stdout:0/3: mknod c0 0 2024-04-13T10:58:31.454 INFO:tasks.workunit.client.0.smithi134.stdout:2/0: write - no filename 2024-04-13T10:58:31.454 INFO:tasks.workunit.client.0.smithi134.stdout:2/1: read - no filename 2024-04-13T10:58:31.456 INFO:tasks.workunit.client.0.smithi134.stdout:1/1: symlink l0 0 2024-04-13T10:58:31.456 INFO:tasks.workunit.client.0.smithi134.stdout:1/2: dwrite - no filename 2024-04-13T10:58:31.456 INFO:tasks.workunit.client.0.smithi134.stdout:1/3: dwrite - no filename 2024-04-13T10:58:31.456 INFO:tasks.workunit.client.0.smithi134.stdout:1/4: write - no filename 2024-04-13T10:58:31.458 INFO:tasks.workunit.client.0.smithi134.stdout:3/0: readlink - no filename 2024-04-13T10:58:31.460 INFO:tasks.workunit.client.0.smithi134.stdout:1/5: unlink l0 0 2024-04-13T10:58:31.460 INFO:tasks.workunit.client.0.smithi134.stdout:1/6: chown . 13 1 2024-04-13T10:58:31.461 INFO:tasks.workunit.client.0.smithi134.stdout:2/2: creat f0 x:0 0 0 2024-04-13T10:58:31.462 INFO:tasks.workunit.client.0.smithi134.stdout:4/0: write - no filename 2024-04-13T10:58:31.462 INFO:tasks.workunit.client.0.smithi134.stdout:4/1: rename - no filename 2024-04-13T10:58:31.462 INFO:tasks.workunit.client.0.smithi134.stdout:4/2: chown . 946 1 2024-04-13T10:58:31.463 INFO:tasks.workunit.client.0.smithi134.stdout:0/4: link c0 c1 0 2024-04-13T10:58:31.463 INFO:tasks.workunit.client.0.smithi134.stdout:0/5: write - no filename 2024-04-13T10:58:31.465 INFO:tasks.workunit.client.0.smithi134.stdout:1/7: creat f1 x:0 0 0 2024-04-13T10:58:31.465 INFO:tasks.workunit.client.0.smithi134.stdout:1/8: write f1 [547946,2993] 0 2024-04-13T10:58:31.466 INFO:tasks.workunit.client.0.smithi134.stdout:2/3: unlink f0 0 2024-04-13T10:58:31.466 INFO:tasks.workunit.client.0.smithi134.stdout:2/4: chown . 50927 1 2024-04-13T10:58:31.467 INFO:tasks.workunit.client.0.smithi134.stdout:2/5: dread - no filename 2024-04-13T10:58:31.468 INFO:tasks.workunit.client.0.smithi134.stdout:5/0: rename - no filename 2024-04-13T10:58:31.468 INFO:tasks.workunit.client.0.smithi134.stdout:5/1: dread - no filename 2024-04-13T10:58:31.468 INFO:tasks.workunit.client.0.smithi134.stdout:5/2: write - no filename 2024-04-13T10:58:31.468 INFO:tasks.workunit.client.0.smithi134.stdout:5/3: truncate - no filename 2024-04-13T10:58:31.468 INFO:tasks.workunit.client.0.smithi134.stdout:5/4: fsync - no filename 2024-04-13T10:58:31.468 INFO:tasks.workunit.client.0.smithi134.stdout:5/5: truncate - no filename 2024-04-13T10:58:31.469 INFO:tasks.workunit.client.0.smithi134.stdout:3/1: creat f0 x:0 0 0 2024-04-13T10:58:31.473 INFO:tasks.workunit.client.0.smithi134.stdout:1/9: creat f2 x:0 0 0 2024-04-13T10:58:31.474 INFO:tasks.workunit.client.0.smithi134.stdout:2/6: creat f1 x:0 0 0 2024-04-13T10:58:31.474 INFO:tasks.workunit.client.0.smithi134.stdout:1/10: read - f2 zero size 2024-04-13T10:58:31.476 INFO:tasks.workunit.client.0.smithi134.stdout:6/0: dwrite - no filename 2024-04-13T10:58:31.476 INFO:tasks.workunit.client.0.smithi134.stdout:6/1: dwrite - no filename 2024-04-13T10:58:31.476 INFO:tasks.workunit.client.0.smithi134.stdout:2/7: write f1 [935393,122718] 0 2024-04-13T10:58:31.477 INFO:tasks.workunit.client.0.smithi134.stdout:4/3: symlink l0 0 2024-04-13T10:58:31.477 INFO:tasks.workunit.client.0.smithi134.stdout:4/4: truncate - no filename 2024-04-13T10:58:31.477 INFO:tasks.workunit.client.0.smithi134.stdout:4/5: truncate - no filename 2024-04-13T10:58:31.477 INFO:tasks.workunit.client.0.smithi134.stdout:0/6: stat c1 0 2024-04-13T10:58:31.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/6: stat l0 0 2024-04-13T10:58:31.478 INFO:tasks.workunit.client.0.smithi134.stdout:3/2: dwrite f0 [0,4194304] 0 2024-04-13T10:58:31.481 INFO:tasks.workunit.client.0.smithi134.stdout:1/11: mkdir d3 0 2024-04-13T10:58:31.484 INFO:tasks.workunit.client.0.smithi134.stdout:5/6: creat f0 x:0 0 0 2024-04-13T10:58:31.485 INFO:tasks.workunit.client.0.smithi134.stdout:5/7: dread - f0 zero size 2024-04-13T10:58:31.489 INFO:tasks.workunit.client.0.smithi134.stdout:0/7: creat f2 x:0 0 0 2024-04-13T10:58:31.492 INFO:tasks.workunit.client.0.smithi134.stdout:3/3: symlink l1 0 2024-04-13T10:58:31.495 INFO:tasks.workunit.client.0.smithi134.stdout:2/8: dread f1 [0,4194304] 0 2024-04-13T10:58:31.495 INFO:tasks.workunit.client.0.smithi134.stdout:5/8: dwrite f0 [0,4194304] 0 2024-04-13T10:58:31.499 INFO:tasks.workunit.client.0.smithi134.stdout:8/0: fsync - no filename 2024-04-13T10:58:31.499 INFO:tasks.workunit.client.0.smithi134.stdout:8/1: dread - no filename 2024-04-13T10:58:31.499 INFO:tasks.workunit.client.0.smithi134.stdout:8/2: dwrite - no filename 2024-04-13T10:58:31.499 INFO:tasks.workunit.client.0.smithi134.stdout:8/3: fdatasync - no filename 2024-04-13T10:58:31.501 INFO:tasks.workunit.client.0.smithi134.stdout:6/2: mknod c0 0 2024-04-13T10:58:31.501 INFO:tasks.workunit.client.0.smithi134.stdout:6/3: dwrite - no filename 2024-04-13T10:58:31.501 INFO:tasks.workunit.client.0.smithi134.stdout:6/4: rmdir - no directory 2024-04-13T10:58:31.503 INFO:tasks.workunit.client.0.smithi134.stdout:5/9: dread f0 [0,4194304] 0 2024-04-13T10:58:31.507 INFO:tasks.workunit.client.0.smithi134.stdout:1/12: creat d3/f4 x:0 0 0 2024-04-13T10:58:31.510 INFO:tasks.workunit.client.0.smithi134.stdout:2/9: symlink l2 0 2024-04-13T10:58:31.514 INFO:tasks.workunit.client.0.smithi134.stdout:7/0: creat f0 x:0 0 0 2024-04-13T10:58:31.519 INFO:tasks.workunit.client.0.smithi134.stdout:0/8: stat c0 0 2024-04-13T10:58:31.520 INFO:tasks.workunit.client.0.smithi134.stdout:0/9: read - f2 zero size 2024-04-13T10:58:31.521 INFO:tasks.workunit.client.0.smithi134.stdout:1/13: mknod d3/c5 0 2024-04-13T10:58:31.524 INFO:tasks.workunit.client.0.smithi134.stdout:2/10: creat f3 x:0 0 0 2024-04-13T10:58:31.525 INFO:tasks.workunit.client.0.smithi134.stdout:2/11: dread - f3 zero size 2024-04-13T10:58:31.527 INFO:tasks.workunit.client.0.smithi134.stdout:7/1: creat f1 x:0 0 0 2024-04-13T10:58:31.527 INFO:tasks.workunit.client.0.smithi134.stdout:7/2: truncate f1 287678 0 2024-04-13T10:58:31.531 INFO:tasks.workunit.client.0.smithi134.stdout:8/4: creat f0 x:0 0 0 2024-04-13T10:58:31.534 INFO:tasks.workunit.client.0.smithi134.stdout:8/5: write f0 [468744,117502] 0 2024-04-13T10:58:31.535 INFO:tasks.workunit.client.0.smithi134.stdout:5/10: link f0 f1 0 2024-04-13T10:58:31.538 INFO:tasks.workunit.client.0.smithi134.stdout:7/3: dwrite f1 [0,4194304] 0 2024-04-13T10:58:31.538 INFO:tasks.workunit.client.0.smithi134.stdout:7/4: readlink - no filename 2024-04-13T10:58:31.538 INFO:tasks.workunit.client.0.smithi134.stdout:1/14: mkdir d3/d6 0 2024-04-13T10:58:31.539 INFO:tasks.workunit.client.0.smithi134.stdout:1/15: write f1 [333730,105223] 0 2024-04-13T10:58:31.540 INFO:tasks.workunit.client.0.smithi134.stdout:1/16: chown d3/f4 43 1 2024-04-13T10:58:31.545 INFO:tasks.workunit.client.0.smithi134.stdout:2/12: rename f3 to f4 0 2024-04-13T10:58:31.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/0: symlink l0 0 2024-04-13T10:58:31.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/1: dread - no filename 2024-04-13T10:58:31.551 INFO:tasks.workunit.client.0.smithi134.stdout:1/17: dwrite f1 [0,4194304] 0 2024-04-13T10:58:31.553 INFO:tasks.workunit.client.0.smithi134.stdout:8/6: symlink l1 0 2024-04-13T10:58:31.555 INFO:tasks.workunit.client.0.smithi134.stdout:5/11: creat f2 x:0 0 0 2024-04-13T10:58:31.559 INFO:tasks.workunit.client.0.smithi134.stdout:5/12: dread f0 [0,4194304] 0 2024-04-13T10:58:31.563 INFO:tasks.workunit.client.0.smithi134.stdout:2/13: mkdir d5 0 2024-04-13T10:58:31.564 INFO:tasks.workunit.client.0.smithi134.stdout:2/14: truncate f4 512770 0 2024-04-13T10:58:31.565 INFO:tasks.workunit.client.0.smithi134.stdout:9/2: symlink l1 0 2024-04-13T10:58:31.565 INFO:tasks.workunit.client.0.smithi134.stdout:9/3: chown l1 285020482 1 2024-04-13T10:58:31.565 INFO:tasks.workunit.client.0.smithi134.stdout:9/4: fsync - no filename 2024-04-13T10:58:31.566 INFO:tasks.workunit.client.0.smithi134.stdout:9/5: chown l1 64 1 2024-04-13T10:58:31.579 INFO:tasks.workunit.client.0.smithi134.stdout:2/15: mkdir d5/d6 0 2024-04-13T10:58:31.583 INFO:tasks.workunit.client.0.smithi134.stdout:9/6: link l1 l2 0 2024-04-13T10:58:31.583 INFO:tasks.workunit.client.0.smithi134.stdout:9/7: truncate - no filename 2024-04-13T10:58:31.589 INFO:tasks.workunit.client.0.smithi134.stdout:2/16: dwrite f4 [0,4194304] 0 2024-04-13T10:58:31.598 INFO:tasks.workunit.client.0.smithi134.stdout:2/17: dwrite f4 [0,4194304] 0 2024-04-13T10:58:31.602 INFO:tasks.workunit.client.0.smithi134.stdout:2/18: mknod d5/c7 0 2024-04-13T10:58:31.607 INFO:tasks.workunit.client.0.smithi134.stdout:2/19: link f4 d5/d6/f8 0 2024-04-13T10:58:31.613 INFO:tasks.workunit.client.0.smithi134.stdout:2/20: link f1 d5/d6/f9 0 2024-04-13T10:58:31.687 INFO:tasks.workunit.client.0.smithi134.stdout:0/10: fsync f2 0 2024-04-13T10:58:31.689 INFO:tasks.workunit.client.0.smithi134.stdout:6/5: getdents . 0 2024-04-13T10:58:31.690 INFO:tasks.workunit.client.0.smithi134.stdout:6/6: fdatasync - no filename 2024-04-13T10:58:31.691 INFO:tasks.workunit.client.0.smithi134.stdout:6/7: unlink c0 0 2024-04-13T10:58:31.691 INFO:tasks.workunit.client.0.smithi134.stdout:6/8: write - no filename 2024-04-13T10:58:31.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/9: rename - no filename 2024-04-13T10:58:31.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/10: link - no file 2024-04-13T10:58:31.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/11: truncate - no filename 2024-04-13T10:58:31.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/12: rmdir - no directory 2024-04-13T10:58:31.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/13: fdatasync - no filename 2024-04-13T10:58:31.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/14: read - no filename 2024-04-13T10:58:31.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/15: rmdir - no directory 2024-04-13T10:58:31.693 INFO:tasks.workunit.client.0.smithi134.stdout:6/16: creat f1 x:0 0 0 2024-04-13T10:58:31.695 INFO:tasks.workunit.client.0.smithi134.stdout:7/5: fsync f0 0 2024-04-13T10:58:31.701 INFO:tasks.workunit.client.0.smithi134.stdout:3/4: truncate f0 1053616 0 2024-04-13T10:58:31.702 INFO:tasks.workunit.client.0.smithi134.stdout:6/17: dwrite f1 [0,4194304] 0 2024-04-13T10:58:31.703 INFO:tasks.workunit.client.0.smithi134.stdout:3/5: creat f2 x:0 0 0 2024-04-13T10:58:31.705 INFO:tasks.workunit.client.0.smithi134.stdout:8/7: fsync f0 0 2024-04-13T10:58:31.706 INFO:tasks.workunit.client.0.smithi134.stdout:7/6: dwrite f1 [0,4194304] 0 2024-04-13T10:58:31.714 INFO:tasks.workunit.client.0.smithi134.stdout:7/7: mknod c2 0 2024-04-13T10:58:31.715 INFO:tasks.workunit.client.0.smithi134.stdout:8/8: dread f0 [0,4194304] 0 2024-04-13T10:58:31.716 INFO:tasks.workunit.client.0.smithi134.stdout:7/8: mkdir d3 0 2024-04-13T10:58:31.717 INFO:tasks.workunit.client.0.smithi134.stdout:3/6: dwrite f2 [0,4194304] 0 2024-04-13T10:58:31.725 INFO:tasks.workunit.client.0.smithi134.stdout:7/9: rmdir d3 0 2024-04-13T10:58:31.725 INFO:tasks.workunit.client.0.smithi134.stdout:7/10: rmdir - no directory 2024-04-13T10:58:31.727 INFO:tasks.workunit.client.0.smithi134.stdout:7/11: rename f1 to f4 0 2024-04-13T10:58:31.730 INFO:tasks.workunit.client.0.smithi134.stdout:7/12: link f0 f5 0 2024-04-13T10:58:31.730 INFO:tasks.workunit.client.0.smithi134.stdout:7/13: rmdir - no directory 2024-04-13T10:58:31.730 INFO:tasks.workunit.client.0.smithi134.stdout:7/14: read - f0 zero size 2024-04-13T10:58:31.736 INFO:tasks.workunit.client.0.smithi134.stdout:5/13: truncate f0 2571752 0 2024-04-13T10:58:31.739 INFO:tasks.workunit.client.0.smithi134.stdout:1/18: dwrite f1 [4194304,4194304] 0 2024-04-13T10:58:31.741 INFO:tasks.workunit.client.0.smithi134.stdout:1/19: stat d3 0 2024-04-13T10:58:31.745 INFO:tasks.workunit.client.0.smithi134.stdout:7/15: dwrite f5 [0,4194304] 0 2024-04-13T10:58:31.746 INFO:tasks.workunit.client.0.smithi134.stdout:1/20: rename d3/f4 to d3/d6/f7 0 2024-04-13T10:58:31.752 INFO:tasks.workunit.client.0.smithi134.stdout:1/21: creat d3/f8 x:0 0 0 2024-04-13T10:58:31.753 INFO:tasks.workunit.client.0.smithi134.stdout:1/22: dread - d3/f8 zero size 2024-04-13T10:58:31.756 INFO:tasks.workunit.client.0.smithi134.stdout:1/23: link d3/d6/f7 d3/f9 0 2024-04-13T10:58:31.762 INFO:tasks.workunit.client.0.smithi134.stdout:2/21: fsync f1 0 2024-04-13T10:58:31.764 INFO:tasks.workunit.client.0.smithi134.stdout:2/22: write f4 [4134891,53652] 0 2024-04-13T10:58:31.768 INFO:tasks.workunit.client.0.smithi134.stdout:2/23: getdents d5 0 2024-04-13T10:58:31.769 INFO:tasks.workunit.client.0.smithi134.stdout:2/24: rmdir d5/d6 39 2024-04-13T10:58:31.772 INFO:tasks.workunit.client.0.smithi134.stdout:2/25: write d5/d6/f9 [2065175,20050] 0 2024-04-13T10:58:31.773 INFO:tasks.workunit.client.0.smithi134.stdout:2/26: write f4 [567936,110428] 0 2024-04-13T10:58:31.792 INFO:tasks.workunit.client.0.smithi134.stdout:5/14: truncate f0 2600533 0 2024-04-13T10:58:31.793 INFO:tasks.workunit.client.0.smithi134.stdout:7/16: write f0 [4591835,48471] 0 2024-04-13T10:58:31.794 INFO:tasks.workunit.client.0.smithi134.stdout:3/7: dwrite f0 [0,4194304] 0 2024-04-13T10:58:31.794 INFO:tasks.workunit.client.0.smithi134.stdout:5/15: mknod c3 0 2024-04-13T10:58:31.795 INFO:tasks.workunit.client.0.smithi134.stdout:6/18: dwrite f1 [4194304,4194304] 0 2024-04-13T10:58:31.796 INFO:tasks.workunit.client.0.smithi134.stdout:6/19: chown f1 1365479420 1 2024-04-13T10:58:31.797 INFO:tasks.workunit.client.0.smithi134.stdout:6/20: write f1 [9372808,5576] 0 2024-04-13T10:58:31.798 INFO:tasks.workunit.client.0.smithi134.stdout:1/24: getdents d3 0 2024-04-13T10:58:31.800 INFO:tasks.workunit.client.0.smithi134.stdout:7/17: creat f6 x:0 0 0 2024-04-13T10:58:31.800 INFO:tasks.workunit.client.0.smithi134.stdout:3/8: symlink l3 0 2024-04-13T10:58:31.802 INFO:tasks.workunit.client.0.smithi134.stdout:5/16: symlink l4 0 2024-04-13T10:58:31.804 INFO:tasks.workunit.client.0.smithi134.stdout:2/27: truncate f4 1698124 0 2024-04-13T10:58:31.806 INFO:tasks.workunit.client.0.smithi134.stdout:2/28: fdatasync d5/d6/f9 0 2024-04-13T10:58:31.809 INFO:tasks.workunit.client.0.smithi134.stdout:3/9: creat f4 x:0 0 0 2024-04-13T10:58:31.809 INFO:tasks.workunit.client.0.smithi134.stdout:6/21: dwrite f1 [8388608,4194304] 0 2024-04-13T10:58:31.809 INFO:tasks.workunit.client.0.smithi134.stdout:7/18: dread f5 [0,4194304] 0 2024-04-13T10:58:31.815 INFO:tasks.workunit.client.0.smithi134.stdout:7/19: creat f7 x:0 0 0 2024-04-13T10:58:31.816 INFO:tasks.workunit.client.0.smithi134.stdout:6/22: dread f1 [0,4194304] 0 2024-04-13T10:58:31.816 INFO:tasks.workunit.client.0.smithi134.stdout:6/23: stat f1 0 2024-04-13T10:58:31.817 INFO:tasks.workunit.client.0.smithi134.stdout:6/24: read f1 [8806867,9866] 0 2024-04-13T10:58:31.817 INFO:tasks.workunit.client.0.smithi134.stdout:7/20: creat f8 x:0 0 0 2024-04-13T10:58:31.819 INFO:tasks.workunit.client.0.smithi134.stdout:7/21: mknod c9 0 2024-04-13T10:58:31.820 INFO:tasks.workunit.client.0.smithi134.stdout:7/22: mkdir da 0 2024-04-13T10:58:31.822 INFO:tasks.workunit.client.0.smithi134.stdout:7/23: fdatasync f4 0 2024-04-13T10:58:31.822 INFO:tasks.workunit.client.0.smithi134.stdout:6/25: dread f1 [8388608,4194304] 0 2024-04-13T10:58:31.825 INFO:tasks.workunit.client.0.smithi134.stdout:2/29: dread d5/d6/f8 [0,4194304] 0 2024-04-13T10:58:31.826 INFO:tasks.workunit.client.0.smithi134.stdout:7/24: link f7 da/fb 0 2024-04-13T10:58:31.827 INFO:tasks.workunit.client.0.smithi134.stdout:7/25: dread - f8 zero size 2024-04-13T10:58:31.827 INFO:tasks.workunit.client.0.smithi134.stdout:6/26: dread f1 [8388608,4194304] 0 2024-04-13T10:58:31.827 INFO:tasks.workunit.client.0.smithi134.stdout:3/10: getdents . 0 2024-04-13T10:58:31.828 INFO:tasks.workunit.client.0.smithi134.stdout:2/30: write d5/d6/f9 [583990,65255] 0 2024-04-13T10:58:31.829 INFO:tasks.workunit.client.0.smithi134.stdout:3/11: readlink l1 0 2024-04-13T10:58:31.831 INFO:tasks.workunit.client.0.smithi134.stdout:6/27: rename f1 to f2 0 2024-04-13T10:58:31.831 INFO:tasks.workunit.client.0.smithi134.stdout:2/31: dread d5/d6/f8 [0,4194304] 0 2024-04-13T10:58:31.832 INFO:tasks.workunit.client.0.smithi134.stdout:2/32: read d5/d6/f8 [32137,103832] 0 2024-04-13T10:58:31.833 INFO:tasks.workunit.client.0.smithi134.stdout:3/12: creat f5 x:0 0 0 2024-04-13T10:58:31.834 INFO:tasks.workunit.client.0.smithi134.stdout:3/13: write f4 [1003610,93291] 0 2024-04-13T10:58:31.834 INFO:tasks.workunit.client.0.smithi134.stdout:6/28: symlink l3 0 2024-04-13T10:58:31.835 INFO:tasks.workunit.client.0.smithi134.stdout:5/17: write f1 [1282152,85109] 0 2024-04-13T10:58:31.836 INFO:tasks.workunit.client.0.smithi134.stdout:5/18: chown f0 353382081 1 2024-04-13T10:58:31.837 INFO:tasks.workunit.client.0.smithi134.stdout:2/33: write d5/d6/f8 [467816,48158] 0 2024-04-13T10:58:31.837 INFO:tasks.workunit.client.0.smithi134.stdout:3/14: mknod c6 0 2024-04-13T10:58:31.838 INFO:tasks.workunit.client.0.smithi134.stdout:2/34: read f4 [1694991,75532] 0 2024-04-13T10:58:31.838 INFO:tasks.workunit.client.0.smithi134.stdout:3/15: chown c6 21818619 1 2024-04-13T10:58:31.839 INFO:tasks.workunit.client.0.smithi134.stdout:5/19: fdatasync f0 0 2024-04-13T10:58:31.840 INFO:tasks.workunit.client.0.smithi134.stdout:2/35: write f1 [802455,99146] 0 2024-04-13T10:58:31.848 INFO:tasks.workunit.client.0.smithi134.stdout:6/29: dwrite f2 [4194304,4194304] 0 2024-04-13T10:58:31.849 INFO:tasks.workunit.client.0.smithi134.stdout:6/30: readlink l3 0 2024-04-13T10:58:31.850 INFO:tasks.workunit.client.0.smithi134.stdout:2/36: truncate d5/d6/f8 644099 0 2024-04-13T10:58:31.851 INFO:tasks.workunit.client.0.smithi134.stdout:3/16: dwrite f4 [0,4194304] 0 2024-04-13T10:58:31.852 INFO:tasks.workunit.client.0.smithi134.stdout:6/31: mkdir d4 0 2024-04-13T10:58:31.852 INFO:tasks.workunit.client.0.smithi134.stdout:5/20: dwrite f1 [0,4194304] 0 2024-04-13T10:58:31.855 INFO:tasks.workunit.client.0.smithi134.stdout:3/17: creat f7 x:0 0 0 2024-04-13T10:58:31.863 INFO:tasks.workunit.client.0.smithi134.stdout:6/32: dread f2 [0,4194304] 0 2024-04-13T10:58:31.863 INFO:tasks.workunit.client.0.smithi134.stdout:3/18: mknod c8 0 2024-04-13T10:58:31.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/19: readlink l1 0 2024-04-13T10:58:31.865 INFO:tasks.workunit.client.0.smithi134.stdout:3/20: fsync f0 0 2024-04-13T10:58:31.865 INFO:tasks.workunit.client.0.smithi134.stdout:5/21: dread f0 [0,4194304] 0 2024-04-13T10:58:31.866 INFO:tasks.workunit.client.0.smithi134.stdout:2/37: creat d5/d6/fa x:0 0 0 2024-04-13T10:58:31.868 INFO:tasks.workunit.client.0.smithi134.stdout:3/21: symlink l9 0 2024-04-13T10:58:31.868 INFO:tasks.workunit.client.0.smithi134.stdout:6/33: getdents d4 0 2024-04-13T10:58:31.868 INFO:tasks.workunit.client.0.smithi134.stdout:3/22: fsync f2 0 2024-04-13T10:58:31.869 INFO:tasks.workunit.client.0.smithi134.stdout:6/34: chown l3 424951 1 2024-04-13T10:58:31.869 INFO:tasks.workunit.client.0.smithi134.stdout:3/23: write f5 [234304,70470] 0 2024-04-13T10:58:31.870 INFO:tasks.workunit.client.0.smithi134.stdout:5/22: mknod c5 0 2024-04-13T10:58:31.872 INFO:tasks.workunit.client.0.smithi134.stdout:6/35: rename f2 to d4/f5 0 2024-04-13T10:58:31.874 INFO:tasks.workunit.client.0.smithi134.stdout:5/23: dread f1 [0,4194304] 0 2024-04-13T10:58:31.874 INFO:tasks.workunit.client.0.smithi134.stdout:5/24: chown l4 2982 1 2024-04-13T10:58:31.883 INFO:tasks.workunit.client.0.smithi134.stdout:6/36: dwrite d4/f5 [4194304,4194304] 0 2024-04-13T10:58:31.884 INFO:tasks.workunit.client.0.smithi134.stdout:5/25: dwrite f2 [0,4194304] 0 2024-04-13T10:58:31.886 INFO:tasks.workunit.client.0.smithi134.stdout:3/24: getdents . 0 2024-04-13T10:58:31.888 INFO:tasks.workunit.client.0.smithi134.stdout:6/37: creat d4/f6 x:0 0 0 2024-04-13T10:58:31.892 INFO:tasks.workunit.client.0.smithi134.stdout:3/25: dread f5 [0,4194304] 0 2024-04-13T10:58:31.893 INFO:tasks.workunit.client.0.smithi134.stdout:3/26: truncate f7 815661 0 2024-04-13T10:58:31.893 INFO:tasks.workunit.client.0.smithi134.stdout:3/27: chown f5 11 1 2024-04-13T10:58:31.897 INFO:tasks.workunit.client.0.smithi134.stdout:2/38: write f4 [1255002,58469] 0 2024-04-13T10:58:31.899 INFO:tasks.workunit.client.0.smithi134.stdout:2/39: chown d5/d6/f9 742 1 2024-04-13T10:58:31.901 INFO:tasks.workunit.client.0.smithi134.stdout:3/28: dwrite f0 [4194304,4194304] 0 2024-04-13T10:58:31.901 INFO:tasks.workunit.client.0.smithi134.stdout:2/40: mknod d5/cb 0 2024-04-13T10:58:31.905 INFO:tasks.workunit.client.0.smithi134.stdout:2/41: unlink f4 0 2024-04-13T10:58:31.906 INFO:tasks.workunit.client.0.smithi134.stdout:3/29: dread f0 [0,4194304] 0 2024-04-13T10:58:31.907 INFO:tasks.workunit.client.0.smithi134.stdout:3/30: write f7 [777706,69982] 0 2024-04-13T10:58:31.907 INFO:tasks.workunit.client.0.smithi134.stdout:5/26: fsync f2 0 2024-04-13T10:58:31.908 INFO:tasks.workunit.client.0.smithi134.stdout:5/27: write f2 [1337948,81625] 0 2024-04-13T10:58:31.909 INFO:tasks.workunit.client.0.smithi134.stdout:3/31: creat fa x:0 0 0 2024-04-13T10:58:31.911 INFO:tasks.workunit.client.0.smithi134.stdout:3/32: rename fa to fb 0 2024-04-13T10:58:31.915 INFO:tasks.workunit.client.0.smithi134.stdout:5/28: dwrite f1 [0,4194304] 0 2024-04-13T10:58:31.948 INFO:tasks.workunit.client.0.smithi134.stdout:3/33: dread f4 [0,4194304] 0 2024-04-13T10:58:31.953 INFO:tasks.workunit.client.0.smithi134.stdout:3/34: mkdir dc 0 2024-04-13T10:58:31.955 INFO:tasks.workunit.client.0.smithi134.stdout:3/35: write fb [353150,116106] 0 2024-04-13T10:58:31.956 INFO:tasks.workunit.client.0.smithi134.stdout:5/29: fsync f1 0 2024-04-13T10:58:31.956 INFO:tasks.workunit.client.0.smithi134.stdout:3/36: readlink l1 0 2024-04-13T10:58:31.959 INFO:tasks.workunit.client.0.smithi134.stdout:5/30: rename f0 to f6 0 2024-04-13T10:58:31.960 INFO:tasks.workunit.client.0.smithi134.stdout:2/42: write d5/d6/f8 [157489,93618] 0 2024-04-13T10:58:31.965 INFO:tasks.workunit.client.0.smithi134.stdout:3/37: dwrite f0 [0,4194304] 0 2024-04-13T10:58:31.967 INFO:tasks.workunit.client.0.smithi134.stdout:5/31: write f6 [2716069,26315] 0 2024-04-13T10:58:31.970 INFO:tasks.workunit.client.0.smithi134.stdout:5/32: write f1 [3354256,13223] 0 2024-04-13T10:58:31.975 INFO:tasks.workunit.client.0.smithi134.stdout:3/38: dwrite fb [0,4194304] 0 2024-04-13T10:58:31.976 INFO:tasks.workunit.client.0.smithi134.stdout:2/43: dread d5/d6/f9 [0,4194304] 0 2024-04-13T10:58:31.979 INFO:tasks.workunit.client.0.smithi134.stdout:2/44: chown d5/d6/f8 758514 1 2024-04-13T10:58:31.984 INFO:tasks.workunit.client.0.smithi134.stdout:2/45: link d5/d6/f9 d5/fc 0 2024-04-13T10:58:31.992 INFO:tasks.workunit.client.0.smithi134.stdout:2/46: dwrite d5/d6/fa [0,4194304] 0 2024-04-13T10:58:32.000 INFO:tasks.workunit.client.0.smithi134.stdout:2/47: dwrite d5/d6/fa [0,4194304] 0 2024-04-13T10:58:32.004 INFO:tasks.workunit.client.0.smithi134.stdout:2/48: link f1 d5/fd 0 2024-04-13T10:58:32.131 INFO:tasks.workunit.client.1.smithi194.stdout:7/15: sync 2024-04-13T10:58:32.131 INFO:tasks.workunit.client.1.smithi194.stdout:5/8: sync 2024-04-13T10:58:32.131 INFO:tasks.workunit.client.1.smithi194.stdout:4/32: sync 2024-04-13T10:58:32.131 INFO:tasks.workunit.client.1.smithi194.stdout:8/22: sync 2024-04-13T10:58:32.131 INFO:tasks.workunit.client.1.smithi194.stdout:2/22: sync 2024-04-13T10:58:32.131 INFO:tasks.workunit.client.1.smithi194.stdout:0/18: sync 2024-04-13T10:58:32.131 INFO:tasks.workunit.client.1.smithi194.stdout:9/11: sync 2024-04-13T10:58:32.131 INFO:tasks.workunit.client.1.smithi194.stdout:3/23: sync 2024-04-13T10:58:32.131 INFO:tasks.workunit.client.1.smithi194.stdout:3/24: read - no filename 2024-04-13T10:58:32.131 INFO:tasks.workunit.client.1.smithi194.stdout:9/12: readlink - no filename 2024-04-13T10:58:32.132 INFO:tasks.workunit.client.1.smithi194.stdout:9/13: write d0/f2 [769736,2412] 0 2024-04-13T10:58:32.132 INFO:tasks.workunit.client.1.smithi194.stdout:9/14: dread - d0/f3 zero size 2024-04-13T10:58:32.133 INFO:tasks.workunit.client.1.smithi194.stdout:8/23: mkdir d6/d9 0 2024-04-13T10:58:32.133 INFO:tasks.workunit.client.1.smithi194.stdout:7/16: symlink d1/l6 0 2024-04-13T10:58:32.135 INFO:tasks.workunit.client.1.smithi194.stdout:0/19: rename l4 to l6 0 2024-04-13T10:58:32.135 INFO:tasks.workunit.client.1.smithi194.stdout:4/33: dread d2/f4 [0,4194304] 0 2024-04-13T10:58:32.136 INFO:tasks.workunit.client.1.smithi194.stdout:8/24: fdatasync f5 0 2024-04-13T10:58:32.137 INFO:tasks.workunit.client.1.smithi194.stdout:9/15: creat d0/f4 x:0 0 0 2024-04-13T10:58:32.137 INFO:tasks.workunit.client.1.smithi194.stdout:9/16: readlink - no filename 2024-04-13T10:58:32.138 INFO:tasks.workunit.client.1.smithi194.stdout:7/17: mknod d1/c7 0 2024-04-13T10:58:32.139 INFO:tasks.workunit.client.1.smithi194.stdout:2/23: symlink d2/d3/lb 0 2024-04-13T10:58:32.142 INFO:tasks.workunit.client.1.smithi194.stdout:4/34: symlink d2/la 0 2024-04-13T10:58:32.143 INFO:tasks.workunit.client.1.smithi194.stdout:4/35: chown d2/l3 19 1 2024-04-13T10:58:32.144 INFO:tasks.workunit.client.1.smithi194.stdout:9/17: dwrite d0/f4 [0,4194304] 0 2024-04-13T10:58:32.146 INFO:tasks.workunit.client.1.smithi194.stdout:2/24: creat d2/d5/fc x:0 0 0 2024-04-13T10:58:32.147 INFO:tasks.workunit.client.1.smithi194.stdout:8/25: mknod d6/d9/ca 0 2024-04-13T10:58:32.148 INFO:tasks.workunit.client.1.smithi194.stdout:8/26: chown f5 0 1 2024-04-13T10:58:32.149 INFO:tasks.workunit.client.1.smithi194.stdout:7/18: rmdir d1 39 2024-04-13T10:58:32.149 INFO:tasks.workunit.client.1.smithi194.stdout:2/25: dread - d2/d5/fc zero size 2024-04-13T10:58:32.149 INFO:tasks.workunit.client.1.smithi194.stdout:4/36: dread d2/f6 [0,4194304] 0 2024-04-13T10:58:32.150 INFO:tasks.workunit.client.1.smithi194.stdout:7/19: stat d1/l4 0 2024-04-13T10:58:32.152 INFO:tasks.workunit.client.1.smithi194.stdout:9/18: link d0/f3 d0/f5 0 2024-04-13T10:58:32.152 INFO:tasks.workunit.client.1.smithi194.stdout:8/27: rmdir d6/d9 39 2024-04-13T10:58:32.153 INFO:tasks.workunit.client.1.smithi194.stdout:9/19: dread - d0/f5 zero size 2024-04-13T10:58:32.153 INFO:tasks.workunit.client.1.smithi194.stdout:2/26: fsync d2/d5/f9 0 2024-04-13T10:58:32.155 INFO:tasks.workunit.client.1.smithi194.stdout:4/37: creat d2/fb x:0 0 0 2024-04-13T10:58:32.156 INFO:tasks.workunit.client.1.smithi194.stdout:9/20: write d0/f4 [2117879,107099] 0 2024-04-13T10:58:32.156 INFO:tasks.workunit.client.1.smithi194.stdout:7/20: creat d1/f8 x:0 0 0 2024-04-13T10:58:32.158 INFO:tasks.workunit.client.1.smithi194.stdout:0/20: dwrite f2 [0,4194304] 0 2024-04-13T10:58:32.158 INFO:tasks.workunit.client.1.smithi194.stdout:8/28: unlink d6/f8 0 2024-04-13T10:58:32.160 INFO:tasks.workunit.client.1.smithi194.stdout:2/27: creat d2/fd x:0 0 0 2024-04-13T10:58:32.160 INFO:tasks.workunit.client.1.smithi194.stdout:4/38: fdatasync d2/f6 0 2024-04-13T10:58:32.162 INFO:tasks.workunit.client.1.smithi194.stdout:4/39: dread - d2/fb zero size 2024-04-13T10:58:32.163 INFO:tasks.workunit.client.1.smithi194.stdout:4/40: chown d2/fb 32121495 1 2024-04-13T10:58:32.164 INFO:tasks.workunit.client.1.smithi194.stdout:9/21: mkdir d0/d6 0 2024-04-13T10:58:32.165 INFO:tasks.workunit.client.1.smithi194.stdout:9/22: stat d0 0 2024-04-13T10:58:32.167 INFO:tasks.workunit.client.1.smithi194.stdout:4/41: rmdir d2 39 2024-04-13T10:58:32.168 INFO:tasks.workunit.client.1.smithi194.stdout:8/29: mknod d6/cb 0 2024-04-13T10:58:32.170 INFO:tasks.workunit.client.1.smithi194.stdout:8/30: fsync d6/f7 0 2024-04-13T10:58:32.172 INFO:tasks.workunit.client.1.smithi194.stdout:8/31: write f5 [1639363,108370] 0 2024-04-13T10:58:32.172 INFO:tasks.workunit.client.1.smithi194.stdout:4/42: rename d2/l3 to d2/lc 0 2024-04-13T10:58:32.173 INFO:tasks.workunit.client.1.smithi194.stdout:2/28: dwrite d2/d5/fc [0,4194304] 0 2024-04-13T10:58:32.175 INFO:tasks.workunit.client.1.smithi194.stdout:8/32: symlink d6/lc 0 2024-04-13T10:58:32.175 INFO:tasks.workunit.client.1.smithi194.stdout:4/43: fsync d2/f4 0 2024-04-13T10:58:32.176 INFO:tasks.workunit.client.1.smithi194.stdout:2/29: mkdir d2/d3/de 0 2024-04-13T10:58:32.176 INFO:tasks.workunit.client.1.smithi194.stdout:0/21: fsync f2 0 2024-04-13T10:58:32.176 INFO:tasks.workunit.client.1.smithi194.stdout:8/33: read f2 [989287,30137] 0 2024-04-13T10:58:32.178 INFO:tasks.workunit.client.1.smithi194.stdout:0/22: creat f7 x:0 0 0 2024-04-13T10:58:32.179 INFO:tasks.workunit.client.1.smithi194.stdout:2/30: creat d2/d3/ff x:0 0 0 2024-04-13T10:58:32.180 INFO:tasks.workunit.client.1.smithi194.stdout:2/31: dread - d2/fd zero size 2024-04-13T10:58:32.183 INFO:tasks.workunit.client.1.smithi194.stdout:2/32: fdatasync d2/d5/f9 0 2024-04-13T10:58:32.183 INFO:tasks.workunit.client.1.smithi194.stdout:7/21: dwrite d1/f5 [4194304,4194304] 0 2024-04-13T10:58:32.184 INFO:tasks.workunit.client.1.smithi194.stdout:7/22: stat d1/f5 0 2024-04-13T10:58:32.184 INFO:tasks.workunit.client.1.smithi194.stdout:2/33: dread - d2/d3/ff zero size 2024-04-13T10:58:32.185 INFO:tasks.workunit.client.1.smithi194.stdout:8/34: truncate f2 661205 0 2024-04-13T10:58:32.186 INFO:tasks.workunit.client.1.smithi194.stdout:7/23: mknod d1/c9 0 2024-04-13T10:58:32.187 INFO:tasks.workunit.client.1.smithi194.stdout:7/24: dread - d1/f8 zero size 2024-04-13T10:58:32.187 INFO:tasks.workunit.client.1.smithi194.stdout:0/23: dread f1 [0,4194304] 0 2024-04-13T10:58:32.188 INFO:tasks.workunit.client.1.smithi194.stdout:2/34: mknod d2/d5/c10 0 2024-04-13T10:58:32.189 INFO:tasks.workunit.client.1.smithi194.stdout:2/35: read d2/d5/fc [2452946,98506] 0 2024-04-13T10:58:32.190 INFO:tasks.workunit.client.1.smithi194.stdout:7/25: creat d1/fa x:0 0 0 2024-04-13T10:58:32.191 INFO:tasks.workunit.client.1.smithi194.stdout:0/24: rename f2 to f8 0 2024-04-13T10:58:32.191 INFO:tasks.workunit.client.1.smithi194.stdout:7/26: chown d1/f8 799 1 2024-04-13T10:58:32.193 INFO:tasks.workunit.client.1.smithi194.stdout:2/36: rename l0 to d2/d3/de/l11 0 2024-04-13T10:58:32.194 INFO:tasks.workunit.client.1.smithi194.stdout:7/27: mknod d1/cb 0 2024-04-13T10:58:32.195 INFO:tasks.workunit.client.1.smithi194.stdout:2/37: write d2/d3/ff [387968,103372] 0 2024-04-13T10:58:32.195 INFO:tasks.workunit.client.1.smithi194.stdout:0/25: dread f1 [0,4194304] 0 2024-04-13T10:58:32.196 INFO:tasks.workunit.client.1.smithi194.stdout:0/26: dread - f3 zero size 2024-04-13T10:58:32.196 INFO:tasks.workunit.client.1.smithi194.stdout:2/38: readlink d2/d3/lb 0 2024-04-13T10:58:32.197 INFO:tasks.workunit.client.1.smithi194.stdout:2/39: dread - d2/fd zero size 2024-04-13T10:58:32.199 INFO:tasks.workunit.client.1.smithi194.stdout:2/40: write d2/fd [109946,86708] 0 2024-04-13T10:58:32.201 INFO:tasks.workunit.client.1.smithi194.stdout:7/28: dread d1/f5 [4194304,4194304] 0 2024-04-13T10:58:32.202 INFO:tasks.workunit.client.1.smithi194.stdout:2/41: mkdir d2/d3/d12 0 2024-04-13T10:58:32.203 INFO:tasks.workunit.client.1.smithi194.stdout:7/29: chown d1/fa 34 1 2024-04-13T10:58:32.204 INFO:tasks.workunit.client.1.smithi194.stdout:8/35: truncate f5 1202803 0 2024-04-13T10:58:32.205 INFO:tasks.workunit.client.1.smithi194.stdout:2/42: write d2/d3/ff [443193,98004] 0 2024-04-13T10:58:32.206 INFO:tasks.workunit.client.1.smithi194.stdout:0/27: dwrite f5 [0,4194304] 0 2024-04-13T10:58:32.209 INFO:tasks.workunit.client.1.smithi194.stdout:2/43: symlink d2/d5/l13 0 2024-04-13T10:58:32.212 INFO:tasks.workunit.client.1.smithi194.stdout:8/36: rename d6/d9 to d6/dd 0 2024-04-13T10:58:32.215 INFO:tasks.workunit.client.1.smithi194.stdout:2/44: truncate d2/fd 741895 0 2024-04-13T10:58:32.215 INFO:tasks.workunit.client.1.smithi194.stdout:8/37: mkdir d6/dd/de 0 2024-04-13T10:58:32.216 INFO:tasks.workunit.client.1.smithi194.stdout:7/30: dwrite d1/f3 [0,4194304] 0 2024-04-13T10:58:32.218 INFO:tasks.workunit.client.1.smithi194.stdout:8/38: dread - d6/f7 zero size 2024-04-13T10:58:32.218 INFO:tasks.workunit.client.1.smithi194.stdout:7/31: dread - d1/f8 zero size 2024-04-13T10:58:32.218 INFO:tasks.workunit.client.1.smithi194.stdout:0/28: dwrite f5 [4194304,4194304] 0 2024-04-13T10:58:32.219 INFO:tasks.workunit.client.1.smithi194.stdout:2/45: rename d2/d3/de to d2/d3/de/d14 22 2024-04-13T10:58:32.219 INFO:tasks.workunit.client.1.smithi194.stdout:8/39: fsync d6/f7 0 2024-04-13T10:58:32.219 INFO:tasks.workunit.client.1.smithi194.stdout:0/29: read - f3 zero size 2024-04-13T10:58:32.219 INFO:tasks.workunit.client.1.smithi194.stdout:8/40: chown d6 5728 1 2024-04-13T10:58:32.221 INFO:tasks.workunit.client.1.smithi194.stdout:7/32: symlink d1/lc 0 2024-04-13T10:58:32.231 INFO:tasks.workunit.client.1.smithi194.stdout:2/46: dwrite d2/d3/ff [0,4194304] 0 2024-04-13T10:58:32.233 INFO:tasks.workunit.client.1.smithi194.stdout:7/33: dwrite d1/f3 [0,4194304] 0 2024-04-13T10:58:32.237 INFO:tasks.workunit.client.1.smithi194.stdout:2/47: symlink d2/d3/l15 0 2024-04-13T10:58:32.243 INFO:tasks.workunit.client.1.smithi194.stdout:7/34: dwrite d1/f8 [0,4194304] 0 2024-04-13T10:58:32.247 INFO:tasks.workunit.client.1.smithi194.stdout:8/41: rmdir d6 39 2024-04-13T10:58:32.248 INFO:tasks.workunit.client.1.smithi194.stdout:7/35: rmdir d1 39 2024-04-13T10:58:32.248 INFO:tasks.workunit.client.1.smithi194.stdout:2/48: dwrite d2/d5/fc [0,4194304] 0 2024-04-13T10:58:32.253 INFO:tasks.workunit.client.1.smithi194.stdout:2/49: creat d2/d3/de/f16 x:0 0 0 2024-04-13T10:58:32.253 INFO:tasks.workunit.client.1.smithi194.stdout:8/42: rename d6/dd to d6/dd/de/df 22 2024-04-13T10:58:32.253 INFO:tasks.workunit.client.1.smithi194.stdout:2/50: write d2/d5/f9 [246030,53789] 0 2024-04-13T10:58:32.254 INFO:tasks.workunit.client.1.smithi194.stdout:0/30: truncate f5 4657755 0 2024-04-13T10:58:32.257 INFO:tasks.workunit.client.1.smithi194.stdout:8/43: dread f2 [0,4194304] 0 2024-04-13T10:58:32.258 INFO:tasks.workunit.client.1.smithi194.stdout:7/36: link d1/f5 d1/fd 0 2024-04-13T10:58:32.259 INFO:tasks.workunit.client.1.smithi194.stdout:8/44: chown d6/dd/ca 273648 1 2024-04-13T10:58:32.260 INFO:tasks.workunit.client.1.smithi194.stdout:8/45: stat f2 0 2024-04-13T10:58:32.261 INFO:tasks.workunit.client.1.smithi194.stdout:2/51: dwrite d2/d5/fc [4194304,4194304] 0 2024-04-13T10:58:32.261 INFO:tasks.workunit.client.1.smithi194.stdout:0/31: mkdir d9 0 2024-04-13T10:58:32.263 INFO:tasks.workunit.client.1.smithi194.stdout:0/32: write f3 [848103,89283] 0 2024-04-13T10:58:32.263 INFO:tasks.workunit.client.1.smithi194.stdout:8/46: fsync f2 0 2024-04-13T10:58:32.267 INFO:tasks.workunit.client.1.smithi194.stdout:8/47: mknod d6/c10 0 2024-04-13T10:58:32.268 INFO:tasks.workunit.client.1.smithi194.stdout:8/48: read f2 [14319,116042] 0 2024-04-13T10:58:32.271 INFO:tasks.workunit.client.1.smithi194.stdout:0/33: read f5 [4314652,26927] 0 2024-04-13T10:58:32.272 INFO:tasks.workunit.client.1.smithi194.stdout:0/34: read f1 [4051535,130639] 0 2024-04-13T10:58:32.273 INFO:tasks.workunit.client.1.smithi194.stdout:8/49: rmdir d6/dd/de 0 2024-04-13T10:58:32.274 INFO:tasks.workunit.client.1.smithi194.stdout:7/37: getdents d1 0 2024-04-13T10:58:32.275 INFO:tasks.workunit.client.1.smithi194.stdout:0/35: creat d9/fa x:0 0 0 2024-04-13T10:58:32.277 INFO:tasks.workunit.client.1.smithi194.stdout:2/52: truncate d2/d3/ff 1420950 0 2024-04-13T10:58:32.279 INFO:tasks.workunit.client.1.smithi194.stdout:0/36: write f1 [4758961,79419] 0 2024-04-13T10:58:32.281 INFO:tasks.workunit.client.1.smithi194.stdout:0/37: readlink l6 0 2024-04-13T10:58:32.347 INFO:tasks.workunit.client.1.smithi194.stdout:1/40: sync 2024-04-13T10:58:32.347 INFO:tasks.workunit.client.1.smithi194.stdout:6/36: sync 2024-04-13T10:58:32.386 INFO:tasks.workunit.client.1.smithi194.stdout:2/53: truncate d2/d3/de/f16 531115 0 2024-04-13T10:58:32.387 INFO:tasks.workunit.client.1.smithi194.stdout:8/50: dwrite d6/f7 [0,4194304] 0 2024-04-13T10:58:32.388 INFO:tasks.workunit.client.1.smithi194.stdout:7/38: dwrite d1/fa [0,4194304] 0 2024-04-13T10:58:32.388 INFO:tasks.workunit.client.1.smithi194.stdout:0/38: mkdir d9/db 0 2024-04-13T10:58:32.393 INFO:tasks.workunit.client.1.smithi194.stdout:7/39: creat d1/fe x:0 0 0 2024-04-13T10:58:32.395 INFO:tasks.workunit.client.1.smithi194.stdout:7/40: dread - d1/fe zero size 2024-04-13T10:58:32.397 INFO:tasks.workunit.client.1.smithi194.stdout:0/39: symlink d9/db/lc 0 2024-04-13T10:58:32.398 INFO:tasks.workunit.client.1.smithi194.stdout:7/41: stat d1/l4 0 2024-04-13T10:58:32.398 INFO:tasks.workunit.client.1.smithi194.stdout:2/54: dwrite d2/fd [0,4194304] 0 2024-04-13T10:58:32.402 INFO:tasks.workunit.client.1.smithi194.stdout:8/51: creat d6/f11 x:0 0 0 2024-04-13T10:58:32.403 INFO:tasks.workunit.client.1.smithi194.stdout:1/41: dwrite fb [0,4194304] 0 2024-04-13T10:58:32.406 INFO:tasks.workunit.client.1.smithi194.stdout:6/37: getdents d0 0 2024-04-13T10:58:32.406 INFO:tasks.workunit.client.1.smithi194.stdout:7/42: symlink d1/lf 0 2024-04-13T10:58:32.406 INFO:tasks.workunit.client.1.smithi194.stdout:1/42: chown l3 56803 1 2024-04-13T10:58:32.406 INFO:tasks.workunit.client.1.smithi194.stdout:2/55: mkdir d2/d3/de/d17 0 2024-04-13T10:58:32.410 INFO:tasks.workunit.client.1.smithi194.stdout:1/43: symlink lc 0 2024-04-13T10:58:32.412 INFO:tasks.workunit.client.1.smithi194.stdout:1/44: write fb [3365534,124241] 0 2024-04-13T10:58:32.414 INFO:tasks.workunit.client.1.smithi194.stdout:0/40: dwrite d9/fa [0,4194304] 0 2024-04-13T10:58:32.415 INFO:tasks.workunit.client.1.smithi194.stdout:0/41: readlink l6 0 2024-04-13T10:58:32.417 INFO:tasks.workunit.client.1.smithi194.stdout:6/38: dread d0/f5 [4194304,4194304] 0 2024-04-13T10:58:32.417 INFO:tasks.workunit.client.1.smithi194.stdout:7/43: symlink d1/l10 0 2024-04-13T10:58:32.421 INFO:tasks.workunit.client.1.smithi194.stdout:2/56: symlink d2/d5/l18 0 2024-04-13T10:58:32.422 INFO:tasks.workunit.client.1.smithi194.stdout:1/45: dwrite f6 [0,4194304] 0 2024-04-13T10:58:32.432 INFO:tasks.workunit.client.1.smithi194.stdout:0/42: rename f8 to d9/fd 0 2024-04-13T10:58:32.432 INFO:tasks.workunit.client.1.smithi194.stdout:0/43: chown d9 8009245 1 2024-04-13T10:58:32.433 INFO:tasks.workunit.client.1.smithi194.stdout:0/44: truncate f5 5652522 0 2024-04-13T10:58:32.433 INFO:tasks.workunit.client.1.smithi194.stdout:0/45: read f5 [2387877,4952] 0 2024-04-13T10:58:32.434 INFO:tasks.workunit.client.1.smithi194.stdout:0/46: readlink l6 0 2024-04-13T10:58:32.434 INFO:tasks.workunit.client.1.smithi194.stdout:6/39: fsync d0/f5 0 2024-04-13T10:58:32.434 INFO:tasks.workunit.client.1.smithi194.stdout:0/47: chown d9/fd 15794981 1 2024-04-13T10:58:32.435 INFO:tasks.workunit.client.1.smithi194.stdout:6/40: read d0/f5 [8293020,124042] 0 2024-04-13T10:58:32.436 INFO:tasks.workunit.client.1.smithi194.stdout:7/44: creat d1/f11 x:0 0 0 2024-04-13T10:58:32.455 INFO:tasks.workunit.client.1.smithi194.stdout:0/48: mknod d9/ce 0 2024-04-13T10:58:32.455 INFO:tasks.workunit.client.1.smithi194.stdout:6/41: creat d0/f7 x:0 0 0 2024-04-13T10:58:32.456 INFO:tasks.workunit.client.1.smithi194.stdout:2/57: mkdir d2/d3/d12/d19 0 2024-04-13T10:58:32.456 INFO:tasks.workunit.client.1.smithi194.stdout:7/45: creat d1/f12 x:0 0 0 2024-04-13T10:58:32.461 INFO:tasks.workunit.client.1.smithi194.stdout:6/42: dread d0/f5 [0,4194304] 0 2024-04-13T10:58:32.462 INFO:tasks.workunit.client.1.smithi194.stdout:2/58: dwrite d2/d5/f9 [0,4194304] 0 2024-04-13T10:58:32.463 INFO:tasks.workunit.client.1.smithi194.stdout:2/59: read d2/d5/fc [6993356,36680] 0 2024-04-13T10:58:32.470 INFO:tasks.workunit.client.1.smithi194.stdout:2/60: dwrite d2/d5/fc [8388608,4194304] 0 2024-04-13T10:58:32.475 INFO:tasks.workunit.client.1.smithi194.stdout:8/52: getdents d6 0 2024-04-13T10:58:32.498 INFO:tasks.workunit.client.1.smithi194.stdout:5/9: sync 2024-04-13T10:58:32.498 INFO:tasks.workunit.client.1.smithi194.stdout:7/46: fsync d1/f11 0 2024-04-13T10:58:32.505 INFO:tasks.workunit.client.1.smithi194.stdout:6/43: fsync d0/f7 0 2024-04-13T10:58:32.506 INFO:tasks.workunit.client.1.smithi194.stdout:6/44: truncate d0/f7 323864 0 2024-04-13T10:58:32.509 INFO:tasks.workunit.client.1.smithi194.stdout:6/45: dread d0/f5 [0,4194304] 0 2024-04-13T10:58:32.509 INFO:tasks.workunit.client.1.smithi194.stdout:1/46: truncate f1 2871059 0 2024-04-13T10:58:32.574 INFO:tasks.workunit.client.1.smithi194.stdout:4/44: sync 2024-04-13T10:58:32.574 INFO:tasks.workunit.client.1.smithi194.stdout:3/25: sync 2024-04-13T10:58:32.575 INFO:tasks.workunit.client.1.smithi194.stdout:9/23: sync 2024-04-13T10:58:32.575 INFO:tasks.workunit.client.1.smithi194.stdout:9/24: readlink - no filename 2024-04-13T10:58:32.575 INFO:tasks.workunit.client.1.smithi194.stdout:3/26: chown d2 63 1 2024-04-13T10:58:32.575 INFO:tasks.workunit.client.1.smithi194.stdout:4/45: truncate d2/fb 457580 0 2024-04-13T10:58:32.596 INFO:tasks.workunit.client.1.smithi194.stdout:0/49: mkdir d9/df 0 2024-04-13T10:58:32.599 INFO:tasks.workunit.client.1.smithi194.stdout:2/61: creat d2/d3/de/f1a x:0 0 0 2024-04-13T10:58:32.599 INFO:tasks.workunit.client.1.smithi194.stdout:8/53: mknod d6/c12 0 2024-04-13T10:58:32.600 INFO:tasks.workunit.client.1.smithi194.stdout:7/47: mkdir d1/d13 0 2024-04-13T10:58:32.601 INFO:tasks.workunit.client.1.smithi194.stdout:6/46: rename d0/f5 to d0/f8 0 2024-04-13T10:58:32.602 INFO:tasks.workunit.client.1.smithi194.stdout:6/47: truncate d0/f7 385490 0 2024-04-13T10:58:32.602 INFO:tasks.workunit.client.1.smithi194.stdout:3/27: symlink d2/l4 0 2024-04-13T10:58:32.604 INFO:tasks.workunit.client.1.smithi194.stdout:9/25: rename d0/f5 to d0/d6/f7 0 2024-04-13T10:58:32.605 INFO:tasks.workunit.client.1.smithi194.stdout:7/48: dread d1/fa [0,4194304] 0 2024-04-13T10:58:32.606 INFO:tasks.workunit.client.1.smithi194.stdout:4/46: creat d2/fd x:0 0 0 2024-04-13T10:58:32.606 INFO:tasks.workunit.client.1.smithi194.stdout:7/49: dread - d1/f11 zero size 2024-04-13T10:58:32.606 INFO:tasks.workunit.client.1.smithi194.stdout:7/50: chown d1 1638 1 2024-04-13T10:58:32.606 INFO:tasks.workunit.client.1.smithi194.stdout:4/47: stat d2/f6 0 2024-04-13T10:58:32.606 INFO:tasks.workunit.client.1.smithi194.stdout:0/50: mknod d9/c10 0 2024-04-13T10:58:32.611 INFO:tasks.workunit.client.1.smithi194.stdout:3/28: creat d2/f5 x:0 0 0 2024-04-13T10:58:32.612 INFO:tasks.workunit.client.1.smithi194.stdout:3/29: dread - d2/f5 zero size 2024-04-13T10:58:32.612 INFO:tasks.workunit.client.1.smithi194.stdout:6/48: mknod d0/c9 0 2024-04-13T10:58:32.612 INFO:tasks.workunit.client.1.smithi194.stdout:3/30: dread - d2/f5 zero size 2024-04-13T10:58:32.612 INFO:tasks.workunit.client.1.smithi194.stdout:6/49: readlink d0/l6 0 2024-04-13T10:58:32.612 INFO:tasks.workunit.client.1.smithi194.stdout:9/26: rmdir d0/d6 39 2024-04-13T10:58:32.613 INFO:tasks.workunit.client.1.smithi194.stdout:7/51: creat d1/f14 x:0 0 0 2024-04-13T10:58:32.614 INFO:tasks.workunit.client.1.smithi194.stdout:4/48: symlink d2/le 0 2024-04-13T10:58:32.619 INFO:tasks.workunit.client.1.smithi194.stdout:6/50: creat d0/fa x:0 0 0 2024-04-13T10:58:32.621 INFO:tasks.workunit.client.1.smithi194.stdout:0/51: mkdir d9/df/d11 0 2024-04-13T10:58:32.622 INFO:tasks.workunit.client.1.smithi194.stdout:3/31: dwrite d2/f5 [0,4194304] 0 2024-04-13T10:58:32.625 INFO:tasks.workunit.client.1.smithi194.stdout:3/32: write d2/f5 [495940,71805] 0 2024-04-13T10:58:32.626 INFO:tasks.workunit.client.1.smithi194.stdout:4/49: dwrite d2/f6 [0,4194304] 0 2024-04-13T10:58:32.626 INFO:tasks.workunit.client.1.smithi194.stdout:9/27: creat d0/d6/f8 x:0 0 0 2024-04-13T10:58:32.627 INFO:tasks.workunit.client.1.smithi194.stdout:5/10: sync 2024-04-13T10:58:32.627 INFO:tasks.workunit.client.1.smithi194.stdout:5/11: write - no filename 2024-04-13T10:58:32.627 INFO:tasks.workunit.client.1.smithi194.stdout:5/12: dwrite - no filename 2024-04-13T10:58:32.627 INFO:tasks.workunit.client.1.smithi194.stdout:5/13: fsync - no filename 2024-04-13T10:58:32.628 INFO:tasks.workunit.client.1.smithi194.stdout:4/50: write d2/f4 [3444580,12680] 0 2024-04-13T10:58:32.628 INFO:tasks.workunit.client.1.smithi194.stdout:9/28: chown d0/f2 201448160 1 2024-04-13T10:58:32.630 INFO:tasks.workunit.client.1.smithi194.stdout:0/52: unlink d9/ce 0 2024-04-13T10:58:32.631 INFO:tasks.workunit.client.1.smithi194.stdout:2/62: getdents d2 0 2024-04-13T10:58:32.638 INFO:tasks.workunit.client.1.smithi194.stdout:4/51: creat d2/ff x:0 0 0 2024-04-13T10:58:32.639 INFO:tasks.workunit.client.1.smithi194.stdout:0/53: creat d9/df/f12 x:0 0 0 2024-04-13T10:58:32.642 INFO:tasks.workunit.client.1.smithi194.stdout:3/33: creat d2/d3/f6 x:0 0 0 2024-04-13T10:58:32.643 INFO:tasks.workunit.client.1.smithi194.stdout:3/34: chown d2 42108 1 2024-04-13T10:58:32.643 INFO:tasks.workunit.client.1.smithi194.stdout:5/14: symlink l0 0 2024-04-13T10:58:32.647 INFO:tasks.workunit.client.1.smithi194.stdout:4/52: rename d2/le to d2/l10 0 2024-04-13T10:58:32.649 INFO:tasks.workunit.client.1.smithi194.stdout:0/54: unlink l6 0 2024-04-13T10:58:32.651 INFO:tasks.workunit.client.1.smithi194.stdout:2/63: link d2/d3/de/f1a d2/d3/d12/f1b 0 2024-04-13T10:58:32.652 INFO:tasks.workunit.client.1.smithi194.stdout:2/64: dread - d2/d3/de/f1a zero size 2024-04-13T10:58:32.653 INFO:tasks.workunit.client.1.smithi194.stdout:5/15: rename l0 to l1 0 2024-04-13T10:58:32.653 INFO:tasks.workunit.client.1.smithi194.stdout:5/16: write - no filename 2024-04-13T10:58:32.653 INFO:tasks.workunit.client.1.smithi194.stdout:5/17: dwrite - no filename 2024-04-13T10:58:32.653 INFO:tasks.workunit.client.1.smithi194.stdout:5/18: dwrite - no filename 2024-04-13T10:58:32.653 INFO:tasks.workunit.client.1.smithi194.stdout:5/19: dwrite - no filename 2024-04-13T10:58:32.655 INFO:tasks.workunit.client.1.smithi194.stdout:4/53: mkdir d2/d11 0 2024-04-13T10:58:32.655 INFO:tasks.workunit.client.1.smithi194.stdout:0/55: dwrite d9/fa [0,4194304] 0 2024-04-13T10:58:32.656 INFO:tasks.workunit.client.1.smithi194.stdout:0/56: stat d9/df/f12 0 2024-04-13T10:58:32.659 INFO:tasks.workunit.client.1.smithi194.stdout:5/20: symlink l2 0 2024-04-13T10:58:32.659 INFO:tasks.workunit.client.1.smithi194.stdout:5/21: dwrite - no filename 2024-04-13T10:58:32.659 INFO:tasks.workunit.client.1.smithi194.stdout:5/22: truncate - no filename 2024-04-13T10:58:32.659 INFO:tasks.workunit.client.1.smithi194.stdout:5/23: rmdir - no directory 2024-04-13T10:58:32.660 INFO:tasks.workunit.client.1.smithi194.stdout:2/65: creat d2/d3/d12/f1c x:0 0 0 2024-04-13T10:58:32.664 INFO:tasks.workunit.client.1.smithi194.stdout:5/24: mkdir d3 0 2024-04-13T10:58:32.665 INFO:tasks.workunit.client.1.smithi194.stdout:4/54: symlink d2/d11/l12 0 2024-04-13T10:58:32.671 INFO:tasks.workunit.client.1.smithi194.stdout:4/55: dwrite d2/ff [0,4194304] 0 2024-04-13T10:58:32.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:32 smithi134 ceph-mon[39696]: pgmap v20: 65 pgs: 65 active+clean; 212 MiB data, 840 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 346 op/s 2024-04-13T10:58:32.731 INFO:tasks.workunit.client.1.smithi194.stdout:2/66: creat d2/d5/f1d x:0 0 0 2024-04-13T10:58:32.732 INFO:tasks.workunit.client.1.smithi194.stdout:2/67: chown d2/d5/c10 9588224 1 2024-04-13T10:58:32.732 INFO:tasks.workunit.client.1.smithi194.stdout:0/57: creat d9/df/d11/f13 x:0 0 0 2024-04-13T10:58:32.735 INFO:tasks.workunit.client.1.smithi194.stdout:4/56: creat d2/f13 x:0 0 0 2024-04-13T10:58:32.736 INFO:tasks.workunit.client.1.smithi194.stdout:0/58: creat d9/df/f14 x:0 0 0 2024-04-13T10:58:32.736 INFO:tasks.workunit.client.1.smithi194.stdout:0/59: truncate d9/df/f12 649307 0 2024-04-13T10:58:32.738 INFO:tasks.workunit.client.1.smithi194.stdout:4/57: rename d2/c5 to d2/d11/c14 0 2024-04-13T10:58:32.738 INFO:tasks.workunit.client.1.smithi194.stdout:4/58: dread - d2/f13 zero size 2024-04-13T10:58:32.740 INFO:tasks.workunit.client.1.smithi194.stdout:0/60: creat d9/db/f15 x:0 0 0 2024-04-13T10:58:32.741 INFO:tasks.workunit.client.1.smithi194.stdout:0/61: write d9/df/d11/f13 [416161,33299] 0 2024-04-13T10:58:32.741 INFO:tasks.workunit.client.1.smithi194.stdout:4/59: symlink d2/l15 0 2024-04-13T10:58:32.742 INFO:tasks.workunit.client.1.smithi194.stdout:4/60: write d2/f6 [2277434,30676] 0 2024-04-13T10:58:32.743 INFO:tasks.workunit.client.1.smithi194.stdout:0/62: mkdir d9/df/d16 0 2024-04-13T10:58:32.744 INFO:tasks.workunit.client.1.smithi194.stdout:0/63: truncate d9/db/f15 592615 0 2024-04-13T10:58:32.746 INFO:tasks.workunit.client.1.smithi194.stdout:1/47: fsync f0 0 2024-04-13T10:58:32.746 INFO:tasks.workunit.client.1.smithi194.stdout:1/48: readlink l3 0 2024-04-13T10:58:32.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:32 smithi194 ceph-mon[46737]: pgmap v20: 65 pgs: 65 active+clean; 212 MiB data, 840 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 346 op/s 2024-04-13T10:58:32.748 INFO:tasks.workunit.client.1.smithi194.stdout:1/49: mknod cd 0 2024-04-13T10:58:32.769 INFO:tasks.workunit.client.1.smithi194.stdout:6/51: sync 2024-04-13T10:58:32.770 INFO:tasks.workunit.client.1.smithi194.stdout:6/52: write d0/fa [864784,90607] 0 2024-04-13T10:58:32.770 INFO:tasks.workunit.client.1.smithi194.stdout:6/53: truncate d0/fa 1238351 0 2024-04-13T10:58:32.793 INFO:tasks.workunit.client.1.smithi194.stdout:8/54: getdents d6 0 2024-04-13T10:58:32.795 INFO:tasks.workunit.client.1.smithi194.stdout:9/29: fsync d0/f3 0 2024-04-13T10:58:32.795 INFO:tasks.workunit.client.1.smithi194.stdout:4/61: fsync d2/fd 0 2024-04-13T10:58:32.799 INFO:tasks.workunit.client.1.smithi194.stdout:9/30: unlink d0/d6/f7 0 2024-04-13T10:58:32.800 INFO:tasks.workunit.client.1.smithi194.stdout:4/62: mkdir d2/d16 0 2024-04-13T10:58:32.801 INFO:tasks.workunit.client.1.smithi194.stdout:8/55: dwrite d6/f7 [4194304,4194304] 0 2024-04-13T10:58:32.801 INFO:tasks.workunit.client.1.smithi194.stdout:4/63: fdatasync d2/f6 0 2024-04-13T10:58:32.801 INFO:tasks.workunit.client.1.smithi194.stdout:4/64: chown d2 7 1 2024-04-13T10:58:32.802 INFO:tasks.workunit.client.1.smithi194.stdout:9/31: mkdir d0/d6/d9 0 2024-04-13T10:58:32.805 INFO:tasks.workunit.client.1.smithi194.stdout:9/32: symlink d0/d6/la 0 2024-04-13T10:58:32.807 INFO:tasks.workunit.client.1.smithi194.stdout:7/52: truncate d1/f3 759687 0 2024-04-13T10:58:32.808 INFO:tasks.workunit.client.1.smithi194.stdout:8/56: dread f5 [0,4194304] 0 2024-04-13T10:58:32.809 INFO:tasks.workunit.client.1.smithi194.stdout:7/53: mknod d1/c15 0 2024-04-13T10:58:32.811 INFO:tasks.workunit.client.1.smithi194.stdout:8/57: mknod d6/c13 0 2024-04-13T10:58:32.814 INFO:tasks.workunit.client.1.smithi194.stdout:9/33: rename d0/d6/la to d0/lb 0 2024-04-13T10:58:32.815 INFO:tasks.workunit.client.1.smithi194.stdout:8/58: chown d6/lc 48 1 2024-04-13T10:58:32.818 INFO:tasks.workunit.client.1.smithi194.stdout:9/34: unlink d0/f2 0 2024-04-13T10:58:32.823 INFO:tasks.workunit.client.1.smithi194.stdout:8/59: mknod d6/c14 0 2024-04-13T10:58:32.825 INFO:tasks.workunit.client.1.smithi194.stdout:9/35: creat d0/d6/d9/fc x:0 0 0 2024-04-13T10:58:32.826 INFO:tasks.workunit.client.1.smithi194.stdout:8/60: mknod d6/c15 0 2024-04-13T10:58:32.827 INFO:tasks.workunit.client.1.smithi194.stdout:8/61: read f2 [361038,40394] 0 2024-04-13T10:58:32.832 INFO:tasks.workunit.client.1.smithi194.stdout:1/50: getdents . 0 2024-04-13T10:58:32.834 INFO:tasks.workunit.client.1.smithi194.stdout:1/51: rename c8 to ce 0 2024-04-13T10:58:32.838 INFO:tasks.workunit.client.1.smithi194.stdout:7/54: getdents d1 0 2024-04-13T10:58:32.841 INFO:tasks.workunit.client.1.smithi194.stdout:7/55: rename d1/f11 to d1/f16 0 2024-04-13T10:58:32.841 INFO:tasks.workunit.client.1.smithi194.stdout:1/52: dwrite f2 [0,4194304] 0 2024-04-13T10:58:32.841 INFO:tasks.workunit.client.1.smithi194.stdout:1/53: stat fb 0 2024-04-13T10:58:32.844 INFO:tasks.workunit.client.1.smithi194.stdout:1/54: creat ff x:0 0 0 2024-04-13T10:58:32.849 INFO:tasks.workunit.client.1.smithi194.stdout:7/56: write d1/fd [1604409,76441] 0 2024-04-13T10:58:32.852 INFO:tasks.workunit.client.1.smithi194.stdout:8/62: dwrite f5 [0,4194304] 0 2024-04-13T10:58:32.852 INFO:tasks.workunit.client.1.smithi194.stdout:7/57: chown d1/f8 142209 1 2024-04-13T10:58:32.853 INFO:tasks.workunit.client.1.smithi194.stdout:1/55: dwrite fb [0,4194304] 0 2024-04-13T10:58:32.855 INFO:tasks.workunit.client.1.smithi194.stdout:7/58: symlink d1/d13/l17 0 2024-04-13T10:58:32.856 INFO:tasks.workunit.client.1.smithi194.stdout:1/56: creat f10 x:0 0 0 2024-04-13T10:58:32.857 INFO:tasks.workunit.client.1.smithi194.stdout:1/57: fsync f1 0 2024-04-13T10:58:32.857 INFO:tasks.workunit.client.1.smithi194.stdout:7/59: write d1/f8 [2676198,63325] 0 2024-04-13T10:58:32.859 INFO:tasks.workunit.client.1.smithi194.stdout:1/58: write f2 [4561092,7083] 0 2024-04-13T10:58:32.859 INFO:tasks.workunit.client.1.smithi194.stdout:8/63: dread d6/f7 [4194304,4194304] 0 2024-04-13T10:58:32.860 INFO:tasks.workunit.client.1.smithi194.stdout:7/60: write d1/f5 [1772259,98562] 0 2024-04-13T10:58:32.863 INFO:tasks.workunit.client.1.smithi194.stdout:8/64: write d6/f11 [925162,10096] 0 2024-04-13T10:58:32.865 INFO:tasks.workunit.client.1.smithi194.stdout:7/61: rename d1/l4 to d1/d13/l18 0 2024-04-13T10:58:32.869 INFO:tasks.workunit.client.1.smithi194.stdout:7/62: rename d1/c15 to d1/c19 0 2024-04-13T10:58:32.870 INFO:tasks.workunit.client.1.smithi194.stdout:8/65: creat d6/dd/f16 x:0 0 0 2024-04-13T10:58:32.878 INFO:tasks.workunit.client.1.smithi194.stdout:7/63: dwrite d1/f12 [0,4194304] 0 2024-04-13T10:58:32.879 INFO:tasks.workunit.client.1.smithi194.stdout:7/64: fdatasync d1/fe 0 2024-04-13T10:58:32.880 INFO:tasks.workunit.client.1.smithi194.stdout:3/35: sync 2024-04-13T10:58:32.880 INFO:tasks.workunit.client.1.smithi194.stdout:8/66: dwrite f5 [4194304,4194304] 0 2024-04-13T10:58:32.880 INFO:tasks.workunit.client.1.smithi194.stdout:7/65: chown d1/cb 121006643 1 2024-04-13T10:58:32.881 INFO:tasks.workunit.client.1.smithi194.stdout:3/36: read d2/f5 [3581859,16674] 0 2024-04-13T10:58:32.884 INFO:tasks.workunit.client.1.smithi194.stdout:3/37: chown d2/d3/f6 5228690 1 2024-04-13T10:58:32.887 INFO:tasks.workunit.client.1.smithi194.stdout:3/38: symlink d2/l7 0 2024-04-13T10:58:32.888 INFO:tasks.workunit.client.1.smithi194.stdout:7/66: truncate d1/f3 1360619 0 2024-04-13T10:58:32.889 INFO:tasks.workunit.client.1.smithi194.stdout:3/39: creat d2/d3/f8 x:0 0 0 2024-04-13T10:58:32.890 INFO:tasks.workunit.client.1.smithi194.stdout:8/67: rename d6/cb to d6/c17 0 2024-04-13T10:58:32.890 INFO:tasks.workunit.client.1.smithi194.stdout:7/67: mknod d1/d13/c1a 0 2024-04-13T10:58:32.891 INFO:tasks.workunit.client.1.smithi194.stdout:3/40: creat d2/f9 x:0 0 0 2024-04-13T10:58:32.891 INFO:tasks.workunit.client.1.smithi194.stdout:3/41: chown d2/l7 0 1 2024-04-13T10:58:32.892 INFO:tasks.workunit.client.1.smithi194.stdout:7/68: symlink d1/d13/l1b 0 2024-04-13T10:58:32.896 INFO:tasks.workunit.client.1.smithi194.stdout:7/69: rename d1/fd to d1/d13/f1c 0 2024-04-13T10:58:32.896 INFO:tasks.workunit.client.1.smithi194.stdout:8/68: fdatasync f5 0 2024-04-13T10:58:32.900 INFO:tasks.workunit.client.1.smithi194.stdout:7/70: creat d1/f1d x:0 0 0 2024-04-13T10:58:32.900 INFO:tasks.workunit.client.1.smithi194.stdout:7/71: dread - d1/fe zero size 2024-04-13T10:58:32.901 INFO:tasks.workunit.client.1.smithi194.stdout:3/42: getdents d2/d3 0 2024-04-13T10:58:32.902 INFO:tasks.workunit.client.1.smithi194.stdout:3/43: write d2/f9 [6498,37210] 0 2024-04-13T10:58:32.903 INFO:tasks.workunit.client.1.smithi194.stdout:7/72: mknod d1/c1e 0 2024-04-13T10:58:32.903 INFO:tasks.workunit.client.1.smithi194.stdout:7/73: read d1/fa [2979919,13826] 0 2024-04-13T10:58:32.905 INFO:tasks.workunit.client.1.smithi194.stdout:7/74: read d1/f12 [2884238,103148] 0 2024-04-13T10:58:32.905 INFO:tasks.workunit.client.1.smithi194.stdout:7/75: dread - d1/f1d zero size 2024-04-13T10:58:32.905 INFO:tasks.workunit.client.1.smithi194.stdout:3/44: symlink d2/la 0 2024-04-13T10:58:32.906 INFO:tasks.workunit.client.1.smithi194.stdout:3/45: dread d2/f9 [0,4194304] 0 2024-04-13T10:58:32.910 INFO:tasks.workunit.client.1.smithi194.stdout:8/69: getdents d6 0 2024-04-13T10:58:32.914 INFO:tasks.workunit.client.1.smithi194.stdout:8/70: symlink d6/l18 0 2024-04-13T10:58:32.915 INFO:tasks.workunit.client.1.smithi194.stdout:7/76: dwrite d1/fe [0,4194304] 0 2024-04-13T10:58:32.917 INFO:tasks.workunit.client.1.smithi194.stdout:3/46: dwrite d2/d3/f6 [0,4194304] 0 2024-04-13T10:58:32.921 INFO:tasks.workunit.client.1.smithi194.stdout:3/47: rmdir d2 39 2024-04-13T10:58:32.923 INFO:tasks.workunit.client.1.smithi194.stdout:8/71: creat d6/dd/f19 x:0 0 0 2024-04-13T10:58:32.927 INFO:tasks.workunit.client.1.smithi194.stdout:3/48: rename d2/la to d2/lb 0 2024-04-13T10:58:32.931 INFO:tasks.workunit.client.1.smithi194.stdout:8/72: dwrite d6/f11 [0,4194304] 0 2024-04-13T10:58:32.931 INFO:tasks.workunit.client.1.smithi194.stdout:3/49: mkdir d2/dc 0 2024-04-13T10:58:32.935 INFO:tasks.workunit.client.1.smithi194.stdout:3/50: creat d2/fd x:0 0 0 2024-04-13T10:58:32.937 INFO:tasks.workunit.client.1.smithi194.stdout:3/51: mkdir d2/de 0 2024-04-13T10:58:32.938 INFO:tasks.workunit.client.1.smithi194.stdout:3/52: creat d2/d3/ff x:0 0 0 2024-04-13T10:58:32.954 INFO:tasks.workunit.client.1.smithi194.stdout:3/53: rmdir d2 39 2024-04-13T10:58:32.972 INFO:tasks.workunit.client.1.smithi194.stdout:3/54: unlink d2/l4 0 2024-04-13T10:58:32.975 INFO:tasks.workunit.client.1.smithi194.stdout:3/55: symlink d2/de/l10 0 2024-04-13T10:58:32.976 INFO:tasks.workunit.client.1.smithi194.stdout:3/56: truncate d2/f9 968394 0 2024-04-13T10:58:32.992 INFO:tasks.workunit.client.1.smithi194.stdout:2/68: sync 2024-04-13T10:58:32.993 INFO:tasks.workunit.client.1.smithi194.stdout:0/64: sync 2024-04-13T10:58:32.993 INFO:tasks.workunit.client.1.smithi194.stdout:5/25: sync 2024-04-13T10:58:32.993 INFO:tasks.workunit.client.1.smithi194.stdout:5/26: dwrite - no filename 2024-04-13T10:58:33.061 INFO:tasks.workunit.client.1.smithi194.stdout:3/57: rmdir d2/dc 0 2024-04-13T10:58:33.061 INFO:tasks.workunit.client.1.smithi194.stdout:0/65: creat d9/df/d11/f17 x:0 0 0 2024-04-13T10:58:33.062 INFO:tasks.workunit.client.1.smithi194.stdout:2/69: rename d2/d3/d12/d19 to d2/d3/de/d17/d1e 0 2024-04-13T10:58:33.063 INFO:tasks.workunit.client.1.smithi194.stdout:5/27: creat d3/f4 x:0 0 0 2024-04-13T10:58:33.063 INFO:tasks.workunit.client.1.smithi194.stdout:5/28: dread - d3/f4 zero size 2024-04-13T10:58:33.064 INFO:tasks.workunit.client.1.smithi194.stdout:0/66: write d9/fd [5907235,79588] 0 2024-04-13T10:58:33.066 INFO:tasks.workunit.client.1.smithi194.stdout:3/58: fdatasync d2/f9 0 2024-04-13T10:58:33.067 INFO:tasks.workunit.client.1.smithi194.stdout:3/59: dread - d2/d3/f8 zero size 2024-04-13T10:58:33.069 INFO:tasks.workunit.client.1.smithi194.stdout:3/60: rename d2/d3/ff to d2/f11 0 2024-04-13T10:58:33.071 INFO:tasks.workunit.client.1.smithi194.stdout:0/67: link d9/df/f12 d9/df/d11/f18 0 2024-04-13T10:58:33.072 INFO:tasks.workunit.client.1.smithi194.stdout:5/29: rmdir d3 39 2024-04-13T10:58:33.075 INFO:tasks.workunit.client.1.smithi194.stdout:5/30: unlink l2 0 2024-04-13T10:58:33.075 INFO:tasks.workunit.client.1.smithi194.stdout:4/65: sync 2024-04-13T10:58:33.075 INFO:tasks.workunit.client.1.smithi194.stdout:7/77: sync 2024-04-13T10:58:33.075 INFO:tasks.workunit.client.1.smithi194.stdout:6/54: sync 2024-04-13T10:58:33.076 INFO:tasks.workunit.client.1.smithi194.stdout:1/59: sync 2024-04-13T10:58:33.076 INFO:tasks.workunit.client.1.smithi194.stdout:9/36: sync 2024-04-13T10:58:33.077 INFO:tasks.workunit.client.1.smithi194.stdout:0/68: dread d9/df/d11/f13 [0,4194304] 0 2024-04-13T10:58:33.079 INFO:tasks.workunit.client.1.smithi194.stdout:1/60: write fb [3825634,61832] 0 2024-04-13T10:58:33.079 INFO:tasks.workunit.client.1.smithi194.stdout:4/66: fdatasync d2/ff 0 2024-04-13T10:58:33.080 INFO:tasks.workunit.client.1.smithi194.stdout:5/31: truncate d3/f4 87046 0 2024-04-13T10:58:33.081 INFO:tasks.workunit.client.1.smithi194.stdout:6/55: mkdir d0/db 0 2024-04-13T10:58:33.118 INFO:tasks.workunit.client.1.smithi194.stdout:3/61: dwrite d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:33.119 INFO:tasks.workunit.client.1.smithi194.stdout:7/78: write d1/f16 [412889,101924] 0 2024-04-13T10:58:33.119 INFO:tasks.workunit.client.1.smithi194.stdout:0/69: mkdir d9/db/d19 0 2024-04-13T10:58:33.123 INFO:tasks.workunit.client.1.smithi194.stdout:4/67: write d2/f6 [3477006,56533] 0 2024-04-13T10:58:33.124 INFO:tasks.workunit.client.1.smithi194.stdout:5/32: creat d3/f5 x:0 0 0 2024-04-13T10:58:33.124 INFO:tasks.workunit.client.1.smithi194.stdout:2/70: dwrite d2/d5/fc [12582912,4194304] 0 2024-04-13T10:58:33.124 INFO:tasks.workunit.client.1.smithi194.stdout:7/79: read d1/f16 [151652,80430] 0 2024-04-13T10:58:33.125 INFO:tasks.workunit.client.1.smithi194.stdout:3/62: mkdir d2/d3/d12 0 2024-04-13T10:58:33.128 INFO:tasks.workunit.client.1.smithi194.stdout:7/80: chown d1/f12 62284 1 2024-04-13T10:58:33.129 INFO:tasks.workunit.client.1.smithi194.stdout:6/56: getdents d0/db 0 2024-04-13T10:58:33.129 INFO:tasks.workunit.client.1.smithi194.stdout:5/33: truncate d3/f5 581009 0 2024-04-13T10:58:33.131 INFO:tasks.workunit.client.1.smithi194.stdout:4/68: creat d2/d11/f17 x:0 0 0 2024-04-13T10:58:33.133 INFO:tasks.workunit.client.1.smithi194.stdout:1/61: dwrite f1 [0,4194304] 0 2024-04-13T10:58:33.136 INFO:tasks.workunit.client.1.smithi194.stdout:4/69: write d2/f13 [805476,122150] 0 2024-04-13T10:58:33.137 INFO:tasks.workunit.client.1.smithi194.stdout:7/81: creat d1/d13/f1f x:0 0 0 2024-04-13T10:58:33.140 INFO:tasks.workunit.client.1.smithi194.stdout:2/71: link d2/d5/l18 d2/d3/de/d17/l1f 0 2024-04-13T10:58:33.140 INFO:tasks.workunit.client.1.smithi194.stdout:7/82: dread - d1/d13/f1f zero size 2024-04-13T10:58:33.142 INFO:tasks.workunit.client.1.smithi194.stdout:8/73: sync 2024-04-13T10:58:33.148 INFO:tasks.workunit.client.1.smithi194.stdout:3/63: dread d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:33.149 INFO:tasks.workunit.client.1.smithi194.stdout:8/74: rmdir d6 39 2024-04-13T10:58:33.153 INFO:tasks.workunit.client.1.smithi194.stdout:8/75: stat l3 0 2024-04-13T10:58:33.153 INFO:tasks.workunit.client.1.smithi194.stdout:5/34: dwrite d3/f5 [0,4194304] 0 2024-04-13T10:58:33.154 INFO:tasks.workunit.client.1.smithi194.stdout:4/70: unlink d2/l8 0 2024-04-13T10:58:33.154 INFO:tasks.workunit.client.1.smithi194.stdout:1/62: getdents . 0 2024-04-13T10:58:33.154 INFO:tasks.workunit.client.1.smithi194.stdout:6/57: dwrite d0/f7 [0,4194304] 0 2024-04-13T10:58:33.156 INFO:tasks.workunit.client.1.smithi194.stdout:2/72: rename d2/d5/ca to d2/d3/c20 0 2024-04-13T10:58:33.162 INFO:tasks.workunit.client.1.smithi194.stdout:0/70: dwrite d9/df/f12 [0,4194304] 0 2024-04-13T10:58:33.162 INFO:tasks.workunit.client.1.smithi194.stdout:5/35: mknod d3/c6 0 2024-04-13T10:58:33.163 INFO:tasks.workunit.client.1.smithi194.stdout:1/63: symlink l11 0 2024-04-13T10:58:33.166 INFO:tasks.workunit.client.1.smithi194.stdout:4/71: creat d2/d16/f18 x:0 0 0 2024-04-13T10:58:33.167 INFO:tasks.workunit.client.1.smithi194.stdout:5/36: chown d3/f4 58259 1 2024-04-13T10:58:33.167 INFO:tasks.workunit.client.1.smithi194.stdout:0/71: dread - f7 zero size 2024-04-13T10:58:33.168 INFO:tasks.workunit.client.1.smithi194.stdout:4/72: fdatasync d2/fb 0 2024-04-13T10:58:33.168 INFO:tasks.workunit.client.1.smithi194.stdout:3/64: rename d2/d3/f6 to d2/de/f13 0 2024-04-13T10:58:33.170 INFO:tasks.workunit.client.1.smithi194.stdout:6/58: creat d0/db/fc x:0 0 0 2024-04-13T10:58:33.170 INFO:tasks.workunit.client.1.smithi194.stdout:5/37: read d3/f4 [56129,99672] 0 2024-04-13T10:58:33.170 INFO:tasks.workunit.client.1.smithi194.stdout:3/65: fdatasync d2/fd 0 2024-04-13T10:58:33.174 INFO:tasks.workunit.client.1.smithi194.stdout:7/83: dwrite d1/fa [0,4194304] 0 2024-04-13T10:58:33.176 INFO:tasks.workunit.client.1.smithi194.stdout:0/72: mknod d9/df/c1a 0 2024-04-13T10:58:33.176 INFO:tasks.workunit.client.1.smithi194.stdout:8/76: dread d6/f11 [0,4194304] 0 2024-04-13T10:58:33.178 INFO:tasks.workunit.client.1.smithi194.stdout:5/38: unlink d3/c6 0 2024-04-13T10:58:33.182 INFO:tasks.workunit.client.1.smithi194.stdout:5/39: fdatasync d3/f5 0 2024-04-13T10:58:33.182 INFO:tasks.workunit.client.1.smithi194.stdout:0/73: creat d9/db/f1b x:0 0 0 2024-04-13T10:58:33.183 INFO:tasks.workunit.client.1.smithi194.stdout:3/66: symlink d2/d3/d12/l14 0 2024-04-13T10:58:33.183 INFO:tasks.workunit.client.1.smithi194.stdout:0/74: stat d9/db 0 2024-04-13T10:58:33.184 INFO:tasks.workunit.client.1.smithi194.stdout:8/77: symlink d6/l1a 0 2024-04-13T10:58:33.185 INFO:tasks.workunit.client.1.smithi194.stdout:5/40: chown d3/f5 1 1 2024-04-13T10:58:33.185 INFO:tasks.workunit.client.1.smithi194.stdout:4/73: dwrite d2/f4 [0,4194304] 0 2024-04-13T10:58:33.190 INFO:tasks.workunit.client.1.smithi194.stdout:0/75: symlink d9/df/d11/l1c 0 2024-04-13T10:58:33.192 INFO:tasks.workunit.client.1.smithi194.stdout:0/76: fsync f3 0 2024-04-13T10:58:33.195 INFO:tasks.workunit.client.1.smithi194.stdout:5/41: rename d3/f5 to d3/f7 0 2024-04-13T10:58:33.196 INFO:tasks.workunit.client.1.smithi194.stdout:8/78: fsync d6/f7 0 2024-04-13T10:58:33.198 INFO:tasks.workunit.client.1.smithi194.stdout:6/59: dwrite d0/f8 [0,4194304] 0 2024-04-13T10:58:33.203 INFO:tasks.workunit.client.1.smithi194.stdout:5/42: dread d3/f4 [0,4194304] 0 2024-04-13T10:58:33.203 INFO:tasks.workunit.client.1.smithi194.stdout:0/77: rename f7 to d9/df/f1d 0 2024-04-13T10:58:33.205 INFO:tasks.workunit.client.1.smithi194.stdout:8/79: creat d6/dd/f1b x:0 0 0 2024-04-13T10:58:33.206 INFO:tasks.workunit.client.1.smithi194.stdout:6/60: dread - d0/db/fc zero size 2024-04-13T10:58:33.209 INFO:tasks.workunit.client.1.smithi194.stdout:7/84: dwrite d1/f3 [0,4194304] 0 2024-04-13T10:58:33.210 INFO:tasks.workunit.client.1.smithi194.stdout:4/74: dwrite d2/f6 [0,4194304] 0 2024-04-13T10:58:33.212 INFO:tasks.workunit.client.1.smithi194.stdout:3/67: dwrite d2/f11 [0,4194304] 0 2024-04-13T10:58:33.212 INFO:tasks.workunit.client.1.smithi194.stdout:0/78: truncate d9/df/f1d 364621 0 2024-04-13T10:58:33.212 INFO:tasks.workunit.client.1.smithi194.stdout:9/37: sync 2024-04-13T10:58:33.215 INFO:tasks.workunit.client.1.smithi194.stdout:4/75: creat d2/f19 x:0 0 0 2024-04-13T10:58:33.215 INFO:tasks.workunit.client.1.smithi194.stdout:7/85: write d1/f5 [8526789,129251] 0 2024-04-13T10:58:33.215 INFO:tasks.workunit.client.1.smithi194.stdout:0/79: read f3 [68169,57876] 0 2024-04-13T10:58:33.216 INFO:tasks.workunit.client.1.smithi194.stdout:8/80: rename d6/dd/f1b to d6/f1c 0 2024-04-13T10:58:33.218 INFO:tasks.workunit.client.1.smithi194.stdout:9/38: write d0/d6/f8 [333584,48570] 0 2024-04-13T10:58:33.219 INFO:tasks.workunit.client.1.smithi194.stdout:7/86: dread - d1/f1d zero size 2024-04-13T10:58:33.221 INFO:tasks.workunit.client.1.smithi194.stdout:4/76: dread d2/fb [0,4194304] 0 2024-04-13T10:58:33.223 INFO:tasks.workunit.client.1.smithi194.stdout:9/39: mknod d0/cd 0 2024-04-13T10:58:33.224 INFO:tasks.workunit.client.1.smithi194.stdout:7/87: chown d1/d13/l1b 2796 1 2024-04-13T10:58:33.225 INFO:tasks.workunit.client.1.smithi194.stdout:4/77: read d2/f4 [2217942,81499] 0 2024-04-13T10:58:33.225 INFO:tasks.workunit.client.1.smithi194.stdout:8/81: creat d6/f1d x:0 0 0 2024-04-13T10:58:33.226 INFO:tasks.workunit.client.1.smithi194.stdout:6/61: dwrite d0/f8 [0,4194304] 0 2024-04-13T10:58:33.227 INFO:tasks.workunit.client.1.smithi194.stdout:0/80: truncate d9/df/d11/f18 4972329 0 2024-04-13T10:58:33.228 INFO:tasks.workunit.client.1.smithi194.stdout:4/78: dread - d2/d11/f17 zero size 2024-04-13T10:58:33.233 INFO:tasks.workunit.client.1.smithi194.stdout:3/68: dwrite d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:33.234 INFO:tasks.workunit.client.1.smithi194.stdout:8/82: stat d6/dd/ca 0 2024-04-13T10:58:33.235 INFO:tasks.workunit.client.1.smithi194.stdout:3/69: read d2/de/f13 [2081702,126756] 0 2024-04-13T10:58:33.236 INFO:tasks.workunit.client.1.smithi194.stdout:7/88: creat d1/d13/f20 x:0 0 0 2024-04-13T10:58:33.238 INFO:tasks.workunit.client.1.smithi194.stdout:8/83: dread f2 [0,4194304] 0 2024-04-13T10:58:33.238 INFO:tasks.workunit.client.1.smithi194.stdout:8/84: chown d6/dd 24 1 2024-04-13T10:58:33.239 INFO:tasks.workunit.client.1.smithi194.stdout:7/89: mknod d1/c21 0 2024-04-13T10:58:33.240 INFO:tasks.workunit.client.1.smithi194.stdout:0/81: getdents d9/df/d11 0 2024-04-13T10:58:33.241 INFO:tasks.workunit.client.1.smithi194.stdout:0/82: readlink d9/df/d11/l1c 0 2024-04-13T10:58:33.241 INFO:tasks.workunit.client.1.smithi194.stdout:0/83: write f3 [1522838,62802] 0 2024-04-13T10:58:33.242 INFO:tasks.workunit.client.1.smithi194.stdout:7/90: symlink d1/l22 0 2024-04-13T10:58:33.242 INFO:tasks.workunit.client.1.smithi194.stdout:3/70: dread d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:33.245 INFO:tasks.workunit.client.1.smithi194.stdout:8/85: creat d6/f1e x:0 0 0 2024-04-13T10:58:33.246 INFO:tasks.workunit.client.1.smithi194.stdout:7/91: dread d1/f16 [0,4194304] 0 2024-04-13T10:58:33.247 INFO:tasks.workunit.client.1.smithi194.stdout:8/86: mknod d6/dd/c1f 0 2024-04-13T10:58:33.248 INFO:tasks.workunit.client.1.smithi194.stdout:7/92: unlink d1/l6 0 2024-04-13T10:58:33.249 INFO:tasks.workunit.client.1.smithi194.stdout:8/87: write d6/f1d [225647,7821] 0 2024-04-13T10:58:33.252 INFO:tasks.workunit.client.1.smithi194.stdout:3/71: dwrite d2/fd [0,4194304] 0 2024-04-13T10:58:33.252 INFO:tasks.workunit.client.1.smithi194.stdout:8/88: mkdir d6/d20 0 2024-04-13T10:58:33.253 INFO:tasks.workunit.client.1.smithi194.stdout:8/89: chown d6/dd/f16 6935937 1 2024-04-13T10:58:33.255 INFO:tasks.workunit.client.1.smithi194.stdout:3/72: chown d2/lb 250964 1 2024-04-13T10:58:33.256 INFO:tasks.workunit.client.1.smithi194.stdout:3/73: chown d2/d3/d12/l14 21400176 1 2024-04-13T10:58:33.258 INFO:tasks.workunit.client.1.smithi194.stdout:3/74: mknod d2/c15 0 2024-04-13T10:58:33.259 INFO:tasks.workunit.client.1.smithi194.stdout:3/75: readlink d2/lb 0 2024-04-13T10:58:33.260 INFO:tasks.workunit.client.1.smithi194.stdout:8/90: dread d6/f11 [0,4194304] 0 2024-04-13T10:58:33.260 INFO:tasks.workunit.client.1.smithi194.stdout:3/76: rmdir d2/de 39 2024-04-13T10:58:33.261 INFO:tasks.workunit.client.1.smithi194.stdout:4/79: rmdir d2 39 2024-04-13T10:58:33.265 INFO:tasks.workunit.client.1.smithi194.stdout:3/77: dread d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:33.266 INFO:tasks.workunit.client.1.smithi194.stdout:4/80: mkdir d2/d16/d1a 0 2024-04-13T10:58:33.267 INFO:tasks.workunit.client.1.smithi194.stdout:8/91: creat d6/f21 x:0 0 0 2024-04-13T10:58:33.269 INFO:tasks.workunit.client.1.smithi194.stdout:8/92: chown d6/dd/ca 448 1 2024-04-13T10:58:33.272 INFO:tasks.workunit.client.1.smithi194.stdout:7/93: truncate d1/fa 2619484 0 2024-04-13T10:58:33.273 INFO:tasks.workunit.client.1.smithi194.stdout:4/81: dwrite d2/ff [0,4194304] 0 2024-04-13T10:58:33.273 INFO:tasks.workunit.client.1.smithi194.stdout:3/78: write d2/f9 [207658,55935] 0 2024-04-13T10:58:33.281 INFO:tasks.workunit.client.1.smithi194.stdout:4/82: dwrite d2/f6 [0,4194304] 0 2024-04-13T10:58:33.282 INFO:tasks.workunit.client.1.smithi194.stdout:4/83: dread - d2/d11/f17 zero size 2024-04-13T10:58:33.286 INFO:tasks.workunit.client.1.smithi194.stdout:4/84: rename l0 to d2/d16/d1a/l1b 0 2024-04-13T10:58:33.290 INFO:tasks.workunit.client.1.smithi194.stdout:4/85: unlink d2/f6 0 2024-04-13T10:58:33.292 INFO:tasks.workunit.client.1.smithi194.stdout:4/86: mkdir d2/d16/d1a/d1c 0 2024-04-13T10:58:33.293 INFO:tasks.workunit.client.1.smithi194.stdout:4/87: dread - d2/d16/f18 zero size 2024-04-13T10:58:33.293 INFO:tasks.workunit.client.1.smithi194.stdout:4/88: dread - d2/f19 zero size 2024-04-13T10:58:33.300 INFO:tasks.workunit.client.1.smithi194.stdout:4/89: dwrite d2/f19 [0,4194304] 0 2024-04-13T10:58:33.301 INFO:tasks.workunit.client.1.smithi194.stdout:4/90: chown d2/f19 822091 1 2024-04-13T10:58:33.304 INFO:tasks.workunit.client.1.smithi194.stdout:4/91: mkdir d2/d16/d1a/d1d 0 2024-04-13T10:58:33.309 INFO:tasks.workunit.client.1.smithi194.stdout:4/92: symlink d2/d16/d1a/d1c/l1e 0 2024-04-13T10:58:33.314 INFO:tasks.workunit.client.1.smithi194.stdout:4/93: rename d2/d16/d1a/l1b to d2/d16/d1a/d1d/l1f 0 2024-04-13T10:58:33.314 INFO:tasks.workunit.client.1.smithi194.stdout:4/94: chown d2/d11 1140 1 2024-04-13T10:58:33.317 INFO:tasks.workunit.client.1.smithi194.stdout:4/95: link d2/f13 d2/d16/d1a/d1d/f20 0 2024-04-13T10:58:33.318 INFO:tasks.workunit.client.1.smithi194.stdout:4/96: mknod d2/d16/d1a/d1c/c21 0 2024-04-13T10:58:33.324 INFO:tasks.workunit.client.1.smithi194.stdout:4/97: dwrite d2/f19 [0,4194304] 0 2024-04-13T10:58:33.336 INFO:tasks.workunit.client.1.smithi194.stdout:4/98: dwrite d2/f13 [0,4194304] 0 2024-04-13T10:58:33.337 INFO:tasks.workunit.client.1.smithi194.stdout:4/99: write d2/d11/f17 [200219,81543] 0 2024-04-13T10:58:33.338 INFO:tasks.workunit.client.1.smithi194.stdout:4/100: read d2/f4 [3375686,121631] 0 2024-04-13T10:58:33.339 INFO:tasks.workunit.client.1.smithi194.stdout:4/101: dread - d2/fd zero size 2024-04-13T10:58:33.342 INFO:tasks.workunit.client.1.smithi194.stdout:4/102: dread d2/ff [0,4194304] 0 2024-04-13T10:58:33.343 INFO:tasks.workunit.client.1.smithi194.stdout:4/103: write d2/f19 [2152328,12362] 0 2024-04-13T10:58:33.343 INFO:tasks.workunit.client.1.smithi194.stdout:2/73: sync 2024-04-13T10:58:33.345 INFO:tasks.workunit.client.1.smithi194.stdout:4/104: read d2/d11/f17 [128640,35673] 0 2024-04-13T10:58:33.346 INFO:tasks.workunit.client.1.smithi194.stdout:4/105: write d2/d16/f18 [145944,42620] 0 2024-04-13T10:58:33.347 INFO:tasks.workunit.client.1.smithi194.stdout:4/106: fsync d2/ff 0 2024-04-13T10:58:33.348 INFO:tasks.workunit.client.1.smithi194.stdout:4/107: chown d2/f4 0 1 2024-04-13T10:58:33.404 INFO:tasks.workunit.client.1.smithi194.stdout:2/74: truncate d2/fd 3011420 0 2024-04-13T10:58:33.404 INFO:tasks.workunit.client.1.smithi194.stdout:2/75: chown d2/d3/de/f16 1 1 2024-04-13T10:58:33.405 INFO:tasks.workunit.client.1.smithi194.stdout:2/76: truncate d2/d3/de/f16 685980 0 2024-04-13T10:58:33.408 INFO:tasks.workunit.client.1.smithi194.stdout:2/77: symlink d2/d3/de/l21 0 2024-04-13T10:58:33.411 INFO:tasks.workunit.client.1.smithi194.stdout:2/78: creat d2/d3/d12/f22 x:0 0 0 2024-04-13T10:58:33.412 INFO:tasks.workunit.client.1.smithi194.stdout:4/108: getdents d2/d16/d1a/d1c 0 2024-04-13T10:58:33.418 INFO:tasks.workunit.client.1.smithi194.stdout:4/109: creat d2/d16/d1a/f22 x:0 0 0 2024-04-13T10:58:33.419 INFO:tasks.workunit.client.1.smithi194.stdout:4/110: write d2/d16/d1a/d1d/f20 [3581301,46955] 0 2024-04-13T10:58:33.424 INFO:tasks.workunit.client.1.smithi194.stdout:4/111: mknod d2/d16/d1a/c23 0 2024-04-13T10:58:33.425 INFO:tasks.workunit.client.1.smithi194.stdout:2/79: write d2/d3/d12/f1b [803637,4934] 0 2024-04-13T10:58:33.427 INFO:tasks.workunit.client.1.smithi194.stdout:4/112: symlink d2/d16/d1a/d1c/l24 0 2024-04-13T10:58:33.429 INFO:tasks.workunit.client.1.smithi194.stdout:2/80: creat d2/f23 x:0 0 0 2024-04-13T10:58:33.429 INFO:tasks.workunit.client.1.smithi194.stdout:2/81: read d2/d3/de/f16 [477183,79794] 0 2024-04-13T10:58:33.432 INFO:tasks.workunit.client.1.smithi194.stdout:2/82: creat d2/d3/de/f24 x:0 0 0 2024-04-13T10:58:33.434 INFO:tasks.workunit.client.1.smithi194.stdout:2/83: mknod d2/d3/de/d17/c25 0 2024-04-13T10:58:33.437 INFO:tasks.workunit.client.1.smithi194.stdout:2/84: unlink d2/d5/f9 0 2024-04-13T10:58:33.437 INFO:tasks.workunit.client.1.smithi194.stdout:2/85: fsync d2/d5/f1d 0 2024-04-13T10:58:33.437 INFO:tasks.workunit.client.1.smithi194.stdout:1/64: sync 2024-04-13T10:58:33.438 INFO:tasks.workunit.client.1.smithi194.stdout:1/65: truncate f1 4689874 0 2024-04-13T10:58:33.439 INFO:tasks.workunit.client.1.smithi194.stdout:1/66: write f6 [3092309,91152] 0 2024-04-13T10:58:33.442 INFO:tasks.workunit.client.1.smithi194.stdout:2/86: dread d2/d5/fc [12582912,4194304] 0 2024-04-13T10:58:33.442 INFO:tasks.workunit.client.1.smithi194.stdout:2/87: stat d2/d3/de/f24 0 2024-04-13T10:58:33.444 INFO:tasks.workunit.client.1.smithi194.stdout:1/67: mkdir d12 0 2024-04-13T10:58:33.451 INFO:tasks.workunit.client.1.smithi194.stdout:1/68: mkdir d12/d13 0 2024-04-13T10:58:33.451 INFO:tasks.workunit.client.1.smithi194.stdout:1/69: dread - f10 zero size 2024-04-13T10:58:33.454 INFO:tasks.workunit.client.1.smithi194.stdout:1/70: dread f5 [0,4194304] 0 2024-04-13T10:58:33.467 INFO:tasks.workunit.client.1.smithi194.stdout:1/71: write f10 [117874,88577] 0 2024-04-13T10:58:33.472 INFO:tasks.workunit.client.1.smithi194.stdout:2/88: dwrite d2/fd [0,4194304] 0 2024-04-13T10:58:33.529 INFO:tasks.workunit.client.1.smithi194.stdout:5/43: sync 2024-04-13T10:58:33.578 INFO:tasks.workunit.client.1.smithi194.stdout:0/84: sync 2024-04-13T10:58:33.578 INFO:tasks.workunit.client.1.smithi194.stdout:9/40: sync 2024-04-13T10:58:33.578 INFO:tasks.workunit.client.1.smithi194.stdout:6/62: sync 2024-04-13T10:58:33.620 INFO:tasks.workunit.client.1.smithi194.stdout:1/72: symlink d12/l14 0 2024-04-13T10:58:33.620 INFO:tasks.workunit.client.1.smithi194.stdout:1/73: chown d12/l14 1845 1 2024-04-13T10:58:33.621 INFO:tasks.workunit.client.1.smithi194.stdout:2/89: rename d2/d5/l13 to d2/d3/l26 0 2024-04-13T10:58:33.623 INFO:tasks.workunit.client.1.smithi194.stdout:5/44: rmdir d3 39 2024-04-13T10:58:33.625 INFO:tasks.workunit.client.1.smithi194.stdout:9/41: mknod d0/d6/d9/ce 0 2024-04-13T10:58:33.626 INFO:tasks.workunit.client.1.smithi194.stdout:7/94: sync 2024-04-13T10:58:33.626 INFO:tasks.workunit.client.1.smithi194.stdout:4/113: sync 2024-04-13T10:58:33.626 INFO:tasks.workunit.client.1.smithi194.stdout:8/93: sync 2024-04-13T10:58:33.626 INFO:tasks.workunit.client.1.smithi194.stdout:3/79: sync 2024-04-13T10:58:33.626 INFO:tasks.workunit.client.1.smithi194.stdout:1/74: unlink f2 0 2024-04-13T10:58:33.627 INFO:tasks.workunit.client.1.smithi194.stdout:1/75: read f5 [643356,21266] 0 2024-04-13T10:58:33.627 INFO:tasks.workunit.client.1.smithi194.stdout:7/95: dread - d1/d13/f20 zero size 2024-04-13T10:58:33.628 INFO:tasks.workunit.client.1.smithi194.stdout:6/63: rename d0/c9 to d0/db/cd 0 2024-04-13T10:58:33.628 INFO:tasks.workunit.client.1.smithi194.stdout:9/42: truncate d0/d6/f8 811025 0 2024-04-13T10:58:33.629 INFO:tasks.workunit.client.1.smithi194.stdout:6/64: write d0/fa [947946,4962] 0 2024-04-13T10:58:33.632 INFO:tasks.workunit.client.1.smithi194.stdout:9/43: dread d0/f4 [0,4194304] 0 2024-04-13T10:58:33.633 INFO:tasks.workunit.client.1.smithi194.stdout:9/44: write d0/f4 [1277414,113655] 0 2024-04-13T10:58:33.635 INFO:tasks.workunit.client.1.smithi194.stdout:9/45: read d0/d6/f8 [619380,127230] 0 2024-04-13T10:58:33.638 INFO:tasks.workunit.client.1.smithi194.stdout:9/46: dread d0/f4 [0,4194304] 0 2024-04-13T10:58:33.655 INFO:tasks.workunit.client.1.smithi194.stdout:2/90: creat d2/d3/de/d17/d1e/f27 x:0 0 0 2024-04-13T10:58:33.655 INFO:tasks.workunit.client.1.smithi194.stdout:2/91: stat d2/d5/f1d 0 2024-04-13T10:58:33.663 INFO:tasks.workunit.client.1.smithi194.stdout:8/94: unlink d6/l1a 0 2024-04-13T10:58:33.667 INFO:tasks.workunit.client.1.smithi194.stdout:4/114: symlink d2/d16/l25 0 2024-04-13T10:58:33.668 INFO:tasks.workunit.client.1.smithi194.stdout:4/115: write d2/f19 [2410416,114136] 0 2024-04-13T10:58:33.669 INFO:tasks.workunit.client.1.smithi194.stdout:4/116: write d2/f13 [246425,104370] 0 2024-04-13T10:58:33.670 INFO:tasks.workunit.client.1.smithi194.stdout:1/76: creat d12/f15 x:0 0 0 2024-04-13T10:58:33.679 INFO:tasks.workunit.client.1.smithi194.stdout:0/85: rename d9/df/f12 to d9/df/d11/f1e 0 2024-04-13T10:58:33.679 INFO:tasks.workunit.client.1.smithi194.stdout:7/96: dwrite d1/f16 [0,4194304] 0 2024-04-13T10:58:33.680 INFO:tasks.workunit.client.1.smithi194.stdout:7/97: chown d1/lc 3 1 2024-04-13T10:58:33.680 INFO:tasks.workunit.client.1.smithi194.stdout:7/98: chown d1/lf 928 1 2024-04-13T10:58:33.681 INFO:tasks.workunit.client.1.smithi194.stdout:6/65: mknod d0/ce 0 2024-04-13T10:58:33.681 INFO:tasks.workunit.client.1.smithi194.stdout:6/66: fdatasync d0/db/fc 0 2024-04-13T10:58:33.682 INFO:tasks.workunit.client.1.smithi194.stdout:6/67: chown d0/f8 138812982 1 2024-04-13T10:58:33.683 INFO:tasks.workunit.client.1.smithi194.stdout:6/68: write d0/db/fc [379988,128837] 0 2024-04-13T10:58:33.691 INFO:tasks.workunit.client.1.smithi194.stdout:5/45: mknod d3/c8 0 2024-04-13T10:58:33.694 INFO:tasks.workunit.client.1.smithi194.stdout:2/92: dwrite d2/d3/ff [0,4194304] 0 2024-04-13T10:58:33.695 INFO:tasks.workunit.client.1.smithi194.stdout:2/93: readlink d2/d3/l15 0 2024-04-13T10:58:33.699 INFO:tasks.workunit.client.1.smithi194.stdout:2/94: dread d2/d3/de/f1a [0,4194304] 0 2024-04-13T10:58:33.709 INFO:tasks.workunit.client.1.smithi194.stdout:3/80: rename d2/de/f13 to d2/d3/d12/f16 0 2024-04-13T10:58:33.710 INFO:tasks.workunit.client.1.smithi194.stdout:0/86: creat d9/df/f1f x:0 0 0 2024-04-13T10:58:33.713 INFO:tasks.workunit.client.1.smithi194.stdout:6/69: symlink d0/lf 0 2024-04-13T10:58:33.714 INFO:tasks.workunit.client.1.smithi194.stdout:6/70: chown d0/db/fc 18778 1 2024-04-13T10:58:33.715 INFO:tasks.workunit.client.1.smithi194.stdout:9/47: mknod d0/cf 0 2024-04-13T10:58:33.717 INFO:tasks.workunit.client.1.smithi194.stdout:5/46: rename d3/f7 to d3/f9 0 2024-04-13T10:58:33.721 INFO:tasks.workunit.client.1.smithi194.stdout:2/95: unlink d2/l7 0 2024-04-13T10:58:33.721 INFO:tasks.workunit.client.1.smithi194.stdout:2/96: dread - d2/d5/f1d zero size 2024-04-13T10:58:33.723 INFO:tasks.workunit.client.1.smithi194.stdout:4/117: link d2/fb d2/d16/d1a/d1d/f26 0 2024-04-13T10:58:33.724 INFO:tasks.workunit.client.1.smithi194.stdout:4/118: dread - d2/d16/d1a/f22 zero size 2024-04-13T10:58:33.724 INFO:tasks.workunit.client.1.smithi194.stdout:4/119: write d2/ff [4741993,87927] 0 2024-04-13T10:58:33.725 INFO:tasks.workunit.client.1.smithi194.stdout:1/77: rename lc to d12/d13/l16 0 2024-04-13T10:58:33.725 INFO:tasks.workunit.client.1.smithi194.stdout:1/78: read - ff zero size 2024-04-13T10:58:33.730 INFO:tasks.workunit.client.1.smithi194.stdout:6/71: creat d0/f10 x:0 0 0 2024-04-13T10:58:33.731 INFO:tasks.workunit.client.1.smithi194.stdout:6/72: fsync d0/db/fc 0 2024-04-13T10:58:33.732 INFO:tasks.workunit.client.1.smithi194.stdout:3/81: dwrite d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:33.736 INFO:tasks.workunit.client.1.smithi194.stdout:8/95: rename d6/d20 to d6/d22 0 2024-04-13T10:58:33.736 INFO:tasks.workunit.client.1.smithi194.stdout:9/48: dread d0/d6/f8 [0,4194304] 0 2024-04-13T10:58:33.736 INFO:tasks.workunit.client.1.smithi194.stdout:3/82: write d2/d3/f8 [2225312,21838] 0 2024-04-13T10:58:33.738 INFO:tasks.workunit.client.1.smithi194.stdout:3/83: stat d2/d3 0 2024-04-13T10:58:33.739 INFO:tasks.workunit.client.1.smithi194.stdout:2/97: write d2/d3/d12/f1b [971041,37126] 0 2024-04-13T10:58:33.741 INFO:tasks.workunit.client.1.smithi194.stdout:6/73: dwrite d0/fa [0,4194304] 0 2024-04-13T10:58:33.751 INFO:tasks.workunit.client.1.smithi194.stdout:3/84: dread d2/f9 [0,4194304] 0 2024-04-13T10:58:33.751 INFO:tasks.workunit.client.1.smithi194.stdout:1/79: dread f0 [4194304,4194304] 0 2024-04-13T10:58:33.751 INFO:tasks.workunit.client.1.smithi194.stdout:1/80: write d12/f15 [1011349,81520] 0 2024-04-13T10:58:33.751 INFO:tasks.workunit.client.1.smithi194.stdout:3/85: dread d2/d3/d12/f16 [0,4194304] 0 2024-04-13T10:58:33.751 INFO:tasks.workunit.client.1.smithi194.stdout:3/86: chown d2/fd 30375293 1 2024-04-13T10:58:33.752 INFO:tasks.workunit.client.1.smithi194.stdout:3/87: write d2/f11 [2967621,19759] 0 2024-04-13T10:58:33.752 INFO:tasks.workunit.client.1.smithi194.stdout:3/88: chown d2/de 876108 1 2024-04-13T10:58:33.752 INFO:tasks.workunit.client.1.smithi194.stdout:7/99: sync 2024-04-13T10:58:33.752 INFO:tasks.workunit.client.1.smithi194.stdout:3/89: chown d2/fd 0 1 2024-04-13T10:58:33.757 INFO:tasks.workunit.client.1.smithi194.stdout:8/96: write d6/f11 [5123076,120780] 0 2024-04-13T10:58:33.762 INFO:tasks.workunit.client.1.smithi194.stdout:2/98: rename d2/l4 to d2/d3/de/d17/l28 0 2024-04-13T10:58:33.763 INFO:tasks.workunit.client.1.smithi194.stdout:2/99: chown d2/d3/ff 100 1 2024-04-13T10:58:33.763 INFO:tasks.workunit.client.1.smithi194.stdout:2/100: chown d2/d5/fc 55689 1 2024-04-13T10:58:33.764 INFO:tasks.workunit.client.1.smithi194.stdout:6/74: mknod d0/db/c11 0 2024-04-13T10:58:33.766 INFO:tasks.workunit.client.1.smithi194.stdout:6/75: readlink d0/l6 0 2024-04-13T10:58:33.767 INFO:tasks.workunit.client.1.smithi194.stdout:6/76: write d0/f7 [409234,113194] 0 2024-04-13T10:58:33.767 INFO:tasks.workunit.client.1.smithi194.stdout:0/87: link d9/df/c1a d9/c20 0 2024-04-13T10:58:33.770 INFO:tasks.workunit.client.1.smithi194.stdout:1/81: mknod d12/d13/c17 0 2024-04-13T10:58:33.771 INFO:tasks.workunit.client.1.smithi194.stdout:2/101: dwrite d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:33.773 INFO:tasks.workunit.client.1.smithi194.stdout:7/100: mknod d1/d13/c23 0 2024-04-13T10:58:33.776 INFO:tasks.workunit.client.1.smithi194.stdout:3/90: truncate d2/f5 1175390 0 2024-04-13T10:58:33.778 INFO:tasks.workunit.client.1.smithi194.stdout:8/97: mkdir d6/d22/d23 0 2024-04-13T10:58:33.779 INFO:tasks.workunit.client.1.smithi194.stdout:3/91: dread d2/d3/d12/f16 [0,4194304] 0 2024-04-13T10:58:33.792 INFO:tasks.workunit.client.1.smithi194.stdout:1/82: creat d12/d13/f18 x:0 0 0 2024-04-13T10:58:33.793 INFO:tasks.workunit.client.1.smithi194.stdout:2/102: stat d2/d3/de/d17/l1f 0 2024-04-13T10:58:33.794 INFO:tasks.workunit.client.1.smithi194.stdout:2/103: fdatasync d2/fd 0 2024-04-13T10:58:33.795 INFO:tasks.workunit.client.1.smithi194.stdout:7/101: creat d1/f24 x:0 0 0 2024-04-13T10:58:33.796 INFO:tasks.workunit.client.1.smithi194.stdout:1/83: dread f5 [0,4194304] 0 2024-04-13T10:58:33.797 INFO:tasks.workunit.client.1.smithi194.stdout:8/98: symlink d6/d22/l24 0 2024-04-13T10:58:33.801 INFO:tasks.workunit.client.1.smithi194.stdout:0/88: symlink d9/db/d19/l21 0 2024-04-13T10:58:33.803 INFO:tasks.workunit.client.1.smithi194.stdout:2/104: mknod d2/d3/c29 0 2024-04-13T10:58:33.804 INFO:tasks.workunit.client.1.smithi194.stdout:8/99: dwrite d6/dd/f19 [0,4194304] 0 2024-04-13T10:58:33.804 INFO:tasks.workunit.client.1.smithi194.stdout:7/102: symlink d1/d13/l25 0 2024-04-13T10:58:33.804 INFO:tasks.workunit.client.1.smithi194.stdout:1/84: symlink d12/d13/l19 0 2024-04-13T10:58:33.805 INFO:tasks.workunit.client.1.smithi194.stdout:7/103: fdatasync d1/f16 0 2024-04-13T10:58:33.806 INFO:tasks.workunit.client.1.smithi194.stdout:9/49: getdents d0/d6 0 2024-04-13T10:58:33.809 INFO:tasks.workunit.client.1.smithi194.stdout:0/89: creat d9/f22 x:0 0 0 2024-04-13T10:58:33.810 INFO:tasks.workunit.client.1.smithi194.stdout:3/92: creat d2/f17 x:0 0 0 2024-04-13T10:58:33.811 INFO:tasks.workunit.client.1.smithi194.stdout:7/104: symlink d1/l26 0 2024-04-13T10:58:33.812 INFO:tasks.workunit.client.1.smithi194.stdout:9/50: fsync d0/d6/f8 0 2024-04-13T10:58:33.813 INFO:tasks.workunit.client.1.smithi194.stdout:8/100: mkdir d6/d22/d23/d25 0 2024-04-13T10:58:33.813 INFO:tasks.workunit.client.1.smithi194.stdout:0/90: truncate d9/df/f1f 135721 0 2024-04-13T10:58:33.814 INFO:tasks.workunit.client.1.smithi194.stdout:2/105: dread d2/d5/fc [0,4194304] 0 2024-04-13T10:58:33.814 INFO:tasks.workunit.client.1.smithi194.stdout:0/91: fdatasync f5 0 2024-04-13T10:58:33.815 INFO:tasks.workunit.client.1.smithi194.stdout:3/93: fdatasync d2/d3/d12/f16 0 2024-04-13T10:58:33.815 INFO:tasks.workunit.client.1.smithi194.stdout:1/85: dread f0 [0,4194304] 0 2024-04-13T10:58:33.816 INFO:tasks.workunit.client.1.smithi194.stdout:2/106: chown d2/d5/fc 1 1 2024-04-13T10:58:33.817 INFO:tasks.workunit.client.1.smithi194.stdout:3/94: chown d2/lb 6 1 2024-04-13T10:58:33.819 INFO:tasks.workunit.client.1.smithi194.stdout:1/86: creat d12/f1a x:0 0 0 2024-04-13T10:58:33.822 INFO:tasks.workunit.client.1.smithi194.stdout:2/107: mknod d2/d3/de/d17/d1e/c2a 0 2024-04-13T10:58:33.824 INFO:tasks.workunit.client.1.smithi194.stdout:7/105: dwrite d1/f24 [0,4194304] 0 2024-04-13T10:58:33.826 INFO:tasks.workunit.client.1.smithi194.stdout:3/95: link d2/d3/f8 d2/d3/d12/f18 0 2024-04-13T10:58:33.828 INFO:tasks.workunit.client.1.smithi194.stdout:2/108: creat d2/d3/d12/f2b x:0 0 0 2024-04-13T10:58:33.828 INFO:tasks.workunit.client.1.smithi194.stdout:1/87: dwrite d12/d13/f18 [0,4194304] 0 2024-04-13T10:58:33.829 INFO:tasks.workunit.client.1.smithi194.stdout:7/106: symlink d1/d13/l27 0 2024-04-13T10:58:33.833 INFO:tasks.workunit.client.1.smithi194.stdout:3/96: dread d2/d3/d12/f18 [0,4194304] 0 2024-04-13T10:58:33.835 INFO:tasks.workunit.client.1.smithi194.stdout:2/109: rename d2/d5/fc to d2/d3/de/d17/d1e/f2c 0 2024-04-13T10:58:33.841 INFO:tasks.workunit.client.1.smithi194.stdout:3/97: symlink d2/l19 0 2024-04-13T10:58:33.843 INFO:tasks.workunit.client.1.smithi194.stdout:3/98: mkdir d2/d3/d1a 0 2024-04-13T10:58:33.845 INFO:tasks.workunit.client.1.smithi194.stdout:3/99: symlink d2/d3/l1b 0 2024-04-13T10:58:33.854 INFO:tasks.workunit.client.1.smithi194.stdout:3/100: dwrite d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:33.857 INFO:tasks.workunit.client.1.smithi194.stdout:3/101: mknod d2/d3/d12/c1c 0 2024-04-13T10:58:33.860 INFO:tasks.workunit.client.1.smithi194.stdout:3/102: dread d2/d3/d12/f16 [0,4194304] 0 2024-04-13T10:58:33.910 INFO:tasks.workunit.client.1.smithi194.stdout:9/51: rmdir d0/d6/d9 39 2024-04-13T10:58:33.912 INFO:tasks.workunit.client.1.smithi194.stdout:9/52: dread - d0/d6/d9/fc zero size 2024-04-13T10:58:33.916 INFO:tasks.workunit.client.1.smithi194.stdout:9/53: getdents d0/d6/d9 0 2024-04-13T10:58:33.917 INFO:tasks.workunit.client.1.smithi194.stdout:9/54: mknod d0/d6/d9/c10 0 2024-04-13T10:58:33.918 INFO:tasks.workunit.client.1.smithi194.stdout:9/55: fsync d0/d6/f8 0 2024-04-13T10:58:33.920 INFO:tasks.workunit.client.1.smithi194.stdout:9/56: mkdir d0/d11 0 2024-04-13T10:58:33.933 INFO:tasks.workunit.client.1.smithi194.stdout:5/47: fsync d3/f9 0 2024-04-13T10:58:33.938 INFO:tasks.workunit.client.1.smithi194.stdout:4/120: getdents d2/d16/d1a/d1d 0 2024-04-13T10:58:33.938 INFO:tasks.workunit.client.1.smithi194.stdout:4/121: chown d2/d16/l25 93383933 1 2024-04-13T10:58:33.940 INFO:tasks.workunit.client.1.smithi194.stdout:4/122: symlink d2/d16/d1a/l27 0 2024-04-13T10:58:33.942 INFO:tasks.workunit.client.1.smithi194.stdout:4/123: read d2/d16/f18 [134317,85879] 0 2024-04-13T10:58:33.944 INFO:tasks.workunit.client.1.smithi194.stdout:8/101: sync 2024-04-13T10:58:33.947 INFO:tasks.workunit.client.1.smithi194.stdout:8/102: creat d6/d22/f26 x:0 0 0 2024-04-13T10:58:33.948 INFO:tasks.workunit.client.1.smithi194.stdout:5/48: dwrite d3/f9 [0,4194304] 0 2024-04-13T10:58:33.950 INFO:tasks.workunit.client.1.smithi194.stdout:4/124: dwrite d2/d16/d1a/d1d/f20 [0,4194304] 0 2024-04-13T10:58:33.952 INFO:tasks.workunit.client.1.smithi194.stdout:5/49: mknod d3/ca 0 2024-04-13T10:58:33.953 INFO:tasks.workunit.client.1.smithi194.stdout:4/125: rmdir d2/d11 39 2024-04-13T10:58:33.954 INFO:tasks.workunit.client.1.smithi194.stdout:8/103: dread f5 [0,4194304] 0 2024-04-13T10:58:33.954 INFO:tasks.workunit.client.1.smithi194.stdout:5/50: symlink d3/lb 0 2024-04-13T10:58:33.954 INFO:tasks.workunit.client.1.smithi194.stdout:4/126: dread d2/fb [0,4194304] 0 2024-04-13T10:58:33.957 INFO:tasks.workunit.client.1.smithi194.stdout:4/127: dread d2/d16/d1a/d1d/f26 [0,4194304] 0 2024-04-13T10:58:33.958 INFO:tasks.workunit.client.1.smithi194.stdout:4/128: dread - d2/fd zero size 2024-04-13T10:58:33.959 INFO:tasks.workunit.client.1.smithi194.stdout:8/104: dread d6/dd/f19 [0,4194304] 0 2024-04-13T10:58:33.960 INFO:tasks.workunit.client.1.smithi194.stdout:4/129: write d2/ff [3093461,3578] 0 2024-04-13T10:58:33.960 INFO:tasks.workunit.client.1.smithi194.stdout:8/105: fdatasync d6/f11 0 2024-04-13T10:58:33.961 INFO:tasks.workunit.client.1.smithi194.stdout:8/106: readlink d6/d22/l24 0 2024-04-13T10:58:33.968 INFO:tasks.workunit.client.1.smithi194.stdout:4/130: unlink d2/d16/d1a/d1d/f20 0 2024-04-13T10:58:33.972 INFO:tasks.workunit.client.1.smithi194.stdout:4/131: mknod d2/d16/d1a/d1d/c28 0 2024-04-13T10:58:33.973 INFO:tasks.workunit.client.1.smithi194.stdout:8/107: truncate f5 4784079 0 2024-04-13T10:58:33.975 INFO:tasks.workunit.client.1.smithi194.stdout:4/132: mknod d2/c29 0 2024-04-13T10:58:33.976 INFO:tasks.workunit.client.1.smithi194.stdout:8/108: truncate f2 345864 0 2024-04-13T10:58:33.978 INFO:tasks.workunit.client.1.smithi194.stdout:4/133: fsync d2/f13 0 2024-04-13T10:58:33.982 INFO:tasks.workunit.client.1.smithi194.stdout:8/109: dwrite d6/f21 [0,4194304] 0 2024-04-13T10:58:33.984 INFO:tasks.workunit.client.1.smithi194.stdout:6/77: truncate d0/f7 1145853 0 2024-04-13T10:58:33.988 INFO:tasks.workunit.client.1.smithi194.stdout:6/78: rename d0/fa to d0/f12 0 2024-04-13T10:58:33.988 INFO:tasks.workunit.client.1.smithi194.stdout:6/79: rename d0 to d0/db/d13 22 2024-04-13T10:58:33.989 INFO:tasks.workunit.client.1.smithi194.stdout:8/110: link d6/f1d d6/d22/d23/d25/f27 0 2024-04-13T10:58:33.992 INFO:tasks.workunit.client.1.smithi194.stdout:8/111: chown d6/c15 3533569 1 2024-04-13T10:58:33.992 INFO:tasks.workunit.client.1.smithi194.stdout:0/92: sync 2024-04-13T10:58:33.993 INFO:tasks.workunit.client.1.smithi194.stdout:6/80: chown d0/f7 3 1 2024-04-13T10:58:33.993 INFO:tasks.workunit.client.1.smithi194.stdout:8/112: write d6/f1c [427132,9280] 0 2024-04-13T10:58:33.994 INFO:tasks.workunit.client.1.smithi194.stdout:0/93: creat d9/df/f23 x:0 0 0 2024-04-13T10:58:33.995 INFO:tasks.workunit.client.1.smithi194.stdout:6/81: creat d0/db/f14 x:0 0 0 2024-04-13T10:58:33.996 INFO:tasks.workunit.client.1.smithi194.stdout:0/94: write f3 [351458,129187] 0 2024-04-13T10:58:33.996 INFO:tasks.workunit.client.1.smithi194.stdout:6/82: readlink d0/l6 0 2024-04-13T10:58:33.996 INFO:tasks.workunit.client.1.smithi194.stdout:6/83: dread - d0/db/f14 zero size 2024-04-13T10:58:33.997 INFO:tasks.workunit.client.1.smithi194.stdout:6/84: chown d0/lf 210514 1 2024-04-13T10:58:33.998 INFO:tasks.workunit.client.1.smithi194.stdout:6/85: dread - d0/f10 zero size 2024-04-13T10:58:33.998 INFO:tasks.workunit.client.1.smithi194.stdout:2/110: getdents d2/d3/d12 0 2024-04-13T10:58:33.999 INFO:tasks.workunit.client.1.smithi194.stdout:1/88: write d12/d13/f18 [5002274,44813] 0 2024-04-13T10:58:34.000 INFO:tasks.workunit.client.1.smithi194.stdout:6/86: readlink d0/lf 0 2024-04-13T10:58:34.001 INFO:tasks.workunit.client.1.smithi194.stdout:7/107: write d1/fa [2948440,98080] 0 2024-04-13T10:58:34.001 INFO:tasks.workunit.client.1.smithi194.stdout:2/111: readlink d2/d3/de/d17/l1f 0 2024-04-13T10:58:34.002 INFO:tasks.workunit.client.1.smithi194.stdout:1/89: write fb [1120861,64278] 0 2024-04-13T10:58:34.005 INFO:tasks.workunit.client.1.smithi194.stdout:7/108: rmdir d1/d13 39 2024-04-13T10:58:34.006 INFO:tasks.workunit.client.1.smithi194.stdout:2/112: creat d2/d3/f2d x:0 0 0 2024-04-13T10:58:34.006 INFO:tasks.workunit.client.1.smithi194.stdout:1/90: read - d12/f1a zero size 2024-04-13T10:58:34.006 INFO:tasks.workunit.client.1.smithi194.stdout:0/95: dwrite d9/df/f1f [0,4194304] 0 2024-04-13T10:58:34.007 INFO:tasks.workunit.client.1.smithi194.stdout:3/103: rmdir d2 39 2024-04-13T10:58:34.009 INFO:tasks.workunit.client.1.smithi194.stdout:9/57: write d0/f3 [322119,86616] 0 2024-04-13T10:58:34.009 INFO:tasks.workunit.client.1.smithi194.stdout:7/109: read d1/fa [1548838,96663] 0 2024-04-13T10:58:34.014 INFO:tasks.workunit.client.1.smithi194.stdout:3/104: readlink d2/l7 0 2024-04-13T10:58:34.015 INFO:tasks.workunit.client.1.smithi194.stdout:9/58: fdatasync d0/d6/d9/fc 0 2024-04-13T10:58:34.016 INFO:tasks.workunit.client.1.smithi194.stdout:6/87: dwrite d0/db/fc [0,4194304] 0 2024-04-13T10:58:34.017 INFO:tasks.workunit.client.1.smithi194.stdout:0/96: creat d9/df/f24 x:0 0 0 2024-04-13T10:58:34.017 INFO:tasks.workunit.client.1.smithi194.stdout:4/134: write d2/d16/d1a/d1d/f26 [1127666,103452] 0 2024-04-13T10:58:34.021 INFO:tasks.workunit.client.1.smithi194.stdout:5/51: write d3/f4 [919757,119375] 0 2024-04-13T10:58:34.021 INFO:tasks.workunit.client.1.smithi194.stdout:6/88: read d0/f8 [3347061,42714] 0 2024-04-13T10:58:34.024 INFO:tasks.workunit.client.1.smithi194.stdout:9/59: write d0/d6/f8 [1443876,41018] 0 2024-04-13T10:58:34.025 INFO:tasks.workunit.client.1.smithi194.stdout:0/97: chown d9/db/f15 26193405 1 2024-04-13T10:58:34.025 INFO:tasks.workunit.client.1.smithi194.stdout:5/52: stat d3/c8 0 2024-04-13T10:58:34.027 INFO:tasks.workunit.client.1.smithi194.stdout:7/110: dread d1/fa [0,4194304] 0 2024-04-13T10:58:34.027 INFO:tasks.workunit.client.1.smithi194.stdout:1/91: dread f5 [0,4194304] 0 2024-04-13T10:58:34.029 INFO:tasks.workunit.client.1.smithi194.stdout:0/98: chown d9/f22 3352 1 2024-04-13T10:58:34.031 INFO:tasks.workunit.client.1.smithi194.stdout:6/89: truncate d0/db/f14 550657 0 2024-04-13T10:58:34.034 INFO:tasks.workunit.client.1.smithi194.stdout:3/105: dwrite d2/f11 [0,4194304] 0 2024-04-13T10:58:34.037 INFO:tasks.workunit.client.1.smithi194.stdout:6/90: write d0/f10 [951186,126764] 0 2024-04-13T10:58:34.040 INFO:tasks.workunit.client.1.smithi194.stdout:3/106: write d2/fd [4246338,79882] 0 2024-04-13T10:58:34.040 INFO:tasks.workunit.client.1.smithi194.stdout:4/135: dwrite d2/ff [0,4194304] 0 2024-04-13T10:58:34.043 INFO:tasks.workunit.client.1.smithi194.stdout:9/60: rename d0/d6/d9/c10 to d0/c12 0 2024-04-13T10:58:34.043 INFO:tasks.workunit.client.1.smithi194.stdout:6/91: chown d0/ce 5 1 2024-04-13T10:58:34.048 INFO:tasks.workunit.client.1.smithi194.stdout:7/111: dread d1/f8 [0,4194304] 0 2024-04-13T10:58:34.048 INFO:tasks.workunit.client.1.smithi194.stdout:6/92: write d0/f10 [164078,55243] 0 2024-04-13T10:58:34.051 INFO:tasks.workunit.client.1.smithi194.stdout:1/92: rename l3 to d12/d13/l1b 0 2024-04-13T10:58:34.052 INFO:tasks.workunit.client.1.smithi194.stdout:9/61: truncate d0/f4 3616046 0 2024-04-13T10:58:34.052 INFO:tasks.workunit.client.1.smithi194.stdout:0/99: rename d9/db to d9/db/d19/d25 22 2024-04-13T10:58:34.053 INFO:tasks.workunit.client.1.smithi194.stdout:4/136: unlink d2/d16/d1a/d1d/c28 0 2024-04-13T10:58:34.054 INFO:tasks.workunit.client.1.smithi194.stdout:2/113: dwrite d2/d3/de/f16 [0,4194304] 0 2024-04-13T10:58:34.054 INFO:tasks.workunit.client.1.smithi194.stdout:6/93: truncate d0/f8 2143678 0 2024-04-13T10:58:34.054 INFO:tasks.workunit.client.1.smithi194.stdout:7/112: write d1/fa [3011499,110871] 0 2024-04-13T10:58:34.056 INFO:tasks.workunit.client.1.smithi194.stdout:5/53: truncate d3/f9 3323211 0 2024-04-13T10:58:34.058 INFO:tasks.workunit.client.1.smithi194.stdout:4/137: read - d2/d16/d1a/f22 zero size 2024-04-13T10:58:34.058 INFO:tasks.workunit.client.1.smithi194.stdout:0/100: mknod d9/c26 0 2024-04-13T10:58:34.063 INFO:tasks.workunit.client.1.smithi194.stdout:0/101: fdatasync d9/df/d11/f17 0 2024-04-13T10:58:34.064 INFO:tasks.workunit.client.1.smithi194.stdout:5/54: dread d3/f4 [0,4194304] 0 2024-04-13T10:58:34.065 INFO:tasks.workunit.client.1.smithi194.stdout:4/138: fsync d2/d16/f18 0 2024-04-13T10:58:34.066 INFO:tasks.workunit.client.1.smithi194.stdout:6/94: dread d0/f10 [0,4194304] 0 2024-04-13T10:58:34.066 INFO:tasks.workunit.client.1.smithi194.stdout:2/114: dread d2/fd [0,4194304] 0 2024-04-13T10:58:34.068 INFO:tasks.workunit.client.1.smithi194.stdout:7/113: creat d1/d13/f28 x:0 0 0 2024-04-13T10:58:34.069 INFO:tasks.workunit.client.1.smithi194.stdout:4/139: write d2/fb [1818812,64177] 0 2024-04-13T10:58:34.069 INFO:tasks.workunit.client.1.smithi194.stdout:1/93: rmdir d12/d13 39 2024-04-13T10:58:34.073 INFO:tasks.workunit.client.1.smithi194.stdout:8/113: dread d6/f1c [0,4194304] 0 2024-04-13T10:58:34.074 INFO:tasks.workunit.client.1.smithi194.stdout:3/107: dwrite d2/f9 [0,4194304] 0 2024-04-13T10:58:34.077 INFO:tasks.workunit.client.1.smithi194.stdout:5/55: readlink l1 0 2024-04-13T10:58:34.085 INFO:tasks.workunit.client.1.smithi194.stdout:7/114: rmdir d1/d13 39 2024-04-13T10:58:34.086 INFO:tasks.workunit.client.1.smithi194.stdout:7/115: readlink d1/l10 0 2024-04-13T10:58:34.086 INFO:tasks.workunit.client.1.smithi194.stdout:8/114: symlink d6/d22/d23/l28 0 2024-04-13T10:58:34.087 INFO:tasks.workunit.client.1.smithi194.stdout:5/56: mkdir d3/dc 0 2024-04-13T10:58:34.088 INFO:tasks.workunit.client.1.smithi194.stdout:3/108: dwrite d2/f17 [0,4194304] 0 2024-04-13T10:58:34.095 INFO:tasks.workunit.client.1.smithi194.stdout:1/94: write f0 [3172358,29166] 0 2024-04-13T10:58:34.096 INFO:tasks.workunit.client.1.smithi194.stdout:7/116: write d1/d13/f20 [733815,90443] 0 2024-04-13T10:58:34.096 INFO:tasks.workunit.client.1.smithi194.stdout:5/57: mknod d3/cd 0 2024-04-13T10:58:34.097 INFO:tasks.workunit.client.1.smithi194.stdout:3/109: read d2/f5 [256056,23592] 0 2024-04-13T10:58:34.098 INFO:tasks.workunit.client.1.smithi194.stdout:3/110: write d2/f11 [4255916,67684] 0 2024-04-13T10:58:34.099 INFO:tasks.workunit.client.1.smithi194.stdout:9/62: rename d0/f4 to d0/d6/f13 0 2024-04-13T10:58:34.099 INFO:tasks.workunit.client.1.smithi194.stdout:3/111: rename d2 to d2/d3/d12/d1d 22 2024-04-13T10:58:34.100 INFO:tasks.workunit.client.1.smithi194.stdout:7/117: dread d1/f8 [0,4194304] 0 2024-04-13T10:58:34.103 INFO:tasks.workunit.client.1.smithi194.stdout:2/115: getdents d2 0 2024-04-13T10:58:34.106 INFO:tasks.workunit.client.1.smithi194.stdout:1/95: mkdir d12/d13/d1c 0 2024-04-13T10:58:34.107 INFO:tasks.workunit.client.1.smithi194.stdout:6/95: truncate d0/db/fc 3838416 0 2024-04-13T10:58:34.109 INFO:tasks.workunit.client.1.smithi194.stdout:4/140: truncate d2/f19 207983 0 2024-04-13T10:58:34.109 INFO:tasks.workunit.client.1.smithi194.stdout:7/118: dwrite d1/d13/f1c [4194304,4194304] 0 2024-04-13T10:58:34.111 INFO:tasks.workunit.client.1.smithi194.stdout:8/115: getdents d6/d22/d23/d25 0 2024-04-13T10:58:34.113 INFO:tasks.workunit.client.1.smithi194.stdout:9/63: mkdir d0/d6/d14 0 2024-04-13T10:58:34.115 INFO:tasks.workunit.client.1.smithi194.stdout:5/58: link d3/lb d3/le 0 2024-04-13T10:58:34.117 INFO:tasks.workunit.client.1.smithi194.stdout:1/96: dwrite f0 [4194304,4194304] 0 2024-04-13T10:58:34.119 INFO:tasks.workunit.client.1.smithi194.stdout:6/96: creat d0/db/f15 x:0 0 0 2024-04-13T10:58:34.119 INFO:tasks.workunit.client.1.smithi194.stdout:8/116: rmdir d6 39 2024-04-13T10:58:34.121 INFO:tasks.workunit.client.1.smithi194.stdout:4/141: dwrite d2/fd [0,4194304] 0 2024-04-13T10:58:34.125 INFO:tasks.workunit.client.1.smithi194.stdout:9/64: readlink d0/lb 0 2024-04-13T10:58:34.128 INFO:tasks.workunit.client.1.smithi194.stdout:5/59: symlink d3/dc/lf 0 2024-04-13T10:58:34.130 INFO:tasks.workunit.client.1.smithi194.stdout:3/112: getdents d2/d3 0 2024-04-13T10:58:34.130 INFO:tasks.workunit.client.1.smithi194.stdout:4/142: dread d2/d16/d1a/d1d/f26 [0,4194304] 0 2024-04-13T10:58:34.131 INFO:tasks.workunit.client.1.smithi194.stdout:1/97: mknod d12/d13/d1c/c1d 0 2024-04-13T10:58:34.134 INFO:tasks.workunit.client.1.smithi194.stdout:1/98: truncate d12/f1a 796156 0 2024-04-13T10:58:34.137 INFO:tasks.workunit.client.1.smithi194.stdout:8/117: dwrite d6/f21 [0,4194304] 0 2024-04-13T10:58:34.137 INFO:tasks.workunit.client.1.smithi194.stdout:7/119: creat d1/f29 x:0 0 0 2024-04-13T10:58:34.141 INFO:tasks.workunit.client.1.smithi194.stdout:5/60: mkdir d3/dc/d10 0 2024-04-13T10:58:34.141 INFO:tasks.workunit.client.1.smithi194.stdout:3/113: dread d2/d3/d12/f16 [0,4194304] 0 2024-04-13T10:58:34.141 INFO:tasks.workunit.client.1.smithi194.stdout:4/143: symlink d2/d16/d1a/d1d/l2a 0 2024-04-13T10:58:34.141 INFO:tasks.workunit.client.1.smithi194.stdout:2/116: truncate d2/d3/de/d17/d1e/f2c 14431694 0 2024-04-13T10:58:34.144 INFO:tasks.workunit.client.1.smithi194.stdout:9/65: creat d0/d11/f15 x:0 0 0 2024-04-13T10:58:34.146 INFO:tasks.workunit.client.1.smithi194.stdout:1/99: mknod d12/d13/d1c/c1e 0 2024-04-13T10:58:34.151 INFO:tasks.workunit.client.1.smithi194.stdout:5/61: write d3/f9 [546188,63177] 0 2024-04-13T10:58:34.152 INFO:tasks.workunit.client.1.smithi194.stdout:3/114: creat d2/de/f1e x:0 0 0 2024-04-13T10:58:34.154 INFO:tasks.workunit.client.1.smithi194.stdout:4/144: unlink d2/f13 0 2024-04-13T10:58:34.156 INFO:tasks.workunit.client.1.smithi194.stdout:1/100: dwrite d12/f15 [0,4194304] 0 2024-04-13T10:58:34.156 INFO:tasks.workunit.client.1.smithi194.stdout:8/118: dwrite d6/f7 [4194304,4194304] 0 2024-04-13T10:58:34.159 INFO:tasks.workunit.client.1.smithi194.stdout:1/101: truncate f0 8857850 0 2024-04-13T10:58:34.159 INFO:tasks.workunit.client.1.smithi194.stdout:8/119: write d6/f1e [254568,44159] 0 2024-04-13T10:58:34.165 INFO:tasks.workunit.client.1.smithi194.stdout:6/97: getdents d0/db 0 2024-04-13T10:58:34.165 INFO:tasks.workunit.client.1.smithi194.stdout:2/117: getdents d2/d3/d12 0 2024-04-13T10:58:34.167 INFO:tasks.workunit.client.1.smithi194.stdout:9/66: symlink d0/d6/d14/l16 0 2024-04-13T10:58:34.167 INFO:tasks.workunit.client.1.smithi194.stdout:9/67: stat d0 0 2024-04-13T10:58:34.169 INFO:tasks.workunit.client.1.smithi194.stdout:2/118: chown d2/d3/c29 25 1 2024-04-13T10:58:34.170 INFO:tasks.workunit.client.1.smithi194.stdout:3/115: dread d2/d3/d12/f16 [0,4194304] 0 2024-04-13T10:58:34.170 INFO:tasks.workunit.client.1.smithi194.stdout:2/119: fsync d2/fd 0 2024-04-13T10:58:34.171 INFO:tasks.workunit.client.1.smithi194.stdout:9/68: chown d0/d6/d9/fc 15954757 1 2024-04-13T10:58:34.171 INFO:tasks.workunit.client.1.smithi194.stdout:1/102: readlink d12/d13/l1b 0 2024-04-13T10:58:34.172 INFO:tasks.workunit.client.1.smithi194.stdout:5/62: creat d3/dc/d10/f11 x:0 0 0 2024-04-13T10:58:34.173 INFO:tasks.workunit.client.1.smithi194.stdout:7/120: rename d1/c19 to d1/c2a 0 2024-04-13T10:58:34.174 INFO:tasks.workunit.client.1.smithi194.stdout:4/145: rename d2/d16/d1a/d1c/l24 to d2/l2b 0 2024-04-13T10:58:34.175 INFO:tasks.workunit.client.1.smithi194.stdout:1/103: write f6 [1364802,104156] 0 2024-04-13T10:58:34.176 INFO:tasks.workunit.client.1.smithi194.stdout:3/116: mknod d2/d3/c1f 0 2024-04-13T10:58:34.177 INFO:tasks.workunit.client.1.smithi194.stdout:5/63: write d3/f9 [890452,24371] 0 2024-04-13T10:58:34.178 INFO:tasks.workunit.client.1.smithi194.stdout:8/120: dwrite d6/dd/f16 [0,4194304] 0 2024-04-13T10:58:34.178 INFO:tasks.workunit.client.1.smithi194.stdout:0/102: sync 2024-04-13T10:58:34.181 INFO:tasks.workunit.client.1.smithi194.stdout:6/98: truncate d0/f8 2862028 0 2024-04-13T10:58:34.182 INFO:tasks.workunit.client.1.smithi194.stdout:9/69: unlink d0/c12 0 2024-04-13T10:58:34.182 INFO:tasks.workunit.client.1.smithi194.stdout:4/146: dread d2/d16/f18 [0,4194304] 0 2024-04-13T10:58:34.184 INFO:tasks.workunit.client.1.smithi194.stdout:5/64: symlink d3/dc/l12 0 2024-04-13T10:58:34.188 INFO:tasks.workunit.client.1.smithi194.stdout:3/117: symlink d2/d3/d12/l20 0 2024-04-13T10:58:34.188 INFO:tasks.workunit.client.1.smithi194.stdout:6/99: dread d0/f10 [0,4194304] 0 2024-04-13T10:58:34.188 INFO:tasks.workunit.client.1.smithi194.stdout:0/103: creat d9/df/d16/f27 x:0 0 0 2024-04-13T10:58:34.192 INFO:tasks.workunit.client.1.smithi194.stdout:3/118: dread - d2/de/f1e zero size 2024-04-13T10:58:34.193 INFO:tasks.workunit.client.1.smithi194.stdout:2/120: dwrite d2/d3/de/f16 [0,4194304] 0 2024-04-13T10:58:34.197 INFO:tasks.workunit.client.1.smithi194.stdout:7/121: dwrite d1/f3 [4194304,4194304] 0 2024-04-13T10:58:34.198 INFO:tasks.workunit.client.1.smithi194.stdout:4/147: mknod d2/c2c 0 2024-04-13T10:58:34.201 INFO:tasks.workunit.client.1.smithi194.stdout:8/121: rename d6/c12 to d6/d22/c29 0 2024-04-13T10:58:34.201 INFO:tasks.workunit.client.1.smithi194.stdout:9/70: creat d0/f17 x:0 0 0 2024-04-13T10:58:34.204 INFO:tasks.workunit.client.1.smithi194.stdout:4/148: unlink d2/lc 0 2024-04-13T10:58:34.206 INFO:tasks.workunit.client.1.smithi194.stdout:7/122: fdatasync d1/fa 0 2024-04-13T10:58:34.206 INFO:tasks.workunit.client.1.smithi194.stdout:9/71: dread - d0/d6/d9/fc zero size 2024-04-13T10:58:34.210 INFO:tasks.workunit.client.1.smithi194.stdout:0/104: rename d9/df/d11 to d9/db/d19/d28 0 2024-04-13T10:58:34.211 INFO:tasks.workunit.client.1.smithi194.stdout:9/72: readlink d0/lb 0 2024-04-13T10:58:34.212 INFO:tasks.workunit.client.1.smithi194.stdout:5/65: dwrite d3/dc/d10/f11 [0,4194304] 0 2024-04-13T10:58:34.215 INFO:tasks.workunit.client.1.smithi194.stdout:4/149: unlink d2/d16/d1a/d1c/l1e 0 2024-04-13T10:58:34.217 INFO:tasks.workunit.client.1.smithi194.stdout:9/73: write d0/f17 [887524,128848] 0 2024-04-13T10:58:34.217 INFO:tasks.workunit.client.1.smithi194.stdout:0/105: dread - d9/df/f14 zero size 2024-04-13T10:58:34.218 INFO:tasks.workunit.client.1.smithi194.stdout:1/104: truncate d12/f1a 65314 0 2024-04-13T10:58:34.219 INFO:tasks.workunit.client.1.smithi194.stdout:7/123: truncate d1/f24 4239523 0 2024-04-13T10:58:34.219 INFO:tasks.workunit.client.1.smithi194.stdout:2/121: fsync d2/d3/de/f16 0 2024-04-13T10:58:34.222 INFO:tasks.workunit.client.1.smithi194.stdout:3/119: dwrite d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:34.222 INFO:tasks.workunit.client.1.smithi194.stdout:6/100: dwrite d0/f12 [0,4194304] 0 2024-04-13T10:58:34.226 INFO:tasks.workunit.client.1.smithi194.stdout:5/66: symlink d3/dc/l13 0 2024-04-13T10:58:34.227 INFO:tasks.workunit.client.1.smithi194.stdout:8/122: dread d6/dd/f16 [0,4194304] 0 2024-04-13T10:58:34.228 INFO:tasks.workunit.client.1.smithi194.stdout:3/120: dread - d2/de/f1e zero size 2024-04-13T10:58:34.229 INFO:tasks.workunit.client.1.smithi194.stdout:1/105: rename cd to d12/d13/d1c/c1f 0 2024-04-13T10:58:34.231 INFO:tasks.workunit.client.1.smithi194.stdout:6/101: mknod d0/c16 0 2024-04-13T10:58:34.231 INFO:tasks.workunit.client.1.smithi194.stdout:9/74: symlink d0/d6/l18 0 2024-04-13T10:58:34.234 INFO:tasks.workunit.client.1.smithi194.stdout:6/102: chown d0/db 1614274 1 2024-04-13T10:58:34.234 INFO:tasks.workunit.client.1.smithi194.stdout:4/150: unlink d2/d11/l12 0 2024-04-13T10:58:34.234 INFO:tasks.workunit.client.1.smithi194.stdout:5/67: write d3/f9 [3339701,35691] 0 2024-04-13T10:58:34.235 INFO:tasks.workunit.client.1.smithi194.stdout:1/106: write f5 [7993183,21179] 0 2024-04-13T10:58:34.239 INFO:tasks.workunit.client.1.smithi194.stdout:1/107: dread - ff zero size 2024-04-13T10:58:34.240 INFO:tasks.workunit.client.1.smithi194.stdout:2/122: link d2/d3/de/d17/d1e/f27 d2/d3/de/f2e 0 2024-04-13T10:58:34.240 INFO:tasks.workunit.client.1.smithi194.stdout:7/124: dwrite d1/f3 [0,4194304] 0 2024-04-13T10:58:34.241 INFO:tasks.workunit.client.1.smithi194.stdout:6/103: mknod d0/db/c17 0 2024-04-13T10:58:34.243 INFO:tasks.workunit.client.1.smithi194.stdout:5/68: creat d3/dc/d10/f14 x:0 0 0 2024-04-13T10:58:34.244 INFO:tasks.workunit.client.1.smithi194.stdout:0/106: dwrite d9/db/f15 [0,4194304] 0 2024-04-13T10:58:34.246 INFO:tasks.workunit.client.1.smithi194.stdout:6/104: chown d0/db/c17 24 1 2024-04-13T10:58:34.247 INFO:tasks.workunit.client.1.smithi194.stdout:3/121: dread d2/fd [0,4194304] 0 2024-04-13T10:58:34.249 INFO:tasks.workunit.client.1.smithi194.stdout:5/69: mkdir d3/dc/d15 0 2024-04-13T10:58:34.249 INFO:tasks.workunit.client.1.smithi194.stdout:0/107: write d9/df/f1f [3801436,115557] 0 2024-04-13T10:58:34.253 INFO:tasks.workunit.client.1.smithi194.stdout:7/125: mkdir d1/d2b 0 2024-04-13T10:58:34.254 INFO:tasks.workunit.client.1.smithi194.stdout:0/108: chown f3 43482 1 2024-04-13T10:58:34.254 INFO:tasks.workunit.client.1.smithi194.stdout:4/151: dread d2/d16/d1a/d1d/f26 [0,4194304] 0 2024-04-13T10:58:34.255 INFO:tasks.workunit.client.1.smithi194.stdout:6/105: creat d0/f18 x:0 0 0 2024-04-13T10:58:34.256 INFO:tasks.workunit.client.1.smithi194.stdout:1/108: write d12/f1a [403429,71357] 0 2024-04-13T10:58:34.256 INFO:tasks.workunit.client.1.smithi194.stdout:7/126: dread - d1/f29 zero size 2024-04-13T10:58:34.257 INFO:tasks.workunit.client.1.smithi194.stdout:5/70: dread d3/f4 [0,4194304] 0 2024-04-13T10:58:34.257 INFO:tasks.workunit.client.1.smithi194.stdout:9/75: dread d0/d6/f13 [0,4194304] 0 2024-04-13T10:58:34.257 INFO:tasks.workunit.client.1.smithi194.stdout:3/122: mkdir d2/d3/d12/d21 0 2024-04-13T10:58:34.259 INFO:tasks.workunit.client.1.smithi194.stdout:1/109: stat d12 0 2024-04-13T10:58:34.262 INFO:tasks.workunit.client.1.smithi194.stdout:3/123: chown d2/l7 31 1 2024-04-13T10:58:34.263 INFO:tasks.workunit.client.1.smithi194.stdout:2/123: dwrite d2/d3/d12/f1c [0,4194304] 0 2024-04-13T10:58:34.264 INFO:tasks.workunit.client.1.smithi194.stdout:9/76: chown d0/d6/f13 1181072 1 2024-04-13T10:58:34.264 INFO:tasks.workunit.client.1.smithi194.stdout:6/106: dread d0/db/f14 [0,4194304] 0 2024-04-13T10:58:34.265 INFO:tasks.workunit.client.1.smithi194.stdout:7/127: unlink d1/f14 0 2024-04-13T10:58:34.266 INFO:tasks.workunit.client.1.smithi194.stdout:1/110: rmdir d12/d13 39 2024-04-13T10:58:34.267 INFO:tasks.workunit.client.1.smithi194.stdout:7/128: chown d1/c21 7225 1 2024-04-13T10:58:34.269 INFO:tasks.workunit.client.1.smithi194.stdout:3/124: rmdir d2/de 39 2024-04-13T10:58:34.270 INFO:tasks.workunit.client.1.smithi194.stdout:2/124: creat d2/d5/f2f x:0 0 0 2024-04-13T10:58:34.272 INFO:tasks.workunit.client.1.smithi194.stdout:5/71: write d3/f4 [1738848,28667] 0 2024-04-13T10:58:34.274 INFO:tasks.workunit.client.1.smithi194.stdout:4/152: write d2/f4 [519970,44018] 0 2024-04-13T10:58:34.276 INFO:tasks.workunit.client.1.smithi194.stdout:5/72: rename d3/dc/d10 to d3/dc/d10/d16 22 2024-04-13T10:58:34.276 INFO:tasks.workunit.client.1.smithi194.stdout:4/153: readlink d2/l15 0 2024-04-13T10:58:34.277 INFO:tasks.workunit.client.1.smithi194.stdout:3/125: unlink d2/lb 0 2024-04-13T10:58:34.281 INFO:tasks.workunit.client.1.smithi194.stdout:9/77: dread d0/d6/f13 [0,4194304] 0 2024-04-13T10:58:34.282 INFO:tasks.workunit.client.1.smithi194.stdout:7/129: dwrite d1/fa [0,4194304] 0 2024-04-13T10:58:34.282 INFO:tasks.workunit.client.1.smithi194.stdout:6/107: truncate d0/db/f14 132187 0 2024-04-13T10:58:34.282 INFO:tasks.workunit.client.1.smithi194.stdout:4/154: write d2/ff [2272928,19862] 0 2024-04-13T10:58:34.287 INFO:tasks.workunit.client.1.smithi194.stdout:1/111: getdents d12/d13 0 2024-04-13T10:58:34.288 INFO:tasks.workunit.client.1.smithi194.stdout:3/126: creat d2/d3/d12/f22 x:0 0 0 2024-04-13T10:58:34.290 INFO:tasks.workunit.client.1.smithi194.stdout:9/78: unlink d0/f17 0 2024-04-13T10:58:34.292 INFO:tasks.workunit.client.1.smithi194.stdout:2/125: dwrite d2/d3/f2d [0,4194304] 0 2024-04-13T10:58:34.296 INFO:tasks.workunit.client.1.smithi194.stdout:6/108: creat d0/db/f19 x:0 0 0 2024-04-13T10:58:34.298 INFO:tasks.workunit.client.1.smithi194.stdout:0/109: dread d9/fd [0,4194304] 0 2024-04-13T10:58:34.300 INFO:tasks.workunit.client.1.smithi194.stdout:5/73: dwrite d3/dc/d10/f11 [0,4194304] 0 2024-04-13T10:58:34.300 INFO:tasks.workunit.client.1.smithi194.stdout:4/155: rename d2/d16/l25 to d2/d11/l2d 0 2024-04-13T10:58:34.301 INFO:tasks.workunit.client.1.smithi194.stdout:7/130: mkdir d1/d2b/d2c 0 2024-04-13T10:58:34.303 INFO:tasks.workunit.client.1.smithi194.stdout:9/79: mknod d0/d11/c19 0 2024-04-13T10:58:34.306 INFO:tasks.workunit.client.1.smithi194.stdout:6/109: creat d0/f1a x:0 0 0 2024-04-13T10:58:34.309 INFO:tasks.workunit.client.1.smithi194.stdout:0/110: creat d9/db/d19/d28/f29 x:0 0 0 2024-04-13T10:58:34.309 INFO:tasks.workunit.client.1.smithi194.stdout:7/131: write d1/f29 [843658,71012] 0 2024-04-13T10:58:34.311 INFO:tasks.workunit.client.1.smithi194.stdout:1/112: dwrite ff [0,4194304] 0 2024-04-13T10:58:34.311 INFO:tasks.workunit.client.1.smithi194.stdout:6/110: rmdir d0/db 39 2024-04-13T10:58:34.312 INFO:tasks.workunit.client.1.smithi194.stdout:3/127: dwrite d2/f17 [0,4194304] 0 2024-04-13T10:58:34.316 INFO:tasks.workunit.client.1.smithi194.stdout:2/126: dwrite d2/d5/f1d [0,4194304] 0 2024-04-13T10:58:34.318 INFO:tasks.workunit.client.1.smithi194.stdout:5/74: rmdir d3/dc/d15 0 2024-04-13T10:58:34.318 INFO:tasks.workunit.client.1.smithi194.stdout:3/128: chown d2/d3/d12/d21 1533946631 1 2024-04-13T10:58:34.318 INFO:tasks.workunit.client.1.smithi194.stdout:1/113: fdatasync d12/d13/f18 0 2024-04-13T10:58:34.320 INFO:tasks.workunit.client.1.smithi194.stdout:5/75: write d3/dc/d10/f11 [2214309,124441] 0 2024-04-13T10:58:34.321 INFO:tasks.workunit.client.1.smithi194.stdout:0/111: fdatasync d9/db/d19/d28/f1e 0 2024-04-13T10:58:34.322 INFO:tasks.workunit.client.1.smithi194.stdout:7/132: truncate d1/f1d 560047 0 2024-04-13T10:58:34.323 INFO:tasks.workunit.client.1.smithi194.stdout:7/133: readlink d1/l22 0 2024-04-13T10:58:34.323 INFO:tasks.workunit.client.1.smithi194.stdout:0/112: write d9/df/f14 [678341,90778] 0 2024-04-13T10:58:34.324 INFO:tasks.workunit.client.1.smithi194.stdout:6/111: symlink d0/l1b 0 2024-04-13T10:58:34.326 INFO:tasks.workunit.client.1.smithi194.stdout:9/80: getdents d0/d6/d14 0 2024-04-13T10:58:34.326 INFO:tasks.workunit.client.1.smithi194.stdout:1/114: read f6 [3351625,126958] 0 2024-04-13T10:58:34.326 INFO:tasks.workunit.client.1.smithi194.stdout:5/76: mkdir d3/dc/d17 0 2024-04-13T10:58:34.327 INFO:tasks.workunit.client.1.smithi194.stdout:2/127: rename d2/d3/de/d17/l1f to d2/d3/de/d17/d1e/l30 0 2024-04-13T10:58:34.327 INFO:tasks.workunit.client.1.smithi194.stdout:9/81: readlink d0/lb 0 2024-04-13T10:58:34.327 INFO:tasks.workunit.client.1.smithi194.stdout:0/113: write d9/db/d19/d28/f18 [2954836,143] 0 2024-04-13T10:58:34.328 INFO:tasks.workunit.client.1.smithi194.stdout:7/134: mknod d1/d13/c2d 0 2024-04-13T10:58:34.328 INFO:tasks.workunit.client.1.smithi194.stdout:5/77: write d3/f9 [1640895,23091] 0 2024-04-13T10:58:34.328 INFO:tasks.workunit.client.1.smithi194.stdout:1/115: truncate ff 4974293 0 2024-04-13T10:58:34.329 INFO:tasks.workunit.client.1.smithi194.stdout:3/129: creat d2/de/f23 x:0 0 0 2024-04-13T10:58:34.330 INFO:tasks.workunit.client.1.smithi194.stdout:0/114: chown d9/df/d16/f27 435076777 1 2024-04-13T10:58:34.330 INFO:tasks.workunit.client.1.smithi194.stdout:1/116: write d12/f15 [57417,4454] 0 2024-04-13T10:58:34.331 INFO:tasks.workunit.client.1.smithi194.stdout:5/78: write d3/dc/d10/f11 [4893699,120806] 0 2024-04-13T10:58:34.332 INFO:tasks.workunit.client.1.smithi194.stdout:2/128: creat d2/d5/f31 x:0 0 0 2024-04-13T10:58:34.332 INFO:tasks.workunit.client.1.smithi194.stdout:0/115: readlink d9/db/d19/l21 0 2024-04-13T10:58:34.332 INFO:tasks.workunit.client.1.smithi194.stdout:9/82: creat d0/d6/d14/f1a x:0 0 0 2024-04-13T10:58:34.333 INFO:tasks.workunit.client.1.smithi194.stdout:5/79: stat d3/dc/d10 0 2024-04-13T10:58:34.334 INFO:tasks.workunit.client.1.smithi194.stdout:6/112: symlink d0/l1c 0 2024-04-13T10:58:34.334 INFO:tasks.workunit.client.1.smithi194.stdout:9/83: dread - d0/d11/f15 zero size 2024-04-13T10:58:34.334 INFO:tasks.workunit.client.1.smithi194.stdout:0/116: dread - d9/df/f23 zero size 2024-04-13T10:58:34.335 INFO:tasks.workunit.client.1.smithi194.stdout:2/129: write d2/d5/f1d [1076840,51514] 0 2024-04-13T10:58:34.337 INFO:tasks.workunit.client.1.smithi194.stdout:0/117: write f5 [4667135,21331] 0 2024-04-13T10:58:34.338 INFO:tasks.workunit.client.1.smithi194.stdout:5/80: creat d3/dc/f18 x:0 0 0 2024-04-13T10:58:34.338 INFO:tasks.workunit.client.1.smithi194.stdout:2/130: write d2/d3/d12/f1b [896971,42352] 0 2024-04-13T10:58:34.340 INFO:tasks.workunit.client.1.smithi194.stdout:1/117: dread f0 [4194304,4194304] 0 2024-04-13T10:58:34.340 INFO:tasks.workunit.client.1.smithi194.stdout:9/84: dread d0/d6/f8 [0,4194304] 0 2024-04-13T10:58:34.342 INFO:tasks.workunit.client.1.smithi194.stdout:0/118: creat d9/db/f2a x:0 0 0 2024-04-13T10:58:34.344 INFO:tasks.workunit.client.1.smithi194.stdout:7/135: fsync d1/f29 0 2024-04-13T10:58:34.345 INFO:tasks.workunit.client.1.smithi194.stdout:2/131: fsync d2/d3/de/f2e 0 2024-04-13T10:58:34.345 INFO:tasks.workunit.client.1.smithi194.stdout:9/85: dread d0/d6/f8 [0,4194304] 0 2024-04-13T10:58:34.347 INFO:tasks.workunit.client.1.smithi194.stdout:5/81: dread d3/f9 [0,4194304] 0 2024-04-13T10:58:34.348 INFO:tasks.workunit.client.1.smithi194.stdout:1/118: mkdir d12/d20 0 2024-04-13T10:58:34.351 INFO:tasks.workunit.client.1.smithi194.stdout:9/86: readlink d0/d6/d14/l16 0 2024-04-13T10:58:34.352 INFO:tasks.workunit.client.1.smithi194.stdout:2/132: creat d2/d3/de/f32 x:0 0 0 2024-04-13T10:58:34.352 INFO:tasks.workunit.client.1.smithi194.stdout:7/136: write d1/d13/f1f [820510,26969] 0 2024-04-13T10:58:34.353 INFO:tasks.workunit.client.1.smithi194.stdout:1/119: creat d12/d13/d1c/f21 x:0 0 0 2024-04-13T10:58:34.356 INFO:tasks.workunit.client.1.smithi194.stdout:9/87: mknod d0/c1b 0 2024-04-13T10:58:34.357 INFO:tasks.workunit.client.1.smithi194.stdout:1/120: write f6 [3549046,52202] 0 2024-04-13T10:58:34.358 INFO:tasks.workunit.client.1.smithi194.stdout:9/88: stat d0/d11 0 2024-04-13T10:58:34.359 INFO:tasks.workunit.client.1.smithi194.stdout:7/137: unlink d1/f5 0 2024-04-13T10:58:34.360 INFO:tasks.workunit.client.1.smithi194.stdout:1/121: readlink d12/d13/l16 0 2024-04-13T10:58:34.360 INFO:tasks.workunit.client.1.smithi194.stdout:0/119: dwrite d9/f22 [0,4194304] 0 2024-04-13T10:58:34.362 INFO:tasks.workunit.client.1.smithi194.stdout:7/138: dread - d1/d13/f28 zero size 2024-04-13T10:58:34.364 INFO:tasks.workunit.client.1.smithi194.stdout:7/139: chown d1/f16 17622894 1 2024-04-13T10:58:34.364 INFO:tasks.workunit.client.1.smithi194.stdout:5/82: dwrite d3/dc/d10/f11 [4194304,4194304] 0 2024-04-13T10:58:34.368 INFO:tasks.workunit.client.1.smithi194.stdout:5/83: chown d3/dc/lf 1539412 1 2024-04-13T10:58:34.370 INFO:tasks.workunit.client.1.smithi194.stdout:3/130: write d2/f5 [514344,45465] 0 2024-04-13T10:58:34.374 INFO:tasks.workunit.client.1.smithi194.stdout:1/122: creat d12/f22 x:0 0 0 2024-04-13T10:58:34.375 INFO:tasks.workunit.client.1.smithi194.stdout:9/89: dwrite d0/d6/d14/f1a [0,4194304] 0 2024-04-13T10:58:34.376 INFO:tasks.workunit.client.1.smithi194.stdout:3/131: chown d2/d3/d12/f18 4027376 1 2024-04-13T10:58:34.380 INFO:tasks.workunit.client.1.smithi194.stdout:3/132: dread - d2/de/f23 zero size 2024-04-13T10:58:34.380 INFO:tasks.workunit.client.1.smithi194.stdout:0/120: dwrite f3 [0,4194304] 0 2024-04-13T10:58:34.383 INFO:tasks.workunit.client.1.smithi194.stdout:7/140: creat d1/f2e x:0 0 0 2024-04-13T10:58:34.384 INFO:tasks.workunit.client.1.smithi194.stdout:2/133: truncate d2/d3/de/f1a 381333 0 2024-04-13T10:58:34.387 INFO:tasks.workunit.client.1.smithi194.stdout:9/90: rename d0/d11/c19 to d0/d6/d9/c1c 0 2024-04-13T10:58:34.390 INFO:tasks.workunit.client.1.smithi194.stdout:6/113: dwrite d0/db/fc [0,4194304] 0 2024-04-13T10:58:34.390 INFO:tasks.workunit.client.1.smithi194.stdout:1/123: mknod d12/c23 0 2024-04-13T10:58:34.395 INFO:tasks.workunit.client.1.smithi194.stdout:1/124: write ff [1525043,79204] 0 2024-04-13T10:58:34.396 INFO:tasks.workunit.client.1.smithi194.stdout:5/84: dread d3/dc/d10/f11 [4194304,4194304] 0 2024-04-13T10:58:34.398 INFO:tasks.workunit.client.1.smithi194.stdout:1/125: readlink d12/l14 0 2024-04-13T10:58:34.400 INFO:tasks.workunit.client.1.smithi194.stdout:3/133: dread d2/d3/d12/f16 [0,4194304] 0 2024-04-13T10:58:34.400 INFO:tasks.workunit.client.1.smithi194.stdout:7/141: dread d1/fa [0,4194304] 0 2024-04-13T10:58:34.401 INFO:tasks.workunit.client.1.smithi194.stdout:1/126: chown d12/d13/l16 94 1 2024-04-13T10:58:34.403 INFO:tasks.workunit.client.1.smithi194.stdout:7/142: write d1/fe [2593367,43922] 0 2024-04-13T10:58:34.405 INFO:tasks.workunit.client.1.smithi194.stdout:2/134: dwrite d2/d3/d12/f1c [0,4194304] 0 2024-04-13T10:58:34.405 INFO:tasks.workunit.client.1.smithi194.stdout:1/127: readlink d12/d13/l1b 0 2024-04-13T10:58:34.408 INFO:tasks.workunit.client.1.smithi194.stdout:6/114: mknod d0/db/c1d 0 2024-04-13T10:58:34.408 INFO:tasks.workunit.client.1.smithi194.stdout:7/143: write d1/f3 [859244,35323] 0 2024-04-13T10:58:34.410 INFO:tasks.workunit.client.1.smithi194.stdout:2/135: mkdir d2/d3/de/d33 0 2024-04-13T10:58:34.412 INFO:tasks.workunit.client.1.smithi194.stdout:7/144: fsync d1/f16 0 2024-04-13T10:58:34.412 INFO:tasks.workunit.client.1.smithi194.stdout:3/134: mkdir d2/d3/d1a/d24 0 2024-04-13T10:58:34.415 INFO:tasks.workunit.client.1.smithi194.stdout:2/136: truncate d2/d3/de/f32 255883 0 2024-04-13T10:58:34.415 INFO:tasks.workunit.client.1.smithi194.stdout:1/128: rmdir d12/d20 0 2024-04-13T10:58:34.416 INFO:tasks.workunit.client.1.smithi194.stdout:1/129: fdatasync f6 0 2024-04-13T10:58:34.416 INFO:tasks.workunit.client.1.smithi194.stdout:2/137: stat d2/d5/f31 0 2024-04-13T10:58:34.417 INFO:tasks.workunit.client.1.smithi194.stdout:5/85: dwrite d3/f9 [0,4194304] 0 2024-04-13T10:58:34.418 INFO:tasks.workunit.client.1.smithi194.stdout:8/123: sync 2024-04-13T10:58:34.420 INFO:tasks.workunit.client.1.smithi194.stdout:9/91: getdents d0/d6/d14 0 2024-04-13T10:58:34.424 INFO:tasks.workunit.client.1.smithi194.stdout:7/145: mknod d1/c2f 0 2024-04-13T10:58:34.425 INFO:tasks.workunit.client.1.smithi194.stdout:1/130: dread f1 [0,4194304] 0 2024-04-13T10:58:34.426 INFO:tasks.workunit.client.1.smithi194.stdout:5/86: write d3/dc/d10/f11 [6071684,20794] 0 2024-04-13T10:58:34.427 INFO:tasks.workunit.client.1.smithi194.stdout:1/131: fsync d12/f1a 0 2024-04-13T10:58:34.429 INFO:tasks.workunit.client.1.smithi194.stdout:2/138: dwrite d2/d3/de/f16 [0,4194304] 0 2024-04-13T10:58:34.434 INFO:tasks.workunit.client.1.smithi194.stdout:1/132: dread ff [0,4194304] 0 2024-04-13T10:58:34.435 INFO:tasks.workunit.client.1.smithi194.stdout:3/135: mknod d2/d3/d1a/d24/c25 0 2024-04-13T10:58:34.440 INFO:tasks.workunit.client.1.smithi194.stdout:0/121: dread d9/fa [0,4194304] 0 2024-04-13T10:58:34.440 INFO:tasks.workunit.client.1.smithi194.stdout:2/139: dwrite d2/d5/f1d [0,4194304] 0 2024-04-13T10:58:34.442 INFO:tasks.workunit.client.1.smithi194.stdout:6/115: link d0/l6 d0/l1e 0 2024-04-13T10:58:34.445 INFO:tasks.workunit.client.1.smithi194.stdout:9/92: link d0/f3 d0/d11/f1d 0 2024-04-13T10:58:34.445 INFO:tasks.workunit.client.1.smithi194.stdout:1/133: dwrite ff [0,4194304] 0 2024-04-13T10:58:34.446 INFO:tasks.workunit.client.1.smithi194.stdout:7/146: mkdir d1/d2b/d2c/d30 0 2024-04-13T10:58:34.452 INFO:tasks.workunit.client.1.smithi194.stdout:4/156: sync 2024-04-13T10:58:34.454 INFO:tasks.workunit.client.1.smithi194.stdout:0/122: mkdir d9/d2b 0 2024-04-13T10:58:34.454 INFO:tasks.workunit.client.1.smithi194.stdout:8/124: write f5 [2256604,73775] 0 2024-04-13T10:58:34.456 INFO:tasks.workunit.client.1.smithi194.stdout:2/140: fsync d2/d3/de/d17/d1e/f27 0 2024-04-13T10:58:34.463 INFO:tasks.workunit.client.1.smithi194.stdout:2/141: dwrite d2/f23 [0,4194304] 0 2024-04-13T10:58:34.464 INFO:tasks.workunit.client.1.smithi194.stdout:3/136: mkdir d2/d3/d12/d21/d26 0 2024-04-13T10:58:34.465 INFO:tasks.workunit.client.1.smithi194.stdout:3/137: write d2/f11 [4304998,73997] 0 2024-04-13T10:58:34.466 INFO:tasks.workunit.client.1.smithi194.stdout:4/157: creat d2/d11/f2e x:0 0 0 2024-04-13T10:58:34.471 INFO:tasks.workunit.client.1.smithi194.stdout:8/125: rmdir d6/dd 39 2024-04-13T10:58:34.473 INFO:tasks.workunit.client.1.smithi194.stdout:4/158: truncate d2/d11/f2e 531834 0 2024-04-13T10:58:34.473 INFO:tasks.workunit.client.1.smithi194.stdout:2/142: dread d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:34.474 INFO:tasks.workunit.client.1.smithi194.stdout:2/143: chown d2/d5 390889059 1 2024-04-13T10:58:34.475 INFO:tasks.workunit.client.1.smithi194.stdout:2/144: write d2/d3/de/f24 [73498,65723] 0 2024-04-13T10:58:34.477 INFO:tasks.workunit.client.1.smithi194.stdout:9/93: fsync d0/f3 0 2024-04-13T10:58:34.479 INFO:tasks.workunit.client.1.smithi194.stdout:1/134: mknod d12/c24 0 2024-04-13T10:58:34.480 INFO:tasks.workunit.client.1.smithi194.stdout:2/145: dread d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:34.482 INFO:tasks.workunit.client.1.smithi194.stdout:7/147: creat d1/d2b/d2c/d30/f31 x:0 0 0 2024-04-13T10:58:34.486 INFO:tasks.workunit.client.1.smithi194.stdout:5/87: truncate d3/f9 3609467 0 2024-04-13T10:58:34.495 INFO:tasks.workunit.client.1.smithi194.stdout:4/159: rename d2/fd to d2/d16/d1a/f2f 0 2024-04-13T10:58:34.495 INFO:tasks.workunit.client.1.smithi194.stdout:4/160: readlink d2/la 0 2024-04-13T10:58:34.499 INFO:tasks.workunit.client.1.smithi194.stdout:9/94: mkdir d0/d11/d1e 0 2024-04-13T10:58:34.501 INFO:tasks.workunit.client.1.smithi194.stdout:9/95: chown d0/d6/d9/fc 114491507 1 2024-04-13T10:58:34.501 INFO:tasks.workunit.client.1.smithi194.stdout:4/161: dwrite d2/d11/f2e [0,4194304] 0 2024-04-13T10:58:34.502 INFO:tasks.workunit.client.1.smithi194.stdout:1/135: write f0 [5525730,116287] 0 2024-04-13T10:58:34.504 INFO:tasks.workunit.client.1.smithi194.stdout:7/148: creat d1/d2b/d2c/d30/f32 x:0 0 0 2024-04-13T10:58:34.506 INFO:tasks.workunit.client.1.smithi194.stdout:7/149: chown d1/c9 7100621 1 2024-04-13T10:58:34.507 INFO:tasks.workunit.client.1.smithi194.stdout:9/96: dread d0/d6/f8 [0,4194304] 0 2024-04-13T10:58:34.508 INFO:tasks.workunit.client.1.smithi194.stdout:7/150: write d1/f2e [706723,66011] 0 2024-04-13T10:58:34.509 INFO:tasks.workunit.client.1.smithi194.stdout:8/126: mkdir d6/d2a 0 2024-04-13T10:58:34.510 INFO:tasks.workunit.client.1.smithi194.stdout:7/151: write d1/f16 [237440,94926] 0 2024-04-13T10:58:34.511 INFO:tasks.workunit.client.1.smithi194.stdout:1/136: dwrite f0 [0,4194304] 0 2024-04-13T10:58:34.513 INFO:tasks.workunit.client.1.smithi194.stdout:1/137: read d12/f15 [2958706,125998] 0 2024-04-13T10:58:34.524 INFO:tasks.workunit.client.1.smithi194.stdout:0/123: truncate d9/f22 1880572 0 2024-04-13T10:58:34.533 INFO:tasks.workunit.client.1.smithi194.stdout:5/88: creat d3/dc/d17/f19 x:0 0 0 2024-04-13T10:58:34.545 INFO:tasks.workunit.client.1.smithi194.stdout:1/138: mkdir d12/d13/d25 0 2024-04-13T10:58:34.546 INFO:tasks.workunit.client.1.smithi194.stdout:3/138: sync 2024-04-13T10:58:34.546 INFO:tasks.workunit.client.1.smithi194.stdout:6/116: link d0/f7 d0/f1f 0 2024-04-13T10:58:34.547 INFO:tasks.workunit.client.1.smithi194.stdout:6/117: read - d0/db/f15 zero size 2024-04-13T10:58:34.549 INFO:tasks.workunit.client.1.smithi194.stdout:0/124: rename d9/db/d19/d28/l1c to d9/l2c 0 2024-04-13T10:58:34.550 INFO:tasks.workunit.client.1.smithi194.stdout:2/146: write d2/d3/de/d17/d1e/f2c [10793170,37519] 0 2024-04-13T10:58:34.551 INFO:tasks.workunit.client.1.smithi194.stdout:4/162: mkdir d2/d30 0 2024-04-13T10:58:34.552 INFO:tasks.workunit.client.1.smithi194.stdout:2/147: write d2/d3/f2d [526344,67707] 0 2024-04-13T10:58:34.554 INFO:tasks.workunit.client.1.smithi194.stdout:5/89: creat d3/f1a x:0 0 0 2024-04-13T10:58:34.554 INFO:tasks.workunit.client.1.smithi194.stdout:5/90: write d3/dc/d10/f11 [7356831,14963] 0 2024-04-13T10:58:34.560 INFO:tasks.workunit.client.1.smithi194.stdout:5/91: dwrite d3/f4 [0,4194304] 0 2024-04-13T10:58:34.562 INFO:tasks.workunit.client.1.smithi194.stdout:5/92: write d3/f1a [508724,17121] 0 2024-04-13T10:58:34.562 INFO:tasks.workunit.client.1.smithi194.stdout:5/93: chown d3/dc/d10 7 1 2024-04-13T10:58:34.562 INFO:tasks.workunit.client.1.smithi194.stdout:5/94: chown d3 11 1 2024-04-13T10:58:34.565 INFO:tasks.workunit.client.1.smithi194.stdout:5/95: write d3/f4 [2726073,96728] 0 2024-04-13T10:58:34.568 INFO:tasks.workunit.client.1.smithi194.stdout:0/125: rename f5 to d9/df/f2d 0 2024-04-13T10:58:34.569 INFO:tasks.workunit.client.1.smithi194.stdout:5/96: dread d3/dc/d10/f11 [0,4194304] 0 2024-04-13T10:58:34.572 INFO:tasks.workunit.client.1.smithi194.stdout:4/163: mkdir d2/d16/d1a/d1d/d31 0 2024-04-13T10:58:34.574 INFO:tasks.workunit.client.1.smithi194.stdout:5/97: fdatasync d3/f4 0 2024-04-13T10:58:34.578 INFO:tasks.workunit.client.1.smithi194.stdout:9/97: link d0/d6/l18 d0/d11/d1e/l1f 0 2024-04-13T10:58:34.579 INFO:tasks.workunit.client.1.smithi194.stdout:9/98: write d0/d6/d9/fc [758854,86075] 0 2024-04-13T10:58:34.582 INFO:tasks.workunit.client.1.smithi194.stdout:8/127: truncate d6/f21 98879 0 2024-04-13T10:58:34.587 INFO:tasks.workunit.client.1.smithi194.stdout:6/118: truncate d0/db/f14 33180 0 2024-04-13T10:58:34.590 INFO:tasks.workunit.client.1.smithi194.stdout:0/126: creat d9/db/d19/d28/f2e x:0 0 0 2024-04-13T10:58:34.591 INFO:tasks.workunit.client.1.smithi194.stdout:0/127: fsync d9/db/d19/d28/f18 0 2024-04-13T10:58:34.591 INFO:tasks.workunit.client.1.smithi194.stdout:0/128: fdatasync d9/df/f23 0 2024-04-13T10:58:34.668 INFO:tasks.workunit.client.1.smithi194.stdout:5/98: mkdir d3/dc/d17/d1b 0 2024-04-13T10:58:34.669 INFO:tasks.workunit.client.1.smithi194.stdout:7/152: getdents d1/d2b 0 2024-04-13T10:58:34.670 INFO:tasks.workunit.client.1.smithi194.stdout:1/139: creat d12/f26 x:0 0 0 2024-04-13T10:58:34.673 INFO:tasks.workunit.client.1.smithi194.stdout:7/153: dread d1/f2e [0,4194304] 0 2024-04-13T10:58:34.673 INFO:tasks.workunit.client.1.smithi194.stdout:8/128: symlink d6/d22/d23/l2b 0 2024-04-13T10:58:34.673 INFO:tasks.workunit.client.1.smithi194.stdout:3/139: truncate d2/f17 3179217 0 2024-04-13T10:58:34.675 INFO:tasks.workunit.client.1.smithi194.stdout:3/140: write d2/de/f1e [619969,115525] 0 2024-04-13T10:58:34.677 INFO:tasks.workunit.client.1.smithi194.stdout:6/119: creat d0/db/f20 x:0 0 0 2024-04-13T10:58:34.677 INFO:tasks.workunit.client.1.smithi194.stdout:1/140: dwrite d12/d13/d1c/f21 [0,4194304] 0 2024-04-13T10:58:34.691 INFO:tasks.workunit.client.1.smithi194.stdout:4/164: mknod d2/c32 0 2024-04-13T10:58:34.692 INFO:tasks.workunit.client.1.smithi194.stdout:3/141: dread d2/f9 [0,4194304] 0 2024-04-13T10:58:34.693 INFO:tasks.workunit.client.1.smithi194.stdout:1/141: mkdir d12/d13/d1c/d27 0 2024-04-13T10:58:34.693 INFO:tasks.workunit.client.1.smithi194.stdout:9/99: sync 2024-04-13T10:58:34.695 INFO:tasks.workunit.client.1.smithi194.stdout:0/129: link d9/db/d19/d28/f29 d9/db/d19/d28/f2f 0 2024-04-13T10:58:34.696 INFO:tasks.workunit.client.1.smithi194.stdout:2/148: link d2/d3/c20 d2/c34 0 2024-04-13T10:58:34.698 INFO:tasks.workunit.client.1.smithi194.stdout:2/149: chown d2/d3/de/l21 13158 1 2024-04-13T10:58:34.700 INFO:tasks.workunit.client.1.smithi194.stdout:5/99: dwrite d3/dc/d10/f11 [0,4194304] 0 2024-04-13T10:58:34.702 INFO:tasks.workunit.client.1.smithi194.stdout:1/142: dwrite d12/d13/d1c/f21 [0,4194304] 0 2024-04-13T10:58:34.705 INFO:tasks.workunit.client.1.smithi194.stdout:1/143: fdatasync d12/f22 0 2024-04-13T10:58:34.707 INFO:tasks.workunit.client.1.smithi194.stdout:0/130: mkdir d9/db/d19/d30 0 2024-04-13T10:58:34.715 INFO:tasks.workunit.client.1.smithi194.stdout:4/165: dwrite d2/d16/d1a/f2f [0,4194304] 0 2024-04-13T10:58:34.716 INFO:tasks.workunit.client.1.smithi194.stdout:0/131: dread f1 [4194304,4194304] 0 2024-04-13T10:58:34.717 INFO:tasks.workunit.client.1.smithi194.stdout:1/144: dwrite f10 [0,4194304] 0 2024-04-13T10:58:34.718 INFO:tasks.workunit.client.1.smithi194.stdout:0/132: fsync d9/db/d19/d28/f18 0 2024-04-13T10:58:34.720 INFO:tasks.workunit.client.1.smithi194.stdout:1/145: write d12/d13/d1c/f21 [2684809,13933] 0 2024-04-13T10:58:34.720 INFO:tasks.workunit.client.1.smithi194.stdout:0/133: chown d9/fa 276437814 1 2024-04-13T10:58:34.721 INFO:tasks.workunit.client.1.smithi194.stdout:0/134: readlink d9/db/lc 0 2024-04-13T10:58:34.721 INFO:tasks.workunit.client.1.smithi194.stdout:0/135: chown d9 22879571 1 2024-04-13T10:58:34.723 INFO:tasks.workunit.client.1.smithi194.stdout:9/100: creat d0/f20 x:0 0 0 2024-04-13T10:58:34.724 INFO:tasks.workunit.client.1.smithi194.stdout:9/101: read - d0/f20 zero size 2024-04-13T10:58:34.728 INFO:tasks.workunit.client.1.smithi194.stdout:1/146: dwrite d12/f26 [0,4194304] 0 2024-04-13T10:58:34.730 INFO:tasks.workunit.client.1.smithi194.stdout:5/100: link d3/dc/d10/f14 d3/dc/d17/f1c 0 2024-04-13T10:58:34.732 INFO:tasks.workunit.client.1.smithi194.stdout:5/101: write d3/dc/d17/f19 [312617,78748] 0 2024-04-13T10:58:34.737 INFO:tasks.workunit.client.1.smithi194.stdout:4/166: unlink d2/la 0 2024-04-13T10:58:34.740 INFO:tasks.workunit.client.1.smithi194.stdout:3/142: rename d2/de/f23 to d2/f27 0 2024-04-13T10:58:34.743 INFO:tasks.workunit.client.1.smithi194.stdout:5/102: dwrite d3/dc/d17/f19 [0,4194304] 0 2024-04-13T10:58:34.744 INFO:tasks.workunit.client.1.smithi194.stdout:5/103: read d3/dc/d10/f11 [5850646,53441] 0 2024-04-13T10:58:34.744 INFO:tasks.workunit.client.1.smithi194.stdout:1/147: mkdir d12/d13/d1c/d28 0 2024-04-13T10:58:34.750 INFO:tasks.workunit.client.1.smithi194.stdout:4/167: rmdir d2/d16/d1a/d1d 39 2024-04-13T10:58:34.754 INFO:tasks.workunit.client.1.smithi194.stdout:6/120: dwrite d0/db/f14 [0,4194304] 0 2024-04-13T10:58:34.755 INFO:tasks.workunit.client.1.smithi194.stdout:0/136: rename d9/df/f24 to d9/d2b/f31 0 2024-04-13T10:58:34.758 INFO:tasks.workunit.client.1.smithi194.stdout:9/102: creat d0/d11/d1e/f21 x:0 0 0 2024-04-13T10:58:34.759 INFO:tasks.workunit.client.1.smithi194.stdout:3/143: creat d2/d3/d1a/d24/f28 x:0 0 0 2024-04-13T10:58:34.760 INFO:tasks.workunit.client.1.smithi194.stdout:4/168: dwrite d2/ff [0,4194304] 0 2024-04-13T10:58:34.768 INFO:tasks.workunit.client.1.smithi194.stdout:2/150: write d2/d3/de/f2e [844790,63309] 0 2024-04-13T10:58:34.769 INFO:tasks.workunit.client.1.smithi194.stdout:2/151: fsync d2/d5/f1d 0 2024-04-13T10:58:34.773 INFO:tasks.workunit.client.1.smithi194.stdout:1/148: rename d12/c24 to d12/d13/c29 0 2024-04-13T10:58:34.776 INFO:tasks.workunit.client.1.smithi194.stdout:4/169: rmdir d2/d16/d1a/d1c 39 2024-04-13T10:58:34.782 INFO:tasks.workunit.client.1.smithi194.stdout:4/170: dwrite d2/d16/d1a/f22 [0,4194304] 0 2024-04-13T10:58:34.783 INFO:tasks.workunit.client.1.smithi194.stdout:4/171: fdatasync d2/d16/d1a/f2f 0 2024-04-13T10:58:34.784 INFO:tasks.workunit.client.1.smithi194.stdout:4/172: chown d2/d16/f18 384 1 2024-04-13T10:58:34.786 INFO:tasks.workunit.client.1.smithi194.stdout:4/173: write d2/d16/f18 [77258,91442] 0 2024-04-13T10:58:34.786 INFO:tasks.workunit.client.1.smithi194.stdout:2/152: rename d2/d3/de/d17/d1e/f27 to d2/d3/de/d33/f35 0 2024-04-13T10:58:34.788 INFO:tasks.workunit.client.1.smithi194.stdout:1/149: creat d12/d13/f2a x:0 0 0 2024-04-13T10:58:34.788 INFO:tasks.workunit.client.1.smithi194.stdout:1/150: fdatasync d12/d13/f2a 0 2024-04-13T10:58:34.796 INFO:tasks.workunit.client.1.smithi194.stdout:5/104: link d3/dc/lf d3/dc/d17/d1b/l1d 0 2024-04-13T10:58:34.796 INFO:tasks.workunit.client.1.smithi194.stdout:5/105: chown d3/c8 7 1 2024-04-13T10:58:34.797 INFO:tasks.workunit.client.1.smithi194.stdout:5/106: write d3/dc/d17/f19 [233791,54110] 0 2024-04-13T10:58:34.800 INFO:tasks.workunit.client.1.smithi194.stdout:6/121: creat d0/f21 x:0 0 0 2024-04-13T10:58:34.807 INFO:tasks.workunit.client.1.smithi194.stdout:3/144: truncate d2/d3/d12/f16 1687248 0 2024-04-13T10:58:34.812 INFO:tasks.workunit.client.1.smithi194.stdout:5/107: rename d3/ca to d3/dc/d17/d1b/c1e 0 2024-04-13T10:58:34.815 INFO:tasks.workunit.client.1.smithi194.stdout:6/122: mknod d0/db/c22 0 2024-04-13T10:58:34.821 INFO:tasks.workunit.client.1.smithi194.stdout:6/123: dwrite d0/f1a [0,4194304] 0 2024-04-13T10:58:34.824 INFO:tasks.workunit.client.1.smithi194.stdout:5/108: creat d3/f1f x:0 0 0 2024-04-13T10:58:34.824 INFO:tasks.workunit.client.1.smithi194.stdout:9/103: truncate d0/d6/d9/fc 143707 0 2024-04-13T10:58:34.827 INFO:tasks.workunit.client.1.smithi194.stdout:4/174: rename d2/d11 to d2/d33 0 2024-04-13T10:58:34.834 INFO:tasks.workunit.client.1.smithi194.stdout:8/129: sync 2024-04-13T10:58:34.834 INFO:tasks.workunit.client.1.smithi194.stdout:9/104: rename d0/d6 to d0/d6/d22 22 2024-04-13T10:58:34.835 INFO:tasks.workunit.client.1.smithi194.stdout:9/105: chown d0/d6/d9/ce 28 1 2024-04-13T10:58:34.835 INFO:tasks.workunit.client.1.smithi194.stdout:9/106: chown d0/d11/d1e/f21 14454749 1 2024-04-13T10:58:34.836 INFO:tasks.workunit.client.1.smithi194.stdout:9/107: truncate d0/d11/f15 724625 0 2024-04-13T10:58:34.838 INFO:tasks.workunit.client.1.smithi194.stdout:5/109: truncate d3/f9 2009886 0 2024-04-13T10:58:34.840 INFO:tasks.workunit.client.1.smithi194.stdout:8/130: chown d6/dd/f19 423 1 2024-04-13T10:58:34.843 INFO:tasks.workunit.client.1.smithi194.stdout:4/175: mknod d2/d16/d1a/c34 0 2024-04-13T10:58:34.844 INFO:tasks.workunit.client.1.smithi194.stdout:9/108: unlink d0/cd 0 2024-04-13T10:58:34.846 INFO:tasks.workunit.client.1.smithi194.stdout:6/124: rmdir d0/db 39 2024-04-13T10:58:34.848 INFO:tasks.workunit.client.1.smithi194.stdout:1/151: truncate f5 4595901 0 2024-04-13T10:58:34.855 INFO:tasks.workunit.client.1.smithi194.stdout:8/131: mknod d6/c2c 0 2024-04-13T10:58:34.856 INFO:tasks.workunit.client.1.smithi194.stdout:8/132: readlink d6/l18 0 2024-04-13T10:58:34.856 INFO:tasks.workunit.client.1.smithi194.stdout:4/176: dread d2/f4 [0,4194304] 0 2024-04-13T10:58:34.857 INFO:tasks.workunit.client.1.smithi194.stdout:4/177: write d2/ff [2301993,48647] 0 2024-04-13T10:58:34.862 INFO:tasks.workunit.client.1.smithi194.stdout:3/145: write d2/d3/d12/f16 [1400030,1341] 0 2024-04-13T10:58:34.863 INFO:tasks.workunit.client.1.smithi194.stdout:1/152: symlink d12/d13/d1c/d28/l2b 0 2024-04-13T10:58:34.863 INFO:tasks.workunit.client.1.smithi194.stdout:3/146: chown d2/de/l10 20097 1 2024-04-13T10:58:34.863 INFO:tasks.workunit.client.1.smithi194.stdout:1/153: chown d12/d13/l16 9243 1 2024-04-13T10:58:34.864 INFO:tasks.workunit.client.1.smithi194.stdout:3/147: readlink d2/d3/d12/l20 0 2024-04-13T10:58:34.864 INFO:tasks.workunit.client.1.smithi194.stdout:3/148: read d2/d3/d12/f18 [714378,108505] 0 2024-04-13T10:58:34.865 INFO:tasks.workunit.client.1.smithi194.stdout:3/149: fdatasync d2/f5 0 2024-04-13T10:58:34.865 INFO:tasks.workunit.client.1.smithi194.stdout:3/150: read d2/d3/d12/f16 [756740,56646] 0 2024-04-13T10:58:34.868 INFO:tasks.workunit.client.1.smithi194.stdout:8/133: mknod d6/d2a/c2d 0 2024-04-13T10:58:34.871 INFO:tasks.workunit.client.1.smithi194.stdout:9/109: getdents d0/d11 0 2024-04-13T10:58:34.872 INFO:tasks.workunit.client.1.smithi194.stdout:9/110: fdatasync d0/d11/f15 0 2024-04-13T10:58:34.872 INFO:tasks.workunit.client.1.smithi194.stdout:3/151: symlink d2/d3/d1a/l29 0 2024-04-13T10:58:34.875 INFO:tasks.workunit.client.1.smithi194.stdout:8/134: rename d6/f7 to d6/d22/f2e 0 2024-04-13T10:58:34.877 INFO:tasks.workunit.client.1.smithi194.stdout:3/152: dwrite d2/d3/d1a/d24/f28 [0,4194304] 0 2024-04-13T10:58:34.880 INFO:tasks.workunit.client.1.smithi194.stdout:8/135: read d6/f21 [61486,113328] 0 2024-04-13T10:58:34.881 INFO:tasks.workunit.client.1.smithi194.stdout:8/136: readlink d6/d22/l24 0 2024-04-13T10:58:34.887 INFO:tasks.workunit.client.1.smithi194.stdout:9/111: creat d0/d6/f23 x:0 0 0 2024-04-13T10:58:34.889 INFO:tasks.workunit.client.1.smithi194.stdout:8/137: link d6/c2c d6/d22/d23/d25/c2f 0 2024-04-13T10:58:34.892 INFO:tasks.workunit.client.1.smithi194.stdout:3/153: dwrite d2/fd [4194304,4194304] 0 2024-04-13T10:58:34.892 INFO:tasks.workunit.client.1.smithi194.stdout:8/138: write d6/dd/f16 [864529,124294] 0 2024-04-13T10:58:34.895 INFO:tasks.workunit.client.1.smithi194.stdout:3/154: creat d2/d3/d12/f2a x:0 0 0 2024-04-13T10:58:34.896 INFO:tasks.workunit.client.1.smithi194.stdout:3/155: read d2/fd [1462306,80798] 0 2024-04-13T10:58:34.897 INFO:tasks.workunit.client.1.smithi194.stdout:3/156: dread - d2/f27 zero size 2024-04-13T10:58:34.898 INFO:tasks.workunit.client.1.smithi194.stdout:3/157: write d2/d3/d12/f22 [241932,52126] 0 2024-04-13T10:58:34.901 INFO:tasks.workunit.client.1.smithi194.stdout:8/139: truncate d6/f11 4395641 0 2024-04-13T10:58:34.903 INFO:tasks.workunit.client.1.smithi194.stdout:7/154: sync 2024-04-13T10:58:34.903 INFO:tasks.workunit.client.1.smithi194.stdout:8/140: fdatasync d6/f1d 0 2024-04-13T10:58:34.905 INFO:tasks.workunit.client.1.smithi194.stdout:7/155: mkdir d1/d2b/d2c/d30/d33 0 2024-04-13T10:58:34.907 INFO:tasks.workunit.client.1.smithi194.stdout:8/141: mkdir d6/d22/d23/d25/d30 0 2024-04-13T10:58:34.908 INFO:tasks.workunit.client.1.smithi194.stdout:8/142: fsync d6/dd/f19 0 2024-04-13T10:58:34.914 INFO:tasks.workunit.client.1.smithi194.stdout:5/110: truncate d3/f1a 93512 0 2024-04-13T10:58:34.917 INFO:tasks.workunit.client.1.smithi194.stdout:9/112: dread d0/d6/d9/fc [0,4194304] 0 2024-04-13T10:58:34.919 INFO:tasks.workunit.client.1.smithi194.stdout:1/154: dwrite f5 [4194304,4194304] 0 2024-04-13T10:58:34.919 INFO:tasks.workunit.client.1.smithi194.stdout:9/113: dread d0/d6/d9/fc [0,4194304] 0 2024-04-13T10:58:34.920 INFO:tasks.workunit.client.1.smithi194.stdout:9/114: chown d0/d6/f23 61 1 2024-04-13T10:58:34.920 INFO:tasks.workunit.client.1.smithi194.stdout:1/155: write d12/d13/f2a [785036,79951] 0 2024-04-13T10:58:34.921 INFO:tasks.workunit.client.1.smithi194.stdout:9/115: read - d0/f20 zero size 2024-04-13T10:58:34.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:34 smithi134 ceph-mon[39696]: pgmap v21: 65 pgs: 65 active+clean; 342 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 22 MiB/s wr, 393 op/s 2024-04-13T10:58:34.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:34 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:34.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:34 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:34.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:34 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:58:34.955 INFO:tasks.workunit.client.1.smithi194.stdout:5/111: mkdir d3/dc/d10/d20 0 2024-04-13T10:58:34.957 INFO:tasks.workunit.client.1.smithi194.stdout:9/116: truncate d0/d6/f13 297119 0 2024-04-13T10:58:34.981 INFO:tasks.workunit.client.1.smithi194.stdout:1/156: symlink d12/l2c 0 2024-04-13T10:58:34.985 INFO:tasks.workunit.client.1.smithi194.stdout:2/153: sync 2024-04-13T10:58:34.985 INFO:tasks.workunit.client.1.smithi194.stdout:0/137: sync 2024-04-13T10:58:34.986 INFO:tasks.workunit.client.1.smithi194.stdout:1/157: creat d12/d13/d25/f2d x:0 0 0 2024-04-13T10:58:34.986 INFO:tasks.workunit.client.1.smithi194.stdout:9/117: link d0/d6/d14/l16 d0/d11/l24 0 2024-04-13T10:58:34.988 INFO:tasks.workunit.client.1.smithi194.stdout:2/154: rmdir d2/d3/de/d17 39 2024-04-13T10:58:34.989 INFO:tasks.workunit.client.1.smithi194.stdout:1/158: rmdir d12/d13/d1c 39 2024-04-13T10:58:34.992 INFO:tasks.workunit.client.1.smithi194.stdout:9/118: creat d0/d11/f25 x:0 0 0 2024-04-13T10:58:34.994 INFO:tasks.workunit.client.1.smithi194.stdout:9/119: read - d0/d6/f23 zero size 2024-04-13T10:58:34.994 INFO:tasks.workunit.client.1.smithi194.stdout:2/155: dread d2/d3/de/f2e [0,4194304] 0 2024-04-13T10:58:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:34 smithi194 ceph-mon[46737]: pgmap v21: 65 pgs: 65 active+clean; 342 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 22 MiB/s wr, 393 op/s 2024-04-13T10:58:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:34 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:34 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:58:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:34 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:58:34.998 INFO:tasks.workunit.client.1.smithi194.stdout:9/120: mkdir d0/d6/d14/d26 0 2024-04-13T10:58:34.998 INFO:tasks.workunit.client.1.smithi194.stdout:0/138: link d9/l2c d9/d2b/l32 0 2024-04-13T10:58:34.999 INFO:tasks.workunit.client.1.smithi194.stdout:9/121: dread - d0/f20 zero size 2024-04-13T10:58:35.001 INFO:tasks.workunit.client.1.smithi194.stdout:0/139: creat d9/db/f33 x:0 0 0 2024-04-13T10:58:35.001 INFO:tasks.workunit.client.1.smithi194.stdout:9/122: write d0/d6/f23 [704982,69008] 0 2024-04-13T10:58:35.003 INFO:tasks.workunit.client.1.smithi194.stdout:2/156: dwrite d2/d3/d12/f2b [0,4194304] 0 2024-04-13T10:58:35.004 INFO:tasks.workunit.client.1.smithi194.stdout:2/157: chown d2/d3/de/l21 139933 1 2024-04-13T10:58:35.004 INFO:tasks.workunit.client.1.smithi194.stdout:0/140: symlink d9/df/l34 0 2024-04-13T10:58:35.006 INFO:tasks.workunit.client.1.smithi194.stdout:9/123: creat d0/d6/d14/f27 x:0 0 0 2024-04-13T10:58:35.007 INFO:tasks.workunit.client.1.smithi194.stdout:0/141: symlink d9/df/l35 0 2024-04-13T10:58:35.010 INFO:tasks.workunit.client.1.smithi194.stdout:2/158: dread d2/d3/d12/f2b [0,4194304] 0 2024-04-13T10:58:35.016 INFO:tasks.workunit.client.1.smithi194.stdout:2/159: mkdir d2/d3/de/d17/d36 0 2024-04-13T10:58:35.016 INFO:tasks.workunit.client.1.smithi194.stdout:0/142: dwrite d9/d2b/f31 [0,4194304] 0 2024-04-13T10:58:35.019 INFO:tasks.workunit.client.1.smithi194.stdout:2/160: mkdir d2/d37 0 2024-04-13T10:58:35.020 INFO:tasks.workunit.client.1.smithi194.stdout:0/143: creat d9/db/f36 x:0 0 0 2024-04-13T10:58:35.022 INFO:tasks.workunit.client.1.smithi194.stdout:2/161: rmdir d2/d3/de/d17 39 2024-04-13T10:58:35.023 INFO:tasks.workunit.client.1.smithi194.stdout:6/125: sync 2024-04-13T10:58:35.023 INFO:tasks.workunit.client.1.smithi194.stdout:4/178: sync 2024-04-13T10:58:35.024 INFO:tasks.workunit.client.1.smithi194.stdout:0/144: getdents d9/db/d19/d30 0 2024-04-13T10:58:35.027 INFO:tasks.workunit.client.1.smithi194.stdout:0/145: write d9/db/f2a [366714,27999] 0 2024-04-13T10:58:35.027 INFO:tasks.workunit.client.1.smithi194.stdout:4/179: dread d2/d33/f17 [0,4194304] 0 2024-04-13T10:58:35.028 INFO:tasks.workunit.client.1.smithi194.stdout:0/146: dread - d9/db/f36 zero size 2024-04-13T10:58:35.029 INFO:tasks.workunit.client.1.smithi194.stdout:6/126: rename d0/f10 to d0/db/f23 0 2024-04-13T10:58:35.034 INFO:tasks.workunit.client.1.smithi194.stdout:2/162: getdents d2/d3/de/d17/d1e 0 2024-04-13T10:58:35.035 INFO:tasks.workunit.client.1.smithi194.stdout:5/112: fsync d3/f1a 0 2024-04-13T10:58:35.038 INFO:tasks.workunit.client.1.smithi194.stdout:4/180: creat d2/d16/d1a/f35 x:0 0 0 2024-04-13T10:58:35.040 INFO:tasks.workunit.client.1.smithi194.stdout:9/124: read d0/d6/f13 [276885,105925] 0 2024-04-13T10:58:35.042 INFO:tasks.workunit.client.1.smithi194.stdout:8/143: dwrite d6/d22/d23/d25/f27 [0,4194304] 0 2024-04-13T10:58:35.044 INFO:tasks.workunit.client.1.smithi194.stdout:4/181: stat d2/d16/d1a/l27 0 2024-04-13T10:58:35.044 INFO:tasks.workunit.client.1.smithi194.stdout:6/127: dwrite d0/db/f15 [0,4194304] 0 2024-04-13T10:58:35.047 INFO:tasks.workunit.client.1.smithi194.stdout:1/159: truncate d12/d13/f2a 480583 0 2024-04-13T10:58:35.050 INFO:tasks.workunit.client.1.smithi194.stdout:7/156: dwrite d1/f2e [0,4194304] 0 2024-04-13T10:58:35.050 INFO:tasks.workunit.client.1.smithi194.stdout:0/147: getdents d9/df 0 2024-04-13T10:58:35.050 INFO:tasks.workunit.client.1.smithi194.stdout:9/125: symlink d0/d11/d1e/l28 0 2024-04-13T10:58:35.052 INFO:tasks.workunit.client.1.smithi194.stdout:5/113: creat d3/dc/d17/d1b/f21 x:0 0 0 2024-04-13T10:58:35.053 INFO:tasks.workunit.client.1.smithi194.stdout:0/148: dread - d9/db/d19/d28/f17 zero size 2024-04-13T10:58:35.054 INFO:tasks.workunit.client.1.smithi194.stdout:0/149: chown d9/df/l34 1 1 2024-04-13T10:58:35.054 INFO:tasks.workunit.client.1.smithi194.stdout:0/150: readlink d9/db/lc 0 2024-04-13T10:58:35.055 INFO:tasks.workunit.client.1.smithi194.stdout:2/163: rename d2/d3/de/f2e to d2/d3/de/d17/d36/f38 0 2024-04-13T10:58:35.056 INFO:tasks.workunit.client.1.smithi194.stdout:6/128: symlink d0/db/l24 0 2024-04-13T10:58:35.056 INFO:tasks.workunit.client.1.smithi194.stdout:6/129: readlink d0/l1b 0 2024-04-13T10:58:35.063 INFO:tasks.workunit.client.1.smithi194.stdout:9/126: mknod d0/d11/d1e/c29 0 2024-04-13T10:58:35.063 INFO:tasks.workunit.client.1.smithi194.stdout:3/158: sync 2024-04-13T10:58:35.068 INFO:tasks.workunit.client.1.smithi194.stdout:0/151: write d9/fd [2558833,87588] 0 2024-04-13T10:58:35.070 INFO:tasks.workunit.client.1.smithi194.stdout:2/164: write d2/d3/d12/f2b [2937484,45090] 0 2024-04-13T10:58:35.070 INFO:tasks.workunit.client.1.smithi194.stdout:6/130: creat d0/db/f25 x:0 0 0 2024-04-13T10:58:35.070 INFO:tasks.workunit.client.1.smithi194.stdout:7/157: mknod d1/d2b/d2c/d30/d33/c34 0 2024-04-13T10:58:35.070 INFO:tasks.workunit.client.1.smithi194.stdout:0/152: write d9/db/f1b [278220,5688] 0 2024-04-13T10:58:35.073 INFO:tasks.workunit.client.1.smithi194.stdout:5/114: symlink d3/dc/d10/d20/l22 0 2024-04-13T10:58:35.073 INFO:tasks.workunit.client.1.smithi194.stdout:8/144: write d6/f21 [634581,67161] 0 2024-04-13T10:58:35.074 INFO:tasks.workunit.client.1.smithi194.stdout:1/160: mkdir d12/d13/d1c/d27/d2e 0 2024-04-13T10:58:35.079 INFO:tasks.workunit.client.1.smithi194.stdout:0/153: unlink d9/c26 0 2024-04-13T10:58:35.080 INFO:tasks.workunit.client.1.smithi194.stdout:0/154: fsync d9/db/f2a 0 2024-04-13T10:58:35.080 INFO:tasks.workunit.client.1.smithi194.stdout:2/165: mkdir d2/d3/de/d17/d39 0 2024-04-13T10:58:35.081 INFO:tasks.workunit.client.1.smithi194.stdout:2/166: fdatasync d2/d3/f2d 0 2024-04-13T10:58:35.084 INFO:tasks.workunit.client.1.smithi194.stdout:4/182: rename d2/d16/f18 to d2/d16/d1a/f36 0 2024-04-13T10:58:35.085 INFO:tasks.workunit.client.1.smithi194.stdout:5/115: mkdir d3/dc/d10/d20/d23 0 2024-04-13T10:58:35.087 INFO:tasks.workunit.client.1.smithi194.stdout:9/127: dwrite d0/d6/f13 [0,4194304] 0 2024-04-13T10:58:35.087 INFO:tasks.workunit.client.1.smithi194.stdout:5/116: chown d3/dc/d17/d1b/f21 215 1 2024-04-13T10:58:35.089 INFO:tasks.workunit.client.1.smithi194.stdout:8/145: unlink d6/f11 0 2024-04-13T10:58:35.089 INFO:tasks.workunit.client.1.smithi194.stdout:5/117: write d3/f1f [461423,35863] 0 2024-04-13T10:58:35.092 INFO:tasks.workunit.client.1.smithi194.stdout:3/159: rename d2/c15 to d2/de/c2b 0 2024-04-13T10:58:35.094 INFO:tasks.workunit.client.1.smithi194.stdout:7/158: symlink d1/d13/l35 0 2024-04-13T10:58:35.095 INFO:tasks.workunit.client.1.smithi194.stdout:6/131: dwrite d0/f7 [0,4194304] 0 2024-04-13T10:58:35.098 INFO:tasks.workunit.client.1.smithi194.stdout:2/167: mknod d2/d3/de/d17/d39/c3a 0 2024-04-13T10:58:35.098 INFO:tasks.workunit.client.1.smithi194.stdout:8/146: mknod d6/dd/c31 0 2024-04-13T10:58:35.099 INFO:tasks.workunit.client.1.smithi194.stdout:8/147: stat l3 0 2024-04-13T10:58:35.099 INFO:tasks.workunit.client.1.smithi194.stdout:3/160: dread d2/de/f1e [0,4194304] 0 2024-04-13T10:58:35.102 INFO:tasks.workunit.client.1.smithi194.stdout:8/148: write d6/d22/d23/d25/f27 [821117,121573] 0 2024-04-13T10:58:35.102 INFO:tasks.workunit.client.1.smithi194.stdout:3/161: write d2/d3/d12/f2a [841840,87197] 0 2024-04-13T10:58:35.103 INFO:tasks.workunit.client.1.smithi194.stdout:5/118: symlink d3/dc/d17/d1b/l24 0 2024-04-13T10:58:35.104 INFO:tasks.workunit.client.1.smithi194.stdout:0/155: link d9/db/d19/l21 d9/db/d19/d28/l37 0 2024-04-13T10:58:35.105 INFO:tasks.workunit.client.1.smithi194.stdout:5/119: read - d3/dc/f18 zero size 2024-04-13T10:58:35.105 INFO:tasks.workunit.client.1.smithi194.stdout:6/132: write d0/db/f23 [498958,72886] 0 2024-04-13T10:58:35.107 INFO:tasks.workunit.client.1.smithi194.stdout:1/161: getdents d12 0 2024-04-13T10:58:35.107 INFO:tasks.workunit.client.1.smithi194.stdout:1/162: readlink d12/l2c 0 2024-04-13T10:58:35.108 INFO:tasks.workunit.client.1.smithi194.stdout:1/163: chown f10 6686 1 2024-04-13T10:58:35.110 INFO:tasks.workunit.client.1.smithi194.stdout:2/168: symlink d2/d3/de/d17/l3b 0 2024-04-13T10:58:35.113 INFO:tasks.workunit.client.1.smithi194.stdout:3/162: symlink d2/d3/d12/d21/l2c 0 2024-04-13T10:58:35.117 INFO:tasks.workunit.client.1.smithi194.stdout:6/133: rmdir d0/db 39 2024-04-13T10:58:35.118 INFO:tasks.workunit.client.1.smithi194.stdout:9/128: write d0/d11/f1d [473049,114362] 0 2024-04-13T10:58:35.119 INFO:tasks.workunit.client.1.smithi194.stdout:9/129: truncate d0/d6/f23 872514 0 2024-04-13T10:58:35.124 INFO:tasks.workunit.client.1.smithi194.stdout:8/149: rename d6/c2c to d6/d22/c32 0 2024-04-13T10:58:35.124 INFO:tasks.workunit.client.1.smithi194.stdout:2/169: dread d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:35.124 INFO:tasks.workunit.client.1.smithi194.stdout:4/183: link d2/d33/l2d d2/d33/l37 0 2024-04-13T10:58:35.126 INFO:tasks.workunit.client.1.smithi194.stdout:6/134: dread - d0/db/f20 zero size 2024-04-13T10:58:35.126 INFO:tasks.workunit.client.1.smithi194.stdout:6/135: readlink d0/lf 0 2024-04-13T10:58:35.127 INFO:tasks.workunit.client.1.smithi194.stdout:6/136: fdatasync d0/db/f23 0 2024-04-13T10:58:35.133 INFO:tasks.workunit.client.1.smithi194.stdout:5/120: rename d3/f4 to d3/dc/f25 0 2024-04-13T10:58:35.133 INFO:tasks.workunit.client.1.smithi194.stdout:5/121: fdatasync d3/dc/d17/d1b/f21 0 2024-04-13T10:58:35.134 INFO:tasks.workunit.client.1.smithi194.stdout:1/164: write d12/d13/f2a [817841,92616] 0 2024-04-13T10:58:35.135 INFO:tasks.workunit.client.1.smithi194.stdout:2/170: truncate d2/d3/d12/f22 2407647 0 2024-04-13T10:58:35.136 INFO:tasks.workunit.client.1.smithi194.stdout:0/156: link d9/db/d19/d28/f2f d9/db/f38 0 2024-04-13T10:58:35.137 INFO:tasks.workunit.client.1.smithi194.stdout:0/157: truncate d9/db/f36 80445 0 2024-04-13T10:58:35.139 INFO:tasks.workunit.client.1.smithi194.stdout:6/137: unlink d0/db/fc 0 2024-04-13T10:58:35.139 INFO:tasks.workunit.client.1.smithi194.stdout:6/138: dread - d0/db/f19 zero size 2024-04-13T10:58:35.139 INFO:tasks.workunit.client.1.smithi194.stdout:7/159: getdents d1/d2b/d2c/d30 0 2024-04-13T10:58:35.140 INFO:tasks.workunit.client.1.smithi194.stdout:6/139: fsync d0/db/f20 0 2024-04-13T10:58:35.140 INFO:tasks.workunit.client.1.smithi194.stdout:9/130: symlink d0/d6/d14/d26/l2a 0 2024-04-13T10:58:35.141 INFO:tasks.workunit.client.1.smithi194.stdout:6/140: chown d0/db/f14 60754756 1 2024-04-13T10:58:35.141 INFO:tasks.workunit.client.1.smithi194.stdout:8/150: mkdir d6/d22/d23/d25/d30/d33 0 2024-04-13T10:58:35.141 INFO:tasks.workunit.client.1.smithi194.stdout:6/141: dread - d0/db/f25 zero size 2024-04-13T10:58:35.145 INFO:tasks.workunit.client.1.smithi194.stdout:6/142: write d0/db/f19 [6157,129572] 0 2024-04-13T10:58:35.145 INFO:tasks.workunit.client.1.smithi194.stdout:7/160: symlink d1/d2b/l36 0 2024-04-13T10:58:35.145 INFO:tasks.workunit.client.1.smithi194.stdout:6/143: read d0/f7 [3151366,7084] 0 2024-04-13T10:58:35.146 INFO:tasks.workunit.client.1.smithi194.stdout:6/144: chown d0/f18 16846 1 2024-04-13T10:58:35.147 INFO:tasks.workunit.client.1.smithi194.stdout:6/145: write d0/f7 [4843913,62299] 0 2024-04-13T10:58:35.148 INFO:tasks.workunit.client.1.smithi194.stdout:8/151: creat d6/d2a/f34 x:0 0 0 2024-04-13T10:58:35.150 INFO:tasks.workunit.client.1.smithi194.stdout:8/152: write d6/d2a/f34 [132162,105202] 0 2024-04-13T10:58:35.152 INFO:tasks.workunit.client.1.smithi194.stdout:2/171: mkdir d2/d3/de/d3c 0 2024-04-13T10:58:35.153 INFO:tasks.workunit.client.1.smithi194.stdout:5/122: rename d3/dc/d17/d1b/l1d to d3/dc/l26 0 2024-04-13T10:58:35.154 INFO:tasks.workunit.client.1.smithi194.stdout:4/184: truncate d2/f4 3920618 0 2024-04-13T10:58:35.154 INFO:tasks.workunit.client.1.smithi194.stdout:6/146: dwrite d0/f21 [0,4194304] 0 2024-04-13T10:58:35.155 INFO:tasks.workunit.client.1.smithi194.stdout:7/161: rmdir d1/d2b/d2c/d30 39 2024-04-13T10:58:35.156 INFO:tasks.workunit.client.1.smithi194.stdout:4/185: write d2/d16/d1a/f22 [4341340,85331] 0 2024-04-13T10:58:35.156 INFO:tasks.workunit.client.1.smithi194.stdout:6/147: chown d0/db/f20 2069 1 2024-04-13T10:58:35.161 INFO:tasks.workunit.client.1.smithi194.stdout:0/158: rename d9/df/l35 to d9/db/d19/d28/l39 0 2024-04-13T10:58:35.161 INFO:tasks.workunit.client.1.smithi194.stdout:5/123: chown d3/le 136 1 2024-04-13T10:58:35.162 INFO:tasks.workunit.client.1.smithi194.stdout:1/165: truncate f0 1065332 0 2024-04-13T10:58:35.164 INFO:tasks.workunit.client.1.smithi194.stdout:7/162: read - d1/d2b/d2c/d30/f32 zero size 2024-04-13T10:58:35.168 INFO:tasks.workunit.client.1.smithi194.stdout:6/148: write d0/f21 [4758234,77778] 0 2024-04-13T10:58:35.175 INFO:tasks.workunit.client.1.smithi194.stdout:5/124: rmdir d3/dc 39 2024-04-13T10:58:35.178 INFO:tasks.workunit.client.1.smithi194.stdout:1/166: unlink fb 0 2024-04-13T10:58:35.178 INFO:tasks.workunit.client.1.smithi194.stdout:1/167: chown d12/d13/d1c/d27/d2e 6 1 2024-04-13T10:58:35.178 INFO:tasks.workunit.client.1.smithi194.stdout:7/163: mkdir d1/d2b/d2c/d30/d37 0 2024-04-13T10:58:35.179 INFO:tasks.workunit.client.1.smithi194.stdout:1/168: truncate d12/f1a 1221771 0 2024-04-13T10:58:35.179 INFO:tasks.workunit.client.1.smithi194.stdout:4/186: symlink d2/d30/l38 0 2024-04-13T10:58:35.180 INFO:tasks.workunit.client.1.smithi194.stdout:9/131: getdents d0/d6/d14/d26 0 2024-04-13T10:58:35.180 INFO:tasks.workunit.client.1.smithi194.stdout:9/132: fdatasync d0/f3 0 2024-04-13T10:58:35.180 INFO:tasks.workunit.client.1.smithi194.stdout:2/172: write d2/d3/de/f1a [86510,86198] 0 2024-04-13T10:58:35.184 INFO:tasks.workunit.client.1.smithi194.stdout:6/149: dread d0/f7 [0,4194304] 0 2024-04-13T10:58:35.185 INFO:tasks.workunit.client.1.smithi194.stdout:7/164: write d1/fa [253054,70285] 0 2024-04-13T10:58:35.186 INFO:tasks.workunit.client.1.smithi194.stdout:7/165: chown d1/d2b/d2c/d30 16 1 2024-04-13T10:58:35.189 INFO:tasks.workunit.client.1.smithi194.stdout:9/133: rmdir d0/d6 39 2024-04-13T10:58:35.191 INFO:tasks.workunit.client.1.smithi194.stdout:0/159: truncate f3 1353535 0 2024-04-13T10:58:35.191 INFO:tasks.workunit.client.1.smithi194.stdout:0/160: stat d9/df/f14 0 2024-04-13T10:58:35.191 INFO:tasks.workunit.client.1.smithi194.stdout:8/153: link d6/d22/c32 d6/d22/d23/d25/d30/d33/c35 0 2024-04-13T10:58:35.192 INFO:tasks.workunit.client.1.smithi194.stdout:1/169: chown f1 1135265 1 2024-04-13T10:58:35.192 INFO:tasks.workunit.client.1.smithi194.stdout:1/170: fdatasync d12/f26 0 2024-04-13T10:58:35.193 INFO:tasks.workunit.client.1.smithi194.stdout:1/171: truncate d12/f22 530219 0 2024-04-13T10:58:35.193 INFO:tasks.workunit.client.1.smithi194.stdout:2/173: unlink d2/d3/de/l21 0 2024-04-13T10:58:35.195 INFO:tasks.workunit.client.1.smithi194.stdout:4/187: creat d2/d16/d1a/d1c/f39 x:0 0 0 2024-04-13T10:58:35.196 INFO:tasks.workunit.client.1.smithi194.stdout:9/134: symlink d0/d11/d1e/l2b 0 2024-04-13T10:58:35.197 INFO:tasks.workunit.client.1.smithi194.stdout:0/161: mkdir d9/db/d3a 0 2024-04-13T10:58:35.197 INFO:tasks.workunit.client.1.smithi194.stdout:8/154: creat d6/d22/d23/d25/f36 x:0 0 0 2024-04-13T10:58:35.198 INFO:tasks.workunit.client.1.smithi194.stdout:4/188: write d2/d16/d1a/f2f [265242,95162] 0 2024-04-13T10:58:35.200 INFO:tasks.workunit.client.1.smithi194.stdout:2/174: mkdir d2/d3/de/d17/d36/d3d 0 2024-04-13T10:58:35.203 INFO:tasks.workunit.client.1.smithi194.stdout:1/172: dwrite d12/f22 [0,4194304] 0 2024-04-13T10:58:35.203 INFO:tasks.workunit.client.1.smithi194.stdout:0/162: symlink d9/db/d19/l3b 0 2024-04-13T10:58:35.206 INFO:tasks.workunit.client.1.smithi194.stdout:5/125: truncate d3/dc/d17/f19 2679031 0 2024-04-13T10:58:35.208 INFO:tasks.workunit.client.1.smithi194.stdout:1/173: symlink d12/d13/d1c/d28/l2f 0 2024-04-13T10:58:35.209 INFO:tasks.workunit.client.1.smithi194.stdout:2/175: dread d2/f23 [0,4194304] 0 2024-04-13T10:58:35.210 INFO:tasks.workunit.client.1.smithi194.stdout:5/126: chown d3/dc/d10/d20/l22 0 1 2024-04-13T10:58:35.210 INFO:tasks.workunit.client.1.smithi194.stdout:1/174: write d12/f1a [1078836,60535] 0 2024-04-13T10:58:35.212 INFO:tasks.workunit.client.1.smithi194.stdout:4/189: dwrite d2/fb [0,4194304] 0 2024-04-13T10:58:35.214 INFO:tasks.workunit.client.1.smithi194.stdout:1/175: dread f5 [0,4194304] 0 2024-04-13T10:58:35.278 INFO:tasks.workunit.client.1.smithi194.stdout:9/135: mkdir d0/d6/d2c 0 2024-04-13T10:58:35.278 INFO:tasks.workunit.client.1.smithi194.stdout:9/136: chown d0/d6/f8 410251860 1 2024-04-13T10:58:35.279 INFO:tasks.workunit.client.1.smithi194.stdout:9/137: write d0/f3 [515501,40162] 0 2024-04-13T10:58:35.279 INFO:tasks.workunit.client.1.smithi194.stdout:8/155: mknod d6/d22/d23/d25/d30/d33/c37 0 2024-04-13T10:58:35.279 INFO:tasks.workunit.client.1.smithi194.stdout:8/156: readlink l3 0 2024-04-13T10:58:35.280 INFO:tasks.workunit.client.1.smithi194.stdout:8/157: truncate d6/f21 1185399 0 2024-04-13T10:58:35.280 INFO:tasks.workunit.client.1.smithi194.stdout:7/166: rename d1/c2a to d1/d13/c38 0 2024-04-13T10:58:35.281 INFO:tasks.workunit.client.1.smithi194.stdout:8/158: chown d6/dd/ca 10680 1 2024-04-13T10:58:35.281 INFO:tasks.workunit.client.1.smithi194.stdout:7/167: read d1/f2e [1618803,65198] 0 2024-04-13T10:58:35.284 INFO:tasks.workunit.client.1.smithi194.stdout:8/159: dread d6/d22/d23/d25/f27 [0,4194304] 0 2024-04-13T10:58:35.294 INFO:tasks.workunit.client.1.smithi194.stdout:2/176: creat d2/d3/de/d17/d36/d3d/f3e x:0 0 0 2024-04-13T10:58:35.296 INFO:tasks.workunit.client.1.smithi194.stdout:3/163: sync 2024-04-13T10:58:35.298 INFO:tasks.workunit.client.1.smithi194.stdout:7/168: chown d1/d13/l27 36 1 2024-04-13T10:58:35.299 INFO:tasks.workunit.client.1.smithi194.stdout:8/160: symlink d6/l38 0 2024-04-13T10:58:35.300 INFO:tasks.workunit.client.1.smithi194.stdout:7/169: read d1/fe [915563,10054] 0 2024-04-13T10:58:35.300 INFO:tasks.workunit.client.1.smithi194.stdout:1/176: truncate d12/f22 3645170 0 2024-04-13T10:58:35.301 INFO:tasks.workunit.client.1.smithi194.stdout:4/190: creat d2/d16/d1a/d1d/d31/f3a x:0 0 0 2024-04-13T10:58:35.303 INFO:tasks.workunit.client.1.smithi194.stdout:9/138: rename d0/d11/d1e/l2b to d0/l2d 0 2024-04-13T10:58:35.303 INFO:tasks.workunit.client.1.smithi194.stdout:5/127: dread d3/dc/d17/f19 [0,4194304] 0 2024-04-13T10:58:35.304 INFO:tasks.workunit.client.1.smithi194.stdout:8/161: mkdir d6/d22/d23/d25/d39 0 2024-04-13T10:58:35.307 INFO:tasks.workunit.client.1.smithi194.stdout:2/177: rename d2/d3/de/f24 to d2/d3/de/d17/d1e/f3f 0 2024-04-13T10:58:35.307 INFO:tasks.workunit.client.1.smithi194.stdout:1/177: dread d12/f15 [0,4194304] 0 2024-04-13T10:58:35.308 INFO:tasks.workunit.client.1.smithi194.stdout:7/170: dread d1/f2e [0,4194304] 0 2024-04-13T10:58:35.308 INFO:tasks.workunit.client.1.smithi194.stdout:4/191: mkdir d2/d16/d1a/d1c/d3b 0 2024-04-13T10:58:35.310 INFO:tasks.workunit.client.1.smithi194.stdout:1/178: write d12/d13/f2a [1192800,25946] 0 2024-04-13T10:58:35.313 INFO:tasks.workunit.client.1.smithi194.stdout:9/139: rename d0/d6/f8 to d0/d11/d1e/f2e 0 2024-04-13T10:58:35.314 INFO:tasks.workunit.client.1.smithi194.stdout:3/164: dwrite d2/d3/d12/f16 [0,4194304] 0 2024-04-13T10:58:35.314 INFO:tasks.workunit.client.1.smithi194.stdout:2/178: mkdir d2/d3/d12/d40 0 2024-04-13T10:58:35.315 INFO:tasks.workunit.client.1.smithi194.stdout:2/179: write d2/fd [4283706,121314] 0 2024-04-13T10:58:35.318 INFO:tasks.workunit.client.1.smithi194.stdout:4/192: mknod d2/d33/c3c 0 2024-04-13T10:58:35.319 INFO:tasks.workunit.client.1.smithi194.stdout:7/171: mkdir d1/d2b/d2c/d30/d33/d39 0 2024-04-13T10:58:35.320 INFO:tasks.workunit.client.1.smithi194.stdout:1/179: symlink d12/d13/d25/l30 0 2024-04-13T10:58:35.320 INFO:tasks.workunit.client.1.smithi194.stdout:7/172: stat d1/d2b/l36 0 2024-04-13T10:58:35.320 INFO:tasks.workunit.client.1.smithi194.stdout:4/193: write d2/d16/d1a/f22 [5417660,78629] 0 2024-04-13T10:58:35.322 INFO:tasks.workunit.client.1.smithi194.stdout:7/173: chown d1/c9 283 1 2024-04-13T10:58:35.322 INFO:tasks.workunit.client.1.smithi194.stdout:1/180: dread - d12/d13/d25/f2d zero size 2024-04-13T10:58:35.323 INFO:tasks.workunit.client.1.smithi194.stdout:3/165: dwrite d2/f5 [0,4194304] 0 2024-04-13T10:58:35.324 INFO:tasks.workunit.client.1.smithi194.stdout:9/140: rmdir d0/d6/d14 39 2024-04-13T10:58:35.324 INFO:tasks.workunit.client.1.smithi194.stdout:2/180: rmdir d2/d3/de/d33 39 2024-04-13T10:58:35.325 INFO:tasks.workunit.client.1.smithi194.stdout:5/128: link d3/dc/d10/d20/l22 d3/dc/l27 0 2024-04-13T10:58:35.325 INFO:tasks.workunit.client.1.smithi194.stdout:2/181: stat d2/f23 0 2024-04-13T10:58:35.329 INFO:tasks.workunit.client.1.smithi194.stdout:7/174: rmdir d1/d2b/d2c/d30/d33 39 2024-04-13T10:58:35.331 INFO:tasks.workunit.client.1.smithi194.stdout:7/175: write d1/d2b/d2c/d30/f32 [812898,128496] 0 2024-04-13T10:58:35.331 INFO:tasks.workunit.client.1.smithi194.stdout:1/181: rename d12/d13/f2a to d12/d13/d1c/f31 0 2024-04-13T10:58:35.332 INFO:tasks.workunit.client.1.smithi194.stdout:4/194: dwrite d2/d16/d1a/d1d/f26 [0,4194304] 0 2024-04-13T10:58:35.334 INFO:tasks.workunit.client.1.smithi194.stdout:4/195: write d2/d16/d1a/f2f [2867838,69832] 0 2024-04-13T10:58:35.338 INFO:tasks.workunit.client.1.smithi194.stdout:5/129: creat d3/dc/d17/f28 x:0 0 0 2024-04-13T10:58:35.339 INFO:tasks.workunit.client.1.smithi194.stdout:4/196: stat d2/d16/d1a 0 2024-04-13T10:58:35.339 INFO:tasks.workunit.client.1.smithi194.stdout:1/182: chown d12/d13/d1c/d28/l2f 389 1 2024-04-13T10:58:35.345 INFO:tasks.workunit.client.1.smithi194.stdout:2/182: rename d2/d3/l26 to d2/d3/de/d3c/l41 0 2024-04-13T10:58:35.346 INFO:tasks.workunit.client.1.smithi194.stdout:9/141: write d0/d6/d9/fc [546335,99148] 0 2024-04-13T10:58:35.347 INFO:tasks.workunit.client.1.smithi194.stdout:7/176: symlink d1/d2b/d2c/d30/d33/d39/l3a 0 2024-04-13T10:58:35.349 INFO:tasks.workunit.client.1.smithi194.stdout:5/130: dwrite d3/f1f [0,4194304] 0 2024-04-13T10:58:35.350 INFO:tasks.workunit.client.1.smithi194.stdout:2/183: write d2/d5/f1d [3124510,43388] 0 2024-04-13T10:58:35.350 INFO:tasks.workunit.client.1.smithi194.stdout:1/183: rename f5 to d12/f32 0 2024-04-13T10:58:35.353 INFO:tasks.workunit.client.1.smithi194.stdout:4/197: dwrite d2/d16/d1a/f35 [0,4194304] 0 2024-04-13T10:58:35.355 INFO:tasks.workunit.client.1.smithi194.stdout:3/166: truncate d2/de/f1e 191351 0 2024-04-13T10:58:35.357 INFO:tasks.workunit.client.1.smithi194.stdout:4/198: read d2/d33/f2e [2029242,39307] 0 2024-04-13T10:58:35.360 INFO:tasks.workunit.client.1.smithi194.stdout:5/131: mkdir d3/d29 0 2024-04-13T10:58:35.364 INFO:tasks.workunit.client.1.smithi194.stdout:7/177: dwrite d1/f16 [0,4194304] 0 2024-04-13T10:58:35.364 INFO:tasks.workunit.client.1.smithi194.stdout:9/142: rename d0/d11/f15 to d0/d6/d14/d26/f2f 0 2024-04-13T10:58:35.364 INFO:tasks.workunit.client.1.smithi194.stdout:3/167: dread d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:35.366 INFO:tasks.workunit.client.1.smithi194.stdout:3/168: chown d2/d3/d1a/d24 289198323 1 2024-04-13T10:58:35.367 INFO:tasks.workunit.client.1.smithi194.stdout:2/184: dwrite d2/d5/f1d [0,4194304] 0 2024-04-13T10:58:35.370 INFO:tasks.workunit.client.1.smithi194.stdout:9/143: mknod d0/d6/d9/c30 0 2024-04-13T10:58:35.371 INFO:tasks.workunit.client.1.smithi194.stdout:4/199: symlink d2/d16/d1a/d1c/d3b/l3d 0 2024-04-13T10:58:35.371 INFO:tasks.workunit.client.1.smithi194.stdout:5/132: chown d3/dc/d10/d20/l22 86139 1 2024-04-13T10:58:35.372 INFO:tasks.workunit.client.1.smithi194.stdout:1/184: rename d12/d13/d1c to d12/d13/d1c/d27/d2e/d33 22 2024-04-13T10:58:35.373 INFO:tasks.workunit.client.1.smithi194.stdout:3/169: mknod d2/d3/d1a/c2d 0 2024-04-13T10:58:35.375 INFO:tasks.workunit.client.1.smithi194.stdout:3/170: stat d2/d3/c1f 0 2024-04-13T10:58:35.377 INFO:tasks.workunit.client.1.smithi194.stdout:5/133: unlink d3/f1a 0 2024-04-13T10:58:35.378 INFO:tasks.workunit.client.1.smithi194.stdout:2/185: mkdir d2/d3/de/d17/d1e/d42 0 2024-04-13T10:58:35.381 INFO:tasks.workunit.client.1.smithi194.stdout:4/200: mkdir d2/d16/d1a/d1c/d3e 0 2024-04-13T10:58:35.381 INFO:tasks.workunit.client.1.smithi194.stdout:5/134: chown d3/dc/d17/d1b/l24 7 1 2024-04-13T10:58:35.382 INFO:tasks.workunit.client.1.smithi194.stdout:3/171: unlink d2/d3/d12/f2a 0 2024-04-13T10:58:35.383 INFO:tasks.workunit.client.1.smithi194.stdout:7/178: truncate d1/d13/f20 1784433 0 2024-04-13T10:58:35.384 INFO:tasks.workunit.client.1.smithi194.stdout:4/201: read d2/d16/d1a/f36 [148805,116695] 0 2024-04-13T10:58:35.385 INFO:tasks.workunit.client.1.smithi194.stdout:5/135: read - d3/dc/d17/f1c zero size 2024-04-13T10:58:35.385 INFO:tasks.workunit.client.1.smithi194.stdout:1/185: rename f0 to d12/d13/d25/f34 0 2024-04-13T10:58:35.385 INFO:tasks.workunit.client.1.smithi194.stdout:9/144: dwrite d0/d6/f23 [0,4194304] 0 2024-04-13T10:58:35.388 INFO:tasks.workunit.client.1.smithi194.stdout:4/202: fsync d2/ff 0 2024-04-13T10:58:35.389 INFO:tasks.workunit.client.1.smithi194.stdout:2/186: mknod d2/d3/de/d33/c43 0 2024-04-13T10:58:35.390 INFO:tasks.workunit.client.1.smithi194.stdout:4/203: chown d2/d16 4906 1 2024-04-13T10:58:35.391 INFO:tasks.workunit.client.1.smithi194.stdout:5/136: dread - d3/dc/d17/f1c zero size 2024-04-13T10:58:35.391 INFO:tasks.workunit.client.1.smithi194.stdout:3/172: creat d2/d3/d1a/f2e x:0 0 0 2024-04-13T10:58:35.392 INFO:tasks.workunit.client.1.smithi194.stdout:1/186: read d12/f32 [361661,51101] 0 2024-04-13T10:58:35.393 INFO:tasks.workunit.client.1.smithi194.stdout:2/187: creat d2/d5/f44 x:0 0 0 2024-04-13T10:58:35.394 INFO:tasks.workunit.client.1.smithi194.stdout:1/187: stat f10 0 2024-04-13T10:58:35.394 INFO:tasks.workunit.client.1.smithi194.stdout:3/173: chown d2/l19 161 1 2024-04-13T10:58:35.395 INFO:tasks.workunit.client.1.smithi194.stdout:5/137: rmdir d3/dc/d17/d1b 39 2024-04-13T10:58:35.395 INFO:tasks.workunit.client.1.smithi194.stdout:3/174: chown d2/d3 119763 1 2024-04-13T10:58:35.398 INFO:tasks.workunit.client.1.smithi194.stdout:0/163: sync 2024-04-13T10:58:35.398 INFO:tasks.workunit.client.1.smithi194.stdout:6/150: sync 2024-04-13T10:58:35.400 INFO:tasks.workunit.client.1.smithi194.stdout:0/164: stat d9/df/f14 0 2024-04-13T10:58:35.401 INFO:tasks.workunit.client.1.smithi194.stdout:7/179: dread d1/fa [0,4194304] 0 2024-04-13T10:58:35.403 INFO:tasks.workunit.client.1.smithi194.stdout:3/175: fsync d2/d3/d12/f22 0 2024-04-13T10:58:35.404 INFO:tasks.workunit.client.1.smithi194.stdout:1/188: rmdir d12/d13 39 2024-04-13T10:58:35.405 INFO:tasks.workunit.client.1.smithi194.stdout:4/204: dwrite d2/d16/d1a/f2f [0,4194304] 0 2024-04-13T10:58:35.406 INFO:tasks.workunit.client.1.smithi194.stdout:2/188: rmdir d2/d3 39 2024-04-13T10:58:35.407 INFO:tasks.workunit.client.1.smithi194.stdout:9/145: fdatasync d0/d6/f23 0 2024-04-13T10:58:35.408 INFO:tasks.workunit.client.1.smithi194.stdout:3/176: dread - d2/d3/d1a/f2e zero size 2024-04-13T10:58:35.410 INFO:tasks.workunit.client.1.smithi194.stdout:0/165: creat d9/df/f3c x:0 0 0 2024-04-13T10:58:35.412 INFO:tasks.workunit.client.1.smithi194.stdout:7/180: symlink d1/l3b 0 2024-04-13T10:58:35.413 INFO:tasks.workunit.client.1.smithi194.stdout:6/151: dwrite d0/db/f15 [0,4194304] 0 2024-04-13T10:58:35.414 INFO:tasks.workunit.client.1.smithi194.stdout:9/146: creat d0/d11/f31 x:0 0 0 2024-04-13T10:58:35.415 INFO:tasks.workunit.client.1.smithi194.stdout:5/138: dwrite d3/dc/f18 [0,4194304] 0 2024-04-13T10:58:35.416 INFO:tasks.workunit.client.1.smithi194.stdout:2/189: read d2/d3/de/f16 [1097165,97563] 0 2024-04-13T10:58:35.420 INFO:tasks.workunit.client.1.smithi194.stdout:4/205: creat d2/d16/d1a/d1c/d3e/f3f x:0 0 0 2024-04-13T10:58:35.427 INFO:tasks.workunit.client.1.smithi194.stdout:0/166: write d9/db/f38 [799279,29996] 0 2024-04-13T10:58:35.428 INFO:tasks.workunit.client.1.smithi194.stdout:0/167: fdatasync d9/db/d19/d28/f17 0 2024-04-13T10:58:35.428 INFO:tasks.workunit.client.1.smithi194.stdout:9/147: creat d0/d6/d9/f32 x:0 0 0 2024-04-13T10:58:35.430 INFO:tasks.workunit.client.1.smithi194.stdout:1/189: creat d12/f35 x:0 0 0 2024-04-13T10:58:35.430 INFO:tasks.workunit.client.1.smithi194.stdout:2/190: creat d2/d3/de/d3c/f45 x:0 0 0 2024-04-13T10:58:35.430 INFO:tasks.workunit.client.1.smithi194.stdout:8/162: sync 2024-04-13T10:58:35.431 INFO:tasks.workunit.client.1.smithi194.stdout:2/191: stat d2/d3/l15 0 2024-04-13T10:58:35.431 INFO:tasks.workunit.client.1.smithi194.stdout:5/139: rename d3/dc/l13 to d3/dc/d10/l2a 0 2024-04-13T10:58:35.432 INFO:tasks.workunit.client.1.smithi194.stdout:7/181: mkdir d1/d2b/d2c/d30/d37/d3c 0 2024-04-13T10:58:35.434 INFO:tasks.workunit.client.1.smithi194.stdout:5/140: chown d3/dc/d10/f11 339 1 2024-04-13T10:58:35.435 INFO:tasks.workunit.client.1.smithi194.stdout:3/177: truncate d2/fd 2159803 0 2024-04-13T10:58:35.437 INFO:tasks.workunit.client.1.smithi194.stdout:6/152: rename d0/db to d0/d26 0 2024-04-13T10:58:35.438 INFO:tasks.workunit.client.1.smithi194.stdout:2/192: symlink d2/d3/de/d3c/l46 0 2024-04-13T10:58:35.439 INFO:tasks.workunit.client.1.smithi194.stdout:0/168: dwrite d9/db/f38 [0,4194304] 0 2024-04-13T10:58:35.439 INFO:tasks.workunit.client.1.smithi194.stdout:5/141: chown d3/dc/d17/f28 16789244 1 2024-04-13T10:58:35.439 INFO:tasks.workunit.client.1.smithi194.stdout:6/153: stat d0/d26/f14 0 2024-04-13T10:58:35.441 INFO:tasks.workunit.client.1.smithi194.stdout:9/148: mknod d0/c33 0 2024-04-13T10:58:35.443 INFO:tasks.workunit.client.1.smithi194.stdout:6/154: write d0/d26/f15 [2209218,97757] 0 2024-04-13T10:58:35.445 INFO:tasks.workunit.client.1.smithi194.stdout:8/163: rename d6/d22/f2e to d6/d22/d23/d25/d30/d33/f3a 0 2024-04-13T10:58:35.446 INFO:tasks.workunit.client.1.smithi194.stdout:4/206: dread d2/f4 [0,4194304] 0 2024-04-13T10:58:35.449 INFO:tasks.workunit.client.1.smithi194.stdout:3/178: unlink d2/f11 0 2024-04-13T10:58:35.450 INFO:tasks.workunit.client.1.smithi194.stdout:5/142: dread d3/dc/f25 [0,4194304] 0 2024-04-13T10:58:35.450 INFO:tasks.workunit.client.1.smithi194.stdout:2/193: dwrite d2/d3/de/d3c/f45 [0,4194304] 0 2024-04-13T10:58:35.452 INFO:tasks.workunit.client.1.smithi194.stdout:2/194: chown d2 7112421 1 2024-04-13T10:58:35.453 INFO:tasks.workunit.client.1.smithi194.stdout:5/143: chown d3/dc/d17/f1c 5 1 2024-04-13T10:58:35.453 INFO:tasks.workunit.client.1.smithi194.stdout:7/182: creat d1/d2b/d2c/d30/d33/d39/f3d x:0 0 0 2024-04-13T10:58:35.456 INFO:tasks.workunit.client.1.smithi194.stdout:8/164: dwrite d6/dd/f16 [0,4194304] 0 2024-04-13T10:58:35.457 INFO:tasks.workunit.client.1.smithi194.stdout:8/165: chown d6/d2a/c2d 7 1 2024-04-13T10:58:35.457 INFO:tasks.workunit.client.1.smithi194.stdout:0/169: dread f3 [0,4194304] 0 2024-04-13T10:58:35.461 INFO:tasks.workunit.client.1.smithi194.stdout:0/170: dread d9/fa [0,4194304] 0 2024-04-13T10:58:35.461 INFO:tasks.workunit.client.1.smithi194.stdout:0/171: chown d9/fd 1833 1 2024-04-13T10:58:35.465 INFO:tasks.workunit.client.1.smithi194.stdout:6/155: mknod d0/d26/c27 0 2024-04-13T10:58:35.469 INFO:tasks.workunit.client.1.smithi194.stdout:0/172: dread d9/fd [0,4194304] 0 2024-04-13T10:58:35.470 INFO:tasks.workunit.client.1.smithi194.stdout:0/173: readlink d9/df/l34 0 2024-04-13T10:58:35.471 INFO:tasks.workunit.client.1.smithi194.stdout:0/174: chown d9/db/f33 267880 1 2024-04-13T10:58:35.475 INFO:tasks.workunit.client.1.smithi194.stdout:3/179: read d2/d3/f8 [4078058,74004] 0 2024-04-13T10:58:35.476 INFO:tasks.workunit.client.1.smithi194.stdout:2/195: mkdir d2/d3/de/d33/d47 0 2024-04-13T10:58:35.481 INFO:tasks.workunit.client.1.smithi194.stdout:2/196: dwrite d2/d3/d12/f1c [0,4194304] 0 2024-04-13T10:58:35.483 INFO:tasks.workunit.client.1.smithi194.stdout:7/183: mkdir d1/d2b/d3e 0 2024-04-13T10:58:35.493 INFO:tasks.workunit.client.1.smithi194.stdout:6/156: mknod d0/d26/c28 0 2024-04-13T10:58:35.498 INFO:tasks.workunit.client.1.smithi194.stdout:0/175: creat d9/db/f3d x:0 0 0 2024-04-13T10:58:35.499 INFO:tasks.workunit.client.1.smithi194.stdout:3/180: rename d2/d3/d12/c1c to d2/d3/d12/d21/c2f 0 2024-04-13T10:58:35.499 INFO:tasks.workunit.client.1.smithi194.stdout:3/181: stat d2/de/l10 0 2024-04-13T10:58:35.504 INFO:tasks.workunit.client.1.smithi194.stdout:7/184: read - d1/d13/f28 zero size 2024-04-13T10:58:35.504 INFO:tasks.workunit.client.1.smithi194.stdout:0/176: dwrite d9/df/f3c [0,4194304] 0 2024-04-13T10:58:35.505 INFO:tasks.workunit.client.1.smithi194.stdout:8/166: mknod d6/d22/d23/d25/d39/c3b 0 2024-04-13T10:58:35.506 INFO:tasks.workunit.client.1.smithi194.stdout:8/167: fdatasync d6/f21 0 2024-04-13T10:58:35.507 INFO:tasks.workunit.client.1.smithi194.stdout:1/190: creat d12/d13/d1c/d27/d2e/f36 x:0 0 0 2024-04-13T10:58:35.509 INFO:tasks.workunit.client.1.smithi194.stdout:1/191: fdatasync d12/d13/d25/f2d 0 2024-04-13T10:58:35.511 INFO:tasks.workunit.client.1.smithi194.stdout:2/197: dwrite d2/d3/de/d17/d1e/f3f [0,4194304] 0 2024-04-13T10:58:35.513 INFO:tasks.workunit.client.1.smithi194.stdout:6/157: creat d0/d26/f29 x:0 0 0 2024-04-13T10:58:35.513 INFO:tasks.workunit.client.1.smithi194.stdout:6/158: stat d0/d26 0 2024-04-13T10:58:35.528 INFO:tasks.workunit.client.1.smithi194.stdout:3/182: dwrite d2/f27 [0,4194304] 0 2024-04-13T10:58:35.530 INFO:tasks.workunit.client.1.smithi194.stdout:7/185: creat d1/d2b/d2c/d30/d37/f3f x:0 0 0 2024-04-13T10:58:35.538 INFO:tasks.workunit.client.1.smithi194.stdout:9/149: getdents d0/d11/d1e 0 2024-04-13T10:58:35.538 INFO:tasks.workunit.client.1.smithi194.stdout:9/150: dread - d0/d6/d9/f32 zero size 2024-04-13T10:58:35.540 INFO:tasks.workunit.client.1.smithi194.stdout:5/144: write d3/f9 [1890329,70083] 0 2024-04-13T10:58:35.544 INFO:tasks.workunit.client.1.smithi194.stdout:2/198: dread d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:35.547 INFO:tasks.workunit.client.1.smithi194.stdout:4/207: getdents d2/d16/d1a/d1c 0 2024-04-13T10:58:35.556 INFO:tasks.workunit.client.1.smithi194.stdout:0/177: link d9/fa d9/d2b/f3e 0 2024-04-13T10:58:35.561 INFO:tasks.workunit.client.1.smithi194.stdout:9/151: creat d0/d6/d14/d26/f34 x:0 0 0 2024-04-13T10:58:35.564 INFO:tasks.workunit.client.1.smithi194.stdout:5/145: fsync d3/dc/f25 0 2024-04-13T10:58:35.565 INFO:tasks.workunit.client.1.smithi194.stdout:5/146: chown d3/dc/d10/f14 127940266 1 2024-04-13T10:58:35.567 INFO:tasks.workunit.client.1.smithi194.stdout:2/199: symlink d2/d3/de/d17/d39/l48 0 2024-04-13T10:58:35.567 INFO:tasks.workunit.client.1.smithi194.stdout:2/200: write d2/fd [180079,75292] 0 2024-04-13T10:58:35.568 INFO:tasks.workunit.client.1.smithi194.stdout:2/201: write d2/d5/f44 [506684,7388] 0 2024-04-13T10:58:35.570 INFO:tasks.workunit.client.1.smithi194.stdout:6/159: unlink d0/l6 0 2024-04-13T10:58:35.575 INFO:tasks.workunit.client.1.smithi194.stdout:7/186: write d1/f12 [2599614,104949] 0 2024-04-13T10:58:35.580 INFO:tasks.workunit.client.1.smithi194.stdout:9/152: mknod d0/d6/d14/c35 0 2024-04-13T10:58:35.581 INFO:tasks.workunit.client.1.smithi194.stdout:2/202: symlink d2/d3/de/d17/d36/l49 0 2024-04-13T10:58:35.584 INFO:tasks.workunit.client.1.smithi194.stdout:3/183: creat d2/f30 x:0 0 0 2024-04-13T10:58:35.584 INFO:tasks.workunit.client.1.smithi194.stdout:3/184: chown d2/f9 28947 1 2024-04-13T10:58:35.585 INFO:tasks.workunit.client.1.smithi194.stdout:8/168: getdents d6/d22/d23/d25/d30/d33 0 2024-04-13T10:58:35.586 INFO:tasks.workunit.client.1.smithi194.stdout:3/185: write d2/d3/d1a/f2e [1041399,39665] 0 2024-04-13T10:58:35.587 INFO:tasks.workunit.client.1.smithi194.stdout:1/192: rename d12/f22 to d12/d13/f37 0 2024-04-13T10:58:35.588 INFO:tasks.workunit.client.1.smithi194.stdout:5/147: getdents d3/dc/d10/d20/d23 0 2024-04-13T10:58:35.592 INFO:tasks.workunit.client.1.smithi194.stdout:2/203: creat d2/d3/f4a x:0 0 0 2024-04-13T10:58:35.594 INFO:tasks.workunit.client.1.smithi194.stdout:4/208: link d2/d33/f2e d2/d16/d1a/d1d/d31/f40 0 2024-04-13T10:58:35.596 INFO:tasks.workunit.client.1.smithi194.stdout:8/169: creat d6/d22/d23/d25/d30/d33/f3c x:0 0 0 2024-04-13T10:58:35.597 INFO:tasks.workunit.client.1.smithi194.stdout:3/186: mkdir d2/d3/d12/d31 0 2024-04-13T10:58:35.602 INFO:tasks.workunit.client.1.smithi194.stdout:9/153: creat d0/d6/d2c/f36 x:0 0 0 2024-04-13T10:58:35.604 INFO:tasks.workunit.client.1.smithi194.stdout:2/204: unlink d2/fd 0 2024-04-13T10:58:35.606 INFO:tasks.workunit.client.1.smithi194.stdout:6/160: creat d0/f2a x:0 0 0 2024-04-13T10:58:35.613 INFO:tasks.workunit.client.1.smithi194.stdout:5/148: symlink d3/l2b 0 2024-04-13T10:58:35.614 INFO:tasks.workunit.client.1.smithi194.stdout:8/170: dwrite d6/d22/d23/d25/d30/d33/f3a [8388608,4194304] 0 2024-04-13T10:58:35.616 INFO:tasks.workunit.client.1.smithi194.stdout:8/171: write d6/dd/f16 [4580027,23766] 0 2024-04-13T10:58:35.617 INFO:tasks.workunit.client.1.smithi194.stdout:2/205: creat d2/d5/f4b x:0 0 0 2024-04-13T10:58:35.618 INFO:tasks.workunit.client.1.smithi194.stdout:5/149: dread d3/f1f [0,4194304] 0 2024-04-13T10:58:35.627 INFO:tasks.workunit.client.1.smithi194.stdout:3/187: rename d2/de/c2b to d2/de/c32 0 2024-04-13T10:58:35.628 INFO:tasks.workunit.client.1.smithi194.stdout:3/188: write d2/d3/d1a/f2e [1085628,11777] 0 2024-04-13T10:58:35.634 INFO:tasks.workunit.client.1.smithi194.stdout:7/187: truncate d1/d2b/d2c/d30/f32 191521 0 2024-04-13T10:58:35.635 INFO:tasks.workunit.client.1.smithi194.stdout:8/172: mkdir d6/d22/d23/d3d 0 2024-04-13T10:58:35.637 INFO:tasks.workunit.client.1.smithi194.stdout:2/206: write d2/d3/de/d17/d36/f38 [48808,76073] 0 2024-04-13T10:58:35.639 INFO:tasks.workunit.client.1.smithi194.stdout:2/207: write d2/d3/de/d17/d36/d3d/f3e [722552,89996] 0 2024-04-13T10:58:35.640 INFO:tasks.workunit.client.1.smithi194.stdout:2/208: stat d2/d3/de/d33 0 2024-04-13T10:58:35.640 INFO:tasks.workunit.client.1.smithi194.stdout:5/150: fdatasync d3/dc/d10/f11 0 2024-04-13T10:58:35.643 INFO:tasks.workunit.client.1.smithi194.stdout:5/151: dread d3/dc/f18 [0,4194304] 0 2024-04-13T10:58:35.682 INFO:tasks.workunit.client.1.smithi194.stdout:0/178: sync 2024-04-13T10:58:35.691 INFO:tasks.workunit.client.1.smithi194.stdout:3/189: rmdir d2/d3/d12/d21 39 2024-04-13T10:58:35.691 INFO:tasks.workunit.client.1.smithi194.stdout:3/190: stat d2/l19 0 2024-04-13T10:58:35.693 INFO:tasks.workunit.client.1.smithi194.stdout:9/154: creat d0/f37 x:0 0 0 2024-04-13T10:58:35.693 INFO:tasks.workunit.client.1.smithi194.stdout:9/155: dread - d0/d6/d14/d26/f34 zero size 2024-04-13T10:58:35.696 INFO:tasks.workunit.client.1.smithi194.stdout:4/209: write d2/f19 [977938,7894] 0 2024-04-13T10:58:35.699 INFO:tasks.workunit.client.1.smithi194.stdout:2/209: readlink d2/d5/l18 0 2024-04-13T10:58:35.699 INFO:tasks.workunit.client.1.smithi194.stdout:2/210: fdatasync d2/d3/de/d17/d1e/f2c 0 2024-04-13T10:58:35.700 INFO:tasks.workunit.client.1.smithi194.stdout:2/211: write d2/d3/de/d17/d1e/f2c [13107814,105439] 0 2024-04-13T10:58:35.705 INFO:tasks.workunit.client.1.smithi194.stdout:5/152: creat d3/dc/f2c x:0 0 0 2024-04-13T10:58:35.709 INFO:tasks.workunit.client.1.smithi194.stdout:7/188: creat d1/d2b/d2c/d30/d37/d3c/f40 x:0 0 0 2024-04-13T10:58:35.710 INFO:tasks.workunit.client.1.smithi194.stdout:6/161: truncate d0/d26/f15 1735867 0 2024-04-13T10:58:35.711 INFO:tasks.workunit.client.1.smithi194.stdout:9/156: unlink d0/d6/d9/f32 0 2024-04-13T10:58:35.714 INFO:tasks.workunit.client.1.smithi194.stdout:4/210: rmdir d2/d16 39 2024-04-13T10:58:35.718 INFO:tasks.workunit.client.1.smithi194.stdout:9/157: dwrite d0/d6/d9/fc [0,4194304] 0 2024-04-13T10:58:35.718 INFO:tasks.workunit.client.1.smithi194.stdout:9/158: readlink d0/lb 0 2024-04-13T10:58:35.721 INFO:tasks.workunit.client.1.smithi194.stdout:2/212: creat d2/d5/f4c x:0 0 0 2024-04-13T10:58:35.722 INFO:tasks.workunit.client.1.smithi194.stdout:2/213: dread - d2/d5/f2f zero size 2024-04-13T10:58:35.723 INFO:tasks.workunit.client.1.smithi194.stdout:7/189: dread d1/f8 [0,4194304] 0 2024-04-13T10:58:35.723 INFO:tasks.workunit.client.1.smithi194.stdout:1/193: getdents d12 0 2024-04-13T10:58:35.726 INFO:tasks.workunit.client.1.smithi194.stdout:7/190: dread d1/f8 [0,4194304] 0 2024-04-13T10:58:35.727 INFO:tasks.workunit.client.1.smithi194.stdout:5/153: truncate d3/dc/d10/f14 926057 0 2024-04-13T10:58:35.727 INFO:tasks.workunit.client.1.smithi194.stdout:9/159: dread d0/d11/f1d [0,4194304] 0 2024-04-13T10:58:35.727 INFO:tasks.workunit.client.1.smithi194.stdout:1/194: dread d12/d13/d1c/f21 [0,4194304] 0 2024-04-13T10:58:35.728 INFO:tasks.workunit.client.1.smithi194.stdout:1/195: stat d12/d13/c17 0 2024-04-13T10:58:35.729 INFO:tasks.workunit.client.1.smithi194.stdout:0/179: symlink d9/db/d3a/l3f 0 2024-04-13T10:58:35.729 INFO:tasks.workunit.client.1.smithi194.stdout:0/180: stat f1 0 2024-04-13T10:58:35.731 INFO:tasks.workunit.client.1.smithi194.stdout:3/191: symlink d2/d3/d12/d31/l33 0 2024-04-13T10:58:35.734 INFO:tasks.workunit.client.1.smithi194.stdout:3/192: dread d2/f27 [0,4194304] 0 2024-04-13T10:58:35.734 INFO:tasks.workunit.client.1.smithi194.stdout:3/193: dread - d2/f30 zero size 2024-04-13T10:58:35.736 INFO:tasks.workunit.client.1.smithi194.stdout:3/194: write d2/d3/d1a/f2e [1838461,31133] 0 2024-04-13T10:58:35.743 INFO:tasks.workunit.client.1.smithi194.stdout:2/214: rmdir d2/d3/de/d33 39 2024-04-13T10:58:35.749 INFO:tasks.workunit.client.1.smithi194.stdout:2/215: dwrite d2/d3/f2d [4194304,4194304] 0 2024-04-13T10:58:35.749 INFO:tasks.workunit.client.1.smithi194.stdout:5/154: mkdir d3/dc/d2d 0 2024-04-13T10:58:35.752 INFO:tasks.workunit.client.1.smithi194.stdout:9/160: creat d0/d6/d14/d26/f38 x:0 0 0 2024-04-13T10:58:35.759 INFO:tasks.workunit.client.1.smithi194.stdout:9/161: dwrite d0/d11/f31 [0,4194304] 0 2024-04-13T10:58:35.760 INFO:tasks.workunit.client.1.smithi194.stdout:9/162: chown d0/d11/d1e 2116521 1 2024-04-13T10:58:35.761 INFO:tasks.workunit.client.1.smithi194.stdout:9/163: write d0/d11/f31 [1294836,28228] 0 2024-04-13T10:58:35.766 INFO:tasks.workunit.client.1.smithi194.stdout:3/195: mkdir d2/d3/d12/d31/d34 0 2024-04-13T10:58:35.767 INFO:tasks.workunit.client.1.smithi194.stdout:3/196: write d2/d3/d1a/f2e [2139759,33053] 0 2024-04-13T10:58:35.768 INFO:tasks.workunit.client.1.smithi194.stdout:8/173: getdents d6/d22/d23 0 2024-04-13T10:58:35.771 INFO:tasks.workunit.client.1.smithi194.stdout:4/211: creat d2/d16/d1a/d1c/f41 x:0 0 0 2024-04-13T10:58:35.773 INFO:tasks.workunit.client.1.smithi194.stdout:8/174: dwrite d6/dd/f19 [0,4194304] 0 2024-04-13T10:58:35.780 INFO:tasks.workunit.client.1.smithi194.stdout:5/155: write d3/dc/d17/d1b/f21 [596430,13702] 0 2024-04-13T10:58:35.780 INFO:tasks.workunit.client.1.smithi194.stdout:2/216: dread d2/d3/de/d17/d1e/f2c [8388608,4194304] 0 2024-04-13T10:58:35.782 INFO:tasks.workunit.client.1.smithi194.stdout:1/196: symlink d12/d13/l38 0 2024-04-13T10:58:35.785 INFO:tasks.workunit.client.1.smithi194.stdout:5/156: dread d3/dc/d17/f19 [0,4194304] 0 2024-04-13T10:58:35.788 INFO:tasks.workunit.client.1.smithi194.stdout:2/217: dwrite d2/d5/f4b [0,4194304] 0 2024-04-13T10:58:35.788 INFO:tasks.workunit.client.1.smithi194.stdout:6/162: mkdir d0/d26/d2b 0 2024-04-13T10:58:35.790 INFO:tasks.workunit.client.1.smithi194.stdout:2/218: chown d2/d3/de/d17/d36/l49 14953 1 2024-04-13T10:58:35.792 INFO:tasks.workunit.client.1.smithi194.stdout:9/164: rename d0/cf to d0/d6/d14/c39 0 2024-04-13T10:58:35.793 INFO:tasks.workunit.client.1.smithi194.stdout:7/191: truncate d1/d2b/d2c/d30/f32 155268 0 2024-04-13T10:58:35.795 INFO:tasks.workunit.client.1.smithi194.stdout:2/219: dread d2/d5/f1d [0,4194304] 0 2024-04-13T10:58:35.799 INFO:tasks.workunit.client.1.smithi194.stdout:3/197: mknod d2/d3/d1a/c35 0 2024-04-13T10:58:35.805 INFO:tasks.workunit.client.1.smithi194.stdout:1/197: rmdir d12/d13/d1c/d27/d2e 39 2024-04-13T10:58:35.806 INFO:tasks.workunit.client.1.smithi194.stdout:3/198: dwrite d2/d3/d1a/d24/f28 [0,4194304] 0 2024-04-13T10:58:35.808 INFO:tasks.workunit.client.1.smithi194.stdout:4/212: dwrite d2/d33/f17 [0,4194304] 0 2024-04-13T10:58:35.808 INFO:tasks.workunit.client.1.smithi194.stdout:5/157: write d3/dc/d17/f19 [580774,43498] 0 2024-04-13T10:58:35.809 INFO:tasks.workunit.client.1.smithi194.stdout:5/158: fsync d3/dc/d17/f28 0 2024-04-13T10:58:35.814 INFO:tasks.workunit.client.1.smithi194.stdout:9/165: chown d0/l2d 7484 1 2024-04-13T10:58:35.817 INFO:tasks.workunit.client.1.smithi194.stdout:7/192: unlink d1/d13/f28 0 2024-04-13T10:58:35.819 INFO:tasks.workunit.client.1.smithi194.stdout:2/220: symlink d2/d5/l4d 0 2024-04-13T10:58:35.820 INFO:tasks.workunit.client.1.smithi194.stdout:2/221: write d2/d5/f4c [936175,67618] 0 2024-04-13T10:58:35.825 INFO:tasks.workunit.client.1.smithi194.stdout:1/198: symlink d12/l39 0 2024-04-13T10:58:35.828 INFO:tasks.workunit.client.1.smithi194.stdout:4/213: mkdir d2/d16/d1a/d1c/d3b/d42 0 2024-04-13T10:58:35.828 INFO:tasks.workunit.client.1.smithi194.stdout:3/199: dread d2/fd [0,4194304] 0 2024-04-13T10:58:35.829 INFO:tasks.workunit.client.1.smithi194.stdout:4/214: write d2/d16/d1a/f35 [1030111,70617] 0 2024-04-13T10:58:35.829 INFO:tasks.workunit.client.1.smithi194.stdout:6/163: mkdir d0/d2c 0 2024-04-13T10:58:35.829 INFO:tasks.workunit.client.1.smithi194.stdout:3/200: fsync d2/f5 0 2024-04-13T10:58:35.830 INFO:tasks.workunit.client.1.smithi194.stdout:4/215: write d2/ff [2284794,55546] 0 2024-04-13T10:58:35.832 INFO:tasks.workunit.client.1.smithi194.stdout:4/216: read - d2/d16/d1a/d1c/f41 zero size 2024-04-13T10:58:35.836 INFO:tasks.workunit.client.1.smithi194.stdout:8/175: link d6/d22/d23/l28 d6/d22/d23/d25/d30/l3e 0 2024-04-13T10:58:35.837 INFO:tasks.workunit.client.1.smithi194.stdout:8/176: chown d6/d22/d23/d25/c2f 4 1 2024-04-13T10:58:35.839 INFO:tasks.workunit.client.1.smithi194.stdout:8/177: write d6/d22/d23/d25/d30/d33/f3a [10504374,101766] 0 2024-04-13T10:58:35.841 INFO:tasks.workunit.client.1.smithi194.stdout:2/222: dwrite d2/d3/de/d17/d1e/f2c [4194304,4194304] 0 2024-04-13T10:58:35.846 INFO:tasks.workunit.client.1.smithi194.stdout:3/201: stat d2/d3/d12/d21 0 2024-04-13T10:58:35.850 INFO:tasks.workunit.client.1.smithi194.stdout:2/223: dwrite d2/d3/ff [0,4194304] 0 2024-04-13T10:58:35.855 INFO:tasks.workunit.client.1.smithi194.stdout:3/202: dread d2/d3/d1a/f2e [0,4194304] 0 2024-04-13T10:58:35.861 INFO:tasks.workunit.client.1.smithi194.stdout:7/193: creat d1/f41 x:0 0 0 2024-04-13T10:58:35.863 INFO:tasks.workunit.client.1.smithi194.stdout:5/159: write d3/dc/d10/f14 [1221745,21439] 0 2024-04-13T10:58:35.865 INFO:tasks.workunit.client.1.smithi194.stdout:7/194: dread d1/f16 [0,4194304] 0 2024-04-13T10:58:35.865 INFO:tasks.workunit.client.1.smithi194.stdout:5/160: readlink d3/dc/d17/d1b/l24 0 2024-04-13T10:58:35.866 INFO:tasks.workunit.client.1.smithi194.stdout:2/224: mknod d2/d3/c4e 0 2024-04-13T10:58:35.868 INFO:tasks.workunit.client.1.smithi194.stdout:8/178: symlink d6/l3f 0 2024-04-13T10:58:35.869 INFO:tasks.workunit.client.1.smithi194.stdout:8/179: fdatasync d6/f1e 0 2024-04-13T10:58:35.870 INFO:tasks.workunit.client.1.smithi194.stdout:8/180: dread - d6/d22/d23/d25/f36 zero size 2024-04-13T10:58:35.870 INFO:tasks.workunit.client.1.smithi194.stdout:5/161: dwrite d3/dc/f25 [0,4194304] 0 2024-04-13T10:58:35.871 INFO:tasks.workunit.client.1.smithi194.stdout:5/162: readlink d3/l2b 0 2024-04-13T10:58:35.871 INFO:tasks.workunit.client.1.smithi194.stdout:5/163: stat d3/cd 0 2024-04-13T10:58:35.871 INFO:tasks.workunit.client.1.smithi194.stdout:0/181: sync 2024-04-13T10:58:35.872 INFO:tasks.workunit.client.1.smithi194.stdout:1/199: mkdir d12/d3a 0 2024-04-13T10:58:35.873 INFO:tasks.workunit.client.1.smithi194.stdout:5/164: write d3/dc/d17/f1c [1556710,106223] 0 2024-04-13T10:58:35.878 INFO:tasks.workunit.client.1.smithi194.stdout:4/217: link d2/d16/d1a/d1c/f39 d2/d16/d1a/f43 0 2024-04-13T10:58:35.879 INFO:tasks.workunit.client.1.smithi194.stdout:7/195: creat d1/d2b/d2c/d30/d37/d3c/f42 x:0 0 0 2024-04-13T10:58:35.883 INFO:tasks.workunit.client.1.smithi194.stdout:6/164: rename d0/ce to d0/c2d 0 2024-04-13T10:58:35.883 INFO:tasks.workunit.client.1.smithi194.stdout:2/225: read d2/d3/de/d33/f35 [900064,113679] 0 2024-04-13T10:58:35.884 INFO:tasks.workunit.client.1.smithi194.stdout:2/226: chown d2/d3/d12/f1c 86749957 1 2024-04-13T10:58:35.885 INFO:tasks.workunit.client.1.smithi194.stdout:2/227: read d2/d3/de/d17/d1e/f3f [3135876,7152] 0 2024-04-13T10:58:35.887 INFO:tasks.workunit.client.1.smithi194.stdout:2/228: write d2/d3/de/d17/d36/f38 [485515,83822] 0 2024-04-13T10:58:35.889 INFO:tasks.workunit.client.1.smithi194.stdout:6/165: dwrite d0/d26/f14 [0,4194304] 0 2024-04-13T10:58:35.890 INFO:tasks.workunit.client.1.smithi194.stdout:2/229: write d2/d3/de/d17/d1e/f2c [6276636,121348] 0 2024-04-13T10:58:35.891 INFO:tasks.workunit.client.1.smithi194.stdout:5/165: creat d3/dc/d10/f2e x:0 0 0 2024-04-13T10:58:35.891 INFO:tasks.workunit.client.1.smithi194.stdout:6/166: dread - d0/d26/f20 zero size 2024-04-13T10:58:35.891 INFO:tasks.workunit.client.1.smithi194.stdout:4/218: fdatasync d2/d16/d1a/f36 0 2024-04-13T10:58:35.892 INFO:tasks.workunit.client.1.smithi194.stdout:5/166: chown d3/f1f 31166 1 2024-04-13T10:58:35.897 INFO:tasks.workunit.client.1.smithi194.stdout:3/203: link d2/de/l10 d2/d3/d1a/d24/l36 0 2024-04-13T10:58:35.898 INFO:tasks.workunit.client.1.smithi194.stdout:8/181: creat d6/d22/d23/d3d/f40 x:0 0 0 2024-04-13T10:58:35.899 INFO:tasks.workunit.client.1.smithi194.stdout:2/230: dwrite d2/d3/ff [0,4194304] 0 2024-04-13T10:58:35.900 INFO:tasks.workunit.client.1.smithi194.stdout:8/182: write d6/f1e [235368,19508] 0 2024-04-13T10:58:35.908 INFO:tasks.workunit.client.1.smithi194.stdout:2/231: dread d2/d5/f4b [0,4194304] 0 2024-04-13T10:58:35.909 INFO:tasks.workunit.client.1.smithi194.stdout:2/232: readlink d2/d3/de/d3c/l46 0 2024-04-13T10:58:35.911 INFO:tasks.workunit.client.1.smithi194.stdout:4/219: mkdir d2/d16/d1a/d1d/d31/d44 0 2024-04-13T10:58:35.915 INFO:tasks.workunit.client.1.smithi194.stdout:9/166: sync 2024-04-13T10:58:35.917 INFO:tasks.workunit.client.1.smithi194.stdout:4/220: dwrite d2/d16/d1a/d1d/f26 [0,4194304] 0 2024-04-13T10:58:35.920 INFO:tasks.workunit.client.1.smithi194.stdout:3/204: rmdir d2/d3/d1a 39 2024-04-13T10:58:35.925 INFO:tasks.workunit.client.1.smithi194.stdout:4/221: dread d2/d33/f17 [0,4194304] 0 2024-04-13T10:58:35.926 INFO:tasks.workunit.client.1.smithi194.stdout:2/233: symlink d2/d3/de/d17/d1e/l4f 0 2024-04-13T10:58:35.926 INFO:tasks.workunit.client.1.smithi194.stdout:9/167: mknod d0/d6/d2c/c3a 0 2024-04-13T10:58:35.929 INFO:tasks.workunit.client.1.smithi194.stdout:2/234: chown d2/d3/de/d17/d36/d3d/f3e 8766246 1 2024-04-13T10:58:35.930 INFO:tasks.workunit.client.1.smithi194.stdout:7/196: getdents d1 0 2024-04-13T10:58:35.931 INFO:tasks.workunit.client.1.smithi194.stdout:8/183: dwrite d6/f1c [0,4194304] 0 2024-04-13T10:58:35.932 INFO:tasks.workunit.client.1.smithi194.stdout:2/235: readlink d2/d5/l18 0 2024-04-13T10:58:35.933 INFO:tasks.workunit.client.1.smithi194.stdout:7/197: chown d1/c2f 17402991 1 2024-04-13T10:58:35.934 INFO:tasks.workunit.client.1.smithi194.stdout:6/167: link d0/f2a d0/f2e 0 2024-04-13T10:58:35.934 INFO:tasks.workunit.client.1.smithi194.stdout:6/168: chown d0/d26 14 1 2024-04-13T10:58:35.935 INFO:tasks.workunit.client.1.smithi194.stdout:9/168: mkdir d0/d6/d14/d26/d3b 0 2024-04-13T10:58:35.936 INFO:tasks.workunit.client.1.smithi194.stdout:5/167: getdents d3/dc/d10 0 2024-04-13T10:58:35.936 INFO:tasks.workunit.client.1.smithi194.stdout:9/169: write d0/d11/f31 [3229691,35761] 0 2024-04-13T10:58:35.938 INFO:tasks.workunit.client.1.smithi194.stdout:9/170: fdatasync d0/d6/d14/f1a 0 2024-04-13T10:58:35.939 INFO:tasks.workunit.client.1.smithi194.stdout:8/184: mkdir d6/d22/d23/d25/d39/d41 0 2024-04-13T10:58:35.946 INFO:tasks.workunit.client.1.smithi194.stdout:9/171: unlink d0/d6/d9/fc 0 2024-04-13T10:58:35.947 INFO:tasks.workunit.client.1.smithi194.stdout:8/185: mknod d6/d2a/c42 0 2024-04-13T10:58:35.947 INFO:tasks.workunit.client.1.smithi194.stdout:0/182: dwrite d9/f22 [0,4194304] 0 2024-04-13T10:58:35.947 INFO:tasks.workunit.client.1.smithi194.stdout:6/169: getdents d0/d2c 0 2024-04-13T10:58:35.948 INFO:tasks.workunit.client.1.smithi194.stdout:0/183: stat d9/d2b/f31 0 2024-04-13T10:58:35.949 INFO:tasks.workunit.client.1.smithi194.stdout:7/198: truncate d1/d13/f1c 8383265 0 2024-04-13T10:58:35.949 INFO:tasks.workunit.client.1.smithi194.stdout:6/170: dread - d0/d26/f29 zero size 2024-04-13T10:58:35.949 INFO:tasks.workunit.client.1.smithi194.stdout:7/199: fdatasync d1/f24 0 2024-04-13T10:58:35.952 INFO:tasks.workunit.client.1.smithi194.stdout:9/172: creat d0/d11/f3c x:0 0 0 2024-04-13T10:58:35.956 INFO:tasks.workunit.client.1.smithi194.stdout:8/186: dread d6/f1d [0,4194304] 0 2024-04-13T10:58:35.956 INFO:tasks.workunit.client.1.smithi194.stdout:6/171: unlink d0/d26/c28 0 2024-04-13T10:58:35.957 INFO:tasks.workunit.client.1.smithi194.stdout:6/172: read d0/d26/f14 [2016218,28797] 0 2024-04-13T10:58:35.957 INFO:tasks.workunit.client.1.smithi194.stdout:1/200: truncate d12/f1a 359173 0 2024-04-13T10:58:35.960 INFO:tasks.workunit.client.1.smithi194.stdout:9/173: mkdir d0/d11/d3d 0 2024-04-13T10:58:35.962 INFO:tasks.workunit.client.1.smithi194.stdout:5/168: getdents d3/dc 0 2024-04-13T10:58:35.962 INFO:tasks.workunit.client.1.smithi194.stdout:9/174: dread - d0/d11/f25 zero size 2024-04-13T10:58:35.963 INFO:tasks.workunit.client.1.smithi194.stdout:5/169: readlink d3/dc/l12 0 2024-04-13T10:58:35.964 INFO:tasks.workunit.client.1.smithi194.stdout:9/175: readlink d0/lb 0 2024-04-13T10:58:35.965 INFO:tasks.workunit.client.1.smithi194.stdout:0/184: link d9/db/f38 d9/db/d3a/f40 0 2024-04-13T10:58:35.966 INFO:tasks.workunit.client.1.smithi194.stdout:1/201: dwrite f10 [0,4194304] 0 2024-04-13T10:58:35.966 INFO:tasks.workunit.client.1.smithi194.stdout:9/176: write d0/d6/d14/f1a [3990126,2917] 0 2024-04-13T10:58:35.966 INFO:tasks.workunit.client.1.smithi194.stdout:7/200: mknod d1/d2b/d2c/c43 0 2024-04-13T10:58:35.967 INFO:tasks.workunit.client.1.smithi194.stdout:0/185: chown d9/fd 1 1 2024-04-13T10:58:35.969 INFO:tasks.workunit.client.1.smithi194.stdout:0/186: write d9/db/d19/d28/f1e [2413688,4770] 0 2024-04-13T10:58:35.970 INFO:tasks.workunit.client.1.smithi194.stdout:6/173: mkdir d0/d2f 0 2024-04-13T10:58:35.971 INFO:tasks.workunit.client.1.smithi194.stdout:5/170: read d3/f1f [3218817,111738] 0 2024-04-13T10:58:35.973 INFO:tasks.workunit.client.1.smithi194.stdout:5/171: chown d3/dc/d10/d20 221716073 1 2024-04-13T10:58:35.974 INFO:tasks.workunit.client.1.smithi194.stdout:9/177: readlink d0/d6/l18 0 2024-04-13T10:58:35.975 INFO:tasks.workunit.client.1.smithi194.stdout:5/172: write d3/f9 [420112,63460] 0 2024-04-13T10:58:35.976 INFO:tasks.workunit.client.1.smithi194.stdout:9/178: stat d0/d6/d9/c30 0 2024-04-13T10:58:35.976 INFO:tasks.workunit.client.1.smithi194.stdout:4/222: dwrite d2/d33/f2e [4194304,4194304] 0 2024-04-13T10:58:35.978 INFO:tasks.workunit.client.1.smithi194.stdout:0/187: symlink d9/df/l41 0 2024-04-13T10:58:35.983 INFO:tasks.workunit.client.1.smithi194.stdout:7/201: dread d1/d13/f1f [0,4194304] 0 2024-04-13T10:58:35.984 INFO:tasks.workunit.client.1.smithi194.stdout:6/174: readlink d0/l1e 0 2024-04-13T10:58:35.985 INFO:tasks.workunit.client.1.smithi194.stdout:1/202: creat d12/d13/d1c/d28/f3b x:0 0 0 2024-04-13T10:58:35.987 INFO:tasks.workunit.client.1.smithi194.stdout:1/203: write ff [5391866,129253] 0 2024-04-13T10:58:35.989 INFO:tasks.workunit.client.1.smithi194.stdout:5/173: dread d3/f1f [0,4194304] 0 2024-04-13T10:58:35.989 INFO:tasks.workunit.client.1.smithi194.stdout:8/187: getdents d6/d22/d23/d25 0 2024-04-13T10:58:35.990 INFO:tasks.workunit.client.1.smithi194.stdout:4/223: mknod d2/d30/c45 0 2024-04-13T10:58:35.991 INFO:tasks.workunit.client.1.smithi194.stdout:0/188: mknod d9/df/d16/c42 0 2024-04-13T10:58:35.991 INFO:tasks.workunit.client.1.smithi194.stdout:5/174: write d3/dc/f25 [2598022,10596] 0 2024-04-13T10:58:35.992 INFO:tasks.workunit.client.1.smithi194.stdout:9/179: creat d0/d6/d14/d26/f3e x:0 0 0 2024-04-13T10:58:35.994 INFO:tasks.workunit.client.1.smithi194.stdout:7/202: stat d1/d13/c38 0 2024-04-13T10:58:35.996 INFO:tasks.workunit.client.1.smithi194.stdout:6/175: write d0/f18 [562500,77355] 0 2024-04-13T10:58:36.003 INFO:tasks.workunit.client.1.smithi194.stdout:7/203: rmdir d1 39 2024-04-13T10:58:36.004 INFO:tasks.workunit.client.1.smithi194.stdout:5/175: mknod d3/c2f 0 2024-04-13T10:58:36.006 INFO:tasks.workunit.client.1.smithi194.stdout:8/188: dwrite d6/dd/f16 [0,4194304] 0 2024-04-13T10:58:36.007 INFO:tasks.workunit.client.1.smithi194.stdout:0/189: dwrite d9/db/f33 [0,4194304] 0 2024-04-13T10:58:36.007 INFO:tasks.workunit.client.1.smithi194.stdout:9/180: creat d0/d11/d3d/f3f x:0 0 0 2024-04-13T10:58:36.007 INFO:tasks.workunit.client.1.smithi194.stdout:6/176: symlink d0/d26/d2b/l30 0 2024-04-13T10:58:36.008 INFO:tasks.workunit.client.1.smithi194.stdout:1/204: truncate d12/d13/d1c/d27/d2e/f36 560427 0 2024-04-13T10:58:36.014 INFO:tasks.workunit.client.1.smithi194.stdout:9/181: read d0/d6/f13 [3020127,73721] 0 2024-04-13T10:58:36.014 INFO:tasks.workunit.client.1.smithi194.stdout:0/190: write d9/db/f33 [2926165,54600] 0 2024-04-13T10:58:36.014 INFO:tasks.workunit.client.1.smithi194.stdout:1/205: chown d12/f1a 28949665 1 2024-04-13T10:58:36.017 INFO:tasks.workunit.client.1.smithi194.stdout:8/189: creat d6/d22/d23/d25/d39/d41/f43 x:0 0 0 2024-04-13T10:58:36.020 INFO:tasks.workunit.client.1.smithi194.stdout:0/191: rmdir d9/db/d19/d28 39 2024-04-13T10:58:36.022 INFO:tasks.workunit.client.1.smithi194.stdout:9/182: dread d0/d11/f1d [0,4194304] 0 2024-04-13T10:58:36.024 INFO:tasks.workunit.client.1.smithi194.stdout:4/224: truncate d2/d16/d1a/f22 5457860 0 2024-04-13T10:58:36.025 INFO:tasks.workunit.client.1.smithi194.stdout:9/183: chown d0/l2d 45 1 2024-04-13T10:58:36.029 INFO:tasks.workunit.client.1.smithi194.stdout:7/204: dwrite d1/d2b/d2c/d30/d37/d3c/f40 [0,4194304] 0 2024-04-13T10:58:36.030 INFO:tasks.workunit.client.1.smithi194.stdout:8/190: dread d6/d22/d23/d25/f27 [0,4194304] 0 2024-04-13T10:58:36.033 INFO:tasks.workunit.client.1.smithi194.stdout:9/184: getdents d0/d6/d14 0 2024-04-13T10:58:36.034 INFO:tasks.workunit.client.1.smithi194.stdout:8/191: dread - d6/d22/f26 zero size 2024-04-13T10:58:36.034 INFO:tasks.workunit.client.1.smithi194.stdout:1/206: write d12/d13/d25/f34 [1264695,93318] 0 2024-04-13T10:58:36.039 INFO:tasks.workunit.client.1.smithi194.stdout:1/207: write f10 [2957007,3511] 0 2024-04-13T10:58:36.041 INFO:tasks.workunit.client.1.smithi194.stdout:5/176: dwrite d3/f1f [4194304,4194304] 0 2024-04-13T10:58:36.042 INFO:tasks.workunit.client.1.smithi194.stdout:9/185: creat d0/d11/f40 x:0 0 0 2024-04-13T10:58:36.044 INFO:tasks.workunit.client.1.smithi194.stdout:4/225: truncate d2/d16/d1a/d1d/d31/f40 952498 0 2024-04-13T10:58:36.045 INFO:tasks.workunit.client.1.smithi194.stdout:6/177: dwrite d0/f2a [0,4194304] 0 2024-04-13T10:58:36.045 INFO:tasks.workunit.client.1.smithi194.stdout:9/186: fsync d0/d11/f3c 0 2024-04-13T10:58:36.050 INFO:tasks.workunit.client.1.smithi194.stdout:7/205: dread d1/d2b/d2c/d30/d37/d3c/f40 [0,4194304] 0 2024-04-13T10:58:36.050 INFO:tasks.workunit.client.1.smithi194.stdout:9/187: write d0/d6/d14/f27 [436602,109271] 0 2024-04-13T10:58:36.053 INFO:tasks.workunit.client.1.smithi194.stdout:9/188: readlink d0/d6/l18 0 2024-04-13T10:58:36.053 INFO:tasks.workunit.client.1.smithi194.stdout:8/192: dread d6/dd/f16 [0,4194304] 0 2024-04-13T10:58:36.057 INFO:tasks.workunit.client.1.smithi194.stdout:4/226: dread d2/fb [0,4194304] 0 2024-04-13T10:58:36.059 INFO:tasks.workunit.client.1.smithi194.stdout:1/208: dwrite d12/d13/d1c/d27/d2e/f36 [0,4194304] 0 2024-04-13T10:58:36.065 INFO:tasks.workunit.client.1.smithi194.stdout:5/177: rename d3/dc/f25 to d3/dc/d10/d20/d23/f30 0 2024-04-13T10:58:36.090 INFO:tasks.workunit.client.1.smithi194.stdout:9/189: creat d0/d11/f41 x:0 0 0 2024-04-13T10:58:36.095 INFO:tasks.workunit.client.1.smithi194.stdout:5/178: readlink d3/dc/lf 0 2024-04-13T10:58:36.097 INFO:tasks.workunit.client.1.smithi194.stdout:6/178: rename d0/d26/f20 to d0/d2c/f31 0 2024-04-13T10:58:36.099 INFO:tasks.workunit.client.1.smithi194.stdout:7/206: mknod d1/d2b/d2c/d30/c44 0 2024-04-13T10:58:36.099 INFO:tasks.workunit.client.1.smithi194.stdout:7/207: chown d1/l10 26 1 2024-04-13T10:58:36.100 INFO:tasks.workunit.client.1.smithi194.stdout:9/190: mkdir d0/d6/d14/d26/d42 0 2024-04-13T10:58:36.101 INFO:tasks.workunit.client.1.smithi194.stdout:5/179: dread d3/dc/d17/d1b/f21 [0,4194304] 0 2024-04-13T10:58:36.101 INFO:tasks.workunit.client.1.smithi194.stdout:1/209: mknod d12/c3c 0 2024-04-13T10:58:36.103 INFO:tasks.workunit.client.1.smithi194.stdout:1/210: chown d12/d13/f18 602 1 2024-04-13T10:58:36.105 INFO:tasks.workunit.client.1.smithi194.stdout:6/179: creat d0/d2c/f32 x:0 0 0 2024-04-13T10:58:36.106 INFO:tasks.workunit.client.1.smithi194.stdout:9/191: write d0/d11/d1e/f2e [1697097,74608] 0 2024-04-13T10:58:36.110 INFO:tasks.workunit.client.1.smithi194.stdout:8/193: rename d6/lc to d6/d22/d23/d25/l44 0 2024-04-13T10:58:36.113 INFO:tasks.workunit.client.1.smithi194.stdout:9/192: fsync d0/d6/d14/d26/f2f 0 2024-04-13T10:58:36.114 INFO:tasks.workunit.client.1.smithi194.stdout:9/193: chown d0/d6/d14/f27 746787308 1 2024-04-13T10:58:36.115 INFO:tasks.workunit.client.1.smithi194.stdout:1/211: creat d12/d3a/f3d x:0 0 0 2024-04-13T10:58:36.116 INFO:tasks.workunit.client.1.smithi194.stdout:8/194: write d6/dd/f16 [3498788,65596] 0 2024-04-13T10:58:36.116 INFO:tasks.workunit.client.1.smithi194.stdout:1/212: readlink d12/d13/d25/l30 0 2024-04-13T10:58:36.120 INFO:tasks.workunit.client.1.smithi194.stdout:9/194: symlink d0/l43 0 2024-04-13T10:58:36.125 INFO:tasks.workunit.client.1.smithi194.stdout:9/195: dread d0/d11/d1e/f2e [0,4194304] 0 2024-04-13T10:58:36.125 INFO:tasks.workunit.client.1.smithi194.stdout:1/213: rename d12/d13/d25 to d12/d13/d3e 0 2024-04-13T10:58:36.125 INFO:tasks.workunit.client.1.smithi194.stdout:1/214: read - d12/f35 zero size 2024-04-13T10:58:36.127 INFO:tasks.workunit.client.1.smithi194.stdout:9/196: mkdir d0/d11/d44 0 2024-04-13T10:58:36.128 INFO:tasks.workunit.client.1.smithi194.stdout:8/195: getdents d6/d22/d23/d25/d30 0 2024-04-13T10:58:36.128 INFO:tasks.workunit.client.1.smithi194.stdout:9/197: readlink d0/d6/d14/d26/l2a 0 2024-04-13T10:58:36.129 INFO:tasks.workunit.client.1.smithi194.stdout:9/198: stat d0/d6/d14/d26/f38 0 2024-04-13T10:58:36.130 INFO:tasks.workunit.client.1.smithi194.stdout:9/199: stat d0/d11/f40 0 2024-04-13T10:58:36.132 INFO:tasks.workunit.client.1.smithi194.stdout:1/215: rename d12/l14 to d12/d13/d1c/l3f 0 2024-04-13T10:58:36.133 INFO:tasks.workunit.client.1.smithi194.stdout:8/196: dread d6/dd/f19 [0,4194304] 0 2024-04-13T10:58:36.133 INFO:tasks.workunit.client.1.smithi194.stdout:8/197: readlink d6/d22/d23/l2b 0 2024-04-13T10:58:36.134 INFO:tasks.workunit.client.1.smithi194.stdout:9/200: mknod d0/d6/d14/c45 0 2024-04-13T10:58:36.138 INFO:tasks.workunit.client.1.smithi194.stdout:8/198: dread d6/f1c [0,4194304] 0 2024-04-13T10:58:36.141 INFO:tasks.workunit.client.1.smithi194.stdout:8/199: dread d6/d2a/f34 [0,4194304] 0 2024-04-13T10:58:36.143 INFO:tasks.workunit.client.1.smithi194.stdout:9/201: dwrite d0/d11/d3d/f3f [0,4194304] 0 2024-04-13T10:58:36.145 INFO:tasks.workunit.client.1.smithi194.stdout:4/227: stat d2/d33/f2e 0 2024-04-13T10:58:36.147 INFO:tasks.workunit.client.1.smithi194.stdout:4/228: mknod d2/d30/c46 0 2024-04-13T10:58:36.147 INFO:tasks.workunit.client.1.smithi194.stdout:8/200: dread d6/f1c [0,4194304] 0 2024-04-13T10:58:36.148 INFO:tasks.workunit.client.1.smithi194.stdout:8/201: write d6/d22/d23/d25/d30/d33/f3c [349831,37829] 0 2024-04-13T10:58:36.150 INFO:tasks.workunit.client.1.smithi194.stdout:4/229: symlink d2/d16/d1a/d1c/d3b/l47 0 2024-04-13T10:58:36.151 INFO:tasks.workunit.client.1.smithi194.stdout:4/230: truncate d2/d16/d1a/f36 211624 0 2024-04-13T10:58:36.152 INFO:tasks.workunit.client.1.smithi194.stdout:8/202: truncate d6/d22/d23/d25/f27 837121 0 2024-04-13T10:58:36.152 INFO:tasks.workunit.client.1.smithi194.stdout:5/180: write d3/dc/d10/f11 [1465876,3475] 0 2024-04-13T10:58:36.154 INFO:tasks.workunit.client.1.smithi194.stdout:5/181: chown d3/dc/d10/f2e 204473 1 2024-04-13T10:58:36.155 INFO:tasks.workunit.client.1.smithi194.stdout:5/182: chown d3/lb 8734 1 2024-04-13T10:58:36.156 INFO:tasks.workunit.client.1.smithi194.stdout:5/183: dread - d3/dc/f2c zero size 2024-04-13T10:58:36.159 INFO:tasks.workunit.client.1.smithi194.stdout:5/184: chown d3/f1f 69486515 1 2024-04-13T10:58:36.159 INFO:tasks.workunit.client.1.smithi194.stdout:4/231: dread d2/d16/d1a/f36 [0,4194304] 0 2024-04-13T10:58:36.163 INFO:tasks.workunit.client.1.smithi194.stdout:9/202: write d0/d11/f1d [1192800,126283] 0 2024-04-13T10:58:36.163 INFO:tasks.workunit.client.1.smithi194.stdout:7/208: dwrite d1/d2b/d2c/d30/f32 [0,4194304] 0 2024-04-13T10:58:36.164 INFO:tasks.workunit.client.1.smithi194.stdout:4/232: read d2/d16/d1a/d1d/f26 [1097751,88556] 0 2024-04-13T10:58:36.166 INFO:tasks.workunit.client.1.smithi194.stdout:7/209: stat d1/l22 0 2024-04-13T10:58:36.167 INFO:tasks.workunit.client.1.smithi194.stdout:9/203: write d0/d11/f41 [466301,95972] 0 2024-04-13T10:58:36.168 INFO:tasks.workunit.client.1.smithi194.stdout:5/185: truncate d3/dc/d17/f28 511776 0 2024-04-13T10:58:36.170 INFO:tasks.workunit.client.1.smithi194.stdout:6/180: dwrite d0/f8 [0,4194304] 0 2024-04-13T10:58:36.172 INFO:tasks.workunit.client.1.smithi194.stdout:9/204: creat d0/d11/d1e/f46 x:0 0 0 2024-04-13T10:58:36.173 INFO:tasks.workunit.client.1.smithi194.stdout:4/233: mkdir d2/d16/d1a/d1c/d3e/d48 0 2024-04-13T10:58:36.175 INFO:tasks.workunit.client.1.smithi194.stdout:7/210: mknod d1/d2b/d2c/d30/d33/d39/c45 0 2024-04-13T10:58:36.175 INFO:tasks.workunit.client.1.smithi194.stdout:4/234: chown d2/d16/d1a/d1c/d3e/d48 27107 1 2024-04-13T10:58:36.177 INFO:tasks.workunit.client.1.smithi194.stdout:6/181: mknod d0/d2c/c33 0 2024-04-13T10:58:36.177 INFO:tasks.workunit.client.1.smithi194.stdout:6/182: chown d0/d26/f14 40 1 2024-04-13T10:58:36.179 INFO:tasks.workunit.client.1.smithi194.stdout:9/205: creat d0/d6/d2c/f47 x:0 0 0 2024-04-13T10:58:36.181 INFO:tasks.workunit.client.1.smithi194.stdout:4/235: creat d2/d30/f49 x:0 0 0 2024-04-13T10:58:36.181 INFO:tasks.workunit.client.1.smithi194.stdout:8/203: dread d6/d22/d23/d25/d30/d33/f3a [4194304,4194304] 0 2024-04-13T10:58:36.182 INFO:tasks.workunit.client.1.smithi194.stdout:4/236: fsync d2/d16/d1a/f2f 0 2024-04-13T10:58:36.184 INFO:tasks.workunit.client.1.smithi194.stdout:6/183: dread d0/d26/f15 [0,4194304] 0 2024-04-13T10:58:36.184 INFO:tasks.workunit.client.1.smithi194.stdout:9/206: write d0/d11/d1e/f2e [2529517,114196] 0 2024-04-13T10:58:36.185 INFO:tasks.workunit.client.1.smithi194.stdout:6/184: readlink d0/d26/d2b/l30 0 2024-04-13T10:58:36.185 INFO:tasks.workunit.client.1.smithi194.stdout:8/204: mkdir d6/dd/d45 0 2024-04-13T10:58:36.186 INFO:tasks.workunit.client.1.smithi194.stdout:8/205: read d6/d22/d23/d25/d30/d33/f3a [4286033,109493] 0 2024-04-13T10:58:36.187 INFO:tasks.workunit.client.1.smithi194.stdout:5/186: link d3/dc/d10/l2a d3/dc/d10/d20/d23/l31 0 2024-04-13T10:58:36.190 INFO:tasks.workunit.client.1.smithi194.stdout:9/207: creat d0/d6/d9/f48 x:0 0 0 2024-04-13T10:58:36.191 INFO:tasks.workunit.client.1.smithi194.stdout:9/208: write d0/d11/d1e/f46 [448690,87458] 0 2024-04-13T10:58:36.192 INFO:tasks.workunit.client.1.smithi194.stdout:8/206: rename l3 to d6/dd/d45/l46 0 2024-04-13T10:58:36.198 INFO:tasks.workunit.client.1.smithi194.stdout:9/209: symlink d0/d6/d14/l49 0 2024-04-13T10:58:36.198 INFO:tasks.workunit.client.1.smithi194.stdout:8/207: write d6/d22/d23/d25/d30/d33/f3a [204901,49200] 0 2024-04-13T10:58:36.199 INFO:tasks.workunit.client.1.smithi194.stdout:8/208: chown d6/d22/d23/d25/d39/d41/f43 274658514 1 2024-04-13T10:58:36.201 INFO:tasks.workunit.client.1.smithi194.stdout:7/211: link d1/d13/l25 d1/d2b/d2c/d30/l46 0 2024-04-13T10:58:36.203 INFO:tasks.workunit.client.1.smithi194.stdout:7/212: write d1/d2b/d2c/d30/d33/d39/f3d [513161,87778] 0 2024-04-13T10:58:36.203 INFO:tasks.workunit.client.1.smithi194.stdout:6/185: creat d0/f34 x:0 0 0 2024-04-13T10:58:36.204 INFO:tasks.workunit.client.1.smithi194.stdout:5/187: link d3/dc/l12 d3/dc/d10/d20/l32 0 2024-04-13T10:58:36.204 INFO:tasks.workunit.client.1.smithi194.stdout:4/237: write d2/d16/d1a/d1d/d31/f40 [1835481,89831] 0 2024-04-13T10:58:36.206 INFO:tasks.workunit.client.1.smithi194.stdout:6/186: mknod d0/d2c/c35 0 2024-04-13T10:58:36.208 INFO:tasks.workunit.client.1.smithi194.stdout:8/209: dwrite d6/f21 [0,4194304] 0 2024-04-13T10:58:36.209 INFO:tasks.workunit.client.1.smithi194.stdout:7/213: chown d1/d2b/d2c/d30/d33/c34 95 1 2024-04-13T10:58:36.209 INFO:tasks.workunit.client.1.smithi194.stdout:8/210: write d6/f1e [543935,129876] 0 2024-04-13T10:58:36.212 INFO:tasks.workunit.client.1.smithi194.stdout:4/238: chown d2/d33/l37 950321 1 2024-04-13T10:58:36.213 INFO:tasks.workunit.client.1.smithi194.stdout:5/188: write d3/dc/d10/d20/d23/f30 [3764314,24368] 0 2024-04-13T10:58:36.214 INFO:tasks.workunit.client.1.smithi194.stdout:6/187: mkdir d0/d26/d2b/d36 0 2024-04-13T10:58:36.214 INFO:tasks.workunit.client.1.smithi194.stdout:7/214: creat d1/d2b/f47 x:0 0 0 2024-04-13T10:58:36.216 INFO:tasks.workunit.client.1.smithi194.stdout:5/189: write d3/dc/d10/f2e [303508,40103] 0 2024-04-13T10:58:36.217 INFO:tasks.workunit.client.1.smithi194.stdout:4/239: symlink d2/d16/d1a/d1d/d31/d44/l4a 0 2024-04-13T10:58:36.217 INFO:tasks.workunit.client.1.smithi194.stdout:6/188: write d0/f21 [1117793,12557] 0 2024-04-13T10:58:36.218 INFO:tasks.workunit.client.1.smithi194.stdout:6/189: readlink d0/l1b 0 2024-04-13T10:58:36.219 INFO:tasks.workunit.client.1.smithi194.stdout:4/240: truncate d2/d16/d1a/d1d/d31/f3a 659725 0 2024-04-13T10:58:36.219 INFO:tasks.workunit.client.1.smithi194.stdout:4/241: stat d2/d30 0 2024-04-13T10:58:36.222 INFO:tasks.workunit.client.1.smithi194.stdout:8/211: dread d6/f1e [0,4194304] 0 2024-04-13T10:58:36.222 INFO:tasks.workunit.client.1.smithi194.stdout:7/215: link d1/d2b/d2c/d30/l46 d1/d2b/d2c/d30/d33/d39/l48 0 2024-04-13T10:58:36.223 INFO:tasks.workunit.client.1.smithi194.stdout:6/190: link d0/d2c/c35 d0/d2c/c37 0 2024-04-13T10:58:36.224 INFO:tasks.workunit.client.1.smithi194.stdout:7/216: dread - d1/d2b/f47 zero size 2024-04-13T10:58:36.225 INFO:tasks.workunit.client.1.smithi194.stdout:8/212: creat d6/d22/d23/d3d/f47 x:0 0 0 2024-04-13T10:58:36.227 INFO:tasks.workunit.client.1.smithi194.stdout:6/191: mknod d0/d2f/c38 0 2024-04-13T10:58:36.229 INFO:tasks.workunit.client.1.smithi194.stdout:8/213: rename d6/d22/d23/d25/d39/d41/f43 to d6/dd/f48 0 2024-04-13T10:58:36.229 INFO:tasks.workunit.client.1.smithi194.stdout:7/217: truncate d1/d13/f1c 7175523 0 2024-04-13T10:58:36.231 INFO:tasks.workunit.client.1.smithi194.stdout:6/192: unlink d0/l1b 0 2024-04-13T10:58:36.232 INFO:tasks.workunit.client.1.smithi194.stdout:6/193: chown d0 0 1 2024-04-13T10:58:36.233 INFO:tasks.workunit.client.1.smithi194.stdout:7/218: creat d1/d2b/d2c/d30/d37/f49 x:0 0 0 2024-04-13T10:58:36.235 INFO:tasks.workunit.client.1.smithi194.stdout:6/194: creat d0/d26/d2b/f39 x:0 0 0 2024-04-13T10:58:36.236 INFO:tasks.workunit.client.1.smithi194.stdout:8/214: dwrite d6/dd/f16 [0,4194304] 0 2024-04-13T10:58:36.237 INFO:tasks.workunit.client.1.smithi194.stdout:7/219: mknod d1/d2b/d3e/c4a 0 2024-04-13T10:58:36.239 INFO:tasks.workunit.client.1.smithi194.stdout:4/242: dwrite d2/d16/d1a/f43 [0,4194304] 0 2024-04-13T10:58:36.243 INFO:tasks.workunit.client.1.smithi194.stdout:8/215: write d6/f1e [1324070,34621] 0 2024-04-13T10:58:36.249 INFO:tasks.workunit.client.1.smithi194.stdout:7/220: dwrite d1/f1d [0,4194304] 0 2024-04-13T10:58:36.249 INFO:tasks.workunit.client.1.smithi194.stdout:2/236: sync 2024-04-13T10:58:36.249 INFO:tasks.workunit.client.1.smithi194.stdout:3/205: sync 2024-04-13T10:58:36.251 INFO:tasks.workunit.client.1.smithi194.stdout:4/243: creat d2/d33/f4b x:0 0 0 2024-04-13T10:58:36.255 INFO:tasks.workunit.client.1.smithi194.stdout:8/216: dwrite f5 [0,4194304] 0 2024-04-13T10:58:36.256 INFO:tasks.workunit.client.1.smithi194.stdout:7/221: creat d1/d2b/d2c/d30/d33/d39/f4b x:0 0 0 2024-04-13T10:58:36.257 INFO:tasks.workunit.client.1.smithi194.stdout:8/217: write d6/f21 [2924828,110013] 0 2024-04-13T10:58:36.259 INFO:tasks.workunit.client.1.smithi194.stdout:7/222: read - d1/d2b/d2c/d30/d37/d3c/f42 zero size 2024-04-13T10:58:36.261 INFO:tasks.workunit.client.1.smithi194.stdout:3/206: rmdir d2/d3/d12/d21/d26 0 2024-04-13T10:58:36.262 INFO:tasks.workunit.client.1.smithi194.stdout:2/237: creat d2/d3/de/d33/d47/f50 x:0 0 0 2024-04-13T10:58:36.264 INFO:tasks.workunit.client.1.smithi194.stdout:7/223: mkdir d1/d2b/d4c 0 2024-04-13T10:58:36.265 INFO:tasks.workunit.client.1.smithi194.stdout:4/244: creat d2/d16/d1a/f4c x:0 0 0 2024-04-13T10:58:36.267 INFO:tasks.workunit.client.1.smithi194.stdout:4/245: write d2/d16/d1a/d1d/d31/f40 [859249,102756] 0 2024-04-13T10:58:36.270 INFO:tasks.workunit.client.1.smithi194.stdout:3/207: creat d2/d3/d12/d31/d34/f37 x:0 0 0 2024-04-13T10:58:36.270 INFO:tasks.workunit.client.1.smithi194.stdout:7/224: mkdir d1/d13/d4d 0 2024-04-13T10:58:36.274 INFO:tasks.workunit.client.1.smithi194.stdout:6/195: dread d0/f1a [0,4194304] 0 2024-04-13T10:58:36.275 INFO:tasks.workunit.client.1.smithi194.stdout:8/218: dwrite d6/d22/d23/d3d/f47 [0,4194304] 0 2024-04-13T10:58:36.276 INFO:tasks.workunit.client.1.smithi194.stdout:8/219: write d6/f21 [2738328,83524] 0 2024-04-13T10:58:36.283 INFO:tasks.workunit.client.1.smithi194.stdout:6/196: dwrite d0/d26/f29 [0,4194304] 0 2024-04-13T10:58:36.283 INFO:tasks.workunit.client.1.smithi194.stdout:6/197: stat d0/d26/d2b 0 2024-04-13T10:58:36.332 INFO:tasks.workunit.client.1.smithi194.stdout:4/246: unlink d2/l2b 0 2024-04-13T10:58:36.338 INFO:tasks.workunit.client.1.smithi194.stdout:6/198: chown d0/l1c 3 1 2024-04-13T10:58:36.340 INFO:tasks.workunit.client.1.smithi194.stdout:3/208: rename d2/f17 to d2/d3/d1a/d24/f38 0 2024-04-13T10:58:36.341 INFO:tasks.workunit.client.1.smithi194.stdout:8/220: unlink d6/f21 0 2024-04-13T10:58:36.343 INFO:tasks.workunit.client.1.smithi194.stdout:8/221: dread - d6/d22/d23/d3d/f40 zero size 2024-04-13T10:58:36.343 INFO:tasks.workunit.client.1.smithi194.stdout:6/199: unlink d0/d26/c22 0 2024-04-13T10:58:36.345 INFO:tasks.workunit.client.1.smithi194.stdout:3/209: creat d2/d3/d12/d31/d34/f39 x:0 0 0 2024-04-13T10:58:36.346 INFO:tasks.workunit.client.1.smithi194.stdout:2/238: dwrite d2/d5/f1d [0,4194304] 0 2024-04-13T10:58:36.347 INFO:tasks.workunit.client.1.smithi194.stdout:7/225: rename d1/d13/l17 to d1/d2b/d2c/d30/d37/d3c/l4e 0 2024-04-13T10:58:36.348 INFO:tasks.workunit.client.1.smithi194.stdout:8/222: mknod d6/d22/d23/d25/d30/c49 0 2024-04-13T10:58:36.352 INFO:tasks.workunit.client.1.smithi194.stdout:4/247: truncate d2/d33/f2e 1608327 0 2024-04-13T10:58:36.353 INFO:tasks.workunit.client.1.smithi194.stdout:7/226: mkdir d1/d2b/d4c/d4f 0 2024-04-13T10:58:36.353 INFO:tasks.workunit.client.1.smithi194.stdout:3/210: read d2/de/f1e [189364,115378] 0 2024-04-13T10:58:36.353 INFO:tasks.workunit.client.1.smithi194.stdout:2/239: creat d2/d3/de/d17/d1e/f51 x:0 0 0 2024-04-13T10:58:36.355 INFO:tasks.workunit.client.1.smithi194.stdout:6/200: dwrite d0/f34 [0,4194304] 0 2024-04-13T10:58:36.361 INFO:tasks.workunit.client.1.smithi194.stdout:6/201: creat d0/d26/d2b/f3a x:0 0 0 2024-04-13T10:58:36.365 INFO:tasks.workunit.client.1.smithi194.stdout:8/223: dwrite d6/d22/d23/d25/d30/d33/f3c [0,4194304] 0 2024-04-13T10:58:36.368 INFO:tasks.workunit.client.1.smithi194.stdout:0/192: sync 2024-04-13T10:58:36.368 INFO:tasks.workunit.client.1.smithi194.stdout:7/227: link d1/d13/c2d d1/d2b/d2c/c50 0 2024-04-13T10:58:36.369 INFO:tasks.workunit.client.1.smithi194.stdout:2/240: dread d2/d3/ff [0,4194304] 0 2024-04-13T10:58:36.371 INFO:tasks.workunit.client.1.smithi194.stdout:3/211: dwrite d2/f9 [0,4194304] 0 2024-04-13T10:58:36.374 INFO:tasks.workunit.client.1.smithi194.stdout:2/241: write d2/d3/f2d [8889324,78697] 0 2024-04-13T10:58:36.382 INFO:tasks.workunit.client.1.smithi194.stdout:4/248: dwrite d2/d16/d1a/d1d/d31/f40 [0,4194304] 0 2024-04-13T10:58:36.383 INFO:tasks.workunit.client.1.smithi194.stdout:3/212: fsync d2/d3/d12/f16 0 2024-04-13T10:58:36.383 INFO:tasks.workunit.client.1.smithi194.stdout:6/202: dread d0/f1a [0,4194304] 0 2024-04-13T10:58:36.385 INFO:tasks.workunit.client.1.smithi194.stdout:8/224: dwrite d6/d22/d23/d25/f36 [0,4194304] 0 2024-04-13T10:58:36.385 INFO:tasks.workunit.client.1.smithi194.stdout:7/228: rename d1/d13 to d1/d2b/d4c/d4f/d51 0 2024-04-13T10:58:36.386 INFO:tasks.workunit.client.1.smithi194.stdout:2/242: fdatasync d2/d3/d12/f1c 0 2024-04-13T10:58:36.391 INFO:tasks.workunit.client.1.smithi194.stdout:2/243: read d2/d3/de/d17/d1e/f2c [6578829,73307] 0 2024-04-13T10:58:36.391 INFO:tasks.workunit.client.1.smithi194.stdout:4/249: rmdir d2/d16/d1a/d1d/d31 39 2024-04-13T10:58:36.392 INFO:tasks.workunit.client.1.smithi194.stdout:8/225: mknod d6/d22/d23/d3d/c4a 0 2024-04-13T10:58:36.394 INFO:tasks.workunit.client.1.smithi194.stdout:2/244: chown d2/d3/de/d17/l3b 11206000 1 2024-04-13T10:58:36.397 INFO:tasks.workunit.client.1.smithi194.stdout:2/245: chown d2/d3/de/d17/l3b 885707 1 2024-04-13T10:58:36.397 INFO:tasks.workunit.client.1.smithi194.stdout:0/193: dwrite d9/db/d19/d28/f2e [0,4194304] 0 2024-04-13T10:58:36.398 INFO:tasks.workunit.client.1.smithi194.stdout:8/226: symlink d6/d2a/l4b 0 2024-04-13T10:58:36.399 INFO:tasks.workunit.client.1.smithi194.stdout:4/250: mknod d2/d16/d1a/d1c/d3b/c4d 0 2024-04-13T10:58:36.400 INFO:tasks.workunit.client.1.smithi194.stdout:0/194: chown d9/df/c1a 1 1 2024-04-13T10:58:36.401 INFO:tasks.workunit.client.1.smithi194.stdout:2/246: mkdir d2/d3/de/d17/d1e/d42/d52 0 2024-04-13T10:58:36.401 INFO:tasks.workunit.client.1.smithi194.stdout:8/227: creat d6/d2a/f4c x:0 0 0 2024-04-13T10:58:36.402 INFO:tasks.workunit.client.1.smithi194.stdout:8/228: stat d6/dd/c31 0 2024-04-13T10:58:36.403 INFO:tasks.workunit.client.1.smithi194.stdout:4/251: symlink d2/d16/d1a/d1c/d3e/l4e 0 2024-04-13T10:58:36.404 INFO:tasks.workunit.client.1.smithi194.stdout:4/252: chown d2/d16/d1a/d1d/l2a 4 1 2024-04-13T10:58:36.405 INFO:tasks.workunit.client.1.smithi194.stdout:4/253: chown d2/d16/d1a/d1c 485261 1 2024-04-13T10:58:36.406 INFO:tasks.workunit.client.1.smithi194.stdout:0/195: unlink d9/db/d3a/l3f 0 2024-04-13T10:58:36.408 INFO:tasks.workunit.client.1.smithi194.stdout:2/247: dwrite d2/d5/f44 [0,4194304] 0 2024-04-13T10:58:36.408 INFO:tasks.workunit.client.1.smithi194.stdout:4/254: write d2/d16/d1a/d1c/f41 [665754,121443] 0 2024-04-13T10:58:36.410 INFO:tasks.workunit.client.1.smithi194.stdout:8/229: symlink d6/dd/l4d 0 2024-04-13T10:58:36.414 INFO:tasks.workunit.client.1.smithi194.stdout:8/230: truncate d6/dd/f48 280000 0 2024-04-13T10:58:36.416 INFO:tasks.workunit.client.1.smithi194.stdout:0/196: getdents d9/df/d16 0 2024-04-13T10:58:36.417 INFO:tasks.workunit.client.1.smithi194.stdout:2/248: link d2/d3/de/d17/d36/d3d/f3e d2/d3/de/d17/d36/f53 0 2024-04-13T10:58:36.419 INFO:tasks.workunit.client.1.smithi194.stdout:3/213: dwrite d2/d3/d1a/f2e [0,4194304] 0 2024-04-13T10:58:36.421 INFO:tasks.workunit.client.1.smithi194.stdout:6/203: dwrite d0/f7 [0,4194304] 0 2024-04-13T10:58:36.421 INFO:tasks.workunit.client.1.smithi194.stdout:8/231: creat d6/d22/d23/d25/d39/d41/f4e x:0 0 0 2024-04-13T10:58:36.424 INFO:tasks.workunit.client.1.smithi194.stdout:4/255: dread d2/d33/f17 [0,4194304] 0 2024-04-13T10:58:36.424 INFO:tasks.workunit.client.1.smithi194.stdout:8/232: chown d6/dd/ca 84 1 2024-04-13T10:58:36.424 INFO:tasks.workunit.client.1.smithi194.stdout:2/249: creat d2/d5/f54 x:0 0 0 2024-04-13T10:58:36.426 INFO:tasks.workunit.client.1.smithi194.stdout:3/214: truncate d2/f27 3345713 0 2024-04-13T10:58:36.426 INFO:tasks.workunit.client.1.smithi194.stdout:6/204: mknod d0/d26/c3b 0 2024-04-13T10:58:36.428 INFO:tasks.workunit.client.1.smithi194.stdout:3/215: write d2/f9 [1850284,48085] 0 2024-04-13T10:58:36.434 INFO:tasks.workunit.client.1.smithi194.stdout:2/250: mknod d2/d3/de/d17/c55 0 2024-04-13T10:58:36.435 INFO:tasks.workunit.client.1.smithi194.stdout:8/233: creat d6/d22/d23/d25/d30/f4f x:0 0 0 2024-04-13T10:58:36.435 INFO:tasks.workunit.client.1.smithi194.stdout:6/205: creat d0/d26/d2b/f3c x:0 0 0 2024-04-13T10:58:36.436 INFO:tasks.workunit.client.1.smithi194.stdout:3/216: mkdir d2/d3/d1a/d24/d3a 0 2024-04-13T10:58:36.441 INFO:tasks.workunit.client.1.smithi194.stdout:3/217: read d2/d3/f8 [3195092,50607] 0 2024-04-13T10:58:36.445 INFO:tasks.workunit.client.1.smithi194.stdout:2/251: dwrite d2/d3/d12/f2b [0,4194304] 0 2024-04-13T10:58:36.445 INFO:tasks.workunit.client.1.smithi194.stdout:8/234: dread f5 [0,4194304] 0 2024-04-13T10:58:36.445 INFO:tasks.workunit.client.1.smithi194.stdout:6/206: dread d0/f2e [0,4194304] 0 2024-04-13T10:58:36.447 INFO:tasks.workunit.client.1.smithi194.stdout:3/218: truncate d2/d3/d1a/f2e 4264874 0 2024-04-13T10:58:36.450 INFO:tasks.workunit.client.1.smithi194.stdout:8/235: mknod d6/d22/c50 0 2024-04-13T10:58:36.451 INFO:tasks.workunit.client.1.smithi194.stdout:6/207: mknod d0/d2c/c3d 0 2024-04-13T10:58:36.451 INFO:tasks.workunit.client.1.smithi194.stdout:2/252: symlink d2/d3/de/l56 0 2024-04-13T10:58:36.453 INFO:tasks.workunit.client.1.smithi194.stdout:2/253: write d2/d3/d12/f1b [1049863,30387] 0 2024-04-13T10:58:36.455 INFO:tasks.workunit.client.1.smithi194.stdout:0/197: dread d9/db/f38 [0,4194304] 0 2024-04-13T10:58:36.457 INFO:tasks.workunit.client.1.smithi194.stdout:8/236: creat d6/dd/d45/f51 x:0 0 0 2024-04-13T10:58:36.458 INFO:tasks.workunit.client.1.smithi194.stdout:4/256: dwrite d2/d16/d1a/f22 [0,4194304] 0 2024-04-13T10:58:36.459 INFO:tasks.workunit.client.1.smithi194.stdout:8/237: chown d6/d2a/f4c 8349 1 2024-04-13T10:58:36.459 INFO:tasks.workunit.client.1.smithi194.stdout:2/254: dread d2/d5/f4c [0,4194304] 0 2024-04-13T10:58:36.460 INFO:tasks.workunit.client.1.smithi194.stdout:6/208: link d0/d2c/f32 d0/d2c/f3e 0 2024-04-13T10:58:36.462 INFO:tasks.workunit.client.1.smithi194.stdout:8/238: write d6/d22/d23/d25/d30/d33/f3a [10051495,72346] 0 2024-04-13T10:58:36.463 INFO:tasks.workunit.client.1.smithi194.stdout:0/198: write d9/db/d19/d28/f2f [3435777,22477] 0 2024-04-13T10:58:36.464 INFO:tasks.workunit.client.1.smithi194.stdout:4/257: symlink d2/d30/l4f 0 2024-04-13T10:58:36.465 INFO:tasks.workunit.client.1.smithi194.stdout:4/258: chown d2/d16/d1a/d1d 75992 1 2024-04-13T10:58:36.468 INFO:tasks.workunit.client.1.smithi194.stdout:8/239: write d6/dd/f48 [1254636,10562] 0 2024-04-13T10:58:36.469 INFO:tasks.workunit.client.1.smithi194.stdout:0/199: symlink d9/l43 0 2024-04-13T10:58:36.470 INFO:tasks.workunit.client.1.smithi194.stdout:8/240: chown d6/dd/f16 15 1 2024-04-13T10:58:36.472 INFO:tasks.workunit.client.1.smithi194.stdout:4/259: dwrite d2/d16/d1a/f22 [0,4194304] 0 2024-04-13T10:58:36.472 INFO:tasks.workunit.client.1.smithi194.stdout:8/241: truncate d6/d2a/f4c 711381 0 2024-04-13T10:58:36.473 INFO:tasks.workunit.client.1.smithi194.stdout:4/260: write d2/d16/d1a/d1c/f39 [4002527,29040] 0 2024-04-13T10:58:36.480 INFO:tasks.workunit.client.1.smithi194.stdout:4/261: mkdir d2/d30/d50 0 2024-04-13T10:58:36.481 INFO:tasks.workunit.client.1.smithi194.stdout:9/210: sync 2024-04-13T10:58:36.481 INFO:tasks.workunit.client.1.smithi194.stdout:5/190: sync 2024-04-13T10:58:36.481 INFO:tasks.workunit.client.1.smithi194.stdout:1/216: sync 2024-04-13T10:58:36.482 INFO:tasks.workunit.client.1.smithi194.stdout:0/200: truncate d9/fa 3061139 0 2024-04-13T10:58:36.483 INFO:tasks.workunit.client.1.smithi194.stdout:5/191: write d3/dc/d10/f2e [1106886,28812] 0 2024-04-13T10:58:36.487 INFO:tasks.workunit.client.1.smithi194.stdout:2/255: dread d2/d3/d12/f1c [0,4194304] 0 2024-04-13T10:58:36.489 INFO:tasks.workunit.client.1.smithi194.stdout:1/217: mknod d12/d3a/c40 0 2024-04-13T10:58:36.493 INFO:tasks.workunit.client.1.smithi194.stdout:0/201: symlink d9/db/d19/d28/l44 0 2024-04-13T10:58:36.495 INFO:tasks.workunit.client.1.smithi194.stdout:8/242: creat d6/f52 x:0 0 0 2024-04-13T10:58:36.501 INFO:tasks.workunit.client.1.smithi194.stdout:9/211: mkdir d0/d6/d4a 0 2024-04-13T10:58:36.501 INFO:tasks.workunit.client.1.smithi194.stdout:9/212: chown d0/d11/f41 17832463 1 2024-04-13T10:58:36.503 INFO:tasks.workunit.client.1.smithi194.stdout:2/256: mkdir d2/d5/d57 0 2024-04-13T10:58:36.505 INFO:tasks.workunit.client.1.smithi194.stdout:0/202: symlink d9/db/d3a/l45 0 2024-04-13T10:58:36.507 INFO:tasks.workunit.client.1.smithi194.stdout:8/243: stat d6/dd/d45/l46 0 2024-04-13T10:58:36.510 INFO:tasks.workunit.client.1.smithi194.stdout:4/262: creat d2/d16/d1a/d1d/f51 x:0 0 0 2024-04-13T10:58:36.514 INFO:tasks.workunit.client.1.smithi194.stdout:1/218: unlink d12/d13/c29 0 2024-04-13T10:58:36.522 INFO:tasks.workunit.client.1.smithi194.stdout:1/219: mkdir d12/d13/d1c/d28/d41 0 2024-04-13T10:58:36.526 INFO:tasks.workunit.client.1.smithi194.stdout:4/263: creat d2/d16/d1a/d1c/d3b/d42/f52 x:0 0 0 2024-04-13T10:58:36.528 INFO:tasks.workunit.client.1.smithi194.stdout:2/257: creat d2/d3/de/f58 x:0 0 0 2024-04-13T10:58:36.529 INFO:tasks.workunit.client.1.smithi194.stdout:1/220: creat d12/d13/d3e/f42 x:0 0 0 2024-04-13T10:58:36.532 INFO:tasks.workunit.client.1.smithi194.stdout:8/244: rename d6/d22/d23/d25/d30/d33/c35 to d6/c53 0 2024-04-13T10:58:36.533 INFO:tasks.workunit.client.1.smithi194.stdout:9/213: getdents d0/d6/d14 0 2024-04-13T10:58:36.537 INFO:tasks.workunit.client.1.smithi194.stdout:5/192: dwrite d3/dc/d17/d1b/f21 [0,4194304] 0 2024-04-13T10:58:36.539 INFO:tasks.workunit.client.1.smithi194.stdout:5/193: chown d3/dc/d17/d1b/f21 63 1 2024-04-13T10:58:36.551 INFO:tasks.workunit.client.1.smithi194.stdout:5/194: symlink d3/dc/d10/d20/d23/l33 0 2024-04-13T10:58:36.553 INFO:tasks.workunit.client.1.smithi194.stdout:9/214: creat d0/d6/d14/d26/d42/f4b x:0 0 0 2024-04-13T10:58:36.554 INFO:tasks.workunit.client.1.smithi194.stdout:9/215: write d0/d11/d3d/f3f [364278,77201] 0 2024-04-13T10:58:36.555 INFO:tasks.workunit.client.1.smithi194.stdout:9/216: readlink d0/d11/d1e/l28 0 2024-04-13T10:58:36.581 INFO:tasks.workunit.client.1.smithi194.stdout:1/221: rename f6 to d12/d13/f43 0 2024-04-13T10:58:36.585 INFO:tasks.workunit.client.1.smithi194.stdout:9/217: mkdir d0/d11/d3d/d4c 0 2024-04-13T10:58:36.587 INFO:tasks.workunit.client.1.smithi194.stdout:2/258: write d2/d5/f4b [4218598,106952] 0 2024-04-13T10:58:36.587 INFO:tasks.workunit.client.1.smithi194.stdout:9/218: write d0/d11/d3d/f3f [2140435,78846] 0 2024-04-13T10:58:36.587 INFO:tasks.workunit.client.1.smithi194.stdout:8/245: link d6/f1d d6/d22/d23/f54 0 2024-04-13T10:58:36.588 INFO:tasks.workunit.client.1.smithi194.stdout:8/246: readlink d6/d22/l24 0 2024-04-13T10:58:36.588 INFO:tasks.workunit.client.1.smithi194.stdout:9/219: fdatasync d0/d6/d14/d26/f34 0 2024-04-13T10:58:36.591 INFO:tasks.workunit.client.1.smithi194.stdout:5/195: rename d3/dc/d17/f28 to d3/d29/f34 0 2024-04-13T10:58:36.594 INFO:tasks.workunit.client.1.smithi194.stdout:2/259: mknod d2/d3/de/d17/d39/c59 0 2024-04-13T10:58:36.596 INFO:tasks.workunit.client.1.smithi194.stdout:2/260: dread - d2/d5/f2f zero size 2024-04-13T10:58:36.596 INFO:tasks.workunit.client.1.smithi194.stdout:8/247: dwrite d6/dd/f48 [0,4194304] 0 2024-04-13T10:58:36.597 INFO:tasks.workunit.client.1.smithi194.stdout:1/222: dread ff [0,4194304] 0 2024-04-13T10:58:36.601 INFO:tasks.workunit.client.1.smithi194.stdout:5/196: rename d3/dc/d17/d1b/l24 to d3/dc/d10/d20/d23/l35 0 2024-04-13T10:58:36.601 INFO:tasks.workunit.client.1.smithi194.stdout:5/197: fsync d3/dc/d10/f11 0 2024-04-13T10:58:36.605 INFO:tasks.workunit.client.1.smithi194.stdout:4/264: truncate d2/d16/d1a/d1d/d31/f40 2077158 0 2024-04-13T10:58:36.606 INFO:tasks.workunit.client.1.smithi194.stdout:7/229: sync 2024-04-13T10:58:36.609 INFO:tasks.workunit.client.1.smithi194.stdout:9/220: link d0/d6/d14/d26/f34 d0/f4d 0 2024-04-13T10:58:36.609 INFO:tasks.workunit.client.1.smithi194.stdout:9/221: dread - d0/d6/d14/d26/f38 zero size 2024-04-13T10:58:36.610 INFO:tasks.workunit.client.1.smithi194.stdout:9/222: dread - d0/d11/d1e/f21 zero size 2024-04-13T10:58:36.614 INFO:tasks.workunit.client.1.smithi194.stdout:1/223: mkdir d12/d13/d44 0 2024-04-13T10:58:36.618 INFO:tasks.workunit.client.1.smithi194.stdout:5/198: creat d3/dc/d2d/f36 x:0 0 0 2024-04-13T10:58:36.620 INFO:tasks.workunit.client.1.smithi194.stdout:9/223: symlink d0/d6/d14/l4e 0 2024-04-13T10:58:36.626 INFO:tasks.workunit.client.1.smithi194.stdout:5/199: dwrite d3/dc/d10/d20/d23/f30 [0,4194304] 0 2024-04-13T10:58:36.630 INFO:tasks.workunit.client.1.smithi194.stdout:2/261: write d2/d3/de/d17/d1e/f2c [9852355,108420] 0 2024-04-13T10:58:36.631 INFO:tasks.workunit.client.1.smithi194.stdout:5/200: symlink d3/dc/d10/l37 0 2024-04-13T10:58:36.634 INFO:tasks.workunit.client.1.smithi194.stdout:1/224: dwrite d12/f26 [0,4194304] 0 2024-04-13T10:58:36.637 INFO:tasks.workunit.client.1.smithi194.stdout:9/224: link d0/d6/d14/l16 d0/d6/d14/l4f 0 2024-04-13T10:58:36.639 INFO:tasks.workunit.client.1.smithi194.stdout:5/201: truncate d3/d29/f34 1153134 0 2024-04-13T10:58:36.642 INFO:tasks.workunit.client.1.smithi194.stdout:1/225: write d12/d13/f18 [1212348,129743] 0 2024-04-13T10:58:36.643 INFO:tasks.workunit.client.1.smithi194.stdout:9/225: read d0/f3 [215221,118885] 0 2024-04-13T10:58:36.643 INFO:tasks.workunit.client.1.smithi194.stdout:7/230: dread d1/f1d [0,4194304] 0 2024-04-13T10:58:36.645 INFO:tasks.workunit.client.1.smithi194.stdout:4/265: dwrite d2/d16/d1a/d1d/d31/f40 [0,4194304] 0 2024-04-13T10:58:36.649 INFO:tasks.workunit.client.1.smithi194.stdout:9/226: read - d0/d6/d2c/f47 zero size 2024-04-13T10:58:36.650 INFO:tasks.workunit.client.1.smithi194.stdout:1/226: mknod d12/d13/d3e/c45 0 2024-04-13T10:58:36.651 INFO:tasks.workunit.client.1.smithi194.stdout:5/202: mkdir d3/dc/d10/d38 0 2024-04-13T10:58:36.653 INFO:tasks.workunit.client.1.smithi194.stdout:8/248: dwrite d6/f1d [0,4194304] 0 2024-04-13T10:58:36.654 INFO:tasks.workunit.client.1.smithi194.stdout:4/266: symlink d2/d16/d1a/d1c/d3b/d42/l53 0 2024-04-13T10:58:36.655 INFO:tasks.workunit.client.1.smithi194.stdout:7/231: write d1/d2b/d2c/d30/d37/d3c/f42 [611661,114424] 0 2024-04-13T10:58:36.655 INFO:tasks.workunit.client.1.smithi194.stdout:8/249: stat d6/d22/d23/d25/d30/d33 0 2024-04-13T10:58:36.656 INFO:tasks.workunit.client.1.smithi194.stdout:1/227: creat d12/d13/d1c/d28/f46 x:0 0 0 2024-04-13T10:58:36.661 INFO:tasks.workunit.client.1.smithi194.stdout:2/262: dwrite d2/d5/f44 [0,4194304] 0 2024-04-13T10:58:36.661 INFO:tasks.workunit.client.1.smithi194.stdout:5/203: fsync d3/dc/d17/f19 0 2024-04-13T10:58:36.663 INFO:tasks.workunit.client.1.smithi194.stdout:8/250: readlink d6/d22/d23/l2b 0 2024-04-13T10:58:36.663 INFO:tasks.workunit.client.1.smithi194.stdout:4/267: mkdir d2/d16/d1a/d1c/d54 0 2024-04-13T10:58:36.669 INFO:tasks.workunit.client.1.smithi194.stdout:6/209: sync 2024-04-13T10:58:36.669 INFO:tasks.workunit.client.1.smithi194.stdout:0/203: sync 2024-04-13T10:58:36.669 INFO:tasks.workunit.client.1.smithi194.stdout:3/219: sync 2024-04-13T10:58:36.669 INFO:tasks.workunit.client.1.smithi194.stdout:9/227: link d0/d6/f13 d0/d6/d9/f50 0 2024-04-13T10:58:36.671 INFO:tasks.workunit.client.1.smithi194.stdout:1/228: mkdir d12/d13/d47 0 2024-04-13T10:58:36.671 INFO:tasks.workunit.client.1.smithi194.stdout:1/229: readlink l11 0 2024-04-13T10:58:36.674 INFO:tasks.workunit.client.1.smithi194.stdout:1/230: write f10 [3551103,78158] 0 2024-04-13T10:58:36.677 INFO:tasks.workunit.client.1.smithi194.stdout:2/263: mkdir d2/d3/de/d17/d1e/d42/d52/d5a 0 2024-04-13T10:58:36.678 INFO:tasks.workunit.client.1.smithi194.stdout:4/268: symlink d2/d16/d1a/l55 0 2024-04-13T10:58:36.680 INFO:tasks.workunit.client.1.smithi194.stdout:0/204: mknod d9/db/d19/d30/c46 0 2024-04-13T10:58:36.681 INFO:tasks.workunit.client.1.smithi194.stdout:6/210: dwrite d0/f21 [0,4194304] 0 2024-04-13T10:58:36.681 INFO:tasks.workunit.client.1.smithi194.stdout:7/232: link d1/d2b/d4c/d4f/d51/l35 d1/d2b/d4c/l52 0 2024-04-13T10:58:36.685 INFO:tasks.workunit.client.1.smithi194.stdout:8/251: getdents d6/d22/d23/d25 0 2024-04-13T10:58:36.691 INFO:tasks.workunit.client.1.smithi194.stdout:5/204: truncate d3/dc/d17/d1b/f21 2454109 0 2024-04-13T10:58:36.692 INFO:tasks.workunit.client.1.smithi194.stdout:9/228: dwrite d0/d6/d9/f48 [0,4194304] 0 2024-04-13T10:58:36.695 INFO:tasks.workunit.client.1.smithi194.stdout:1/231: dwrite d12/d3a/f3d [0,4194304] 0 2024-04-13T10:58:36.697 INFO:tasks.workunit.client.1.smithi194.stdout:1/232: chown f10 4 1 2024-04-13T10:58:36.697 INFO:tasks.workunit.client.1.smithi194.stdout:8/252: rmdir d6/d22/d23/d25/d39 39 2024-04-13T10:58:36.698 INFO:tasks.workunit.client.1.smithi194.stdout:0/205: mknod d9/db/d19/c47 0 2024-04-13T10:58:36.701 INFO:tasks.workunit.client.1.smithi194.stdout:3/220: dwrite d2/de/f1e [0,4194304] 0 2024-04-13T10:58:36.701 INFO:tasks.workunit.client.1.smithi194.stdout:7/233: unlink d1/d2b/d4c/d4f/d51/c23 0 2024-04-13T10:58:36.701 INFO:tasks.workunit.client.1.smithi194.stdout:6/211: mkdir d0/d26/d2b/d36/d3f 0 2024-04-13T10:58:36.706 INFO:tasks.workunit.client.1.smithi194.stdout:6/212: dread d0/f2e [0,4194304] 0 2024-04-13T10:58:36.706 INFO:tasks.workunit.client.1.smithi194.stdout:0/206: unlink d9/f22 0 2024-04-13T10:58:36.707 INFO:tasks.workunit.client.1.smithi194.stdout:6/213: write d0/d26/f29 [4791482,78501] 0 2024-04-13T10:58:36.710 INFO:tasks.workunit.client.1.smithi194.stdout:6/214: truncate d0/d26/d2b/f39 67207 0 2024-04-13T10:58:36.712 INFO:tasks.workunit.client.1.smithi194.stdout:0/207: dread d9/db/d3a/f40 [0,4194304] 0 2024-04-13T10:58:36.712 INFO:tasks.workunit.client.1.smithi194.stdout:4/269: rename d2/d16/d1a/d1c/f41 to d2/f56 0 2024-04-13T10:58:36.713 INFO:tasks.workunit.client.1.smithi194.stdout:2/264: getdents d2/d3/de/d17/d1e/d42/d52 0 2024-04-13T10:58:36.713 INFO:tasks.workunit.client.1.smithi194.stdout:3/221: chown d2/de/l10 0 1 2024-04-13T10:58:36.713 INFO:tasks.workunit.client.1.smithi194.stdout:7/234: creat d1/d2b/d4c/d4f/f53 x:0 0 0 2024-04-13T10:58:36.714 INFO:tasks.workunit.client.1.smithi194.stdout:2/265: chown d2/d3/de 0 1 2024-04-13T10:58:36.717 INFO:tasks.workunit.client.1.smithi194.stdout:5/205: creat d3/dc/d17/f39 x:0 0 0 2024-04-13T10:58:36.718 INFO:tasks.workunit.client.1.smithi194.stdout:2/266: read d2/f23 [474540,113446] 0 2024-04-13T10:58:36.718 INFO:tasks.workunit.client.1.smithi194.stdout:1/233: symlink d12/d13/d1c/d28/d41/l48 0 2024-04-13T10:58:36.723 INFO:tasks.workunit.client.1.smithi194.stdout:0/208: creat d9/db/d19/d28/f48 x:0 0 0 2024-04-13T10:58:36.723 INFO:tasks.workunit.client.1.smithi194.stdout:1/234: dread d12/f1a [0,4194304] 0 2024-04-13T10:58:36.725 INFO:tasks.workunit.client.1.smithi194.stdout:7/235: dread - d1/f41 zero size 2024-04-13T10:58:36.725 INFO:tasks.workunit.client.1.smithi194.stdout:4/270: dwrite d2/d16/d1a/d1c/d3b/d42/f52 [0,4194304] 0 2024-04-13T10:58:36.728 INFO:tasks.workunit.client.1.smithi194.stdout:8/253: link d6/dd/f16 d6/f55 0 2024-04-13T10:58:36.731 INFO:tasks.workunit.client.1.smithi194.stdout:4/271: write d2/d16/d1a/d1d/f51 [265926,39415] 0 2024-04-13T10:58:36.732 INFO:tasks.workunit.client.1.smithi194.stdout:7/236: chown d1/d2b/d2c/d30/d37/d3c/f42 437075 1 2024-04-13T10:58:36.733 INFO:tasks.workunit.client.1.smithi194.stdout:5/206: rename d3/c8 to d3/dc/d10/d20/d23/c3a 0 2024-04-13T10:58:36.733 INFO:tasks.workunit.client.1.smithi194.stdout:2/267: dwrite d2/d3/de/f32 [0,4194304] 0 2024-04-13T10:58:36.736 INFO:tasks.workunit.client.1.smithi194.stdout:6/215: dwrite d0/f2e [0,4194304] 0 2024-04-13T10:58:36.739 INFO:tasks.workunit.client.1.smithi194.stdout:1/235: creat d12/d13/d1c/d28/f49 x:0 0 0 2024-04-13T10:58:36.743 INFO:tasks.workunit.client.1.smithi194.stdout:1/236: truncate d12/f35 146060 0 2024-04-13T10:58:36.744 INFO:tasks.workunit.client.1.smithi194.stdout:0/209: getdents d9/db/d19 0 2024-04-13T10:58:36.744 INFO:tasks.workunit.client.1.smithi194.stdout:6/216: fsync d0/d26/f23 0 2024-04-13T10:58:36.747 INFO:tasks.workunit.client.1.smithi194.stdout:7/237: write d1/d2b/d2c/d30/d33/d39/f3d [741394,102882] 0 2024-04-13T10:58:36.747 INFO:tasks.workunit.client.1.smithi194.stdout:3/222: dread d2/fd [0,4194304] 0 2024-04-13T10:58:36.747 INFO:tasks.workunit.client.1.smithi194.stdout:6/217: stat d0/d26/f29 0 2024-04-13T10:58:36.749 INFO:tasks.workunit.client.1.smithi194.stdout:0/210: fsync d9/db/f2a 0 2024-04-13T10:58:36.751 INFO:tasks.workunit.client.1.smithi194.stdout:1/237: rmdir d12/d13 39 2024-04-13T10:58:36.757 INFO:tasks.workunit.client.1.smithi194.stdout:8/254: dread d6/d22/d23/d3d/f47 [0,4194304] 0 2024-04-13T10:58:36.758 INFO:tasks.workunit.client.1.smithi194.stdout:0/211: write d9/db/f33 [4032424,91782] 0 2024-04-13T10:58:36.758 INFO:tasks.workunit.client.1.smithi194.stdout:3/223: dwrite d2/de/f1e [0,4194304] 0 2024-04-13T10:58:36.761 INFO:tasks.workunit.client.1.smithi194.stdout:4/272: truncate d2/d16/d1a/f22 4262996 0 2024-04-13T10:58:36.761 INFO:tasks.workunit.client.1.smithi194.stdout:5/207: dwrite d3/d29/f34 [0,4194304] 0 2024-04-13T10:58:36.762 INFO:tasks.workunit.client.1.smithi194.stdout:3/224: stat d2/de 0 2024-04-13T10:58:36.764 INFO:tasks.workunit.client.1.smithi194.stdout:5/208: stat d3/le 0 2024-04-13T10:58:36.766 INFO:tasks.workunit.client.1.smithi194.stdout:1/238: creat d12/d13/d1c/d28/d41/f4a x:0 0 0 2024-04-13T10:58:36.766 INFO:tasks.workunit.client.1.smithi194.stdout:3/225: chown d2/d3/d1a/f2e 3 1 2024-04-13T10:58:36.767 INFO:tasks.workunit.client.1.smithi194.stdout:8/255: write d6/d22/d23/d3d/f47 [3123114,48801] 0 2024-04-13T10:58:36.770 INFO:tasks.workunit.client.1.smithi194.stdout:6/218: getdents d0/d2f 0 2024-04-13T10:58:36.771 INFO:tasks.workunit.client.1.smithi194.stdout:4/273: dread d2/d16/d1a/d1d/d31/f3a [0,4194304] 0 2024-04-13T10:58:36.775 INFO:tasks.workunit.client.1.smithi194.stdout:1/239: stat d12/f32 0 2024-04-13T10:58:36.775 INFO:tasks.workunit.client.1.smithi194.stdout:7/238: dwrite d1/d2b/d2c/d30/f31 [0,4194304] 0 2024-04-13T10:58:36.776 INFO:tasks.workunit.client.1.smithi194.stdout:4/274: unlink d2/l9 0 2024-04-13T10:58:36.779 INFO:tasks.workunit.client.1.smithi194.stdout:0/212: getdents d9/db/d19/d28 0 2024-04-13T10:58:36.781 INFO:tasks.workunit.client.1.smithi194.stdout:1/240: unlink d12/d13/f43 0 2024-04-13T10:58:36.782 INFO:tasks.workunit.client.1.smithi194.stdout:7/239: write d1/f12 [1614618,46255] 0 2024-04-13T10:58:36.783 INFO:tasks.workunit.client.1.smithi194.stdout:3/226: dwrite d2/f30 [0,4194304] 0 2024-04-13T10:58:36.784 INFO:tasks.workunit.client.1.smithi194.stdout:4/275: symlink d2/d30/l57 0 2024-04-13T10:58:36.786 INFO:tasks.workunit.client.1.smithi194.stdout:4/276: read d2/d33/f17 [2259711,74382] 0 2024-04-13T10:58:36.787 INFO:tasks.workunit.client.1.smithi194.stdout:0/213: creat d9/db/d3a/f49 x:0 0 0 2024-04-13T10:58:36.788 INFO:tasks.workunit.client.1.smithi194.stdout:8/256: write f2 [537176,46637] 0 2024-04-13T10:58:36.789 INFO:tasks.workunit.client.1.smithi194.stdout:1/241: symlink d12/d13/d1c/l4b 0 2024-04-13T10:58:36.789 INFO:tasks.workunit.client.1.smithi194.stdout:6/219: dwrite d0/d2c/f31 [0,4194304] 0 2024-04-13T10:58:36.791 INFO:tasks.workunit.client.1.smithi194.stdout:3/227: rmdir d2/d3/d12 39 2024-04-13T10:58:36.797 INFO:tasks.workunit.client.1.smithi194.stdout:0/214: dwrite d9/df/f3c [0,4194304] 0 2024-04-13T10:58:36.848 INFO:tasks.workunit.client.1.smithi194.stdout:7/240: mkdir d1/d2b/d3e/d54 0 2024-04-13T10:58:36.851 INFO:tasks.workunit.client.1.smithi194.stdout:9/229: sync 2024-04-13T10:58:36.887 INFO:tasks.workunit.client.1.smithi194.stdout:4/277: rename d2/d16/d1a/d1d/l2a to d2/d33/l58 0 2024-04-13T10:58:36.888 INFO:tasks.workunit.client.1.smithi194.stdout:6/220: creat d0/d26/d2b/f40 x:0 0 0 2024-04-13T10:58:36.889 INFO:tasks.workunit.client.1.smithi194.stdout:0/215: creat d9/d2b/f4a x:0 0 0 2024-04-13T10:58:36.891 INFO:tasks.workunit.client.1.smithi194.stdout:1/242: truncate d12/f15 1111969 0 2024-04-13T10:58:36.892 INFO:tasks.workunit.client.1.smithi194.stdout:4/278: dwrite d2/ff [0,4194304] 0 2024-04-13T10:58:36.893 INFO:tasks.workunit.client.1.smithi194.stdout:8/257: unlink d6/d22/d23/l28 0 2024-04-13T10:58:36.895 INFO:tasks.workunit.client.1.smithi194.stdout:9/230: mkdir d0/d6/d9/d51 0 2024-04-13T10:58:36.898 INFO:tasks.workunit.client.1.smithi194.stdout:6/221: creat d0/d2c/f41 x:0 0 0 2024-04-13T10:58:36.899 INFO:tasks.workunit.client.1.smithi194.stdout:0/216: creat d9/f4b x:0 0 0 2024-04-13T10:58:36.901 INFO:tasks.workunit.client.1.smithi194.stdout:1/243: mkdir d12/d13/d1c/d27/d4c 0 2024-04-13T10:58:36.904 INFO:tasks.workunit.client.1.smithi194.stdout:3/228: rename d2/l19 to d2/d3/l3b 0 2024-04-13T10:58:36.907 INFO:tasks.workunit.client.1.smithi194.stdout:8/258: dwrite f5 [4194304,4194304] 0 2024-04-13T10:58:36.908 INFO:tasks.workunit.client.1.smithi194.stdout:1/244: dread ff [0,4194304] 0 2024-04-13T10:58:36.909 INFO:tasks.workunit.client.1.smithi194.stdout:7/241: rename d1/c9 to d1/d2b/d3e/d54/c55 0 2024-04-13T10:58:36.910 INFO:tasks.workunit.client.1.smithi194.stdout:0/217: dread d9/fd [4194304,4194304] 0 2024-04-13T10:58:36.912 INFO:tasks.workunit.client.1.smithi194.stdout:8/259: creat d6/d22/d23/d25/d30/f56 x:0 0 0 2024-04-13T10:58:36.912 INFO:tasks.workunit.client.1.smithi194.stdout:0/218: fdatasync d9/f4b 0 2024-04-13T10:58:36.915 INFO:tasks.workunit.client.1.smithi194.stdout:0/219: chown d9/db/d19 206371 1 2024-04-13T10:58:36.915 INFO:tasks.workunit.client.1.smithi194.stdout:4/279: rename d2/d16/d1a/l27 to d2/d30/l59 0 2024-04-13T10:58:36.917 INFO:tasks.workunit.client.1.smithi194.stdout:3/229: truncate d2/d3/d12/f16 2885287 0 2024-04-13T10:58:36.918 INFO:tasks.workunit.client.1.smithi194.stdout:8/260: creat d6/d2a/f57 x:0 0 0 2024-04-13T10:58:36.918 INFO:tasks.workunit.client.1.smithi194.stdout:1/245: dwrite d12/f35 [0,4194304] 0 2024-04-13T10:58:36.921 INFO:tasks.workunit.client.1.smithi194.stdout:1/246: chown d12/d13/d1c/d27/d2e 2142407 1 2024-04-13T10:58:36.922 INFO:tasks.workunit.client.1.smithi194.stdout:0/220: creat d9/df/f4c x:0 0 0 2024-04-13T10:58:36.925 INFO:tasks.workunit.client.1.smithi194.stdout:3/230: mknod d2/de/c3c 0 2024-04-13T10:58:36.926 INFO:tasks.workunit.client.1.smithi194.stdout:3/231: write d2/de/f1e [628940,3156] 0 2024-04-13T10:58:36.927 INFO:tasks.workunit.client.1.smithi194.stdout:1/247: unlink ff 0 2024-04-13T10:58:36.929 INFO:tasks.workunit.client.1.smithi194.stdout:1/248: dread - d12/d13/d3e/f42 zero size 2024-04-13T10:58:36.929 INFO:tasks.workunit.client.1.smithi194.stdout:4/280: creat d2/d30/d50/f5a x:0 0 0 2024-04-13T10:58:36.931 INFO:tasks.workunit.client.1.smithi194.stdout:8/261: dwrite d6/f1c [0,4194304] 0 2024-04-13T10:58:36.932 INFO:tasks.workunit.client.1.smithi194.stdout:8/262: stat d6/c15 0 2024-04-13T10:58:36.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:36 smithi134 ceph-mon[39696]: pgmap v22: 65 pgs: 65 active+clean; 462 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 38 MiB/s wr, 403 op/s 2024-04-13T10:58:36.934 INFO:tasks.workunit.client.1.smithi194.stdout:8/263: fdatasync d6/d22/d23/d3d/f40 0 2024-04-13T10:58:36.937 INFO:tasks.workunit.client.1.smithi194.stdout:6/222: rename d0/d26/d2b/d36 to d0/d42 0 2024-04-13T10:58:36.938 INFO:tasks.workunit.client.1.smithi194.stdout:8/264: write d6/d22/f26 [132333,118200] 0 2024-04-13T10:58:36.938 INFO:tasks.workunit.client.1.smithi194.stdout:7/242: dread d1/f24 [0,4194304] 0 2024-04-13T10:58:36.940 INFO:tasks.workunit.client.1.smithi194.stdout:1/249: dwrite d12/d13/d3e/f34 [0,4194304] 0 2024-04-13T10:58:36.941 INFO:tasks.workunit.client.1.smithi194.stdout:4/281: mknod d2/d16/d1a/d1c/c5b 0 2024-04-13T10:58:36.944 INFO:tasks.workunit.client.1.smithi194.stdout:1/250: truncate d12/f32 5108326 0 2024-04-13T10:58:36.948 INFO:tasks.workunit.client.1.smithi194.stdout:6/223: dwrite d0/f7 [0,4194304] 0 2024-04-13T10:58:36.948 INFO:tasks.workunit.client.1.smithi194.stdout:3/232: creat d2/d3/f3d x:0 0 0 2024-04-13T10:58:36.950 INFO:tasks.workunit.client.1.smithi194.stdout:3/233: chown d2/f9 1682912180 1 2024-04-13T10:58:36.954 INFO:tasks.workunit.client.1.smithi194.stdout:8/265: dwrite d6/dd/f19 [0,4194304] 0 2024-04-13T10:58:36.955 INFO:tasks.workunit.client.1.smithi194.stdout:4/282: unlink d2/d33/f4b 0 2024-04-13T10:58:36.956 INFO:tasks.workunit.client.1.smithi194.stdout:7/243: write d1/f8 [5073183,45862] 0 2024-04-13T10:58:36.958 INFO:tasks.workunit.client.1.smithi194.stdout:7/244: write d1/d2b/d2c/d30/d37/d3c/f42 [1014010,11935] 0 2024-04-13T10:58:36.961 INFO:tasks.workunit.client.1.smithi194.stdout:6/224: creat d0/d42/f43 x:0 0 0 2024-04-13T10:58:36.962 INFO:tasks.workunit.client.1.smithi194.stdout:3/234: mknod d2/de/c3e 0 2024-04-13T10:58:36.965 INFO:tasks.workunit.client.1.smithi194.stdout:8/266: dread - d6/d22/d23/d25/d39/d41/f4e zero size 2024-04-13T10:58:36.969 INFO:tasks.workunit.client.1.smithi194.stdout:6/225: unlink d0/d26/f25 0 2024-04-13T10:58:36.970 INFO:tasks.workunit.client.1.smithi194.stdout:3/235: chown d2/d3/d12/d21/c2f 6510345 1 2024-04-13T10:58:36.970 INFO:tasks.workunit.client.1.smithi194.stdout:3/236: readlink d2/d3/l1b 0 2024-04-13T10:58:36.971 INFO:tasks.workunit.client.1.smithi194.stdout:4/283: mknod d2/d16/d1a/c5c 0 2024-04-13T10:58:36.971 INFO:tasks.workunit.client.1.smithi194.stdout:4/284: stat d2/d30/l4f 0 2024-04-13T10:58:36.972 INFO:tasks.workunit.client.1.smithi194.stdout:8/267: symlink d6/d2a/l58 0 2024-04-13T10:58:36.973 INFO:tasks.workunit.client.1.smithi194.stdout:8/268: chown d6/l18 2918415 1 2024-04-13T10:58:36.977 INFO:tasks.workunit.client.1.smithi194.stdout:7/245: creat d1/d2b/d4c/d4f/d51/f56 x:0 0 0 2024-04-13T10:58:36.977 INFO:tasks.workunit.client.1.smithi194.stdout:6/226: read d0/d26/f14 [3116557,94328] 0 2024-04-13T10:58:36.980 INFO:tasks.workunit.client.1.smithi194.stdout:8/269: rename d6/d2a/l58 to d6/d22/d23/d25/d39/d41/l59 0 2024-04-13T10:58:36.980 INFO:tasks.workunit.client.1.smithi194.stdout:4/285: dwrite d2/d16/d1a/f4c [0,4194304] 0 2024-04-13T10:58:36.981 INFO:tasks.workunit.client.1.smithi194.stdout:1/251: dread d12/d13/f18 [0,4194304] 0 2024-04-13T10:58:36.981 INFO:tasks.workunit.client.1.smithi194.stdout:7/246: fdatasync d1/d2b/d2c/d30/d33/d39/f3d 0 2024-04-13T10:58:36.982 INFO:tasks.workunit.client.1.smithi194.stdout:3/237: truncate d2/d3/d12/f16 3226358 0 2024-04-13T10:58:36.985 INFO:tasks.workunit.client.1.smithi194.stdout:6/227: dread d0/f2a [0,4194304] 0 2024-04-13T10:58:36.987 INFO:tasks.workunit.client.1.smithi194.stdout:6/228: write d0/d42/f43 [560056,99229] 0 2024-04-13T10:58:36.988 INFO:tasks.workunit.client.1.smithi194.stdout:7/247: chown d1/d2b/d3e/d54/c55 2709 1 2024-04-13T10:58:36.990 INFO:tasks.workunit.client.1.smithi194.stdout:4/286: dwrite d2/d30/d50/f5a [0,4194304] 0 2024-04-13T10:58:36.992 INFO:tasks.workunit.client.1.smithi194.stdout:3/238: rmdir d2/de 39 2024-04-13T10:58:36.993 INFO:tasks.workunit.client.1.smithi194.stdout:1/252: symlink d12/d13/d1c/d28/d41/l4d 0 2024-04-13T10:58:36.995 INFO:tasks.workunit.client.1.smithi194.stdout:3/239: chown d2/d3/d12/d31/d34 192056281 1 2024-04-13T10:58:36.996 INFO:tasks.workunit.client.1.smithi194.stdout:6/229: mknod d0/d42/c44 0 2024-04-13T10:58:36.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:36 smithi194 ceph-mon[46737]: pgmap v22: 65 pgs: 65 active+clean; 462 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 38 MiB/s wr, 403 op/s 2024-04-13T10:58:36.998 INFO:tasks.workunit.client.1.smithi194.stdout:8/270: rename d6/d2a/l4b to d6/l5a 0 2024-04-13T10:58:37.001 INFO:tasks.workunit.client.1.smithi194.stdout:1/253: mkdir d12/d13/d1c/d28/d41/d4e 0 2024-04-13T10:58:37.002 INFO:tasks.workunit.client.1.smithi194.stdout:6/230: mkdir d0/d2f/d45 0 2024-04-13T10:58:37.004 INFO:tasks.workunit.client.1.smithi194.stdout:4/287: dwrite d2/d16/d1a/f35 [4194304,4194304] 0 2024-04-13T10:58:37.004 INFO:tasks.workunit.client.1.smithi194.stdout:6/231: readlink d0/d26/l24 0 2024-04-13T10:58:37.005 INFO:tasks.workunit.client.1.smithi194.stdout:4/288: chown d2/c7 5791141 1 2024-04-13T10:58:37.005 INFO:tasks.workunit.client.1.smithi194.stdout:8/271: mkdir d6/d22/d23/d25/d39/d41/d5b 0 2024-04-13T10:58:37.007 INFO:tasks.workunit.client.1.smithi194.stdout:1/254: mkdir d12/d3a/d4f 0 2024-04-13T10:58:37.009 INFO:tasks.workunit.client.1.smithi194.stdout:8/272: dread d6/d2a/f34 [0,4194304] 0 2024-04-13T10:58:37.009 INFO:tasks.workunit.client.1.smithi194.stdout:6/232: dread d0/d42/f43 [0,4194304] 0 2024-04-13T10:58:37.012 INFO:tasks.workunit.client.1.smithi194.stdout:7/248: rename d1/l10 to d1/d2b/d4c/d4f/d51/l57 0 2024-04-13T10:58:37.015 INFO:tasks.workunit.client.1.smithi194.stdout:4/289: mkdir d2/d16/d1a/d1c/d54/d5d 0 2024-04-13T10:58:37.017 INFO:tasks.workunit.client.1.smithi194.stdout:3/240: rename d2/de/c3e to d2/d3/d12/d21/c3f 0 2024-04-13T10:58:37.018 INFO:tasks.workunit.client.1.smithi194.stdout:2/268: sync 2024-04-13T10:58:37.019 INFO:tasks.workunit.client.1.smithi194.stdout:2/269: fdatasync d2/d3/de/f32 0 2024-04-13T10:58:37.019 INFO:tasks.workunit.client.1.smithi194.stdout:7/249: creat d1/d2b/d2c/d30/d37/f58 x:0 0 0 2024-04-13T10:58:37.022 INFO:tasks.workunit.client.1.smithi194.stdout:3/241: unlink d2/d3/d12/d21/l2c 0 2024-04-13T10:58:37.023 INFO:tasks.workunit.client.1.smithi194.stdout:1/255: rmdir d12/d13/d47 0 2024-04-13T10:58:37.027 INFO:tasks.workunit.client.1.smithi194.stdout:4/290: mknod d2/d16/d1a/d1c/d54/d5d/c5e 0 2024-04-13T10:58:37.028 INFO:tasks.workunit.client.1.smithi194.stdout:3/242: mknod d2/d3/d1a/c40 0 2024-04-13T10:58:37.029 INFO:tasks.workunit.client.1.smithi194.stdout:7/250: dread d1/f29 [0,4194304] 0 2024-04-13T10:58:37.030 INFO:tasks.workunit.client.1.smithi194.stdout:2/270: mknod d2/d5/d57/c5b 0 2024-04-13T10:58:37.031 INFO:tasks.workunit.client.1.smithi194.stdout:1/256: mkdir d12/d13/d1c/d28/d41/d50 0 2024-04-13T10:58:37.031 INFO:tasks.workunit.client.1.smithi194.stdout:8/273: dread d6/dd/f16 [0,4194304] 0 2024-04-13T10:58:37.033 INFO:tasks.workunit.client.1.smithi194.stdout:4/291: creat d2/d16/d1a/d1c/d54/f5f x:0 0 0 2024-04-13T10:58:37.035 INFO:tasks.workunit.client.1.smithi194.stdout:7/251: truncate d1/d2b/d4c/d4f/d51/f20 1945386 0 2024-04-13T10:58:37.036 INFO:tasks.workunit.client.1.smithi194.stdout:7/252: write d1/d2b/d2c/d30/f31 [4817558,40714] 0 2024-04-13T10:58:37.036 INFO:tasks.workunit.client.1.smithi194.stdout:2/271: creat d2/d3/de/d17/d1e/d42/d52/f5c x:0 0 0 2024-04-13T10:58:37.037 INFO:tasks.workunit.client.1.smithi194.stdout:6/233: truncate d0/f1f 1199904 0 2024-04-13T10:58:37.037 INFO:tasks.workunit.client.1.smithi194.stdout:2/272: readlink d2/d3/de/d17/d39/l48 0 2024-04-13T10:58:37.038 INFO:tasks.workunit.client.1.smithi194.stdout:6/234: dread - d0/d2c/f32 zero size 2024-04-13T10:58:37.039 INFO:tasks.workunit.client.1.smithi194.stdout:1/257: rename d12/d13/d1c/d28/f3b to d12/d13/d1c/d28/d41/f51 0 2024-04-13T10:58:37.041 INFO:tasks.workunit.client.1.smithi194.stdout:3/243: creat d2/d3/d12/f41 x:0 0 0 2024-04-13T10:58:37.042 INFO:tasks.workunit.client.1.smithi194.stdout:8/274: symlink d6/d22/d23/d25/d39/d41/d5b/l5c 0 2024-04-13T10:58:37.043 INFO:tasks.workunit.client.1.smithi194.stdout:7/253: readlink d1/d2b/d4c/l52 0 2024-04-13T10:58:37.044 INFO:tasks.workunit.client.1.smithi194.stdout:4/292: mkdir d2/d16/d1a/d60 0 2024-04-13T10:58:37.045 INFO:tasks.workunit.client.1.smithi194.stdout:3/244: dread - d2/d3/d12/d31/d34/f37 zero size 2024-04-13T10:58:37.046 INFO:tasks.workunit.client.1.smithi194.stdout:6/235: write d0/d42/f43 [1550943,60731] 0 2024-04-13T10:58:37.047 INFO:tasks.workunit.client.1.smithi194.stdout:7/254: write d1/f12 [3365292,124057] 0 2024-04-13T10:58:37.048 INFO:tasks.workunit.client.1.smithi194.stdout:8/275: write d6/d22/d23/d25/f27 [633747,100476] 0 2024-04-13T10:58:37.049 INFO:tasks.workunit.client.1.smithi194.stdout:2/273: rmdir d2/d3/d12/d40 0 2024-04-13T10:58:37.052 INFO:tasks.workunit.client.1.smithi194.stdout:1/258: dwrite d12/d13/d1c/d28/d41/f4a [0,4194304] 0 2024-04-13T10:58:37.054 INFO:tasks.workunit.client.1.smithi194.stdout:6/236: rmdir d0/d42 39 2024-04-13T10:58:37.055 INFO:tasks.workunit.client.1.smithi194.stdout:1/259: stat d12/d13/d1c/d28/d41 0 2024-04-13T10:58:37.056 INFO:tasks.workunit.client.1.smithi194.stdout:4/293: mknod d2/d16/d1a/d1c/d54/d5d/c61 0 2024-04-13T10:58:37.057 INFO:tasks.workunit.client.1.smithi194.stdout:1/260: truncate f1 5587673 0 2024-04-13T10:58:37.060 INFO:tasks.workunit.client.1.smithi194.stdout:7/255: fdatasync d1/f16 0 2024-04-13T10:58:37.060 INFO:tasks.workunit.client.1.smithi194.stdout:3/245: dwrite d2/d3/d1a/d24/f28 [0,4194304] 0 2024-04-13T10:58:37.062 INFO:tasks.workunit.client.1.smithi194.stdout:7/256: stat d1/d2b/d2c/d30/f31 0 2024-04-13T10:58:37.062 INFO:tasks.workunit.client.1.smithi194.stdout:8/276: dread d6/d22/d23/d25/f36 [0,4194304] 0 2024-04-13T10:58:37.063 INFO:tasks.workunit.client.1.smithi194.stdout:4/294: fdatasync d2/f56 0 2024-04-13T10:58:37.066 INFO:tasks.workunit.client.1.smithi194.stdout:1/261: symlink d12/d13/d3e/l52 0 2024-04-13T10:58:37.070 INFO:tasks.workunit.client.1.smithi194.stdout:7/257: unlink d1/d2b/d2c/d30/d37/f3f 0 2024-04-13T10:58:37.073 INFO:tasks.workunit.client.1.smithi194.stdout:1/262: mkdir d12/d13/d1c/d53 0 2024-04-13T10:58:37.075 INFO:tasks.workunit.client.1.smithi194.stdout:6/237: rmdir d0/d2f/d45 0 2024-04-13T10:58:37.077 INFO:tasks.workunit.client.1.smithi194.stdout:2/274: rename d2/d3/de/d17/d36/f38 to d2/d3/de/f5d 0 2024-04-13T10:58:37.078 INFO:tasks.workunit.client.1.smithi194.stdout:1/263: creat d12/d13/d3e/f54 x:0 0 0 2024-04-13T10:58:37.081 INFO:tasks.workunit.client.1.smithi194.stdout:7/258: dwrite d1/d2b/d2c/d30/f32 [0,4194304] 0 2024-04-13T10:58:37.081 INFO:tasks.workunit.client.1.smithi194.stdout:4/295: dread d2/d16/d1a/f22 [0,4194304] 0 2024-04-13T10:58:37.081 INFO:tasks.workunit.client.1.smithi194.stdout:3/246: rename d2/f9 to d2/d3/d1a/f42 0 2024-04-13T10:58:37.082 INFO:tasks.workunit.client.1.smithi194.stdout:3/247: chown d2/d3/d1a/c35 27 1 2024-04-13T10:58:37.084 INFO:tasks.workunit.client.1.smithi194.stdout:6/238: truncate d0/f7 1750683 0 2024-04-13T10:58:37.085 INFO:tasks.workunit.client.1.smithi194.stdout:2/275: creat d2/d3/de/d17/d1e/d42/d52/f5e x:0 0 0 2024-04-13T10:58:37.095 INFO:tasks.workunit.client.1.smithi194.stdout:2/276: creat d2/d37/f5f x:0 0 0 2024-04-13T10:58:37.098 INFO:tasks.workunit.client.1.smithi194.stdout:3/248: creat d2/d3/f43 x:0 0 0 2024-04-13T10:58:37.100 INFO:tasks.workunit.client.1.smithi194.stdout:2/277: chown d2/d3/de/d17/l28 16 1 2024-04-13T10:58:37.102 INFO:tasks.workunit.client.1.smithi194.stdout:6/239: link d0/f1a d0/d42/f46 0 2024-04-13T10:58:37.104 INFO:tasks.workunit.client.1.smithi194.stdout:6/240: write d0/d26/d2b/f3c [794722,13769] 0 2024-04-13T10:58:37.104 INFO:tasks.workunit.client.1.smithi194.stdout:7/259: link d1/d2b/d4c/d4f/d51/l35 d1/d2b/d4c/d4f/d51/l59 0 2024-04-13T10:58:37.107 INFO:tasks.workunit.client.1.smithi194.stdout:3/249: symlink d2/d3/d1a/d24/d3a/l44 0 2024-04-13T10:58:37.107 INFO:tasks.workunit.client.1.smithi194.stdout:1/264: write d12/d13/f37 [2391461,22728] 0 2024-04-13T10:58:37.108 INFO:tasks.workunit.client.1.smithi194.stdout:4/296: truncate d2/d16/d1a/f4c 753099 0 2024-04-13T10:58:37.110 INFO:tasks.workunit.client.1.smithi194.stdout:1/265: write f10 [5181156,16592] 0 2024-04-13T10:58:37.112 INFO:tasks.workunit.client.1.smithi194.stdout:4/297: mkdir d2/d16/d1a/d1c/d54/d62 0 2024-04-13T10:58:37.114 INFO:tasks.workunit.client.1.smithi194.stdout:3/250: truncate d2/f5 551028 0 2024-04-13T10:58:37.115 INFO:tasks.workunit.client.1.smithi194.stdout:1/266: write d12/d3a/f3d [2696469,46323] 0 2024-04-13T10:58:37.116 INFO:tasks.workunit.client.1.smithi194.stdout:2/278: dread d2/d5/f1d [0,4194304] 0 2024-04-13T10:58:37.116 INFO:tasks.workunit.client.1.smithi194.stdout:4/298: symlink d2/d16/d1a/d1c/d54/l63 0 2024-04-13T10:58:37.117 INFO:tasks.workunit.client.1.smithi194.stdout:3/251: fsync d2/d3/d12/d31/d34/f37 0 2024-04-13T10:58:37.118 INFO:tasks.workunit.client.1.smithi194.stdout:2/279: stat d2/d3/de/d17/d36/l49 0 2024-04-13T10:58:37.121 INFO:tasks.workunit.client.1.smithi194.stdout:7/260: truncate d1/d2b/d2c/d30/d37/d3c/f42 804984 0 2024-04-13T10:58:37.121 INFO:tasks.workunit.client.1.smithi194.stdout:1/267: dread d12/f26 [0,4194304] 0 2024-04-13T10:58:37.122 INFO:tasks.workunit.client.1.smithi194.stdout:4/299: mknod d2/d16/d1a/d1c/d54/d5d/c64 0 2024-04-13T10:58:37.122 INFO:tasks.workunit.client.1.smithi194.stdout:6/241: dwrite d0/f1a [0,4194304] 0 2024-04-13T10:58:37.122 INFO:tasks.workunit.client.1.smithi194.stdout:7/261: chown d1/d2b/d2c/d30/f31 3938249 1 2024-04-13T10:58:37.123 INFO:tasks.workunit.client.1.smithi194.stdout:3/252: creat d2/d3/d1a/d24/d3a/f45 x:0 0 0 2024-04-13T10:58:37.123 INFO:tasks.workunit.client.1.smithi194.stdout:7/262: chown d1/d2b/d4c 443907363 1 2024-04-13T10:58:37.125 INFO:tasks.workunit.client.1.smithi194.stdout:6/242: creat d0/d26/d2b/f47 x:0 0 0 2024-04-13T10:58:37.127 INFO:tasks.workunit.client.1.smithi194.stdout:2/280: symlink d2/d3/de/l60 0 2024-04-13T10:58:37.129 INFO:tasks.workunit.client.1.smithi194.stdout:3/253: rmdir d2/d3/d1a 39 2024-04-13T10:58:37.130 INFO:tasks.workunit.client.1.smithi194.stdout:3/254: dread - d2/d3/d12/d31/d34/f39 zero size 2024-04-13T10:58:37.131 INFO:tasks.workunit.client.1.smithi194.stdout:2/281: dread d2/d3/d12/f2b [0,4194304] 0 2024-04-13T10:58:37.134 INFO:tasks.workunit.client.1.smithi194.stdout:6/243: chown d0/c2d 2692 1 2024-04-13T10:58:37.136 INFO:tasks.workunit.client.1.smithi194.stdout:1/268: creat d12/f55 x:0 0 0 2024-04-13T10:58:37.138 INFO:tasks.workunit.client.1.smithi194.stdout:2/282: mkdir d2/d3/de/d17/d1e/d42/d61 0 2024-04-13T10:58:37.139 INFO:tasks.workunit.client.1.smithi194.stdout:6/244: mkdir d0/d2f/d48 0 2024-04-13T10:58:37.139 INFO:tasks.workunit.client.1.smithi194.stdout:6/245: write d0/f1a [4643995,28743] 0 2024-04-13T10:58:37.141 INFO:tasks.workunit.client.1.smithi194.stdout:7/263: rename d1/d2b/d2c/d30/d37 to d1/d2b/d3e/d54/d5a 0 2024-04-13T10:58:37.144 INFO:tasks.workunit.client.1.smithi194.stdout:2/283: creat d2/d3/de/d17/d1e/f62 x:0 0 0 2024-04-13T10:58:37.145 INFO:tasks.workunit.client.1.smithi194.stdout:2/284: stat d2/d5/c8 0 2024-04-13T10:58:37.146 INFO:tasks.workunit.client.1.smithi194.stdout:5/209: sync 2024-04-13T10:58:37.146 INFO:tasks.workunit.client.1.smithi194.stdout:5/210: chown d3/dc/d2d 28 1 2024-04-13T10:58:37.147 INFO:tasks.workunit.client.1.smithi194.stdout:4/300: getdents d2/d16/d1a/d1c/d3e 0 2024-04-13T10:58:37.148 INFO:tasks.workunit.client.1.smithi194.stdout:5/211: read d3/f1f [4956866,116220] 0 2024-04-13T10:58:37.149 INFO:tasks.workunit.client.1.smithi194.stdout:1/269: creat d12/d13/d1c/d28/d41/d4e/f56 x:0 0 0 2024-04-13T10:58:37.150 INFO:tasks.workunit.client.1.smithi194.stdout:1/270: write d12/d13/d1c/d28/d41/f4a [664651,76085] 0 2024-04-13T10:58:37.151 INFO:tasks.workunit.client.1.smithi194.stdout:2/285: creat d2/d3/f63 x:0 0 0 2024-04-13T10:58:37.152 INFO:tasks.workunit.client.1.smithi194.stdout:6/246: unlink d0/f7 0 2024-04-13T10:58:37.154 INFO:tasks.workunit.client.1.smithi194.stdout:6/247: chown d0/d2f/d48 0 1 2024-04-13T10:58:37.155 INFO:tasks.workunit.client.1.smithi194.stdout:4/301: rmdir d2/d16/d1a/d1c/d54 39 2024-04-13T10:58:37.156 INFO:tasks.workunit.client.1.smithi194.stdout:5/212: creat d3/dc/d10/f3b x:0 0 0 2024-04-13T10:58:37.156 INFO:tasks.workunit.client.1.smithi194.stdout:3/255: link d2/d3/d1a/d24/l36 d2/d3/d12/d31/l46 0 2024-04-13T10:58:37.158 INFO:tasks.workunit.client.1.smithi194.stdout:2/286: rename d2/d3/de/d3c/f45 to d2/d3/de/d17/d39/f64 0 2024-04-13T10:58:37.158 INFO:tasks.workunit.client.1.smithi194.stdout:4/302: chown d2/d30/l57 60810 1 2024-04-13T10:58:37.158 INFO:tasks.workunit.client.1.smithi194.stdout:5/213: readlink d3/dc/d10/l37 0 2024-04-13T10:58:37.159 INFO:tasks.workunit.client.1.smithi194.stdout:6/248: creat d0/d2c/f49 x:0 0 0 2024-04-13T10:58:37.162 INFO:tasks.workunit.client.1.smithi194.stdout:6/249: dread - d0/d2c/f41 zero size 2024-04-13T10:58:37.163 INFO:tasks.workunit.client.1.smithi194.stdout:7/264: dwrite d1/fa [4194304,4194304] 0 2024-04-13T10:58:37.163 INFO:tasks.workunit.client.1.smithi194.stdout:1/271: creat d12/d13/d1c/d27/f57 x:0 0 0 2024-04-13T10:58:37.164 INFO:tasks.workunit.client.1.smithi194.stdout:2/287: mkdir d2/d3/de/d17/d36/d65 0 2024-04-13T10:58:37.171 INFO:tasks.workunit.client.1.smithi194.stdout:1/272: creat d12/d13/d1c/d28/f58 x:0 0 0 2024-04-13T10:58:37.171 INFO:tasks.workunit.client.1.smithi194.stdout:7/265: mknod d1/d2b/d3e/d54/d5a/d3c/c5b 0 2024-04-13T10:58:37.172 INFO:tasks.workunit.client.1.smithi194.stdout:3/256: link d2/d3/d1a/d24/d3a/l44 d2/d3/d12/d31/d34/l47 0 2024-04-13T10:58:37.174 INFO:tasks.workunit.client.1.smithi194.stdout:2/288: read - d2/d3/de/d33/d47/f50 zero size 2024-04-13T10:58:37.175 INFO:tasks.workunit.client.1.smithi194.stdout:7/266: rmdir d1/d2b/d3e 39 2024-04-13T10:58:37.176 INFO:tasks.workunit.client.1.smithi194.stdout:5/214: dwrite d3/dc/d10/d20/d23/f30 [0,4194304] 0 2024-04-13T10:58:37.176 INFO:tasks.workunit.client.1.smithi194.stdout:9/231: sync 2024-04-13T10:58:37.176 INFO:tasks.workunit.client.1.smithi194.stdout:0/221: sync 2024-04-13T10:58:37.179 INFO:tasks.workunit.client.1.smithi194.stdout:4/303: dread d2/f4 [0,4194304] 0 2024-04-13T10:58:37.179 INFO:tasks.workunit.client.1.smithi194.stdout:3/257: mkdir d2/d3/d1a/d24/d3a/d48 0 2024-04-13T10:58:37.183 INFO:tasks.workunit.client.1.smithi194.stdout:2/289: symlink d2/d3/de/d17/d39/l66 0 2024-04-13T10:58:37.184 INFO:tasks.workunit.client.1.smithi194.stdout:7/267: creat d1/d2b/d4c/d4f/f5c x:0 0 0 2024-04-13T10:58:37.185 INFO:tasks.workunit.client.1.smithi194.stdout:9/232: dread d0/d11/f41 [0,4194304] 0 2024-04-13T10:58:37.185 INFO:tasks.workunit.client.1.smithi194.stdout:0/222: rmdir d9/db/d19/d30 39 2024-04-13T10:58:37.186 INFO:tasks.workunit.client.1.smithi194.stdout:7/268: fdatasync d1/f8 0 2024-04-13T10:58:37.187 INFO:tasks.workunit.client.1.smithi194.stdout:5/215: unlink d3/dc/l12 0 2024-04-13T10:58:37.189 INFO:tasks.workunit.client.1.smithi194.stdout:5/216: dread - d3/dc/d10/f3b zero size 2024-04-13T10:58:37.189 INFO:tasks.workunit.client.1.smithi194.stdout:2/290: unlink d2/d5/f44 0 2024-04-13T10:58:37.190 INFO:tasks.workunit.client.1.smithi194.stdout:1/273: dwrite d12/d13/d1c/f21 [0,4194304] 0 2024-04-13T10:58:37.190 INFO:tasks.workunit.client.1.smithi194.stdout:6/250: link d0/d26/d2b/l30 d0/d2c/l4a 0 2024-04-13T10:58:37.191 INFO:tasks.workunit.client.1.smithi194.stdout:2/291: read - d2/d3/de/f58 zero size 2024-04-13T10:58:37.192 INFO:tasks.workunit.client.1.smithi194.stdout:0/223: mknod d9/c4d 0 2024-04-13T10:58:37.193 INFO:tasks.workunit.client.1.smithi194.stdout:0/224: write d9/db/d3a/f49 [396810,184] 0 2024-04-13T10:58:37.195 INFO:tasks.workunit.client.1.smithi194.stdout:7/269: creat d1/d2b/d4c/f5d x:0 0 0 2024-04-13T10:58:37.195 INFO:tasks.workunit.client.1.smithi194.stdout:0/225: dread - d9/db/f3d zero size 2024-04-13T10:58:37.199 INFO:tasks.workunit.client.1.smithi194.stdout:5/217: rename d3/dc/d17/f39 to d3/dc/d10/f3c 0 2024-04-13T10:58:37.199 INFO:tasks.workunit.client.1.smithi194.stdout:4/304: write d2/d16/d1a/f36 [861391,2539] 0 2024-04-13T10:58:37.200 INFO:tasks.workunit.client.1.smithi194.stdout:9/233: symlink d0/d6/d9/d51/l52 0 2024-04-13T10:58:37.201 INFO:tasks.workunit.client.1.smithi194.stdout:2/292: dwrite d2/d5/f54 [0,4194304] 0 2024-04-13T10:58:37.201 INFO:tasks.workunit.client.1.smithi194.stdout:5/218: chown d3/dc/d10/f14 59 1 2024-04-13T10:58:37.203 INFO:tasks.workunit.client.1.smithi194.stdout:0/226: stat d9/l2c 0 2024-04-13T10:58:37.203 INFO:tasks.workunit.client.1.smithi194.stdout:3/258: write d2/d3/d12/f16 [563936,84075] 0 2024-04-13T10:58:37.206 INFO:tasks.workunit.client.1.smithi194.stdout:6/251: truncate d0/d26/f19 706828 0 2024-04-13T10:58:37.207 INFO:tasks.workunit.client.1.smithi194.stdout:4/305: chown d2/d16/d1a/d1d/l1f 31 1 2024-04-13T10:58:37.211 INFO:tasks.workunit.client.1.smithi194.stdout:3/259: fsync d2/d3/d12/f22 0 2024-04-13T10:58:37.211 INFO:tasks.workunit.client.1.smithi194.stdout:3/260: chown d2/d3 1132 1 2024-04-13T10:58:37.212 INFO:tasks.workunit.client.1.smithi194.stdout:7/270: mkdir d1/d2b/d4c/d4f/d51/d4d/d5e 0 2024-04-13T10:58:37.213 INFO:tasks.workunit.client.1.smithi194.stdout:6/252: mkdir d0/d26/d4b 0 2024-04-13T10:58:37.213 INFO:tasks.workunit.client.1.smithi194.stdout:5/219: mknod d3/dc/d17/c3d 0 2024-04-13T10:58:37.216 INFO:tasks.workunit.client.1.smithi194.stdout:5/220: symlink d3/dc/d2d/l3e 0 2024-04-13T10:58:37.217 INFO:tasks.workunit.client.1.smithi194.stdout:5/221: chown d3/dc/d17/d1b 2516508 1 2024-04-13T10:58:37.217 INFO:tasks.workunit.client.1.smithi194.stdout:4/306: link d2/d30/c46 d2/d16/d1a/d1c/d3e/c65 0 2024-04-13T10:58:37.220 INFO:tasks.workunit.client.1.smithi194.stdout:3/261: getdents d2/d3 0 2024-04-13T10:58:37.223 INFO:tasks.workunit.client.1.smithi194.stdout:3/262: read d2/d3/d1a/d24/f28 [106342,111003] 0 2024-04-13T10:58:37.223 INFO:tasks.workunit.client.1.smithi194.stdout:5/222: read d3/f9 [452092,53074] 0 2024-04-13T10:58:37.224 INFO:tasks.workunit.client.1.smithi194.stdout:4/307: truncate d2/d16/d1a/f4c 233303 0 2024-04-13T10:58:37.227 INFO:tasks.workunit.client.1.smithi194.stdout:9/234: dread d0/d6/f23 [0,4194304] 0 2024-04-13T10:58:37.231 INFO:tasks.workunit.client.1.smithi194.stdout:0/227: dread d9/db/d19/d28/f1e [0,4194304] 0 2024-04-13T10:58:37.231 INFO:tasks.workunit.client.1.smithi194.stdout:3/263: dread d2/de/f1e [0,4194304] 0 2024-04-13T10:58:37.231 INFO:tasks.workunit.client.1.smithi194.stdout:9/235: write d0/d11/f25 [17371,87687] 0 2024-04-13T10:58:37.236 INFO:tasks.workunit.client.1.smithi194.stdout:3/264: dread - d2/d3/d12/d31/d34/f39 zero size 2024-04-13T10:58:37.236 INFO:tasks.workunit.client.1.smithi194.stdout:9/236: dread - d0/d6/d14/d26/f38 zero size 2024-04-13T10:58:37.237 INFO:tasks.workunit.client.1.smithi194.stdout:2/293: dwrite d2/d3/de/d17/d36/f53 [0,4194304] 0 2024-04-13T10:58:37.241 INFO:tasks.workunit.client.1.smithi194.stdout:9/237: mknod d0/d6/d9/c53 0 2024-04-13T10:58:37.243 INFO:tasks.workunit.client.1.smithi194.stdout:0/228: dread f3 [0,4194304] 0 2024-04-13T10:58:37.243 INFO:tasks.workunit.client.1.smithi194.stdout:3/265: rename d2/d3/d12/f18 to d2/d3/d12/d21/f49 0 2024-04-13T10:58:37.244 INFO:tasks.workunit.client.1.smithi194.stdout:4/308: dread d2/d16/d1a/d1c/f39 [0,4194304] 0 2024-04-13T10:58:37.245 INFO:tasks.workunit.client.1.smithi194.stdout:4/309: fsync d2/d16/d1a/d1d/f51 0 2024-04-13T10:58:37.247 INFO:tasks.workunit.client.1.smithi194.stdout:9/238: symlink d0/d11/d1e/l54 0 2024-04-13T10:58:37.248 INFO:tasks.workunit.client.1.smithi194.stdout:5/223: dread d3/dc/f18 [0,4194304] 0 2024-04-13T10:58:37.248 INFO:tasks.workunit.client.1.smithi194.stdout:0/229: unlink f3 0 2024-04-13T10:58:37.250 INFO:tasks.workunit.client.1.smithi194.stdout:2/294: link d2/d3/de/d17/d39/l66 d2/d3/de/d17/d36/l67 0 2024-04-13T10:58:37.252 INFO:tasks.workunit.client.1.smithi194.stdout:3/266: dwrite d2/d3/d12/d31/d34/f37 [0,4194304] 0 2024-04-13T10:58:37.260 INFO:tasks.workunit.client.1.smithi194.stdout:9/239: dwrite d0/d11/f40 [0,4194304] 0 2024-04-13T10:58:37.263 INFO:tasks.workunit.client.1.smithi194.stdout:3/267: rename d2/d3/d12/d21/c2f to d2/d3/d1a/c4a 0 2024-04-13T10:58:37.264 INFO:tasks.workunit.client.1.smithi194.stdout:4/310: truncate d2/d16/d1a/f4c 143298 0 2024-04-13T10:58:37.264 INFO:tasks.workunit.client.1.smithi194.stdout:9/240: truncate d0/d6/d14/f27 1352295 0 2024-04-13T10:58:37.265 INFO:tasks.workunit.client.1.smithi194.stdout:0/230: truncate d9/db/f1b 186689 0 2024-04-13T10:58:37.266 INFO:tasks.workunit.client.1.smithi194.stdout:2/295: dread d2/d3/de/d17/d1e/f2c [8388608,4194304] 0 2024-04-13T10:58:37.269 INFO:tasks.workunit.client.1.smithi194.stdout:0/231: mknod d9/d2b/c4e 0 2024-04-13T10:58:37.270 INFO:tasks.workunit.client.1.smithi194.stdout:4/311: symlink d2/d16/d1a/d1c/d3b/d42/l66 0 2024-04-13T10:58:37.272 INFO:tasks.workunit.client.1.smithi194.stdout:9/241: creat d0/f55 x:0 0 0 2024-04-13T10:58:37.273 INFO:tasks.workunit.client.1.smithi194.stdout:0/232: creat d9/d2b/f4f x:0 0 0 2024-04-13T10:58:37.282 INFO:tasks.workunit.client.1.smithi194.stdout:4/312: rmdir d2/d16/d1a/d1c 39 2024-04-13T10:58:37.282 INFO:tasks.workunit.client.1.smithi194.stdout:9/242: getdents d0/d6/d14/d26/d42 0 2024-04-13T10:58:37.283 INFO:tasks.workunit.client.1.smithi194.stdout:2/296: write d2/d3/d12/f22 [606168,16543] 0 2024-04-13T10:58:37.283 INFO:tasks.workunit.client.1.smithi194.stdout:9/243: readlink d0/d6/d14/l4e 0 2024-04-13T10:58:37.286 INFO:tasks.workunit.client.1.smithi194.stdout:4/313: creat d2/d16/d1a/d1c/d3e/f67 x:0 0 0 2024-04-13T10:58:37.287 INFO:tasks.workunit.client.1.smithi194.stdout:3/268: truncate d2/d3/d1a/f2e 605320 0 2024-04-13T10:58:37.289 INFO:tasks.workunit.client.1.smithi194.stdout:2/297: truncate d2/d3/de/d33/f35 17370 0 2024-04-13T10:58:37.289 INFO:tasks.workunit.client.1.smithi194.stdout:0/233: write d9/fd [5299984,103610] 0 2024-04-13T10:58:37.289 INFO:tasks.workunit.client.1.smithi194.stdout:3/269: stat d2/d3/f3d 0 2024-04-13T10:58:37.290 INFO:tasks.workunit.client.1.smithi194.stdout:4/314: readlink d2/d16/d1a/d1c/d3b/l47 0 2024-04-13T10:58:37.290 INFO:tasks.workunit.client.1.smithi194.stdout:5/224: dread d3/dc/d10/f11 [4194304,4194304] 0 2024-04-13T10:58:37.292 INFO:tasks.workunit.client.1.smithi194.stdout:2/298: symlink d2/d5/l68 0 2024-04-13T10:58:37.293 INFO:tasks.workunit.client.1.smithi194.stdout:9/244: dwrite d0/d11/f25 [0,4194304] 0 2024-04-13T10:58:37.293 INFO:tasks.workunit.client.1.smithi194.stdout:3/270: creat d2/d3/d1a/d24/f4b x:0 0 0 2024-04-13T10:58:37.295 INFO:tasks.workunit.client.1.smithi194.stdout:9/245: fdatasync d0/d6/d14/f1a 0 2024-04-13T10:58:37.297 INFO:tasks.workunit.client.1.smithi194.stdout:2/299: creat d2/d5/d57/f69 x:0 0 0 2024-04-13T10:58:37.299 INFO:tasks.workunit.client.1.smithi194.stdout:8/277: sync 2024-04-13T10:58:37.299 INFO:tasks.workunit.client.1.smithi194.stdout:0/234: rename f1 to d9/db/d19/f50 0 2024-04-13T10:58:37.302 INFO:tasks.workunit.client.1.smithi194.stdout:3/271: getdents d2/d3/d1a/d24/d3a/d48 0 2024-04-13T10:58:37.303 INFO:tasks.workunit.client.1.smithi194.stdout:5/225: dwrite d3/dc/d10/f14 [0,4194304] 0 2024-04-13T10:58:37.303 INFO:tasks.workunit.client.1.smithi194.stdout:2/300: write d2/d3/de/d33/d47/f50 [181092,108224] 0 2024-04-13T10:58:37.305 INFO:tasks.workunit.client.1.smithi194.stdout:8/278: write d6/dd/d45/f51 [1043062,49721] 0 2024-04-13T10:58:37.309 INFO:tasks.workunit.client.1.smithi194.stdout:2/301: creat d2/d37/f6a x:0 0 0 2024-04-13T10:58:37.310 INFO:tasks.workunit.client.1.smithi194.stdout:5/226: creat d3/d29/f3f x:0 0 0 2024-04-13T10:58:37.314 INFO:tasks.workunit.client.1.smithi194.stdout:8/279: mknod d6/dd/d45/c5d 0 2024-04-13T10:58:37.314 INFO:tasks.workunit.client.1.smithi194.stdout:9/246: dwrite d0/d6/d2c/f36 [0,4194304] 0 2024-04-13T10:58:37.321 INFO:tasks.workunit.client.1.smithi194.stdout:9/247: creat d0/d6/d2c/f56 x:0 0 0 2024-04-13T10:58:37.322 INFO:tasks.workunit.client.1.smithi194.stdout:0/235: dwrite d9/d2b/f4f [0,4194304] 0 2024-04-13T10:58:37.324 INFO:tasks.workunit.client.1.smithi194.stdout:9/248: fsync d0/d6/d2c/f47 0 2024-04-13T10:58:37.324 INFO:tasks.workunit.client.1.smithi194.stdout:0/236: stat d9/db/d19/d28/f13 0 2024-04-13T10:58:37.326 INFO:tasks.workunit.client.1.smithi194.stdout:4/315: dread d2/d16/d1a/d1d/d31/f40 [0,4194304] 0 2024-04-13T10:58:37.327 INFO:tasks.workunit.client.1.smithi194.stdout:5/227: dread d3/d29/f34 [0,4194304] 0 2024-04-13T10:58:37.328 INFO:tasks.workunit.client.1.smithi194.stdout:9/249: mknod d0/d11/d3d/c57 0 2024-04-13T10:58:37.331 INFO:tasks.workunit.client.1.smithi194.stdout:8/280: truncate d6/dd/f16 2902343 0 2024-04-13T10:58:37.333 INFO:tasks.workunit.client.1.smithi194.stdout:8/281: rmdir d6/d22/d23/d25 39 2024-04-13T10:58:37.334 INFO:tasks.workunit.client.1.smithi194.stdout:0/237: getdents d9/d2b 0 2024-04-13T10:58:37.334 INFO:tasks.workunit.client.1.smithi194.stdout:8/282: write f2 [540514,37951] 0 2024-04-13T10:58:37.336 INFO:tasks.workunit.client.1.smithi194.stdout:8/283: write f5 [1767284,31308] 0 2024-04-13T10:58:37.337 INFO:tasks.workunit.client.1.smithi194.stdout:5/228: write d3/dc/d10/f14 [5086454,116150] 0 2024-04-13T10:58:37.338 INFO:tasks.workunit.client.1.smithi194.stdout:2/302: dread d2/d3/de/d33/f35 [0,4194304] 0 2024-04-13T10:58:37.338 INFO:tasks.workunit.client.1.smithi194.stdout:9/250: write d0/d6/f13 [2867032,37365] 0 2024-04-13T10:58:37.340 INFO:tasks.workunit.client.1.smithi194.stdout:5/229: read - d3/dc/d2d/f36 zero size 2024-04-13T10:58:37.341 INFO:tasks.workunit.client.1.smithi194.stdout:0/238: symlink d9/db/d19/l51 0 2024-04-13T10:58:37.342 INFO:tasks.workunit.client.1.smithi194.stdout:2/303: chown d2/d3/de/d17/d1e/f62 623 1 2024-04-13T10:58:37.342 INFO:tasks.workunit.client.1.smithi194.stdout:5/230: chown d3/dc/lf 160126640 1 2024-04-13T10:58:37.342 INFO:tasks.workunit.client.1.smithi194.stdout:9/251: truncate d0/d6/d14/f27 1774147 0 2024-04-13T10:58:37.346 INFO:tasks.workunit.client.1.smithi194.stdout:9/252: read - d0/d6/d14/d26/d42/f4b zero size 2024-04-13T10:58:37.350 INFO:tasks.workunit.client.1.smithi194.stdout:0/239: dwrite d9/db/d19/d28/f2e [0,4194304] 0 2024-04-13T10:58:37.351 INFO:tasks.workunit.client.1.smithi194.stdout:9/253: mkdir d0/d11/d58 0 2024-04-13T10:58:37.352 INFO:tasks.workunit.client.1.smithi194.stdout:2/304: link d2/d3/de/d17/d1e/l4f d2/d3/de/d17/d1e/d42/d52/l6b 0 2024-04-13T10:58:37.353 INFO:tasks.workunit.client.1.smithi194.stdout:4/316: dread d2/fb [0,4194304] 0 2024-04-13T10:58:37.354 INFO:tasks.workunit.client.1.smithi194.stdout:8/284: write d6/f55 [2583028,64127] 0 2024-04-13T10:58:37.355 INFO:tasks.workunit.client.1.smithi194.stdout:2/305: chown d2/d3/d12/f22 52242 1 2024-04-13T10:58:37.355 INFO:tasks.workunit.client.1.smithi194.stdout:9/254: truncate d0/d6/d2c/f47 47628 0 2024-04-13T10:58:37.355 INFO:tasks.workunit.client.1.smithi194.stdout:0/240: rmdir d9/db/d3a 39 2024-04-13T10:58:37.356 INFO:tasks.workunit.client.1.smithi194.stdout:8/285: chown d6/dd/f16 434339423 1 2024-04-13T10:58:37.358 INFO:tasks.workunit.client.1.smithi194.stdout:8/286: fdatasync d6/dd/d45/f51 0 2024-04-13T10:58:37.360 INFO:tasks.workunit.client.1.smithi194.stdout:5/231: link d3/dc/d10/d20/d23/l31 d3/dc/d10/d20/l40 0 2024-04-13T10:58:37.363 INFO:tasks.workunit.client.1.smithi194.stdout:0/241: write d9/db/d19/d28/f18 [2257248,36781] 0 2024-04-13T10:58:37.365 INFO:tasks.workunit.client.1.smithi194.stdout:9/255: dread d0/d11/f40 [0,4194304] 0 2024-04-13T10:58:37.365 INFO:tasks.workunit.client.1.smithi194.stdout:2/306: link d2/d5/f4c d2/d3/de/d17/f6c 0 2024-04-13T10:58:37.366 INFO:tasks.workunit.client.1.smithi194.stdout:8/287: creat d6/d22/d23/f5e x:0 0 0 2024-04-13T10:58:37.366 INFO:tasks.workunit.client.1.smithi194.stdout:0/242: fsync d9/d2b/f4a 0 2024-04-13T10:58:37.370 INFO:tasks.workunit.client.1.smithi194.stdout:2/307: dread - d2/d3/de/d17/d1e/d42/d52/f5e zero size 2024-04-13T10:58:37.371 INFO:tasks.workunit.client.1.smithi194.stdout:8/288: creat d6/d22/d23/f5f x:0 0 0 2024-04-13T10:58:37.372 INFO:tasks.workunit.client.1.smithi194.stdout:9/256: rename d0/d6/f23 to d0/d6/d14/d26/d3b/f59 0 2024-04-13T10:58:37.373 INFO:tasks.workunit.client.1.smithi194.stdout:0/243: creat d9/db/f52 x:0 0 0 2024-04-13T10:58:37.373 INFO:tasks.workunit.client.1.smithi194.stdout:5/232: dwrite d3/dc/d10/d20/d23/f30 [0,4194304] 0 2024-04-13T10:58:37.374 INFO:tasks.workunit.client.1.smithi194.stdout:4/317: dwrite d2/d16/d1a/d1d/d31/f3a [0,4194304] 0 2024-04-13T10:58:37.375 INFO:tasks.workunit.client.1.smithi194.stdout:0/244: readlink d9/db/lc 0 2024-04-13T10:58:37.375 INFO:tasks.workunit.client.1.smithi194.stdout:2/308: fsync d2/d3/ff 0 2024-04-13T10:58:37.375 INFO:tasks.workunit.client.1.smithi194.stdout:8/289: write d6/d22/d23/d3d/f47 [2626518,59714] 0 2024-04-13T10:58:37.376 INFO:tasks.workunit.client.1.smithi194.stdout:0/245: dread - d9/db/f52 zero size 2024-04-13T10:58:37.378 INFO:tasks.workunit.client.1.smithi194.stdout:8/290: fdatasync d6/d22/d23/f5e 0 2024-04-13T10:58:37.384 INFO:tasks.workunit.client.1.smithi194.stdout:1/274: sync 2024-04-13T10:58:37.384 INFO:tasks.workunit.client.1.smithi194.stdout:5/233: rename d3/dc/d17/f19 to d3/dc/d2d/f41 0 2024-04-13T10:58:37.386 INFO:tasks.workunit.client.1.smithi194.stdout:4/318: creat d2/d16/d1a/d1d/f68 x:0 0 0 2024-04-13T10:58:37.386 INFO:tasks.workunit.client.1.smithi194.stdout:8/291: write d6/d2a/f4c [99024,71676] 0 2024-04-13T10:58:37.387 INFO:tasks.workunit.client.1.smithi194.stdout:1/275: write d12/d13/d1c/d28/f46 [159627,85707] 0 2024-04-13T10:58:37.388 INFO:tasks.workunit.client.1.smithi194.stdout:5/234: creat d3/dc/d17/d1b/f42 x:0 0 0 2024-04-13T10:58:37.390 INFO:tasks.workunit.client.1.smithi194.stdout:0/246: rename d9/fa to d9/db/d19/d28/f53 0 2024-04-13T10:58:37.391 INFO:tasks.workunit.client.1.smithi194.stdout:1/276: fsync d12/f26 0 2024-04-13T10:58:37.392 INFO:tasks.workunit.client.1.smithi194.stdout:5/235: fsync d3/dc/d10/f3c 0 2024-04-13T10:58:37.393 INFO:tasks.workunit.client.1.smithi194.stdout:0/247: truncate d9/db/f52 210309 0 2024-04-13T10:58:37.393 INFO:tasks.workunit.client.1.smithi194.stdout:4/319: unlink d2/d16/d1a/d1c/d54/d5d/c64 0 2024-04-13T10:58:37.393 INFO:tasks.workunit.client.1.smithi194.stdout:8/292: creat d6/f60 x:0 0 0 2024-04-13T10:58:37.394 INFO:tasks.workunit.client.1.smithi194.stdout:1/277: mknod d12/d3a/d4f/c59 0 2024-04-13T10:58:37.396 INFO:tasks.workunit.client.1.smithi194.stdout:8/293: unlink d6/dd/c1f 0 2024-04-13T10:58:37.396 INFO:tasks.workunit.client.1.smithi194.stdout:5/236: creat d3/dc/d10/d20/f43 x:0 0 0 2024-04-13T10:58:37.398 INFO:tasks.workunit.client.1.smithi194.stdout:8/294: dread - d6/d22/d23/d3d/f40 zero size 2024-04-13T10:58:37.398 INFO:tasks.workunit.client.1.smithi194.stdout:1/278: symlink d12/d13/d1c/d27/d2e/l5a 0 2024-04-13T10:58:37.400 INFO:tasks.workunit.client.1.smithi194.stdout:5/237: creat d3/dc/d10/d38/f44 x:0 0 0 2024-04-13T10:58:37.401 INFO:tasks.workunit.client.1.smithi194.stdout:4/320: dread d2/d16/d1a/f22 [0,4194304] 0 2024-04-13T10:58:37.402 INFO:tasks.workunit.client.1.smithi194.stdout:1/279: readlink d12/d13/d1c/l3f 0 2024-04-13T10:58:37.402 INFO:tasks.workunit.client.1.smithi194.stdout:8/295: mknod d6/c61 0 2024-04-13T10:58:37.403 INFO:tasks.workunit.client.1.smithi194.stdout:5/238: write d3/dc/d10/d38/f44 [802462,111725] 0 2024-04-13T10:58:37.403 INFO:tasks.workunit.client.1.smithi194.stdout:0/248: dread d9/db/d19/f50 [0,4194304] 0 2024-04-13T10:58:37.404 INFO:tasks.workunit.client.1.smithi194.stdout:4/321: fdatasync d2/d33/f2e 0 2024-04-13T10:58:37.406 INFO:tasks.workunit.client.1.smithi194.stdout:5/239: mknod d3/d29/c45 0 2024-04-13T10:58:37.406 INFO:tasks.workunit.client.1.smithi194.stdout:2/309: dread d2/f23 [0,4194304] 0 2024-04-13T10:58:37.407 INFO:tasks.workunit.client.1.smithi194.stdout:0/249: readlink d9/db/d19/d28/l37 0 2024-04-13T10:58:37.408 INFO:tasks.workunit.client.1.smithi194.stdout:8/296: creat d6/d22/d23/d25/d39/f62 x:0 0 0 2024-04-13T10:58:37.408 INFO:tasks.workunit.client.1.smithi194.stdout:4/322: mknod d2/d16/d1a/d1d/d31/c69 0 2024-04-13T10:58:37.410 INFO:tasks.workunit.client.1.smithi194.stdout:2/310: chown d2/d3/de/f1a 59 1 2024-04-13T10:58:37.410 INFO:tasks.workunit.client.1.smithi194.stdout:0/250: write d9/d2b/f4f [2071843,10756] 0 2024-04-13T10:58:37.414 INFO:tasks.workunit.client.1.smithi194.stdout:0/251: chown d9/df/f1f 930 1 2024-04-13T10:58:37.414 INFO:tasks.workunit.client.1.smithi194.stdout:5/240: getdents d3 0 2024-04-13T10:58:37.414 INFO:tasks.workunit.client.1.smithi194.stdout:1/280: dwrite d12/d13/d1c/f31 [0,4194304] 0 2024-04-13T10:58:37.415 INFO:tasks.workunit.client.1.smithi194.stdout:2/311: fdatasync d2/d5/f4c 0 2024-04-13T10:58:37.416 INFO:tasks.workunit.client.1.smithi194.stdout:1/281: chown d12/f35 2510954 1 2024-04-13T10:58:37.416 INFO:tasks.workunit.client.1.smithi194.stdout:2/312: chown d2/d3/de/d17/f6c 140355 1 2024-04-13T10:58:37.417 INFO:tasks.workunit.client.1.smithi194.stdout:0/252: creat d9/f54 x:0 0 0 2024-04-13T10:58:37.418 INFO:tasks.workunit.client.1.smithi194.stdout:2/313: truncate d2/d3/f4a 60803 0 2024-04-13T10:58:37.418 INFO:tasks.workunit.client.1.smithi194.stdout:4/323: rename d2/d16/d1a/d1d/d31/d44/l4a to d2/d16/d1a/d1d/d31/d44/l6a 0 2024-04-13T10:58:37.419 INFO:tasks.workunit.client.1.smithi194.stdout:5/241: mkdir d3/dc/d10/d38/d46 0 2024-04-13T10:58:37.421 INFO:tasks.workunit.client.1.smithi194.stdout:2/314: mkdir d2/d3/d6d 0 2024-04-13T10:58:37.422 INFO:tasks.workunit.client.1.smithi194.stdout:4/324: write d2/d16/d1a/d1d/f26 [3895602,87866] 0 2024-04-13T10:58:37.423 INFO:tasks.workunit.client.1.smithi194.stdout:4/325: readlink d2/d16/d1a/d1c/d3b/l3d 0 2024-04-13T10:58:37.427 INFO:tasks.workunit.client.1.smithi194.stdout:1/282: rename d12/d13/d1c/d27/d2e/f36 to d12/f5b 0 2024-04-13T10:58:37.427 INFO:tasks.workunit.client.1.smithi194.stdout:5/242: getdents d3/dc/d10/d38/d46 0 2024-04-13T10:58:37.429 INFO:tasks.workunit.client.1.smithi194.stdout:0/253: rename d9/db/f38 to d9/db/f55 0 2024-04-13T10:58:37.431 INFO:tasks.workunit.client.1.smithi194.stdout:4/326: rename d2/f4 to d2/d30/d50/f6b 0 2024-04-13T10:58:37.432 INFO:tasks.workunit.client.1.smithi194.stdout:4/327: stat d2/d33/c3c 0 2024-04-13T10:58:37.433 INFO:tasks.workunit.client.1.smithi194.stdout:5/243: creat d3/dc/d17/d1b/f47 x:0 0 0 2024-04-13T10:58:37.434 INFO:tasks.workunit.client.1.smithi194.stdout:0/254: rename d9/db/d19/l51 to d9/l56 0 2024-04-13T10:58:37.435 INFO:tasks.workunit.client.1.smithi194.stdout:0/255: chown d9/df/f3c 106370079 1 2024-04-13T10:58:37.435 INFO:tasks.workunit.client.1.smithi194.stdout:1/283: mkdir d12/d13/d1c/d27/d5c 0 2024-04-13T10:58:37.436 INFO:tasks.workunit.client.1.smithi194.stdout:1/284: read - d12/f55 zero size 2024-04-13T10:58:37.437 INFO:tasks.workunit.client.1.smithi194.stdout:5/244: chown d3/dc/d10/d20/d23/l31 16905014 1 2024-04-13T10:58:37.437 INFO:tasks.workunit.client.1.smithi194.stdout:1/285: dread - d12/d13/d1c/d27/f57 zero size 2024-04-13T10:58:37.438 INFO:tasks.workunit.client.1.smithi194.stdout:4/328: creat d2/d16/d1a/d1c/d54/d62/f6c x:0 0 0 2024-04-13T10:58:37.438 INFO:tasks.workunit.client.1.smithi194.stdout:1/286: stat d12/d3a/f3d 0 2024-04-13T10:58:37.442 INFO:tasks.workunit.client.1.smithi194.stdout:0/256: fdatasync d9/db/d19/d28/f2f 0 2024-04-13T10:58:37.443 INFO:tasks.workunit.client.1.smithi194.stdout:1/287: mknod d12/d13/d1c/d28/d41/d4e/c5d 0 2024-04-13T10:58:37.444 INFO:tasks.workunit.client.1.smithi194.stdout:5/245: mkdir d3/dc/d17/d48 0 2024-04-13T10:58:37.446 INFO:tasks.workunit.client.1.smithi194.stdout:2/315: dwrite d2/d3/de/d17/f6c [0,4194304] 0 2024-04-13T10:58:37.448 INFO:tasks.workunit.client.1.smithi194.stdout:5/246: write d3/dc/d10/f2e [584920,70364] 0 2024-04-13T10:58:37.451 INFO:tasks.workunit.client.1.smithi194.stdout:1/288: creat d12/d13/d44/f5e x:0 0 0 2024-04-13T10:58:37.451 INFO:tasks.workunit.client.1.smithi194.stdout:4/329: dwrite d2/d16/d1a/d1c/f39 [0,4194304] 0 2024-04-13T10:58:37.452 INFO:tasks.workunit.client.1.smithi194.stdout:5/247: chown d3/dc/d2d/f36 17773288 1 2024-04-13T10:58:37.452 INFO:tasks.workunit.client.1.smithi194.stdout:1/289: chown d12/d13/c17 1618 1 2024-04-13T10:58:37.455 INFO:tasks.workunit.client.1.smithi194.stdout:2/316: link d2/d3/c29 d2/d3/de/d17/d36/d65/c6e 0 2024-04-13T10:58:37.457 INFO:tasks.workunit.client.1.smithi194.stdout:1/290: symlink d12/d13/d1c/d53/l5f 0 2024-04-13T10:58:37.461 INFO:tasks.workunit.client.1.smithi194.stdout:2/317: unlink d2/d3/de/d17/d36/f53 0 2024-04-13T10:58:37.462 INFO:tasks.workunit.client.1.smithi194.stdout:5/248: dread d3/dc/f18 [0,4194304] 0 2024-04-13T10:58:37.462 INFO:tasks.workunit.client.1.smithi194.stdout:4/330: dwrite d2/d16/d1a/f36 [0,4194304] 0 2024-04-13T10:58:37.464 INFO:tasks.workunit.client.1.smithi194.stdout:4/331: read d2/d33/f2e [909857,105449] 0 2024-04-13T10:58:37.465 INFO:tasks.workunit.client.1.smithi194.stdout:0/257: dread d9/db/d19/d28/f53 [0,4194304] 0 2024-04-13T10:58:37.466 INFO:tasks.workunit.client.1.smithi194.stdout:4/332: chown d2/d16/d1a/f36 1033811 1 2024-04-13T10:58:37.467 INFO:tasks.workunit.client.1.smithi194.stdout:4/333: write d2/d33/f2e [1091234,129418] 0 2024-04-13T10:58:37.469 INFO:tasks.workunit.client.1.smithi194.stdout:6/253: sync 2024-04-13T10:58:37.469 INFO:tasks.workunit.client.1.smithi194.stdout:7/271: sync 2024-04-13T10:58:37.471 INFO:tasks.workunit.client.1.smithi194.stdout:7/272: write d1/d2b/d2c/d30/f31 [3824728,125280] 0 2024-04-13T10:58:37.471 INFO:tasks.workunit.client.1.smithi194.stdout:5/249: write d3/d29/f34 [1387609,84155] 0 2024-04-13T10:58:37.473 INFO:tasks.workunit.client.1.smithi194.stdout:5/250: write d3/dc/d10/f3c [134113,72159] 0 2024-04-13T10:58:37.484 INFO:tasks.workunit.client.1.smithi194.stdout:6/254: symlink d0/d26/l4c 0 2024-04-13T10:58:37.490 INFO:tasks.workunit.client.1.smithi194.stdout:2/318: creat d2/d3/d6d/f6f x:0 0 0 2024-04-13T10:58:37.491 INFO:tasks.workunit.client.1.smithi194.stdout:2/319: chown d2/d3/de/l60 37 1 2024-04-13T10:58:37.495 INFO:tasks.workunit.client.1.smithi194.stdout:4/334: mknod d2/d16/d1a/d1c/d3e/d48/c6d 0 2024-04-13T10:58:37.496 INFO:tasks.workunit.client.1.smithi194.stdout:0/258: creat d9/db/d3a/f57 x:0 0 0 2024-04-13T10:58:37.497 INFO:tasks.workunit.client.1.smithi194.stdout:5/251: mkdir d3/dc/d17/d48/d49 0 2024-04-13T10:58:37.499 INFO:tasks.workunit.client.1.smithi194.stdout:2/320: fsync d2/d3/de/d33/f35 0 2024-04-13T10:58:37.500 INFO:tasks.workunit.client.1.smithi194.stdout:1/291: truncate d12/d13/d1c/d28/d41/f4a 1233690 0 2024-04-13T10:58:37.503 INFO:tasks.workunit.client.1.smithi194.stdout:6/255: write d0/f34 [4652803,8606] 0 2024-04-13T10:58:37.503 INFO:tasks.workunit.client.1.smithi194.stdout:3/272: dread d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:37.503 INFO:tasks.workunit.client.1.smithi194.stdout:4/335: mkdir d2/d16/d1a/d1c/d54/d62/d6e 0 2024-04-13T10:58:37.503 INFO:tasks.workunit.client.1.smithi194.stdout:0/259: creat d9/db/d3a/f58 x:0 0 0 2024-04-13T10:58:37.507 INFO:tasks.workunit.client.1.smithi194.stdout:0/260: readlink d9/db/d19/l21 0 2024-04-13T10:58:37.508 INFO:tasks.workunit.client.1.smithi194.stdout:7/273: dwrite d1/d2b/d3e/d54/d5a/f58 [0,4194304] 0 2024-04-13T10:58:37.510 INFO:tasks.workunit.client.1.smithi194.stdout:0/261: chown d9/f54 574389 1 2024-04-13T10:58:37.513 INFO:tasks.workunit.client.1.smithi194.stdout:6/256: mkdir d0/d26/d2b/d4d 0 2024-04-13T10:58:37.515 INFO:tasks.workunit.client.1.smithi194.stdout:1/292: mknod d12/d13/d1c/d28/d41/d4e/c60 0 2024-04-13T10:58:37.517 INFO:tasks.workunit.client.1.smithi194.stdout:5/252: dread d3/dc/d10/f14 [0,4194304] 0 2024-04-13T10:58:37.517 INFO:tasks.workunit.client.1.smithi194.stdout:4/336: unlink d2/d30/l59 0 2024-04-13T10:58:37.518 INFO:tasks.workunit.client.1.smithi194.stdout:0/262: fdatasync d9/db/d19/d28/f48 0 2024-04-13T10:58:37.518 INFO:tasks.workunit.client.1.smithi194.stdout:2/321: rmdir d2/d3/de/d17/d1e/d42/d61 0 2024-04-13T10:58:37.520 INFO:tasks.workunit.client.1.smithi194.stdout:6/257: creat d0/d26/f4e x:0 0 0 2024-04-13T10:58:37.522 INFO:tasks.workunit.client.1.smithi194.stdout:8/297: dread d6/d22/d23/d3d/f47 [0,4194304] 0 2024-04-13T10:58:37.522 INFO:tasks.workunit.client.1.smithi194.stdout:1/293: write d12/d13/d3e/f2d [464895,57382] 0 2024-04-13T10:58:37.526 INFO:tasks.workunit.client.1.smithi194.stdout:0/263: mknod d9/df/d16/c59 0 2024-04-13T10:58:37.526 INFO:tasks.workunit.client.1.smithi194.stdout:8/298: chown d6/l3f 1037052 1 2024-04-13T10:58:37.526 INFO:tasks.workunit.client.1.smithi194.stdout:2/322: dread d2/d3/de/f5d [0,4194304] 0 2024-04-13T10:58:37.527 INFO:tasks.workunit.client.1.smithi194.stdout:5/253: read d3/dc/d10/f2e [650829,34790] 0 2024-04-13T10:58:37.527 INFO:tasks.workunit.client.1.smithi194.stdout:3/273: dwrite d2/d3/d12/d31/d34/f37 [0,4194304] 0 2024-04-13T10:58:37.529 INFO:tasks.workunit.client.1.smithi194.stdout:7/274: dwrite d1/d2b/d2c/d30/f32 [0,4194304] 0 2024-04-13T10:58:37.530 INFO:tasks.workunit.client.1.smithi194.stdout:0/264: chown d9/db/d19 54351508 1 2024-04-13T10:58:37.530 INFO:tasks.workunit.client.1.smithi194.stdout:1/294: symlink d12/d13/d44/l61 0 2024-04-13T10:58:37.533 INFO:tasks.workunit.client.1.smithi194.stdout:5/254: symlink d3/l4a 0 2024-04-13T10:58:37.534 INFO:tasks.workunit.client.1.smithi194.stdout:3/274: creat d2/d3/d1a/d24/f4c x:0 0 0 2024-04-13T10:58:37.550 INFO:tasks.workunit.client.1.smithi194.stdout:1/295: creat d12/d13/d1c/d27/d2e/f62 x:0 0 0 2024-04-13T10:58:37.550 INFO:tasks.workunit.client.1.smithi194.stdout:4/337: truncate d2/d16/d1a/f2f 1517542 0 2024-04-13T10:58:37.550 INFO:tasks.workunit.client.1.smithi194.stdout:6/258: dwrite d0/d2c/f31 [0,4194304] 0 2024-04-13T10:58:37.551 INFO:tasks.workunit.client.1.smithi194.stdout:0/265: dread d9/d2b/f3e [0,4194304] 0 2024-04-13T10:58:37.551 INFO:tasks.workunit.client.1.smithi194.stdout:2/323: rename d2/d5/c10 to d2/d3/de/d17/d1e/d42/d52/d5a/c70 0 2024-04-13T10:58:37.551 INFO:tasks.workunit.client.1.smithi194.stdout:3/275: write d2/d3/d12/d31/d34/f37 [3427903,23390] 0 2024-04-13T10:58:37.551 INFO:tasks.workunit.client.1.smithi194.stdout:8/299: dwrite d6/f1e [0,4194304] 0 2024-04-13T10:58:37.551 INFO:tasks.workunit.client.1.smithi194.stdout:9/257: sync 2024-04-13T10:58:37.551 INFO:tasks.workunit.client.1.smithi194.stdout:4/338: dread - d2/d16/d1a/d1c/d3e/f3f zero size 2024-04-13T10:58:37.551 INFO:tasks.workunit.client.1.smithi194.stdout:0/266: write d9/d2b/f4f [1918482,108862] 0 2024-04-13T10:58:37.552 INFO:tasks.workunit.client.1.smithi194.stdout:4/339: write d2/d30/d50/f5a [158847,25164] 0 2024-04-13T10:58:37.552 INFO:tasks.workunit.client.1.smithi194.stdout:2/324: fsync d2/d3/de/d33/d47/f50 0 2024-04-13T10:58:37.552 INFO:tasks.workunit.client.1.smithi194.stdout:6/259: read d0/d26/f14 [2399175,105780] 0 2024-04-13T10:58:37.553 INFO:tasks.workunit.client.1.smithi194.stdout:2/325: chown d2/d5/l4d 410499 1 2024-04-13T10:58:37.554 INFO:tasks.workunit.client.1.smithi194.stdout:3/276: mknod d2/de/c4d 0 2024-04-13T10:58:37.557 INFO:tasks.workunit.client.1.smithi194.stdout:9/258: mknod d0/d6/d2c/c5a 0 2024-04-13T10:58:37.557 INFO:tasks.workunit.client.1.smithi194.stdout:0/267: mkdir d9/d2b/d5a 0 2024-04-13T10:58:37.563 INFO:tasks.workunit.client.1.smithi194.stdout:3/277: dwrite d2/d3/d1a/d24/f4c [0,4194304] 0 2024-04-13T10:58:37.564 INFO:tasks.workunit.client.1.smithi194.stdout:2/326: dread d2/d3/de/d17/f6c [0,4194304] 0 2024-04-13T10:58:37.565 INFO:tasks.workunit.client.1.smithi194.stdout:5/255: rmdir d3/dc/d2d 39 2024-04-13T10:58:37.566 INFO:tasks.workunit.client.1.smithi194.stdout:2/327: write d2/d3/de/f1a [1513500,12298] 0 2024-04-13T10:58:37.567 INFO:tasks.workunit.client.1.smithi194.stdout:4/340: creat d2/d16/d1a/f6f x:0 0 0 2024-04-13T10:58:37.571 INFO:tasks.workunit.client.1.smithi194.stdout:9/259: mknod d0/d6/d9/d51/c5b 0 2024-04-13T10:58:37.571 INFO:tasks.workunit.client.1.smithi194.stdout:9/260: chown d0/d11/d1e 33035174 1 2024-04-13T10:58:37.572 INFO:tasks.workunit.client.1.smithi194.stdout:9/261: chown d0/d11 31 1 2024-04-13T10:58:37.573 INFO:tasks.workunit.client.1.smithi194.stdout:0/268: creat d9/d2b/d5a/f5b x:0 0 0 2024-04-13T10:58:37.574 INFO:tasks.workunit.client.1.smithi194.stdout:3/278: creat d2/d3/d12/d31/f4e x:0 0 0 2024-04-13T10:58:37.575 INFO:tasks.workunit.client.1.smithi194.stdout:3/279: readlink d2/d3/d12/l20 0 2024-04-13T10:58:37.577 INFO:tasks.workunit.client.1.smithi194.stdout:2/328: unlink d2/d3/f63 0 2024-04-13T10:58:37.578 INFO:tasks.workunit.client.1.smithi194.stdout:8/300: creat d6/d22/d23/d25/d30/f63 x:0 0 0 2024-04-13T10:58:37.579 INFO:tasks.workunit.client.1.smithi194.stdout:8/301: chown d6/dd/c31 15378 1 2024-04-13T10:58:37.581 INFO:tasks.workunit.client.1.smithi194.stdout:9/262: creat d0/d6/d14/f5c x:0 0 0 2024-04-13T10:58:37.581 INFO:tasks.workunit.client.1.smithi194.stdout:7/275: truncate d1/d2b/d3e/d54/d5a/d3c/f40 1872812 0 2024-04-13T10:58:37.583 INFO:tasks.workunit.client.1.smithi194.stdout:5/256: mknod d3/dc/d10/d20/c4b 0 2024-04-13T10:58:37.588 INFO:tasks.workunit.client.1.smithi194.stdout:4/341: truncate d2/d16/d1a/d1d/f51 81539 0 2024-04-13T10:58:37.588 INFO:tasks.workunit.client.1.smithi194.stdout:9/263: write d0/d11/f41 [615662,16826] 0 2024-04-13T10:58:37.589 INFO:tasks.workunit.client.1.smithi194.stdout:6/260: dwrite d0/d26/f15 [0,4194304] 0 2024-04-13T10:58:37.591 INFO:tasks.workunit.client.1.smithi194.stdout:0/269: link d9/db/d19/d28/f53 d9/db/d3a/f5c 0 2024-04-13T10:58:37.592 INFO:tasks.workunit.client.1.smithi194.stdout:5/257: fdatasync d3/dc/d10/f14 0 2024-04-13T10:58:37.593 INFO:tasks.workunit.client.1.smithi194.stdout:6/261: stat d0/d2c 0 2024-04-13T10:58:37.593 INFO:tasks.workunit.client.1.smithi194.stdout:1/296: dread d12/d13/f37 [0,4194304] 0 2024-04-13T10:58:37.593 INFO:tasks.workunit.client.1.smithi194.stdout:8/302: dwrite d6/dd/f16 [0,4194304] 0 2024-04-13T10:58:37.594 INFO:tasks.workunit.client.1.smithi194.stdout:4/342: chown d2/d16/d1a/d1c/d54/d5d/c61 454558 1 2024-04-13T10:58:37.595 INFO:tasks.workunit.client.1.smithi194.stdout:7/276: mkdir d1/d2b/d4c/d4f/d51/d4d/d5e/d5f 0 2024-04-13T10:58:37.597 INFO:tasks.workunit.client.1.smithi194.stdout:1/297: chown d12/d13/l16 923051 1 2024-04-13T10:58:37.597 INFO:tasks.workunit.client.1.smithi194.stdout:6/262: dread - d0/d26/d2b/f40 zero size 2024-04-13T10:58:37.597 INFO:tasks.workunit.client.1.smithi194.stdout:7/277: fdatasync d1/f8 0 2024-04-13T10:58:37.597 INFO:tasks.workunit.client.1.smithi194.stdout:8/303: write d6/d2a/f4c [1116298,116320] 0 2024-04-13T10:58:37.599 INFO:tasks.workunit.client.1.smithi194.stdout:1/298: read - d12/d13/d3e/f42 zero size 2024-04-13T10:58:37.599 INFO:tasks.workunit.client.1.smithi194.stdout:8/304: chown d6/dd/l4d 926 1 2024-04-13T10:58:37.599 INFO:tasks.workunit.client.1.smithi194.stdout:0/270: creat d9/df/d16/f5d x:0 0 0 2024-04-13T10:58:37.601 INFO:tasks.workunit.client.1.smithi194.stdout:0/271: chown d9/db/d19/d28/f17 17 1 2024-04-13T10:58:37.601 INFO:tasks.workunit.client.1.smithi194.stdout:8/305: truncate d6/d22/f26 1247537 0 2024-04-13T10:58:37.602 INFO:tasks.workunit.client.1.smithi194.stdout:8/306: write d6/d22/d23/d25/d39/d41/f4e [1008352,107418] 0 2024-04-13T10:58:37.602 INFO:tasks.workunit.client.1.smithi194.stdout:5/258: creat d3/dc/d10/f4c x:0 0 0 2024-04-13T10:58:37.603 INFO:tasks.workunit.client.1.smithi194.stdout:3/280: write d2/f27 [910736,119077] 0 2024-04-13T10:58:37.605 INFO:tasks.workunit.client.1.smithi194.stdout:8/307: write d6/d22/d23/d25/f27 [2617760,97930] 0 2024-04-13T10:58:37.606 INFO:tasks.workunit.client.1.smithi194.stdout:8/308: chown d6/dd 129552951 1 2024-04-13T10:58:37.607 INFO:tasks.workunit.client.1.smithi194.stdout:9/264: unlink d0/d6/d14/l16 0 2024-04-13T10:58:37.610 INFO:tasks.workunit.client.1.smithi194.stdout:7/278: rmdir d1/d2b/d3e/d54/d5a/d3c 39 2024-04-13T10:58:37.610 INFO:tasks.workunit.client.1.smithi194.stdout:1/299: creat d12/d3a/d4f/f63 x:0 0 0 2024-04-13T10:58:37.611 INFO:tasks.workunit.client.1.smithi194.stdout:9/265: chown d0/d11/f40 2 1 2024-04-13T10:58:37.611 INFO:tasks.workunit.client.1.smithi194.stdout:0/272: mknod d9/df/c5e 0 2024-04-13T10:58:37.615 INFO:tasks.workunit.client.1.smithi194.stdout:6/263: creat d0/d26/d2b/d4d/f4f x:0 0 0 2024-04-13T10:58:37.616 INFO:tasks.workunit.client.1.smithi194.stdout:1/300: chown d12/d13/d3e/f2d 57922850 1 2024-04-13T10:58:37.616 INFO:tasks.workunit.client.1.smithi194.stdout:9/266: creat d0/d11/d3d/f5d x:0 0 0 2024-04-13T10:58:37.617 INFO:tasks.workunit.client.1.smithi194.stdout:5/259: dwrite d3/dc/d17/d1b/f47 [0,4194304] 0 2024-04-13T10:58:37.618 INFO:tasks.workunit.client.1.smithi194.stdout:8/309: dread d6/d22/f26 [0,4194304] 0 2024-04-13T10:58:37.618 INFO:tasks.workunit.client.1.smithi194.stdout:4/343: getdents d2/d16/d1a/d1c/d3b 0 2024-04-13T10:58:37.618 INFO:tasks.workunit.client.1.smithi194.stdout:0/273: chown d9/db/d19/d28/f53 1 1 2024-04-13T10:58:37.620 INFO:tasks.workunit.client.1.smithi194.stdout:7/279: write d1/d2b/d2c/d30/d33/d39/f4b [313371,109681] 0 2024-04-13T10:58:37.621 INFO:tasks.workunit.client.1.smithi194.stdout:9/267: symlink d0/d6/d9/l5e 0 2024-04-13T10:58:37.621 INFO:tasks.workunit.client.1.smithi194.stdout:5/260: unlink d3/dc/d10/f14 0 2024-04-13T10:58:37.623 INFO:tasks.workunit.client.1.smithi194.stdout:9/268: chown d0/d6 29 1 2024-04-13T10:58:37.623 INFO:tasks.workunit.client.1.smithi194.stdout:6/264: write d0/d26/d2b/f3c [1093677,1288] 0 2024-04-13T10:58:37.626 INFO:tasks.workunit.client.1.smithi194.stdout:7/280: read d1/fa [2486548,100804] 0 2024-04-13T10:58:37.626 INFO:tasks.workunit.client.1.smithi194.stdout:5/261: chown d3/dc/d10/d38/d46 10549 1 2024-04-13T10:58:37.628 INFO:tasks.workunit.client.1.smithi194.stdout:0/274: symlink d9/d2b/d5a/l5f 0 2024-04-13T10:58:37.631 INFO:tasks.workunit.client.1.smithi194.stdout:8/310: mkdir d6/d22/d23/d25/d39/d41/d64 0 2024-04-13T10:58:37.631 INFO:tasks.workunit.client.1.smithi194.stdout:4/344: dread d2/d33/f2e [0,4194304] 0 2024-04-13T10:58:37.633 INFO:tasks.workunit.client.1.smithi194.stdout:1/301: dwrite d12/d13/d1c/d28/f46 [0,4194304] 0 2024-04-13T10:58:37.637 INFO:tasks.workunit.client.1.smithi194.stdout:1/302: readlink d12/d13/l19 0 2024-04-13T10:58:37.638 INFO:tasks.workunit.client.1.smithi194.stdout:6/265: rmdir d0/d2f 39 2024-04-13T10:58:37.639 INFO:tasks.workunit.client.1.smithi194.stdout:1/303: chown d12/d13/d1c 1671 1 2024-04-13T10:58:37.639 INFO:tasks.workunit.client.1.smithi194.stdout:3/281: dwrite d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:37.640 INFO:tasks.workunit.client.1.smithi194.stdout:9/269: creat d0/d11/d58/f5f x:0 0 0 2024-04-13T10:58:37.642 INFO:tasks.workunit.client.1.smithi194.stdout:0/275: symlink d9/db/d19/l60 0 2024-04-13T10:58:37.642 INFO:tasks.workunit.client.1.smithi194.stdout:5/262: write d3/f9 [1433699,38040] 0 2024-04-13T10:58:37.645 INFO:tasks.workunit.client.1.smithi194.stdout:3/282: truncate d2/d3/d12/d31/d34/f39 675653 0 2024-04-13T10:58:37.647 INFO:tasks.workunit.client.1.smithi194.stdout:7/281: rename d1/d2b/d4c/d4f/d51/c2d to d1/d2b/d4c/d4f/d51/d4d/d5e/c60 0 2024-04-13T10:58:37.648 INFO:tasks.workunit.client.1.smithi194.stdout:7/282: chown d1/d2b/d4c/d4f 3328 1 2024-04-13T10:58:37.648 INFO:tasks.workunit.client.1.smithi194.stdout:9/270: unlink d0/f55 0 2024-04-13T10:58:37.649 INFO:tasks.workunit.client.1.smithi194.stdout:1/304: fsync d12/d13/d1c/d28/f46 0 2024-04-13T10:58:37.649 INFO:tasks.workunit.client.1.smithi194.stdout:9/271: chown d0/c33 5707732 1 2024-04-13T10:58:37.653 INFO:tasks.workunit.client.1.smithi194.stdout:5/263: creat d3/dc/d10/d38/f4d x:0 0 0 2024-04-13T10:58:37.657 INFO:tasks.workunit.client.1.smithi194.stdout:8/311: rename d6/f1e to d6/d22/d23/d3d/f65 0 2024-04-13T10:58:37.659 INFO:tasks.workunit.client.1.smithi194.stdout:1/305: dwrite d12/d13/d1c/d27/d2e/f62 [0,4194304] 0 2024-04-13T10:58:37.659 INFO:tasks.workunit.client.1.smithi194.stdout:8/312: readlink d6/d22/d23/l2b 0 2024-04-13T10:58:37.660 INFO:tasks.workunit.client.1.smithi194.stdout:8/313: chown d6/d2a/f57 67 1 2024-04-13T10:58:37.665 INFO:tasks.workunit.client.1.smithi194.stdout:9/272: creat d0/d6/d14/d26/d42/f60 x:0 0 0 2024-04-13T10:58:37.667 INFO:tasks.workunit.client.1.smithi194.stdout:5/264: dread - d3/dc/d2d/f36 zero size 2024-04-13T10:58:37.668 INFO:tasks.workunit.client.1.smithi194.stdout:5/265: chown d3/f9 3 1 2024-04-13T10:58:37.668 INFO:tasks.workunit.client.1.smithi194.stdout:0/276: dread d9/db/f15 [0,4194304] 0 2024-04-13T10:58:37.671 INFO:tasks.workunit.client.1.smithi194.stdout:4/345: rename d2/d16/d1a/d1d to d2/d16/d70 0 2024-04-13T10:58:37.671 INFO:tasks.workunit.client.1.smithi194.stdout:5/266: dread d3/dc/d10/f3c [0,4194304] 0 2024-04-13T10:58:37.675 INFO:tasks.workunit.client.1.smithi194.stdout:9/273: unlink d0/d6/d14/f5c 0 2024-04-13T10:58:37.675 INFO:tasks.workunit.client.1.smithi194.stdout:0/277: symlink d9/df/l61 0 2024-04-13T10:58:37.676 INFO:tasks.workunit.client.1.smithi194.stdout:3/283: dread d2/f30 [0,4194304] 0 2024-04-13T10:58:37.678 INFO:tasks.workunit.client.1.smithi194.stdout:2/329: sync 2024-04-13T10:58:37.678 INFO:tasks.workunit.client.1.smithi194.stdout:5/267: chown d3/dc/d10/d20/l32 144340137 1 2024-04-13T10:58:37.678 INFO:tasks.workunit.client.1.smithi194.stdout:8/314: symlink d6/l66 0 2024-04-13T10:58:37.679 INFO:tasks.workunit.client.1.smithi194.stdout:5/268: dread - d3/dc/d10/d20/f43 zero size 2024-04-13T10:58:37.680 INFO:tasks.workunit.client.1.smithi194.stdout:9/274: symlink d0/d6/d14/l61 0 2024-04-13T10:58:37.682 INFO:tasks.workunit.client.1.smithi194.stdout:0/278: unlink d9/db/d3a/f40 0 2024-04-13T10:58:37.683 INFO:tasks.workunit.client.1.smithi194.stdout:6/266: rename d0/l1c to d0/d42/d3f/l50 0 2024-04-13T10:58:37.683 INFO:tasks.workunit.client.1.smithi194.stdout:7/283: getdents d1/d2b/d2c/d30 0 2024-04-13T10:58:37.684 INFO:tasks.workunit.client.1.smithi194.stdout:2/330: mkdir d2/d3/de/d33/d71 0 2024-04-13T10:58:37.684 INFO:tasks.workunit.client.1.smithi194.stdout:8/315: creat d6/d22/d23/d25/d39/d41/f67 x:0 0 0 2024-04-13T10:58:37.685 INFO:tasks.workunit.client.1.smithi194.stdout:5/269: symlink d3/dc/d10/l4e 0 2024-04-13T10:58:37.686 INFO:tasks.workunit.client.1.smithi194.stdout:0/279: write d9/db/d19/f50 [6164092,50997] 0 2024-04-13T10:58:37.688 INFO:tasks.workunit.client.1.smithi194.stdout:3/284: rename d2/d3/d12/f41 to d2/d3/d12/d31/f4f 0 2024-04-13T10:58:37.688 INFO:tasks.workunit.client.1.smithi194.stdout:4/346: dread d2/d16/d1a/f2f [0,4194304] 0 2024-04-13T10:58:37.689 INFO:tasks.workunit.client.1.smithi194.stdout:1/306: dread d12/d3a/f3d [0,4194304] 0 2024-04-13T10:58:37.689 INFO:tasks.workunit.client.1.smithi194.stdout:7/284: mknod d1/d2b/d3e/c61 0 2024-04-13T10:58:37.691 INFO:tasks.workunit.client.1.smithi194.stdout:7/285: fdatasync d1/d2b/d3e/d54/d5a/f58 0 2024-04-13T10:58:37.694 INFO:tasks.workunit.client.1.smithi194.stdout:6/267: rename d0/d26/f19 to d0/d2f/f51 0 2024-04-13T10:58:37.694 INFO:tasks.workunit.client.1.smithi194.stdout:2/331: mknod d2/d3/de/d17/d36/d65/c72 0 2024-04-13T10:58:37.696 INFO:tasks.workunit.client.1.smithi194.stdout:6/268: write d0/d26/d2b/f40 [808014,88479] 0 2024-04-13T10:58:37.697 INFO:tasks.workunit.client.1.smithi194.stdout:1/307: dread d12/d13/d1c/f21 [0,4194304] 0 2024-04-13T10:58:37.697 INFO:tasks.workunit.client.1.smithi194.stdout:8/316: mkdir d6/d22/d23/d25/d68 0 2024-04-13T10:58:37.698 INFO:tasks.workunit.client.1.smithi194.stdout:6/269: chown d0/d26/f23 7034 1 2024-04-13T10:58:37.699 INFO:tasks.workunit.client.1.smithi194.stdout:5/270: mkdir d3/d29/d4f 0 2024-04-13T10:58:37.699 INFO:tasks.workunit.client.1.smithi194.stdout:6/270: chown d0/d26/d2b/f47 716926461 1 2024-04-13T10:58:37.700 INFO:tasks.workunit.client.1.smithi194.stdout:9/275: mknod d0/d11/c62 0 2024-04-13T10:58:37.707 INFO:tasks.workunit.client.1.smithi194.stdout:8/317: dwrite d6/d22/d23/d25/d39/d41/f4e [0,4194304] 0 2024-04-13T10:58:37.711 INFO:tasks.workunit.client.1.smithi194.stdout:9/276: creat d0/d6/d14/d26/d3b/f63 x:0 0 0 2024-04-13T10:58:37.713 INFO:tasks.workunit.client.1.smithi194.stdout:3/285: rmdir d2/d3/d12/d31 39 2024-04-13T10:58:37.715 INFO:tasks.workunit.client.1.smithi194.stdout:1/308: dread d12/f26 [0,4194304] 0 2024-04-13T10:58:37.717 INFO:tasks.workunit.client.1.smithi194.stdout:2/332: rename d2/d3/de/d17/d36/d3d/f3e to d2/d3/f73 0 2024-04-13T10:58:37.723 INFO:tasks.workunit.client.1.smithi194.stdout:3/286: symlink d2/de/l50 0 2024-04-13T10:58:37.725 INFO:tasks.workunit.client.1.smithi194.stdout:4/347: write d2/d16/d1a/f22 [3041493,93852] 0 2024-04-13T10:58:37.725 INFO:tasks.workunit.client.1.smithi194.stdout:2/333: dwrite d2/d3/de/d17/d1e/f62 [0,4194304] 0 2024-04-13T10:58:37.727 INFO:tasks.workunit.client.1.smithi194.stdout:0/280: dwrite d9/db/d19/d28/f53 [0,4194304] 0 2024-04-13T10:58:37.729 INFO:tasks.workunit.client.1.smithi194.stdout:3/287: write d2/f27 [4082139,74521] 0 2024-04-13T10:58:37.730 INFO:tasks.workunit.client.1.smithi194.stdout:2/334: fdatasync d2/d3/d12/f1c 0 2024-04-13T10:58:37.730 INFO:tasks.workunit.client.1.smithi194.stdout:4/348: stat d2/d16/d1a/d1c/d54/f5f 0 2024-04-13T10:58:37.736 INFO:tasks.workunit.client.1.smithi194.stdout:6/271: rename d0/d26/d2b/l30 to d0/d42/d3f/l52 0 2024-04-13T10:58:37.741 INFO:tasks.workunit.client.1.smithi194.stdout:5/271: link d3/dc/lf d3/dc/d10/d20/l50 0 2024-04-13T10:58:37.742 INFO:tasks.workunit.client.1.smithi194.stdout:9/277: chown d0/d11/f40 24188 1 2024-04-13T10:58:37.742 INFO:tasks.workunit.client.1.smithi194.stdout:5/272: fsync d3/dc/d10/f4c 0 2024-04-13T10:58:37.743 INFO:tasks.workunit.client.1.smithi194.stdout:9/278: dread - d0/d6/d14/d26/f38 zero size 2024-04-13T10:58:37.744 INFO:tasks.workunit.client.1.smithi194.stdout:7/286: truncate d1/d2b/d2c/d30/f31 186306 0 2024-04-13T10:58:37.744 INFO:tasks.workunit.client.1.smithi194.stdout:7/287: chown d1 1753 1 2024-04-13T10:58:37.745 INFO:tasks.workunit.client.1.smithi194.stdout:3/288: mknod d2/d3/c51 0 2024-04-13T10:58:37.746 INFO:tasks.workunit.client.1.smithi194.stdout:1/309: write d12/f1a [1377888,110728] 0 2024-04-13T10:58:37.748 INFO:tasks.workunit.client.1.smithi194.stdout:5/273: creat d3/dc/d10/d38/f51 x:0 0 0 2024-04-13T10:58:37.749 INFO:tasks.workunit.client.1.smithi194.stdout:5/274: readlink d3/dc/d10/l37 0 2024-04-13T10:58:37.750 INFO:tasks.workunit.client.1.smithi194.stdout:7/288: rmdir d1/d2b/d2c/d30 39 2024-04-13T10:58:37.750 INFO:tasks.workunit.client.1.smithi194.stdout:7/289: write d1/f12 [120643,130002] 0 2024-04-13T10:58:37.752 INFO:tasks.workunit.client.1.smithi194.stdout:6/272: mkdir d0/d53 0 2024-04-13T10:58:37.754 INFO:tasks.workunit.client.1.smithi194.stdout:0/281: rename d9/db/lc to d9/db/l62 0 2024-04-13T10:58:37.755 INFO:tasks.workunit.client.1.smithi194.stdout:1/310: mknod d12/d13/d1c/d28/d41/d4e/c64 0 2024-04-13T10:58:37.758 INFO:tasks.workunit.client.1.smithi194.stdout:3/289: readlink d2/d3/d12/d31/l46 0 2024-04-13T10:58:37.761 INFO:tasks.workunit.client.1.smithi194.stdout:2/335: rename d2/d3/de/f5d to d2/f74 0 2024-04-13T10:58:37.762 INFO:tasks.workunit.client.1.smithi194.stdout:6/273: fdatasync d0/f8 0 2024-04-13T10:58:37.763 INFO:tasks.workunit.client.1.smithi194.stdout:2/336: write d2/d3/de/d33/d47/f50 [703979,9008] 0 2024-04-13T10:58:37.763 INFO:tasks.workunit.client.1.smithi194.stdout:0/282: mkdir d9/df/d63 0 2024-04-13T10:58:37.764 INFO:tasks.workunit.client.1.smithi194.stdout:1/311: creat d12/d13/d1c/f65 x:0 0 0 2024-04-13T10:58:37.765 INFO:tasks.workunit.client.1.smithi194.stdout:9/279: getdents d0/d11/d44 0 2024-04-13T10:58:37.766 INFO:tasks.workunit.client.1.smithi194.stdout:0/283: dread d9/db/d3a/f49 [0,4194304] 0 2024-04-13T10:58:37.766 INFO:tasks.workunit.client.1.smithi194.stdout:3/290: creat d2/d3/d12/d31/f52 x:0 0 0 2024-04-13T10:58:37.768 INFO:tasks.workunit.client.1.smithi194.stdout:7/290: creat d1/d2b/d2c/d30/d33/d39/f62 x:0 0 0 2024-04-13T10:58:37.770 INFO:tasks.workunit.client.1.smithi194.stdout:0/284: dread d9/db/f15 [0,4194304] 0 2024-04-13T10:58:37.771 INFO:tasks.workunit.client.1.smithi194.stdout:0/285: chown d9/db/d19/d28 332 1 2024-04-13T10:58:37.774 INFO:tasks.workunit.client.1.smithi194.stdout:1/312: creat d12/d13/d3e/f66 x:0 0 0 2024-04-13T10:58:37.777 INFO:tasks.workunit.client.1.smithi194.stdout:3/291: chown d2/d3/d12/d31/d34/l47 1 1 2024-04-13T10:58:37.778 INFO:tasks.workunit.client.1.smithi194.stdout:7/291: chown d1/c21 5 1 2024-04-13T10:58:37.782 INFO:tasks.workunit.client.1.smithi194.stdout:2/337: creat d2/d3/de/d33/d71/f75 x:0 0 0 2024-04-13T10:58:37.783 INFO:tasks.workunit.client.1.smithi194.stdout:2/338: write d2/d3/f4a [696357,72865] 0 2024-04-13T10:58:37.783 INFO:tasks.workunit.client.1.smithi194.stdout:0/286: mknod d9/d2b/c64 0 2024-04-13T10:58:37.784 INFO:tasks.workunit.client.1.smithi194.stdout:0/287: chown d9/c20 24 1 2024-04-13T10:58:37.785 INFO:tasks.workunit.client.1.smithi194.stdout:6/274: dread d0/f1a [0,4194304] 0 2024-04-13T10:58:37.787 INFO:tasks.workunit.client.1.smithi194.stdout:9/280: symlink d0/d11/l64 0 2024-04-13T10:58:37.789 INFO:tasks.workunit.client.1.smithi194.stdout:3/292: creat d2/d3/d12/d31/d34/f53 x:0 0 0 2024-04-13T10:58:37.789 INFO:tasks.workunit.client.1.smithi194.stdout:7/292: mknod d1/d2b/d2c/d30/c63 0 2024-04-13T10:58:37.789 INFO:tasks.workunit.client.1.smithi194.stdout:3/293: dread - d2/d3/d12/d31/f4e zero size 2024-04-13T10:58:37.790 INFO:tasks.workunit.client.1.smithi194.stdout:5/275: write d3/dc/d17/f1c [3763443,107231] 0 2024-04-13T10:58:37.792 INFO:tasks.workunit.client.1.smithi194.stdout:0/288: mkdir d9/df/d16/d65 0 2024-04-13T10:58:37.793 INFO:tasks.workunit.client.1.smithi194.stdout:0/289: read - d9/d2b/f4a zero size 2024-04-13T10:58:37.794 INFO:tasks.workunit.client.1.smithi194.stdout:3/294: mknod d2/d3/c54 0 2024-04-13T10:58:37.794 INFO:tasks.workunit.client.1.smithi194.stdout:7/293: creat d1/d2b/d4c/d4f/f64 x:0 0 0 2024-04-13T10:58:37.795 INFO:tasks.workunit.client.1.smithi194.stdout:7/294: stat d1/d2b/d3e/d54/d5a/f58 0 2024-04-13T10:58:37.798 INFO:tasks.workunit.client.1.smithi194.stdout:1/313: getdents d12/d13/d44 0 2024-04-13T10:58:37.800 INFO:tasks.workunit.client.1.smithi194.stdout:3/295: symlink d2/d3/d12/l55 0 2024-04-13T10:58:37.802 INFO:tasks.workunit.client.1.smithi194.stdout:1/314: dread d12/d3a/f3d [0,4194304] 0 2024-04-13T10:58:37.803 INFO:tasks.workunit.client.1.smithi194.stdout:2/339: link d2/d3/de/d33/f35 d2/d3/de/d3c/f76 0 2024-04-13T10:58:37.804 INFO:tasks.workunit.client.1.smithi194.stdout:0/290: truncate d9/db/d19/d28/f2f 968423 0 2024-04-13T10:58:37.805 INFO:tasks.workunit.client.1.smithi194.stdout:5/276: link d3/dc/d10/d20/l32 d3/dc/d10/d20/l52 0 2024-04-13T10:58:37.805 INFO:tasks.workunit.client.1.smithi194.stdout:0/291: dread - d9/db/f3d zero size 2024-04-13T10:58:37.806 INFO:tasks.workunit.client.1.smithi194.stdout:3/296: mkdir d2/d3/d1a/d24/d3a/d56 0 2024-04-13T10:58:37.807 INFO:tasks.workunit.client.1.smithi194.stdout:7/295: creat d1/d2b/d3e/d54/d5a/d3c/f65 x:0 0 0 2024-04-13T10:58:37.808 INFO:tasks.workunit.client.1.smithi194.stdout:2/340: rmdir d2 39 2024-04-13T10:58:37.809 INFO:tasks.workunit.client.1.smithi194.stdout:1/315: dwrite d12/f55 [0,4194304] 0 2024-04-13T10:58:37.811 INFO:tasks.workunit.client.1.smithi194.stdout:0/292: symlink d9/db/d3a/l66 0 2024-04-13T10:58:37.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/277: creat d3/dc/d10/d38/d46/f53 x:0 0 0 2024-04-13T10:58:37.814 INFO:tasks.workunit.client.1.smithi194.stdout:3/297: mkdir d2/d3/d1a/d24/d3a/d48/d57 0 2024-04-13T10:58:37.817 INFO:tasks.workunit.client.1.smithi194.stdout:1/316: link d12/d13/d3e/f42 d12/d13/d1c/d28/d41/d4e/f67 0 2024-04-13T10:58:37.818 INFO:tasks.workunit.client.1.smithi194.stdout:6/275: truncate d0/f2e 3020403 0 2024-04-13T10:58:37.821 INFO:tasks.workunit.client.1.smithi194.stdout:7/296: creat d1/d2b/d2c/d30/d33/d39/f66 x:0 0 0 2024-04-13T10:58:37.821 INFO:tasks.workunit.client.1.smithi194.stdout:6/276: read d0/d2f/f51 [136879,98029] 0 2024-04-13T10:58:37.822 INFO:tasks.workunit.client.1.smithi194.stdout:7/297: fdatasync d1/d2b/d3e/d54/d5a/f58 0 2024-04-13T10:58:37.826 INFO:tasks.workunit.client.1.smithi194.stdout:5/278: creat d3/dc/d17/d48/f54 x:0 0 0 2024-04-13T10:58:37.830 INFO:tasks.workunit.client.1.smithi194.stdout:3/298: rename d2/de/c32 to d2/d3/c58 0 2024-04-13T10:58:37.830 INFO:tasks.workunit.client.1.smithi194.stdout:7/298: dwrite d1/d2b/d4c/d4f/f53 [0,4194304] 0 2024-04-13T10:58:37.833 INFO:tasks.workunit.client.1.smithi194.stdout:5/279: chown d3/dc/d17/d1b/f42 3344 1 2024-04-13T10:58:37.837 INFO:tasks.workunit.client.1.smithi194.stdout:3/299: mknod d2/d3/d12/d21/c59 0 2024-04-13T10:58:37.838 INFO:tasks.workunit.client.1.smithi194.stdout:7/299: creat d1/d2b/d4c/d4f/d51/d4d/d5e/f67 x:0 0 0 2024-04-13T10:58:37.840 INFO:tasks.workunit.client.1.smithi194.stdout:1/317: getdents d12/d13/d1c/d27 0 2024-04-13T10:58:37.844 INFO:tasks.workunit.client.1.smithi194.stdout:5/280: symlink d3/l55 0 2024-04-13T10:58:37.847 INFO:tasks.workunit.client.1.smithi194.stdout:1/318: creat d12/d13/d1c/d27/d5c/f68 x:0 0 0 2024-04-13T10:58:37.848 INFO:tasks.workunit.client.1.smithi194.stdout:7/300: dwrite d1/d2b/d2c/d30/d33/d39/f66 [0,4194304] 0 2024-04-13T10:58:37.848 INFO:tasks.workunit.client.1.smithi194.stdout:0/293: truncate d9/db/d19/d28/f29 32806 0 2024-04-13T10:58:37.849 INFO:tasks.workunit.client.1.smithi194.stdout:6/277: dwrite d0/f1f [0,4194304] 0 2024-04-13T10:58:37.850 INFO:tasks.workunit.client.1.smithi194.stdout:5/281: readlink d3/dc/d10/d20/d23/l31 0 2024-04-13T10:58:37.851 INFO:tasks.workunit.client.1.smithi194.stdout:0/294: fsync d9/db/d19/d28/f18 0 2024-04-13T10:58:37.851 INFO:tasks.workunit.client.1.smithi194.stdout:1/319: symlink d12/d13/d44/l69 0 2024-04-13T10:58:37.852 INFO:tasks.workunit.client.1.smithi194.stdout:7/301: read d1/d2b/d4c/d4f/f53 [913611,21136] 0 2024-04-13T10:58:37.853 INFO:tasks.workunit.client.1.smithi194.stdout:5/282: write d3/dc/d17/f1c [1768552,59572] 0 2024-04-13T10:58:37.867 INFO:tasks.workunit.client.1.smithi194.stdout:6/278: dwrite d0/d26/d2b/f39 [0,4194304] 0 2024-04-13T10:58:37.867 INFO:tasks.workunit.client.1.smithi194.stdout:3/300: dread d2/d3/d1a/f42 [0,4194304] 0 2024-04-13T10:58:37.868 INFO:tasks.workunit.client.1.smithi194.stdout:7/302: link d1/d2b/d2c/d30/d33/d39/f62 d1/d2b/d2c/f68 0 2024-04-13T10:58:37.872 INFO:tasks.workunit.client.1.smithi194.stdout:0/295: write d9/db/f1b [1228366,24255] 0 2024-04-13T10:58:37.873 INFO:tasks.workunit.client.1.smithi194.stdout:6/279: write d0/d42/f43 [1868668,104078] 0 2024-04-13T10:58:37.873 INFO:tasks.workunit.client.1.smithi194.stdout:5/283: dwrite d3/dc/f2c [0,4194304] 0 2024-04-13T10:58:37.876 INFO:tasks.workunit.client.1.smithi194.stdout:3/301: write d2/d3/d12/d31/d34/f39 [664354,80319] 0 2024-04-13T10:58:37.878 INFO:tasks.workunit.client.1.smithi194.stdout:7/303: chown d1/d2b/d4c/d4f/d51/f20 36 1 2024-04-13T10:58:37.879 INFO:tasks.workunit.client.1.smithi194.stdout:3/302: readlink d2/d3/d12/l55 0 2024-04-13T10:58:37.880 INFO:tasks.workunit.client.1.smithi194.stdout:1/320: dwrite d12/f15 [0,4194304] 0 2024-04-13T10:58:37.881 INFO:tasks.workunit.client.1.smithi194.stdout:1/321: write f1 [1902540,6181] 0 2024-04-13T10:58:37.882 INFO:tasks.workunit.client.1.smithi194.stdout:5/284: truncate d3/dc/f18 1929767 0 2024-04-13T10:58:37.886 INFO:tasks.workunit.client.1.smithi194.stdout:6/280: write d0/d2c/f3e [601938,1299] 0 2024-04-13T10:58:37.886 INFO:tasks.workunit.client.1.smithi194.stdout:7/304: creat d1/d2b/d4c/f69 x:0 0 0 2024-04-13T10:58:37.887 INFO:tasks.workunit.client.1.smithi194.stdout:0/296: getdents d9/d2b 0 2024-04-13T10:58:37.889 INFO:tasks.workunit.client.1.smithi194.stdout:3/303: fsync d2/d3/d12/d31/d34/f39 0 2024-04-13T10:58:37.893 INFO:tasks.workunit.client.1.smithi194.stdout:3/304: fdatasync d2/d3/d12/d31/d34/f39 0 2024-04-13T10:58:37.894 INFO:tasks.workunit.client.1.smithi194.stdout:1/322: dwrite d12/d13/d3e/f54 [0,4194304] 0 2024-04-13T10:58:37.897 INFO:tasks.workunit.client.1.smithi194.stdout:5/285: rmdir d3/d29/d4f 0 2024-04-13T10:58:37.897 INFO:tasks.workunit.client.1.smithi194.stdout:8/318: sync 2024-04-13T10:58:37.899 INFO:tasks.workunit.client.1.smithi194.stdout:0/297: dread d9/db/d19/d28/f29 [0,4194304] 0 2024-04-13T10:58:37.900 INFO:tasks.workunit.client.1.smithi194.stdout:1/323: write d12/d13/d1c/d27/d2e/f62 [111833,101018] 0 2024-04-13T10:58:37.901 INFO:tasks.workunit.client.1.smithi194.stdout:8/319: chown d6/d22/d23/d25/f27 8131 1 2024-04-13T10:58:37.902 INFO:tasks.workunit.client.1.smithi194.stdout:3/305: symlink d2/d3/d1a/d24/d3a/d56/l5a 0 2024-04-13T10:58:37.902 INFO:tasks.workunit.client.1.smithi194.stdout:0/298: fsync d9/db/f2a 0 2024-04-13T10:58:37.902 INFO:tasks.workunit.client.1.smithi194.stdout:7/305: dwrite d1/d2b/d2c/d30/d33/d39/f4b [0,4194304] 0 2024-04-13T10:58:37.903 INFO:tasks.workunit.client.1.smithi194.stdout:1/324: stat d12/d13/d3e/f54 0 2024-04-13T10:58:37.905 INFO:tasks.workunit.client.1.smithi194.stdout:0/299: dread - d9/db/d3a/f57 zero size 2024-04-13T10:58:37.905 INFO:tasks.workunit.client.1.smithi194.stdout:3/306: dread - d2/d3/d12/d31/f52 zero size 2024-04-13T10:58:37.906 INFO:tasks.workunit.client.1.smithi194.stdout:1/325: chown d12/d13/d1c/d27/f57 454469284 1 2024-04-13T10:58:37.908 INFO:tasks.workunit.client.1.smithi194.stdout:3/307: truncate d2/d3/d1a/f42 4807953 0 2024-04-13T10:58:37.909 INFO:tasks.workunit.client.1.smithi194.stdout:3/308: readlink d2/d3/d12/l20 0 2024-04-13T10:58:37.909 INFO:tasks.workunit.client.1.smithi194.stdout:6/281: dread d0/f8 [0,4194304] 0 2024-04-13T10:58:37.910 INFO:tasks.workunit.client.1.smithi194.stdout:1/326: creat d12/d3a/f6a x:0 0 0 2024-04-13T10:58:37.912 INFO:tasks.workunit.client.1.smithi194.stdout:0/300: rename d9/d2b/d5a/l5f to d9/db/d19/d28/l67 0 2024-04-13T10:58:37.914 INFO:tasks.workunit.client.1.smithi194.stdout:7/306: mknod d1/d2b/d4c/d4f/d51/c6a 0 2024-04-13T10:58:37.915 INFO:tasks.workunit.client.1.smithi194.stdout:7/307: stat d1/d2b/d4c 0 2024-04-13T10:58:37.916 INFO:tasks.workunit.client.1.smithi194.stdout:6/282: unlink d0/d2c/c33 0 2024-04-13T10:58:37.917 INFO:tasks.workunit.client.1.smithi194.stdout:5/286: getdents d3/d29 0 2024-04-13T10:58:37.918 INFO:tasks.workunit.client.1.smithi194.stdout:6/283: write d0/f1f [3598795,117604] 0 2024-04-13T10:58:37.919 INFO:tasks.workunit.client.1.smithi194.stdout:3/309: creat d2/f5b x:0 0 0 2024-04-13T10:58:37.920 INFO:tasks.workunit.client.1.smithi194.stdout:7/308: write d1/d2b/d4c/d4f/d51/f56 [156304,51915] 0 2024-04-13T10:58:37.922 INFO:tasks.workunit.client.1.smithi194.stdout:5/287: readlink d3/le 0 2024-04-13T10:58:37.922 INFO:tasks.workunit.client.1.smithi194.stdout:0/301: dwrite d9/db/d19/d28/f53 [0,4194304] 0 2024-04-13T10:58:37.922 INFO:tasks.workunit.client.1.smithi194.stdout:1/327: getdents d12/d13/d1c/d27 0 2024-04-13T10:58:37.924 INFO:tasks.workunit.client.1.smithi194.stdout:6/284: unlink d0/d2c/f49 0 2024-04-13T10:58:37.924 INFO:tasks.workunit.client.1.smithi194.stdout:1/328: write f1 [1962486,84314] 0 2024-04-13T10:58:37.925 INFO:tasks.workunit.client.1.smithi194.stdout:6/285: chown d0/d26/c3b 0 1 2024-04-13T10:58:37.925 INFO:tasks.workunit.client.1.smithi194.stdout:3/310: fsync d2/d3/d1a/d24/f28 0 2024-04-13T10:58:37.928 INFO:tasks.workunit.client.1.smithi194.stdout:7/309: rmdir d1/d2b/d3e/d54/d5a/d3c 39 2024-04-13T10:58:37.934 INFO:tasks.workunit.client.1.smithi194.stdout:8/320: dread d6/f1c [0,4194304] 0 2024-04-13T10:58:37.935 INFO:tasks.workunit.client.1.smithi194.stdout:8/321: fdatasync f2 0 2024-04-13T10:58:37.937 INFO:tasks.workunit.client.1.smithi194.stdout:0/302: unlink d9/db/d19/d28/l37 0 2024-04-13T10:58:37.937 INFO:tasks.workunit.client.1.smithi194.stdout:1/329: unlink d12/d13/d1c/d28/d41/d4e/c64 0 2024-04-13T10:58:37.940 INFO:tasks.workunit.client.1.smithi194.stdout:0/303: dread d9/fd [4194304,4194304] 0 2024-04-13T10:58:37.942 INFO:tasks.workunit.client.1.smithi194.stdout:8/322: mkdir d6/d2a/d69 0 2024-04-13T10:58:37.943 INFO:tasks.workunit.client.1.smithi194.stdout:1/330: dread d12/f55 [0,4194304] 0 2024-04-13T10:58:37.946 INFO:tasks.workunit.client.1.smithi194.stdout:6/286: rename d0/d2c/c37 to d0/d26/d2b/d4d/c54 0 2024-04-13T10:58:37.948 INFO:tasks.workunit.client.1.smithi194.stdout:0/304: dwrite d9/f54 [0,4194304] 0 2024-04-13T10:58:37.949 INFO:tasks.workunit.client.1.smithi194.stdout:1/331: unlink d12/d13/l38 0 2024-04-13T10:58:37.949 INFO:tasks.workunit.client.1.smithi194.stdout:0/305: read - d9/db/d19/d28/f17 zero size 2024-04-13T10:58:37.949 INFO:tasks.workunit.client.1.smithi194.stdout:0/306: fdatasync d9/f4b 0 2024-04-13T10:58:37.953 INFO:tasks.workunit.client.1.smithi194.stdout:4/349: sync 2024-04-13T10:58:37.954 INFO:tasks.workunit.client.1.smithi194.stdout:5/288: write d3/dc/d17/d1b/f21 [2091017,77953] 0 2024-04-13T10:58:37.956 INFO:tasks.workunit.client.1.smithi194.stdout:5/289: chown d3/dc/d10/d38/d46 19711 1 2024-04-13T10:58:37.956 INFO:tasks.workunit.client.1.smithi194.stdout:3/311: write d2/f5 [265119,43760] 0 2024-04-13T10:58:37.960 INFO:tasks.workunit.client.1.smithi194.stdout:0/307: dread d9/df/f14 [0,4194304] 0 2024-04-13T10:58:37.960 INFO:tasks.workunit.client.1.smithi194.stdout:6/287: rename d0/f2e to d0/d53/f55 0 2024-04-13T10:58:37.961 INFO:tasks.workunit.client.1.smithi194.stdout:8/323: dread d6/d22/d23/f54 [0,4194304] 0 2024-04-13T10:58:37.961 INFO:tasks.workunit.client.1.smithi194.stdout:0/308: write d9/db/d19/d28/f17 [900584,43662] 0 2024-04-13T10:58:37.961 INFO:tasks.workunit.client.1.smithi194.stdout:4/350: creat d2/d16/d1a/d1c/d54/d62/f71 x:0 0 0 2024-04-13T10:58:37.962 INFO:tasks.workunit.client.1.smithi194.stdout:0/309: chown d9/db/f36 11199 1 2024-04-13T10:58:37.965 INFO:tasks.workunit.client.1.smithi194.stdout:0/310: write d9/df/d16/f5d [286583,26694] 0 2024-04-13T10:58:37.965 INFO:tasks.workunit.client.1.smithi194.stdout:5/290: unlink d3/dc/d10/d20/d23/f30 0 2024-04-13T10:58:37.968 INFO:tasks.workunit.client.1.smithi194.stdout:3/312: mknod d2/d3/d12/d31/c5c 0 2024-04-13T10:58:37.969 INFO:tasks.workunit.client.1.smithi194.stdout:8/324: dwrite d6/d2a/f57 [0,4194304] 0 2024-04-13T10:58:37.970 INFO:tasks.workunit.client.1.smithi194.stdout:6/288: unlink d0/d26/c17 0 2024-04-13T10:58:37.970 INFO:tasks.workunit.client.1.smithi194.stdout:7/310: truncate d1/f2e 3230691 0 2024-04-13T10:58:37.971 INFO:tasks.workunit.client.1.smithi194.stdout:4/351: creat d2/d16/d1a/d1c/d3b/f72 x:0 0 0 2024-04-13T10:58:37.973 INFO:tasks.workunit.client.1.smithi194.stdout:0/311: rmdir d9/d2b/d5a 39 2024-04-13T10:58:37.974 INFO:tasks.workunit.client.1.smithi194.stdout:1/332: link d12/d13/d3e/l52 d12/d13/d1c/d28/d41/d4e/l6b 0 2024-04-13T10:58:37.974 INFO:tasks.workunit.client.1.smithi194.stdout:5/291: dwrite d3/d29/f3f [0,4194304] 0 2024-04-13T10:58:37.975 INFO:tasks.workunit.client.1.smithi194.stdout:1/333: dread - d12/d13/d44/f5e zero size 2024-04-13T10:58:37.977 INFO:tasks.workunit.client.1.smithi194.stdout:1/334: truncate d12/d3a/d4f/f63 314160 0 2024-04-13T10:58:37.979 INFO:tasks.workunit.client.1.smithi194.stdout:4/352: dwrite d2/d16/d70/f26 [0,4194304] 0 2024-04-13T10:58:37.982 INFO:tasks.workunit.client.1.smithi194.stdout:6/289: mknod d0/d26/c56 0 2024-04-13T10:58:37.983 INFO:tasks.workunit.client.1.smithi194.stdout:7/311: readlink d1/d2b/d4c/l52 0 2024-04-13T10:58:37.983 INFO:tasks.workunit.client.1.smithi194.stdout:8/325: rename d6/f55 to d6/dd/d45/f6a 0 2024-04-13T10:58:37.985 INFO:tasks.workunit.client.1.smithi194.stdout:7/312: write d1/f8 [3139640,125905] 0 2024-04-13T10:58:37.987 INFO:tasks.workunit.client.1.smithi194.stdout:6/290: dread d0/d2c/f3e [0,4194304] 0 2024-04-13T10:58:37.989 INFO:tasks.workunit.client.1.smithi194.stdout:6/291: write d0/d2c/f31 [4948897,39104] 0 2024-04-13T10:58:37.991 INFO:tasks.workunit.client.1.smithi194.stdout:1/335: mknod d12/d3a/c6c 0 2024-04-13T10:58:37.997 INFO:tasks.workunit.client.1.smithi194.stdout:0/312: rename d9/c20 to d9/df/c68 0 2024-04-13T10:58:37.999 INFO:tasks.workunit.client.1.smithi194.stdout:5/292: symlink d3/dc/d17/l56 0 2024-04-13T10:58:38.001 INFO:tasks.workunit.client.1.smithi194.stdout:9/281: sync 2024-04-13T10:58:38.001 INFO:tasks.workunit.client.1.smithi194.stdout:2/341: sync 2024-04-13T10:58:38.001 INFO:tasks.workunit.client.1.smithi194.stdout:3/313: dwrite d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:38.003 INFO:tasks.workunit.client.1.smithi194.stdout:4/353: symlink d2/d16/d1a/d1c/l73 0 2024-04-13T10:58:38.009 INFO:tasks.workunit.client.1.smithi194.stdout:8/326: dread d6/dd/f19 [0,4194304] 0 2024-04-13T10:58:38.010 INFO:tasks.workunit.client.1.smithi194.stdout:4/354: dread d2/f56 [0,4194304] 0 2024-04-13T10:58:38.010 INFO:tasks.workunit.client.1.smithi194.stdout:4/355: stat d2/d16/d1a/d1c/d54/d62/f6c 0 2024-04-13T10:58:38.012 INFO:tasks.workunit.client.1.smithi194.stdout:4/356: truncate d2/d16/d1a/d1c/d3e/f3f 741878 0 2024-04-13T10:58:38.014 INFO:tasks.workunit.client.1.smithi194.stdout:1/336: dread f10 [0,4194304] 0 2024-04-13T10:58:38.022 INFO:tasks.workunit.client.1.smithi194.stdout:3/314: symlink d2/de/l5d 0 2024-04-13T10:58:38.023 INFO:tasks.workunit.client.1.smithi194.stdout:8/327: fdatasync d6/d2a/f34 0 2024-04-13T10:58:38.024 INFO:tasks.workunit.client.1.smithi194.stdout:0/313: mknod d9/df/d63/c69 0 2024-04-13T10:58:38.024 INFO:tasks.workunit.client.1.smithi194.stdout:4/357: rmdir d2/d16/d70 39 2024-04-13T10:58:38.025 INFO:tasks.workunit.client.1.smithi194.stdout:4/358: write d2/f56 [136321,69180] 0 2024-04-13T10:58:38.026 INFO:tasks.workunit.client.1.smithi194.stdout:2/342: symlink d2/d3/de/d17/d1e/l77 0 2024-04-13T10:58:38.027 INFO:tasks.workunit.client.1.smithi194.stdout:1/337: rename d12/d13/d1c/d28/d41/l4d to d12/d13/d1c/d28/d41/l6d 0 2024-04-13T10:58:38.029 INFO:tasks.workunit.client.1.smithi194.stdout:3/315: creat d2/d3/d12/d31/f5e x:0 0 0 2024-04-13T10:58:38.030 INFO:tasks.workunit.client.1.smithi194.stdout:8/328: creat d6/d22/d23/d25/d39/f6b x:0 0 0 2024-04-13T10:58:38.032 INFO:tasks.workunit.client.1.smithi194.stdout:2/343: mknod d2/d3/de/d17/d36/d3d/c78 0 2024-04-13T10:58:38.033 INFO:tasks.workunit.client.1.smithi194.stdout:5/293: link d3/dc/l27 d3/dc/d10/l57 0 2024-04-13T10:58:38.033 INFO:tasks.workunit.client.1.smithi194.stdout:9/282: dwrite d0/d11/f40 [0,4194304] 0 2024-04-13T10:58:38.035 INFO:tasks.workunit.client.1.smithi194.stdout:3/316: mknod d2/d3/d12/d31/d34/c5f 0 2024-04-13T10:58:38.035 INFO:tasks.workunit.client.1.smithi194.stdout:4/359: mknod d2/d16/d70/d31/c74 0 2024-04-13T10:58:38.037 INFO:tasks.workunit.client.1.smithi194.stdout:8/329: symlink d6/d22/d23/l6c 0 2024-04-13T10:58:38.038 INFO:tasks.workunit.client.1.smithi194.stdout:5/294: read d3/dc/d10/f2e [872084,29705] 0 2024-04-13T10:58:38.040 INFO:tasks.workunit.client.1.smithi194.stdout:5/295: readlink l1 0 2024-04-13T10:58:38.040 INFO:tasks.workunit.client.1.smithi194.stdout:7/313: dwrite d1/fe [0,4194304] 0 2024-04-13T10:58:38.040 INFO:tasks.workunit.client.1.smithi194.stdout:4/360: readlink d2/d16/d1a/d1c/d54/l63 0 2024-04-13T10:58:38.042 INFO:tasks.workunit.client.1.smithi194.stdout:6/292: dwrite d0/d53/f55 [0,4194304] 0 2024-04-13T10:58:38.043 INFO:tasks.workunit.client.1.smithi194.stdout:2/344: creat d2/d3/de/d17/d36/d65/f79 x:0 0 0 2024-04-13T10:58:38.043 INFO:tasks.workunit.client.1.smithi194.stdout:8/330: write d6/d22/d23/d25/d39/f6b [397981,126713] 0 2024-04-13T10:58:38.044 INFO:tasks.workunit.client.1.smithi194.stdout:1/338: getdents d12/d3a/d4f 0 2024-04-13T10:58:38.045 INFO:tasks.workunit.client.1.smithi194.stdout:0/314: write d9/fd [6664308,27500] 0 2024-04-13T10:58:38.048 INFO:tasks.workunit.client.1.smithi194.stdout:5/296: write d3/dc/d10/f2e [685815,119502] 0 2024-04-13T10:58:38.051 INFO:tasks.workunit.client.1.smithi194.stdout:7/314: dread d1/d2b/d2c/d30/d33/d39/f4b [0,4194304] 0 2024-04-13T10:58:38.051 INFO:tasks.workunit.client.1.smithi194.stdout:6/293: readlink d0/lf 0 2024-04-13T10:58:38.052 INFO:tasks.workunit.client.1.smithi194.stdout:2/345: write d2/f23 [2133810,40965] 0 2024-04-13T10:58:38.054 INFO:tasks.workunit.client.1.smithi194.stdout:8/331: write d6/d22/d23/d3d/f65 [2903761,32582] 0 2024-04-13T10:58:38.055 INFO:tasks.workunit.client.1.smithi194.stdout:5/297: creat d3/dc/d10/f58 x:0 0 0 2024-04-13T10:58:38.056 INFO:tasks.workunit.client.1.smithi194.stdout:9/283: link d0/l43 d0/d6/l65 0 2024-04-13T10:58:38.056 INFO:tasks.workunit.client.1.smithi194.stdout:8/332: write d6/f52 [685943,92327] 0 2024-04-13T10:58:38.057 INFO:tasks.workunit.client.1.smithi194.stdout:5/298: read d3/d29/f3f [2339494,66822] 0 2024-04-13T10:58:38.058 INFO:tasks.workunit.client.1.smithi194.stdout:2/346: rmdir d2/d3/de/d17 39 2024-04-13T10:58:38.058 INFO:tasks.workunit.client.1.smithi194.stdout:8/333: chown d6/f1c 93 1 2024-04-13T10:58:38.059 INFO:tasks.workunit.client.1.smithi194.stdout:6/294: mkdir d0/d57 0 2024-04-13T10:58:38.060 INFO:tasks.workunit.client.1.smithi194.stdout:2/347: write d2/d3/f2d [4029410,41661] 0 2024-04-13T10:58:38.061 INFO:tasks.workunit.client.1.smithi194.stdout:6/295: dread - d0/d26/d2b/f47 zero size 2024-04-13T10:58:38.062 INFO:tasks.workunit.client.1.smithi194.stdout:0/315: rename d9/df/f1d to d9/db/f6a 0 2024-04-13T10:58:38.063 INFO:tasks.workunit.client.1.smithi194.stdout:6/296: read d0/d26/d2b/f3c [69699,17888] 0 2024-04-13T10:58:38.065 INFO:tasks.workunit.client.1.smithi194.stdout:5/299: chown d3/f1f 56861 1 2024-04-13T10:58:38.068 INFO:tasks.workunit.client.1.smithi194.stdout:0/316: chown d9/db/d19/d30 10674128 1 2024-04-13T10:58:38.069 INFO:tasks.workunit.client.1.smithi194.stdout:5/300: write d3/dc/d10/f2e [1580560,2956] 0 2024-04-13T10:58:38.071 INFO:tasks.workunit.client.1.smithi194.stdout:4/361: dwrite d2/d33/f17 [0,4194304] 0 2024-04-13T10:58:38.072 INFO:tasks.workunit.client.1.smithi194.stdout:2/348: dwrite d2/d3/de/d33/d47/f50 [0,4194304] 0 2024-04-13T10:58:38.073 INFO:tasks.workunit.client.1.smithi194.stdout:6/297: truncate d0/d26/f14 3763614 0 2024-04-13T10:58:38.075 INFO:tasks.workunit.client.1.smithi194.stdout:4/362: readlink d2/d16/d1a/d1c/d54/l63 0 2024-04-13T10:58:38.078 INFO:tasks.workunit.client.1.smithi194.stdout:0/317: dread d9/fd [4194304,4194304] 0 2024-04-13T10:58:38.078 INFO:tasks.workunit.client.1.smithi194.stdout:5/301: stat d3/dc/d10/d20/d23/c3a 0 2024-04-13T10:58:38.081 INFO:tasks.workunit.client.1.smithi194.stdout:8/334: getdents d6/dd 0 2024-04-13T10:58:38.083 INFO:tasks.workunit.client.1.smithi194.stdout:9/284: truncate d0/d11/f41 587998 0 2024-04-13T10:58:38.093 INFO:tasks.workunit.client.1.smithi194.stdout:6/298: dwrite d0/d26/f29 [0,4194304] 0 2024-04-13T10:58:38.101 INFO:tasks.workunit.client.1.smithi194.stdout:1/339: dwrite d12/d13/d3e/f42 [0,4194304] 0 2024-04-13T10:58:38.103 INFO:tasks.workunit.client.1.smithi194.stdout:5/302: dwrite d3/d29/f34 [4194304,4194304] 0 2024-04-13T10:58:38.105 INFO:tasks.workunit.client.1.smithi194.stdout:6/299: dread - d0/d2c/f41 zero size 2024-04-13T10:58:38.106 INFO:tasks.workunit.client.1.smithi194.stdout:4/363: dwrite d2/f56 [0,4194304] 0 2024-04-13T10:58:38.110 INFO:tasks.workunit.client.1.smithi194.stdout:5/303: write d3/dc/d17/d48/f54 [419591,95481] 0 2024-04-13T10:58:38.112 INFO:tasks.workunit.client.1.smithi194.stdout:6/300: creat d0/d26/d2b/f58 x:0 0 0 2024-04-13T10:58:38.113 INFO:tasks.workunit.client.1.smithi194.stdout:8/335: creat d6/d22/d23/d25/d30/d33/f6d x:0 0 0 2024-04-13T10:58:38.117 INFO:tasks.workunit.client.1.smithi194.stdout:6/301: chown d0/d42/d3f/l50 3 1 2024-04-13T10:58:38.118 INFO:tasks.workunit.client.1.smithi194.stdout:4/364: creat d2/d16/d1a/d1c/d3b/d42/f75 x:0 0 0 2024-04-13T10:58:38.120 INFO:tasks.workunit.client.1.smithi194.stdout:6/302: fsync d0/f12 0 2024-04-13T10:58:38.121 INFO:tasks.workunit.client.1.smithi194.stdout:8/336: write d6/d22/d23/d25/d30/f56 [574742,31280] 0 2024-04-13T10:58:38.123 INFO:tasks.workunit.client.1.smithi194.stdout:1/340: dwrite d12/d13/d1c/f65 [0,4194304] 0 2024-04-13T10:58:38.123 INFO:tasks.workunit.client.1.smithi194.stdout:9/285: dwrite d0/f3 [0,4194304] 0 2024-04-13T10:58:38.125 INFO:tasks.workunit.client.1.smithi194.stdout:5/304: dread d3/dc/f18 [0,4194304] 0 2024-04-13T10:58:38.125 INFO:tasks.workunit.client.1.smithi194.stdout:8/337: truncate d6/f52 1624674 0 2024-04-13T10:58:38.127 INFO:tasks.workunit.client.1.smithi194.stdout:5/305: fdatasync d3/dc/d10/d38/f51 0 2024-04-13T10:58:38.127 INFO:tasks.workunit.client.1.smithi194.stdout:8/338: chown d6/dd/l4d 8225 1 2024-04-13T10:58:38.128 INFO:tasks.workunit.client.1.smithi194.stdout:4/365: creat d2/d16/d1a/d1c/d54/d62/d6e/f76 x:0 0 0 2024-04-13T10:58:38.129 INFO:tasks.workunit.client.1.smithi194.stdout:4/366: chown d2/d16/d1a/f36 0 1 2024-04-13T10:58:38.130 INFO:tasks.workunit.client.1.smithi194.stdout:6/303: creat d0/d26/d4b/f59 x:0 0 0 2024-04-13T10:58:38.131 INFO:tasks.workunit.client.1.smithi194.stdout:5/306: rmdir d3/dc/d10/d20/d23 39 2024-04-13T10:58:38.136 INFO:tasks.workunit.client.1.smithi194.stdout:6/304: symlink d0/d2f/d48/l5a 0 2024-04-13T10:58:38.140 INFO:tasks.workunit.client.1.smithi194.stdout:5/307: dwrite d3/dc/d10/d38/f51 [0,4194304] 0 2024-04-13T10:58:38.140 INFO:tasks.workunit.client.1.smithi194.stdout:8/339: dwrite d6/d22/d23/d25/f36 [0,4194304] 0 2024-04-13T10:58:38.141 INFO:tasks.workunit.client.1.smithi194.stdout:5/308: dread - d3/dc/d10/d20/f43 zero size 2024-04-13T10:58:38.142 INFO:tasks.workunit.client.1.smithi194.stdout:5/309: write d3/dc/d17/d48/f54 [1063222,96415] 0 2024-04-13T10:58:38.143 INFO:tasks.workunit.client.1.smithi194.stdout:8/340: mknod d6/d22/d23/d3d/c6e 0 2024-04-13T10:58:38.145 INFO:tasks.workunit.client.1.smithi194.stdout:6/305: rename d0/d2f/d48/l5a to d0/l5b 0 2024-04-13T10:58:38.146 INFO:tasks.workunit.client.1.smithi194.stdout:8/341: symlink d6/d22/d23/d25/d39/d41/l6f 0 2024-04-13T10:58:38.149 INFO:tasks.workunit.client.1.smithi194.stdout:5/310: rename d3/dc/d17/d48 to d3/dc/d10/d38/d59 0 2024-04-13T10:58:38.150 INFO:tasks.workunit.client.1.smithi194.stdout:6/306: creat d0/d26/f5c x:0 0 0 2024-04-13T10:58:38.151 INFO:tasks.workunit.client.1.smithi194.stdout:6/307: dread - d0/d26/d2b/d4d/f4f zero size 2024-04-13T10:58:38.152 INFO:tasks.workunit.client.1.smithi194.stdout:8/342: symlink d6/d22/d23/d25/d39/d41/l70 0 2024-04-13T10:58:38.152 INFO:tasks.workunit.client.1.smithi194.stdout:6/308: write d0/d26/d2b/f47 [1000611,49175] 0 2024-04-13T10:58:38.156 INFO:tasks.workunit.client.1.smithi194.stdout:5/311: read d3/dc/d10/f11 [7380802,69332] 0 2024-04-13T10:58:38.157 INFO:tasks.workunit.client.1.smithi194.stdout:8/343: mkdir d6/d22/d23/d25/d71 0 2024-04-13T10:58:38.159 INFO:tasks.workunit.client.1.smithi194.stdout:9/286: truncate d0/f3 3985219 0 2024-04-13T10:58:38.162 INFO:tasks.workunit.client.1.smithi194.stdout:4/367: truncate d2/ff 1362041 0 2024-04-13T10:58:38.162 INFO:tasks.workunit.client.1.smithi194.stdout:9/287: chown d0/d6/d14/d26/l2a 5 1 2024-04-13T10:58:38.163 INFO:tasks.workunit.client.1.smithi194.stdout:8/344: dread d6/d2a/f57 [0,4194304] 0 2024-04-13T10:58:38.164 INFO:tasks.workunit.client.1.smithi194.stdout:4/368: creat d2/d30/f77 x:0 0 0 2024-04-13T10:58:38.170 INFO:tasks.workunit.client.1.smithi194.stdout:5/312: link d3/l2b d3/dc/d10/d20/d23/l5a 0 2024-04-13T10:58:38.173 INFO:tasks.workunit.client.1.smithi194.stdout:9/288: dwrite d0/d11/d1e/f2e [0,4194304] 0 2024-04-13T10:58:38.175 INFO:tasks.workunit.client.1.smithi194.stdout:8/345: dread d6/d2a/f4c [0,4194304] 0 2024-04-13T10:58:38.175 INFO:tasks.workunit.client.1.smithi194.stdout:4/369: dwrite d2/d30/d50/f5a [0,4194304] 0 2024-04-13T10:58:38.178 INFO:tasks.workunit.client.1.smithi194.stdout:5/313: unlink d3/dc/d2d/f41 0 2024-04-13T10:58:38.181 INFO:tasks.workunit.client.1.smithi194.stdout:9/289: mknod d0/d6/d2c/c66 0 2024-04-13T10:58:38.182 INFO:tasks.workunit.client.1.smithi194.stdout:5/314: truncate d3/dc/f2c 4399776 0 2024-04-13T10:58:38.182 INFO:tasks.workunit.client.1.smithi194.stdout:8/346: symlink d6/d2a/d69/l72 0 2024-04-13T10:58:38.184 INFO:tasks.workunit.client.1.smithi194.stdout:6/309: dwrite d0/d26/f14 [0,4194304] 0 2024-04-13T10:58:38.186 INFO:tasks.workunit.client.1.smithi194.stdout:8/347: chown d6/d22/d23/d3d/c6e 1191762 1 2024-04-13T10:58:38.186 INFO:tasks.workunit.client.1.smithi194.stdout:5/315: creat d3/dc/d10/d38/f5b x:0 0 0 2024-04-13T10:58:38.189 INFO:tasks.workunit.client.1.smithi194.stdout:6/310: rename d0/d26/c56 to d0/d2f/c5d 0 2024-04-13T10:58:38.193 INFO:tasks.workunit.client.1.smithi194.stdout:8/348: creat d6/d22/d23/d25/d39/d41/f73 x:0 0 0 2024-04-13T10:58:38.194 INFO:tasks.workunit.client.1.smithi194.stdout:6/311: stat d0/c2d 0 2024-04-13T10:58:38.194 INFO:tasks.workunit.client.1.smithi194.stdout:5/316: dwrite d3/dc/d10/f2e [0,4194304] 0 2024-04-13T10:58:38.194 INFO:tasks.workunit.client.1.smithi194.stdout:8/349: chown d6/c13 6561338 1 2024-04-13T10:58:38.197 INFO:tasks.workunit.client.1.smithi194.stdout:6/312: unlink d0/d26/d2b/f3a 0 2024-04-13T10:58:38.198 INFO:tasks.workunit.client.1.smithi194.stdout:6/313: write d0/f34 [923563,79394] 0 2024-04-13T10:58:38.199 INFO:tasks.workunit.client.1.smithi194.stdout:4/370: dread d2/ff [0,4194304] 0 2024-04-13T10:58:38.199 INFO:tasks.workunit.client.1.smithi194.stdout:9/290: truncate d0/d11/d3d/f3f 2172604 0 2024-04-13T10:58:38.224 INFO:tasks.workunit.client.1.smithi194.stdout:3/317: sync 2024-04-13T10:58:38.244 INFO:tasks.workunit.client.1.smithi194.stdout:6/314: mknod d0/d57/c5e 0 2024-04-13T10:58:38.244 INFO:tasks.workunit.client.1.smithi194.stdout:4/371: write d2/d16/d1a/d1c/d3e/f67 [963205,99587] 0 2024-04-13T10:58:38.244 INFO:tasks.workunit.client.1.smithi194.stdout:3/318: fsync d2/d3/d12/d31/f52 0 2024-04-13T10:58:38.245 INFO:tasks.workunit.client.1.smithi194.stdout:9/291: write d0/d6/d14/d26/d3b/f63 [1037751,22196] 0 2024-04-13T10:58:38.245 INFO:tasks.workunit.client.1.smithi194.stdout:8/350: getdents d6/d22/d23/d3d 0 2024-04-13T10:58:38.246 INFO:tasks.workunit.client.1.smithi194.stdout:5/317: dread d3/d29/f3f [0,4194304] 0 2024-04-13T10:58:38.247 INFO:tasks.workunit.client.1.smithi194.stdout:9/292: readlink d0/d11/d1e/l54 0 2024-04-13T10:58:38.294 INFO:tasks.workunit.client.1.smithi194.stdout:3/319: chown d2/d3/d1a/d24/l36 15 1 2024-04-13T10:58:38.294 INFO:tasks.workunit.client.1.smithi194.stdout:4/372: write d2/ff [961511,127849] 0 2024-04-13T10:58:38.295 INFO:tasks.workunit.client.1.smithi194.stdout:8/351: creat d6/d22/d23/d25/d39/d41/f74 x:0 0 0 2024-04-13T10:58:38.295 INFO:tasks.workunit.client.1.smithi194.stdout:9/293: fsync d0/d6/d14/d26/d3b/f59 0 2024-04-13T10:58:38.298 INFO:tasks.workunit.client.1.smithi194.stdout:3/320: mknod d2/d3/d1a/d24/d3a/d48/c60 0 2024-04-13T10:58:38.299 INFO:tasks.workunit.client.1.smithi194.stdout:4/373: symlink d2/d16/d1a/d1c/d3b/l78 0 2024-04-13T10:58:38.300 INFO:tasks.workunit.client.1.smithi194.stdout:8/352: write d6/d22/d23/f54 [2583204,102691] 0 2024-04-13T10:58:38.302 INFO:tasks.workunit.client.1.smithi194.stdout:3/321: chown d2/d3/d12/d31/f4e 18 1 2024-04-13T10:58:38.302 INFO:tasks.workunit.client.1.smithi194.stdout:6/315: dwrite d0/d26/d2b/f3c [0,4194304] 0 2024-04-13T10:58:38.303 INFO:tasks.workunit.client.1.smithi194.stdout:9/294: rename d0/d6/d9/f50 to d0/d6/d14/d26/f67 0 2024-04-13T10:58:38.306 INFO:tasks.workunit.client.1.smithi194.stdout:9/295: mkdir d0/d6/d2c/d68 0 2024-04-13T10:58:38.307 INFO:tasks.workunit.client.1.smithi194.stdout:9/296: chown d0/d11 40 1 2024-04-13T10:58:38.307 INFO:tasks.workunit.client.1.smithi194.stdout:6/316: creat d0/d42/d3f/f5f x:0 0 0 2024-04-13T10:58:38.310 INFO:tasks.workunit.client.1.smithi194.stdout:3/322: truncate d2/d3/d1a/d24/f28 331870 0 2024-04-13T10:58:38.310 INFO:tasks.workunit.client.1.smithi194.stdout:4/374: dwrite d2/d16/d1a/d1c/d54/d62/f71 [0,4194304] 0 2024-04-13T10:58:38.310 INFO:tasks.workunit.client.1.smithi194.stdout:7/315: sync 2024-04-13T10:58:38.316 INFO:tasks.workunit.client.1.smithi194.stdout:5/318: dread d3/dc/d10/f11 [4194304,4194304] 0 2024-04-13T10:58:38.316 INFO:tasks.workunit.client.1.smithi194.stdout:8/353: getdents d6/d22/d23/d25/d30 0 2024-04-13T10:58:38.316 INFO:tasks.workunit.client.1.smithi194.stdout:7/316: mkdir d1/d2b/d3e/d54/d6b 0 2024-04-13T10:58:38.317 INFO:tasks.workunit.client.1.smithi194.stdout:3/323: mkdir d2/d3/d1a/d24/d3a/d48/d61 0 2024-04-13T10:58:38.317 INFO:tasks.workunit.client.1.smithi194.stdout:6/317: dread d0/d2c/f3e [0,4194304] 0 2024-04-13T10:58:38.317 INFO:tasks.workunit.client.1.smithi194.stdout:7/317: fdatasync d1/f3 0 2024-04-13T10:58:38.318 INFO:tasks.workunit.client.1.smithi194.stdout:8/354: dread - d6/d22/d23/f5f zero size 2024-04-13T10:58:38.318 INFO:tasks.workunit.client.1.smithi194.stdout:5/319: readlink d3/dc/d10/d20/d23/l5a 0 2024-04-13T10:58:38.320 INFO:tasks.workunit.client.1.smithi194.stdout:8/355: read d6/f1c [3570414,70864] 0 2024-04-13T10:58:38.320 INFO:tasks.workunit.client.1.smithi194.stdout:5/320: chown d3/dc/f18 352694306 1 2024-04-13T10:58:38.320 INFO:tasks.workunit.client.1.smithi194.stdout:6/318: fsync d0/d2c/f32 0 2024-04-13T10:58:38.325 INFO:tasks.workunit.client.1.smithi194.stdout:3/324: rename d2/d3/d1a/c40 to d2/d3/d1a/c62 0 2024-04-13T10:58:38.327 INFO:tasks.workunit.client.1.smithi194.stdout:5/321: dwrite d3/dc/d10/d38/f4d [0,4194304] 0 2024-04-13T10:58:38.327 INFO:tasks.workunit.client.1.smithi194.stdout:8/356: unlink d6/d22/d23/d25/d30/d33/f6d 0 2024-04-13T10:58:38.329 INFO:tasks.workunit.client.1.smithi194.stdout:3/325: truncate d2/d3/d12/d31/f4e 717165 0 2024-04-13T10:58:38.329 INFO:tasks.workunit.client.1.smithi194.stdout:7/318: mkdir d1/d6c 0 2024-04-13T10:58:38.332 INFO:tasks.workunit.client.1.smithi194.stdout:4/375: truncate d2/d30/d50/f5a 2891389 0 2024-04-13T10:58:38.333 INFO:tasks.workunit.client.1.smithi194.stdout:6/319: link d0/d26/d4b/f59 d0/d53/f60 0 2024-04-13T10:58:38.335 INFO:tasks.workunit.client.1.smithi194.stdout:4/376: read d2/d16/d1a/d1c/d3b/d42/f52 [3495970,60597] 0 2024-04-13T10:58:38.335 INFO:tasks.workunit.client.1.smithi194.stdout:3/326: unlink d2/d3/d1a/d24/d3a/l44 0 2024-04-13T10:58:38.337 INFO:tasks.workunit.client.1.smithi194.stdout:3/327: chown d2/de/c4d 493090099 1 2024-04-13T10:58:38.337 INFO:tasks.workunit.client.1.smithi194.stdout:2/349: sync 2024-04-13T10:58:38.337 INFO:tasks.workunit.client.1.smithi194.stdout:0/318: sync 2024-04-13T10:58:38.338 INFO:tasks.workunit.client.1.smithi194.stdout:0/319: write d9/db/d3a/f5c [3451892,15197] 0 2024-04-13T10:58:38.342 INFO:tasks.workunit.client.1.smithi194.stdout:7/319: creat d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f6d x:0 0 0 2024-04-13T10:58:38.343 INFO:tasks.workunit.client.1.smithi194.stdout:7/320: chown d1/f3 14 1 2024-04-13T10:58:38.343 INFO:tasks.workunit.client.1.smithi194.stdout:4/377: symlink d2/d16/d1a/d1c/d3b/l79 0 2024-04-13T10:58:38.344 INFO:tasks.workunit.client.1.smithi194.stdout:4/378: chown d2/d16/d1a/l55 13 1 2024-04-13T10:58:38.344 INFO:tasks.workunit.client.1.smithi194.stdout:9/297: dread d0/d11/f31 [0,4194304] 0 2024-04-13T10:58:38.349 INFO:tasks.workunit.client.1.smithi194.stdout:5/322: link d3/l55 d3/dc/d10/l5c 0 2024-04-13T10:58:38.349 INFO:tasks.workunit.client.1.smithi194.stdout:4/379: dwrite d2/d16/d1a/f43 [0,4194304] 0 2024-04-13T10:58:38.353 INFO:tasks.workunit.client.1.smithi194.stdout:9/298: creat d0/d6/d2c/f69 x:0 0 0 2024-04-13T10:58:38.356 INFO:tasks.workunit.client.1.smithi194.stdout:2/350: mkdir d2/d3/de/d17/d36/d7a 0 2024-04-13T10:58:38.357 INFO:tasks.workunit.client.1.smithi194.stdout:0/320: mkdir d9/db/d6b 0 2024-04-13T10:58:38.358 INFO:tasks.workunit.client.1.smithi194.stdout:0/321: chown d9/db/f1b 39 1 2024-04-13T10:58:38.359 INFO:tasks.workunit.client.1.smithi194.stdout:8/357: truncate d6/dd/d45/f6a 3057250 0 2024-04-13T10:58:38.359 INFO:tasks.workunit.client.1.smithi194.stdout:8/358: chown d6/dd/c31 537 1 2024-04-13T10:58:38.361 INFO:tasks.workunit.client.1.smithi194.stdout:8/359: write d6/d22/d23/d25/f36 [320381,96393] 0 2024-04-13T10:58:38.363 INFO:tasks.workunit.client.1.smithi194.stdout:4/380: creat d2/d16/d1a/d1c/d3b/d42/f7a x:0 0 0 2024-04-13T10:58:38.363 INFO:tasks.workunit.client.1.smithi194.stdout:3/328: truncate d2/d3/d1a/d24/f28 688220 0 2024-04-13T10:58:38.364 INFO:tasks.workunit.client.1.smithi194.stdout:9/299: readlink d0/d6/l65 0 2024-04-13T10:58:38.366 INFO:tasks.workunit.client.1.smithi194.stdout:8/360: dread d6/f1c [0,4194304] 0 2024-04-13T10:58:38.367 INFO:tasks.workunit.client.1.smithi194.stdout:2/351: creat d2/d3/f7b x:0 0 0 2024-04-13T10:58:38.369 INFO:tasks.workunit.client.1.smithi194.stdout:5/323: mknod d3/dc/d10/d38/d59/d49/c5d 0 2024-04-13T10:58:38.370 INFO:tasks.workunit.client.1.smithi194.stdout:5/324: fdatasync d3/dc/d10/d38/f5b 0 2024-04-13T10:58:38.370 INFO:tasks.workunit.client.1.smithi194.stdout:7/321: fsync d1/d2b/d3e/d54/d5a/d3c/f42 0 2024-04-13T10:58:38.372 INFO:tasks.workunit.client.1.smithi194.stdout:4/381: mkdir d2/d16/d70/d31/d7b 0 2024-04-13T10:58:38.374 INFO:tasks.workunit.client.1.smithi194.stdout:4/382: fsync d2/d16/d1a/d1c/d3b/f72 0 2024-04-13T10:58:38.374 INFO:tasks.workunit.client.1.smithi194.stdout:5/325: dread d3/dc/d10/d38/f51 [0,4194304] 0 2024-04-13T10:58:38.376 INFO:tasks.workunit.client.1.smithi194.stdout:3/329: unlink d2/d3/d1a/d24/d3a/d48/c60 0 2024-04-13T10:58:38.376 INFO:tasks.workunit.client.1.smithi194.stdout:6/320: truncate d0/f2a 2627385 0 2024-04-13T10:58:38.376 INFO:tasks.workunit.client.1.smithi194.stdout:8/361: fsync d6/d2a/f57 0 2024-04-13T10:58:38.378 INFO:tasks.workunit.client.1.smithi194.stdout:6/321: fdatasync d0/d26/d2b/f40 0 2024-04-13T10:58:38.378 INFO:tasks.workunit.client.1.smithi194.stdout:0/322: dread d9/db/d19/d28/f18 [0,4194304] 0 2024-04-13T10:58:38.378 INFO:tasks.workunit.client.1.smithi194.stdout:3/330: write d2/d3/d1a/d24/f4c [1397143,107983] 0 2024-04-13T10:58:38.380 INFO:tasks.workunit.client.1.smithi194.stdout:3/331: write d2/f5 [1062631,68784] 0 2024-04-13T10:58:38.380 INFO:tasks.workunit.client.1.smithi194.stdout:7/322: mkdir d1/d2b/d4c/d4f/d6e 0 2024-04-13T10:58:38.385 INFO:tasks.workunit.client.1.smithi194.stdout:4/383: mknod d2/d30/d50/c7c 0 2024-04-13T10:58:38.386 INFO:tasks.workunit.client.1.smithi194.stdout:4/384: read d2/d16/d70/d31/f40 [2959642,81041] 0 2024-04-13T10:58:38.392 INFO:tasks.workunit.client.1.smithi194.stdout:4/385: dwrite d2/d16/d1a/d1c/d54/d62/d6e/f76 [0,4194304] 0 2024-04-13T10:58:38.392 INFO:tasks.workunit.client.1.smithi194.stdout:4/386: stat d2/d33/l37 0 2024-04-13T10:58:38.393 INFO:tasks.workunit.client.1.smithi194.stdout:4/387: write d2/d16/d1a/d1c/d3e/f3f [847142,87609] 0 2024-04-13T10:58:38.394 INFO:tasks.workunit.client.1.smithi194.stdout:6/322: rmdir d0/d57 39 2024-04-13T10:58:38.394 INFO:tasks.workunit.client.1.smithi194.stdout:8/362: mknod d6/d22/d23/d25/d30/d33/c75 0 2024-04-13T10:58:38.395 INFO:tasks.workunit.client.1.smithi194.stdout:9/300: truncate d0/f3 1841231 0 2024-04-13T10:58:38.397 INFO:tasks.workunit.client.1.smithi194.stdout:7/323: symlink d1/d2b/d4c/d4f/d51/d4d/d5e/l6f 0 2024-04-13T10:58:38.398 INFO:tasks.workunit.client.1.smithi194.stdout:5/326: mknod d3/c5e 0 2024-04-13T10:58:38.401 INFO:tasks.workunit.client.1.smithi194.stdout:5/327: chown d3/dc/d10/f3b 476 1 2024-04-13T10:58:38.402 INFO:tasks.workunit.client.1.smithi194.stdout:6/323: mknod d0/d26/d4b/c61 0 2024-04-13T10:58:38.403 INFO:tasks.workunit.client.1.smithi194.stdout:1/341: sync 2024-04-13T10:58:38.405 INFO:tasks.workunit.client.1.smithi194.stdout:7/324: creat d1/d2b/d4c/d4f/f70 x:0 0 0 2024-04-13T10:58:38.406 INFO:tasks.workunit.client.1.smithi194.stdout:4/388: dwrite d2/d16/d1a/d1c/d54/d62/f71 [0,4194304] 0 2024-04-13T10:58:38.406 INFO:tasks.workunit.client.1.smithi194.stdout:1/342: stat d12/d13/d1c/d28 0 2024-04-13T10:58:38.407 INFO:tasks.workunit.client.1.smithi194.stdout:5/328: creat d3/dc/d10/d20/d23/f5f x:0 0 0 2024-04-13T10:58:38.407 INFO:tasks.workunit.client.1.smithi194.stdout:2/352: dwrite d2/d3/de/d3c/f76 [0,4194304] 0 2024-04-13T10:58:38.407 INFO:tasks.workunit.client.1.smithi194.stdout:9/301: creat d0/d6/d2c/d68/f6a x:0 0 0 2024-04-13T10:58:38.408 INFO:tasks.workunit.client.1.smithi194.stdout:6/324: truncate d0/d53/f60 481797 0 2024-04-13T10:58:38.410 INFO:tasks.workunit.client.1.smithi194.stdout:2/353: fdatasync d2/d3/de/d33/d47/f50 0 2024-04-13T10:58:38.412 INFO:tasks.workunit.client.1.smithi194.stdout:7/325: read - d1/d2b/d4c/d4f/d51/d4d/d5e/f67 zero size 2024-04-13T10:58:38.416 INFO:tasks.workunit.client.1.smithi194.stdout:8/363: getdents d6/d22/d23/d25 0 2024-04-13T10:58:38.417 INFO:tasks.workunit.client.1.smithi194.stdout:2/354: read d2/d3/d12/f1b [1249856,767] 0 2024-04-13T10:58:38.419 INFO:tasks.workunit.client.1.smithi194.stdout:3/332: rename d2/d3/d12/d31/d34/f53 to d2/d3/d12/f63 0 2024-04-13T10:58:38.420 INFO:tasks.workunit.client.1.smithi194.stdout:1/343: symlink d12/d13/d1c/d27/d4c/l6e 0 2024-04-13T10:58:38.421 INFO:tasks.workunit.client.1.smithi194.stdout:9/302: symlink d0/d11/d3d/d4c/l6b 0 2024-04-13T10:58:38.425 INFO:tasks.workunit.client.1.smithi194.stdout:5/329: rename d3/dc/d10/f11 to d3/dc/d10/d38/f60 0 2024-04-13T10:58:38.425 INFO:tasks.workunit.client.1.smithi194.stdout:3/333: write d2/d3/d1a/d24/d3a/f45 [291969,118831] 0 2024-04-13T10:58:38.427 INFO:tasks.workunit.client.1.smithi194.stdout:6/325: dwrite d0/d42/f46 [4194304,4194304] 0 2024-04-13T10:58:38.427 INFO:tasks.workunit.client.1.smithi194.stdout:7/326: creat d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f71 x:0 0 0 2024-04-13T10:58:38.429 INFO:tasks.workunit.client.1.smithi194.stdout:9/303: creat d0/d11/d1e/f6c x:0 0 0 2024-04-13T10:58:38.430 INFO:tasks.workunit.client.1.smithi194.stdout:1/344: mknod d12/d13/d1c/d27/d4c/c6f 0 2024-04-13T10:58:38.431 INFO:tasks.workunit.client.1.smithi194.stdout:2/355: rename d2/d5/f54 to d2/d3/d6d/f7c 0 2024-04-13T10:58:38.431 INFO:tasks.workunit.client.1.smithi194.stdout:8/364: dwrite d6/d22/d23/d25/d30/d33/f3a [4194304,4194304] 0 2024-04-13T10:58:38.431 INFO:tasks.workunit.client.1.smithi194.stdout:4/389: link d2/l10 d2/d16/d70/d31/d44/l7d 0 2024-04-13T10:58:38.431 INFO:tasks.workunit.client.1.smithi194.stdout:6/326: dread - d0/d2c/f41 zero size 2024-04-13T10:58:38.431 INFO:tasks.workunit.client.1.smithi194.stdout:7/327: dread - d1/d2b/d3e/d54/d5a/f49 zero size 2024-04-13T10:58:38.432 INFO:tasks.workunit.client.1.smithi194.stdout:5/330: creat d3/dc/d10/f61 x:0 0 0 2024-04-13T10:58:38.432 INFO:tasks.workunit.client.1.smithi194.stdout:2/356: readlink d2/d3/de/l56 0 2024-04-13T10:58:38.433 INFO:tasks.workunit.client.1.smithi194.stdout:3/334: symlink d2/d3/d1a/d24/l64 0 2024-04-13T10:58:38.435 INFO:tasks.workunit.client.1.smithi194.stdout:6/327: mknod d0/d26/d2b/c62 0 2024-04-13T10:58:38.489 INFO:tasks.workunit.client.1.smithi194.stdout:4/390: rmdir d2/d16/d1a/d1c/d54 39 2024-04-13T10:58:38.496 INFO:tasks.workunit.client.1.smithi194.stdout:7/328: unlink d1/d2b/d4c/d4f/d51/d4d/d5e/f67 0 2024-04-13T10:58:38.497 INFO:tasks.workunit.client.1.smithi194.stdout:3/335: mkdir d2/d3/d1a/d24/d3a/d65 0 2024-04-13T10:58:38.498 INFO:tasks.workunit.client.1.smithi194.stdout:4/391: rmdir d2/d16/d1a/d1c/d3b/d42 39 2024-04-13T10:58:38.499 INFO:tasks.workunit.client.1.smithi194.stdout:6/328: dread d0/d26/f23 [0,4194304] 0 2024-04-13T10:58:38.501 INFO:tasks.workunit.client.1.smithi194.stdout:8/365: dwrite d6/d22/d23/d25/d30/f63 [0,4194304] 0 2024-04-13T10:58:38.504 INFO:tasks.workunit.client.1.smithi194.stdout:9/304: dread d0/d6/d14/d26/d3b/f59 [0,4194304] 0 2024-04-13T10:58:38.505 INFO:tasks.workunit.client.1.smithi194.stdout:2/357: dwrite d2/d5/f1d [0,4194304] 0 2024-04-13T10:58:38.505 INFO:tasks.workunit.client.1.smithi194.stdout:5/331: dwrite d3/dc/d10/d38/f44 [0,4194304] 0 2024-04-13T10:58:38.507 INFO:tasks.workunit.client.1.smithi194.stdout:3/336: creat d2/d3/d1a/d24/d3a/d65/f66 x:0 0 0 2024-04-13T10:58:38.508 INFO:tasks.workunit.client.1.smithi194.stdout:7/329: truncate d1/d2b/d3e/d54/d5a/d3c/f65 274899 0 2024-04-13T10:58:38.508 INFO:tasks.workunit.client.1.smithi194.stdout:6/329: creat d0/d57/f63 x:0 0 0 2024-04-13T10:58:38.510 INFO:tasks.workunit.client.1.smithi194.stdout:4/392: creat d2/d16/d1a/d1c/d54/d5d/f7e x:0 0 0 2024-04-13T10:58:38.512 INFO:tasks.workunit.client.1.smithi194.stdout:8/366: write d6/d22/d23/d3d/f40 [421019,26775] 0 2024-04-13T10:58:38.515 INFO:tasks.workunit.client.1.smithi194.stdout:7/330: creat d1/d2b/d3e/d54/f72 x:0 0 0 2024-04-13T10:58:38.517 INFO:tasks.workunit.client.1.smithi194.stdout:4/393: mkdir d2/d16/d1a/d1c/d3e/d48/d7f 0 2024-04-13T10:58:38.522 INFO:tasks.workunit.client.1.smithi194.stdout:3/337: rename d2/d3/d1a/d24/d3a/d48 to d2/d3/d1a/d24/d3a/d56/d67 0 2024-04-13T10:58:38.522 INFO:tasks.workunit.client.1.smithi194.stdout:9/305: dwrite d0/d11/f31 [4194304,4194304] 0 2024-04-13T10:58:38.522 INFO:tasks.workunit.client.1.smithi194.stdout:7/331: mknod d1/d2b/d2c/d30/d33/d39/c73 0 2024-04-13T10:58:38.523 INFO:tasks.workunit.client.1.smithi194.stdout:5/332: link d3/dc/d10/d38/f60 d3/dc/d10/d20/f62 0 2024-04-13T10:58:38.524 INFO:tasks.workunit.client.1.smithi194.stdout:9/306: truncate d0/d11/d1e/f46 882742 0 2024-04-13T10:58:38.528 INFO:tasks.workunit.client.1.smithi194.stdout:6/330: rename d0/f34 to d0/d42/d3f/f64 0 2024-04-13T10:58:38.530 INFO:tasks.workunit.client.1.smithi194.stdout:9/307: mkdir d0/d6/d14/d6d 0 2024-04-13T10:58:38.534 INFO:tasks.workunit.client.1.smithi194.stdout:5/333: dread d3/dc/d10/d38/f51 [0,4194304] 0 2024-04-13T10:58:38.534 INFO:tasks.workunit.client.1.smithi194.stdout:8/367: rename d6/d22/d23/d25/d30 to d6/d22/d23/d25/d39/d41/d5b/d76 0 2024-04-13T10:58:38.538 INFO:tasks.workunit.client.1.smithi194.stdout:6/331: dwrite d0/f21 [0,4194304] 0 2024-04-13T10:58:38.538 INFO:tasks.workunit.client.1.smithi194.stdout:3/338: rmdir d2 39 2024-04-13T10:58:38.540 INFO:tasks.workunit.client.1.smithi194.stdout:9/308: rename d0/d6/d14/d26/d42/f4b to d0/d6/d4a/f6e 0 2024-04-13T10:58:38.541 INFO:tasks.workunit.client.1.smithi194.stdout:0/323: sync 2024-04-13T10:58:38.542 INFO:tasks.workunit.client.1.smithi194.stdout:9/309: fdatasync d0/d6/d14/d26/d3b/f59 0 2024-04-13T10:58:38.543 INFO:tasks.workunit.client.1.smithi194.stdout:0/324: dread - d9/db/d3a/f57 zero size 2024-04-13T10:58:38.544 INFO:tasks.workunit.client.1.smithi194.stdout:4/394: truncate d2/f56 1191847 0 2024-04-13T10:58:38.546 INFO:tasks.workunit.client.1.smithi194.stdout:6/332: creat d0/d42/d3f/f65 x:0 0 0 2024-04-13T10:58:38.547 INFO:tasks.workunit.client.1.smithi194.stdout:5/334: dwrite d3/f9 [0,4194304] 0 2024-04-13T10:58:38.547 INFO:tasks.workunit.client.1.smithi194.stdout:2/358: dread d2/d3/f2d [0,4194304] 0 2024-04-13T10:58:38.549 INFO:tasks.workunit.client.1.smithi194.stdout:3/339: write d2/f30 [3716105,6894] 0 2024-04-13T10:58:38.549 INFO:tasks.workunit.client.1.smithi194.stdout:6/333: fdatasync d0/d26/d2b/f40 0 2024-04-13T10:58:38.550 INFO:tasks.workunit.client.1.smithi194.stdout:9/310: truncate d0/d11/f3c 770281 0 2024-04-13T10:58:38.550 INFO:tasks.workunit.client.1.smithi194.stdout:5/335: chown d3/dc/d10/d38/d59/d49 1112418 1 2024-04-13T10:58:38.553 INFO:tasks.workunit.client.1.smithi194.stdout:4/395: creat d2/d16/d1a/d1c/d3e/d48/f80 x:0 0 0 2024-04-13T10:58:38.553 INFO:tasks.workunit.client.1.smithi194.stdout:3/340: chown d2/f30 318 1 2024-04-13T10:58:38.554 INFO:tasks.workunit.client.1.smithi194.stdout:9/311: chown d0/d6/d14/d26/f34 3758127 1 2024-04-13T10:58:38.555 INFO:tasks.workunit.client.1.smithi194.stdout:3/341: write d2/d3/d12/f16 [2488721,101427] 0 2024-04-13T10:58:38.556 INFO:tasks.workunit.client.1.smithi194.stdout:8/368: chown d6/d22/d23/d25/d39/d41/f67 865120 1 2024-04-13T10:58:38.556 INFO:tasks.workunit.client.1.smithi194.stdout:2/359: rename d2/d3/de/f58 to d2/d3/de/d17/d36/d7a/f7d 0 2024-04-13T10:58:38.560 INFO:tasks.workunit.client.1.smithi194.stdout:9/312: creat d0/d6/d14/d26/d42/f6f x:0 0 0 2024-04-13T10:58:38.564 INFO:tasks.workunit.client.1.smithi194.stdout:6/334: getdents d0/d26/d2b/d4d 0 2024-04-13T10:58:38.566 INFO:tasks.workunit.client.1.smithi194.stdout:5/336: getdents d3/dc 0 2024-04-13T10:58:38.567 INFO:tasks.workunit.client.1.smithi194.stdout:2/360: fsync d2/d3/f73 0 2024-04-13T10:58:38.572 INFO:tasks.workunit.client.1.smithi194.stdout:5/337: read d3/dc/d10/f3c [26613,13809] 0 2024-04-13T10:58:38.573 INFO:tasks.workunit.client.1.smithi194.stdout:5/338: dread - d3/dc/d10/f3b zero size 2024-04-13T10:58:38.573 INFO:tasks.workunit.client.1.smithi194.stdout:4/396: truncate d2/d16/d1a/f36 3545944 0 2024-04-13T10:58:38.574 INFO:tasks.workunit.client.1.smithi194.stdout:9/313: write d0/f3 [2756689,120287] 0 2024-04-13T10:58:38.576 INFO:tasks.workunit.client.1.smithi194.stdout:4/397: write d2/d16/d1a/d1c/d54/f5f [449401,61769] 0 2024-04-13T10:58:38.576 INFO:tasks.workunit.client.1.smithi194.stdout:5/339: read d3/dc/d17/d1b/f47 [74332,33729] 0 2024-04-13T10:58:38.577 INFO:tasks.workunit.client.1.smithi194.stdout:6/335: rename d0/d2f/f51 to d0/f66 0 2024-04-13T10:58:38.579 INFO:tasks.workunit.client.1.smithi194.stdout:4/398: unlink d2/d30/l57 0 2024-04-13T10:58:38.580 INFO:tasks.workunit.client.1.smithi194.stdout:4/399: write d2/d30/f77 [602496,114696] 0 2024-04-13T10:58:38.580 INFO:tasks.workunit.client.1.smithi194.stdout:3/342: dread d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:38.581 INFO:tasks.workunit.client.1.smithi194.stdout:3/343: fdatasync d2/d3/d1a/d24/d3a/d65/f66 0 2024-04-13T10:58:38.582 INFO:tasks.workunit.client.1.smithi194.stdout:3/344: readlink d2/de/l5d 0 2024-04-13T10:58:38.583 INFO:tasks.workunit.client.1.smithi194.stdout:2/361: truncate d2/d3/d6d/f7c 711040 0 2024-04-13T10:58:38.586 INFO:tasks.workunit.client.1.smithi194.stdout:6/336: link d0/f8 d0/d26/d2b/f67 0 2024-04-13T10:58:38.587 INFO:tasks.workunit.client.1.smithi194.stdout:9/314: write d0/d11/f25 [4437659,3954] 0 2024-04-13T10:58:38.588 INFO:tasks.workunit.client.1.smithi194.stdout:3/345: symlink d2/d3/d1a/d24/d3a/d56/l68 0 2024-04-13T10:58:38.589 INFO:tasks.workunit.client.1.smithi194.stdout:2/362: dwrite d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:38.590 INFO:tasks.workunit.client.1.smithi194.stdout:5/340: creat d3/dc/d17/f63 x:0 0 0 2024-04-13T10:58:38.591 INFO:tasks.workunit.client.1.smithi194.stdout:9/315: write d0/d11/d3d/f5d [687838,55073] 0 2024-04-13T10:58:38.591 INFO:tasks.workunit.client.1.smithi194.stdout:3/346: creat d2/d3/f69 x:0 0 0 2024-04-13T10:58:38.592 INFO:tasks.workunit.client.1.smithi194.stdout:9/316: dread - d0/f20 zero size 2024-04-13T10:58:38.592 INFO:tasks.workunit.client.1.smithi194.stdout:5/341: write d3/dc/d10/d38/f44 [4931127,65341] 0 2024-04-13T10:58:38.594 INFO:tasks.workunit.client.1.smithi194.stdout:9/317: fsync d0/d6/d9/f48 0 2024-04-13T10:58:38.594 INFO:tasks.workunit.client.1.smithi194.stdout:2/363: write d2/d3/de/d17/f6c [188080,119434] 0 2024-04-13T10:58:38.598 INFO:tasks.workunit.client.1.smithi194.stdout:3/347: dwrite d2/d3/d12/f16 [0,4194304] 0 2024-04-13T10:58:38.599 INFO:tasks.workunit.client.1.smithi194.stdout:3/348: dread - d2/d3/f69 zero size 2024-04-13T10:58:38.604 INFO:tasks.workunit.client.1.smithi194.stdout:8/369: read d6/d22/d23/d25/d39/d41/d5b/d76/f56 [220719,31932] 0 2024-04-13T10:58:38.604 INFO:tasks.workunit.client.1.smithi194.stdout:9/318: mkdir d0/d6/d9/d70 0 2024-04-13T10:58:38.606 INFO:tasks.workunit.client.1.smithi194.stdout:6/337: getdents d0/d53 0 2024-04-13T10:58:38.608 INFO:tasks.workunit.client.1.smithi194.stdout:3/349: write d2/d3/d12/d21/f49 [3390723,122432] 0 2024-04-13T10:58:38.608 INFO:tasks.workunit.client.1.smithi194.stdout:9/319: dread d0/d6/d2c/f47 [0,4194304] 0 2024-04-13T10:58:38.609 INFO:tasks.workunit.client.1.smithi194.stdout:2/364: rename d2/c34 to d2/d3/c7e 0 2024-04-13T10:58:38.610 INFO:tasks.workunit.client.1.smithi194.stdout:9/320: fsync d0/d6/d14/d26/f3e 0 2024-04-13T10:58:38.611 INFO:tasks.workunit.client.1.smithi194.stdout:8/370: mknod d6/d22/d23/d25/d39/d41/d5b/d76/d33/c77 0 2024-04-13T10:58:38.612 INFO:tasks.workunit.client.1.smithi194.stdout:2/365: fdatasync d2/d3/de/d17/d1e/d42/d52/f5c 0 2024-04-13T10:58:38.613 INFO:tasks.workunit.client.1.smithi194.stdout:4/400: dwrite d2/d30/d50/f6b [0,4194304] 0 2024-04-13T10:58:38.613 INFO:tasks.workunit.client.1.smithi194.stdout:6/338: mkdir d0/d2f/d48/d68 0 2024-04-13T10:58:38.614 INFO:tasks.workunit.client.1.smithi194.stdout:4/401: chown d2/d30/d50/f6b 15465 1 2024-04-13T10:58:38.615 INFO:tasks.workunit.client.1.smithi194.stdout:6/339: truncate d0/d26/d2b/f58 799911 0 2024-04-13T10:58:38.616 INFO:tasks.workunit.client.1.smithi194.stdout:9/321: creat d0/d6/d2c/d68/f71 x:0 0 0 2024-04-13T10:58:38.619 INFO:tasks.workunit.client.1.smithi194.stdout:4/402: dread d2/d30/f77 [0,4194304] 0 2024-04-13T10:58:38.619 INFO:tasks.workunit.client.1.smithi194.stdout:8/371: mkdir d6/d22/d23/d25/d78 0 2024-04-13T10:58:38.622 INFO:tasks.workunit.client.1.smithi194.stdout:2/366: creat d2/d3/de/f7f x:0 0 0 2024-04-13T10:58:38.624 INFO:tasks.workunit.client.1.smithi194.stdout:5/342: write d3/dc/d17/d1b/f47 [4220425,58342] 0 2024-04-13T10:58:38.625 INFO:tasks.workunit.client.1.smithi194.stdout:4/403: symlink d2/d16/d1a/d1c/d54/d5d/l81 0 2024-04-13T10:58:38.626 INFO:tasks.workunit.client.1.smithi194.stdout:8/372: mknod d6/d22/d23/d25/d39/d41/d5b/c79 0 2024-04-13T10:58:38.628 INFO:tasks.workunit.client.1.smithi194.stdout:2/367: dwrite d2/d3/de/f32 [0,4194304] 0 2024-04-13T10:58:38.628 INFO:tasks.workunit.client.1.smithi194.stdout:9/322: rename d0/d6/d14/c39 to d0/c72 0 2024-04-13T10:58:38.629 INFO:tasks.workunit.client.1.smithi194.stdout:9/323: chown d0/d6/d14/d26/d42 186308934 1 2024-04-13T10:58:38.630 INFO:tasks.workunit.client.1.smithi194.stdout:2/368: write d2/d5/f31 [114730,122896] 0 2024-04-13T10:58:38.632 INFO:tasks.workunit.client.1.smithi194.stdout:1/345: sync 2024-04-13T10:58:38.632 INFO:tasks.workunit.client.1.smithi194.stdout:1/346: read - d12/d13/d44/f5e zero size 2024-04-13T10:58:38.633 INFO:tasks.workunit.client.1.smithi194.stdout:5/343: link d3/dc/f2c d3/dc/d10/d38/d59/f64 0 2024-04-13T10:58:38.634 INFO:tasks.workunit.client.1.smithi194.stdout:8/373: mknod d6/d22/d23/d25/d39/d41/d5b/d76/d33/c7a 0 2024-04-13T10:58:38.635 INFO:tasks.workunit.client.1.smithi194.stdout:1/347: chown d12/d13/d1c/d27/d4c/c6f 43372 1 2024-04-13T10:58:38.635 INFO:tasks.workunit.client.1.smithi194.stdout:8/374: readlink d6/d22/d23/l2b 0 2024-04-13T10:58:38.635 INFO:tasks.workunit.client.1.smithi194.stdout:4/404: creat d2/d16/d1a/d1c/d3b/d42/f82 x:0 0 0 2024-04-13T10:58:38.636 INFO:tasks.workunit.client.1.smithi194.stdout:9/324: creat d0/d6/d2c/f73 x:0 0 0 2024-04-13T10:58:38.638 INFO:tasks.workunit.client.1.smithi194.stdout:5/344: creat d3/dc/d10/d38/d46/f65 x:0 0 0 2024-04-13T10:58:38.641 INFO:tasks.workunit.client.1.smithi194.stdout:1/348: creat d12/d13/d1c/d27/f70 x:0 0 0 2024-04-13T10:58:38.643 INFO:tasks.workunit.client.1.smithi194.stdout:2/369: dwrite d2/d3/de/d17/d1e/f2c [4194304,4194304] 0 2024-04-13T10:58:38.644 INFO:tasks.workunit.client.1.smithi194.stdout:1/349: truncate d12/d13/d44/f5e 937946 0 2024-04-13T10:58:38.644 INFO:tasks.workunit.client.1.smithi194.stdout:8/375: dread d6/d22/f26 [0,4194304] 0 2024-04-13T10:58:38.648 INFO:tasks.workunit.client.1.smithi194.stdout:2/370: creat d2/d3/de/d17/d39/f80 x:0 0 0 2024-04-13T10:58:38.648 INFO:tasks.workunit.client.1.smithi194.stdout:1/350: chown d12/d13/d3e/f66 187666 1 2024-04-13T10:58:38.649 INFO:tasks.workunit.client.1.smithi194.stdout:5/345: creat d3/dc/d10/d20/f66 x:0 0 0 2024-04-13T10:58:38.650 INFO:tasks.workunit.client.1.smithi194.stdout:8/376: write d6/d22/d23/f5f [345203,20173] 0 2024-04-13T10:58:38.650 INFO:tasks.workunit.client.1.smithi194.stdout:2/371: chown d2/d3/de/d33/c43 715940421 1 2024-04-13T10:58:38.652 INFO:tasks.workunit.client.1.smithi194.stdout:1/351: creat d12/d3a/d4f/f71 x:0 0 0 2024-04-13T10:58:38.653 INFO:tasks.workunit.client.1.smithi194.stdout:1/352: write d12/f26 [5227678,108] 0 2024-04-13T10:58:38.653 INFO:tasks.workunit.client.1.smithi194.stdout:8/377: unlink d6/f60 0 2024-04-13T10:58:38.654 INFO:tasks.workunit.client.1.smithi194.stdout:5/346: mknod d3/dc/d17/d1b/c67 0 2024-04-13T10:58:38.655 INFO:tasks.workunit.client.1.smithi194.stdout:2/372: mknod d2/d3/de/d33/d47/c81 0 2024-04-13T10:58:38.655 INFO:tasks.workunit.client.1.smithi194.stdout:8/378: write d6/d22/d23/d25/d39/f62 [39239,128535] 0 2024-04-13T10:58:38.657 INFO:tasks.workunit.client.1.smithi194.stdout:8/379: dread - d6/d22/d23/d25/d39/d41/f73 zero size 2024-04-13T10:58:38.659 INFO:tasks.workunit.client.1.smithi194.stdout:5/347: unlink d3/dc/d10/d38/d59/d49/c5d 0 2024-04-13T10:58:38.662 INFO:tasks.workunit.client.1.smithi194.stdout:8/380: unlink d6/d22/d23/d25/d39/d41/d5b/l5c 0 2024-04-13T10:58:38.663 INFO:tasks.workunit.client.1.smithi194.stdout:5/348: rename d3/dc/d17 to d3/dc/d17/d68 22 2024-04-13T10:58:38.663 INFO:tasks.workunit.client.1.smithi194.stdout:4/405: dread d2/fb [0,4194304] 0 2024-04-13T10:58:38.664 INFO:tasks.workunit.client.1.smithi194.stdout:8/381: write f2 [347047,43777] 0 2024-04-13T10:58:38.666 INFO:tasks.workunit.client.1.smithi194.stdout:2/373: dwrite d2/d3/de/d17/d36/d7a/f7d [0,4194304] 0 2024-04-13T10:58:38.669 INFO:tasks.workunit.client.1.smithi194.stdout:5/349: dread d3/dc/d10/f3c [0,4194304] 0 2024-04-13T10:58:38.670 INFO:tasks.workunit.client.1.smithi194.stdout:2/374: chown d2/d3/de/d17/d1e/c2a 5 1 2024-04-13T10:58:38.673 INFO:tasks.workunit.client.1.smithi194.stdout:8/382: mknod d6/d22/d23/d25/d39/d41/d5b/d76/d33/c7b 0 2024-04-13T10:58:38.673 INFO:tasks.workunit.client.1.smithi194.stdout:9/325: dwrite d0/d11/f41 [0,4194304] 0 2024-04-13T10:58:38.675 INFO:tasks.workunit.client.1.smithi194.stdout:4/406: rename d2/d33/l58 to d2/d16/d1a/d1c/d54/d5d/l83 0 2024-04-13T10:58:38.676 INFO:tasks.workunit.client.1.smithi194.stdout:5/350: mknod d3/d29/c69 0 2024-04-13T10:58:38.679 INFO:tasks.workunit.client.1.smithi194.stdout:1/353: truncate d12/f32 2927158 0 2024-04-13T10:58:38.680 INFO:tasks.workunit.client.1.smithi194.stdout:9/326: chown d0/d11/d44 23164 1 2024-04-13T10:58:38.680 INFO:tasks.workunit.client.1.smithi194.stdout:9/327: stat d0/d6/d14 0 2024-04-13T10:58:38.681 INFO:tasks.workunit.client.1.smithi194.stdout:9/328: write d0/d11/d1e/f21 [106293,46104] 0 2024-04-13T10:58:38.683 INFO:tasks.workunit.client.1.smithi194.stdout:8/383: rename d6/d22/d23/d25/d39/d41/d5b/d76/d33/c75 to d6/d22/d23/d25/d78/c7c 0 2024-04-13T10:58:38.763 INFO:tasks.workunit.client.1.smithi194.stdout:2/375: write d2/d3/f73 [2574521,53726] 0 2024-04-13T10:58:38.764 INFO:tasks.workunit.client.1.smithi194.stdout:9/329: dwrite d0/f3 [0,4194304] 0 2024-04-13T10:58:38.764 INFO:tasks.workunit.client.1.smithi194.stdout:5/351: unlink d3/dc/l26 0 2024-04-13T10:58:38.769 INFO:tasks.workunit.client.1.smithi194.stdout:2/376: rmdir d2/d3/de/d33 39 2024-04-13T10:58:38.777 INFO:tasks.workunit.client.1.smithi194.stdout:8/384: mknod d6/d22/d23/d25/d68/c7d 0 2024-04-13T10:58:38.779 INFO:tasks.workunit.client.1.smithi194.stdout:1/354: getdents d12/d13/d1c 0 2024-04-13T10:58:38.779 INFO:tasks.workunit.client.1.smithi194.stdout:5/352: symlink d3/l6a 0 2024-04-13T10:58:38.781 INFO:tasks.workunit.client.1.smithi194.stdout:5/353: fsync d3/dc/d10/f61 0 2024-04-13T10:58:38.781 INFO:tasks.workunit.client.1.smithi194.stdout:9/330: getdents d0/d6/d9/d51 0 2024-04-13T10:58:38.782 INFO:tasks.workunit.client.1.smithi194.stdout:1/355: rename d12/d13/f37 to d12/d13/d1c/f72 0 2024-04-13T10:58:38.783 INFO:tasks.workunit.client.1.smithi194.stdout:9/331: mkdir d0/d6/d4a/d74 0 2024-04-13T10:58:38.786 INFO:tasks.workunit.client.1.smithi194.stdout:1/356: creat d12/d13/d1c/d27/d4c/f73 x:0 0 0 2024-04-13T10:58:38.788 INFO:tasks.workunit.client.1.smithi194.stdout:1/357: read d12/d13/d1c/d27/d2e/f62 [3758202,10607] 0 2024-04-13T10:58:38.792 INFO:tasks.workunit.client.1.smithi194.stdout:1/358: link d12/d13/d1c/f31 d12/d13/d1c/d27/f74 0 2024-04-13T10:58:38.792 INFO:tasks.workunit.client.1.smithi194.stdout:2/377: dread d2/d3/de/f16 [0,4194304] 0 2024-04-13T10:58:38.793 INFO:tasks.workunit.client.1.smithi194.stdout:9/332: getdents d0/d6/d4a 0 2024-04-13T10:58:38.794 INFO:tasks.workunit.client.1.smithi194.stdout:9/333: write d0/f37 [851683,51236] 0 2024-04-13T10:58:38.795 INFO:tasks.workunit.client.1.smithi194.stdout:8/385: truncate d6/d22/d23/d25/d39/d41/d5b/d76/f63 1531317 0 2024-04-13T10:58:38.795 INFO:tasks.workunit.client.1.smithi194.stdout:9/334: chown d0/d6/d9/d51 211594 1 2024-04-13T10:58:38.798 INFO:tasks.workunit.client.1.smithi194.stdout:2/378: rename d2/d3/de/d17/d1e/d42/d52/d5a/c70 to d2/d37/c82 0 2024-04-13T10:58:38.804 INFO:tasks.workunit.client.1.smithi194.stdout:8/386: dwrite d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3a [8388608,4194304] 0 2024-04-13T10:58:38.807 INFO:tasks.workunit.client.1.smithi194.stdout:2/379: rmdir d2/d3 39 2024-04-13T10:58:38.808 INFO:tasks.workunit.client.1.smithi194.stdout:1/359: dwrite d12/f55 [0,4194304] 0 2024-04-13T10:58:38.808 INFO:tasks.workunit.client.1.smithi194.stdout:9/335: dwrite d0/d6/d4a/f6e [0,4194304] 0 2024-04-13T10:58:38.808 INFO:tasks.workunit.client.1.smithi194.stdout:8/387: chown d6/d22/d23/d3d/f40 0 1 2024-04-13T10:58:38.810 INFO:tasks.workunit.client.1.smithi194.stdout:1/360: chown d12/d13/d3e/c45 3029210 1 2024-04-13T10:58:38.811 INFO:tasks.workunit.client.1.smithi194.stdout:9/336: read - d0/d6/d14/d26/d42/f60 zero size 2024-04-13T10:58:38.812 INFO:tasks.workunit.client.1.smithi194.stdout:9/337: stat d0/d6/d14/l49 0 2024-04-13T10:58:38.813 INFO:tasks.workunit.client.1.smithi194.stdout:2/380: unlink d2/d3/d12/f2b 0 2024-04-13T10:58:38.814 INFO:tasks.workunit.client.1.smithi194.stdout:9/338: chown d0/d6/d2c 2896 1 2024-04-13T10:58:38.814 INFO:tasks.workunit.client.1.smithi194.stdout:8/388: mknod d6/d22/d23/d25/d39/d41/d5b/d76/d33/c7e 0 2024-04-13T10:58:38.815 INFO:tasks.workunit.client.1.smithi194.stdout:7/332: sync 2024-04-13T10:58:38.815 INFO:tasks.workunit.client.1.smithi194.stdout:1/361: fdatasync d12/d13/d1c/d28/d41/f51 0 2024-04-13T10:58:38.816 INFO:tasks.workunit.client.1.smithi194.stdout:8/389: chown d6/f1c 716 1 2024-04-13T10:58:38.816 INFO:tasks.workunit.client.1.smithi194.stdout:9/339: chown d0/d6/d2c/f73 197215 1 2024-04-13T10:58:38.817 INFO:tasks.workunit.client.1.smithi194.stdout:2/381: unlink d2/d3/de/d17/f6c 0 2024-04-13T10:58:38.819 INFO:tasks.workunit.client.1.smithi194.stdout:7/333: chown d1/d2b/d4c/d4f/d51/l57 1335 1 2024-04-13T10:58:38.821 INFO:tasks.workunit.client.1.smithi194.stdout:1/362: creat d12/d13/d1c/d28/f75 x:0 0 0 2024-04-13T10:58:38.822 INFO:tasks.workunit.client.1.smithi194.stdout:1/363: fsync d12/d13/d1c/d28/f58 0 2024-04-13T10:58:38.822 INFO:tasks.workunit.client.1.smithi194.stdout:7/334: chown d1/lf 207459642 1 2024-04-13T10:58:38.823 INFO:tasks.workunit.client.1.smithi194.stdout:9/340: mknod d0/d11/d58/c75 0 2024-04-13T10:58:38.825 INFO:tasks.workunit.client.1.smithi194.stdout:1/364: creat d12/d13/d1c/d28/f76 x:0 0 0 2024-04-13T10:58:38.826 INFO:tasks.workunit.client.1.smithi194.stdout:7/335: fsync d1/d2b/d3e/d54/d5a/d3c/f42 0 2024-04-13T10:58:38.829 INFO:tasks.workunit.client.1.smithi194.stdout:1/365: readlink d12/d13/d1c/d28/d41/l6d 0 2024-04-13T10:58:38.831 INFO:tasks.workunit.client.1.smithi194.stdout:2/382: dread d2/d3/de/f1a [0,4194304] 0 2024-04-13T10:58:38.832 INFO:tasks.workunit.client.1.smithi194.stdout:9/341: dwrite d0/d11/d58/f5f [0,4194304] 0 2024-04-13T10:58:38.833 INFO:tasks.workunit.client.1.smithi194.stdout:2/383: chown d2/d3/de/d17/d39/c59 31 1 2024-04-13T10:58:38.839 INFO:tasks.workunit.client.1.smithi194.stdout:9/342: creat d0/d6/f76 x:0 0 0 2024-04-13T10:58:38.840 INFO:tasks.workunit.client.1.smithi194.stdout:2/384: chown d2/d3/de/d17/d36/d65/c6e 12659717 1 2024-04-13T10:58:38.841 INFO:tasks.workunit.client.1.smithi194.stdout:1/366: dwrite d12/d13/d1c/d28/f76 [0,4194304] 0 2024-04-13T10:58:38.841 INFO:tasks.workunit.client.1.smithi194.stdout:2/385: fdatasync d2/d37/f5f 0 2024-04-13T10:58:38.844 INFO:tasks.workunit.client.1.smithi194.stdout:9/343: unlink d0/d11/d1e/f2e 0 2024-04-13T10:58:38.846 INFO:tasks.workunit.client.1.smithi194.stdout:1/367: mkdir d12/d13/d1c/d28/d41/d77 0 2024-04-13T10:58:38.846 INFO:tasks.workunit.client.1.smithi194.stdout:2/386: rmdir d2/d3/de/d17/d1e/d42/d52 39 2024-04-13T10:58:38.847 INFO:tasks.workunit.client.1.smithi194.stdout:1/368: chown d12/f15 1 1 2024-04-13T10:58:38.847 INFO:tasks.workunit.client.1.smithi194.stdout:8/390: dread d6/dd/f48 [0,4194304] 0 2024-04-13T10:58:38.849 INFO:tasks.workunit.client.1.smithi194.stdout:9/344: creat d0/d6/d9/d70/f77 x:0 0 0 2024-04-13T10:58:38.850 INFO:tasks.workunit.client.1.smithi194.stdout:2/387: write d2/d3/f2d [489409,113691] 0 2024-04-13T10:58:38.851 INFO:tasks.workunit.client.1.smithi194.stdout:1/369: symlink d12/d13/d1c/d28/l78 0 2024-04-13T10:58:38.852 INFO:tasks.workunit.client.1.smithi194.stdout:8/391: mkdir d6/d22/d23/d7f 0 2024-04-13T10:58:38.853 INFO:tasks.workunit.client.1.smithi194.stdout:9/345: symlink d0/d11/d3d/l78 0 2024-04-13T10:58:38.854 INFO:tasks.workunit.client.1.smithi194.stdout:8/392: mkdir d6/dd/d80 0 2024-04-13T10:58:38.855 INFO:tasks.workunit.client.1.smithi194.stdout:7/336: dread d1/fa [4194304,4194304] 0 2024-04-13T10:58:38.856 INFO:tasks.workunit.client.1.smithi194.stdout:2/388: dread d2/d3/de/d17/d36/d7a/f7d [0,4194304] 0 2024-04-13T10:58:38.856 INFO:tasks.workunit.client.1.smithi194.stdout:1/370: rename d12/d13/d1c/d27/d2e/l5a to d12/d13/d1c/d27/d4c/l79 0 2024-04-13T10:58:38.856 INFO:tasks.workunit.client.1.smithi194.stdout:8/393: write d6/d22/d23/f54 [3003079,130403] 0 2024-04-13T10:58:38.857 INFO:tasks.workunit.client.1.smithi194.stdout:8/394: readlink d6/d22/d23/l6c 0 2024-04-13T10:58:38.859 INFO:tasks.workunit.client.1.smithi194.stdout:7/337: mknod d1/d2b/d4c/d4f/d6e/c74 0 2024-04-13T10:58:38.859 INFO:tasks.workunit.client.1.smithi194.stdout:8/395: dread - d6/d22/d23/d25/d39/d41/f67 zero size 2024-04-13T10:58:38.860 INFO:tasks.workunit.client.1.smithi194.stdout:1/371: rename d12/d13/d1c/d28/d41/d4e/c5d to d12/d13/d1c/d28/d41/d4e/c7a 0 2024-04-13T10:58:38.860 INFO:tasks.workunit.client.1.smithi194.stdout:1/372: stat d12/d13/d1c/d28/d41 0 2024-04-13T10:58:38.861 INFO:tasks.workunit.client.1.smithi194.stdout:7/338: mkdir d1/d2b/d2c/d30/d33/d75 0 2024-04-13T10:58:38.867 INFO:tasks.workunit.client.1.smithi194.stdout:1/373: mknod d12/d13/d1c/d28/d41/c7b 0 2024-04-13T10:58:38.867 INFO:tasks.workunit.client.1.smithi194.stdout:7/339: dread - d1/d2b/d4c/d4f/f70 zero size 2024-04-13T10:58:38.868 INFO:tasks.workunit.client.1.smithi194.stdout:9/346: truncate d0/d6/d14/d26/d3b/f63 38935 0 2024-04-13T10:58:38.869 INFO:tasks.workunit.client.1.smithi194.stdout:1/374: mkdir d12/d13/d1c/d7c 0 2024-04-13T10:58:38.869 INFO:tasks.workunit.client.1.smithi194.stdout:7/340: creat d1/d2b/d4c/d4f/d6e/f76 x:0 0 0 2024-04-13T10:58:38.874 INFO:tasks.workunit.client.1.smithi194.stdout:1/375: dwrite d12/d13/d1c/d28/f58 [0,4194304] 0 2024-04-13T10:58:38.876 INFO:tasks.workunit.client.1.smithi194.stdout:1/376: write d12/d13/d1c/d28/f46 [764799,118896] 0 2024-04-13T10:58:38.878 INFO:tasks.workunit.client.1.smithi194.stdout:7/341: write d1/d2b/d4c/d4f/f53 [3167941,33476] 0 2024-04-13T10:58:38.880 INFO:tasks.workunit.client.1.smithi194.stdout:1/377: mkdir d12/d13/d1c/d27/d4c/d7d 0 2024-04-13T10:58:38.881 INFO:tasks.workunit.client.1.smithi194.stdout:1/378: stat d12/d13/d1c/f65 0 2024-04-13T10:58:38.884 INFO:tasks.workunit.client.1.smithi194.stdout:7/342: write d1/d2b/d2c/d30/d33/d39/f62 [599430,109246] 0 2024-04-13T10:58:38.887 INFO:tasks.workunit.client.1.smithi194.stdout:7/343: creat d1/d6c/f77 x:0 0 0 2024-04-13T10:58:38.887 INFO:tasks.workunit.client.1.smithi194.stdout:1/379: dwrite d12/d13/f18 [0,4194304] 0 2024-04-13T10:58:38.888 INFO:tasks.workunit.client.1.smithi194.stdout:7/344: read d1/d2b/d3e/d54/d5a/d3c/f65 [106915,19610] 0 2024-04-13T10:58:38.899 INFO:tasks.workunit.client.1.smithi194.stdout:7/345: truncate d1/d2b/d2c/d30/d33/d39/f4b 1076250 0 2024-04-13T10:58:38.902 INFO:tasks.workunit.client.1.smithi194.stdout:7/346: creat d1/d2b/d3e/d54/d5a/f78 x:0 0 0 2024-04-13T10:58:38.904 INFO:tasks.workunit.client.1.smithi194.stdout:7/347: mknod d1/d2b/d3e/d54/d6b/c79 0 2024-04-13T10:58:38.904 INFO:tasks.workunit.client.1.smithi194.stdout:7/348: write d1/d2b/f47 [913440,94819] 0 2024-04-13T10:58:38.906 INFO:tasks.workunit.client.1.smithi194.stdout:7/349: truncate d1/fa 3148259 0 2024-04-13T10:58:38.906 INFO:tasks.workunit.client.1.smithi194.stdout:7/350: fsync d1/f12 0 2024-04-13T10:58:38.908 INFO:tasks.workunit.client.1.smithi194.stdout:7/351: dread d1/d2b/d3e/d54/d5a/d3c/f65 [0,4194304] 0 2024-04-13T10:58:38.909 INFO:tasks.workunit.client.1.smithi194.stdout:7/352: rmdir d1 39 2024-04-13T10:58:38.909 INFO:tasks.workunit.client.1.smithi194.stdout:0/325: sync 2024-04-13T10:58:38.909 INFO:tasks.workunit.client.1.smithi194.stdout:3/350: sync 2024-04-13T10:58:38.910 INFO:tasks.workunit.client.1.smithi194.stdout:6/340: sync 2024-04-13T10:58:38.910 INFO:tasks.workunit.client.1.smithi194.stdout:3/351: chown d2/d3/d1a 27938 1 2024-04-13T10:58:38.910 INFO:tasks.workunit.client.1.smithi194.stdout:6/341: chown d0/d26/l4c 0 1 2024-04-13T10:58:38.911 INFO:tasks.workunit.client.1.smithi194.stdout:6/342: dread - d0/d26/f4e zero size 2024-04-13T10:58:38.911 INFO:tasks.workunit.client.1.smithi194.stdout:0/326: rmdir d9/df/d16 39 2024-04-13T10:58:38.913 INFO:tasks.workunit.client.1.smithi194.stdout:7/353: mknod d1/d2b/d2c/d30/d33/d75/c7a 0 2024-04-13T10:58:38.920 INFO:tasks.workunit.client.1.smithi194.stdout:3/352: creat d2/d3/d1a/d24/d3a/d56/d67/d61/f6a x:0 0 0 2024-04-13T10:58:38.920 INFO:tasks.workunit.client.1.smithi194.stdout:0/327: mkdir d9/d2b/d6c 0 2024-04-13T10:58:38.920 INFO:tasks.workunit.client.1.smithi194.stdout:3/353: truncate d2/d3/f69 777690 0 2024-04-13T10:58:38.923 INFO:tasks.workunit.client.1.smithi194.stdout:3/354: symlink d2/d3/d1a/d24/d3a/d56/d67/d61/l6b 0 2024-04-13T10:58:38.924 INFO:tasks.workunit.client.1.smithi194.stdout:3/355: dread - d2/d3/d12/f63 zero size 2024-04-13T10:58:38.925 INFO:tasks.workunit.client.1.smithi194.stdout:6/343: dread d0/d26/f29 [0,4194304] 0 2024-04-13T10:58:38.926 INFO:tasks.workunit.client.1.smithi194.stdout:6/344: chown d0/d42/c44 114 1 2024-04-13T10:58:38.926 INFO:tasks.workunit.client.1.smithi194.stdout:3/356: mkdir d2/d3/d1a/d24/d6c 0 2024-04-13T10:58:38.930 INFO:tasks.workunit.client.1.smithi194.stdout:6/345: rename d0/d42/d3f to d0/d57/d69 0 2024-04-13T10:58:38.931 INFO:tasks.workunit.client.1.smithi194.stdout:3/357: mkdir d2/d3/d1a/d24/d3a/d56/d67/d6d 0 2024-04-13T10:58:38.931 INFO:tasks.workunit.client.1.smithi194.stdout:3/358: chown d2/f5b 1 1 2024-04-13T10:58:38.932 INFO:tasks.workunit.client.1.smithi194.stdout:6/346: creat d0/d42/f6a x:0 0 0 2024-04-13T10:58:38.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:38 smithi134 ceph-mon[39696]: pgmap v23: 65 pgs: 65 active+clean; 462 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 37 MiB/s wr, 228 op/s 2024-04-13T10:58:38.934 INFO:tasks.workunit.client.1.smithi194.stdout:7/354: dread d1/f3 [0,4194304] 0 2024-04-13T10:58:38.934 INFO:tasks.workunit.client.1.smithi194.stdout:6/347: mknod d0/d26/d2b/d4d/c6b 0 2024-04-13T10:58:38.935 INFO:tasks.workunit.client.1.smithi194.stdout:3/359: getdents d2/d3/d1a/d24/d3a/d56 0 2024-04-13T10:58:38.936 INFO:tasks.workunit.client.1.smithi194.stdout:3/360: readlink d2/d3/d1a/l29 0 2024-04-13T10:58:38.937 INFO:tasks.workunit.client.1.smithi194.stdout:3/361: stat d2/l7 0 2024-04-13T10:58:38.937 INFO:tasks.workunit.client.1.smithi194.stdout:6/348: creat d0/d2c/f6c x:0 0 0 2024-04-13T10:58:38.937 INFO:tasks.workunit.client.1.smithi194.stdout:7/355: mknod d1/d2b/c7b 0 2024-04-13T10:58:38.938 INFO:tasks.workunit.client.1.smithi194.stdout:6/349: write d0/d2c/f6c [58477,97828] 0 2024-04-13T10:58:38.939 INFO:tasks.workunit.client.1.smithi194.stdout:7/356: chown d1/d2b/d4c/d4f 504 1 2024-04-13T10:58:38.939 INFO:tasks.workunit.client.1.smithi194.stdout:6/350: chown d0/d26/l4c 61317150 1 2024-04-13T10:58:38.939 INFO:tasks.workunit.client.1.smithi194.stdout:3/362: creat d2/d3/d1a/d24/d3a/f6e x:0 0 0 2024-04-13T10:58:38.940 INFO:tasks.workunit.client.1.smithi194.stdout:7/357: write d1/d2b/d4c/d4f/f64 [232221,114120] 0 2024-04-13T10:58:38.941 INFO:tasks.workunit.client.1.smithi194.stdout:6/351: write d0/d26/f15 [2480083,28333] 0 2024-04-13T10:58:38.942 INFO:tasks.workunit.client.1.smithi194.stdout:6/352: chown d0/d26/c3b 407 1 2024-04-13T10:58:38.945 INFO:tasks.workunit.client.1.smithi194.stdout:7/358: rename d1/l3b to d1/d2b/d4c/d4f/d51/d4d/l7c 0 2024-04-13T10:58:38.946 INFO:tasks.workunit.client.1.smithi194.stdout:7/359: write d1/d2b/d2c/d30/d33/d39/f3d [998335,117119] 0 2024-04-13T10:58:38.951 INFO:tasks.workunit.client.1.smithi194.stdout:7/360: read d1/d2b/d2c/d30/d33/d39/f4b [557531,117067] 0 2024-04-13T10:58:38.951 INFO:tasks.workunit.client.1.smithi194.stdout:6/353: write d0/f2a [711291,95655] 0 2024-04-13T10:58:38.952 INFO:tasks.workunit.client.1.smithi194.stdout:7/361: write d1/d2b/d3e/d54/d5a/f49 [554624,100986] 0 2024-04-13T10:58:38.954 INFO:tasks.workunit.client.1.smithi194.stdout:6/354: write d0/f18 [130646,67930] 0 2024-04-13T10:58:38.954 INFO:tasks.workunit.client.1.smithi194.stdout:6/355: fsync d0/f12 0 2024-04-13T10:58:38.958 INFO:tasks.workunit.client.1.smithi194.stdout:7/362: rename d1/d2b/d2c/d30/d33/d75 to d1/d2b/d3e/d54/d5a/d7d 0 2024-04-13T10:58:38.960 INFO:tasks.workunit.client.1.smithi194.stdout:6/356: getdents d0/d26/d2b 0 2024-04-13T10:58:38.961 INFO:tasks.workunit.client.1.smithi194.stdout:3/363: dread d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:38.961 INFO:tasks.workunit.client.1.smithi194.stdout:7/363: mkdir d1/d2b/d4c/d7e 0 2024-04-13T10:58:38.962 INFO:tasks.workunit.client.1.smithi194.stdout:7/364: chown d1/d2b/d3e/d54/d5a/f78 4244251 1 2024-04-13T10:58:38.964 INFO:tasks.workunit.client.1.smithi194.stdout:6/357: unlink d0/l5b 0 2024-04-13T10:58:38.964 INFO:tasks.workunit.client.1.smithi194.stdout:3/364: getdents d2/d3/d1a/d24/d3a/d56/d67/d6d 0 2024-04-13T10:58:38.966 INFO:tasks.workunit.client.1.smithi194.stdout:7/365: creat d1/d2b/d2c/f7f x:0 0 0 2024-04-13T10:58:38.967 INFO:tasks.workunit.client.1.smithi194.stdout:7/366: write d1/d2b/d4c/d4f/f53 [2382613,57500] 0 2024-04-13T10:58:38.968 INFO:tasks.workunit.client.1.smithi194.stdout:6/358: rename d0/d26/d2b/c62 to d0/d26/c6d 0 2024-04-13T10:58:38.969 INFO:tasks.workunit.client.1.smithi194.stdout:3/365: fdatasync d2/d3/d1a/d24/f28 0 2024-04-13T10:58:38.971 INFO:tasks.workunit.client.1.smithi194.stdout:3/366: dread d2/d3/d12/d31/f4e [0,4194304] 0 2024-04-13T10:58:38.976 INFO:tasks.workunit.client.1.smithi194.stdout:3/367: symlink d2/d3/d1a/d24/d3a/d56/d67/l6f 0 2024-04-13T10:58:38.978 INFO:tasks.workunit.client.1.smithi194.stdout:7/367: truncate d1/f3 3391118 0 2024-04-13T10:58:38.979 INFO:tasks.workunit.client.1.smithi194.stdout:6/359: getdents d0/d57 0 2024-04-13T10:58:38.983 INFO:tasks.workunit.client.1.smithi194.stdout:3/368: dwrite d2/d3/d1a/d24/d3a/d56/d67/d61/f6a [0,4194304] 0 2024-04-13T10:58:38.988 INFO:tasks.workunit.client.1.smithi194.stdout:6/360: dwrite d0/f21 [4194304,4194304] 0 2024-04-13T10:58:38.988 INFO:tasks.workunit.client.1.smithi194.stdout:7/368: truncate d1/f12 3629644 0 2024-04-13T10:58:38.989 INFO:tasks.workunit.client.1.smithi194.stdout:3/369: mknod d2/d3/d1a/c70 0 2024-04-13T10:58:38.994 INFO:tasks.workunit.client.1.smithi194.stdout:7/369: unlink d1/d2b/d4c/d4f/d51/c38 0 2024-04-13T10:58:38.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:38 smithi194 ceph-mon[46737]: pgmap v23: 65 pgs: 65 active+clean; 462 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 37 MiB/s wr, 228 op/s 2024-04-13T10:58:38.999 INFO:tasks.workunit.client.1.smithi194.stdout:7/370: mkdir d1/d2b/d3e/d54/d5a/d80 0 2024-04-13T10:58:39.009 INFO:tasks.workunit.client.1.smithi194.stdout:7/371: dwrite d1/d2b/d3e/d54/d5a/f78 [0,4194304] 0 2024-04-13T10:58:39.011 INFO:tasks.workunit.client.1.smithi194.stdout:3/370: write d2/d3/d1a/f2e [1032545,82328] 0 2024-04-13T10:58:39.011 INFO:tasks.workunit.client.1.smithi194.stdout:6/361: truncate d0/d26/d2b/f58 194974 0 2024-04-13T10:58:39.013 INFO:tasks.workunit.client.1.smithi194.stdout:6/362: stat d0/d26/c27 0 2024-04-13T10:58:39.013 INFO:tasks.workunit.client.1.smithi194.stdout:6/363: stat d0/f2a 0 2024-04-13T10:58:39.014 INFO:tasks.workunit.client.1.smithi194.stdout:6/364: write d0/d26/f4e [774207,123633] 0 2024-04-13T10:58:39.015 INFO:tasks.workunit.client.1.smithi194.stdout:7/372: rename d1/d2b/d4c/d4f/d51/l59 to d1/d2b/d4c/d7e/l81 0 2024-04-13T10:58:39.015 INFO:tasks.workunit.client.1.smithi194.stdout:2/389: sync 2024-04-13T10:58:39.015 INFO:tasks.workunit.client.1.smithi194.stdout:4/407: sync 2024-04-13T10:58:39.015 INFO:tasks.workunit.client.1.smithi194.stdout:5/354: sync 2024-04-13T10:58:39.015 INFO:tasks.workunit.client.1.smithi194.stdout:6/365: stat d0/f21 0 2024-04-13T10:58:39.016 INFO:tasks.workunit.client.1.smithi194.stdout:2/390: stat d2/d3/de/l56 0 2024-04-13T10:58:39.017 INFO:tasks.workunit.client.1.smithi194.stdout:6/366: fsync d0/d26/f15 0 2024-04-13T10:58:39.018 INFO:tasks.workunit.client.1.smithi194.stdout:3/371: creat d2/d3/d12/f71 x:0 0 0 2024-04-13T10:58:39.018 INFO:tasks.workunit.client.1.smithi194.stdout:5/355: write d3/dc/d17/d1b/f21 [568410,111935] 0 2024-04-13T10:58:39.020 INFO:tasks.workunit.client.1.smithi194.stdout:6/367: write d0/d42/f43 [2056005,42141] 0 2024-04-13T10:58:39.020 INFO:tasks.workunit.client.1.smithi194.stdout:2/391: mknod d2/d3/de/d3c/c83 0 2024-04-13T10:58:39.021 INFO:tasks.workunit.client.1.smithi194.stdout:6/368: chown d0/d26/c1d 882 1 2024-04-13T10:58:39.021 INFO:tasks.workunit.client.1.smithi194.stdout:2/392: readlink d2/d3/lb 0 2024-04-13T10:58:39.022 INFO:tasks.workunit.client.1.smithi194.stdout:7/373: rmdir d1/d2b/d4c/d4f/d51/d4d/d5e/d5f 39 2024-04-13T10:58:39.023 INFO:tasks.workunit.client.1.smithi194.stdout:2/393: fsync d2/d3/de/d17/d1e/f2c 0 2024-04-13T10:58:39.023 INFO:tasks.workunit.client.1.smithi194.stdout:6/369: chown d0/d26/f4e 389857287 1 2024-04-13T10:58:39.023 INFO:tasks.workunit.client.1.smithi194.stdout:4/408: symlink d2/d16/d1a/d1c/l84 0 2024-04-13T10:58:39.024 INFO:tasks.workunit.client.1.smithi194.stdout:6/370: truncate d0/f2a 3180419 0 2024-04-13T10:58:39.025 INFO:tasks.workunit.client.1.smithi194.stdout:3/372: mkdir d2/d3/d1a/d24/d3a/d72 0 2024-04-13T10:58:39.025 INFO:tasks.workunit.client.1.smithi194.stdout:2/394: write d2/d3/de/d17/d1e/f51 [429582,67411] 0 2024-04-13T10:58:39.025 INFO:tasks.workunit.client.1.smithi194.stdout:4/409: read d2/d16/d1a/f43 [998418,44063] 0 2024-04-13T10:58:39.028 INFO:tasks.workunit.client.1.smithi194.stdout:6/371: chown d0/d2c/c3d 108 1 2024-04-13T10:58:39.032 INFO:tasks.workunit.client.1.smithi194.stdout:7/374: truncate d1/d2b/d2c/d30/d33/d39/f4b 1111406 0 2024-04-13T10:58:39.034 INFO:tasks.workunit.client.1.smithi194.stdout:2/395: read d2/d3/d6d/f7c [155628,93127] 0 2024-04-13T10:58:39.035 INFO:tasks.workunit.client.1.smithi194.stdout:6/372: creat d0/d2c/f6e x:0 0 0 2024-04-13T10:58:39.035 INFO:tasks.workunit.client.1.smithi194.stdout:6/373: readlink d0/d26/l4c 0 2024-04-13T10:58:39.038 INFO:tasks.workunit.client.1.smithi194.stdout:6/374: dread d0/f18 [0,4194304] 0 2024-04-13T10:58:39.038 INFO:tasks.workunit.client.1.smithi194.stdout:4/410: rename d2/d16/d1a/d1c/d54/l63 to d2/d30/l85 0 2024-04-13T10:58:39.040 INFO:tasks.workunit.client.1.smithi194.stdout:3/373: creat d2/d3/d1a/d24/d3a/d56/d67/d57/f73 x:0 0 0 2024-04-13T10:58:39.041 INFO:tasks.workunit.client.1.smithi194.stdout:3/374: write d2/f5 [1067112,46096] 0 2024-04-13T10:58:39.041 INFO:tasks.workunit.client.1.smithi194.stdout:7/375: creat d1/d2b/d3e/d54/f82 x:0 0 0 2024-04-13T10:58:39.042 INFO:tasks.workunit.client.1.smithi194.stdout:2/396: creat d2/d3/de/d3c/f84 x:0 0 0 2024-04-13T10:58:39.044 INFO:tasks.workunit.client.1.smithi194.stdout:5/356: dwrite d3/dc/d10/d38/d59/f64 [0,4194304] 0 2024-04-13T10:58:39.044 INFO:tasks.workunit.client.1.smithi194.stdout:7/376: stat d1/d2b/d2c/d30/d33/d39/f66 0 2024-04-13T10:58:39.045 INFO:tasks.workunit.client.1.smithi194.stdout:7/377: read - d1/d2b/d4c/f5d zero size 2024-04-13T10:58:39.046 INFO:tasks.workunit.client.1.smithi194.stdout:7/378: truncate d1/d2b/d3e/d54/f72 671765 0 2024-04-13T10:58:39.047 INFO:tasks.workunit.client.1.smithi194.stdout:4/411: mknod d2/d16/d1a/d1c/c86 0 2024-04-13T10:58:39.049 INFO:tasks.workunit.client.1.smithi194.stdout:3/375: mknod d2/d3/d1a/d24/d6c/c74 0 2024-04-13T10:58:39.050 INFO:tasks.workunit.client.1.smithi194.stdout:5/357: mkdir d3/dc/d17/d1b/d6b 0 2024-04-13T10:58:39.051 INFO:tasks.workunit.client.1.smithi194.stdout:7/379: rmdir d1/d2b/d2c/d30 39 2024-04-13T10:58:39.052 INFO:tasks.workunit.client.1.smithi194.stdout:5/358: truncate d3/dc/d10/d20/d23/f5f 233864 0 2024-04-13T10:58:39.052 INFO:tasks.workunit.client.1.smithi194.stdout:7/380: write d1/d2b/d2c/f7f [656468,99] 0 2024-04-13T10:58:39.054 INFO:tasks.workunit.client.1.smithi194.stdout:2/397: rename d2/d3/de/d3c/f84 to d2/d3/de/d33/d47/f85 0 2024-04-13T10:58:39.054 INFO:tasks.workunit.client.1.smithi194.stdout:7/381: truncate d1/d2b/d4c/f5d 497508 0 2024-04-13T10:58:39.055 INFO:tasks.workunit.client.1.smithi194.stdout:3/376: mkdir d2/d3/d1a/d24/d3a/d56/d67/d75 0 2024-04-13T10:58:39.056 INFO:tasks.workunit.client.1.smithi194.stdout:4/412: symlink d2/l87 0 2024-04-13T10:58:39.056 INFO:tasks.workunit.client.1.smithi194.stdout:3/377: read d2/d3/d1a/d24/f4c [4168120,79395] 0 2024-04-13T10:58:39.058 INFO:tasks.workunit.client.1.smithi194.stdout:5/359: symlink d3/dc/d10/d38/d59/l6c 0 2024-04-13T10:58:39.058 INFO:tasks.workunit.client.1.smithi194.stdout:3/378: write d2/d3/d12/f71 [986503,104742] 0 2024-04-13T10:58:39.059 INFO:tasks.workunit.client.1.smithi194.stdout:7/382: creat d1/d6c/f83 x:0 0 0 2024-04-13T10:58:39.061 INFO:tasks.workunit.client.1.smithi194.stdout:2/398: mkdir d2/d3/de/d17/d1e/d42/d86 0 2024-04-13T10:58:39.062 INFO:tasks.workunit.client.1.smithi194.stdout:5/360: rmdir d3/dc/d10/d20/d23 39 2024-04-13T10:58:39.065 INFO:tasks.workunit.client.1.smithi194.stdout:7/383: write d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f71 [878353,31290] 0 2024-04-13T10:58:39.065 INFO:tasks.workunit.client.1.smithi194.stdout:4/413: dread d2/d16/d70/d31/f40 [0,4194304] 0 2024-04-13T10:58:39.066 INFO:tasks.workunit.client.1.smithi194.stdout:5/361: symlink d3/dc/d10/d38/d46/l6d 0 2024-04-13T10:58:39.068 INFO:tasks.workunit.client.1.smithi194.stdout:3/379: dread d2/d3/d1a/d24/f28 [0,4194304] 0 2024-04-13T10:58:39.070 INFO:tasks.workunit.client.1.smithi194.stdout:7/384: rename d1/d2b/d3e/d54/f82 to d1/d2b/d3e/f84 0 2024-04-13T10:58:39.074 INFO:tasks.workunit.client.1.smithi194.stdout:4/414: dwrite d2/d16/d70/f68 [0,4194304] 0 2024-04-13T10:58:39.074 INFO:tasks.workunit.client.1.smithi194.stdout:5/362: dread d3/dc/d10/d38/d59/f64 [0,4194304] 0 2024-04-13T10:58:39.075 INFO:tasks.workunit.client.1.smithi194.stdout:4/415: stat d2/d16/d1a/d1c/l73 0 2024-04-13T10:58:39.075 INFO:tasks.workunit.client.1.smithi194.stdout:7/385: mkdir d1/d2b/d4c/d4f/d85 0 2024-04-13T10:58:39.076 INFO:tasks.workunit.client.1.smithi194.stdout:4/416: dread - d2/d16/d1a/f6f zero size 2024-04-13T10:58:39.080 INFO:tasks.workunit.client.1.smithi194.stdout:5/363: mknod d3/dc/d10/c6e 0 2024-04-13T10:58:39.080 INFO:tasks.workunit.client.1.smithi194.stdout:4/417: dread d2/d16/d1a/d1c/d54/d62/f71 [0,4194304] 0 2024-04-13T10:58:39.086 INFO:tasks.workunit.client.1.smithi194.stdout:4/418: creat d2/d30/f88 x:0 0 0 2024-04-13T10:58:39.087 INFO:tasks.workunit.client.1.smithi194.stdout:5/364: rename d3/l6a to d3/dc/d10/d38/d59/d49/l6f 0 2024-04-13T10:58:39.089 INFO:tasks.workunit.client.1.smithi194.stdout:5/365: write d3/dc/d10/f2e [1182317,98262] 0 2024-04-13T10:58:39.090 INFO:tasks.workunit.client.1.smithi194.stdout:2/399: write d2/d3/d6d/f7c [684125,98148] 0 2024-04-13T10:58:39.093 INFO:tasks.workunit.client.1.smithi194.stdout:4/419: dwrite d2/d16/d1a/f6f [0,4194304] 0 2024-04-13T10:58:39.095 INFO:tasks.workunit.client.1.smithi194.stdout:5/366: rename d3/dc/d10/l37 to d3/dc/l70 0 2024-04-13T10:58:39.096 INFO:tasks.workunit.client.1.smithi194.stdout:2/400: mknod d2/d3/de/d17/c87 0 2024-04-13T10:58:39.102 INFO:tasks.workunit.client.1.smithi194.stdout:4/420: rename d2/d16/d1a/l55 to d2/d16/d70/l89 0 2024-04-13T10:58:39.103 INFO:tasks.workunit.client.1.smithi194.stdout:3/380: dwrite d2/d3/d1a/d24/f38 [0,4194304] 0 2024-04-13T10:58:39.105 INFO:tasks.workunit.client.1.smithi194.stdout:4/421: write d2/d33/f17 [4386383,33801] 0 2024-04-13T10:58:39.105 INFO:tasks.workunit.client.1.smithi194.stdout:7/386: dwrite d1/f16 [0,4194304] 0 2024-04-13T10:58:39.107 INFO:tasks.workunit.client.1.smithi194.stdout:3/381: read d2/de/f1e [2897242,99485] 0 2024-04-13T10:58:39.108 INFO:tasks.workunit.client.1.smithi194.stdout:2/401: getdents d2/d5/d57 0 2024-04-13T10:58:39.109 INFO:tasks.workunit.client.1.smithi194.stdout:5/367: link d3/dc/d10/d20/d23/l5a d3/dc/d17/d1b/l71 0 2024-04-13T10:58:39.114 INFO:tasks.workunit.client.1.smithi194.stdout:5/368: fdatasync d3/dc/d10/d38/f60 0 2024-04-13T10:58:39.115 INFO:tasks.workunit.client.1.smithi194.stdout:2/402: creat d2/d3/de/d17/d36/f88 x:0 0 0 2024-04-13T10:58:39.115 INFO:tasks.workunit.client.1.smithi194.stdout:8/396: sync 2024-04-13T10:58:39.116 INFO:tasks.workunit.client.1.smithi194.stdout:4/422: dread d2/d16/d1a/f4c [0,4194304] 0 2024-04-13T10:58:39.117 INFO:tasks.workunit.client.1.smithi194.stdout:2/403: write d2/d5/f31 [498257,128347] 0 2024-04-13T10:58:39.117 INFO:tasks.workunit.client.1.smithi194.stdout:7/387: getdents d1/d2b/d4c 0 2024-04-13T10:58:39.121 INFO:tasks.workunit.client.1.smithi194.stdout:4/423: chown d2/d16/d1a/d1c/d54/d5d/l83 4 1 2024-04-13T10:58:39.122 INFO:tasks.workunit.client.1.smithi194.stdout:8/397: creat d6/d22/d23/d7f/f81 x:0 0 0 2024-04-13T10:58:39.124 INFO:tasks.workunit.client.1.smithi194.stdout:2/404: dwrite d2/d3/de/d3c/f76 [0,4194304] 0 2024-04-13T10:58:39.126 INFO:tasks.workunit.client.1.smithi194.stdout:8/398: mknod d6/d22/d23/d25/d39/c82 0 2024-04-13T10:58:39.131 INFO:tasks.workunit.client.1.smithi194.stdout:5/369: truncate d3/dc/d17/f1c 1098002 0 2024-04-13T10:58:39.134 INFO:tasks.workunit.client.1.smithi194.stdout:5/370: chown d3/dc/d17/d1b/f21 3651 1 2024-04-13T10:58:39.134 INFO:tasks.workunit.client.1.smithi194.stdout:2/405: link d2/d5/f31 d2/d3/de/d17/d1e/d42/d86/f89 0 2024-04-13T10:58:39.134 INFO:tasks.workunit.client.1.smithi194.stdout:8/399: dwrite d6/f1d [4194304,4194304] 0 2024-04-13T10:58:39.135 INFO:tasks.workunit.client.1.smithi194.stdout:4/424: truncate d2/d16/d70/f68 3694141 0 2024-04-13T10:58:39.135 INFO:tasks.workunit.client.1.smithi194.stdout:5/371: fsync d3/dc/d2d/f36 0 2024-04-13T10:58:39.139 INFO:tasks.workunit.client.1.smithi194.stdout:8/400: mknod d6/d22/c83 0 2024-04-13T10:58:39.139 INFO:tasks.workunit.client.1.smithi194.stdout:7/388: link d1/d2b/d2c/d30/c44 d1/d2b/d4c/d4f/d51/c86 0 2024-04-13T10:58:39.140 INFO:tasks.workunit.client.1.smithi194.stdout:4/425: dread d2/d30/f77 [0,4194304] 0 2024-04-13T10:58:39.142 INFO:tasks.workunit.client.1.smithi194.stdout:7/389: fdatasync d1/d6c/f83 0 2024-04-13T10:58:39.144 INFO:tasks.workunit.client.1.smithi194.stdout:8/401: write d6/dd/f48 [4288598,24664] 0 2024-04-13T10:58:39.147 INFO:tasks.workunit.client.1.smithi194.stdout:4/426: mknod d2/d16/d1a/d1c/d3e/d48/c8a 0 2024-04-13T10:58:39.150 INFO:tasks.workunit.client.1.smithi194.stdout:2/406: dwrite d2/d3/de/d17/d36/f88 [0,4194304] 0 2024-04-13T10:58:39.150 INFO:tasks.workunit.client.1.smithi194.stdout:7/390: unlink d1/d2b/d4c/d4f/d51/d4d/d5e/l6f 0 2024-04-13T10:58:39.151 INFO:tasks.workunit.client.1.smithi194.stdout:5/372: dwrite d3/dc/d10/d20/f43 [0,4194304] 0 2024-04-13T10:58:39.151 INFO:tasks.workunit.client.1.smithi194.stdout:8/402: chown d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3c 5314 1 2024-04-13T10:58:39.154 INFO:tasks.workunit.client.1.smithi194.stdout:8/403: read d6/d22/d23/f5f [102356,20057] 0 2024-04-13T10:58:39.156 INFO:tasks.workunit.client.1.smithi194.stdout:2/407: symlink d2/d5/d57/l8a 0 2024-04-13T10:58:39.156 INFO:tasks.workunit.client.1.smithi194.stdout:8/404: fsync f5 0 2024-04-13T10:58:39.159 INFO:tasks.workunit.client.1.smithi194.stdout:5/373: readlink d3/dc/d10/d38/d59/d49/l6f 0 2024-04-13T10:58:39.163 INFO:tasks.workunit.client.1.smithi194.stdout:8/405: rmdir d6/d22/d23/d25/d78 39 2024-04-13T10:58:39.168 INFO:tasks.workunit.client.1.smithi194.stdout:8/406: rename d6/f1c to d6/d22/d23/d25/d39/d41/d64/f84 0 2024-04-13T10:58:39.171 INFO:tasks.workunit.client.1.smithi194.stdout:2/408: getdents d2/d3/de/d17/d1e 0 2024-04-13T10:58:39.171 INFO:tasks.workunit.client.1.smithi194.stdout:5/374: link d3/dc/d10/d20/c4b d3/dc/d10/d20/c72 0 2024-04-13T10:58:39.173 INFO:tasks.workunit.client.1.smithi194.stdout:8/407: creat d6/d22/d23/f85 x:0 0 0 2024-04-13T10:58:39.173 INFO:tasks.workunit.client.1.smithi194.stdout:4/427: dwrite d2/d30/d50/f5a [0,4194304] 0 2024-04-13T10:58:39.181 INFO:tasks.workunit.client.1.smithi194.stdout:8/408: rename d6/l18 to d6/d22/d23/d25/d39/d41/d5b/d76/l86 0 2024-04-13T10:58:39.181 INFO:tasks.workunit.client.1.smithi194.stdout:2/409: dwrite d2/d5/d57/f69 [0,4194304] 0 2024-04-13T10:58:39.185 INFO:tasks.workunit.client.1.smithi194.stdout:2/410: creat d2/d3/de/d17/f8b x:0 0 0 2024-04-13T10:58:39.186 INFO:tasks.workunit.client.1.smithi194.stdout:8/409: mknod d6/d22/d23/d25/d78/c87 0 2024-04-13T10:58:39.187 INFO:tasks.workunit.client.1.smithi194.stdout:8/410: write d6/d22/d23/d25/d39/d41/f73 [50936,112157] 0 2024-04-13T10:58:39.189 INFO:tasks.workunit.client.1.smithi194.stdout:2/411: write d2/d3/de/d17/d39/f64 [2978077,84131] 0 2024-04-13T10:58:39.189 INFO:tasks.workunit.client.1.smithi194.stdout:5/375: truncate d3/dc/f2c 259804 0 2024-04-13T10:58:39.190 INFO:tasks.workunit.client.1.smithi194.stdout:4/428: write d2/d16/d1a/d1c/d3b/d42/f52 [1131265,109198] 0 2024-04-13T10:58:39.191 INFO:tasks.workunit.client.1.smithi194.stdout:4/429: chown d2/d30 736375 1 2024-04-13T10:58:39.195 INFO:tasks.workunit.client.1.smithi194.stdout:2/412: write d2/d3/de/d33/d47/f85 [827628,112443] 0 2024-04-13T10:58:39.196 INFO:tasks.workunit.client.1.smithi194.stdout:4/430: rename d2/d30/f77 to d2/d16/d70/f8b 0 2024-04-13T10:58:39.200 INFO:tasks.workunit.client.1.smithi194.stdout:4/431: chown d2/d16/d1a/d1c/d3b/d42 10606197 1 2024-04-13T10:58:39.200 INFO:tasks.workunit.client.1.smithi194.stdout:5/376: dwrite d3/d29/f34 [0,4194304] 0 2024-04-13T10:58:39.201 INFO:tasks.workunit.client.1.smithi194.stdout:8/411: dwrite d6/d22/d23/d25/f36 [0,4194304] 0 2024-04-13T10:58:39.203 INFO:tasks.workunit.client.1.smithi194.stdout:2/413: creat d2/d3/de/d17/d1e/d42/f8c x:0 0 0 2024-04-13T10:58:39.205 INFO:tasks.workunit.client.1.smithi194.stdout:2/414: mknod d2/d3/d12/c8d 0 2024-04-13T10:58:39.207 INFO:tasks.workunit.client.1.smithi194.stdout:4/432: creat d2/d16/d1a/f8c x:0 0 0 2024-04-13T10:58:39.209 INFO:tasks.workunit.client.1.smithi194.stdout:4/433: write d2/d16/d1a/f8c [907073,28205] 0 2024-04-13T10:58:39.210 INFO:tasks.workunit.client.1.smithi194.stdout:2/415: symlink d2/d3/d12/l8e 0 2024-04-13T10:58:39.210 INFO:tasks.workunit.client.1.smithi194.stdout:2/416: dread - d2/d5/f2f zero size 2024-04-13T10:58:39.210 INFO:tasks.workunit.client.1.smithi194.stdout:8/412: truncate d6/d2a/f57 4095020 0 2024-04-13T10:58:39.211 INFO:tasks.workunit.client.1.smithi194.stdout:8/413: chown d6/d22/d23/l2b 644 1 2024-04-13T10:58:39.212 INFO:tasks.workunit.client.1.smithi194.stdout:8/414: truncate d6/d2a/f4c 1863058 0 2024-04-13T10:58:39.213 INFO:tasks.workunit.client.1.smithi194.stdout:8/415: chown d6/d22/d23/d25/d39/d41/d5b/d76/d33 180153222 1 2024-04-13T10:58:39.214 INFO:tasks.workunit.client.1.smithi194.stdout:4/434: mkdir d2/d16/d1a/d1c/d3b/d8d 0 2024-04-13T10:58:39.218 INFO:tasks.workunit.client.1.smithi194.stdout:2/417: rename d2/d5 to d2/d3/de/d17/d36/d8f 0 2024-04-13T10:58:39.219 INFO:tasks.workunit.client.1.smithi194.stdout:8/416: mknod d6/d22/c88 0 2024-04-13T10:58:39.221 INFO:tasks.workunit.client.1.smithi194.stdout:4/435: chown d2/d16/d70/f51 23565716 1 2024-04-13T10:58:39.227 INFO:tasks.workunit.client.1.smithi194.stdout:4/436: dwrite d2/d16/d1a/d1c/d3e/d48/f80 [0,4194304] 0 2024-04-13T10:58:39.232 INFO:tasks.workunit.client.1.smithi194.stdout:2/418: truncate d2/f74 2329255 0 2024-04-13T10:58:39.236 INFO:tasks.workunit.client.1.smithi194.stdout:2/419: rmdir d2/d3/d12 39 2024-04-13T10:58:39.242 INFO:tasks.workunit.client.1.smithi194.stdout:4/437: dwrite d2/fb [4194304,4194304] 0 2024-04-13T10:58:39.243 INFO:tasks.workunit.client.1.smithi194.stdout:2/420: chown d2/d3/de/d17/c55 562 1 2024-04-13T10:58:39.243 INFO:tasks.workunit.client.1.smithi194.stdout:5/377: dwrite d3/dc/d10/d38/d59/f64 [0,4194304] 0 2024-04-13T10:58:39.247 INFO:tasks.workunit.client.1.smithi194.stdout:8/417: dwrite d6/dd/f16 [0,4194304] 0 2024-04-13T10:58:39.248 INFO:tasks.workunit.client.1.smithi194.stdout:2/421: mkdir d2/d3/de/d90 0 2024-04-13T10:58:39.250 INFO:tasks.workunit.client.1.smithi194.stdout:5/378: symlink d3/dc/d2d/l73 0 2024-04-13T10:58:39.251 INFO:tasks.workunit.client.1.smithi194.stdout:4/438: mknod d2/d16/d1a/d1c/d54/d62/d6e/c8e 0 2024-04-13T10:58:39.252 INFO:tasks.workunit.client.1.smithi194.stdout:5/379: chown d3/d29/f34 1692562127 1 2024-04-13T10:58:39.253 INFO:tasks.workunit.client.1.smithi194.stdout:2/422: symlink d2/d3/de/d17/d36/d65/l91 0 2024-04-13T10:58:39.254 INFO:tasks.workunit.client.1.smithi194.stdout:8/418: symlink d6/d22/d23/d25/d71/l89 0 2024-04-13T10:58:39.256 INFO:tasks.workunit.client.1.smithi194.stdout:5/380: fsync d3/dc/d10/d38/f60 0 2024-04-13T10:58:39.261 INFO:tasks.workunit.client.1.smithi194.stdout:9/347: sync 2024-04-13T10:58:39.262 INFO:tasks.workunit.client.1.smithi194.stdout:8/419: creat d6/d22/d23/d25/f8a x:0 0 0 2024-04-13T10:58:39.265 INFO:tasks.workunit.client.1.smithi194.stdout:5/381: link d3/dc/d10/f61 d3/dc/d17/f74 0 2024-04-13T10:58:39.267 INFO:tasks.workunit.client.1.smithi194.stdout:9/348: mkdir d0/d11/d79 0 2024-04-13T10:58:39.270 INFO:tasks.workunit.client.1.smithi194.stdout:2/423: truncate d2/d3/d12/f1b 350995 0 2024-04-13T10:58:39.275 INFO:tasks.workunit.client.1.smithi194.stdout:4/439: dwrite d2/d16/d70/f51 [0,4194304] 0 2024-04-13T10:58:39.279 INFO:tasks.workunit.client.1.smithi194.stdout:4/440: mkdir d2/d33/d8f 0 2024-04-13T10:58:39.280 INFO:tasks.workunit.client.1.smithi194.stdout:9/349: dwrite d0/d6/d2c/d68/f6a [0,4194304] 0 2024-04-13T10:58:39.281 INFO:tasks.workunit.client.1.smithi194.stdout:8/420: dwrite d6/d2a/f57 [0,4194304] 0 2024-04-13T10:58:39.283 INFO:tasks.workunit.client.1.smithi194.stdout:2/424: creat d2/d3/de/d17/d1e/d42/d52/f92 x:0 0 0 2024-04-13T10:58:39.285 INFO:tasks.workunit.client.1.smithi194.stdout:8/421: symlink d6/d22/l8b 0 2024-04-13T10:58:39.288 INFO:tasks.workunit.client.1.smithi194.stdout:2/425: creat d2/d3/de/d17/d1e/d42/d52/f93 x:0 0 0 2024-04-13T10:58:39.289 INFO:tasks.workunit.client.1.smithi194.stdout:9/350: rename d0/d11/l64 to d0/d11/l7a 0 2024-04-13T10:58:39.290 INFO:tasks.workunit.client.1.smithi194.stdout:8/422: mkdir d6/d22/d23/d7f/d8c 0 2024-04-13T10:58:39.291 INFO:tasks.workunit.client.1.smithi194.stdout:9/351: read d0/d11/f41 [3653924,107318] 0 2024-04-13T10:58:39.293 INFO:tasks.workunit.client.1.smithi194.stdout:4/441: dwrite d2/d16/d1a/d1c/d3e/d48/f80 [4194304,4194304] 0 2024-04-13T10:58:39.294 INFO:tasks.workunit.client.1.smithi194.stdout:2/426: symlink d2/d3/de/d17/d1e/d42/d52/l94 0 2024-04-13T10:58:39.299 INFO:tasks.workunit.client.1.smithi194.stdout:8/423: mkdir d6/d22/d23/d7f/d8c/d8d 0 2024-04-13T10:58:39.299 INFO:tasks.workunit.client.1.smithi194.stdout:8/424: readlink d6/d22/l24 0 2024-04-13T10:58:39.304 INFO:tasks.workunit.client.1.smithi194.stdout:8/425: mknod d6/d22/d23/d25/d39/d41/c8e 0 2024-04-13T10:58:39.307 INFO:tasks.workunit.client.1.smithi194.stdout:9/352: rename d0/d6/f76 to d0/d6/f7b 0 2024-04-13T10:58:39.309 INFO:tasks.workunit.client.1.smithi194.stdout:8/426: creat d6/dd/d80/f8f x:0 0 0 2024-04-13T10:58:39.312 INFO:tasks.workunit.client.1.smithi194.stdout:2/427: write d2/d3/de/f16 [1300987,21915] 0 2024-04-13T10:58:39.313 INFO:tasks.workunit.client.1.smithi194.stdout:8/427: symlink d6/d22/d23/d25/d39/d41/d5b/l90 0 2024-04-13T10:58:39.314 INFO:tasks.workunit.client.1.smithi194.stdout:2/428: rmdir d2 39 2024-04-13T10:58:39.314 INFO:tasks.workunit.client.1.smithi194.stdout:9/353: dwrite d0/d6/d14/f1a [0,4194304] 0 2024-04-13T10:58:39.318 INFO:tasks.workunit.client.1.smithi194.stdout:8/428: truncate d6/d22/d23/d7f/f81 912793 0 2024-04-13T10:58:39.320 INFO:tasks.workunit.client.1.smithi194.stdout:4/442: dwrite d2/f56 [0,4194304] 0 2024-04-13T10:58:39.321 INFO:tasks.workunit.client.1.smithi194.stdout:2/429: mknod d2/d3/de/d17/d36/d3d/c95 0 2024-04-13T10:58:39.322 INFO:tasks.workunit.client.1.smithi194.stdout:2/430: stat d2/d3/de/d17/d36/d65 0 2024-04-13T10:58:39.323 INFO:tasks.workunit.client.1.smithi194.stdout:2/431: write d2/d3/de/d17/d1e/f2c [10461915,42337] 0 2024-04-13T10:58:39.324 INFO:tasks.workunit.client.1.smithi194.stdout:2/432: dread - d2/d3/de/d17/d36/d8f/f2f zero size 2024-04-13T10:58:39.332 INFO:tasks.workunit.client.1.smithi194.stdout:4/443: dwrite d2/d33/f2e [0,4194304] 0 2024-04-13T10:58:39.333 INFO:tasks.workunit.client.1.smithi194.stdout:2/433: dwrite d2/d3/de/d33/d71/f75 [0,4194304] 0 2024-04-13T10:58:39.335 INFO:tasks.workunit.client.1.smithi194.stdout:4/444: chown d2/d16/d1a/d1c/d3b/d42/f82 31281 1 2024-04-13T10:58:39.336 INFO:tasks.workunit.client.1.smithi194.stdout:4/445: dread - d2/d16/d1a/d1c/d3b/d42/f75 zero size 2024-04-13T10:58:39.343 INFO:tasks.workunit.client.1.smithi194.stdout:4/446: dread d2/d16/d1a/d1c/d3e/d48/f80 [0,4194304] 0 2024-04-13T10:58:39.343 INFO:tasks.workunit.client.1.smithi194.stdout:6/375: sync 2024-04-13T10:58:39.343 INFO:tasks.workunit.client.1.smithi194.stdout:1/380: sync 2024-04-13T10:58:39.344 INFO:tasks.workunit.client.1.smithi194.stdout:3/382: sync 2024-04-13T10:58:39.344 INFO:tasks.workunit.client.1.smithi194.stdout:0/328: sync 2024-04-13T10:58:39.346 INFO:tasks.workunit.client.1.smithi194.stdout:6/376: mkdir d0/d2f/d6f 0 2024-04-13T10:58:39.347 INFO:tasks.workunit.client.1.smithi194.stdout:2/434: truncate d2/d3/de/d17/d36/d8f/f1d 742433 0 2024-04-13T10:58:39.348 INFO:tasks.workunit.client.1.smithi194.stdout:2/435: write d2/d3/de/f7f [865262,107106] 0 2024-04-13T10:58:39.348 INFO:tasks.workunit.client.1.smithi194.stdout:3/383: symlink d2/d3/d12/d31/l76 0 2024-04-13T10:58:39.349 INFO:tasks.workunit.client.1.smithi194.stdout:6/377: mknod d0/d26/d2b/d4d/c70 0 2024-04-13T10:58:39.350 INFO:tasks.workunit.client.1.smithi194.stdout:6/378: truncate d0/d26/f15 4676422 0 2024-04-13T10:58:39.351 INFO:tasks.workunit.client.1.smithi194.stdout:0/329: unlink d9/db/d19/l21 0 2024-04-13T10:58:39.351 INFO:tasks.workunit.client.1.smithi194.stdout:4/447: mkdir d2/d33/d8f/d90 0 2024-04-13T10:58:39.352 INFO:tasks.workunit.client.1.smithi194.stdout:1/381: symlink d12/d13/d1c/d27/d4c/d7d/l7e 0 2024-04-13T10:58:39.352 INFO:tasks.workunit.client.1.smithi194.stdout:0/330: chown d9/df/l41 1696061 1 2024-04-13T10:58:39.353 INFO:tasks.workunit.client.1.smithi194.stdout:3/384: fdatasync d2/d3/d12/d31/f4f 0 2024-04-13T10:58:39.353 INFO:tasks.workunit.client.1.smithi194.stdout:2/436: creat d2/d3/de/d17/d36/d8f/f96 x:0 0 0 2024-04-13T10:58:39.356 INFO:tasks.workunit.client.1.smithi194.stdout:0/331: chown d9/db/d19/d28/f1e 1 1 2024-04-13T10:58:39.356 INFO:tasks.workunit.client.1.smithi194.stdout:3/385: creat d2/d3/f77 x:0 0 0 2024-04-13T10:58:39.358 INFO:tasks.workunit.client.1.smithi194.stdout:1/382: mkdir d12/d13/d1c/d27/d4c/d7f 0 2024-04-13T10:58:39.358 INFO:tasks.workunit.client.1.smithi194.stdout:6/379: dwrite d0/f1f [0,4194304] 0 2024-04-13T10:58:39.360 INFO:tasks.workunit.client.1.smithi194.stdout:6/380: truncate d0/d2c/f6c 300447 0 2024-04-13T10:58:39.400 INFO:tasks.workunit.client.1.smithi194.stdout:2/437: symlink d2/l97 0 2024-04-13T10:58:39.400 INFO:tasks.workunit.client.1.smithi194.stdout:1/383: truncate d12/d13/d1c/d27/d5c/f68 412612 0 2024-04-13T10:58:39.401 INFO:tasks.workunit.client.1.smithi194.stdout:0/332: unlink d9/df/f1f 0 2024-04-13T10:58:39.401 INFO:tasks.workunit.client.1.smithi194.stdout:3/386: mkdir d2/d3/d1a/d24/d3a/d56/d78 0 2024-04-13T10:58:39.402 INFO:tasks.workunit.client.1.smithi194.stdout:4/448: write d2/d16/d1a/f43 [1658530,30283] 0 2024-04-13T10:58:39.402 INFO:tasks.workunit.client.1.smithi194.stdout:6/381: symlink d0/d26/d4b/l71 0 2024-04-13T10:58:39.402 INFO:tasks.workunit.client.1.smithi194.stdout:3/387: stat d2/d3/c51 0 2024-04-13T10:58:39.405 INFO:tasks.workunit.client.1.smithi194.stdout:4/449: symlink d2/d16/d1a/d1c/d54/d62/d6e/l91 0 2024-04-13T10:58:39.405 INFO:tasks.workunit.client.1.smithi194.stdout:1/384: mkdir d12/d13/d1c/d28/d41/d77/d80 0 2024-04-13T10:58:39.406 INFO:tasks.workunit.client.1.smithi194.stdout:3/388: creat d2/d3/d1a/d24/d3a/d56/d67/f79 x:0 0 0 2024-04-13T10:58:39.407 INFO:tasks.workunit.client.1.smithi194.stdout:4/450: truncate d2/d16/d1a/d1c/d54/d62/d6e/f76 4945886 0 2024-04-13T10:58:39.407 INFO:tasks.workunit.client.1.smithi194.stdout:3/389: chown d2/d3/d1a/d24/d3a/d56/d67 832453 1 2024-04-13T10:58:39.413 INFO:tasks.workunit.client.1.smithi194.stdout:1/385: dwrite f10 [4194304,4194304] 0 2024-04-13T10:58:39.415 INFO:tasks.workunit.client.1.smithi194.stdout:6/382: truncate d0/d26/d2b/f39 3314584 0 2024-04-13T10:58:39.421 INFO:tasks.workunit.client.1.smithi194.stdout:4/451: dread d2/d16/d70/f68 [0,4194304] 0 2024-04-13T10:58:39.421 INFO:tasks.workunit.client.1.smithi194.stdout:0/333: dwrite d9/db/d3a/f49 [0,4194304] 0 2024-04-13T10:58:39.422 INFO:tasks.workunit.client.1.smithi194.stdout:6/383: write d0/d26/f29 [4835191,79148] 0 2024-04-13T10:58:39.425 INFO:tasks.workunit.client.1.smithi194.stdout:1/386: rename d12/d13/d1c/d28/f76 to d12/f81 0 2024-04-13T10:58:39.427 INFO:tasks.workunit.client.1.smithi194.stdout:3/390: dwrite d2/d3/d1a/d24/f4c [0,4194304] 0 2024-04-13T10:58:39.428 INFO:tasks.workunit.client.1.smithi194.stdout:1/387: fdatasync d12/d13/d1c/f31 0 2024-04-13T10:58:39.428 INFO:tasks.workunit.client.1.smithi194.stdout:7/391: sync 2024-04-13T10:58:39.429 INFO:tasks.workunit.client.1.smithi194.stdout:5/382: sync 2024-04-13T10:58:39.429 INFO:tasks.workunit.client.1.smithi194.stdout:4/452: unlink d2/c2c 0 2024-04-13T10:58:39.431 INFO:tasks.workunit.client.1.smithi194.stdout:7/392: dread - d1/d2b/d4c/d4f/d6e/f76 zero size 2024-04-13T10:58:39.432 INFO:tasks.workunit.client.1.smithi194.stdout:6/384: creat d0/d26/d4b/f72 x:0 0 0 2024-04-13T10:58:39.432 INFO:tasks.workunit.client.1.smithi194.stdout:5/383: chown d3/dc/d17/l56 29 1 2024-04-13T10:58:39.433 INFO:tasks.workunit.client.1.smithi194.stdout:6/385: read d0/d2c/f6c [166777,945] 0 2024-04-13T10:58:39.436 INFO:tasks.workunit.client.1.smithi194.stdout:7/393: dread d1/d2b/d2c/d30/d33/d39/f62 [0,4194304] 0 2024-04-13T10:58:39.439 INFO:tasks.workunit.client.1.smithi194.stdout:3/391: unlink d2/d3/d1a/d24/d6c/c74 0 2024-04-13T10:58:39.440 INFO:tasks.workunit.client.1.smithi194.stdout:3/392: write d2/f27 [307811,24057] 0 2024-04-13T10:58:39.440 INFO:tasks.workunit.client.1.smithi194.stdout:1/388: mknod d12/d13/d1c/d28/d41/c82 0 2024-04-13T10:58:39.442 INFO:tasks.workunit.client.1.smithi194.stdout:4/453: rmdir d2/d16/d1a/d1c/d3e 39 2024-04-13T10:58:39.443 INFO:tasks.workunit.client.1.smithi194.stdout:4/454: dread - d2/d16/d1a/d1c/d54/d62/f6c zero size 2024-04-13T10:58:39.444 INFO:tasks.workunit.client.1.smithi194.stdout:0/334: dread d9/db/d19/d28/f18 [0,4194304] 0 2024-04-13T10:58:39.445 INFO:tasks.workunit.client.1.smithi194.stdout:0/335: write d9/df/f4c [61601,104976] 0 2024-04-13T10:58:39.445 INFO:tasks.workunit.client.1.smithi194.stdout:7/394: creat d1/d2b/d4c/d4f/d6e/f87 x:0 0 0 2024-04-13T10:58:39.452 INFO:tasks.workunit.client.1.smithi194.stdout:3/393: getdents d2/d3/d1a/d24/d3a/d72 0 2024-04-13T10:58:39.454 INFO:tasks.workunit.client.1.smithi194.stdout:7/395: write d1/d2b/d2c/f68 [112204,17387] 0 2024-04-13T10:58:39.456 INFO:tasks.workunit.client.1.smithi194.stdout:7/396: fsync d1/d2b/d2c/d30/d33/d39/f62 0 2024-04-13T10:58:39.456 INFO:tasks.workunit.client.1.smithi194.stdout:6/386: creat d0/f73 x:0 0 0 2024-04-13T10:58:39.458 INFO:tasks.workunit.client.1.smithi194.stdout:7/397: dread d1/d2b/d4c/f5d [0,4194304] 0 2024-04-13T10:58:39.458 INFO:tasks.workunit.client.1.smithi194.stdout:3/394: symlink d2/d3/d12/d21/l7a 0 2024-04-13T10:58:39.460 INFO:tasks.workunit.client.1.smithi194.stdout:5/384: truncate d3/dc/d10/d20/f43 1355502 0 2024-04-13T10:58:39.462 INFO:tasks.workunit.client.1.smithi194.stdout:1/389: getdents d12/d13/d1c/d27/d4c/d7d 0 2024-04-13T10:58:39.464 INFO:tasks.workunit.client.1.smithi194.stdout:6/387: rename d0/c2d to d0/d2f/c74 0 2024-04-13T10:58:39.465 INFO:tasks.workunit.client.1.smithi194.stdout:4/455: dwrite d2/d16/d70/f68 [0,4194304] 0 2024-04-13T10:58:39.466 INFO:tasks.workunit.client.1.smithi194.stdout:0/336: truncate d9/db/f33 1616172 0 2024-04-13T10:58:39.469 INFO:tasks.workunit.client.1.smithi194.stdout:1/390: symlink d12/d13/d3e/l83 0 2024-04-13T10:58:39.469 INFO:tasks.workunit.client.1.smithi194.stdout:7/398: mkdir d1/d2b/d4c/d4f/d85/d88 0 2024-04-13T10:58:39.470 INFO:tasks.workunit.client.1.smithi194.stdout:4/456: creat d2/d30/d50/f92 x:0 0 0 2024-04-13T10:58:39.472 INFO:tasks.workunit.client.1.smithi194.stdout:6/388: dwrite d0/f73 [0,4194304] 0 2024-04-13T10:58:39.473 INFO:tasks.workunit.client.1.smithi194.stdout:0/337: truncate d9/db/d19/d28/f13 1301373 0 2024-04-13T10:58:39.474 INFO:tasks.workunit.client.1.smithi194.stdout:7/399: symlink d1/d2b/d4c/d4f/l89 0 2024-04-13T10:58:39.475 INFO:tasks.workunit.client.1.smithi194.stdout:7/400: write d1/f8 [1733012,91251] 0 2024-04-13T10:58:39.476 INFO:tasks.workunit.client.1.smithi194.stdout:5/385: creat d3/dc/d17/f75 x:0 0 0 2024-04-13T10:58:39.478 INFO:tasks.workunit.client.1.smithi194.stdout:4/457: rename d2/d30/d50/f92 to d2/d16/d70/d31/f93 0 2024-04-13T10:58:39.479 INFO:tasks.workunit.client.1.smithi194.stdout:0/338: write d9/db/d3a/f49 [64975,82395] 0 2024-04-13T10:58:39.482 INFO:tasks.workunit.client.1.smithi194.stdout:4/458: dread d2/d33/f2e [0,4194304] 0 2024-04-13T10:58:39.483 INFO:tasks.workunit.client.1.smithi194.stdout:6/389: unlink d0/d2c/l4a 0 2024-04-13T10:58:39.484 INFO:tasks.workunit.client.1.smithi194.stdout:6/390: chown d0/d57/d69/f64 37303 1 2024-04-13T10:58:39.485 INFO:tasks.workunit.client.1.smithi194.stdout:0/339: truncate d9/d2b/d5a/f5b 289819 0 2024-04-13T10:58:39.487 INFO:tasks.workunit.client.1.smithi194.stdout:7/401: creat d1/d2b/d2c/f8a x:0 0 0 2024-04-13T10:58:39.487 INFO:tasks.workunit.client.1.smithi194.stdout:0/340: dread d9/df/f4c [0,4194304] 0 2024-04-13T10:58:39.491 INFO:tasks.workunit.client.1.smithi194.stdout:9/354: sync 2024-04-13T10:58:39.494 INFO:tasks.workunit.client.1.smithi194.stdout:6/391: unlink d0/d26/d2b/f39 0 2024-04-13T10:58:39.495 INFO:tasks.workunit.client.1.smithi194.stdout:4/459: link d2/d16/d1a/d1c/l84 d2/d16/d70/d31/l94 0 2024-04-13T10:58:39.496 INFO:tasks.workunit.client.1.smithi194.stdout:3/395: truncate d2/d3/d1a/d24/d3a/d56/d67/d61/f6a 3350094 0 2024-04-13T10:58:39.497 INFO:tasks.workunit.client.1.smithi194.stdout:4/460: fsync d2/d16/d1a/d1c/d3b/d42/f82 0 2024-04-13T10:58:39.498 INFO:tasks.workunit.client.1.smithi194.stdout:7/402: dwrite d1/f8 [0,4194304] 0 2024-04-13T10:58:39.499 INFO:tasks.workunit.client.1.smithi194.stdout:7/403: truncate d1/d2b/d4c/d4f/f64 1192455 0 2024-04-13T10:58:39.502 INFO:tasks.workunit.client.1.smithi194.stdout:6/392: creat d0/d42/f75 x:0 0 0 2024-04-13T10:58:39.502 INFO:tasks.workunit.client.1.smithi194.stdout:1/391: write d12/d13/d1c/f31 [1581366,8732] 0 2024-04-13T10:58:39.504 INFO:tasks.workunit.client.1.smithi194.stdout:0/341: symlink d9/df/l6d 0 2024-04-13T10:58:39.504 INFO:tasks.workunit.client.1.smithi194.stdout:0/342: readlink d9/d2b/l32 0 2024-04-13T10:58:39.505 INFO:tasks.workunit.client.1.smithi194.stdout:9/355: symlink d0/d6/l7c 0 2024-04-13T10:58:39.506 INFO:tasks.workunit.client.1.smithi194.stdout:9/356: write d0/d6/d14/f27 [1840774,108188] 0 2024-04-13T10:58:39.507 INFO:tasks.workunit.client.1.smithi194.stdout:3/396: symlink d2/d3/d1a/d24/d3a/d72/l7b 0 2024-04-13T10:58:39.510 INFO:tasks.workunit.client.1.smithi194.stdout:6/393: creat d0/d26/d2b/f76 x:0 0 0 2024-04-13T10:58:39.511 INFO:tasks.workunit.client.1.smithi194.stdout:5/386: truncate d3/dc/d10/d38/f44 1808173 0 2024-04-13T10:58:39.511 INFO:tasks.workunit.client.1.smithi194.stdout:5/387: read - d3/dc/d10/f58 zero size 2024-04-13T10:58:39.511 INFO:tasks.workunit.client.1.smithi194.stdout:1/392: fsync d12/d13/d1c/f65 0 2024-04-13T10:58:39.518 INFO:tasks.workunit.client.1.smithi194.stdout:9/357: creat d0/d6/d4a/d74/f7d x:0 0 0 2024-04-13T10:58:39.519 INFO:tasks.workunit.client.1.smithi194.stdout:9/358: dread - d0/d6/d9/d70/f77 zero size 2024-04-13T10:58:39.520 INFO:tasks.workunit.client.1.smithi194.stdout:7/404: truncate d1/d2b/d3e/d54/d5a/f58 668772 0 2024-04-13T10:58:39.522 INFO:tasks.workunit.client.1.smithi194.stdout:3/397: link d2/d3/d1a/f42 d2/d3/d1a/d24/f7c 0 2024-04-13T10:58:39.526 INFO:tasks.workunit.client.1.smithi194.stdout:1/393: link d12/d13/d1c/f65 d12/d13/d1c/d28/d41/f84 0 2024-04-13T10:58:39.526 INFO:tasks.workunit.client.1.smithi194.stdout:1/394: write d12/d13/d1c/d28/f46 [2534440,89647] 0 2024-04-13T10:58:39.526 INFO:tasks.workunit.client.1.smithi194.stdout:9/359: rmdir d0/d6/d9 39 2024-04-13T10:58:39.531 INFO:tasks.workunit.client.1.smithi194.stdout:9/360: creat d0/d11/d3d/f7e x:0 0 0 2024-04-13T10:58:39.534 INFO:tasks.workunit.client.1.smithi194.stdout:3/398: mkdir d2/d7d 0 2024-04-13T10:58:39.536 INFO:tasks.workunit.client.1.smithi194.stdout:9/361: mkdir d0/d6/d14/d26/d7f 0 2024-04-13T10:58:39.541 INFO:tasks.workunit.client.1.smithi194.stdout:9/362: symlink d0/d6/d2c/l80 0 2024-04-13T10:58:39.544 INFO:tasks.workunit.client.1.smithi194.stdout:0/343: link d9/db/f33 d9/db/d19/d28/f6e 0 2024-04-13T10:58:39.545 INFO:tasks.workunit.client.1.smithi194.stdout:9/363: creat d0/d11/d3d/d4c/f81 x:0 0 0 2024-04-13T10:58:39.547 INFO:tasks.workunit.client.1.smithi194.stdout:0/344: mkdir d9/d6f 0 2024-04-13T10:58:39.548 INFO:tasks.workunit.client.1.smithi194.stdout:0/345: write d9/db/d19/d28/f1e [3537816,44554] 0 2024-04-13T10:58:39.550 INFO:tasks.workunit.client.1.smithi194.stdout:9/364: mknod d0/d11/c82 0 2024-04-13T10:58:39.552 INFO:tasks.workunit.client.1.smithi194.stdout:9/365: chown d0/d6/d14/d26/d3b/f63 0 1 2024-04-13T10:58:39.553 INFO:tasks.workunit.client.1.smithi194.stdout:9/366: stat d0/f4d 0 2024-04-13T10:58:39.553 INFO:tasks.workunit.client.1.smithi194.stdout:7/405: write d1/d2b/d2c/d30/d33/d39/f4b [278075,30802] 0 2024-04-13T10:58:39.554 INFO:tasks.workunit.client.1.smithi194.stdout:3/399: write d2/fd [335128,58557] 0 2024-04-13T10:58:39.556 INFO:tasks.workunit.client.1.smithi194.stdout:3/400: chown d2/d3/f77 9648 1 2024-04-13T10:58:39.558 INFO:tasks.workunit.client.1.smithi194.stdout:3/401: stat d2/d3/d1a/d24/d3a/d56/d78 0 2024-04-13T10:58:39.559 INFO:tasks.workunit.client.1.smithi194.stdout:9/367: getdents d0/d6/d2c 0 2024-04-13T10:58:39.560 INFO:tasks.workunit.client.1.smithi194.stdout:7/406: dwrite d1/f8 [4194304,4194304] 0 2024-04-13T10:58:39.560 INFO:tasks.workunit.client.1.smithi194.stdout:3/402: mknod d2/c7e 0 2024-04-13T10:58:39.562 INFO:tasks.workunit.client.1.smithi194.stdout:0/346: write d9/db/f55 [599928,24290] 0 2024-04-13T10:58:39.562 INFO:tasks.workunit.client.1.smithi194.stdout:7/407: read d1/d2b/d4c/f5d [469222,23151] 0 2024-04-13T10:58:39.565 INFO:tasks.workunit.client.1.smithi194.stdout:7/408: mkdir d1/d8b 0 2024-04-13T10:58:39.567 INFO:tasks.workunit.client.1.smithi194.stdout:0/347: mkdir d9/df/d16/d70 0 2024-04-13T10:58:39.568 INFO:tasks.workunit.client.1.smithi194.stdout:9/368: truncate d0/d11/f25 3465429 0 2024-04-13T10:58:39.568 INFO:tasks.workunit.client.1.smithi194.stdout:9/369: stat d0/d6/f13 0 2024-04-13T10:58:39.569 INFO:tasks.workunit.client.1.smithi194.stdout:0/348: mknod d9/df/d16/c71 0 2024-04-13T10:58:39.570 INFO:tasks.workunit.client.1.smithi194.stdout:9/370: fdatasync d0/d6/d2c/d68/f6a 0 2024-04-13T10:58:39.571 INFO:tasks.workunit.client.1.smithi194.stdout:7/409: link d1/d2b/d2c/d30/d33/d39/f66 d1/d2b/d3e/d54/d5a/d80/f8c 0 2024-04-13T10:58:39.574 INFO:tasks.workunit.client.1.smithi194.stdout:0/349: link d9/db/d19/d28/l39 d9/df/d63/l72 0 2024-04-13T10:58:39.574 INFO:tasks.workunit.client.1.smithi194.stdout:7/410: dread d1/d2b/f47 [0,4194304] 0 2024-04-13T10:58:39.577 INFO:tasks.workunit.client.1.smithi194.stdout:0/350: mkdir d9/db/d19/d30/d73 0 2024-04-13T10:58:39.578 INFO:tasks.workunit.client.1.smithi194.stdout:7/411: symlink d1/d2b/d4c/d7e/l8d 0 2024-04-13T10:58:39.578 INFO:tasks.workunit.client.1.smithi194.stdout:3/403: dread d2/f5 [0,4194304] 0 2024-04-13T10:58:39.580 INFO:tasks.workunit.client.1.smithi194.stdout:3/404: read d2/d3/f69 [265964,120061] 0 2024-04-13T10:58:39.584 INFO:tasks.workunit.client.1.smithi194.stdout:3/405: write d2/d3/d12/d31/f52 [739482,34717] 0 2024-04-13T10:58:39.586 INFO:tasks.workunit.client.1.smithi194.stdout:3/406: fsync d2/f27 0 2024-04-13T10:58:39.587 INFO:tasks.workunit.client.1.smithi194.stdout:0/351: dwrite d9/db/d19/d28/f29 [0,4194304] 0 2024-04-13T10:58:39.587 INFO:tasks.workunit.client.1.smithi194.stdout:9/371: dread d0/d11/d3d/f3f [0,4194304] 0 2024-04-13T10:58:39.588 INFO:tasks.workunit.client.1.smithi194.stdout:0/352: chown d9/db/f1b 4658946 1 2024-04-13T10:58:39.589 INFO:tasks.workunit.client.1.smithi194.stdout:7/412: write d1/d2b/d4c/d4f/d51/f1c [7521802,61569] 0 2024-04-13T10:58:39.589 INFO:tasks.workunit.client.1.smithi194.stdout:9/372: creat d0/d11/d58/f83 x:0 0 0 2024-04-13T10:58:39.591 INFO:tasks.workunit.client.1.smithi194.stdout:0/353: mknod d9/d6f/c74 0 2024-04-13T10:58:39.592 INFO:tasks.workunit.client.1.smithi194.stdout:9/373: write d0/f37 [933758,114899] 0 2024-04-13T10:58:39.592 INFO:tasks.workunit.client.1.smithi194.stdout:7/413: readlink d1/d2b/d2c/d30/l46 0 2024-04-13T10:58:39.594 INFO:tasks.workunit.client.1.smithi194.stdout:3/407: rename d2/d3/d12/l20 to d2/d3/d12/d31/d34/l7f 0 2024-04-13T10:58:39.595 INFO:tasks.workunit.client.1.smithi194.stdout:9/374: unlink d0/d6/d14/d26/d42/f60 0 2024-04-13T10:58:39.596 INFO:tasks.workunit.client.1.smithi194.stdout:0/354: mkdir d9/df/d16/d75 0 2024-04-13T10:58:39.597 INFO:tasks.workunit.client.1.smithi194.stdout:7/414: truncate d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f6d 859539 0 2024-04-13T10:58:39.597 INFO:tasks.workunit.client.1.smithi194.stdout:0/355: fsync d9/db/f36 0 2024-04-13T10:58:39.597 INFO:tasks.workunit.client.1.smithi194.stdout:9/375: write d0/d11/d3d/f7e [1011386,36097] 0 2024-04-13T10:58:39.597 INFO:tasks.workunit.client.1.smithi194.stdout:3/408: mkdir d2/d3/d1a/d24/d3a/d56/d67/d6d/d80 0 2024-04-13T10:58:39.600 INFO:tasks.workunit.client.1.smithi194.stdout:0/356: write d9/db/d19/d28/f53 [2295211,114334] 0 2024-04-13T10:58:39.600 INFO:tasks.workunit.client.1.smithi194.stdout:7/415: unlink d1/d2b/d4c/f69 0 2024-04-13T10:58:39.602 INFO:tasks.workunit.client.1.smithi194.stdout:0/357: write d9/db/f36 [285756,117536] 0 2024-04-13T10:58:39.603 INFO:tasks.workunit.client.1.smithi194.stdout:9/376: rename d0/d11/f31 to d0/d11/d79/f84 0 2024-04-13T10:58:39.604 INFO:tasks.workunit.client.1.smithi194.stdout:0/358: symlink d9/l76 0 2024-04-13T10:58:39.605 INFO:tasks.workunit.client.1.smithi194.stdout:7/416: fdatasync d1/d2b/d2c/d30/d33/d39/f66 0 2024-04-13T10:58:39.607 INFO:tasks.workunit.client.1.smithi194.stdout:3/409: dwrite d2/d3/f77 [0,4194304] 0 2024-04-13T10:58:39.608 INFO:tasks.workunit.client.1.smithi194.stdout:0/359: mkdir d9/df/d16/d77 0 2024-04-13T10:58:39.609 INFO:tasks.workunit.client.1.smithi194.stdout:7/417: symlink d1/d6c/l8e 0 2024-04-13T10:58:39.611 INFO:tasks.workunit.client.1.smithi194.stdout:3/410: chown d2/d3/d1a/d24/d3a/d56/d78 3 1 2024-04-13T10:58:39.612 INFO:tasks.workunit.client.1.smithi194.stdout:7/418: chown d1/d2b/d4c/d4f/d51/d4d/d5e 12074 1 2024-04-13T10:58:39.613 INFO:tasks.workunit.client.1.smithi194.stdout:9/377: dwrite d0/d6/d2c/d68/f71 [0,4194304] 0 2024-04-13T10:58:39.613 INFO:tasks.workunit.client.1.smithi194.stdout:3/411: readlink d2/d3/d1a/d24/d3a/d56/d67/l6f 0 2024-04-13T10:58:39.614 INFO:tasks.workunit.client.1.smithi194.stdout:7/419: chown d1/d2b/d3e/d54/d6b 9588 1 2024-04-13T10:58:39.615 INFO:tasks.workunit.client.1.smithi194.stdout:3/412: write d2/d3/f3d [672850,100732] 0 2024-04-13T10:58:39.616 INFO:tasks.workunit.client.1.smithi194.stdout:3/413: readlink d2/d3/d1a/d24/d3a/d56/d67/l6f 0 2024-04-13T10:58:39.616 INFO:tasks.workunit.client.1.smithi194.stdout:9/378: read d0/d11/f40 [3315289,61617] 0 2024-04-13T10:58:39.617 INFO:tasks.workunit.client.1.smithi194.stdout:0/360: rename d9/db/d19/d28/f13 to d9/d2b/d5a/f78 0 2024-04-13T10:58:39.623 INFO:tasks.workunit.client.1.smithi194.stdout:9/379: dwrite d0/d6/d2c/d68/f71 [0,4194304] 0 2024-04-13T10:58:39.623 INFO:tasks.workunit.client.1.smithi194.stdout:8/429: sync 2024-04-13T10:58:39.623 INFO:tasks.workunit.client.1.smithi194.stdout:2/438: sync 2024-04-13T10:58:39.624 INFO:tasks.workunit.client.1.smithi194.stdout:9/380: chown d0/d6/l65 759 1 2024-04-13T10:58:39.624 INFO:tasks.workunit.client.1.smithi194.stdout:8/430: fdatasync d6/f1d 0 2024-04-13T10:58:39.626 INFO:tasks.workunit.client.1.smithi194.stdout:3/414: write d2/d3/d12/d31/d34/f37 [7700,33916] 0 2024-04-13T10:58:39.626 INFO:tasks.workunit.client.1.smithi194.stdout:8/431: stat d6/d22/f26 0 2024-04-13T10:58:39.626 INFO:tasks.workunit.client.1.smithi194.stdout:2/439: read - d2/d3/de/d17/d1e/d42/d52/f5c zero size 2024-04-13T10:58:39.628 INFO:tasks.workunit.client.1.smithi194.stdout:2/440: chown d2/d3/de/d17/d36/d8f 39206 1 2024-04-13T10:58:39.628 INFO:tasks.workunit.client.1.smithi194.stdout:7/420: truncate d1/f2e 1656584 0 2024-04-13T10:58:39.629 INFO:tasks.workunit.client.1.smithi194.stdout:2/441: write d2/d3/de/d17/d1e/f62 [1352070,12092] 0 2024-04-13T10:58:39.630 INFO:tasks.workunit.client.1.smithi194.stdout:2/442: truncate d2/f23 4655832 0 2024-04-13T10:58:39.634 INFO:tasks.workunit.client.1.smithi194.stdout:0/361: creat d9/df/d16/d65/f79 x:0 0 0 2024-04-13T10:58:39.634 INFO:tasks.workunit.client.1.smithi194.stdout:3/415: mknod d2/d3/d12/d21/c81 0 2024-04-13T10:58:39.635 INFO:tasks.workunit.client.1.smithi194.stdout:8/432: creat d6/d22/d23/d7f/f91 x:0 0 0 2024-04-13T10:58:39.635 INFO:tasks.workunit.client.1.smithi194.stdout:7/421: fdatasync d1/d2b/d3e/f84 0 2024-04-13T10:58:39.637 INFO:tasks.workunit.client.1.smithi194.stdout:2/443: symlink d2/d3/de/d33/d71/l98 0 2024-04-13T10:58:39.639 INFO:tasks.workunit.client.1.smithi194.stdout:0/362: dread d9/df/f4c [0,4194304] 0 2024-04-13T10:58:39.696 INFO:tasks.workunit.client.1.smithi194.stdout:9/381: creat d0/d6/f85 x:0 0 0 2024-04-13T10:58:39.697 INFO:tasks.workunit.client.1.smithi194.stdout:2/444: creat d2/d3/de/d17/d1e/d42/d52/f99 x:0 0 0 2024-04-13T10:58:39.698 INFO:tasks.workunit.client.1.smithi194.stdout:9/382: readlink d0/d6/d14/l61 0 2024-04-13T10:58:39.699 INFO:tasks.workunit.client.1.smithi194.stdout:2/445: fdatasync d2/d3/d6d/f7c 0 2024-04-13T10:58:39.700 INFO:tasks.workunit.client.1.smithi194.stdout:7/422: dread d1/d2b/d4c/d4f/d51/f1f [0,4194304] 0 2024-04-13T10:58:39.701 INFO:tasks.workunit.client.1.smithi194.stdout:0/363: dwrite d9/df/f3c [4194304,4194304] 0 2024-04-13T10:58:39.702 INFO:tasks.workunit.client.1.smithi194.stdout:0/364: write d9/db/f52 [479173,53528] 0 2024-04-13T10:58:39.704 INFO:tasks.workunit.client.1.smithi194.stdout:3/416: getdents d2/d3/d12/d21 0 2024-04-13T10:58:39.705 INFO:tasks.workunit.client.1.smithi194.stdout:2/446: readlink d2/d3/de/d17/d1e/l4f 0 2024-04-13T10:58:39.705 INFO:tasks.workunit.client.1.smithi194.stdout:9/383: write d0/f4d [854068,81399] 0 2024-04-13T10:58:39.707 INFO:tasks.workunit.client.1.smithi194.stdout:8/433: link d6/c53 d6/d22/d23/d3d/c92 0 2024-04-13T10:58:39.708 INFO:tasks.workunit.client.1.smithi194.stdout:3/417: mkdir d2/d3/d1a/d24/d82 0 2024-04-13T10:58:39.710 INFO:tasks.workunit.client.1.smithi194.stdout:8/434: write d6/d22/d23/d25/d39/d41/f4e [1636202,21682] 0 2024-04-13T10:58:39.710 INFO:tasks.workunit.client.1.smithi194.stdout:7/423: mknod d1/d2b/d3e/d54/d5a/c8f 0 2024-04-13T10:58:39.713 INFO:tasks.workunit.client.1.smithi194.stdout:8/435: symlink d6/dd/d45/l93 0 2024-04-13T10:58:39.714 INFO:tasks.workunit.client.1.smithi194.stdout:9/384: dwrite d0/d11/d58/f5f [0,4194304] 0 2024-04-13T10:58:39.719 INFO:tasks.workunit.client.1.smithi194.stdout:8/436: write d6/d22/d23/d25/d39/d41/d64/f84 [5070125,50635] 0 2024-04-13T10:58:39.721 INFO:tasks.workunit.client.1.smithi194.stdout:9/385: mknod d0/d6/d14/d6d/c86 0 2024-04-13T10:58:39.721 INFO:tasks.workunit.client.1.smithi194.stdout:3/418: link d2/d3/d1a/d24/d3a/d56/d67/l6f d2/d7d/l83 0 2024-04-13T10:58:39.723 INFO:tasks.workunit.client.1.smithi194.stdout:7/424: dwrite d1/d2b/d4c/d4f/d51/f56 [0,4194304] 0 2024-04-13T10:58:39.724 INFO:tasks.workunit.client.1.smithi194.stdout:9/386: read d0/d6/d2c/f47 [10178,89677] 0 2024-04-13T10:58:39.724 INFO:tasks.workunit.client.1.smithi194.stdout:3/419: chown d2/d3/d12/f63 231246272 1 2024-04-13T10:58:39.725 INFO:tasks.workunit.client.1.smithi194.stdout:3/420: chown d2/d3/d1a 4054 1 2024-04-13T10:58:39.726 INFO:tasks.workunit.client.1.smithi194.stdout:7/425: chown d1/d2b/d3e/d54/d5a/d3c/f40 42395490 1 2024-04-13T10:58:39.727 INFO:tasks.workunit.client.1.smithi194.stdout:9/387: creat d0/d11/d3d/d4c/f87 x:0 0 0 2024-04-13T10:58:39.727 INFO:tasks.workunit.client.1.smithi194.stdout:8/437: link d6/c15 d6/d22/d23/d25/d68/c94 0 2024-04-13T10:58:39.729 INFO:tasks.workunit.client.1.smithi194.stdout:7/426: chown d1/d2b/d2c/d30/d33/d39/l3a 19650059 1 2024-04-13T10:58:39.737 INFO:tasks.workunit.client.1.smithi194.stdout:2/447: dread d2/d3/f73 [0,4194304] 0 2024-04-13T10:58:39.737 INFO:tasks.workunit.client.1.smithi194.stdout:3/421: dwrite d2/d3/d1a/d24/f4c [0,4194304] 0 2024-04-13T10:58:39.738 INFO:tasks.workunit.client.1.smithi194.stdout:4/461: sync 2024-04-13T10:58:39.739 INFO:tasks.workunit.client.1.smithi194.stdout:7/427: dread d1/d2b/d3e/d54/d5a/d3c/f42 [0,4194304] 0 2024-04-13T10:58:39.740 INFO:tasks.workunit.client.1.smithi194.stdout:8/438: dwrite d6/dd/f19 [4194304,4194304] 0 2024-04-13T10:58:39.742 INFO:tasks.workunit.client.1.smithi194.stdout:3/422: creat d2/d3/d12/d31/f84 x:0 0 0 2024-04-13T10:58:39.743 INFO:tasks.workunit.client.1.smithi194.stdout:4/462: creat d2/d33/d8f/f95 x:0 0 0 2024-04-13T10:58:39.745 INFO:tasks.workunit.client.1.smithi194.stdout:8/439: creat d6/d22/d23/d25/d39/f95 x:0 0 0 2024-04-13T10:58:39.747 INFO:tasks.workunit.client.1.smithi194.stdout:9/388: dread d0/d6/d4a/f6e [0,4194304] 0 2024-04-13T10:58:39.748 INFO:tasks.workunit.client.1.smithi194.stdout:4/463: creat d2/d16/d70/d31/f96 x:0 0 0 2024-04-13T10:58:39.754 INFO:tasks.workunit.client.1.smithi194.stdout:3/423: getdents d2/d3/d1a 0 2024-04-13T10:58:39.754 INFO:tasks.workunit.client.1.smithi194.stdout:4/464: symlink d2/d16/d1a/d1c/d3b/l97 0 2024-04-13T10:58:39.756 INFO:tasks.workunit.client.1.smithi194.stdout:9/389: dwrite d0/d6/d2c/f69 [0,4194304] 0 2024-04-13T10:58:39.760 INFO:tasks.workunit.client.1.smithi194.stdout:3/424: mknod d2/d3/d12/d31/c85 0 2024-04-13T10:58:39.763 INFO:tasks.workunit.client.1.smithi194.stdout:3/425: write d2/d3/d12/d31/f4f [190348,109421] 0 2024-04-13T10:58:39.765 INFO:tasks.workunit.client.1.smithi194.stdout:9/390: dread d0/f37 [0,4194304] 0 2024-04-13T10:58:39.766 INFO:tasks.workunit.client.1.smithi194.stdout:4/465: rename d2/d33/d8f to d2/d16/d1a/d1c/d54/d5d/d98 0 2024-04-13T10:58:39.769 INFO:tasks.workunit.client.1.smithi194.stdout:3/426: rename d2/f5 to d2/d3/f86 0 2024-04-13T10:58:39.770 INFO:tasks.workunit.client.1.smithi194.stdout:4/466: unlink d2/d16/d1a/c34 0 2024-04-13T10:58:39.771 INFO:tasks.workunit.client.1.smithi194.stdout:4/467: fdatasync d2/d16/d1a/f35 0 2024-04-13T10:58:39.775 INFO:tasks.workunit.client.1.smithi194.stdout:4/468: mkdir d2/d16/d1a/d1c/d54/d62/d6e/d99 0 2024-04-13T10:58:39.779 INFO:tasks.workunit.client.1.smithi194.stdout:2/448: dread d2/d3/de/d17/d36/d7a/f7d [0,4194304] 0 2024-04-13T10:58:39.779 INFO:tasks.workunit.client.1.smithi194.stdout:9/391: truncate d0/d11/f1d 424133 0 2024-04-13T10:58:39.780 INFO:tasks.workunit.client.1.smithi194.stdout:9/392: read d0/f37 [317898,124913] 0 2024-04-13T10:58:39.780 INFO:tasks.workunit.client.1.smithi194.stdout:7/428: dread d1/f12 [0,4194304] 0 2024-04-13T10:58:39.782 INFO:tasks.workunit.client.1.smithi194.stdout:7/429: readlink d1/d2b/d4c/l52 0 2024-04-13T10:58:39.782 INFO:tasks.workunit.client.1.smithi194.stdout:7/430: stat d1/d2b/d3e/d54/d6b/c79 0 2024-04-13T10:58:39.783 INFO:tasks.workunit.client.1.smithi194.stdout:7/431: write d1/d2b/d4c/d4f/f5c [849860,77802] 0 2024-04-13T10:58:39.784 INFO:tasks.workunit.client.1.smithi194.stdout:9/393: mkdir d0/d88 0 2024-04-13T10:58:39.785 INFO:tasks.workunit.client.1.smithi194.stdout:9/394: dread d0/d11/f3c [0,4194304] 0 2024-04-13T10:58:39.786 INFO:tasks.workunit.client.1.smithi194.stdout:2/449: getdents d2/d3/de/d33/d71 0 2024-04-13T10:58:39.789 INFO:tasks.workunit.client.1.smithi194.stdout:9/395: unlink d0/d6/f13 0 2024-04-13T10:58:39.792 INFO:tasks.workunit.client.1.smithi194.stdout:2/450: rename d2/d3/de/d17/d36/d8f/d57/l8a to d2/d3/de/d17/d36/d65/l9a 0 2024-04-13T10:58:39.792 INFO:tasks.workunit.client.1.smithi194.stdout:7/432: link d1/d2b/d4c/d4f/d6e/c74 d1/d2b/d3e/d54/c90 0 2024-04-13T10:58:39.793 INFO:tasks.workunit.client.1.smithi194.stdout:2/451: fdatasync d2/d3/de/d33/d71/f75 0 2024-04-13T10:58:39.794 INFO:tasks.workunit.client.1.smithi194.stdout:9/396: getdents d0/d6/d4a/d74 0 2024-04-13T10:58:39.796 INFO:tasks.workunit.client.1.smithi194.stdout:7/433: mknod d1/d2b/d4c/d4f/d85/d88/c91 0 2024-04-13T10:58:39.798 INFO:tasks.workunit.client.1.smithi194.stdout:2/452: rename d2/d3/de/d17/c55 to d2/c9b 0 2024-04-13T10:58:39.800 INFO:tasks.workunit.client.1.smithi194.stdout:2/453: chown d2/d3/de/d33/d71/f75 48012 1 2024-04-13T10:58:39.800 INFO:tasks.workunit.client.1.smithi194.stdout:9/397: dwrite d0/d6/d14/d26/f2f [0,4194304] 0 2024-04-13T10:58:39.802 INFO:tasks.workunit.client.1.smithi194.stdout:2/454: write d2/d3/de/d17/d1e/d42/d52/f93 [602578,60800] 0 2024-04-13T10:58:39.803 INFO:tasks.workunit.client.1.smithi194.stdout:2/455: fsync d2/d3/d6d/f7c 0 2024-04-13T10:58:39.811 INFO:tasks.workunit.client.1.smithi194.stdout:7/434: rename d1/d2b/d2c/c50 to d1/d2b/d3e/d54/d5a/c92 0 2024-04-13T10:58:39.812 INFO:tasks.workunit.client.1.smithi194.stdout:7/435: fdatasync d1/d2b/d3e/d54/f72 0 2024-04-13T10:58:39.813 INFO:tasks.workunit.client.1.smithi194.stdout:7/436: read - d1/d6c/f83 zero size 2024-04-13T10:58:39.818 INFO:tasks.workunit.client.1.smithi194.stdout:2/456: rename d2/d3/de/d17/d1e/d42/d52/l6b to d2/d3/de/d90/l9c 0 2024-04-13T10:58:39.819 INFO:tasks.workunit.client.1.smithi194.stdout:7/437: dwrite d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f6d [0,4194304] 0 2024-04-13T10:58:39.821 INFO:tasks.workunit.client.1.smithi194.stdout:7/438: write d1/d2b/d2c/d30/d33/d39/f3d [354797,41918] 0 2024-04-13T10:58:39.822 INFO:tasks.workunit.client.1.smithi194.stdout:7/439: write d1/d2b/d2c/f68 [1093848,63956] 0 2024-04-13T10:58:39.823 INFO:tasks.workunit.client.1.smithi194.stdout:9/398: getdents d0/d11/d58 0 2024-04-13T10:58:39.837 INFO:tasks.workunit.client.1.smithi194.stdout:7/440: dwrite d1/d2b/f47 [0,4194304] 0 2024-04-13T10:58:39.840 INFO:tasks.workunit.client.1.smithi194.stdout:7/441: chown d1/d2b/d2c/d30/d33/d39/c73 436384 1 2024-04-13T10:58:39.842 INFO:tasks.workunit.client.1.smithi194.stdout:9/399: dwrite d0/d11/f40 [0,4194304] 0 2024-04-13T10:58:39.844 INFO:tasks.workunit.client.1.smithi194.stdout:2/457: dwrite d2/d3/de/d17/d36/d8f/f4c [0,4194304] 0 2024-04-13T10:58:39.845 INFO:tasks.workunit.client.1.smithi194.stdout:7/442: creat d1/d8b/f93 x:0 0 0 2024-04-13T10:58:39.847 INFO:tasks.workunit.client.1.smithi194.stdout:2/458: dread - d2/d3/de/d17/d1e/d42/d52/f99 zero size 2024-04-13T10:58:39.848 INFO:tasks.workunit.client.1.smithi194.stdout:9/400: rmdir d0/d6/d14/d6d 39 2024-04-13T10:58:39.854 INFO:tasks.workunit.client.1.smithi194.stdout:9/401: creat d0/d11/d3d/f89 x:0 0 0 2024-04-13T10:58:39.857 INFO:tasks.workunit.client.1.smithi194.stdout:5/388: sync 2024-04-13T10:58:39.857 INFO:tasks.workunit.client.1.smithi194.stdout:6/394: sync 2024-04-13T10:58:39.857 INFO:tasks.workunit.client.1.smithi194.stdout:1/395: sync 2024-04-13T10:58:39.858 INFO:tasks.workunit.client.1.smithi194.stdout:9/402: symlink d0/d11/d79/l8a 0 2024-04-13T10:58:39.859 INFO:tasks.workunit.client.1.smithi194.stdout:7/443: dwrite d1/f29 [0,4194304] 0 2024-04-13T10:58:39.862 INFO:tasks.workunit.client.1.smithi194.stdout:6/395: mkdir d0/d2c/d77 0 2024-04-13T10:58:39.864 INFO:tasks.workunit.client.1.smithi194.stdout:1/396: creat d12/d13/d44/f85 x:0 0 0 2024-04-13T10:58:39.864 INFO:tasks.workunit.client.1.smithi194.stdout:2/459: dwrite d2/d3/de/d17/d1e/d42/d52/f5e [0,4194304] 0 2024-04-13T10:58:39.867 INFO:tasks.workunit.client.1.smithi194.stdout:9/403: rmdir d0/d11/d3d/d4c 39 2024-04-13T10:58:39.867 INFO:tasks.workunit.client.1.smithi194.stdout:2/460: write d2/d3/de/d17/d36/d8f/f4b [599827,11601] 0 2024-04-13T10:58:39.869 INFO:tasks.workunit.client.1.smithi194.stdout:6/396: mkdir d0/d53/d78 0 2024-04-13T10:58:39.870 INFO:tasks.workunit.client.1.smithi194.stdout:6/397: write d0/d26/f29 [5883449,43818] 0 2024-04-13T10:58:39.871 INFO:tasks.workunit.client.1.smithi194.stdout:6/398: write d0/d57/d69/f5f [556884,123854] 0 2024-04-13T10:58:39.875 INFO:tasks.workunit.client.1.smithi194.stdout:1/397: creat d12/d13/d1c/d27/f86 x:0 0 0 2024-04-13T10:58:39.881 INFO:tasks.workunit.client.1.smithi194.stdout:7/444: mknod d1/d2b/d2c/c94 0 2024-04-13T10:58:39.881 INFO:tasks.workunit.client.1.smithi194.stdout:5/389: write d3/dc/d10/f3c [744812,81641] 0 2024-04-13T10:58:39.882 INFO:tasks.workunit.client.1.smithi194.stdout:6/399: symlink d0/d2c/l79 0 2024-04-13T10:58:39.883 INFO:tasks.workunit.client.1.smithi194.stdout:6/400: readlink d0/d57/d69/l50 0 2024-04-13T10:58:39.886 INFO:tasks.workunit.client.1.smithi194.stdout:2/461: dread d2/d3/de/d3c/f76 [0,4194304] 0 2024-04-13T10:58:39.887 INFO:tasks.workunit.client.1.smithi194.stdout:7/445: dread d1/d2b/d4c/d4f/d51/f1f [0,4194304] 0 2024-04-13T10:58:39.891 INFO:tasks.workunit.client.1.smithi194.stdout:9/404: rename d0/d11/d3d/d4c/f87 to d0/d6/d14/d26/d7f/f8b 0 2024-04-13T10:58:39.891 INFO:tasks.workunit.client.1.smithi194.stdout:7/446: truncate d1/d2b/d3e/f84 952420 0 2024-04-13T10:58:39.891 INFO:tasks.workunit.client.1.smithi194.stdout:5/390: dwrite d3/dc/f2c [0,4194304] 0 2024-04-13T10:58:39.894 INFO:tasks.workunit.client.1.smithi194.stdout:7/447: write d1/d8b/f93 [125194,112377] 0 2024-04-13T10:58:39.901 INFO:tasks.workunit.client.1.smithi194.stdout:5/391: read d3/dc/d10/d38/f44 [1094481,24096] 0 2024-04-13T10:58:39.903 INFO:tasks.workunit.client.1.smithi194.stdout:7/448: creat d1/f95 x:0 0 0 2024-04-13T10:58:39.904 INFO:tasks.workunit.client.1.smithi194.stdout:2/462: dwrite d2/d3/de/d33/d47/f85 [0,4194304] 0 2024-04-13T10:58:39.907 INFO:tasks.workunit.client.1.smithi194.stdout:9/405: dwrite d0/d11/d1e/f21 [0,4194304] 0 2024-04-13T10:58:39.907 INFO:tasks.workunit.client.1.smithi194.stdout:5/392: creat d3/dc/d10/d38/f76 x:0 0 0 2024-04-13T10:58:39.910 INFO:tasks.workunit.client.1.smithi194.stdout:1/398: dread d12/d13/d1c/d28/f58 [0,4194304] 0 2024-04-13T10:58:39.912 INFO:tasks.workunit.client.1.smithi194.stdout:6/401: dread d0/d26/d2b/f3c [0,4194304] 0 2024-04-13T10:58:39.912 INFO:tasks.workunit.client.1.smithi194.stdout:2/463: creat d2/d3/de/d17/d36/f9d x:0 0 0 2024-04-13T10:58:39.912 INFO:tasks.workunit.client.1.smithi194.stdout:5/393: chown d3/dc/d10/l2a 150 1 2024-04-13T10:58:39.914 INFO:tasks.workunit.client.1.smithi194.stdout:9/406: creat d0/d6/d4a/d74/f8c x:0 0 0 2024-04-13T10:58:39.914 INFO:tasks.workunit.client.1.smithi194.stdout:5/394: dread - d3/dc/d10/d38/f5b zero size 2024-04-13T10:58:39.915 INFO:tasks.workunit.client.1.smithi194.stdout:9/407: fdatasync d0/d6/d2c/f36 0 2024-04-13T10:58:39.917 INFO:tasks.workunit.client.1.smithi194.stdout:1/399: unlink d12/d13/d1c/d27/d4c/f73 0 2024-04-13T10:58:39.918 INFO:tasks.workunit.client.1.smithi194.stdout:7/449: dwrite d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f6d [0,4194304] 0 2024-04-13T10:58:39.918 INFO:tasks.workunit.client.1.smithi194.stdout:6/402: creat d0/d26/d2b/f7a x:0 0 0 2024-04-13T10:58:39.920 INFO:tasks.workunit.client.1.smithi194.stdout:6/403: write d0/d57/d69/f5f [1538445,92899] 0 2024-04-13T10:58:39.923 INFO:tasks.workunit.client.1.smithi194.stdout:9/408: rmdir d0/d6/d14/d26 39 2024-04-13T10:58:39.923 INFO:tasks.workunit.client.1.smithi194.stdout:7/450: dread d1/d2b/d2c/f68 [0,4194304] 0 2024-04-13T10:58:39.924 INFO:tasks.workunit.client.1.smithi194.stdout:6/404: mkdir d0/d42/d7b 0 2024-04-13T10:58:39.928 INFO:tasks.workunit.client.1.smithi194.stdout:5/395: getdents d3/dc/d10/d38/d59 0 2024-04-13T10:58:39.928 INFO:tasks.workunit.client.1.smithi194.stdout:7/451: mkdir d1/d2b/d3e/d54/d5a/d80/d96 0 2024-04-13T10:58:39.930 INFO:tasks.workunit.client.1.smithi194.stdout:9/409: truncate d0/d6/d14/d26/f3e 706699 0 2024-04-13T10:58:39.931 INFO:tasks.workunit.client.1.smithi194.stdout:7/452: truncate d1/d6c/f83 30127 0 2024-04-13T10:58:39.932 INFO:tasks.workunit.client.1.smithi194.stdout:6/405: dwrite d0/d26/d2b/f7a [0,4194304] 0 2024-04-13T10:58:39.933 INFO:tasks.workunit.client.1.smithi194.stdout:9/410: unlink d0/d6/d14/f27 0 2024-04-13T10:58:39.934 INFO:tasks.workunit.client.1.smithi194.stdout:6/406: dread - d0/d26/d2b/f76 zero size 2024-04-13T10:58:39.936 INFO:tasks.workunit.client.1.smithi194.stdout:7/453: mknod d1/d2b/d4c/d4f/d6e/c97 0 2024-04-13T10:58:39.936 INFO:tasks.workunit.client.1.smithi194.stdout:6/407: rmdir d0/d2f/d48 39 2024-04-13T10:58:39.937 INFO:tasks.workunit.client.1.smithi194.stdout:6/408: rename d0/d26 to d0/d26/d4b/d7c 22 2024-04-13T10:58:39.938 INFO:tasks.workunit.client.1.smithi194.stdout:6/409: fdatasync d0/d2c/f31 0 2024-04-13T10:58:39.939 INFO:tasks.workunit.client.1.smithi194.stdout:7/454: symlink d1/d2b/d4c/d4f/d6e/l98 0 2024-04-13T10:58:39.941 INFO:tasks.workunit.client.1.smithi194.stdout:5/396: rename d3/dc/d17/c3d to d3/dc/d17/c77 0 2024-04-13T10:58:39.942 INFO:tasks.workunit.client.1.smithi194.stdout:6/410: read d0/d57/d69/f64 [1150425,128763] 0 2024-04-13T10:58:39.943 INFO:tasks.workunit.client.1.smithi194.stdout:7/455: symlink d1/d2b/d4c/l99 0 2024-04-13T10:58:39.947 INFO:tasks.workunit.client.1.smithi194.stdout:6/411: link d0/f73 d0/d42/f7d 0 2024-04-13T10:58:39.950 INFO:tasks.workunit.client.1.smithi194.stdout:5/397: link d3/l2b d3/d29/l78 0 2024-04-13T10:58:39.954 INFO:tasks.workunit.client.1.smithi194.stdout:6/412: dwrite d0/d2c/f41 [0,4194304] 0 2024-04-13T10:58:39.954 INFO:tasks.workunit.client.1.smithi194.stdout:5/398: getdents d3/dc/d10/d38/d59 0 2024-04-13T10:58:39.958 INFO:tasks.workunit.client.1.smithi194.stdout:5/399: symlink d3/dc/d10/d20/l79 0 2024-04-13T10:58:39.959 INFO:tasks.workunit.client.1.smithi194.stdout:6/413: rename d0/d57/d69/l50 to d0/d57/l7e 0 2024-04-13T10:58:39.960 INFO:tasks.workunit.client.1.smithi194.stdout:7/456: dwrite d1/d2b/d3e/d54/d5a/d80/f8c [0,4194304] 0 2024-04-13T10:58:39.962 INFO:tasks.workunit.client.1.smithi194.stdout:7/457: dread - d1/d2b/d4c/d4f/d6e/f76 zero size 2024-04-13T10:58:39.963 INFO:tasks.workunit.client.1.smithi194.stdout:7/458: chown d1/d2b/d4c/d4f/d51/l35 0 1 2024-04-13T10:58:39.963 INFO:tasks.workunit.client.1.smithi194.stdout:5/400: truncate d3/dc/d10/d38/d46/f53 37402 0 2024-04-13T10:58:39.966 INFO:tasks.workunit.client.1.smithi194.stdout:7/459: truncate d1/d2b/d4c/d4f/d6e/f76 445399 0 2024-04-13T10:58:39.966 INFO:tasks.workunit.client.1.smithi194.stdout:6/414: truncate d0/d26/f4e 270844 0 2024-04-13T10:58:39.968 INFO:tasks.workunit.client.1.smithi194.stdout:9/411: dread d0/d6/d2c/f36 [0,4194304] 0 2024-04-13T10:58:39.969 INFO:tasks.workunit.client.1.smithi194.stdout:6/415: mkdir d0/d2c/d77/d7f 0 2024-04-13T10:58:39.971 INFO:tasks.workunit.client.1.smithi194.stdout:9/412: write d0/d6/d14/d26/f34 [1217930,3689] 0 2024-04-13T10:58:39.977 INFO:tasks.workunit.client.1.smithi194.stdout:6/416: dread d0/d26/d2b/f47 [0,4194304] 0 2024-04-13T10:58:39.978 INFO:tasks.workunit.client.1.smithi194.stdout:5/401: dread d3/dc/d10/d20/f43 [0,4194304] 0 2024-04-13T10:58:39.981 INFO:tasks.workunit.client.1.smithi194.stdout:5/402: mkdir d3/dc/d10/d38/d59/d7a 0 2024-04-13T10:58:39.984 INFO:tasks.workunit.client.1.smithi194.stdout:6/417: dwrite d0/d26/d2b/f76 [0,4194304] 0 2024-04-13T10:58:39.987 INFO:tasks.workunit.client.1.smithi194.stdout:6/418: rmdir d0/d42 39 2024-04-13T10:58:39.989 INFO:tasks.workunit.client.1.smithi194.stdout:7/460: dread d1/f24 [0,4194304] 0 2024-04-13T10:58:39.996 INFO:tasks.workunit.client.1.smithi194.stdout:0/365: sync 2024-04-13T10:58:39.997 INFO:tasks.workunit.client.1.smithi194.stdout:7/461: getdents d1 0 2024-04-13T10:58:40.002 INFO:tasks.workunit.client.1.smithi194.stdout:5/403: dread d3/dc/d10/f2e [0,4194304] 0 2024-04-13T10:58:40.006 INFO:tasks.workunit.client.1.smithi194.stdout:6/419: dwrite d0/f73 [0,4194304] 0 2024-04-13T10:58:40.009 INFO:tasks.workunit.client.1.smithi194.stdout:6/420: unlink d0/d26/l24 0 2024-04-13T10:58:40.011 INFO:tasks.workunit.client.1.smithi194.stdout:0/366: dwrite d9/db/d3a/f58 [0,4194304] 0 2024-04-13T10:58:40.015 INFO:tasks.workunit.client.1.smithi194.stdout:5/404: dwrite d3/dc/d2d/f36 [0,4194304] 0 2024-04-13T10:58:40.017 INFO:tasks.workunit.client.1.smithi194.stdout:7/462: dread d1/d2b/d3e/d54/d5a/d3c/f40 [0,4194304] 0 2024-04-13T10:58:40.019 INFO:tasks.workunit.client.1.smithi194.stdout:6/421: mkdir d0/d26/d2b/d4d/d80 0 2024-04-13T10:58:40.020 INFO:tasks.workunit.client.1.smithi194.stdout:7/463: mknod d1/d2b/d3e/d54/d6b/c9a 0 2024-04-13T10:58:40.023 INFO:tasks.workunit.client.1.smithi194.stdout:5/405: rename d3/dc/d10/l4e to d3/d29/l7b 0 2024-04-13T10:58:40.026 INFO:tasks.workunit.client.1.smithi194.stdout:5/406: creat d3/dc/d10/f7c x:0 0 0 2024-04-13T10:58:40.026 INFO:tasks.workunit.client.1.smithi194.stdout:0/367: link d9/db/d19/d28/f6e d9/df/d16/d65/f7a 0 2024-04-13T10:58:40.027 INFO:tasks.workunit.client.1.smithi194.stdout:0/368: chown d9/df/d16/c71 2626875 1 2024-04-13T10:58:40.028 INFO:tasks.workunit.client.1.smithi194.stdout:0/369: write d9/db/f3d [529726,63403] 0 2024-04-13T10:58:40.028 INFO:tasks.workunit.client.1.smithi194.stdout:5/407: creat d3/dc/f7d x:0 0 0 2024-04-13T10:58:40.030 INFO:tasks.workunit.client.1.smithi194.stdout:5/408: truncate d3/dc/d10/f61 86073 0 2024-04-13T10:58:40.031 INFO:tasks.workunit.client.1.smithi194.stdout:0/370: dread d9/db/f6a [0,4194304] 0 2024-04-13T10:58:40.031 INFO:tasks.workunit.client.1.smithi194.stdout:5/409: fsync d3/dc/d10/f2e 0 2024-04-13T10:58:40.032 INFO:tasks.workunit.client.1.smithi194.stdout:6/422: write d0/d2c/f3e [413694,9279] 0 2024-04-13T10:58:40.110 INFO:tasks.workunit.client.1.smithi194.stdout:5/410: stat d3/dc/d2d/l73 0 2024-04-13T10:58:40.111 INFO:tasks.workunit.client.1.smithi194.stdout:0/371: chown d9/df/c68 108253009 1 2024-04-13T10:58:40.112 INFO:tasks.workunit.client.1.smithi194.stdout:6/423: creat d0/d53/f81 x:0 0 0 2024-04-13T10:58:40.113 INFO:tasks.workunit.client.1.smithi194.stdout:5/411: symlink d3/dc/d10/l7e 0 2024-04-13T10:58:40.114 INFO:tasks.workunit.client.1.smithi194.stdout:6/424: fsync d0/d57/d69/f64 0 2024-04-13T10:58:40.116 INFO:tasks.workunit.client.1.smithi194.stdout:0/372: mknod d9/d2b/c7b 0 2024-04-13T10:58:40.118 INFO:tasks.workunit.client.1.smithi194.stdout:5/412: symlink d3/dc/d10/d20/l7f 0 2024-04-13T10:58:40.118 INFO:tasks.workunit.client.1.smithi194.stdout:5/413: chown d3/d29 1006509403 1 2024-04-13T10:58:40.119 INFO:tasks.workunit.client.1.smithi194.stdout:5/414: read - d3/dc/d10/f7c zero size 2024-04-13T10:58:40.122 INFO:tasks.workunit.client.1.smithi194.stdout:6/425: mknod d0/d42/d7b/c82 0 2024-04-13T10:58:40.122 INFO:tasks.workunit.client.1.smithi194.stdout:5/415: rmdir d3/dc/d10/d20/d23 39 2024-04-13T10:58:40.124 INFO:tasks.workunit.client.1.smithi194.stdout:5/416: creat d3/dc/d10/d38/d46/f80 x:0 0 0 2024-04-13T10:58:40.125 INFO:tasks.workunit.client.1.smithi194.stdout:6/426: mkdir d0/d2f/d48/d83 0 2024-04-13T10:58:40.126 INFO:tasks.workunit.client.1.smithi194.stdout:6/427: stat d0/d26/f23 0 2024-04-13T10:58:40.126 INFO:tasks.workunit.client.1.smithi194.stdout:5/417: chown d3/dc/d10/d20/l50 8 1 2024-04-13T10:58:40.128 INFO:tasks.workunit.client.1.smithi194.stdout:6/428: mkdir d0/d57/d84 0 2024-04-13T10:58:40.129 INFO:tasks.workunit.client.1.smithi194.stdout:0/373: write d9/db/d19/d28/f6e [476214,119307] 0 2024-04-13T10:58:40.130 INFO:tasks.workunit.client.1.smithi194.stdout:6/429: symlink d0/d53/d78/l85 0 2024-04-13T10:58:40.133 INFO:tasks.workunit.client.1.smithi194.stdout:6/430: dread d0/d26/d2b/f58 [0,4194304] 0 2024-04-13T10:58:40.137 INFO:tasks.workunit.client.1.smithi194.stdout:6/431: write d0/d26/d2b/f47 [2078573,79132] 0 2024-04-13T10:58:40.138 INFO:tasks.workunit.client.1.smithi194.stdout:5/418: write d3/dc/d10/d38/f60 [1804922,18142] 0 2024-04-13T10:58:40.138 INFO:tasks.workunit.client.1.smithi194.stdout:5/419: fdatasync d3/dc/d10/f2e 0 2024-04-13T10:58:40.140 INFO:tasks.workunit.client.1.smithi194.stdout:0/374: dwrite d9/db/f6a [0,4194304] 0 2024-04-13T10:58:40.141 INFO:tasks.workunit.client.1.smithi194.stdout:8/440: sync 2024-04-13T10:58:40.141 INFO:tasks.workunit.client.1.smithi194.stdout:3/427: sync 2024-04-13T10:58:40.141 INFO:tasks.workunit.client.1.smithi194.stdout:5/420: getdents d3/dc/d17/d1b/d6b 0 2024-04-13T10:58:40.143 INFO:tasks.workunit.client.1.smithi194.stdout:5/421: read - d3/dc/d10/f7c zero size 2024-04-13T10:58:40.143 INFO:tasks.workunit.client.1.smithi194.stdout:6/432: truncate d0/d26/d2b/f47 1236415 0 2024-04-13T10:58:40.145 INFO:tasks.workunit.client.1.smithi194.stdout:6/433: fdatasync d0/d2c/f32 0 2024-04-13T10:58:40.145 INFO:tasks.workunit.client.1.smithi194.stdout:3/428: creat d2/d3/d1a/d24/d3a/d56/d67/d61/f87 x:0 0 0 2024-04-13T10:58:40.145 INFO:tasks.workunit.client.1.smithi194.stdout:5/422: dread - d3/dc/d10/d38/f5b zero size 2024-04-13T10:58:40.149 INFO:tasks.workunit.client.1.smithi194.stdout:6/434: symlink d0/d2f/l86 0 2024-04-13T10:58:40.151 INFO:tasks.workunit.client.1.smithi194.stdout:0/375: dwrite d9/db/d19/d28/f17 [0,4194304] 0 2024-04-13T10:58:40.151 INFO:tasks.workunit.client.1.smithi194.stdout:5/423: symlink d3/dc/d10/d38/d59/d7a/l81 0 2024-04-13T10:58:40.155 INFO:tasks.workunit.client.1.smithi194.stdout:6/435: chown d0/d26/d2b/f76 7098317 1 2024-04-13T10:58:40.158 INFO:tasks.workunit.client.1.smithi194.stdout:0/376: mknod d9/d6f/c7c 0 2024-04-13T10:58:40.159 INFO:tasks.workunit.client.1.smithi194.stdout:8/441: dwrite d6/d22/d23/d25/d39/d41/d5b/d76/f56 [0,4194304] 0 2024-04-13T10:58:40.159 INFO:tasks.workunit.client.1.smithi194.stdout:3/429: rename d2/d3/d1a to d2/d3/d12/d31/d34/d88 0 2024-04-13T10:58:40.161 INFO:tasks.workunit.client.1.smithi194.stdout:6/436: creat d0/d2f/d48/f87 x:0 0 0 2024-04-13T10:58:40.163 INFO:tasks.workunit.client.1.smithi194.stdout:6/437: chown d0/d57/d69/f5f 176672886 1 2024-04-13T10:58:40.165 INFO:tasks.workunit.client.1.smithi194.stdout:3/430: truncate d2/d3/d12/d31/f4e 729098 0 2024-04-13T10:58:40.166 INFO:tasks.workunit.client.1.smithi194.stdout:0/377: getdents d9/df/d16/d70 0 2024-04-13T10:58:40.167 INFO:tasks.workunit.client.1.smithi194.stdout:5/424: getdents d3/dc/d17/d1b 0 2024-04-13T10:58:40.169 INFO:tasks.workunit.client.1.smithi194.stdout:8/442: dwrite d6/dd/d45/f51 [0,4194304] 0 2024-04-13T10:58:40.169 INFO:tasks.workunit.client.1.smithi194.stdout:5/425: dread - d3/dc/d17/f63 zero size 2024-04-13T10:58:40.170 INFO:tasks.workunit.client.1.smithi194.stdout:0/378: symlink d9/db/d3a/l7d 0 2024-04-13T10:58:40.171 INFO:tasks.workunit.client.1.smithi194.stdout:5/426: fsync d3/d29/f34 0 2024-04-13T10:58:40.172 INFO:tasks.workunit.client.1.smithi194.stdout:3/431: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/c89 0 2024-04-13T10:58:40.174 INFO:tasks.workunit.client.1.smithi194.stdout:8/443: mknod d6/d22/d23/d25/c96 0 2024-04-13T10:58:40.175 INFO:tasks.workunit.client.1.smithi194.stdout:0/379: mknod d9/df/d16/d70/c7e 0 2024-04-13T10:58:40.178 INFO:tasks.workunit.client.1.smithi194.stdout:6/438: truncate d0/d42/f46 5764596 0 2024-04-13T10:58:40.179 INFO:tasks.workunit.client.1.smithi194.stdout:0/380: fdatasync d9/db/f15 0 2024-04-13T10:58:40.180 INFO:tasks.workunit.client.1.smithi194.stdout:5/427: dwrite d3/dc/d10/d38/d46/f80 [0,4194304] 0 2024-04-13T10:58:40.180 INFO:tasks.workunit.client.1.smithi194.stdout:6/439: write d0/f66 [377476,42165] 0 2024-04-13T10:58:40.185 INFO:tasks.workunit.client.1.smithi194.stdout:0/381: unlink d9/db/d19/d28/f18 0 2024-04-13T10:58:40.191 INFO:tasks.workunit.client.1.smithi194.stdout:6/440: creat d0/d42/d7b/f88 x:0 0 0 2024-04-13T10:58:40.191 INFO:tasks.workunit.client.1.smithi194.stdout:8/444: link d6/d2a/d69/l72 d6/d22/d23/d25/l97 0 2024-04-13T10:58:40.191 INFO:tasks.workunit.client.1.smithi194.stdout:6/441: dread - d0/d26/f5c zero size 2024-04-13T10:58:40.192 INFO:tasks.workunit.client.1.smithi194.stdout:6/442: write d0/d26/f29 [726476,22492] 0 2024-04-13T10:58:40.194 INFO:tasks.workunit.client.1.smithi194.stdout:0/382: link d9/db/d19/d28/l44 d9/d2b/d6c/l7f 0 2024-04-13T10:58:40.198 INFO:tasks.workunit.client.1.smithi194.stdout:8/445: dwrite d6/d2a/f34 [0,4194304] 0 2024-04-13T10:58:40.198 INFO:tasks.workunit.client.1.smithi194.stdout:5/428: write d3/dc/d10/f61 [1069917,66157] 0 2024-04-13T10:58:40.200 INFO:tasks.workunit.client.1.smithi194.stdout:0/383: creat d9/df/d63/f80 x:0 0 0 2024-04-13T10:58:40.207 INFO:tasks.workunit.client.1.smithi194.stdout:8/446: rename d6/dd/d45/f51 to d6/dd/f98 0 2024-04-13T10:58:40.208 INFO:tasks.workunit.client.1.smithi194.stdout:8/447: dread - d6/d22/d23/d7f/f91 zero size 2024-04-13T10:58:40.209 INFO:tasks.workunit.client.1.smithi194.stdout:0/384: creat d9/d6f/f81 x:0 0 0 2024-04-13T10:58:40.211 INFO:tasks.workunit.client.1.smithi194.stdout:5/429: dread d3/dc/f2c [0,4194304] 0 2024-04-13T10:58:40.211 INFO:tasks.workunit.client.1.smithi194.stdout:3/432: dread d2/de/f1e [0,4194304] 0 2024-04-13T10:58:40.212 INFO:tasks.workunit.client.1.smithi194.stdout:0/385: symlink d9/db/d19/d28/l82 0 2024-04-13T10:58:40.216 INFO:tasks.workunit.client.1.smithi194.stdout:8/448: dwrite d6/d2a/f57 [0,4194304] 0 2024-04-13T10:58:40.217 INFO:tasks.workunit.client.1.smithi194.stdout:5/430: dread d3/dc/f18 [0,4194304] 0 2024-04-13T10:58:40.218 INFO:tasks.workunit.client.1.smithi194.stdout:5/431: stat d3/dc/d10/d38/f76 0 2024-04-13T10:58:40.218 INFO:tasks.workunit.client.1.smithi194.stdout:0/386: getdents d9/db/d3a 0 2024-04-13T10:58:40.219 INFO:tasks.workunit.client.1.smithi194.stdout:8/449: fdatasync d6/d22/d23/d25/d39/d41/d5b/d76/f56 0 2024-04-13T10:58:40.220 INFO:tasks.workunit.client.1.smithi194.stdout:3/433: truncate d2/fd 758049 0 2024-04-13T10:58:40.221 INFO:tasks.workunit.client.1.smithi194.stdout:3/434: write d2/f30 [256679,23216] 0 2024-04-13T10:58:40.225 INFO:tasks.workunit.client.1.smithi194.stdout:0/387: mkdir d9/df/d16/d83 0 2024-04-13T10:58:40.225 INFO:tasks.workunit.client.1.smithi194.stdout:8/450: symlink d6/dd/l99 0 2024-04-13T10:58:40.226 INFO:tasks.workunit.client.1.smithi194.stdout:0/388: fdatasync d9/db/f33 0 2024-04-13T10:58:40.226 INFO:tasks.workunit.client.1.smithi194.stdout:3/435: creat d2/d3/d12/d31/d34/d88/d24/f8a x:0 0 0 2024-04-13T10:58:40.229 INFO:tasks.workunit.client.1.smithi194.stdout:0/389: symlink d9/db/l84 0 2024-04-13T10:58:40.231 INFO:tasks.workunit.client.1.smithi194.stdout:3/436: truncate d2/d3/f69 1024730 0 2024-04-13T10:58:40.233 INFO:tasks.workunit.client.1.smithi194.stdout:0/390: creat d9/db/d19/d30/d73/f85 x:0 0 0 2024-04-13T10:58:40.235 INFO:tasks.workunit.client.1.smithi194.stdout:8/451: dwrite d6/d22/d23/d25/d39/d41/d5b/d76/f56 [0,4194304] 0 2024-04-13T10:58:40.237 INFO:tasks.workunit.client.1.smithi194.stdout:5/432: dwrite d3/dc/d10/d38/f51 [0,4194304] 0 2024-04-13T10:58:40.241 INFO:tasks.workunit.client.1.smithi194.stdout:3/437: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/f8b x:0 0 0 2024-04-13T10:58:40.244 INFO:tasks.workunit.client.1.smithi194.stdout:0/391: dread d9/db/d3a/f58 [0,4194304] 0 2024-04-13T10:58:40.244 INFO:tasks.workunit.client.1.smithi194.stdout:5/433: creat d3/dc/d10/d20/d23/f82 x:0 0 0 2024-04-13T10:58:40.247 INFO:tasks.workunit.client.1.smithi194.stdout:5/434: rmdir d3 39 2024-04-13T10:58:40.248 INFO:tasks.workunit.client.1.smithi194.stdout:8/452: dwrite d6/d22/d23/d25/d39/f95 [0,4194304] 0 2024-04-13T10:58:40.248 INFO:tasks.workunit.client.1.smithi194.stdout:4/469: sync 2024-04-13T10:58:40.249 INFO:tasks.workunit.client.1.smithi194.stdout:1/400: sync 2024-04-13T10:58:40.249 INFO:tasks.workunit.client.1.smithi194.stdout:2/464: sync 2024-04-13T10:58:40.249 INFO:tasks.workunit.client.1.smithi194.stdout:1/401: chown d12 5207357 1 2024-04-13T10:58:40.250 INFO:tasks.workunit.client.1.smithi194.stdout:1/402: chown d12/c3c 1816725 1 2024-04-13T10:58:40.253 INFO:tasks.workunit.client.1.smithi194.stdout:3/438: creat d2/d3/d12/d31/d34/d88/d24/d3a/d72/f8c x:0 0 0 2024-04-13T10:58:40.253 INFO:tasks.workunit.client.1.smithi194.stdout:1/403: write d12/f26 [2224450,35922] 0 2024-04-13T10:58:40.254 INFO:tasks.workunit.client.1.smithi194.stdout:0/392: creat d9/df/d16/d83/f86 x:0 0 0 2024-04-13T10:58:40.255 INFO:tasks.workunit.client.1.smithi194.stdout:2/465: mknod d2/d3/de/d3c/c9e 0 2024-04-13T10:58:40.256 INFO:tasks.workunit.client.1.smithi194.stdout:2/466: readlink d2/d3/lb 0 2024-04-13T10:58:40.257 INFO:tasks.workunit.client.1.smithi194.stdout:5/435: chown d3/lb 567941 1 2024-04-13T10:58:40.257 INFO:tasks.workunit.client.1.smithi194.stdout:3/439: chown d2/d3/d12/d31/l33 39 1 2024-04-13T10:58:40.258 INFO:tasks.workunit.client.1.smithi194.stdout:4/470: mkdir d2/d16/d1a/d1c/d9a 0 2024-04-13T10:58:40.261 INFO:tasks.workunit.client.1.smithi194.stdout:1/404: rename l11 to d12/d13/d1c/d27/d4c/d7f/l87 0 2024-04-13T10:58:40.263 INFO:tasks.workunit.client.1.smithi194.stdout:4/471: creat d2/d33/f9b x:0 0 0 2024-04-13T10:58:40.263 INFO:tasks.workunit.client.1.smithi194.stdout:2/467: rmdir d2/d3/de/d17/d36/d8f 39 2024-04-13T10:58:40.263 INFO:tasks.workunit.client.1.smithi194.stdout:3/440: dread d2/d3/d12/d31/f52 [0,4194304] 0 2024-04-13T10:58:40.264 INFO:tasks.workunit.client.1.smithi194.stdout:8/453: link d6/l38 d6/d22/d23/d25/d39/d41/d64/l9a 0 2024-04-13T10:58:40.265 INFO:tasks.workunit.client.1.smithi194.stdout:0/393: fsync d9/db/d19/d28/f1e 0 2024-04-13T10:58:40.266 INFO:tasks.workunit.client.1.smithi194.stdout:4/472: fsync d2/d16/d1a/d1c/d54/d5d/d98/f95 0 2024-04-13T10:58:40.266 INFO:tasks.workunit.client.1.smithi194.stdout:2/468: write d2/d3/de/d33/d71/f75 [3474763,125222] 0 2024-04-13T10:58:40.273 INFO:tasks.workunit.client.1.smithi194.stdout:8/454: symlink d6/d2a/l9b 0 2024-04-13T10:58:40.274 INFO:tasks.workunit.client.1.smithi194.stdout:4/473: dwrite d2/fb [8388608,4194304] 0 2024-04-13T10:58:40.275 INFO:tasks.workunit.client.1.smithi194.stdout:2/469: chown d2/d3/de/d17/d36/d8f 1198212405 1 2024-04-13T10:58:40.278 INFO:tasks.workunit.client.1.smithi194.stdout:4/474: dread d2/d16/d1a/f4c [0,4194304] 0 2024-04-13T10:58:40.281 INFO:tasks.workunit.client.1.smithi194.stdout:1/405: dread d12/d13/d1c/d27/f74 [0,4194304] 0 2024-04-13T10:58:40.282 INFO:tasks.workunit.client.1.smithi194.stdout:5/436: dwrite d3/dc/d17/f1c [0,4194304] 0 2024-04-13T10:58:40.284 INFO:tasks.workunit.client.1.smithi194.stdout:2/470: unlink d2/d3/de/d17/d36/l67 0 2024-04-13T10:58:40.286 INFO:tasks.workunit.client.1.smithi194.stdout:0/394: getdents d9/df 0 2024-04-13T10:58:40.287 INFO:tasks.workunit.client.1.smithi194.stdout:3/441: write d2/fd [116857,113963] 0 2024-04-13T10:58:40.287 INFO:tasks.workunit.client.1.smithi194.stdout:9/413: sync 2024-04-13T10:58:40.287 INFO:tasks.workunit.client.1.smithi194.stdout:7/464: sync 2024-04-13T10:58:40.288 INFO:tasks.workunit.client.1.smithi194.stdout:4/475: mkdir d2/d16/d70/d31/d9c 0 2024-04-13T10:58:40.289 INFO:tasks.workunit.client.1.smithi194.stdout:1/406: write d12/d13/d1c/f72 [529553,49791] 0 2024-04-13T10:58:40.290 INFO:tasks.workunit.client.1.smithi194.stdout:1/407: write d12/f1a [1545383,73235] 0 2024-04-13T10:58:40.291 INFO:tasks.workunit.client.1.smithi194.stdout:5/437: unlink d3/dc/d10/d20/l40 0 2024-04-13T10:58:40.292 INFO:tasks.workunit.client.1.smithi194.stdout:8/455: getdents d6/d22/d23/d25/d71 0 2024-04-13T10:58:40.295 INFO:tasks.workunit.client.1.smithi194.stdout:7/465: mkdir d1/d2b/d4c/d4f/d85/d88/d9b 0 2024-04-13T10:58:40.299 INFO:tasks.workunit.client.1.smithi194.stdout:8/456: chown d6/d22/d23/d25/d68/c94 1735532299 1 2024-04-13T10:58:40.299 INFO:tasks.workunit.client.1.smithi194.stdout:0/395: truncate d9/d2b/d5a/f78 1669528 0 2024-04-13T10:58:40.300 INFO:tasks.workunit.client.1.smithi194.stdout:0/396: stat d9/db/d19/d28/f6e 0 2024-04-13T10:58:40.301 INFO:tasks.workunit.client.1.smithi194.stdout:3/442: unlink d2/d3/d12/d31/f4e 0 2024-04-13T10:58:40.304 INFO:tasks.workunit.client.1.smithi194.stdout:8/457: symlink d6/dd/d45/l9c 0 2024-04-13T10:58:40.305 INFO:tasks.workunit.client.1.smithi194.stdout:7/466: write d1/d2b/d2c/d30/f32 [3916855,128152] 0 2024-04-13T10:58:40.305 INFO:tasks.workunit.client.1.smithi194.stdout:9/414: link d0/lb d0/d11/d44/l8d 0 2024-04-13T10:58:40.305 INFO:tasks.workunit.client.1.smithi194.stdout:1/408: write d12/d13/d1c/f21 [4404309,24156] 0 2024-04-13T10:58:40.308 INFO:tasks.workunit.client.1.smithi194.stdout:3/443: rename d2/d3/d12/d31/d34/d88/l29 to d2/d3/d12/d31/d34/d88/l8d 0 2024-04-13T10:58:40.311 INFO:tasks.workunit.client.1.smithi194.stdout:7/467: rmdir d1/d2b/d4c/d4f/d51 39 2024-04-13T10:58:40.311 INFO:tasks.workunit.client.1.smithi194.stdout:0/397: dwrite d9/db/f1b [0,4194304] 0 2024-04-13T10:58:40.312 INFO:tasks.workunit.client.1.smithi194.stdout:8/458: unlink d6/d22/d23/d25/d39/d41/l70 0 2024-04-13T10:58:40.313 INFO:tasks.workunit.client.1.smithi194.stdout:2/471: dread d2/d3/de/d17/d1e/f2c [4194304,4194304] 0 2024-04-13T10:58:40.315 INFO:tasks.workunit.client.1.smithi194.stdout:1/409: creat d12/d13/d1c/d27/d2e/f88 x:0 0 0 2024-04-13T10:58:40.317 INFO:tasks.workunit.client.1.smithi194.stdout:7/468: mkdir d1/d2b/d3e/d9c 0 2024-04-13T10:58:40.317 INFO:tasks.workunit.client.1.smithi194.stdout:4/476: dread d2/d16/d1a/f36 [0,4194304] 0 2024-04-13T10:58:40.318 INFO:tasks.workunit.client.1.smithi194.stdout:3/444: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d65/l8e 0 2024-04-13T10:58:40.319 INFO:tasks.workunit.client.1.smithi194.stdout:4/477: write d2/d30/f88 [981571,92361] 0 2024-04-13T10:58:40.321 INFO:tasks.workunit.client.1.smithi194.stdout:9/415: rename d0/c33 to d0/d6/d14/d26/d42/c8e 0 2024-04-13T10:58:40.323 INFO:tasks.workunit.client.1.smithi194.stdout:2/472: symlink d2/d3/de/d17/d36/d3d/l9f 0 2024-04-13T10:58:40.326 INFO:tasks.workunit.client.1.smithi194.stdout:3/445: mknod d2/d3/d12/d31/d34/d88/d24/d3a/c8f 0 2024-04-13T10:58:40.327 INFO:tasks.workunit.client.1.smithi194.stdout:9/416: stat d0/f3 0 2024-04-13T10:58:40.329 INFO:tasks.workunit.client.1.smithi194.stdout:1/410: link d12/d13/d44/f5e d12/d13/d44/f89 0 2024-04-13T10:58:40.330 INFO:tasks.workunit.client.1.smithi194.stdout:2/473: dwrite d2/d3/de/d17/d1e/d42/d52/f99 [0,4194304] 0 2024-04-13T10:58:40.331 INFO:tasks.workunit.client.1.smithi194.stdout:3/446: dread d2/d3/d12/d31/d34/d88/d24/f7c [4194304,4194304] 0 2024-04-13T10:58:40.332 INFO:tasks.workunit.client.1.smithi194.stdout:2/474: fsync d2/d3/f2d 0 2024-04-13T10:58:40.332 INFO:tasks.workunit.client.1.smithi194.stdout:4/478: mknod d2/d16/d1a/d1c/d9a/c9d 0 2024-04-13T10:58:40.335 INFO:tasks.workunit.client.1.smithi194.stdout:2/475: read d2/d3/de/d33/d47/f50 [1748557,93118] 0 2024-04-13T10:58:40.335 INFO:tasks.workunit.client.1.smithi194.stdout:0/398: write d9/db/d19/d28/f17 [5171852,94064] 0 2024-04-13T10:58:40.338 INFO:tasks.workunit.client.1.smithi194.stdout:8/459: link d6/d22/d23/d25/d39/d41/d5b/d76/d33/c7b d6/d22/d23/d25/d39/d41/c9d 0 2024-04-13T10:58:40.343 INFO:tasks.workunit.client.1.smithi194.stdout:3/447: rmdir d2/d3/d12/d31/d34 39 2024-04-13T10:58:40.345 INFO:tasks.workunit.client.1.smithi194.stdout:4/479: mkdir d2/d16/d1a/d1c/d54/d62/d9e 0 2024-04-13T10:58:40.347 INFO:tasks.workunit.client.1.smithi194.stdout:2/476: creat d2/d3/de/d33/fa0 x:0 0 0 2024-04-13T10:58:40.347 INFO:tasks.workunit.client.1.smithi194.stdout:0/399: dread - d9/df/d16/f27 zero size 2024-04-13T10:58:40.348 INFO:tasks.workunit.client.1.smithi194.stdout:0/400: write d9/df/f23 [1034462,68668] 0 2024-04-13T10:58:40.349 INFO:tasks.workunit.client.1.smithi194.stdout:7/469: getdents d1/d2b/d4c/d7e 0 2024-04-13T10:58:40.351 INFO:tasks.workunit.client.1.smithi194.stdout:1/411: creat d12/d13/d1c/d28/d41/d77/d80/f8a x:0 0 0 2024-04-13T10:58:40.352 INFO:tasks.workunit.client.1.smithi194.stdout:0/401: fsync d9/d2b/d5a/f5b 0 2024-04-13T10:58:40.353 INFO:tasks.workunit.client.1.smithi194.stdout:4/480: fdatasync d2/d16/d1a/f36 0 2024-04-13T10:58:40.356 INFO:tasks.workunit.client.1.smithi194.stdout:9/417: dwrite d0/d11/f1d [0,4194304] 0 2024-04-13T10:58:40.356 INFO:tasks.workunit.client.1.smithi194.stdout:7/470: write d1/d2b/d3e/d54/d5a/d80/f8c [4575600,34585] 0 2024-04-13T10:58:40.356 INFO:tasks.workunit.client.1.smithi194.stdout:3/448: creat d2/d3/d12/d31/d34/d88/d24/f90 x:0 0 0 2024-04-13T10:58:40.359 INFO:tasks.workunit.client.1.smithi194.stdout:1/412: mkdir d12/d13/d1c/d27/d4c/d7f/d8b 0 2024-04-13T10:58:40.360 INFO:tasks.workunit.client.1.smithi194.stdout:8/460: dwrite d6/dd/f98 [4194304,4194304] 0 2024-04-13T10:58:40.360 INFO:tasks.workunit.client.1.smithi194.stdout:3/449: chown d2/d3/f8 106864 1 2024-04-13T10:58:40.360 INFO:tasks.workunit.client.1.smithi194.stdout:9/418: read - d0/d11/d3d/d4c/f81 zero size 2024-04-13T10:58:40.366 INFO:tasks.workunit.client.1.smithi194.stdout:1/413: dwrite d12/f55 [0,4194304] 0 2024-04-13T10:58:40.367 INFO:tasks.workunit.client.1.smithi194.stdout:8/461: unlink d6/l3f 0 2024-04-13T10:58:40.368 INFO:tasks.workunit.client.1.smithi194.stdout:7/471: unlink d1/d2b/d3e/d54/d5a/d3c/f42 0 2024-04-13T10:58:40.372 INFO:tasks.workunit.client.1.smithi194.stdout:3/450: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 x:0 0 0 2024-04-13T10:58:40.372 INFO:tasks.workunit.client.1.smithi194.stdout:7/472: chown d1/d2b/d3e/d54/d5a/d80 781 1 2024-04-13T10:58:40.374 INFO:tasks.workunit.client.1.smithi194.stdout:8/462: creat d6/d2a/d69/f9e x:0 0 0 2024-04-13T10:58:40.375 INFO:tasks.workunit.client.1.smithi194.stdout:0/402: dread d9/df/f2d [4194304,4194304] 0 2024-04-13T10:58:40.380 INFO:tasks.workunit.client.1.smithi194.stdout:1/414: creat d12/d13/d1c/d27/d4c/d7f/d8b/f8c x:0 0 0 2024-04-13T10:58:40.381 INFO:tasks.workunit.client.1.smithi194.stdout:4/481: write d2/d16/d1a/f4c [361383,60563] 0 2024-04-13T10:58:40.381 INFO:tasks.workunit.client.1.smithi194.stdout:8/463: creat d6/dd/f9f x:0 0 0 2024-04-13T10:58:40.385 INFO:tasks.workunit.client.1.smithi194.stdout:1/415: write d12/d3a/f6a [773727,26914] 0 2024-04-13T10:58:40.386 INFO:tasks.workunit.client.1.smithi194.stdout:3/451: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/f87 [0,4194304] 0 2024-04-13T10:58:40.388 INFO:tasks.workunit.client.1.smithi194.stdout:0/403: dwrite d9/df/d16/d65/f79 [0,4194304] 0 2024-04-13T10:58:40.389 INFO:tasks.workunit.client.1.smithi194.stdout:7/473: link d1/d2b/d4c/d4f/d51/c1a d1/c9d 0 2024-04-13T10:58:40.390 INFO:tasks.workunit.client.1.smithi194.stdout:9/419: write d0/d6/d14/d26/d3b/f63 [650150,19788] 0 2024-04-13T10:58:40.390 INFO:tasks.workunit.client.1.smithi194.stdout:1/416: write d12/f5b [2471651,71460] 0 2024-04-13T10:58:40.392 INFO:tasks.workunit.client.1.smithi194.stdout:0/404: chown d9/db/l84 3880 1 2024-04-13T10:58:40.394 INFO:tasks.workunit.client.1.smithi194.stdout:3/452: dread - d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/f79 zero size 2024-04-13T10:58:40.394 INFO:tasks.workunit.client.1.smithi194.stdout:0/405: stat d9/db/d19/d28/f2f 0 2024-04-13T10:58:40.398 INFO:tasks.workunit.client.1.smithi194.stdout:9/420: mknod d0/d6/d9/d70/c8f 0 2024-04-13T10:58:40.399 INFO:tasks.workunit.client.1.smithi194.stdout:0/406: read d9/db/f33 [705792,40359] 0 2024-04-13T10:58:40.399 INFO:tasks.workunit.client.1.smithi194.stdout:4/482: dread d2/d16/d1a/f2f [0,4194304] 0 2024-04-13T10:58:40.399 INFO:tasks.workunit.client.1.smithi194.stdout:3/453: mknod d2/d3/d12/d31/d34/d88/d24/d6c/c92 0 2024-04-13T10:58:40.401 INFO:tasks.workunit.client.1.smithi194.stdout:8/464: truncate d6/dd/f16 3358853 0 2024-04-13T10:58:40.404 INFO:tasks.workunit.client.1.smithi194.stdout:7/474: chown d1/f29 115 1 2024-04-13T10:58:40.404 INFO:tasks.workunit.client.1.smithi194.stdout:8/465: fdatasync d6/d2a/d69/f9e 0 2024-04-13T10:58:40.405 INFO:tasks.workunit.client.1.smithi194.stdout:9/421: unlink d0/d6/d9/d51/l52 0 2024-04-13T10:58:40.405 INFO:tasks.workunit.client.1.smithi194.stdout:1/417: dwrite d12/f81 [0,4194304] 0 2024-04-13T10:58:40.405 INFO:tasks.workunit.client.1.smithi194.stdout:3/454: mknod d2/d7d/c93 0 2024-04-13T10:58:40.411 INFO:tasks.workunit.client.1.smithi194.stdout:3/455: fdatasync d2/d3/d12/d31/d34/d88/f2e 0 2024-04-13T10:58:40.411 INFO:tasks.workunit.client.1.smithi194.stdout:8/466: mkdir d6/d22/d23/d25/d71/da0 0 2024-04-13T10:58:40.411 INFO:tasks.workunit.client.1.smithi194.stdout:7/475: chown d1/d2b/d3e/d54/d5a/d80/f8c 7 1 2024-04-13T10:58:40.412 INFO:tasks.workunit.client.1.smithi194.stdout:1/418: creat d12/d13/d1c/d53/f8d x:0 0 0 2024-04-13T10:58:40.414 INFO:tasks.workunit.client.1.smithi194.stdout:9/422: mkdir d0/d6/d14/d26/d3b/d90 0 2024-04-13T10:58:40.415 INFO:tasks.workunit.client.1.smithi194.stdout:0/407: dwrite d9/db/f2a [0,4194304] 0 2024-04-13T10:58:40.417 INFO:tasks.workunit.client.1.smithi194.stdout:1/419: dread - d12/d3a/d4f/f71 zero size 2024-04-13T10:58:40.417 INFO:tasks.workunit.client.1.smithi194.stdout:8/467: mknod d6/d22/d23/d25/d78/ca1 0 2024-04-13T10:58:40.420 INFO:tasks.workunit.client.1.smithi194.stdout:3/456: write d2/d3/d12/d31/d34/d88/d24/d3a/f45 [359878,127580] 0 2024-04-13T10:58:40.422 INFO:tasks.workunit.client.1.smithi194.stdout:0/408: mkdir d9/db/d19/d30/d73/d87 0 2024-04-13T10:58:40.425 INFO:tasks.workunit.client.1.smithi194.stdout:4/483: dread d2/d16/d70/d31/f40 [0,4194304] 0 2024-04-13T10:58:40.426 INFO:tasks.workunit.client.1.smithi194.stdout:1/420: dread d12/d13/d3e/f2d [0,4194304] 0 2024-04-13T10:58:40.426 INFO:tasks.workunit.client.1.smithi194.stdout:8/468: dread d6/d22/d23/d7f/f81 [0,4194304] 0 2024-04-13T10:58:40.426 INFO:tasks.workunit.client.1.smithi194.stdout:0/409: read d9/db/f33 [852138,4526] 0 2024-04-13T10:58:40.427 INFO:tasks.workunit.client.1.smithi194.stdout:6/443: sync 2024-04-13T10:58:40.427 INFO:tasks.workunit.client.1.smithi194.stdout:7/476: dwrite d1/f41 [0,4194304] 0 2024-04-13T10:58:40.428 INFO:tasks.workunit.client.1.smithi194.stdout:9/423: truncate d0/d6/d2c/d68/f6a 506573 0 2024-04-13T10:58:40.432 INFO:tasks.workunit.client.1.smithi194.stdout:7/477: chown d1/d2b/d4c/d4f/d51/f1c 368888012 1 2024-04-13T10:58:40.435 INFO:tasks.workunit.client.1.smithi194.stdout:4/484: creat d2/d16/d1a/d1c/d54/d62/d6e/f9f x:0 0 0 2024-04-13T10:58:40.437 INFO:tasks.workunit.client.1.smithi194.stdout:7/478: write d1/d2b/d4c/d4f/d6e/f87 [696830,3186] 0 2024-04-13T10:58:40.437 INFO:tasks.workunit.client.1.smithi194.stdout:1/421: creat d12/d13/d1c/d28/d41/d50/f8e x:0 0 0 2024-04-13T10:58:40.440 INFO:tasks.workunit.client.1.smithi194.stdout:3/457: dwrite d2/d3/d12/d31/d34/f39 [0,4194304] 0 2024-04-13T10:58:40.443 INFO:tasks.workunit.client.1.smithi194.stdout:4/485: creat d2/d16/d1a/d1c/d54/d62/fa0 x:0 0 0 2024-04-13T10:58:40.445 INFO:tasks.workunit.client.1.smithi194.stdout:1/422: read d12/d13/d3e/f34 [65324,27517] 0 2024-04-13T10:58:40.446 INFO:tasks.workunit.client.1.smithi194.stdout:9/424: dwrite d0/d6/d14/d26/f38 [0,4194304] 0 2024-04-13T10:58:40.448 INFO:tasks.workunit.client.1.smithi194.stdout:3/458: mknod d2/d3/d12/d21/c94 0 2024-04-13T10:58:40.453 INFO:tasks.workunit.client.1.smithi194.stdout:7/479: truncate d1/d2b/d3e/d54/d5a/f58 421662 0 2024-04-13T10:58:40.458 INFO:tasks.workunit.client.1.smithi194.stdout:3/459: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95 0 2024-04-13T10:58:40.460 INFO:tasks.workunit.client.1.smithi194.stdout:4/486: mknod d2/d16/d1a/d1c/d3e/d48/d7f/ca1 0 2024-04-13T10:58:40.460 INFO:tasks.workunit.client.1.smithi194.stdout:3/460: stat d2/de/c4d 0 2024-04-13T10:58:40.461 INFO:tasks.workunit.client.1.smithi194.stdout:9/425: getdents d0/d6/d4a 0 2024-04-13T10:58:40.461 INFO:tasks.workunit.client.1.smithi194.stdout:1/423: dwrite d12/d3a/d4f/f63 [0,4194304] 0 2024-04-13T10:58:40.466 INFO:tasks.workunit.client.1.smithi194.stdout:8/469: dread f5 [0,4194304] 0 2024-04-13T10:58:40.467 INFO:tasks.workunit.client.1.smithi194.stdout:0/410: truncate d9/df/f2d 668385 0 2024-04-13T10:58:40.469 INFO:tasks.workunit.client.1.smithi194.stdout:6/444: dread d0/d2c/f31 [0,4194304] 0 2024-04-13T10:58:40.470 INFO:tasks.workunit.client.1.smithi194.stdout:1/424: chown d12/c23 42 1 2024-04-13T10:58:40.471 INFO:tasks.workunit.client.1.smithi194.stdout:9/426: rename d0/d6/l7c to d0/d11/d79/l91 0 2024-04-13T10:58:40.472 INFO:tasks.workunit.client.1.smithi194.stdout:6/445: write d0/d53/f81 [507721,65350] 0 2024-04-13T10:58:40.474 INFO:tasks.workunit.client.1.smithi194.stdout:6/446: stat d0/d26/d2b/d4d 0 2024-04-13T10:58:40.476 INFO:tasks.workunit.client.1.smithi194.stdout:1/425: read d12/d13/d3e/f42 [2014367,57118] 0 2024-04-13T10:58:40.476 INFO:tasks.workunit.client.1.smithi194.stdout:7/480: link d1/f3 d1/d2b/d3e/d54/d5a/d80/d96/f9e 0 2024-04-13T10:58:40.476 INFO:tasks.workunit.client.1.smithi194.stdout:0/411: read d9/d2b/d5a/f78 [511481,82643] 0 2024-04-13T10:58:40.478 INFO:tasks.workunit.client.1.smithi194.stdout:0/412: chown d9/db 1951 1 2024-04-13T10:58:40.478 INFO:tasks.workunit.client.1.smithi194.stdout:1/426: write d12/f15 [1624182,94400] 0 2024-04-13T10:58:40.479 INFO:tasks.workunit.client.1.smithi194.stdout:9/427: dread d0/d6/d14/d26/f38 [0,4194304] 0 2024-04-13T10:58:40.480 INFO:tasks.workunit.client.1.smithi194.stdout:3/461: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d78/c96 0 2024-04-13T10:58:40.483 INFO:tasks.workunit.client.1.smithi194.stdout:0/413: write d9/db/d19/d28/f53 [5228753,73534] 0 2024-04-13T10:58:40.484 INFO:tasks.workunit.client.1.smithi194.stdout:0/414: write d9/f4b [277792,7939] 0 2024-04-13T10:58:40.486 INFO:tasks.workunit.client.1.smithi194.stdout:4/487: dread d2/d30/d50/f6b [0,4194304] 0 2024-04-13T10:58:40.487 INFO:tasks.workunit.client.1.smithi194.stdout:4/488: write d2/d16/d1a/d1c/d3b/d42/f75 [92833,90474] 0 2024-04-13T10:58:40.488 INFO:tasks.workunit.client.1.smithi194.stdout:7/481: write d1/d2b/d2c/f68 [1142409,23396] 0 2024-04-13T10:58:40.489 INFO:tasks.workunit.client.1.smithi194.stdout:7/482: readlink d1/d2b/d4c/d4f/d51/l57 0 2024-04-13T10:58:40.489 INFO:tasks.workunit.client.1.smithi194.stdout:1/427: write d12/d13/d1c/d27/f74 [3285102,78926] 0 2024-04-13T10:58:40.491 INFO:tasks.workunit.client.1.smithi194.stdout:7/483: write d1/d2b/d4c/d4f/f53 [436757,24878] 0 2024-04-13T10:58:40.492 INFO:tasks.workunit.client.1.smithi194.stdout:3/462: read d2/d3/f69 [661174,64304] 0 2024-04-13T10:58:40.497 INFO:tasks.workunit.client.1.smithi194.stdout:9/428: creat d0/d6/d2c/f92 x:0 0 0 2024-04-13T10:58:40.498 INFO:tasks.workunit.client.1.smithi194.stdout:6/447: creat d0/d2f/d6f/f89 x:0 0 0 2024-04-13T10:58:40.498 INFO:tasks.workunit.client.1.smithi194.stdout:8/470: write d6/d22/d23/d25/d39/d41/d5b/d76/f63 [136911,73961] 0 2024-04-13T10:58:40.498 INFO:tasks.workunit.client.1.smithi194.stdout:3/463: fdatasync d2/f27 0 2024-04-13T10:58:40.499 INFO:tasks.workunit.client.1.smithi194.stdout:4/489: unlink d2/d16/d1a/d1c/d3e/d48/c8a 0 2024-04-13T10:58:40.500 INFO:tasks.workunit.client.1.smithi194.stdout:1/428: rmdir d12/d13/d1c/d27/d2e 39 2024-04-13T10:58:40.503 INFO:tasks.workunit.client.1.smithi194.stdout:7/484: creat d1/d2b/d3e/f9f x:0 0 0 2024-04-13T10:58:40.504 INFO:tasks.workunit.client.1.smithi194.stdout:9/429: dread d0/d11/d3d/f5d [0,4194304] 0 2024-04-13T10:58:40.505 INFO:tasks.workunit.client.1.smithi194.stdout:0/415: mkdir d9/df/d16/d77/d88 0 2024-04-13T10:58:40.508 INFO:tasks.workunit.client.1.smithi194.stdout:1/429: symlink d12/d13/d1c/d28/d41/l8f 0 2024-04-13T10:58:40.515 INFO:tasks.workunit.client.1.smithi194.stdout:6/448: dwrite d0/d2f/d6f/f89 [0,4194304] 0 2024-04-13T10:58:40.518 INFO:tasks.workunit.client.1.smithi194.stdout:8/471: dwrite d6/d22/d23/d25/d39/d41/f74 [0,4194304] 0 2024-04-13T10:58:40.520 INFO:tasks.workunit.client.1.smithi194.stdout:1/430: mkdir d12/d13/d1c/d27/d4c/d90 0 2024-04-13T10:58:40.520 INFO:tasks.workunit.client.1.smithi194.stdout:3/464: dwrite d2/d3/d12/d31/d34/d88/f2e [0,4194304] 0 2024-04-13T10:58:40.524 INFO:tasks.workunit.client.1.smithi194.stdout:4/490: getdents d2/d16/d1a/d1c 0 2024-04-13T10:58:40.526 INFO:tasks.workunit.client.1.smithi194.stdout:6/449: creat d0/d57/d69/f8a x:0 0 0 2024-04-13T10:58:40.527 INFO:tasks.workunit.client.1.smithi194.stdout:8/472: write d6/dd/f19 [3470702,104263] 0 2024-04-13T10:58:40.528 INFO:tasks.workunit.client.1.smithi194.stdout:9/430: dwrite d0/d11/d3d/f7e [0,4194304] 0 2024-04-13T10:58:40.529 INFO:tasks.workunit.client.1.smithi194.stdout:1/431: mknod d12/d13/d1c/d28/c91 0 2024-04-13T10:58:40.530 INFO:tasks.workunit.client.1.smithi194.stdout:0/416: dwrite d9/db/f2a [0,4194304] 0 2024-04-13T10:58:40.530 INFO:tasks.workunit.client.1.smithi194.stdout:6/450: readlink d0/d2f/l86 0 2024-04-13T10:58:40.532 INFO:tasks.workunit.client.1.smithi194.stdout:0/417: write d9/db/d19/d28/f53 [3082344,90335] 0 2024-04-13T10:58:40.534 INFO:tasks.workunit.client.1.smithi194.stdout:5/438: sync 2024-04-13T10:58:40.535 INFO:tasks.workunit.client.1.smithi194.stdout:0/418: symlink d9/df/d16/d70/l89 0 2024-04-13T10:58:40.537 INFO:tasks.workunit.client.1.smithi194.stdout:6/451: chown d0/d2c 53081871 1 2024-04-13T10:58:40.538 INFO:tasks.workunit.client.1.smithi194.stdout:1/432: write d12/d3a/f6a [1455392,105170] 0 2024-04-13T10:58:40.538 INFO:tasks.workunit.client.1.smithi194.stdout:4/491: chown d2/d16/d1a/d1c/d3b/d42/f82 0 1 2024-04-13T10:58:40.538 INFO:tasks.workunit.client.1.smithi194.stdout:5/439: fsync d3/dc/d2d/f36 0 2024-04-13T10:58:40.540 INFO:tasks.workunit.client.1.smithi194.stdout:3/465: symlink d2/d3/d12/d31/d34/d88/d24/d6c/l97 0 2024-04-13T10:58:40.542 INFO:tasks.workunit.client.1.smithi194.stdout:5/440: dread d3/dc/d10/d20/d23/f5f [0,4194304] 0 2024-04-13T10:58:40.543 INFO:tasks.workunit.client.1.smithi194.stdout:6/452: truncate d0/d26/d4b/f72 487748 0 2024-04-13T10:58:40.543 INFO:tasks.workunit.client.1.smithi194.stdout:6/453: fsync d0/f66 0 2024-04-13T10:58:40.546 INFO:tasks.workunit.client.1.smithi194.stdout:1/433: write d12/d13/d1c/d28/f58 [4482571,71271] 0 2024-04-13T10:58:40.547 INFO:tasks.workunit.client.1.smithi194.stdout:8/473: unlink d6/d22/d23/d25/d39/d41/d5b/d76/f63 0 2024-04-13T10:58:40.548 INFO:tasks.workunit.client.1.smithi194.stdout:9/431: rename d0/d11/d58/f83 to d0/d6/d4a/d74/f93 0 2024-04-13T10:58:40.550 INFO:tasks.workunit.client.1.smithi194.stdout:4/492: symlink d2/d16/d70/d31/d44/la2 0 2024-04-13T10:58:40.552 INFO:tasks.workunit.client.1.smithi194.stdout:4/493: truncate d2/ff 2338119 0 2024-04-13T10:58:40.552 INFO:tasks.workunit.client.1.smithi194.stdout:8/474: mkdir d6/d2a/d69/da2 0 2024-04-13T10:58:40.553 INFO:tasks.workunit.client.1.smithi194.stdout:3/466: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/c98 0 2024-04-13T10:58:40.554 INFO:tasks.workunit.client.1.smithi194.stdout:6/454: symlink d0/d57/d84/l8b 0 2024-04-13T10:58:40.555 INFO:tasks.workunit.client.1.smithi194.stdout:0/419: link d9/df/d16/d83/f86 d9/db/f8a 0 2024-04-13T10:58:40.556 INFO:tasks.workunit.client.1.smithi194.stdout:7/485: dread d1/d2b/d3e/d54/d5a/d80/d96/f9e [0,4194304] 0 2024-04-13T10:58:40.557 INFO:tasks.workunit.client.1.smithi194.stdout:6/455: fdatasync d0/d57/d69/f8a 0 2024-04-13T10:58:40.559 INFO:tasks.workunit.client.1.smithi194.stdout:3/467: fdatasync d2/d3/d12/d31/d34/d88/d24/d3a/f45 0 2024-04-13T10:58:40.559 INFO:tasks.workunit.client.1.smithi194.stdout:9/432: dwrite d0/d11/d1e/f6c [0,4194304] 0 2024-04-13T10:58:40.561 INFO:tasks.workunit.client.1.smithi194.stdout:5/441: rename d3/dc/d10/d20/d23 to d3/d83 0 2024-04-13T10:58:40.563 INFO:tasks.workunit.client.1.smithi194.stdout:9/433: dread d0/d6/d2c/f36 [0,4194304] 0 2024-04-13T10:58:40.564 INFO:tasks.workunit.client.1.smithi194.stdout:9/434: chown d0/d11/d3d 503420596 1 2024-04-13T10:58:40.564 INFO:tasks.workunit.client.1.smithi194.stdout:9/435: stat d0/d11/d1e/f46 0 2024-04-13T10:58:40.566 INFO:tasks.workunit.client.1.smithi194.stdout:0/420: unlink d9/db/f55 0 2024-04-13T10:58:40.566 INFO:tasks.workunit.client.1.smithi194.stdout:8/475: dread d6/d22/d23/d25/d39/f62 [0,4194304] 0 2024-04-13T10:58:40.567 INFO:tasks.workunit.client.1.smithi194.stdout:0/421: dread - d9/db/f8a zero size 2024-04-13T10:58:40.570 INFO:tasks.workunit.client.1.smithi194.stdout:6/456: creat d0/d2c/d77/f8c x:0 0 0 2024-04-13T10:58:40.574 INFO:tasks.workunit.client.1.smithi194.stdout:4/494: rename d2/d16/d1a/d1c/d54/d62/d6e/f9f to d2/d16/d70/d31/fa3 0 2024-04-13T10:58:40.576 INFO:tasks.workunit.client.1.smithi194.stdout:5/442: creat d3/dc/d2d/f84 x:0 0 0 2024-04-13T10:58:40.577 INFO:tasks.workunit.client.1.smithi194.stdout:7/486: mknod d1/d6c/ca0 0 2024-04-13T10:58:40.580 INFO:tasks.workunit.client.1.smithi194.stdout:9/436: unlink d0/l43 0 2024-04-13T10:58:40.583 INFO:tasks.workunit.client.1.smithi194.stdout:3/468: dread d2/f30 [0,4194304] 0 2024-04-13T10:58:40.584 INFO:tasks.workunit.client.1.smithi194.stdout:8/476: mkdir d6/d2a/d69/da3 0 2024-04-13T10:58:40.584 INFO:tasks.workunit.client.1.smithi194.stdout:3/469: chown d2/d3/f8 2025 1 2024-04-13T10:58:40.586 INFO:tasks.workunit.client.1.smithi194.stdout:3/470: write d2/d3/d12/d31/d34/d88/d24/d3a/d72/f8c [1043936,120980] 0 2024-04-13T10:58:40.588 INFO:tasks.workunit.client.1.smithi194.stdout:3/471: chown d2/d3/d12/d31/d34/d88/d24/f90 15389634 1 2024-04-13T10:58:40.589 INFO:tasks.workunit.client.1.smithi194.stdout:4/495: truncate d2/d16/d1a/d1c/d54/d62/f71 498246 0 2024-04-13T10:58:40.589 INFO:tasks.workunit.client.1.smithi194.stdout:0/422: dread d9/d2b/f4f [0,4194304] 0 2024-04-13T10:58:40.591 INFO:tasks.workunit.client.1.smithi194.stdout:3/472: write d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 [737019,126000] 0 2024-04-13T10:58:40.591 INFO:tasks.workunit.client.1.smithi194.stdout:9/437: rename d0/d6/d14/f1a to d0/d6/d9/d51/f94 0 2024-04-13T10:58:40.593 INFO:tasks.workunit.client.1.smithi194.stdout:8/477: rmdir d6/dd/d80 39 2024-04-13T10:58:40.593 INFO:tasks.workunit.client.1.smithi194.stdout:9/438: chown d0/d6/d4a/d74/f7d 1007173 1 2024-04-13T10:58:40.594 INFO:tasks.workunit.client.1.smithi194.stdout:8/478: write f5 [3211554,107522] 0 2024-04-13T10:58:40.595 INFO:tasks.workunit.client.1.smithi194.stdout:5/443: dread d3/d29/f3f [0,4194304] 0 2024-04-13T10:58:40.598 INFO:tasks.workunit.client.1.smithi194.stdout:7/487: creat d1/d2b/d3e/d54/d5a/d80/d96/fa1 x:0 0 0 2024-04-13T10:58:40.601 INFO:tasks.workunit.client.1.smithi194.stdout:3/473: write d2/d3/d12/f22 [687070,4262] 0 2024-04-13T10:58:40.601 INFO:tasks.workunit.client.1.smithi194.stdout:9/439: dwrite d0/d11/f40 [0,4194304] 0 2024-04-13T10:58:40.605 INFO:tasks.workunit.client.1.smithi194.stdout:5/444: dwrite d3/d83/f82 [0,4194304] 0 2024-04-13T10:58:40.607 INFO:tasks.workunit.client.1.smithi194.stdout:7/488: unlink d1/f3 0 2024-04-13T10:58:40.607 INFO:tasks.workunit.client.1.smithi194.stdout:6/457: write d0/d42/f46 [2398184,92086] 0 2024-04-13T10:58:40.616 INFO:tasks.workunit.client.1.smithi194.stdout:3/474: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d57/l99 0 2024-04-13T10:58:40.617 INFO:tasks.workunit.client.1.smithi194.stdout:5/445: fdatasync d3/dc/d10/d20/f43 0 2024-04-13T10:58:40.618 INFO:tasks.workunit.client.1.smithi194.stdout:3/475: chown d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 6568079 1 2024-04-13T10:58:40.618 INFO:tasks.workunit.client.1.smithi194.stdout:3/476: stat d2/f5b 0 2024-04-13T10:58:40.619 INFO:tasks.workunit.client.1.smithi194.stdout:0/423: rename d9/db/d19/d28/f1e to d9/d2b/f8b 0 2024-04-13T10:58:40.620 INFO:tasks.workunit.client.1.smithi194.stdout:6/458: mknod d0/d2f/d48/c8d 0 2024-04-13T10:58:40.620 INFO:tasks.workunit.client.1.smithi194.stdout:4/496: link d2/d16/d1a/d1c/d3b/l78 d2/d16/d1a/d1c/d3e/d48/d7f/la4 0 2024-04-13T10:58:40.624 INFO:tasks.workunit.client.1.smithi194.stdout:6/459: symlink d0/d2c/l8e 0 2024-04-13T10:58:40.626 INFO:tasks.workunit.client.1.smithi194.stdout:4/497: read d2/d33/f17 [700986,103900] 0 2024-04-13T10:58:40.626 INFO:tasks.workunit.client.1.smithi194.stdout:3/477: dread d2/d3/d12/d31/d34/d88/f2e [0,4194304] 0 2024-04-13T10:58:40.627 INFO:tasks.workunit.client.1.smithi194.stdout:7/489: getdents d1/d2b/d3e/d54/d5a/d7d 0 2024-04-13T10:58:40.628 INFO:tasks.workunit.client.1.smithi194.stdout:6/460: mknod d0/d2f/d6f/c8f 0 2024-04-13T10:58:40.628 INFO:tasks.workunit.client.1.smithi194.stdout:0/424: dwrite d9/df/d16/f5d [0,4194304] 0 2024-04-13T10:58:40.629 INFO:tasks.workunit.client.1.smithi194.stdout:6/461: fsync d0/f2a 0 2024-04-13T10:58:40.632 INFO:tasks.workunit.client.1.smithi194.stdout:4/498: mknod d2/d16/d70/d31/d44/ca5 0 2024-04-13T10:58:40.633 INFO:tasks.workunit.client.1.smithi194.stdout:3/478: read d2/d3/d12/d31/d34/d88/d24/f38 [609357,122300] 0 2024-04-13T10:58:40.638 INFO:tasks.workunit.client.1.smithi194.stdout:5/446: dread d3/dc/d17/d1b/f21 [0,4194304] 0 2024-04-13T10:58:40.649 INFO:tasks.workunit.client.1.smithi194.stdout:5/447: mkdir d3/d29/d85 0 2024-04-13T10:58:40.655 INFO:tasks.workunit.client.1.smithi194.stdout:6/462: write d0/d2c/f6c [75586,24664] 0 2024-04-13T10:58:40.656 INFO:tasks.workunit.client.1.smithi194.stdout:4/499: dread d2/d16/d1a/d1c/d54/d62/d6e/f76 [0,4194304] 0 2024-04-13T10:58:40.656 INFO:tasks.workunit.client.1.smithi194.stdout:7/490: dread d1/d2b/d4c/d4f/d51/f56 [0,4194304] 0 2024-04-13T10:58:40.658 INFO:tasks.workunit.client.1.smithi194.stdout:0/425: link d9/db/d19/c47 d9/df/d16/d77/c8c 0 2024-04-13T10:58:40.659 INFO:tasks.workunit.client.1.smithi194.stdout:3/479: link d2/d3/d12/d31/c85 d2/d3/d12/d31/d34/d88/c9a 0 2024-04-13T10:58:40.659 INFO:tasks.workunit.client.1.smithi194.stdout:9/440: dread d0/d6/d2c/d68/f6a [0,4194304] 0 2024-04-13T10:58:40.660 INFO:tasks.workunit.client.1.smithi194.stdout:6/463: mknod d0/d57/d84/c90 0 2024-04-13T10:58:40.660 INFO:tasks.workunit.client.1.smithi194.stdout:0/426: fsync d9/df/f3c 0 2024-04-13T10:58:40.660 INFO:tasks.workunit.client.1.smithi194.stdout:5/448: dwrite d3/dc/d2d/f84 [0,4194304] 0 2024-04-13T10:58:40.660 INFO:tasks.workunit.client.1.smithi194.stdout:7/491: chown d1/d2b/d2c/d30/d33/d39 1 1 2024-04-13T10:58:40.663 INFO:tasks.workunit.client.1.smithi194.stdout:4/500: creat d2/d16/d1a/d1c/d3b/d42/fa6 x:0 0 0 2024-04-13T10:58:40.665 INFO:tasks.workunit.client.1.smithi194.stdout:0/427: unlink d9/df/c5e 0 2024-04-13T10:58:40.665 INFO:tasks.workunit.client.1.smithi194.stdout:5/449: dread d3/dc/d17/f1c [0,4194304] 0 2024-04-13T10:58:40.666 INFO:tasks.workunit.client.1.smithi194.stdout:6/464: mkdir d0/d53/d78/d91 0 2024-04-13T10:58:40.668 INFO:tasks.workunit.client.1.smithi194.stdout:7/492: mknod d1/d2b/d3e/ca2 0 2024-04-13T10:58:40.668 INFO:tasks.workunit.client.1.smithi194.stdout:7/493: chown d1/d2b/d2c/d30/f32 2807340 1 2024-04-13T10:58:40.671 INFO:tasks.workunit.client.1.smithi194.stdout:3/480: creat d2/d3/d12/d31/d34/d88/d24/d6c/f9b x:0 0 0 2024-04-13T10:58:40.671 INFO:tasks.workunit.client.1.smithi194.stdout:4/501: creat d2/d16/d1a/d1c/d54/d62/d6e/fa7 x:0 0 0 2024-04-13T10:58:40.671 INFO:tasks.workunit.client.1.smithi194.stdout:5/450: fdatasync d3/dc/f2c 0 2024-04-13T10:58:40.673 INFO:tasks.workunit.client.1.smithi194.stdout:4/502: chown d2/d16/d70/f26 0 1 2024-04-13T10:58:40.673 INFO:tasks.workunit.client.1.smithi194.stdout:3/481: write d2/d3/d12/f16 [3912405,90065] 0 2024-04-13T10:58:40.674 INFO:tasks.workunit.client.1.smithi194.stdout:2/477: sync 2024-04-13T10:58:40.676 INFO:tasks.workunit.client.1.smithi194.stdout:4/503: readlink d2/l10 0 2024-04-13T10:58:40.678 INFO:tasks.workunit.client.1.smithi194.stdout:3/482: rename d2/d3/f69 to d2/d7d/f9c 0 2024-04-13T10:58:40.679 INFO:tasks.workunit.client.1.smithi194.stdout:0/428: link d9/d2b/c7b d9/d2b/d5a/c8d 0 2024-04-13T10:58:40.682 INFO:tasks.workunit.client.1.smithi194.stdout:2/478: dwrite d2/d3/de/d17/d39/f64 [0,4194304] 0 2024-04-13T10:58:40.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:40 smithi134 ceph-mon[39696]: pgmap v24: 65 pgs: 65 active+clean; 953 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 MiB/s rd, 122 MiB/s wr, 384 op/s 2024-04-13T10:58:40.684 INFO:tasks.workunit.client.1.smithi194.stdout:5/451: link d3/dc/d10/f3c d3/dc/d10/d38/d59/d7a/f86 0 2024-04-13T10:58:40.685 INFO:tasks.workunit.client.1.smithi194.stdout:2/479: truncate d2/d37/f6a 152396 0 2024-04-13T10:58:40.685 INFO:tasks.workunit.client.1.smithi194.stdout:4/504: dwrite d2/d16/d70/f68 [0,4194304] 0 2024-04-13T10:58:40.686 INFO:tasks.workunit.client.1.smithi194.stdout:2/480: stat d2/d3/de/d17/d1e/f2c 0 2024-04-13T10:58:40.690 INFO:tasks.workunit.client.1.smithi194.stdout:3/483: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d 0 2024-04-13T10:58:40.695 INFO:tasks.workunit.client.1.smithi194.stdout:5/452: dwrite d3/dc/d10/d38/f4d [0,4194304] 0 2024-04-13T10:58:40.695 INFO:tasks.workunit.client.1.smithi194.stdout:4/505: dwrite d2/d33/f9b [0,4194304] 0 2024-04-13T10:58:40.697 INFO:tasks.workunit.client.1.smithi194.stdout:0/429: truncate d9/df/d63/f80 521659 0 2024-04-13T10:58:40.701 INFO:tasks.workunit.client.1.smithi194.stdout:7/494: rename d1/d6c/f83 to d1/d2b/d3e/d54/d5a/d80/d96/fa3 0 2024-04-13T10:58:40.702 INFO:tasks.workunit.client.1.smithi194.stdout:2/481: dread d2/d3/de/d17/d1e/d42/d52/f93 [0,4194304] 0 2024-04-13T10:58:40.706 INFO:tasks.workunit.client.1.smithi194.stdout:3/484: rename d2/de/l10 to d2/d3/l9e 0 2024-04-13T10:58:40.707 INFO:tasks.workunit.client.1.smithi194.stdout:4/506: mknod d2/d16/d1a/d1c/d54/d62/d9e/ca8 0 2024-04-13T10:58:40.709 INFO:tasks.workunit.client.1.smithi194.stdout:7/495: unlink d1/c7 0 2024-04-13T10:58:40.712 INFO:tasks.workunit.client.1.smithi194.stdout:0/430: symlink d9/df/d16/d77/d88/l8e 0 2024-04-13T10:58:40.718 INFO:tasks.workunit.client.1.smithi194.stdout:4/507: mknod d2/d16/d1a/d1c/d3e/ca9 0 2024-04-13T10:58:40.718 INFO:tasks.workunit.client.1.smithi194.stdout:7/496: fsync d1/d2b/d3e/d54/d5a/d3c/f65 0 2024-04-13T10:58:40.719 INFO:tasks.workunit.client.1.smithi194.stdout:3/485: unlink d2/d3/d12/d31/d34/d88/c9a 0 2024-04-13T10:58:40.720 INFO:tasks.workunit.client.1.smithi194.stdout:2/482: creat d2/d3/de/d17/d1e/d42/fa1 x:0 0 0 2024-04-13T10:58:40.722 INFO:tasks.workunit.client.1.smithi194.stdout:0/431: dread d9/df/f4c [0,4194304] 0 2024-04-13T10:58:40.724 INFO:tasks.workunit.client.1.smithi194.stdout:0/432: fsync d9/db/f33 0 2024-04-13T10:58:40.724 INFO:tasks.workunit.client.1.smithi194.stdout:2/483: symlink d2/d3/de/d90/la2 0 2024-04-13T10:58:40.725 INFO:tasks.workunit.client.1.smithi194.stdout:5/453: truncate d3/dc/d17/f74 1057915 0 2024-04-13T10:58:40.728 INFO:tasks.workunit.client.1.smithi194.stdout:3/486: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d65/f66 [0,4194304] 0 2024-04-13T10:58:40.730 INFO:tasks.workunit.client.1.smithi194.stdout:5/454: creat d3/d29/f87 x:0 0 0 2024-04-13T10:58:40.731 INFO:tasks.workunit.client.1.smithi194.stdout:2/484: mknod d2/d3/de/d33/d47/ca3 0 2024-04-13T10:58:40.733 INFO:tasks.workunit.client.1.smithi194.stdout:0/433: dwrite d9/f4b [0,4194304] 0 2024-04-13T10:58:40.733 INFO:tasks.workunit.client.1.smithi194.stdout:2/485: readlink d2/d3/de/l60 0 2024-04-13T10:58:40.733 INFO:tasks.workunit.client.1.smithi194.stdout:4/508: write d2/d16/d1a/f36 [2670484,122638] 0 2024-04-13T10:58:40.734 INFO:tasks.workunit.client.1.smithi194.stdout:2/486: write d2/d3/d12/f1c [370692,19179] 0 2024-04-13T10:58:40.734 INFO:tasks.workunit.client.1.smithi194.stdout:5/455: rmdir d3/dc/d10/d38/d59/d7a 39 2024-04-13T10:58:40.739 INFO:tasks.workunit.client.1.smithi194.stdout:0/434: symlink d9/db/d19/d30/l8f 0 2024-04-13T10:58:40.740 INFO:tasks.workunit.client.1.smithi194.stdout:7/497: write d1/d2b/d3e/d54/d5a/f58 [723770,61923] 0 2024-04-13T10:58:40.741 INFO:tasks.workunit.client.1.smithi194.stdout:2/487: write d2/d3/de/d33/d71/f75 [4483186,6307] 0 2024-04-13T10:58:40.744 INFO:tasks.workunit.client.1.smithi194.stdout:5/456: fsync d3/dc/d2d/f84 0 2024-04-13T10:58:40.744 INFO:tasks.workunit.client.1.smithi194.stdout:7/498: stat d1/d2b/d3e/c61 0 2024-04-13T10:58:40.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:40 smithi194 ceph-mon[46737]: pgmap v24: 65 pgs: 65 active+clean; 953 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 MiB/s rd, 122 MiB/s wr, 384 op/s 2024-04-13T10:58:40.753 INFO:tasks.workunit.client.1.smithi194.stdout:5/457: creat d3/dc/d10/d38/d59/d49/f88 x:0 0 0 2024-04-13T10:58:40.754 INFO:tasks.workunit.client.1.smithi194.stdout:4/509: dwrite d2/d16/d1a/d1c/d3b/d42/f82 [0,4194304] 0 2024-04-13T10:58:40.757 INFO:tasks.workunit.client.1.smithi194.stdout:3/487: dwrite d2/d3/d12/d31/d34/d88/d24/f38 [0,4194304] 0 2024-04-13T10:58:40.758 INFO:tasks.workunit.client.1.smithi194.stdout:0/435: dwrite d9/db/f3d [0,4194304] 0 2024-04-13T10:58:40.764 INFO:tasks.workunit.client.1.smithi194.stdout:0/436: read d9/f4b [1162964,113515] 0 2024-04-13T10:58:40.765 INFO:tasks.workunit.client.1.smithi194.stdout:5/458: unlink d3/d29/l78 0 2024-04-13T10:58:40.767 INFO:tasks.workunit.client.1.smithi194.stdout:2/488: dwrite d2/d3/de/d17/d1e/d42/d86/f89 [0,4194304] 0 2024-04-13T10:58:40.770 INFO:tasks.workunit.client.1.smithi194.stdout:4/510: rename d2/l10 to d2/d16/d70/d31/laa 0 2024-04-13T10:58:40.771 INFO:tasks.workunit.client.1.smithi194.stdout:0/437: chown d9/db/l62 504101 1 2024-04-13T10:58:40.771 INFO:tasks.workunit.client.1.smithi194.stdout:2/489: read d2/d3/de/d17/d36/d7a/f7d [3929583,1919] 0 2024-04-13T10:58:40.773 INFO:tasks.workunit.client.1.smithi194.stdout:5/459: truncate d3/dc/d10/d38/d59/d7a/f86 1606661 0 2024-04-13T10:58:40.773 INFO:tasks.workunit.client.1.smithi194.stdout:0/438: write d9/f4b [3993870,128875] 0 2024-04-13T10:58:40.773 INFO:tasks.workunit.client.1.smithi194.stdout:7/499: truncate d1/d2b/d2c/d30/d33/d39/f3d 865011 0 2024-04-13T10:58:40.776 INFO:tasks.workunit.client.1.smithi194.stdout:3/488: rename d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/f6a to d2/d7d/f9f 0 2024-04-13T10:58:40.777 INFO:tasks.workunit.client.1.smithi194.stdout:3/489: readlink d2/d3/d12/d21/l7a 0 2024-04-13T10:58:40.782 INFO:tasks.workunit.client.1.smithi194.stdout:7/500: write d1/d2b/d2c/d30/d33/d39/f3d [1519110,101165] 0 2024-04-13T10:58:40.783 INFO:tasks.workunit.client.1.smithi194.stdout:0/439: creat d9/db/d19/f90 x:0 0 0 2024-04-13T10:58:40.784 INFO:tasks.workunit.client.1.smithi194.stdout:7/501: fsync d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f6d 0 2024-04-13T10:58:40.785 INFO:tasks.workunit.client.1.smithi194.stdout:0/440: chown d9/db/f36 730341 1 2024-04-13T10:58:40.786 INFO:tasks.workunit.client.1.smithi194.stdout:2/490: rename d2/d3/de/d17/d1e/f51 to d2/d3/fa4 0 2024-04-13T10:58:40.789 INFO:tasks.workunit.client.1.smithi194.stdout:7/502: fsync d1/f41 0 2024-04-13T10:58:40.791 INFO:tasks.workunit.client.1.smithi194.stdout:5/460: dwrite d3/dc/d10/d38/d59/d7a/f86 [0,4194304] 0 2024-04-13T10:58:40.791 INFO:tasks.workunit.client.1.smithi194.stdout:3/490: rename d2/d3/d12/d31/d34/d88/c70 to d2/d3/d12/d31/d34/d88/d24/d3a/d56/ca0 0 2024-04-13T10:58:40.793 INFO:tasks.workunit.client.1.smithi194.stdout:2/491: creat d2/d3/de/d33/d71/fa5 x:0 0 0 2024-04-13T10:58:40.795 INFO:tasks.workunit.client.1.smithi194.stdout:0/441: dwrite d9/db/f1b [0,4194304] 0 2024-04-13T10:58:40.797 INFO:tasks.workunit.client.1.smithi194.stdout:7/503: mknod d1/d2b/d3e/d54/d6b/ca4 0 2024-04-13T10:58:40.798 INFO:tasks.workunit.client.1.smithi194.stdout:3/491: mknod d2/d3/d12/d31/d34/d88/d24/d3a/ca1 0 2024-04-13T10:58:40.799 INFO:tasks.workunit.client.1.smithi194.stdout:5/461: mkdir d3/d89 0 2024-04-13T10:58:40.804 INFO:tasks.workunit.client.1.smithi194.stdout:0/442: dwrite d9/f54 [0,4194304] 0 2024-04-13T10:58:40.806 INFO:tasks.workunit.client.1.smithi194.stdout:7/504: link d1/d6c/ca0 d1/d6c/ca5 0 2024-04-13T10:58:40.806 INFO:tasks.workunit.client.1.smithi194.stdout:2/492: dread d2/d3/d12/f1c [0,4194304] 0 2024-04-13T10:58:40.808 INFO:tasks.workunit.client.1.smithi194.stdout:7/505: stat d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f71 0 2024-04-13T10:58:40.809 INFO:tasks.workunit.client.1.smithi194.stdout:2/493: symlink d2/d3/d12/la6 0 2024-04-13T10:58:40.812 INFO:tasks.workunit.client.1.smithi194.stdout:7/506: creat d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/fa6 x:0 0 0 2024-04-13T10:58:40.816 INFO:tasks.workunit.client.1.smithi194.stdout:0/443: link d9/db/d19/c47 d9/d6f/c91 0 2024-04-13T10:58:40.819 INFO:tasks.workunit.client.1.smithi194.stdout:0/444: read d9/db/d19/d28/f53 [1141497,24361] 0 2024-04-13T10:58:40.820 INFO:tasks.workunit.client.1.smithi194.stdout:0/445: truncate d9/db/f33 2254665 0 2024-04-13T10:58:40.821 INFO:tasks.workunit.client.1.smithi194.stdout:0/446: write d9/db/f3d [333271,45201] 0 2024-04-13T10:58:40.830 INFO:tasks.workunit.client.1.smithi194.stdout:7/507: dread d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f6d [0,4194304] 0 2024-04-13T10:58:40.833 INFO:tasks.workunit.client.1.smithi194.stdout:5/462: write d3/f1f [8072410,57193] 0 2024-04-13T10:58:40.834 INFO:tasks.workunit.client.1.smithi194.stdout:3/492: truncate d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 334245 0 2024-04-13T10:58:40.836 INFO:tasks.workunit.client.1.smithi194.stdout:3/493: fdatasync d2/d3/f43 0 2024-04-13T10:58:40.836 INFO:tasks.workunit.client.1.smithi194.stdout:5/463: getdents d3/d29/d85 0 2024-04-13T10:58:40.838 INFO:tasks.workunit.client.1.smithi194.stdout:7/508: dwrite d1/d2b/d3e/d54/d5a/f78 [4194304,4194304] 0 2024-04-13T10:58:40.844 INFO:tasks.workunit.client.1.smithi194.stdout:7/509: chown d1/d2b/d2c/d30/d33/d39/c45 20 1 2024-04-13T10:58:40.845 INFO:tasks.workunit.client.1.smithi194.stdout:2/494: dwrite d2/d3/de/f1a [0,4194304] 0 2024-04-13T10:58:40.846 INFO:tasks.workunit.client.1.smithi194.stdout:0/447: dwrite d9/db/d19/f50 [0,4194304] 0 2024-04-13T10:58:40.851 INFO:tasks.workunit.client.1.smithi194.stdout:3/494: truncate d2/fd 33708 0 2024-04-13T10:58:40.851 INFO:tasks.workunit.client.1.smithi194.stdout:5/464: write d3/dc/f18 [1401794,39904] 0 2024-04-13T10:58:40.853 INFO:tasks.workunit.client.1.smithi194.stdout:7/510: chown d1/d2b/d2c/d30/c44 164684614 1 2024-04-13T10:58:40.854 INFO:tasks.workunit.client.1.smithi194.stdout:2/495: mknod d2/ca7 0 2024-04-13T10:58:40.855 INFO:tasks.workunit.client.1.smithi194.stdout:7/511: readlink d1/d2b/d4c/d4f/d6e/l98 0 2024-04-13T10:58:40.856 INFO:tasks.workunit.client.1.smithi194.stdout:5/465: creat d3/dc/d17/d1b/f8a x:0 0 0 2024-04-13T10:58:40.856 INFO:tasks.workunit.client.1.smithi194.stdout:2/496: chown d2/d3/de/d33/d71/l98 58 1 2024-04-13T10:58:40.857 INFO:tasks.workunit.client.1.smithi194.stdout:7/512: write d1/d2b/d3e/d54/d5a/f49 [1078273,64624] 0 2024-04-13T10:58:40.861 INFO:tasks.workunit.client.1.smithi194.stdout:0/448: link d9/df/l34 d9/df/d16/l92 0 2024-04-13T10:58:40.862 INFO:tasks.workunit.client.1.smithi194.stdout:5/466: creat d3/dc/d10/d38/d59/f8b x:0 0 0 2024-04-13T10:58:40.865 INFO:tasks.workunit.client.1.smithi194.stdout:5/467: mknod d3/dc/d10/d38/d59/d7a/c8c 0 2024-04-13T10:58:40.868 INFO:tasks.workunit.client.1.smithi194.stdout:0/449: dwrite d9/d2b/d5a/f5b [0,4194304] 0 2024-04-13T10:58:40.868 INFO:tasks.workunit.client.1.smithi194.stdout:1/434: sync 2024-04-13T10:58:40.871 INFO:tasks.workunit.client.1.smithi194.stdout:7/513: read d1/f16 [712149,53329] 0 2024-04-13T10:58:40.876 INFO:tasks.workunit.client.1.smithi194.stdout:0/450: mknod d9/c93 0 2024-04-13T10:58:40.878 INFO:tasks.workunit.client.1.smithi194.stdout:5/468: write d3/dc/d10/d38/d59/d49/f88 [961184,79425] 0 2024-04-13T10:58:40.878 INFO:tasks.workunit.client.1.smithi194.stdout:7/514: creat d1/d2b/d4c/d4f/d51/d4d/fa7 x:0 0 0 2024-04-13T10:58:40.880 INFO:tasks.workunit.client.1.smithi194.stdout:3/495: dread d2/d3/d12/d31/d34/d88/d24/f4c [0,4194304] 0 2024-04-13T10:58:40.882 INFO:tasks.workunit.client.1.smithi194.stdout:0/451: creat d9/df/d16/d75/f94 x:0 0 0 2024-04-13T10:58:40.886 INFO:tasks.workunit.client.1.smithi194.stdout:3/496: fdatasync d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 0 2024-04-13T10:58:40.886 INFO:tasks.workunit.client.1.smithi194.stdout:7/515: dwrite d1/f29 [0,4194304] 0 2024-04-13T10:58:40.894 INFO:tasks.workunit.client.1.smithi194.stdout:3/497: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d78/la2 0 2024-04-13T10:58:40.895 INFO:tasks.workunit.client.1.smithi194.stdout:7/516: dwrite d1/d2b/d3e/d54/d5a/f78 [4194304,4194304] 0 2024-04-13T10:58:40.896 INFO:tasks.workunit.client.1.smithi194.stdout:5/469: write d3/dc/d10/f61 [68804,107720] 0 2024-04-13T10:58:40.899 INFO:tasks.workunit.client.1.smithi194.stdout:5/470: write d3/dc/d10/d38/f60 [226961,56375] 0 2024-04-13T10:58:40.899 INFO:tasks.workunit.client.1.smithi194.stdout:7/517: rmdir d1/d2b/d3e 39 2024-04-13T10:58:40.900 INFO:tasks.workunit.client.1.smithi194.stdout:5/471: fsync d3/dc/d17/f63 0 2024-04-13T10:58:40.905 INFO:tasks.workunit.client.1.smithi194.stdout:5/472: rename d3/d83/l33 to d3/dc/d10/l8d 0 2024-04-13T10:58:40.908 INFO:tasks.workunit.client.1.smithi194.stdout:3/498: link d2/d3/d12/d31/d34/d88/f42 d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/fa3 0 2024-04-13T10:58:40.910 INFO:tasks.workunit.client.1.smithi194.stdout:1/435: dread d12/d13/d1c/f21 [0,4194304] 0 2024-04-13T10:58:40.911 INFO:tasks.workunit.client.1.smithi194.stdout:7/518: getdents d1/d2b/d3e/d54/d5a 0 2024-04-13T10:58:40.913 INFO:tasks.workunit.client.1.smithi194.stdout:3/499: read d2/d3/d12/d31/d34/d88/d24/d3a/d72/f8c [297539,22219] 0 2024-04-13T10:58:40.913 INFO:tasks.workunit.client.1.smithi194.stdout:5/473: dwrite d3/dc/d10/d38/f4d [0,4194304] 0 2024-04-13T10:58:40.915 INFO:tasks.workunit.client.1.smithi194.stdout:5/474: read - d3/d29/f87 zero size 2024-04-13T10:58:40.917 INFO:tasks.workunit.client.1.smithi194.stdout:5/475: dread - d3/dc/d10/f3b zero size 2024-04-13T10:58:40.918 INFO:tasks.workunit.client.1.smithi194.stdout:1/436: getdents d12/d13/d1c/d27/d4c 0 2024-04-13T10:58:40.918 INFO:tasks.workunit.client.1.smithi194.stdout:1/437: chown d12/d13/d1c/d27 0 1 2024-04-13T10:58:40.921 INFO:tasks.workunit.client.1.smithi194.stdout:5/476: symlink d3/dc/d17/l8e 0 2024-04-13T10:58:40.921 INFO:tasks.workunit.client.1.smithi194.stdout:1/438: mknod d12/d13/d1c/d28/c92 0 2024-04-13T10:58:40.925 INFO:tasks.workunit.client.1.smithi194.stdout:5/477: rename d3/dc/d10/f3c to d3/d83/f8f 0 2024-04-13T10:58:40.930 INFO:tasks.workunit.client.1.smithi194.stdout:1/439: mkdir d12/d13/d1c/d28/d41/d77/d93 0 2024-04-13T10:58:40.930 INFO:tasks.workunit.client.1.smithi194.stdout:1/440: fsync d12/d13/d1c/f31 0 2024-04-13T10:58:40.930 INFO:tasks.workunit.client.1.smithi194.stdout:1/441: chown d12/d3a/d4f 16066179 1 2024-04-13T10:58:40.932 INFO:tasks.workunit.client.1.smithi194.stdout:1/442: truncate f1 417767 0 2024-04-13T10:58:40.933 INFO:tasks.workunit.client.1.smithi194.stdout:7/519: truncate d1/d2b/f47 35615 0 2024-04-13T10:58:40.936 INFO:tasks.workunit.client.1.smithi194.stdout:3/500: dread d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:40.937 INFO:tasks.workunit.client.1.smithi194.stdout:7/520: creat d1/d2b/d4c/d4f/d85/d88/d9b/fa8 x:0 0 0 2024-04-13T10:58:40.938 INFO:tasks.workunit.client.1.smithi194.stdout:1/443: dwrite d12/f1a [0,4194304] 0 2024-04-13T10:58:40.940 INFO:tasks.workunit.client.1.smithi194.stdout:1/444: write d12/d13/d3e/f66 [726853,63618] 0 2024-04-13T10:58:40.941 INFO:tasks.workunit.client.1.smithi194.stdout:7/521: creat d1/d2b/d4c/d4f/d51/d4d/fa9 x:0 0 0 2024-04-13T10:58:40.946 INFO:tasks.workunit.client.1.smithi194.stdout:3/501: link d2/d7d/f9f d2/d3/d12/d31/d34/d88/d24/d3a/d56/d78/fa4 0 2024-04-13T10:58:40.949 INFO:tasks.workunit.client.1.smithi194.stdout:3/502: getdents d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61 0 2024-04-13T10:58:40.950 INFO:tasks.workunit.client.1.smithi194.stdout:3/503: stat d2/d3/c54 0 2024-04-13T10:58:40.952 INFO:tasks.workunit.client.1.smithi194.stdout:3/504: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5 0 2024-04-13T10:58:40.954 INFO:tasks.workunit.client.1.smithi194.stdout:3/505: mknod d2/d3/ca6 0 2024-04-13T10:58:40.958 INFO:tasks.workunit.client.1.smithi194.stdout:3/506: unlink d2/d3/d12/d31/d34/d88/d24/l36 0 2024-04-13T10:58:40.960 INFO:tasks.workunit.client.1.smithi194.stdout:3/507: creat d2/d3/d12/d21/fa7 x:0 0 0 2024-04-13T10:58:40.963 INFO:tasks.workunit.client.1.smithi194.stdout:7/522: dread d1/f12 [0,4194304] 0 2024-04-13T10:58:40.964 INFO:tasks.workunit.client.1.smithi194.stdout:3/508: dread d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:40.965 INFO:tasks.workunit.client.1.smithi194.stdout:7/523: write d1/d2b/d2c/d30/d33/d39/f4b [1910211,116278] 0 2024-04-13T10:58:40.966 INFO:tasks.workunit.client.1.smithi194.stdout:1/445: dread d12/f81 [0,4194304] 0 2024-04-13T10:58:40.968 INFO:tasks.workunit.client.1.smithi194.stdout:1/446: creat d12/d13/d44/f94 x:0 0 0 2024-04-13T10:58:40.970 INFO:tasks.workunit.client.1.smithi194.stdout:7/524: dread - d1/d2b/d3e/d54/d5a/d80/d96/fa1 zero size 2024-04-13T10:58:40.971 INFO:tasks.workunit.client.1.smithi194.stdout:7/525: dread - d1/d2b/d3e/d54/d5a/d80/d96/fa1 zero size 2024-04-13T10:58:40.971 INFO:tasks.workunit.client.1.smithi194.stdout:1/447: rmdir d12/d13/d1c/d28/d41/d77/d80 39 2024-04-13T10:58:40.972 INFO:tasks.workunit.client.1.smithi194.stdout:1/448: write d12/f1a [3638841,73450] 0 2024-04-13T10:58:40.974 INFO:tasks.workunit.client.1.smithi194.stdout:1/449: chown d12/d13/d3e/l30 193 1 2024-04-13T10:58:40.977 INFO:tasks.workunit.client.1.smithi194.stdout:7/526: dwrite d1/f29 [0,4194304] 0 2024-04-13T10:58:40.979 INFO:tasks.workunit.client.1.smithi194.stdout:1/450: creat d12/d13/d1c/d27/d4c/d7d/f95 x:0 0 0 2024-04-13T10:58:40.981 INFO:tasks.workunit.client.1.smithi194.stdout:1/451: fsync d12/d13/d1c/d53/f8d 0 2024-04-13T10:58:40.982 INFO:tasks.workunit.client.1.smithi194.stdout:7/527: mknod d1/d2b/d2c/d30/caa 0 2024-04-13T10:58:40.984 INFO:tasks.workunit.client.1.smithi194.stdout:7/528: chown d1/d2b/d4c/d4f/d51/l57 10 1 2024-04-13T10:58:40.985 INFO:tasks.workunit.client.1.smithi194.stdout:3/509: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d78/fa4 [0,4194304] 0 2024-04-13T10:58:40.987 INFO:tasks.workunit.client.1.smithi194.stdout:1/452: write d12/d13/d1c/d27/d2e/f62 [1804884,45376] 0 2024-04-13T10:58:40.987 INFO:tasks.workunit.client.1.smithi194.stdout:7/529: dread d1/d2b/d4c/d4f/d6e/f76 [0,4194304] 0 2024-04-13T10:58:40.988 INFO:tasks.workunit.client.1.smithi194.stdout:7/530: stat d1/d2b/d4c/d4f/d51/l35 0 2024-04-13T10:58:40.990 INFO:tasks.workunit.client.1.smithi194.stdout:7/531: write d1/f29 [630454,98356] 0 2024-04-13T10:58:40.992 INFO:tasks.workunit.client.1.smithi194.stdout:1/453: mkdir d12/d13/d1c/d28/d41/d50/d96 0 2024-04-13T10:58:40.992 INFO:tasks.workunit.client.1.smithi194.stdout:3/510: truncate d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d57/f73 821640 0 2024-04-13T10:58:40.998 INFO:tasks.workunit.client.1.smithi194.stdout:3/511: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/ca8 0 2024-04-13T10:58:40.998 INFO:tasks.workunit.client.1.smithi194.stdout:7/532: getdents d1/d2b/d3e/d9c 0 2024-04-13T10:58:40.998 INFO:tasks.workunit.client.1.smithi194.stdout:3/512: write d2/d3/f3d [1105669,112244] 0 2024-04-13T10:58:40.999 INFO:tasks.workunit.client.1.smithi194.stdout:1/454: rmdir d12/d13/d1c/d27 39 2024-04-13T10:58:40.999 INFO:tasks.workunit.client.1.smithi194.stdout:7/533: stat d1/d2b/d4c/d4f/d51/f56 0 2024-04-13T10:58:41.002 INFO:tasks.workunit.client.1.smithi194.stdout:3/513: chown d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/fa3 997867969 1 2024-04-13T10:58:41.004 INFO:tasks.workunit.client.1.smithi194.stdout:7/534: rename d1/d2b/d3e/d54/d5a/d80 to d1/d2b/d4c/d7e/dab 0 2024-04-13T10:58:41.005 INFO:tasks.workunit.client.1.smithi194.stdout:3/514: creat d2/d3/d12/d31/d34/d88/fa9 x:0 0 0 2024-04-13T10:58:41.009 INFO:tasks.workunit.client.1.smithi194.stdout:1/455: dwrite d12/d13/d1c/d27/f74 [0,4194304] 0 2024-04-13T10:58:41.009 INFO:tasks.workunit.client.1.smithi194.stdout:7/535: write d1/f95 [836638,48864] 0 2024-04-13T10:58:41.010 INFO:tasks.workunit.client.1.smithi194.stdout:3/515: dread - d2/d3/d12/d31/d34/d88/d24/d3a/f6e zero size 2024-04-13T10:58:41.011 INFO:tasks.workunit.client.1.smithi194.stdout:1/456: chown d12/d13/d44/l69 820205653 1 2024-04-13T10:58:41.012 INFO:tasks.workunit.client.1.smithi194.stdout:3/516: chown d2/d3/d12/d21/l7a 337540897 1 2024-04-13T10:58:41.014 INFO:tasks.workunit.client.1.smithi194.stdout:1/457: mknod d12/d13/d1c/d28/d41/c97 0 2024-04-13T10:58:41.014 INFO:tasks.workunit.client.1.smithi194.stdout:3/517: truncate d2/d3/d12/d31/d34/d88/f2e 5077782 0 2024-04-13T10:58:41.014 INFO:tasks.workunit.client.1.smithi194.stdout:7/536: creat d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/fac x:0 0 0 2024-04-13T10:58:41.019 INFO:tasks.workunit.client.1.smithi194.stdout:7/537: getdents d1/d2b/d3e/d9c 0 2024-04-13T10:58:41.019 INFO:tasks.workunit.client.1.smithi194.stdout:9/441: sync 2024-04-13T10:58:41.020 INFO:tasks.workunit.client.1.smithi194.stdout:8/479: sync 2024-04-13T10:58:41.021 INFO:tasks.workunit.client.1.smithi194.stdout:1/458: link d12/d13/d1c/d27/d2e/f88 d12/d13/d1c/d27/f98 0 2024-04-13T10:58:41.023 INFO:tasks.workunit.client.1.smithi194.stdout:3/518: link d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/l6f d2/d3/d12/d31/d34/d88/d24/d82/laa 0 2024-04-13T10:58:41.028 INFO:tasks.workunit.client.1.smithi194.stdout:8/480: link d6/d22/d23/d25/d39/d41/d5b/d76/f4f d6/d22/d23/d25/d39/fa4 0 2024-04-13T10:58:41.030 INFO:tasks.workunit.client.1.smithi194.stdout:3/519: rename d2/d3/ca6 to d2/d3/d12/d31/d34/d88/cab 0 2024-04-13T10:58:41.031 INFO:tasks.workunit.client.1.smithi194.stdout:7/538: getdents d1/d2b/d4c/d7e/dab/d96 0 2024-04-13T10:58:41.036 INFO:tasks.workunit.client.1.smithi194.stdout:3/520: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/fac x:0 0 0 2024-04-13T10:58:41.036 INFO:tasks.workunit.client.1.smithi194.stdout:7/539: dread d1/d2b/d4c/d7e/dab/f8c [4194304,4194304] 0 2024-04-13T10:58:41.036 INFO:tasks.workunit.client.1.smithi194.stdout:8/481: link d6/dd/ca d6/d22/d23/ca5 0 2024-04-13T10:58:41.038 INFO:tasks.workunit.client.1.smithi194.stdout:9/442: dread d0/d6/d14/d26/d3b/f59 [0,4194304] 0 2024-04-13T10:58:41.039 INFO:tasks.workunit.client.1.smithi194.stdout:1/459: dread f10 [0,4194304] 0 2024-04-13T10:58:41.039 INFO:tasks.workunit.client.1.smithi194.stdout:9/443: chown d0/d6/d2c 19 1 2024-04-13T10:58:41.039 INFO:tasks.workunit.client.1.smithi194.stdout:7/540: rmdir d1/d2b/d3e 39 2024-04-13T10:58:41.040 INFO:tasks.workunit.client.1.smithi194.stdout:3/521: creat d2/d3/d12/d31/d34/d88/fad x:0 0 0 2024-04-13T10:58:41.041 INFO:tasks.workunit.client.1.smithi194.stdout:8/482: creat d6/dd/fa6 x:0 0 0 2024-04-13T10:58:41.044 INFO:tasks.workunit.client.1.smithi194.stdout:8/483: stat d6/d22/d23/d25/d78 0 2024-04-13T10:58:41.044 INFO:tasks.workunit.client.1.smithi194.stdout:9/444: creat d0/d6/f95 x:0 0 0 2024-04-13T10:58:41.048 INFO:tasks.workunit.client.1.smithi194.stdout:7/541: dread d1/f12 [0,4194304] 0 2024-04-13T10:58:41.048 INFO:tasks.workunit.client.1.smithi194.stdout:9/445: symlink d0/d11/d3d/l96 0 2024-04-13T10:58:41.054 INFO:tasks.workunit.client.1.smithi194.stdout:3/522: dwrite d2/d3/d12/d31/d34/d88/fa9 [0,4194304] 0 2024-04-13T10:58:41.055 INFO:tasks.workunit.client.1.smithi194.stdout:8/484: dread d6/dd/f19 [0,4194304] 0 2024-04-13T10:58:41.056 INFO:tasks.workunit.client.1.smithi194.stdout:1/460: dread d12/d13/d1c/d28/f46 [0,4194304] 0 2024-04-13T10:58:41.056 INFO:tasks.workunit.client.1.smithi194.stdout:3/523: dread - d2/d3/d12/d31/d34/d88/d24/d6c/f9b zero size 2024-04-13T10:58:41.057 INFO:tasks.workunit.client.1.smithi194.stdout:1/461: chown d12/d13/d1c/d28/d41 919 1 2024-04-13T10:58:41.062 INFO:tasks.workunit.client.1.smithi194.stdout:3/524: dwrite d2/d7d/f9f [0,4194304] 0 2024-04-13T10:58:41.098 INFO:tasks.workunit.client.1.smithi194.stdout:6/465: sync 2024-04-13T10:58:41.099 INFO:tasks.workunit.client.1.smithi194.stdout:7/542: mknod d1/d2b/d3e/d54/d6b/cad 0 2024-04-13T10:58:41.099 INFO:tasks.workunit.client.1.smithi194.stdout:6/466: fdatasync d0/d26/d2b/f40 0 2024-04-13T10:58:41.102 INFO:tasks.workunit.client.1.smithi194.stdout:9/446: rename d0/d11/d58/c75 to d0/d6/d2c/d68/c97 0 2024-04-13T10:58:41.103 INFO:tasks.workunit.client.1.smithi194.stdout:9/447: read d0/d6/d2c/d68/f6a [320618,63561] 0 2024-04-13T10:58:41.105 INFO:tasks.workunit.client.1.smithi194.stdout:8/485: mknod d6/d22/d23/d3d/ca7 0 2024-04-13T10:58:41.110 INFO:tasks.workunit.client.1.smithi194.stdout:1/462: creat d12/d13/d44/f99 x:0 0 0 2024-04-13T10:58:41.110 INFO:tasks.workunit.client.1.smithi194.stdout:8/486: dwrite d6/d22/d23/d3d/f65 [0,4194304] 0 2024-04-13T10:58:41.111 INFO:tasks.workunit.client.1.smithi194.stdout:3/525: write d2/d3/d12/f63 [26439,79480] 0 2024-04-13T10:58:41.112 INFO:tasks.workunit.client.1.smithi194.stdout:6/467: rename d0/d2c/l8e to d0/d26/d2b/d4d/d80/l92 0 2024-04-13T10:58:41.114 INFO:tasks.workunit.client.1.smithi194.stdout:6/468: chown d0/d26/f5c 145218 1 2024-04-13T10:58:41.120 INFO:tasks.workunit.client.1.smithi194.stdout:9/448: creat d0/d88/f98 x:0 0 0 2024-04-13T10:58:41.122 INFO:tasks.workunit.client.1.smithi194.stdout:8/487: fsync d6/d22/d23/d25/d39/d41/d5b/d76/f4f 0 2024-04-13T10:58:41.122 INFO:tasks.workunit.client.1.smithi194.stdout:6/469: dwrite d0/d26/d2b/f7a [0,4194304] 0 2024-04-13T10:58:41.123 INFO:tasks.workunit.client.1.smithi194.stdout:1/463: dwrite d12/d13/d3e/f2d [0,4194304] 0 2024-04-13T10:58:41.124 INFO:tasks.workunit.client.1.smithi194.stdout:6/470: write d0/d2c/f6c [794359,49252] 0 2024-04-13T10:58:41.127 INFO:tasks.workunit.client.1.smithi194.stdout:3/526: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/fae x:0 0 0 2024-04-13T10:58:41.129 INFO:tasks.workunit.client.1.smithi194.stdout:3/527: truncate d2/d3/d12/d31/f5e 211245 0 2024-04-13T10:58:41.136 INFO:tasks.workunit.client.1.smithi194.stdout:1/464: creat d12/d3a/f9a x:0 0 0 2024-04-13T10:58:41.137 INFO:tasks.workunit.client.1.smithi194.stdout:6/471: dwrite d0/d2c/f3e [0,4194304] 0 2024-04-13T10:58:41.139 INFO:tasks.workunit.client.1.smithi194.stdout:9/449: creat d0/d6/d4a/d74/f99 x:0 0 0 2024-04-13T10:58:41.140 INFO:tasks.workunit.client.1.smithi194.stdout:3/528: truncate d2/d3/d12/d31/d34/d88/f42 611464 0 2024-04-13T10:58:41.144 INFO:tasks.workunit.client.1.smithi194.stdout:6/472: readlink d0/d57/l7e 0 2024-04-13T10:58:41.144 INFO:tasks.workunit.client.1.smithi194.stdout:1/465: dwrite d12/d3a/f9a [0,4194304] 0 2024-04-13T10:58:41.145 INFO:tasks.workunit.client.1.smithi194.stdout:9/450: readlink d0/d11/d44/l8d 0 2024-04-13T10:58:41.150 INFO:tasks.workunit.client.1.smithi194.stdout:6/473: mkdir d0/d2c/d77/d93 0 2024-04-13T10:58:41.158 INFO:tasks.workunit.client.1.smithi194.stdout:9/451: dwrite d0/d6/f7b [0,4194304] 0 2024-04-13T10:58:41.170 INFO:tasks.workunit.client.1.smithi194.stdout:9/452: link d0/d11/f1d d0/d6/d9/d51/f9a 0 2024-04-13T10:58:41.174 INFO:tasks.workunit.client.1.smithi194.stdout:9/453: mkdir d0/d11/d3d/d9b 0 2024-04-13T10:58:41.179 INFO:tasks.workunit.client.1.smithi194.stdout:9/454: dwrite d0/f20 [0,4194304] 0 2024-04-13T10:58:41.182 INFO:tasks.workunit.client.1.smithi194.stdout:9/455: mknod d0/d6/d9/d70/c9c 0 2024-04-13T10:58:41.184 INFO:tasks.workunit.client.1.smithi194.stdout:9/456: truncate d0/d11/d3d/f89 1013171 0 2024-04-13T10:58:41.190 INFO:tasks.workunit.client.1.smithi194.stdout:9/457: dread d0/d6/d14/d26/d3b/f63 [0,4194304] 0 2024-04-13T10:58:41.191 INFO:tasks.workunit.client.1.smithi194.stdout:9/458: truncate d0/d11/d58/f5f 4961234 0 2024-04-13T10:58:41.196 INFO:tasks.workunit.client.1.smithi194.stdout:9/459: link d0/d11/c82 d0/d11/d58/c9d 0 2024-04-13T10:58:41.202 INFO:tasks.workunit.client.1.smithi194.stdout:9/460: getdents d0/d6/d14 0 2024-04-13T10:58:41.204 INFO:tasks.workunit.client.1.smithi194.stdout:9/461: unlink d0/d11/d1e/l1f 0 2024-04-13T10:58:41.206 INFO:tasks.workunit.client.1.smithi194.stdout:9/462: mkdir d0/d6/d9/d9e 0 2024-04-13T10:58:41.210 INFO:tasks.workunit.client.1.smithi194.stdout:2/497: sync 2024-04-13T10:58:41.210 INFO:tasks.workunit.client.1.smithi194.stdout:4/511: sync 2024-04-13T10:58:41.210 INFO:tasks.workunit.client.1.smithi194.stdout:5/478: sync 2024-04-13T10:58:41.210 INFO:tasks.workunit.client.1.smithi194.stdout:0/452: sync 2024-04-13T10:58:41.211 INFO:tasks.workunit.client.1.smithi194.stdout:0/453: chown d9/df/d16/d75/f94 139073198 1 2024-04-13T10:58:41.212 INFO:tasks.workunit.client.1.smithi194.stdout:0/454: readlink d9/db/l62 0 2024-04-13T10:58:41.212 INFO:tasks.workunit.client.1.smithi194.stdout:5/479: dread d3/dc/d10/d38/d46/f53 [0,4194304] 0 2024-04-13T10:58:41.212 INFO:tasks.workunit.client.1.smithi194.stdout:4/512: creat d2/d33/fab x:0 0 0 2024-04-13T10:58:41.215 INFO:tasks.workunit.client.1.smithi194.stdout:5/480: write d3/dc/d10/d38/d46/f65 [803185,26519] 0 2024-04-13T10:58:41.217 INFO:tasks.workunit.client.1.smithi194.stdout:0/455: mknod d9/d2b/d6c/c95 0 2024-04-13T10:58:41.219 INFO:tasks.workunit.client.1.smithi194.stdout:1/466: write d12/d13/d1c/d28/d41/f84 [3643889,89006] 0 2024-04-13T10:58:41.221 INFO:tasks.workunit.client.1.smithi194.stdout:2/498: dread d2/d3/de/d17/d1e/f2c [4194304,4194304] 0 2024-04-13T10:58:41.222 INFO:tasks.workunit.client.1.smithi194.stdout:0/456: creat d9/d2b/f96 x:0 0 0 2024-04-13T10:58:41.223 INFO:tasks.workunit.client.1.smithi194.stdout:4/513: dwrite d2/d16/d70/f68 [0,4194304] 0 2024-04-13T10:58:41.226 INFO:tasks.workunit.client.1.smithi194.stdout:4/514: write d2/d16/d1a/d1c/d3b/f72 [316041,54075] 0 2024-04-13T10:58:41.228 INFO:tasks.workunit.client.1.smithi194.stdout:1/467: dread d12/d13/d1c/f31 [0,4194304] 0 2024-04-13T10:58:41.230 INFO:tasks.workunit.client.1.smithi194.stdout:4/515: write d2/d16/d1a/d1c/d54/f5f [1404528,96203] 0 2024-04-13T10:58:41.230 INFO:tasks.workunit.client.1.smithi194.stdout:5/481: truncate d3/dc/d10/d38/d59/f64 883061 0 2024-04-13T10:58:41.232 INFO:tasks.workunit.client.1.smithi194.stdout:4/516: write d2/d16/d1a/f6f [4980870,47537] 0 2024-04-13T10:58:41.233 INFO:tasks.workunit.client.1.smithi194.stdout:0/457: dwrite d9/db/d3a/f49 [0,4194304] 0 2024-04-13T10:58:41.234 INFO:tasks.workunit.client.1.smithi194.stdout:7/543: sync 2024-04-13T10:58:41.234 INFO:tasks.workunit.client.1.smithi194.stdout:0/458: write d9/db/f36 [1328352,29748] 0 2024-04-13T10:58:41.235 INFO:tasks.workunit.client.1.smithi194.stdout:0/459: dread - d9/d2b/f96 zero size 2024-04-13T10:58:41.236 INFO:tasks.workunit.client.1.smithi194.stdout:1/468: creat d12/d13/d1c/d27/d2e/f9b x:0 0 0 2024-04-13T10:58:41.237 INFO:tasks.workunit.client.1.smithi194.stdout:1/469: chown d12/f5b 706 1 2024-04-13T10:58:41.239 INFO:tasks.workunit.client.1.smithi194.stdout:5/482: rename d3/l4a to d3/dc/d10/d38/d46/l90 0 2024-04-13T10:58:41.239 INFO:tasks.workunit.client.1.smithi194.stdout:4/517: creat d2/d30/d50/fac x:0 0 0 2024-04-13T10:58:41.242 INFO:tasks.workunit.client.1.smithi194.stdout:7/544: chown d1/cb 12 1 2024-04-13T10:58:41.243 INFO:tasks.workunit.client.1.smithi194.stdout:6/474: rmdir d0/d26/d4b 39 2024-04-13T10:58:41.243 INFO:tasks.workunit.client.1.smithi194.stdout:7/545: fsync d1/d2b/d2c/d30/f32 0 2024-04-13T10:58:41.244 INFO:tasks.workunit.client.1.smithi194.stdout:0/460: rmdir d9/db/d19/d30 39 2024-04-13T10:58:41.246 INFO:tasks.workunit.client.1.smithi194.stdout:8/488: creat d6/d22/d23/d25/fa8 x:0 0 0 2024-04-13T10:58:41.247 INFO:tasks.workunit.client.1.smithi194.stdout:5/483: symlink d3/dc/d10/d38/d59/d49/l91 0 2024-04-13T10:58:41.248 INFO:tasks.workunit.client.1.smithi194.stdout:4/518: mknod d2/d16/d1a/d1c/d54/cad 0 2024-04-13T10:58:41.249 INFO:tasks.workunit.client.1.smithi194.stdout:6/475: creat d0/d57/f94 x:0 0 0 2024-04-13T10:58:41.251 INFO:tasks.workunit.client.1.smithi194.stdout:0/461: dwrite d9/d2b/f4a [0,4194304] 0 2024-04-13T10:58:41.254 INFO:tasks.workunit.client.1.smithi194.stdout:9/463: creat d0/d6/f9f x:0 0 0 2024-04-13T10:58:41.255 INFO:tasks.workunit.client.1.smithi194.stdout:8/489: stat d6/d22/d23/d25/d78/c7c 0 2024-04-13T10:58:41.257 INFO:tasks.workunit.client.1.smithi194.stdout:7/546: rename d1/c2f to d1/d2b/d2c/d30/d33/d39/cae 0 2024-04-13T10:58:41.258 INFO:tasks.workunit.client.1.smithi194.stdout:6/476: mknod d0/d2c/c95 0 2024-04-13T10:58:41.260 INFO:tasks.workunit.client.1.smithi194.stdout:3/529: unlink d2/d3/d12/d31/d34/d88/f42 0 2024-04-13T10:58:41.260 INFO:tasks.workunit.client.1.smithi194.stdout:1/470: link d12/d13/d1c/d28/d41/l6d d12/d13/d1c/d27/d5c/l9c 0 2024-04-13T10:58:41.263 INFO:tasks.workunit.client.1.smithi194.stdout:4/519: creat d2/d16/d1a/d1c/d3b/d8d/fae x:0 0 0 2024-04-13T10:58:41.264 INFO:tasks.workunit.client.1.smithi194.stdout:8/490: dwrite d6/d22/d23/d25/f8a [0,4194304] 0 2024-04-13T10:58:41.265 INFO:tasks.workunit.client.1.smithi194.stdout:9/464: write d0/d11/d79/f84 [3674932,81352] 0 2024-04-13T10:58:41.265 INFO:tasks.workunit.client.1.smithi194.stdout:8/491: readlink d6/d2a/l9b 0 2024-04-13T10:58:41.265 INFO:tasks.workunit.client.1.smithi194.stdout:6/477: creat d0/d26/d2b/f96 x:0 0 0 2024-04-13T10:58:41.266 INFO:tasks.workunit.client.1.smithi194.stdout:9/465: readlink d0/d11/d1e/l28 0 2024-04-13T10:58:41.269 INFO:tasks.workunit.client.1.smithi194.stdout:8/492: chown d6/d22/d23/d25/d39/d41/f67 57 1 2024-04-13T10:58:41.270 INFO:tasks.workunit.client.1.smithi194.stdout:9/466: write d0/d11/d1e/f46 [475546,121700] 0 2024-04-13T10:58:41.273 INFO:tasks.workunit.client.1.smithi194.stdout:3/530: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/fae [0,4194304] 0 2024-04-13T10:58:41.274 INFO:tasks.workunit.client.1.smithi194.stdout:7/547: link d1/d2b/d2c/d30/d33/d39/f3d d1/d2b/d4c/d4f/d85/d88/d9b/faf 0 2024-04-13T10:58:41.276 INFO:tasks.workunit.client.1.smithi194.stdout:4/520: mkdir d2/daf 0 2024-04-13T10:58:41.281 INFO:tasks.workunit.client.1.smithi194.stdout:6/478: mknod d0/d2f/d48/d68/c97 0 2024-04-13T10:58:41.281 INFO:tasks.workunit.client.1.smithi194.stdout:9/467: fdatasync d0/d6/d9/d51/f9a 0 2024-04-13T10:58:41.285 INFO:tasks.workunit.client.1.smithi194.stdout:0/462: dread d9/db/f6a [0,4194304] 0 2024-04-13T10:58:41.285 INFO:tasks.workunit.client.1.smithi194.stdout:4/521: unlink d2/c7 0 2024-04-13T10:58:41.286 INFO:tasks.workunit.client.1.smithi194.stdout:2/499: truncate d2/d3/de/d17/d36/d8f/f4b 2391344 0 2024-04-13T10:58:41.290 INFO:tasks.workunit.client.1.smithi194.stdout:3/531: mknod d2/d3/d12/d31/d34/d88/d24/d82/caf 0 2024-04-13T10:58:41.293 INFO:tasks.workunit.client.1.smithi194.stdout:8/493: dwrite d6/dd/f19 [0,4194304] 0 2024-04-13T10:58:41.297 INFO:tasks.workunit.client.1.smithi194.stdout:7/548: dwrite d1/fe [0,4194304] 0 2024-04-13T10:58:41.299 INFO:tasks.workunit.client.1.smithi194.stdout:9/468: dwrite d0/d11/d58/f5f [0,4194304] 0 2024-04-13T10:58:41.302 INFO:tasks.workunit.client.1.smithi194.stdout:0/463: symlink d9/db/d19/d30/l97 0 2024-04-13T10:58:41.304 INFO:tasks.workunit.client.1.smithi194.stdout:0/464: chown d9/db/d19/f90 225284396 1 2024-04-13T10:58:41.308 INFO:tasks.workunit.client.1.smithi194.stdout:8/494: dwrite d6/d22/d23/d25/d39/f6b [0,4194304] 0 2024-04-13T10:58:41.309 INFO:tasks.workunit.client.1.smithi194.stdout:4/522: link d2/f56 d2/d16/d1a/d1c/d3e/d48/d7f/fb0 0 2024-04-13T10:58:41.310 INFO:tasks.workunit.client.1.smithi194.stdout:8/495: readlink d6/dd/d45/l46 0 2024-04-13T10:58:41.316 INFO:tasks.workunit.client.1.smithi194.stdout:5/484: write d3/dc/f2c [1303085,102108] 0 2024-04-13T10:58:41.316 INFO:tasks.workunit.client.1.smithi194.stdout:2/500: getdents d2/d3/de 0 2024-04-13T10:58:41.318 INFO:tasks.workunit.client.1.smithi194.stdout:5/485: write d3/dc/d10/d38/d59/f64 [1027232,22715] 0 2024-04-13T10:58:41.318 INFO:tasks.workunit.client.1.smithi194.stdout:4/523: creat d2/d16/d1a/d1c/d54/fb1 x:0 0 0 2024-04-13T10:58:41.319 INFO:tasks.workunit.client.1.smithi194.stdout:7/549: dread d1/d2b/f47 [0,4194304] 0 2024-04-13T10:58:41.319 INFO:tasks.workunit.client.1.smithi194.stdout:2/501: chown d2/d3/de/d17/d1e/d42/d52/f93 8352827 1 2024-04-13T10:58:41.323 INFO:tasks.workunit.client.1.smithi194.stdout:4/524: readlink d2/d16/d1a/d1c/d3b/d42/l53 0 2024-04-13T10:58:41.323 INFO:tasks.workunit.client.1.smithi194.stdout:0/465: symlink d9/d2b/l98 0 2024-04-13T10:58:41.325 INFO:tasks.workunit.client.1.smithi194.stdout:9/469: rmdir d0/d6/d14/d26/d3b/d90 0 2024-04-13T10:58:41.325 INFO:tasks.workunit.client.1.smithi194.stdout:2/502: write d2/d3/de/d17/d39/f64 [4405038,93545] 0 2024-04-13T10:58:41.327 INFO:tasks.workunit.client.1.smithi194.stdout:0/466: readlink d9/db/d19/d30/l97 0 2024-04-13T10:58:41.328 INFO:tasks.workunit.client.1.smithi194.stdout:8/496: dwrite d6/d22/d23/d25/fa8 [0,4194304] 0 2024-04-13T10:58:41.331 INFO:tasks.workunit.client.1.smithi194.stdout:4/525: write d2/d16/d1a/d1c/d3e/f67 [16911,126152] 0 2024-04-13T10:58:41.333 INFO:tasks.workunit.client.1.smithi194.stdout:8/497: fsync d6/d22/d23/d3d/f40 0 2024-04-13T10:58:41.334 INFO:tasks.workunit.client.1.smithi194.stdout:0/467: creat d9/d2b/d5a/f99 x:0 0 0 2024-04-13T10:58:41.334 INFO:tasks.workunit.client.1.smithi194.stdout:3/532: dread d2/f27 [0,4194304] 0 2024-04-13T10:58:41.335 INFO:tasks.workunit.client.1.smithi194.stdout:9/470: symlink d0/d6/d9/d51/la0 0 2024-04-13T10:58:41.336 INFO:tasks.workunit.client.1.smithi194.stdout:2/503: write d2/d3/de/d17/d1e/d42/d52/f99 [4636209,26061] 0 2024-04-13T10:58:41.337 INFO:tasks.workunit.client.1.smithi194.stdout:7/550: chown d1/d2b/d3e/d54/d5a/d3c/l4e 51 1 2024-04-13T10:58:41.337 INFO:tasks.workunit.client.1.smithi194.stdout:5/486: dwrite d3/dc/d10/d38/d59/f54 [0,4194304] 0 2024-04-13T10:58:41.341 INFO:tasks.workunit.client.1.smithi194.stdout:0/468: chown d9/df/l41 98094 1 2024-04-13T10:58:41.342 INFO:tasks.workunit.client.1.smithi194.stdout:1/471: sync 2024-04-13T10:58:41.342 INFO:tasks.workunit.client.1.smithi194.stdout:5/487: write d3/d29/f87 [295887,115842] 0 2024-04-13T10:58:41.343 INFO:tasks.workunit.client.1.smithi194.stdout:8/498: mknod d6/d22/ca9 0 2024-04-13T10:58:41.344 INFO:tasks.workunit.client.1.smithi194.stdout:0/469: chown d9/db/f3d 197 1 2024-04-13T10:58:41.345 INFO:tasks.workunit.client.1.smithi194.stdout:4/526: dwrite d2/d16/d1a/d1c/d54/f5f [0,4194304] 0 2024-04-13T10:58:41.346 INFO:tasks.workunit.client.1.smithi194.stdout:9/471: creat d0/d11/d1e/fa1 x:0 0 0 2024-04-13T10:58:41.348 INFO:tasks.workunit.client.1.smithi194.stdout:5/488: read d3/dc/d2d/f36 [1606961,29662] 0 2024-04-13T10:58:41.349 INFO:tasks.workunit.client.1.smithi194.stdout:7/551: fsync d1/f16 0 2024-04-13T10:58:41.350 INFO:tasks.workunit.client.1.smithi194.stdout:2/504: creat d2/d3/de/d17/d1e/d42/d52/fa8 x:0 0 0 2024-04-13T10:58:41.353 INFO:tasks.workunit.client.1.smithi194.stdout:2/505: stat d2/d3/de/d17/d39/f80 0 2024-04-13T10:58:41.355 INFO:tasks.workunit.client.1.smithi194.stdout:4/527: chown d2/d16/d1a/d1c/d54/d62/f71 1865719 1 2024-04-13T10:58:41.357 INFO:tasks.workunit.client.1.smithi194.stdout:2/506: write d2/d3/de/d17/d36/d65/f79 [230675,65703] 0 2024-04-13T10:58:41.358 INFO:tasks.workunit.client.1.smithi194.stdout:9/472: rename d0/d6/d9/d51/f9a to d0/d6/d14/d26/d3b/fa2 0 2024-04-13T10:58:41.360 INFO:tasks.workunit.client.1.smithi194.stdout:1/472: mknod d12/d13/d1c/c9d 0 2024-04-13T10:58:41.361 INFO:tasks.workunit.client.1.smithi194.stdout:5/489: dwrite d3/dc/d10/f4c [0,4194304] 0 2024-04-13T10:58:41.363 INFO:tasks.workunit.client.1.smithi194.stdout:8/499: getdents d6/d22/d23/d7f 0 2024-04-13T10:58:41.364 INFO:tasks.workunit.client.1.smithi194.stdout:9/473: mkdir d0/d11/da3 0 2024-04-13T10:58:41.365 INFO:tasks.workunit.client.1.smithi194.stdout:1/473: chown d12/d13/d1c/d28/d41/l6d 528482833 1 2024-04-13T10:58:41.366 INFO:tasks.workunit.client.1.smithi194.stdout:9/474: dread d0/d6/d2c/f47 [0,4194304] 0 2024-04-13T10:58:41.366 INFO:tasks.workunit.client.1.smithi194.stdout:8/500: write d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3c [50551,42316] 0 2024-04-13T10:58:41.369 INFO:tasks.workunit.client.1.smithi194.stdout:2/507: rename c1 to d2/d3/ca9 0 2024-04-13T10:58:41.371 INFO:tasks.workunit.client.1.smithi194.stdout:9/475: rmdir d0 39 2024-04-13T10:58:41.373 INFO:tasks.workunit.client.1.smithi194.stdout:1/474: rmdir d12/d13/d1c/d28/d41/d4e 39 2024-04-13T10:58:41.373 INFO:tasks.workunit.client.1.smithi194.stdout:1/475: fsync d12/d13/d1c/d27/f70 0 2024-04-13T10:58:41.374 INFO:tasks.workunit.client.1.smithi194.stdout:1/476: readlink d12/d13/d3e/l83 0 2024-04-13T10:58:41.376 INFO:tasks.workunit.client.1.smithi194.stdout:2/508: creat d2/d3/de/d17/d36/d7a/faa x:0 0 0 2024-04-13T10:58:41.378 INFO:tasks.workunit.client.1.smithi194.stdout:0/470: truncate d9/db/f1b 2591640 0 2024-04-13T10:58:41.379 INFO:tasks.workunit.client.1.smithi194.stdout:7/552: dread d1/d2b/d2c/d30/d33/d39/f66 [0,4194304] 0 2024-04-13T10:58:41.382 INFO:tasks.workunit.client.1.smithi194.stdout:6/479: sync 2024-04-13T10:58:41.383 INFO:tasks.workunit.client.1.smithi194.stdout:9/476: chown d0/d6/l65 2312 1 2024-04-13T10:58:41.391 INFO:tasks.workunit.client.1.smithi194.stdout:2/509: dwrite d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:41.391 INFO:tasks.workunit.client.1.smithi194.stdout:4/528: dread d2/d16/d1a/f35 [0,4194304] 0 2024-04-13T10:58:41.396 INFO:tasks.workunit.client.1.smithi194.stdout:9/477: mkdir d0/d6/d9/d70/da4 0 2024-04-13T10:58:41.400 INFO:tasks.workunit.client.1.smithi194.stdout:3/533: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 [0,4194304] 0 2024-04-13T10:58:41.409 INFO:tasks.workunit.client.1.smithi194.stdout:8/501: dwrite d6/d22/d23/f5f [0,4194304] 0 2024-04-13T10:58:41.410 INFO:tasks.workunit.client.1.smithi194.stdout:5/490: dwrite d3/dc/d10/d20/f43 [0,4194304] 0 2024-04-13T10:58:41.414 INFO:tasks.workunit.client.1.smithi194.stdout:1/477: dwrite d12/f32 [0,4194304] 0 2024-04-13T10:58:41.415 INFO:tasks.workunit.client.1.smithi194.stdout:6/480: dwrite d0/d2c/f32 [0,4194304] 0 2024-04-13T10:58:41.417 INFO:tasks.workunit.client.1.smithi194.stdout:7/553: dread d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f6d [0,4194304] 0 2024-04-13T10:58:41.417 INFO:tasks.workunit.client.1.smithi194.stdout:4/529: write d2/d16/d1a/d1c/d54/d62/d6e/f76 [3606744,22081] 0 2024-04-13T10:58:41.418 INFO:tasks.workunit.client.1.smithi194.stdout:0/471: dwrite d9/d2b/f8b [0,4194304] 0 2024-04-13T10:58:41.420 INFO:tasks.workunit.client.1.smithi194.stdout:3/534: chown d2/d3/d12/d31/d34/d88/d24/d3a/f6e 0 1 2024-04-13T10:58:41.420 INFO:tasks.workunit.client.1.smithi194.stdout:2/510: rename d2/d3/de/d17/d1e/l77 to d2/d3/de/d17/d1e/d42/d86/lab 0 2024-04-13T10:58:41.423 INFO:tasks.workunit.client.1.smithi194.stdout:0/472: stat d9/d2b/f3e 0 2024-04-13T10:58:41.424 INFO:tasks.workunit.client.1.smithi194.stdout:1/478: chown d12/f32 1379276 1 2024-04-13T10:58:41.430 INFO:tasks.workunit.client.1.smithi194.stdout:2/511: dread - d2/d3/f7b zero size 2024-04-13T10:58:41.431 INFO:tasks.workunit.client.1.smithi194.stdout:5/491: mknod d3/dc/d10/d20/c92 0 2024-04-13T10:58:41.432 INFO:tasks.workunit.client.1.smithi194.stdout:3/535: write d2/f27 [2802840,69826] 0 2024-04-13T10:58:41.432 INFO:tasks.workunit.client.1.smithi194.stdout:8/502: dread d6/d22/d23/d25/fa8 [0,4194304] 0 2024-04-13T10:58:41.434 INFO:tasks.workunit.client.1.smithi194.stdout:7/554: mkdir d1/d2b/d3e/d9c/db0 0 2024-04-13T10:58:41.434 INFO:tasks.workunit.client.1.smithi194.stdout:2/512: rmdir d2/d3/de 39 2024-04-13T10:58:41.435 INFO:tasks.workunit.client.1.smithi194.stdout:5/492: write d3/dc/d10/d38/d59/f8b [931093,10609] 0 2024-04-13T10:58:41.436 INFO:tasks.workunit.client.1.smithi194.stdout:1/479: mknod d12/d13/d1c/c9e 0 2024-04-13T10:58:41.437 INFO:tasks.workunit.client.1.smithi194.stdout:8/503: mkdir d6/dd/d45/daa 0 2024-04-13T10:58:41.437 INFO:tasks.workunit.client.1.smithi194.stdout:7/555: dread d1/d2b/d4c/f5d [0,4194304] 0 2024-04-13T10:58:41.438 INFO:tasks.workunit.client.1.smithi194.stdout:1/480: chown d12/d13/d1c/d28/d41/l6d 5641 1 2024-04-13T10:58:41.439 INFO:tasks.workunit.client.1.smithi194.stdout:4/530: rename d2/d16/d70/d31/d9c to d2/d16/d1a/d1c/d54/d5d/db2 0 2024-04-13T10:58:41.439 INFO:tasks.workunit.client.1.smithi194.stdout:7/556: read d1/d2b/d4c/d7e/dab/f8c [654873,104859] 0 2024-04-13T10:58:41.441 INFO:tasks.workunit.client.1.smithi194.stdout:2/513: fsync d2/d3/de/d17/d36/f9d 0 2024-04-13T10:58:41.441 INFO:tasks.workunit.client.1.smithi194.stdout:4/531: stat d2/d16/d1a/f36 0 2024-04-13T10:58:41.442 INFO:tasks.workunit.client.1.smithi194.stdout:1/481: write d12/d13/d1c/d27/f74 [3156481,19813] 0 2024-04-13T10:58:41.444 INFO:tasks.workunit.client.1.smithi194.stdout:7/557: mknod d1/cb1 0 2024-04-13T10:58:41.444 INFO:tasks.workunit.client.1.smithi194.stdout:2/514: mkdir d2/d3/d6d/dac 0 2024-04-13T10:58:41.446 INFO:tasks.workunit.client.1.smithi194.stdout:4/532: dread - d2/d16/d1a/d1c/d54/d62/d6e/fa7 zero size 2024-04-13T10:58:41.447 INFO:tasks.workunit.client.1.smithi194.stdout:5/493: dwrite d3/dc/d10/d38/d59/f8b [0,4194304] 0 2024-04-13T10:58:41.453 INFO:tasks.workunit.client.1.smithi194.stdout:7/558: write d1/d2b/d3e/d54/d5a/f49 [1423977,76226] 0 2024-04-13T10:58:41.458 INFO:tasks.workunit.client.1.smithi194.stdout:6/481: write d0/f18 [323710,45651] 0 2024-04-13T10:58:41.460 INFO:tasks.workunit.client.1.smithi194.stdout:0/473: dread d9/db/f1b [0,4194304] 0 2024-04-13T10:58:41.461 INFO:tasks.workunit.client.1.smithi194.stdout:1/482: dwrite d12/d13/d44/f85 [0,4194304] 0 2024-04-13T10:58:41.461 INFO:tasks.workunit.client.1.smithi194.stdout:3/536: truncate d2/d3/d12/d31/d34/d88/d24/f4c 1313685 0 2024-04-13T10:58:41.463 INFO:tasks.workunit.client.1.smithi194.stdout:7/559: dread - d1/d2b/d4c/d7e/dab/d96/fa1 zero size 2024-04-13T10:58:41.468 INFO:tasks.workunit.client.1.smithi194.stdout:0/474: mkdir d9/db/d3a/d9a 0 2024-04-13T10:58:41.472 INFO:tasks.workunit.client.1.smithi194.stdout:2/515: dwrite d2/d3/de/d17/d1e/d42/d52/f5e [4194304,4194304] 0 2024-04-13T10:58:41.472 INFO:tasks.workunit.client.1.smithi194.stdout:1/483: write d12/d13/d1c/d28/d41/f51 [170725,78613] 0 2024-04-13T10:58:41.474 INFO:tasks.workunit.client.1.smithi194.stdout:3/537: write d2/d3/d12/d31/d34/f37 [1455443,111734] 0 2024-04-13T10:58:41.477 INFO:tasks.workunit.client.1.smithi194.stdout:7/560: symlink d1/d2b/d4c/d4f/d85/lb2 0 2024-04-13T10:58:41.477 INFO:tasks.workunit.client.1.smithi194.stdout:5/494: dwrite d3/dc/d10/d38/d59/d49/f88 [0,4194304] 0 2024-04-13T10:58:41.482 INFO:tasks.workunit.client.1.smithi194.stdout:6/482: dwrite d0/f18 [0,4194304] 0 2024-04-13T10:58:41.484 INFO:tasks.workunit.client.1.smithi194.stdout:1/484: readlink d12/d13/d1c/d27/d4c/l6e 0 2024-04-13T10:58:41.484 INFO:tasks.workunit.client.1.smithi194.stdout:5/495: chown d3/dc/d10/f58 70426 1 2024-04-13T10:58:41.486 INFO:tasks.workunit.client.1.smithi194.stdout:5/496: write d3/dc/d10/d20/f66 [456803,87720] 0 2024-04-13T10:58:41.487 INFO:tasks.workunit.client.1.smithi194.stdout:0/475: dread d9/db/d3a/f49 [0,4194304] 0 2024-04-13T10:58:41.495 INFO:tasks.workunit.client.1.smithi194.stdout:7/561: link d1/d2b/d2c/d30/l46 d1/d2b/d4c/d4f/d51/d4d/lb3 0 2024-04-13T10:58:41.496 INFO:tasks.workunit.client.1.smithi194.stdout:6/483: mkdir d0/d2c/d77/d93/d98 0 2024-04-13T10:58:41.497 INFO:tasks.workunit.client.1.smithi194.stdout:4/533: dread d2/d16/d1a/d1c/d54/d62/d6e/f76 [0,4194304] 0 2024-04-13T10:58:41.497 INFO:tasks.workunit.client.1.smithi194.stdout:2/516: dwrite d2/d3/de/d17/d36/d7a/f7d [0,4194304] 0 2024-04-13T10:58:41.503 INFO:tasks.workunit.client.1.smithi194.stdout:5/497: rename d3/d29/d85 to d3/dc/d17/d93 0 2024-04-13T10:58:41.505 INFO:tasks.workunit.client.1.smithi194.stdout:7/562: mknod d1/d2b/d3e/d54/d5a/d3c/cb4 0 2024-04-13T10:58:41.505 INFO:tasks.workunit.client.1.smithi194.stdout:2/517: chown d2/d3/d6d/f6f 225054 1 2024-04-13T10:58:41.506 INFO:tasks.workunit.client.1.smithi194.stdout:5/498: fdatasync d3/dc/d17/d1b/f47 0 2024-04-13T10:58:41.509 INFO:tasks.workunit.client.1.smithi194.stdout:3/538: write d2/d3/d12/d31/d34/d88/d24/f7c [196864,34477] 0 2024-04-13T10:58:41.511 INFO:tasks.workunit.client.1.smithi194.stdout:5/499: write d3/dc/d10/d38/d59/f54 [1947658,37194] 0 2024-04-13T10:58:41.512 INFO:tasks.workunit.client.1.smithi194.stdout:0/476: truncate d9/d2b/f4a 1785894 0 2024-04-13T10:58:41.520 INFO:tasks.workunit.client.1.smithi194.stdout:1/485: dwrite d12/d13/d1c/d28/d41/f4a [0,4194304] 0 2024-04-13T10:58:41.520 INFO:tasks.workunit.client.1.smithi194.stdout:7/563: dread d1/f95 [0,4194304] 0 2024-04-13T10:58:41.521 INFO:tasks.workunit.client.1.smithi194.stdout:6/484: dwrite d0/d26/f14 [0,4194304] 0 2024-04-13T10:58:41.525 INFO:tasks.workunit.client.1.smithi194.stdout:3/539: mknod d2/d3/d12/d31/d34/d88/d24/d6c/cb0 0 2024-04-13T10:58:41.525 INFO:tasks.workunit.client.1.smithi194.stdout:4/534: dwrite d2/d16/d1a/d1c/d3b/d42/f75 [0,4194304] 0 2024-04-13T10:58:41.530 INFO:tasks.workunit.client.1.smithi194.stdout:0/477: dwrite d9/db/d19/d28/f17 [0,4194304] 0 2024-04-13T10:58:41.530 INFO:tasks.workunit.client.1.smithi194.stdout:7/564: rmdir d1/d2b 39 2024-04-13T10:58:41.536 INFO:tasks.workunit.client.1.smithi194.stdout:0/478: write d9/df/d16/d75/f94 [633000,92505] 0 2024-04-13T10:58:41.538 INFO:tasks.workunit.client.1.smithi194.stdout:3/540: write d2/d3/d12/d31/d34/d88/d24/d3a/d72/f8c [726481,30958] 0 2024-04-13T10:58:41.542 INFO:tasks.workunit.client.1.smithi194.stdout:3/541: readlink d2/d3/d12/d31/d34/d88/d24/d3a/d72/l7b 0 2024-04-13T10:58:41.542 INFO:tasks.workunit.client.1.smithi194.stdout:6/485: creat d0/f99 x:0 0 0 2024-04-13T10:58:41.543 INFO:tasks.workunit.client.1.smithi194.stdout:4/535: write d2/d16/d1a/d1c/d54/d62/f71 [174498,70943] 0 2024-04-13T10:58:41.545 INFO:tasks.workunit.client.1.smithi194.stdout:6/486: write d0/d26/f29 [5909267,129996] 0 2024-04-13T10:58:41.547 INFO:tasks.workunit.client.1.smithi194.stdout:1/486: link d12/d13/d1c/d28/d41/d4e/f56 d12/d13/d1c/d28/f9f 0 2024-04-13T10:58:41.548 INFO:tasks.workunit.client.1.smithi194.stdout:7/565: mknod d1/d2b/d3e/d54/d5a/d7d/cb5 0 2024-04-13T10:58:41.549 INFO:tasks.workunit.client.1.smithi194.stdout:3/542: dread - d2/d3/d12/d31/d34/d88/d24/f90 zero size 2024-04-13T10:58:41.549 INFO:tasks.workunit.client.1.smithi194.stdout:6/487: truncate d0/d42/f46 6641913 0 2024-04-13T10:58:41.550 INFO:tasks.workunit.client.1.smithi194.stdout:4/536: creat d2/d16/d1a/d60/fb3 x:0 0 0 2024-04-13T10:58:41.551 INFO:tasks.workunit.client.1.smithi194.stdout:1/487: symlink d12/d13/d1c/d28/la0 0 2024-04-13T10:58:41.552 INFO:tasks.workunit.client.1.smithi194.stdout:0/479: dwrite d9/db/d19/d30/d73/f85 [0,4194304] 0 2024-04-13T10:58:41.553 INFO:tasks.workunit.client.1.smithi194.stdout:9/478: sync 2024-04-13T10:58:41.556 INFO:tasks.workunit.client.1.smithi194.stdout:6/488: mknod d0/d26/d2b/d4d/c9a 0 2024-04-13T10:58:41.556 INFO:tasks.workunit.client.1.smithi194.stdout:3/543: stat d2/d3/d12/d31/d34/d88/d24/l64 0 2024-04-13T10:58:41.557 INFO:tasks.workunit.client.1.smithi194.stdout:4/537: creat d2/d16/d1a/d1c/d3e/fb4 x:0 0 0 2024-04-13T10:58:41.558 INFO:tasks.workunit.client.1.smithi194.stdout:0/480: creat d9/df/d16/d83/f9b x:0 0 0 2024-04-13T10:58:41.564 INFO:tasks.workunit.client.1.smithi194.stdout:0/481: creat d9/df/d16/f9c x:0 0 0 2024-04-13T10:58:41.564 INFO:tasks.workunit.client.1.smithi194.stdout:1/488: dwrite d12/d13/d1c/d28/d41/f4a [0,4194304] 0 2024-04-13T10:58:41.566 INFO:tasks.workunit.client.1.smithi194.stdout:6/489: rename d0/d57/f94 to d0/d26/d4b/f9b 0 2024-04-13T10:58:41.567 INFO:tasks.workunit.client.1.smithi194.stdout:9/479: link d0/d6/d2c/l80 d0/d6/d9/d70/da4/la5 0 2024-04-13T10:58:41.568 INFO:tasks.workunit.client.1.smithi194.stdout:3/544: dwrite d2/d3/f77 [0,4194304] 0 2024-04-13T10:58:41.568 INFO:tasks.workunit.client.1.smithi194.stdout:3/545: fdatasync d2/f5b 0 2024-04-13T10:58:41.575 INFO:tasks.workunit.client.1.smithi194.stdout:1/489: rename d12/d3a/f3d to d12/d13/d44/fa1 0 2024-04-13T10:58:41.578 INFO:tasks.workunit.client.1.smithi194.stdout:1/490: write d12/f5b [2347534,77237] 0 2024-04-13T10:58:41.579 INFO:tasks.workunit.client.1.smithi194.stdout:9/480: unlink d0/d6/d4a/d74/f99 0 2024-04-13T10:58:41.583 INFO:tasks.workunit.client.1.smithi194.stdout:3/546: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/fb1 x:0 0 0 2024-04-13T10:58:41.585 INFO:tasks.workunit.client.1.smithi194.stdout:6/490: rename d0/d57/d69/f5f to d0/d2c/f9c 0 2024-04-13T10:58:41.586 INFO:tasks.workunit.client.1.smithi194.stdout:9/481: dwrite d0/d6/f9f [0,4194304] 0 2024-04-13T10:58:41.586 INFO:tasks.workunit.client.1.smithi194.stdout:6/491: stat d0/d26/c11 0 2024-04-13T10:58:41.587 INFO:tasks.workunit.client.1.smithi194.stdout:4/538: link d2/d30/f49 d2/d16/d1a/d1c/d3e/fb5 0 2024-04-13T10:58:41.590 INFO:tasks.workunit.client.1.smithi194.stdout:4/539: chown d2/d16/d1a/d1c/d3b/d8d 50054 1 2024-04-13T10:58:41.593 INFO:tasks.workunit.client.1.smithi194.stdout:4/540: write d2/d16/d70/d31/f96 [24570,124294] 0 2024-04-13T10:58:41.594 INFO:tasks.workunit.client.1.smithi194.stdout:7/566: dwrite d1/d2b/d2c/d30/f31 [0,4194304] 0 2024-04-13T10:58:41.595 INFO:tasks.workunit.client.1.smithi194.stdout:4/541: stat d2/d16/d1a/d1c/d54/d5d/d98/d90 0 2024-04-13T10:58:41.596 INFO:tasks.workunit.client.1.smithi194.stdout:6/492: mkdir d0/d2f/d48/d83/d9d 0 2024-04-13T10:58:41.600 INFO:tasks.workunit.client.1.smithi194.stdout:1/491: rename d12/d13/d1c/d28/l2f to d12/d13/d1c/d27/la2 0 2024-04-13T10:58:41.601 INFO:tasks.workunit.client.1.smithi194.stdout:4/542: symlink d2/d30/lb6 0 2024-04-13T10:58:41.602 INFO:tasks.workunit.client.1.smithi194.stdout:1/492: chown c7 36 1 2024-04-13T10:58:41.603 INFO:tasks.workunit.client.1.smithi194.stdout:0/482: dwrite d9/df/f4c [0,4194304] 0 2024-04-13T10:58:41.603 INFO:tasks.workunit.client.1.smithi194.stdout:6/493: mknod d0/d53/c9e 0 2024-04-13T10:58:41.604 INFO:tasks.workunit.client.1.smithi194.stdout:1/493: chown d12/d13/d44/f94 378037136 1 2024-04-13T10:58:41.604 INFO:tasks.workunit.client.1.smithi194.stdout:6/494: chown d0/d53/d78 185150124 1 2024-04-13T10:58:41.607 INFO:tasks.workunit.client.1.smithi194.stdout:0/483: creat d9/df/d16/d70/f9d x:0 0 0 2024-04-13T10:58:41.608 INFO:tasks.workunit.client.1.smithi194.stdout:4/543: truncate d2/d16/d1a/f2f 1364431 0 2024-04-13T10:58:41.609 INFO:tasks.workunit.client.1.smithi194.stdout:0/484: write d9/df/d16/d75/f94 [292677,125065] 0 2024-04-13T10:58:41.609 INFO:tasks.workunit.client.1.smithi194.stdout:1/494: rmdir d12/d13/d1c/d28/d41/d50 39 2024-04-13T10:58:41.612 INFO:tasks.workunit.client.1.smithi194.stdout:7/567: rename d1/d2b/d4c/d4f/d51/f1c to d1/d2b/fb6 0 2024-04-13T10:58:41.615 INFO:tasks.workunit.client.1.smithi194.stdout:1/495: mkdir d12/d3a/d4f/da3 0 2024-04-13T10:58:41.620 INFO:tasks.workunit.client.1.smithi194.stdout:4/544: rename d2/f19 to d2/d16/d1a/d1c/d9a/fb7 0 2024-04-13T10:58:41.621 INFO:tasks.workunit.client.1.smithi194.stdout:1/496: dread d12/d13/d1c/f21 [0,4194304] 0 2024-04-13T10:58:41.622 INFO:tasks.workunit.client.1.smithi194.stdout:1/497: write f1 [2312824,27599] 0 2024-04-13T10:58:41.625 INFO:tasks.workunit.client.1.smithi194.stdout:6/495: truncate d0/f2a 2750221 0 2024-04-13T10:58:41.629 INFO:tasks.workunit.client.1.smithi194.stdout:4/545: rename d2/f56 to d2/d16/d70/d31/fb8 0 2024-04-13T10:58:41.629 INFO:tasks.workunit.client.1.smithi194.stdout:7/568: rmdir d1/d2b/d4c/d4f 39 2024-04-13T10:58:41.636 INFO:tasks.workunit.client.1.smithi194.stdout:6/496: fsync d0/f2a 0 2024-04-13T10:58:41.638 INFO:tasks.workunit.client.1.smithi194.stdout:6/497: dread d0/d26/d4b/f72 [0,4194304] 0 2024-04-13T10:58:41.639 INFO:tasks.workunit.client.1.smithi194.stdout:0/485: dwrite d9/db/d19/d28/f2f [0,4194304] 0 2024-04-13T10:58:41.641 INFO:tasks.workunit.client.1.smithi194.stdout:1/498: write d12/d13/d1c/d28/d41/d4e/f56 [608747,41759] 0 2024-04-13T10:58:41.643 INFO:tasks.workunit.client.1.smithi194.stdout:0/486: mknod d9/d2b/d6c/c9e 0 2024-04-13T10:58:41.645 INFO:tasks.workunit.client.1.smithi194.stdout:7/569: truncate d1/d2b/d4c/d4f/d6e/f87 280921 0 2024-04-13T10:58:41.647 INFO:tasks.workunit.client.1.smithi194.stdout:1/499: getdents d12/d3a/d4f/da3 0 2024-04-13T10:58:41.648 INFO:tasks.workunit.client.1.smithi194.stdout:1/500: dread - d12/d13/d1c/d27/d2e/f88 zero size 2024-04-13T10:58:41.650 INFO:tasks.workunit.client.1.smithi194.stdout:7/570: chown d1/d2b/d4c/d4f/d6e/f87 1609047 1 2024-04-13T10:58:41.653 INFO:tasks.workunit.client.1.smithi194.stdout:1/501: creat d12/fa4 x:0 0 0 2024-04-13T10:58:41.655 INFO:tasks.workunit.client.1.smithi194.stdout:7/571: dread d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f6d [0,4194304] 0 2024-04-13T10:58:41.655 INFO:tasks.workunit.client.1.smithi194.stdout:1/502: mknod d12/d3a/d4f/ca5 0 2024-04-13T10:58:41.656 INFO:tasks.workunit.client.1.smithi194.stdout:0/487: write d9/d2b/d5a/f78 [836722,868] 0 2024-04-13T10:58:41.657 INFO:tasks.workunit.client.1.smithi194.stdout:1/503: chown d12/d13/d1c/d27/d4c/l6e 4169798 1 2024-04-13T10:58:41.660 INFO:tasks.workunit.client.1.smithi194.stdout:1/504: rename d12/d13/d1c/d53/f8d to d12/d13/d44/fa6 0 2024-04-13T10:58:41.662 INFO:tasks.workunit.client.1.smithi194.stdout:7/572: truncate d1/d2b/d2c/f68 494828 0 2024-04-13T10:58:41.663 INFO:tasks.workunit.client.1.smithi194.stdout:1/505: dread d12/f32 [0,4194304] 0 2024-04-13T10:58:41.665 INFO:tasks.workunit.client.1.smithi194.stdout:7/573: getdents d1/d2b 0 2024-04-13T10:58:41.666 INFO:tasks.workunit.client.1.smithi194.stdout:7/574: rmdir d1/d2b/d2c 39 2024-04-13T10:58:41.667 INFO:tasks.workunit.client.1.smithi194.stdout:1/506: mknod d12/d13/d1c/d28/d41/d50/d96/ca7 0 2024-04-13T10:58:41.700 INFO:tasks.workunit.client.1.smithi194.stdout:2/518: sync 2024-04-13T10:58:41.700 INFO:tasks.workunit.client.1.smithi194.stdout:8/504: sync 2024-04-13T10:58:41.700 INFO:tasks.workunit.client.1.smithi194.stdout:5/500: sync 2024-04-13T10:58:41.701 INFO:tasks.workunit.client.1.smithi194.stdout:5/501: chown d3/dc/d2d/f36 10432 1 2024-04-13T10:58:41.702 INFO:tasks.workunit.client.1.smithi194.stdout:5/502: write d3/dc/d10/d38/d59/d49/f88 [5120692,98797] 0 2024-04-13T10:58:41.704 INFO:tasks.workunit.client.1.smithi194.stdout:5/503: write d3/dc/d10/d38/d46/f80 [2939319,1658] 0 2024-04-13T10:58:41.705 INFO:tasks.workunit.client.1.smithi194.stdout:1/507: write d12/d13/d44/f5e [558412,3769] 0 2024-04-13T10:58:41.706 INFO:tasks.workunit.client.1.smithi194.stdout:7/575: write d1/d2b/d4c/d4f/d85/d88/d9b/faf [2159738,119813] 0 2024-04-13T10:58:41.707 INFO:tasks.workunit.client.1.smithi194.stdout:5/504: fsync d3/dc/d10/d38/f76 0 2024-04-13T10:58:41.709 INFO:tasks.workunit.client.1.smithi194.stdout:1/508: creat d12/d13/d3e/fa8 x:0 0 0 2024-04-13T10:58:41.711 INFO:tasks.workunit.client.1.smithi194.stdout:2/519: dwrite d2/d3/fa4 [0,4194304] 0 2024-04-13T10:58:41.713 INFO:tasks.workunit.client.1.smithi194.stdout:1/509: chown d12/d13/d1c/d28/d41/d50/d96/ca7 4812 1 2024-04-13T10:58:41.714 INFO:tasks.workunit.client.1.smithi194.stdout:1/510: write d12/d13/d1c/f31 [4112773,21904] 0 2024-04-13T10:58:41.717 INFO:tasks.workunit.client.1.smithi194.stdout:5/505: rename d3/c2f to d3/dc/d10/c94 0 2024-04-13T10:58:41.720 INFO:tasks.workunit.client.1.smithi194.stdout:1/511: creat d12/d13/d1c/d7c/fa9 x:0 0 0 2024-04-13T10:58:41.726 INFO:tasks.workunit.client.1.smithi194.stdout:7/576: dwrite d1/d2b/f47 [0,4194304] 0 2024-04-13T10:58:41.727 INFO:tasks.workunit.client.1.smithi194.stdout:1/512: dread d12/d13/d1c/d28/f9f [0,4194304] 0 2024-04-13T10:58:41.728 INFO:tasks.workunit.client.1.smithi194.stdout:8/505: dread d6/dd/f98 [0,4194304] 0 2024-04-13T10:58:41.731 INFO:tasks.workunit.client.1.smithi194.stdout:5/506: dwrite d3/dc/f18 [0,4194304] 0 2024-04-13T10:58:41.737 INFO:tasks.workunit.client.1.smithi194.stdout:2/520: dread d2/d3/de/d17/d1e/f3f [0,4194304] 0 2024-04-13T10:58:41.737 INFO:tasks.workunit.client.1.smithi194.stdout:7/577: rename d1/d2b/d3e/d54/d6b/cad to d1/d2b/d3e/d9c/cb7 0 2024-04-13T10:58:41.739 INFO:tasks.workunit.client.1.smithi194.stdout:1/513: rmdir d12/d13/d1c/d28/d41/d77/d80 39 2024-04-13T10:58:41.739 INFO:tasks.workunit.client.1.smithi194.stdout:5/507: stat d3/dc/l70 0 2024-04-13T10:58:41.741 INFO:tasks.workunit.client.1.smithi194.stdout:2/521: fsync d2/d3/de/f16 0 2024-04-13T10:58:41.741 INFO:tasks.workunit.client.1.smithi194.stdout:5/508: dread - d3/dc/d17/d1b/f42 zero size 2024-04-13T10:58:41.742 INFO:tasks.workunit.client.1.smithi194.stdout:8/506: rename d6/dd/f16 to d6/d22/d23/d25/d39/d41/d5b/d76/d33/fab 0 2024-04-13T10:58:41.743 INFO:tasks.workunit.client.1.smithi194.stdout:8/507: dread - d6/d2a/d69/f9e zero size 2024-04-13T10:58:41.744 INFO:tasks.workunit.client.1.smithi194.stdout:7/578: mkdir d1/d2b/d4c/d4f/d85/d88/d9b/db8 0 2024-04-13T10:58:41.745 INFO:tasks.workunit.client.1.smithi194.stdout:2/522: read d2/d3/de/d17/d1e/d42/d52/f5e [4147866,118039] 0 2024-04-13T10:58:41.745 INFO:tasks.workunit.client.1.smithi194.stdout:2/523: readlink d2/l97 0 2024-04-13T10:58:41.746 INFO:tasks.workunit.client.1.smithi194.stdout:2/524: write d2/d3/d6d/f6f [764537,20644] 0 2024-04-13T10:58:41.747 INFO:tasks.workunit.client.1.smithi194.stdout:1/514: mkdir d12/d3a/d4f/da3/daa 0 2024-04-13T10:58:41.748 INFO:tasks.workunit.client.1.smithi194.stdout:7/579: mknod d1/d2b/d3e/cb9 0 2024-04-13T10:58:41.749 INFO:tasks.workunit.client.1.smithi194.stdout:1/515: write d12/d13/d1c/d7c/fa9 [806073,87935] 0 2024-04-13T10:58:41.750 INFO:tasks.workunit.client.1.smithi194.stdout:1/516: read d12/d13/d3e/f34 [2430676,36305] 0 2024-04-13T10:58:41.755 INFO:tasks.workunit.client.1.smithi194.stdout:7/580: dwrite d1/d2b/f47 [0,4194304] 0 2024-04-13T10:58:41.755 INFO:tasks.workunit.client.1.smithi194.stdout:8/508: write d6/dd/d45/f6a [797325,75678] 0 2024-04-13T10:58:41.757 INFO:tasks.workunit.client.1.smithi194.stdout:8/509: rmdir d6/d22/d23/d3d 39 2024-04-13T10:58:41.758 INFO:tasks.workunit.client.1.smithi194.stdout:7/581: rmdir d1/d8b 39 2024-04-13T10:58:41.758 INFO:tasks.workunit.client.1.smithi194.stdout:7/582: chown d1/cb1 622401970 1 2024-04-13T10:58:41.762 INFO:tasks.workunit.client.1.smithi194.stdout:7/583: write d1/d2b/d2c/d30/d33/d39/f3d [2283686,127192] 0 2024-04-13T10:58:41.763 INFO:tasks.workunit.client.1.smithi194.stdout:5/509: dread d3/dc/d10/d20/f62 [0,4194304] 0 2024-04-13T10:58:41.767 INFO:tasks.workunit.client.1.smithi194.stdout:7/584: getdents d1/d2b/d4c/d4f/d51 0 2024-04-13T10:58:41.768 INFO:tasks.workunit.client.1.smithi194.stdout:5/510: link d3/dc/d10/d38/d46/l6d d3/dc/d17/d93/l95 0 2024-04-13T10:58:41.769 INFO:tasks.workunit.client.1.smithi194.stdout:5/511: chown d3/dc/d17/f63 446 1 2024-04-13T10:58:41.770 INFO:tasks.workunit.client.1.smithi194.stdout:7/585: truncate d1/d2b/d2c/d30/d33/d39/f4b 2169698 0 2024-04-13T10:58:41.770 INFO:tasks.workunit.client.1.smithi194.stdout:8/510: write d6/d22/f26 [1445470,35691] 0 2024-04-13T10:58:41.773 INFO:tasks.workunit.client.1.smithi194.stdout:5/512: rename d3/d29/f34 to d3/dc/d10/d38/f96 0 2024-04-13T10:58:41.774 INFO:tasks.workunit.client.1.smithi194.stdout:8/511: mkdir d6/dd/d80/dac 0 2024-04-13T10:58:41.775 INFO:tasks.workunit.client.1.smithi194.stdout:8/512: stat d6/d22/d23/d25/d39/f95 0 2024-04-13T10:58:41.775 INFO:tasks.workunit.client.1.smithi194.stdout:7/586: dread d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f71 [0,4194304] 0 2024-04-13T10:58:41.775 INFO:tasks.workunit.client.1.smithi194.stdout:5/513: creat d3/d89/f97 x:0 0 0 2024-04-13T10:58:41.778 INFO:tasks.workunit.client.1.smithi194.stdout:7/587: mkdir d1/d2b/d2c/d30/d33/d39/dba 0 2024-04-13T10:58:41.780 INFO:tasks.workunit.client.1.smithi194.stdout:7/588: mknod d1/d2b/d4c/d4f/d85/cbb 0 2024-04-13T10:58:41.780 INFO:tasks.workunit.client.1.smithi194.stdout:7/589: fdatasync d1/d2b/d3e/f9f 0 2024-04-13T10:58:41.785 INFO:tasks.workunit.client.1.smithi194.stdout:7/590: mkdir d1/d2b/d4c/d4f/d85/dbc 0 2024-04-13T10:58:41.785 INFO:tasks.workunit.client.1.smithi194.stdout:8/513: truncate d6/d22/d23/f5f 110556 0 2024-04-13T10:58:41.786 INFO:tasks.workunit.client.1.smithi194.stdout:7/591: creat d1/d2b/d2c/d30/d33/fbd x:0 0 0 2024-04-13T10:58:41.787 INFO:tasks.workunit.client.1.smithi194.stdout:7/592: write d1/d2b/d4c/d4f/f5c [12801,56100] 0 2024-04-13T10:58:41.787 INFO:tasks.workunit.client.1.smithi194.stdout:8/514: creat d6/d22/d23/d7f/d8c/d8d/fad x:0 0 0 2024-04-13T10:58:41.790 INFO:tasks.workunit.client.1.smithi194.stdout:7/593: creat d1/d2b/d4c/d4f/fbe x:0 0 0 2024-04-13T10:58:41.792 INFO:tasks.workunit.client.1.smithi194.stdout:5/514: dread d3/dc/d10/d38/f4d [0,4194304] 0 2024-04-13T10:58:41.793 INFO:tasks.workunit.client.1.smithi194.stdout:7/594: symlink d1/d2b/d4c/d4f/d51/d4d/d5e/lbf 0 2024-04-13T10:58:41.802 INFO:tasks.workunit.client.1.smithi194.stdout:7/595: write d1/d2b/d2c/f68 [80591,130581] 0 2024-04-13T10:58:41.805 INFO:tasks.workunit.client.1.smithi194.stdout:8/515: dread d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3c [0,4194304] 0 2024-04-13T10:58:41.806 INFO:tasks.workunit.client.1.smithi194.stdout:7/596: rename d1/d2b/d4c/d4f/d51/l35 to d1/d2b/d3e/d54/d5a/d7d/lc0 0 2024-04-13T10:58:41.807 INFO:tasks.workunit.client.1.smithi194.stdout:8/516: stat d6/c53 0 2024-04-13T10:58:41.808 INFO:tasks.workunit.client.1.smithi194.stdout:5/515: dread d3/dc/d17/f1c [0,4194304] 0 2024-04-13T10:58:41.809 INFO:tasks.workunit.client.1.smithi194.stdout:8/517: mknod d6/dd/d45/cae 0 2024-04-13T10:58:41.809 INFO:tasks.workunit.client.1.smithi194.stdout:5/516: fsync d3/dc/d10/d38/d46/f80 0 2024-04-13T10:58:41.815 INFO:tasks.workunit.client.1.smithi194.stdout:7/597: readlink d1/d2b/d4c/d4f/d51/d4d/lb3 0 2024-04-13T10:58:41.816 INFO:tasks.workunit.client.1.smithi194.stdout:5/517: link d3/dc/d10/c6e d3/d29/c98 0 2024-04-13T10:58:41.818 INFO:tasks.workunit.client.1.smithi194.stdout:8/518: link d6/d22/d23/d25/d39/d41/d5b/d76/l86 d6/d22/d23/d25/laf 0 2024-04-13T10:58:41.820 INFO:tasks.workunit.client.1.smithi194.stdout:8/519: fdatasync d6/d22/d23/d25/d39/f62 0 2024-04-13T10:58:41.821 INFO:tasks.workunit.client.1.smithi194.stdout:7/598: dwrite d1/d2b/d2c/d30/f32 [0,4194304] 0 2024-04-13T10:58:41.821 INFO:tasks.workunit.client.1.smithi194.stdout:5/518: dread d3/dc/d10/d38/d59/f54 [0,4194304] 0 2024-04-13T10:58:41.824 INFO:tasks.workunit.client.1.smithi194.stdout:7/599: creat d1/d2b/d4c/d4f/d51/d4d/fc1 x:0 0 0 2024-04-13T10:58:41.825 INFO:tasks.workunit.client.1.smithi194.stdout:5/519: mkdir d3/dc/d17/d1b/d6b/d99 0 2024-04-13T10:58:41.827 INFO:tasks.workunit.client.1.smithi194.stdout:7/600: chown d1/d2b/d4c/d4f/d51/d4d/d5e/c60 0 1 2024-04-13T10:58:41.827 INFO:tasks.workunit.client.1.smithi194.stdout:8/520: dwrite d6/d2a/f4c [0,4194304] 0 2024-04-13T10:58:41.828 INFO:tasks.workunit.client.1.smithi194.stdout:3/547: sync 2024-04-13T10:58:41.835 INFO:tasks.workunit.client.1.smithi194.stdout:5/520: dwrite d3/dc/d17/d1b/f8a [0,4194304] 0 2024-04-13T10:58:41.837 INFO:tasks.workunit.client.1.smithi194.stdout:8/521: mkdir d6/d22/d23/d3d/db0 0 2024-04-13T10:58:41.840 INFO:tasks.workunit.client.1.smithi194.stdout:5/521: fdatasync d3/dc/d10/d38/f60 0 2024-04-13T10:58:41.844 INFO:tasks.workunit.client.1.smithi194.stdout:7/601: dwrite d1/d2b/d4c/d4f/d51/d4d/fc1 [0,4194304] 0 2024-04-13T10:58:41.845 INFO:tasks.workunit.client.1.smithi194.stdout:3/548: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/f79 [0,4194304] 0 2024-04-13T10:58:41.845 INFO:tasks.workunit.client.1.smithi194.stdout:8/522: fdatasync d6/d22/d23/d25/d39/fa4 0 2024-04-13T10:58:41.846 INFO:tasks.workunit.client.1.smithi194.stdout:5/522: readlink d3/d29/l7b 0 2024-04-13T10:58:41.849 INFO:tasks.workunit.client.1.smithi194.stdout:3/549: write d2/d3/d12/d31/d34/d88/d24/f7c [565200,9632] 0 2024-04-13T10:58:41.851 INFO:tasks.workunit.client.1.smithi194.stdout:8/523: write d6/dd/f98 [7145070,43567] 0 2024-04-13T10:58:41.854 INFO:tasks.workunit.client.1.smithi194.stdout:5/523: write d3/dc/d10/d38/f4d [4752162,85786] 0 2024-04-13T10:58:41.859 INFO:tasks.workunit.client.1.smithi194.stdout:8/524: write d6/d22/d23/d25/d39/d41/d5b/d76/d33/fab [907473,20657] 0 2024-04-13T10:58:41.860 INFO:tasks.workunit.client.1.smithi194.stdout:7/602: dwrite d1/d2b/d4c/d4f/d51/d4d/fa7 [0,4194304] 0 2024-04-13T10:58:41.862 INFO:tasks.workunit.client.1.smithi194.stdout:3/550: dread d2/d3/d12/f63 [0,4194304] 0 2024-04-13T10:58:41.864 INFO:tasks.workunit.client.1.smithi194.stdout:7/603: mknod d1/d2b/d4c/d4f/d85/dbc/cc2 0 2024-04-13T10:58:41.867 INFO:tasks.workunit.client.1.smithi194.stdout:8/525: getdents d6/d22/d23/d25/d39/d41/d5b 0 2024-04-13T10:58:41.869 INFO:tasks.workunit.client.1.smithi194.stdout:8/526: mkdir d6/dd/d80/db1 0 2024-04-13T10:58:41.872 INFO:tasks.workunit.client.1.smithi194.stdout:8/527: write d6/dd/d45/f6a [340837,64194] 0 2024-04-13T10:58:41.873 INFO:tasks.workunit.client.1.smithi194.stdout:8/528: chown d6/d22/l24 9921 1 2024-04-13T10:58:41.874 INFO:tasks.workunit.client.1.smithi194.stdout:3/551: dwrite d2/d3/d12/d31/d34/d88/d24/f4b [0,4194304] 0 2024-04-13T10:58:41.876 INFO:tasks.workunit.client.1.smithi194.stdout:8/529: fsync d6/d22/d23/d25/d39/d41/f4e 0 2024-04-13T10:58:41.878 INFO:tasks.workunit.client.1.smithi194.stdout:8/530: write d6/d22/d23/d25/d39/f6b [3734587,58320] 0 2024-04-13T10:58:41.879 INFO:tasks.workunit.client.1.smithi194.stdout:3/552: creat d2/d3/d12/d31/d34/d88/d24/d3a/fb2 x:0 0 0 2024-04-13T10:58:41.880 INFO:tasks.workunit.client.1.smithi194.stdout:8/531: write d6/d22/d23/d25/d39/d41/f73 [529755,9183] 0 2024-04-13T10:58:41.886 INFO:tasks.workunit.client.1.smithi194.stdout:8/532: getdents d6/d22/d23/d25/d39 0 2024-04-13T10:58:41.886 INFO:tasks.workunit.client.1.smithi194.stdout:7/604: write d1/f2e [2249980,116273] 0 2024-04-13T10:58:41.888 INFO:tasks.workunit.client.1.smithi194.stdout:8/533: mknod d6/d22/cb2 0 2024-04-13T10:58:41.889 INFO:tasks.workunit.client.1.smithi194.stdout:7/605: rmdir d1/d2b 39 2024-04-13T10:58:41.889 INFO:tasks.workunit.client.1.smithi194.stdout:8/534: chown d6/dd/d80/db1 34675 1 2024-04-13T10:58:41.892 INFO:tasks.workunit.client.1.smithi194.stdout:5/524: dread d3/d29/f3f [0,4194304] 0 2024-04-13T10:58:41.892 INFO:tasks.workunit.client.1.smithi194.stdout:8/535: dread d6/d22/d23/d7f/f81 [0,4194304] 0 2024-04-13T10:58:41.892 INFO:tasks.workunit.client.1.smithi194.stdout:7/606: write d1/d2b/d4c/d4f/f64 [1069342,20886] 0 2024-04-13T10:58:41.893 INFO:tasks.workunit.client.1.smithi194.stdout:7/607: chown d1/d2b/d4c/d4f/d85/cbb 22623360 1 2024-04-13T10:58:41.894 INFO:tasks.workunit.client.1.smithi194.stdout:8/536: dread d6/d22/d23/d7f/f81 [0,4194304] 0 2024-04-13T10:58:41.895 INFO:tasks.workunit.client.1.smithi194.stdout:5/525: rename d3/d29/l7b to d3/dc/d2d/l9a 0 2024-04-13T10:58:41.896 INFO:tasks.workunit.client.1.smithi194.stdout:8/537: unlink d6/dd/c31 0 2024-04-13T10:58:41.896 INFO:tasks.workunit.client.1.smithi194.stdout:5/526: mknod d3/d29/c9b 0 2024-04-13T10:58:41.898 INFO:tasks.workunit.client.1.smithi194.stdout:8/538: write d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3c [2231067,26190] 0 2024-04-13T10:58:41.901 INFO:tasks.workunit.client.1.smithi194.stdout:5/527: dread d3/dc/d10/f61 [0,4194304] 0 2024-04-13T10:58:41.903 INFO:tasks.workunit.client.1.smithi194.stdout:5/528: mkdir d3/d29/d9c 0 2024-04-13T10:58:41.904 INFO:tasks.workunit.client.1.smithi194.stdout:5/529: read - d3/dc/d10/f3b zero size 2024-04-13T10:58:41.905 INFO:tasks.workunit.client.1.smithi194.stdout:8/539: dwrite d6/d22/d23/d25/f27 [4194304,4194304] 0 2024-04-13T10:58:41.906 INFO:tasks.workunit.client.1.smithi194.stdout:5/530: symlink d3/dc/d17/d93/l9d 0 2024-04-13T10:58:41.908 INFO:tasks.workunit.client.1.smithi194.stdout:8/540: rmdir d6/d22/d23/d25 39 2024-04-13T10:58:41.910 INFO:tasks.workunit.client.1.smithi194.stdout:5/531: creat d3/dc/d10/d38/d59/d7a/f9e x:0 0 0 2024-04-13T10:58:41.914 INFO:tasks.workunit.client.1.smithi194.stdout:8/541: dwrite d6/d2a/d69/f9e [0,4194304] 0 2024-04-13T10:58:41.918 INFO:tasks.workunit.client.1.smithi194.stdout:8/542: rmdir d6/d22/d23/d25/d68 39 2024-04-13T10:58:41.920 INFO:tasks.workunit.client.1.smithi194.stdout:8/543: write d6/d22/d23/d25/d39/d41/d5b/d76/d33/fab [3933171,130753] 0 2024-04-13T10:58:41.922 INFO:tasks.workunit.client.1.smithi194.stdout:8/544: rmdir d6/d22/d23/d3d 39 2024-04-13T10:58:41.923 INFO:tasks.workunit.client.1.smithi194.stdout:8/545: write f5 [8083314,91458] 0 2024-04-13T10:58:41.924 INFO:tasks.workunit.client.1.smithi194.stdout:8/546: fsync d6/d22/d23/d7f/d8c/d8d/fad 0 2024-04-13T10:58:41.925 INFO:tasks.workunit.client.1.smithi194.stdout:8/547: write d6/d22/d23/d25/d39/d41/d5b/d76/d33/fab [1565438,11101] 0 2024-04-13T10:58:41.928 INFO:tasks.workunit.client.1.smithi194.stdout:8/548: rename d6/c13 to d6/d22/d23/d25/d71/cb3 0 2024-04-13T10:58:41.933 INFO:tasks.workunit.client.1.smithi194.stdout:8/549: dwrite d6/d22/d23/d25/d39/f95 [0,4194304] 0 2024-04-13T10:58:41.936 INFO:tasks.workunit.client.1.smithi194.stdout:8/550: creat d6/d22/fb4 x:0 0 0 2024-04-13T10:58:41.937 INFO:tasks.workunit.client.1.smithi194.stdout:8/551: mknod d6/dd/d80/dac/cb5 0 2024-04-13T10:58:41.939 INFO:tasks.workunit.client.1.smithi194.stdout:8/552: symlink d6/d22/d23/d25/d39/d41/d5b/d76/d33/lb6 0 2024-04-13T10:58:41.943 INFO:tasks.workunit.client.1.smithi194.stdout:8/553: creat d6/d2a/d69/da2/fb7 x:0 0 0 2024-04-13T10:58:41.945 INFO:tasks.workunit.client.1.smithi194.stdout:8/554: mkdir d6/d22/d23/db8 0 2024-04-13T10:58:41.949 INFO:tasks.workunit.client.1.smithi194.stdout:8/555: rename d6/d22/fb4 to d6/dd/d45/fb9 0 2024-04-13T10:58:41.952 INFO:tasks.workunit.client.1.smithi194.stdout:8/556: dread d6/f1d [4194304,4194304] 0 2024-04-13T10:58:41.954 INFO:tasks.workunit.client.1.smithi194.stdout:8/557: chown d6/d22/d23/d3d/c6e 449897 1 2024-04-13T10:58:41.955 INFO:tasks.workunit.client.1.smithi194.stdout:8/558: fsync d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3a 0 2024-04-13T10:58:41.965 INFO:tasks.workunit.client.1.smithi194.stdout:8/559: dwrite d6/d22/d23/d7f/f81 [0,4194304] 0 2024-04-13T10:58:41.966 INFO:tasks.workunit.client.1.smithi194.stdout:9/482: sync 2024-04-13T10:58:41.969 INFO:tasks.workunit.client.1.smithi194.stdout:9/483: creat d0/d11/d79/fa6 x:0 0 0 2024-04-13T10:58:41.969 INFO:tasks.workunit.client.1.smithi194.stdout:8/560: mknod d6/d22/d23/d25/d71/da0/cba 0 2024-04-13T10:58:41.972 INFO:tasks.workunit.client.1.smithi194.stdout:9/484: unlink d0/d6/d2c/f73 0 2024-04-13T10:58:41.976 INFO:tasks.workunit.client.1.smithi194.stdout:8/561: rmdir d6/d22/d23/d3d/db0 0 2024-04-13T10:58:41.980 INFO:tasks.workunit.client.1.smithi194.stdout:8/562: link d6/dd/d45/cae d6/dd/d45/cbb 0 2024-04-13T10:58:41.981 INFO:tasks.workunit.client.1.smithi194.stdout:8/563: write d6/d22/d23/d25/d39/f95 [4541837,85718] 0 2024-04-13T10:58:41.984 INFO:tasks.workunit.client.1.smithi194.stdout:8/564: rename d6/dd/l4d to d6/d22/lbc 0 2024-04-13T10:58:41.986 INFO:tasks.workunit.client.1.smithi194.stdout:8/565: mknod d6/d22/d23/d25/d78/cbd 0 2024-04-13T10:58:41.987 INFO:tasks.workunit.client.1.smithi194.stdout:8/566: write d6/d22/d23/f85 [467226,1954] 0 2024-04-13T10:58:41.990 INFO:tasks.workunit.client.1.smithi194.stdout:8/567: link d6/d22/d23/d25/d78/cbd d6/d22/d23/d25/d78/cbe 0 2024-04-13T10:58:41.992 INFO:tasks.workunit.client.1.smithi194.stdout:8/568: chown d6/d22/d23/d25/d39/f95 47030 1 2024-04-13T10:58:41.992 INFO:tasks.workunit.client.1.smithi194.stdout:8/569: chown f2 21890134 1 2024-04-13T10:58:41.992 INFO:tasks.workunit.client.1.smithi194.stdout:8/570: dread - d6/dd/fa6 zero size 2024-04-13T10:58:41.998 INFO:tasks.workunit.client.1.smithi194.stdout:9/485: dread d0/d6/d9/d51/f94 [0,4194304] 0 2024-04-13T10:58:41.998 INFO:tasks.workunit.client.1.smithi194.stdout:8/571: dwrite d6/d22/d23/d7f/f81 [0,4194304] 0 2024-04-13T10:58:42.004 INFO:tasks.workunit.client.1.smithi194.stdout:8/572: rename d6/d2a/f4c to d6/d22/d23/d25/d39/d41/fbf 0 2024-04-13T10:58:42.007 INFO:tasks.workunit.client.1.smithi194.stdout:9/486: dwrite d0/d11/d1e/f46 [0,4194304] 0 2024-04-13T10:58:42.015 INFO:tasks.workunit.client.1.smithi194.stdout:8/573: dwrite d6/dd/f48 [0,4194304] 0 2024-04-13T10:58:42.020 INFO:tasks.workunit.client.1.smithi194.stdout:9/487: write d0/d11/f25 [3486253,53041] 0 2024-04-13T10:58:42.021 INFO:tasks.workunit.client.1.smithi194.stdout:9/488: stat d0/d11/d3d/l78 0 2024-04-13T10:58:42.022 INFO:tasks.workunit.client.1.smithi194.stdout:8/574: dwrite f5 [8388608,4194304] 0 2024-04-13T10:58:42.022 INFO:tasks.workunit.client.1.smithi194.stdout:9/489: chown d0/d6/d9/d70 3 1 2024-04-13T10:58:42.023 INFO:tasks.workunit.client.1.smithi194.stdout:8/575: write d6/d2a/f34 [4477382,9449] 0 2024-04-13T10:58:42.027 INFO:tasks.workunit.client.1.smithi194.stdout:8/576: mknod d6/d22/d23/d25/d71/da0/cc0 0 2024-04-13T10:58:42.029 INFO:tasks.workunit.client.1.smithi194.stdout:9/490: rename d0/d6/d14/l4f to d0/d6/d9/d70/da4/la7 0 2024-04-13T10:58:42.031 INFO:tasks.workunit.client.1.smithi194.stdout:8/577: symlink d6/d22/lc1 0 2024-04-13T10:58:42.032 INFO:tasks.workunit.client.1.smithi194.stdout:9/491: dread d0/d11/f3c [0,4194304] 0 2024-04-13T10:58:42.033 INFO:tasks.workunit.client.1.smithi194.stdout:9/492: chown d0/d88 438 1 2024-04-13T10:58:42.036 INFO:tasks.workunit.client.1.smithi194.stdout:8/578: rename d6/d22/d23/db8 to d6/d22/d23/d25/d71/dc2 0 2024-04-13T10:58:42.036 INFO:tasks.workunit.client.1.smithi194.stdout:9/493: creat d0/d88/fa8 x:0 0 0 2024-04-13T10:58:42.037 INFO:tasks.workunit.client.1.smithi194.stdout:8/579: chown d6/d22/d23/d25/d39/d41/fbf 479284 1 2024-04-13T10:58:42.038 INFO:tasks.workunit.client.1.smithi194.stdout:9/494: chown d0/d6/d14/d26/d42/c8e 217071438 1 2024-04-13T10:58:42.038 INFO:tasks.workunit.client.1.smithi194.stdout:8/580: write d6/d22/d23/d25/d39/d41/d64/f84 [3537401,40865] 0 2024-04-13T10:58:42.040 INFO:tasks.workunit.client.1.smithi194.stdout:8/581: stat d6/d2a/d69/l72 0 2024-04-13T10:58:42.041 INFO:tasks.workunit.client.1.smithi194.stdout:9/495: fdatasync d0/d11/d3d/f5d 0 2024-04-13T10:58:42.042 INFO:tasks.workunit.client.1.smithi194.stdout:8/582: symlink d6/d2a/d69/da2/lc3 0 2024-04-13T10:58:42.042 INFO:tasks.workunit.client.1.smithi194.stdout:8/583: readlink d6/dd/d45/l9c 0 2024-04-13T10:58:42.044 INFO:tasks.workunit.client.1.smithi194.stdout:8/584: mkdir d6/d2a/d69/dc4 0 2024-04-13T10:58:42.045 INFO:tasks.workunit.client.1.smithi194.stdout:8/585: write d6/d2a/d69/da2/fb7 [314802,41531] 0 2024-04-13T10:58:42.047 INFO:tasks.workunit.client.1.smithi194.stdout:8/586: readlink d6/d22/lbc 0 2024-04-13T10:58:42.051 INFO:tasks.workunit.client.1.smithi194.stdout:8/587: rmdir d6/d2a/d69 39 2024-04-13T10:58:42.053 INFO:tasks.workunit.client.1.smithi194.stdout:8/588: dread d6/d22/d23/d3d/f40 [0,4194304] 0 2024-04-13T10:58:42.058 INFO:tasks.workunit.client.1.smithi194.stdout:8/589: dwrite f2 [0,4194304] 0 2024-04-13T10:58:42.077 INFO:tasks.workunit.client.1.smithi194.stdout:8/590: dread d6/d22/d23/d25/d39/d41/d5b/d76/f56 [0,4194304] 0 2024-04-13T10:58:42.080 INFO:tasks.workunit.client.1.smithi194.stdout:8/591: mkdir d6/d22/d23/d25/d39/d41/d5b/d76/dc5 0 2024-04-13T10:58:42.085 INFO:tasks.workunit.client.1.smithi194.stdout:8/592: dwrite d6/f52 [0,4194304] 0 2024-04-13T10:58:42.089 INFO:tasks.workunit.client.1.smithi194.stdout:8/593: symlink d6/d22/d23/d25/d68/lc6 0 2024-04-13T10:58:42.092 INFO:tasks.workunit.client.1.smithi194.stdout:8/594: mkdir d6/d2a/dc7 0 2024-04-13T10:58:42.093 INFO:tasks.workunit.client.1.smithi194.stdout:8/595: chown d6/d22/d23/d25/d39/fa4 10037 1 2024-04-13T10:58:42.093 INFO:tasks.workunit.client.1.smithi194.stdout:0/488: sync 2024-04-13T10:58:42.093 INFO:tasks.workunit.client.1.smithi194.stdout:4/546: sync 2024-04-13T10:58:42.095 INFO:tasks.workunit.client.1.smithi194.stdout:8/596: mkdir d6/d2a/dc7/dc8 0 2024-04-13T10:58:42.095 INFO:tasks.workunit.client.1.smithi194.stdout:6/498: sync 2024-04-13T10:58:42.096 INFO:tasks.workunit.client.1.smithi194.stdout:2/525: sync 2024-04-13T10:58:42.096 INFO:tasks.workunit.client.1.smithi194.stdout:1/517: sync 2024-04-13T10:58:42.098 INFO:tasks.workunit.client.1.smithi194.stdout:2/526: write d2/d3/de/d17/d1e/d42/d52/f5c [846836,50542] 0 2024-04-13T10:58:42.100 INFO:tasks.workunit.client.1.smithi194.stdout:1/518: write f10 [1741480,66762] 0 2024-04-13T10:58:42.103 INFO:tasks.workunit.client.1.smithi194.stdout:6/499: mkdir d0/d2c/d77/d93/d98/d9f 0 2024-04-13T10:58:42.104 INFO:tasks.workunit.client.1.smithi194.stdout:6/500: write d0/d53/f81 [1413207,65738] 0 2024-04-13T10:58:42.105 INFO:tasks.workunit.client.1.smithi194.stdout:0/489: truncate d9/df/f4c 361333 0 2024-04-13T10:58:42.107 INFO:tasks.workunit.client.1.smithi194.stdout:6/501: write d0/d26/d2b/f7a [2465630,51918] 0 2024-04-13T10:58:42.107 INFO:tasks.workunit.client.1.smithi194.stdout:4/547: truncate d2/d16/d1a/f36 979572 0 2024-04-13T10:58:42.108 INFO:tasks.workunit.client.1.smithi194.stdout:6/502: chown d0/d57 11743579 1 2024-04-13T10:58:42.110 INFO:tasks.workunit.client.1.smithi194.stdout:0/490: rename d9/df/d16/d77/d88 to d9/d9f 0 2024-04-13T10:58:42.112 INFO:tasks.workunit.client.1.smithi194.stdout:6/503: creat d0/d2f/d6f/fa0 x:0 0 0 2024-04-13T10:58:42.112 INFO:tasks.workunit.client.1.smithi194.stdout:4/548: symlink d2/d16/d1a/lb9 0 2024-04-13T10:58:42.113 INFO:tasks.workunit.client.1.smithi194.stdout:6/504: dread - d0/f99 zero size 2024-04-13T10:58:42.113 INFO:tasks.workunit.client.1.smithi194.stdout:8/597: dread d6/d22/d23/d3d/f65 [0,4194304] 0 2024-04-13T10:58:42.115 INFO:tasks.workunit.client.1.smithi194.stdout:4/549: chown d2/d16/d1a/d1c/d3e/l4e 226280341 1 2024-04-13T10:58:42.115 INFO:tasks.workunit.client.1.smithi194.stdout:2/527: dread d2/d3/de/d17/d36/d8f/f4b [0,4194304] 0 2024-04-13T10:58:42.116 INFO:tasks.workunit.client.1.smithi194.stdout:1/519: dread d12/d13/d1c/f31 [0,4194304] 0 2024-04-13T10:58:42.117 INFO:tasks.workunit.client.1.smithi194.stdout:0/491: rename d9/db/d19/d28/f29 to d9/db/d19/d30/fa0 0 2024-04-13T10:58:42.119 INFO:tasks.workunit.client.1.smithi194.stdout:8/598: write d6/d22/d23/d25/d39/d41/fbf [2435126,1929] 0 2024-04-13T10:58:42.120 INFO:tasks.workunit.client.1.smithi194.stdout:4/550: symlink d2/d16/d1a/d1c/d54/d5d/d98/lba 0 2024-04-13T10:58:42.121 INFO:tasks.workunit.client.1.smithi194.stdout:2/528: symlink d2/d3/de/d17/d36/d8f/lad 0 2024-04-13T10:58:42.123 INFO:tasks.workunit.client.1.smithi194.stdout:1/520: creat d12/d13/d1c/d7c/fab x:0 0 0 2024-04-13T10:58:42.124 INFO:tasks.workunit.client.1.smithi194.stdout:1/521: chown c7 13293953 1 2024-04-13T10:58:42.125 INFO:tasks.workunit.client.1.smithi194.stdout:8/599: write d6/dd/d45/fb9 [59769,48563] 0 2024-04-13T10:58:42.125 INFO:tasks.workunit.client.1.smithi194.stdout:1/522: write d12/d13/f18 [5305329,72796] 0 2024-04-13T10:58:42.126 INFO:tasks.workunit.client.1.smithi194.stdout:1/523: chown d12/f5b 985 1 2024-04-13T10:58:42.126 INFO:tasks.workunit.client.1.smithi194.stdout:4/551: mkdir d2/d16/d1a/d1c/d3e/dbb 0 2024-04-13T10:58:42.129 INFO:tasks.workunit.client.1.smithi194.stdout:6/505: rmdir d0/d2c/d77/d93/d98/d9f 0 2024-04-13T10:58:42.130 INFO:tasks.workunit.client.1.smithi194.stdout:8/600: write d6/d22/d23/d3d/f65 [1209441,22664] 0 2024-04-13T10:58:42.131 INFO:tasks.workunit.client.1.smithi194.stdout:1/524: dread d12/d13/d1c/f21 [0,4194304] 0 2024-04-13T10:58:42.135 INFO:tasks.workunit.client.1.smithi194.stdout:4/552: unlink d2/d16/d1a/d1c/d3b/d42/f75 0 2024-04-13T10:58:42.138 INFO:tasks.workunit.client.1.smithi194.stdout:1/525: dwrite d12/d13/d1c/d27/f57 [0,4194304] 0 2024-04-13T10:58:42.139 INFO:tasks.workunit.client.1.smithi194.stdout:0/492: link d9/db/d19/d28/l44 d9/db/d3a/d9a/la1 0 2024-04-13T10:58:42.142 INFO:tasks.workunit.client.1.smithi194.stdout:2/529: dread d2/d3/de/d17/d36/d8f/d57/f69 [0,4194304] 0 2024-04-13T10:58:42.149 INFO:tasks.workunit.client.1.smithi194.stdout:8/601: creat d6/fc9 x:0 0 0 2024-04-13T10:58:42.149 INFO:tasks.workunit.client.1.smithi194.stdout:1/526: dread d12/d3a/f6a [0,4194304] 0 2024-04-13T10:58:42.151 INFO:tasks.workunit.client.1.smithi194.stdout:2/530: dwrite d2/d3/de/d17/d36/d8f/f2f [0,4194304] 0 2024-04-13T10:58:42.152 INFO:tasks.workunit.client.1.smithi194.stdout:2/531: chown d2/d3/de/d33/d47/f50 6331 1 2024-04-13T10:58:42.155 INFO:tasks.workunit.client.1.smithi194.stdout:0/493: creat d9/db/d19/fa2 x:0 0 0 2024-04-13T10:58:42.157 INFO:tasks.workunit.client.1.smithi194.stdout:4/553: getdents d2/d16/d1a/d1c/d3e 0 2024-04-13T10:58:42.158 INFO:tasks.workunit.client.1.smithi194.stdout:8/602: symlink d6/dd/d80/db1/lca 0 2024-04-13T10:58:42.163 INFO:tasks.workunit.client.1.smithi194.stdout:2/532: link d2/d3/de/d17/d36/d8f/f2f d2/d3/de/fae 0 2024-04-13T10:58:42.163 INFO:tasks.workunit.client.1.smithi194.stdout:6/506: dwrite d0/d26/d2b/f58 [0,4194304] 0 2024-04-13T10:58:42.165 INFO:tasks.workunit.client.1.smithi194.stdout:1/527: link d12/d13/d3e/f66 d12/fac 0 2024-04-13T10:58:42.166 INFO:tasks.workunit.client.1.smithi194.stdout:0/494: dwrite d9/f54 [0,4194304] 0 2024-04-13T10:58:42.168 INFO:tasks.workunit.client.1.smithi194.stdout:4/554: dread d2/d16/d1a/d1c/d3b/f72 [0,4194304] 0 2024-04-13T10:58:42.169 INFO:tasks.workunit.client.1.smithi194.stdout:8/603: symlink d6/lcb 0 2024-04-13T10:58:42.170 INFO:tasks.workunit.client.1.smithi194.stdout:3/553: sync 2024-04-13T10:58:42.170 INFO:tasks.workunit.client.1.smithi194.stdout:5/532: sync 2024-04-13T10:58:42.170 INFO:tasks.workunit.client.1.smithi194.stdout:7/608: sync 2024-04-13T10:58:42.173 INFO:tasks.workunit.client.1.smithi194.stdout:1/528: mkdir d12/d3a/dad 0 2024-04-13T10:58:42.174 INFO:tasks.workunit.client.1.smithi194.stdout:3/554: read d2/d3/d12/f16 [896481,105735] 0 2024-04-13T10:58:42.175 INFO:tasks.workunit.client.1.smithi194.stdout:0/495: unlink d9/db/f6a 0 2024-04-13T10:58:42.177 INFO:tasks.workunit.client.1.smithi194.stdout:3/555: write d2/d3/d12/f71 [646019,122181] 0 2024-04-13T10:58:42.180 INFO:tasks.workunit.client.1.smithi194.stdout:0/496: truncate d9/db/d19/f50 4858595 0 2024-04-13T10:58:42.181 INFO:tasks.workunit.client.1.smithi194.stdout:5/533: dread d3/dc/d10/d20/f62 [0,4194304] 0 2024-04-13T10:58:42.181 INFO:tasks.workunit.client.1.smithi194.stdout:8/604: dread d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3c [0,4194304] 0 2024-04-13T10:58:42.181 INFO:tasks.workunit.client.1.smithi194.stdout:7/609: rename d1/d2b/d4c/d7e/dab/f8c to d1/d2b/d4c/d4f/d85/d88/d9b/db8/fc3 0 2024-04-13T10:58:42.182 INFO:tasks.workunit.client.1.smithi194.stdout:0/497: fdatasync d9/db/f15 0 2024-04-13T10:58:42.186 INFO:tasks.workunit.client.1.smithi194.stdout:1/529: mknod d12/d13/d1c/d28/d41/d77/d93/cae 0 2024-04-13T10:58:42.187 INFO:tasks.workunit.client.1.smithi194.stdout:4/555: dwrite d2/d16/d70/d31/f93 [0,4194304] 0 2024-04-13T10:58:42.187 INFO:tasks.workunit.client.1.smithi194.stdout:3/556: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/fb3 x:0 0 0 2024-04-13T10:58:42.189 INFO:tasks.workunit.client.1.smithi194.stdout:8/605: rmdir d6/d22 39 2024-04-13T10:58:42.189 INFO:tasks.workunit.client.1.smithi194.stdout:3/557: fdatasync d2/d3/f3d 0 2024-04-13T10:58:42.191 INFO:tasks.workunit.client.1.smithi194.stdout:5/534: creat d3/dc/d2d/f9f x:0 0 0 2024-04-13T10:58:42.192 INFO:tasks.workunit.client.1.smithi194.stdout:4/556: chown d2/d16/d1a/d1c/d3e/d48/f80 53 1 2024-04-13T10:58:42.192 INFO:tasks.workunit.client.1.smithi194.stdout:0/498: symlink d9/la3 0 2024-04-13T10:58:42.193 INFO:tasks.workunit.client.1.smithi194.stdout:6/507: dwrite d0/d26/d2b/f67 [0,4194304] 0 2024-04-13T10:58:42.194 INFO:tasks.workunit.client.1.smithi194.stdout:4/557: stat d2/d16/d1a/d1c/d54/f5f 0 2024-04-13T10:58:42.195 INFO:tasks.workunit.client.1.smithi194.stdout:7/610: mkdir d1/d2b/dc4 0 2024-04-13T10:58:42.199 INFO:tasks.workunit.client.1.smithi194.stdout:1/530: rmdir d12/d13/d1c/d27 39 2024-04-13T10:58:42.199 INFO:tasks.workunit.client.1.smithi194.stdout:6/508: dread d0/d26/d2b/f67 [0,4194304] 0 2024-04-13T10:58:42.201 INFO:tasks.workunit.client.1.smithi194.stdout:6/509: truncate d0/d42/f75 505515 0 2024-04-13T10:58:42.202 INFO:tasks.workunit.client.1.smithi194.stdout:3/558: write d2/d3/f86 [1979595,35277] 0 2024-04-13T10:58:42.204 INFO:tasks.workunit.client.1.smithi194.stdout:5/535: mknod d3/dc/d2d/ca0 0 2024-04-13T10:58:42.206 INFO:tasks.workunit.client.1.smithi194.stdout:5/536: truncate d3/dc/d10/d38/d59/f64 1867085 0 2024-04-13T10:58:42.207 INFO:tasks.workunit.client.1.smithi194.stdout:4/558: write d2/d30/d50/f6b [4981236,15594] 0 2024-04-13T10:58:42.207 INFO:tasks.workunit.client.1.smithi194.stdout:7/611: mkdir d1/d2b/d3e/d9c/dc5 0 2024-04-13T10:58:42.208 INFO:tasks.workunit.client.1.smithi194.stdout:1/531: creat d12/d13/d1c/d28/faf x:0 0 0 2024-04-13T10:58:42.209 INFO:tasks.workunit.client.1.smithi194.stdout:6/510: creat d0/d2c/d77/d93/d98/fa1 x:0 0 0 2024-04-13T10:58:42.210 INFO:tasks.workunit.client.1.smithi194.stdout:2/533: link d2/d3/l15 d2/d3/de/d33/laf 0 2024-04-13T10:58:42.210 INFO:tasks.workunit.client.1.smithi194.stdout:3/559: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d57/fb4 x:0 0 0 2024-04-13T10:58:42.212 INFO:tasks.workunit.client.1.smithi194.stdout:1/532: chown d12/d13/d3e/f66 22901116 1 2024-04-13T10:58:42.213 INFO:tasks.workunit.client.1.smithi194.stdout:5/537: mkdir d3/d29/d9c/da1 0 2024-04-13T10:58:42.215 INFO:tasks.workunit.client.1.smithi194.stdout:0/499: dwrite d9/db/d19/d30/fa0 [0,4194304] 0 2024-04-13T10:58:42.216 INFO:tasks.workunit.client.1.smithi194.stdout:4/559: rename d2/d33/f9b to d2/d16/d1a/d1c/d3e/dbb/fbc 0 2024-04-13T10:58:42.217 INFO:tasks.workunit.client.1.smithi194.stdout:9/496: sync 2024-04-13T10:58:42.218 INFO:tasks.workunit.client.1.smithi194.stdout:5/538: chown d3/d29/c98 1 1 2024-04-13T10:58:42.219 INFO:tasks.workunit.client.1.smithi194.stdout:9/497: write d0/f4d [1200109,42168] 0 2024-04-13T10:58:42.220 INFO:tasks.workunit.client.1.smithi194.stdout:4/560: truncate d2/d16/d1a/d1c/d54/fb1 324675 0 2024-04-13T10:58:42.224 INFO:tasks.workunit.client.1.smithi194.stdout:0/500: symlink d9/db/d3a/la4 0 2024-04-13T10:58:42.225 INFO:tasks.workunit.client.1.smithi194.stdout:7/612: link d1/cb1 d1/d2b/d4c/cc6 0 2024-04-13T10:58:42.226 INFO:tasks.workunit.client.1.smithi194.stdout:8/606: truncate d6/d22/d23/d25/d39/d41/f74 3482179 0 2024-04-13T10:58:42.227 INFO:tasks.workunit.client.1.smithi194.stdout:1/533: mkdir d12/d13/d1c/d28/d41/db0 0 2024-04-13T10:58:42.228 INFO:tasks.workunit.client.1.smithi194.stdout:2/534: dwrite d2/d3/de/d17/d1e/d42/d52/f93 [0,4194304] 0 2024-04-13T10:58:42.228 INFO:tasks.workunit.client.1.smithi194.stdout:5/539: creat d3/d29/fa2 x:0 0 0 2024-04-13T10:58:42.230 INFO:tasks.workunit.client.1.smithi194.stdout:9/498: unlink d0/d6/f95 0 2024-04-13T10:58:42.234 INFO:tasks.workunit.client.1.smithi194.stdout:5/540: dwrite d3/f9 [0,4194304] 0 2024-04-13T10:58:42.238 INFO:tasks.workunit.client.1.smithi194.stdout:8/607: mkdir d6/d22/d23/d25/d71/dcc 0 2024-04-13T10:58:42.240 INFO:tasks.workunit.client.1.smithi194.stdout:2/535: symlink d2/d3/d6d/lb0 0 2024-04-13T10:58:42.242 INFO:tasks.workunit.client.1.smithi194.stdout:8/608: write d6/d22/d23/f5e [971545,38970] 0 2024-04-13T10:58:42.242 INFO:tasks.workunit.client.1.smithi194.stdout:1/534: creat d12/d13/d1c/d28/d41/d50/fb1 x:0 0 0 2024-04-13T10:58:42.243 INFO:tasks.workunit.client.1.smithi194.stdout:4/561: creat d2/d16/d1a/d1c/d54/d62/d6e/d99/fbd x:0 0 0 2024-04-13T10:58:42.244 INFO:tasks.workunit.client.1.smithi194.stdout:5/541: rmdir d3/dc/d10/d38/d46 39 2024-04-13T10:58:42.246 INFO:tasks.workunit.client.1.smithi194.stdout:9/499: symlink d0/d11/la9 0 2024-04-13T10:58:42.247 INFO:tasks.workunit.client.1.smithi194.stdout:7/613: creat d1/d2b/d4c/d4f/d51/d4d/d5e/fc7 x:0 0 0 2024-04-13T10:58:42.248 INFO:tasks.workunit.client.1.smithi194.stdout:0/501: dwrite d9/df/f2d [0,4194304] 0 2024-04-13T10:58:42.251 INFO:tasks.workunit.client.1.smithi194.stdout:5/542: write d3/dc/d10/d38/f96 [6523339,116692] 0 2024-04-13T10:58:42.257 INFO:tasks.workunit.client.1.smithi194.stdout:3/560: truncate d2/d3/d12/d31/d34/d88/f2e 627992 0 2024-04-13T10:58:42.259 INFO:tasks.workunit.client.1.smithi194.stdout:9/500: rename d0/d6/f9f to d0/d6/d14/d26/d3b/faa 0 2024-04-13T10:58:42.259 INFO:tasks.workunit.client.1.smithi194.stdout:2/536: dwrite d2/d3/de/d17/d39/f80 [0,4194304] 0 2024-04-13T10:58:42.260 INFO:tasks.workunit.client.1.smithi194.stdout:8/609: dwrite d6/d22/d23/d25/d39/f95 [4194304,4194304] 0 2024-04-13T10:58:42.260 INFO:tasks.workunit.client.1.smithi194.stdout:7/614: mkdir d1/d2b/d4c/d4f/d85/d88/d9b/db8/dc8 0 2024-04-13T10:58:42.263 INFO:tasks.workunit.client.1.smithi194.stdout:5/543: unlink d3/dc/d10/d20/l7f 0 2024-04-13T10:58:42.264 INFO:tasks.workunit.client.1.smithi194.stdout:2/537: fsync d2/d3/de/d17/d1e/d42/d52/f92 0 2024-04-13T10:58:42.265 INFO:tasks.workunit.client.1.smithi194.stdout:9/501: fdatasync d0/d6/d2c/f47 0 2024-04-13T10:58:42.265 INFO:tasks.workunit.client.1.smithi194.stdout:7/615: chown d1/d2b/d3e/d54/d5a/d7d/c7a 19380 1 2024-04-13T10:58:42.266 INFO:tasks.workunit.client.1.smithi194.stdout:8/610: fdatasync d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3a 0 2024-04-13T10:58:42.276 INFO:tasks.workunit.client.1.smithi194.stdout:2/538: creat d2/d3/de/d17/d1e/d42/fb1 x:0 0 0 2024-04-13T10:58:42.276 INFO:tasks.workunit.client.1.smithi194.stdout:8/611: dread d6/dd/f98 [4194304,4194304] 0 2024-04-13T10:58:42.276 INFO:tasks.workunit.client.1.smithi194.stdout:5/544: dwrite d3/dc/d2d/f84 [0,4194304] 0 2024-04-13T10:58:42.281 INFO:tasks.workunit.client.1.smithi194.stdout:7/616: dwrite d1/d2b/d4c/d4f/d85/d88/d9b/fa8 [0,4194304] 0 2024-04-13T10:58:42.282 INFO:tasks.workunit.client.1.smithi194.stdout:4/562: truncate d2/d16/d1a/d1c/f39 3466088 0 2024-04-13T10:58:42.283 INFO:tasks.workunit.client.1.smithi194.stdout:5/545: creat d3/d89/fa3 x:0 0 0 2024-04-13T10:58:42.286 INFO:tasks.workunit.client.1.smithi194.stdout:9/502: dwrite d0/d6/d14/d26/f2f [0,4194304] 0 2024-04-13T10:58:42.286 INFO:tasks.workunit.client.1.smithi194.stdout:2/539: read d2/d3/de/f32 [183330,126312] 0 2024-04-13T10:58:42.288 INFO:tasks.workunit.client.1.smithi194.stdout:9/503: write d0/d11/d3d/f7e [5150484,130773] 0 2024-04-13T10:58:42.289 INFO:tasks.workunit.client.1.smithi194.stdout:9/504: write d0/d11/d1e/f21 [3329646,120805] 0 2024-04-13T10:58:42.293 INFO:tasks.workunit.client.1.smithi194.stdout:7/617: fsync d1/d2b/d3e/d54/d5a/d3c/f40 0 2024-04-13T10:58:42.293 INFO:tasks.workunit.client.1.smithi194.stdout:5/546: unlink d3/dc/d10/d20/l50 0 2024-04-13T10:58:42.294 INFO:tasks.workunit.client.1.smithi194.stdout:8/612: mknod d6/d22/d23/d25/d39/d41/d5b/d76/dc5/ccd 0 2024-04-13T10:58:42.294 INFO:tasks.workunit.client.1.smithi194.stdout:5/547: chown d3/dc/f18 0 1 2024-04-13T10:58:42.297 INFO:tasks.workunit.client.1.smithi194.stdout:2/540: creat d2/d3/de/d33/d47/fb2 x:0 0 0 2024-04-13T10:58:42.297 INFO:tasks.workunit.client.1.smithi194.stdout:4/563: dread d2/d16/d1a/f4c [0,4194304] 0 2024-04-13T10:58:42.298 INFO:tasks.workunit.client.1.smithi194.stdout:4/564: readlink d2/d16/d1a/d1c/d3b/l97 0 2024-04-13T10:58:42.299 INFO:tasks.workunit.client.1.smithi194.stdout:2/541: write d2/d3/de/d33/d47/f85 [2574044,50527] 0 2024-04-13T10:58:42.301 INFO:tasks.workunit.client.1.smithi194.stdout:8/613: write d6/d22/d23/d3d/f47 [4074031,37667] 0 2024-04-13T10:58:42.303 INFO:tasks.workunit.client.1.smithi194.stdout:2/542: read d2/d3/de/d17/d39/f64 [2728902,89016] 0 2024-04-13T10:58:42.306 INFO:tasks.workunit.client.1.smithi194.stdout:9/505: link d0/d11/d1e/l54 d0/d6/d14/d26/d7f/lab 0 2024-04-13T10:58:42.308 INFO:tasks.workunit.client.1.smithi194.stdout:4/565: dwrite d2/d16/d1a/d1c/d54/fb1 [0,4194304] 0 2024-04-13T10:58:42.309 INFO:tasks.workunit.client.1.smithi194.stdout:8/614: mkdir d6/d2a/dce 0 2024-04-13T10:58:42.310 INFO:tasks.workunit.client.1.smithi194.stdout:2/543: mknod d2/d3/de/d17/d1e/d42/d52/d5a/cb3 0 2024-04-13T10:58:42.314 INFO:tasks.workunit.client.1.smithi194.stdout:5/548: dread d3/dc/f2c [0,4194304] 0 2024-04-13T10:58:42.317 INFO:tasks.workunit.client.1.smithi194.stdout:8/615: rename d6/d22/d23/d25/d39/d41/d5b/d76/d33/c77 to d6/d2a/d69/da2/ccf 0 2024-04-13T10:58:42.317 INFO:tasks.workunit.client.1.smithi194.stdout:2/544: dread d2/d3/de/fae [0,4194304] 0 2024-04-13T10:58:42.319 INFO:tasks.workunit.client.1.smithi194.stdout:9/506: dwrite d0/d6/d14/d26/f67 [0,4194304] 0 2024-04-13T10:58:42.319 INFO:tasks.workunit.client.1.smithi194.stdout:5/549: truncate d3/dc/d10/d38/f44 2790414 0 2024-04-13T10:58:42.321 INFO:tasks.workunit.client.1.smithi194.stdout:5/550: chown d3/dc/d17/d1b/f42 8215277 1 2024-04-13T10:58:42.323 INFO:tasks.workunit.client.1.smithi194.stdout:8/616: unlink d6/d22/d23/d3d/c4a 0 2024-04-13T10:58:42.326 INFO:tasks.workunit.client.1.smithi194.stdout:2/545: truncate d2/d3/de/d3c/f76 2205541 0 2024-04-13T10:58:42.327 INFO:tasks.workunit.client.1.smithi194.stdout:9/507: truncate d0/d6/d9/f48 614168 0 2024-04-13T10:58:42.327 INFO:tasks.workunit.client.1.smithi194.stdout:2/546: fsync d2/d3/de/d17/f8b 0 2024-04-13T10:58:42.329 INFO:tasks.workunit.client.1.smithi194.stdout:8/617: mkdir d6/d22/d23/d25/d68/dd0 0 2024-04-13T10:58:42.334 INFO:tasks.workunit.client.1.smithi194.stdout:9/508: write d0/d6/d14/d26/d3b/faa [3126983,105802] 0 2024-04-13T10:58:42.337 INFO:tasks.workunit.client.1.smithi194.stdout:2/547: creat d2/d3/de/d90/fb4 x:0 0 0 2024-04-13T10:58:42.338 INFO:tasks.workunit.client.1.smithi194.stdout:8/618: creat d6/d2a/d69/dc4/fd1 x:0 0 0 2024-04-13T10:58:42.338 INFO:tasks.workunit.client.1.smithi194.stdout:5/551: getdents d3/dc/d17/d93 0 2024-04-13T10:58:42.339 INFO:tasks.workunit.client.1.smithi194.stdout:9/509: mkdir d0/d88/dac 0 2024-04-13T10:58:42.340 INFO:tasks.workunit.client.1.smithi194.stdout:7/618: write d1/d2b/d3e/d54/d5a/d3c/f65 [362972,99863] 0 2024-04-13T10:58:42.343 INFO:tasks.workunit.client.1.smithi194.stdout:5/552: mkdir d3/dc/d10/d38/d59/d49/da4 0 2024-04-13T10:58:42.344 INFO:tasks.workunit.client.1.smithi194.stdout:5/553: write d3/d89/f97 [121744,81077] 0 2024-04-13T10:58:42.344 INFO:tasks.workunit.client.1.smithi194.stdout:9/510: symlink d0/d6/d9/d70/da4/lad 0 2024-04-13T10:58:42.347 INFO:tasks.workunit.client.1.smithi194.stdout:5/554: symlink d3/dc/d17/d93/la5 0 2024-04-13T10:58:42.347 INFO:tasks.workunit.client.1.smithi194.stdout:4/566: write d2/d16/d1a/d1c/d54/f5f [5108637,119865] 0 2024-04-13T10:58:42.348 INFO:tasks.workunit.client.1.smithi194.stdout:7/619: mknod d1/d2b/d4c/d4f/d51/cc9 0 2024-04-13T10:58:42.350 INFO:tasks.workunit.client.1.smithi194.stdout:9/511: mkdir d0/d6/d4a/d74/dae 0 2024-04-13T10:58:42.350 INFO:tasks.workunit.client.1.smithi194.stdout:8/619: link d6/d22/d23/l2b d6/d22/d23/d25/d68/dd0/ld2 0 2024-04-13T10:58:42.351 INFO:tasks.workunit.client.1.smithi194.stdout:2/548: dread d2/d3/f2d [4194304,4194304] 0 2024-04-13T10:58:42.352 INFO:tasks.workunit.client.1.smithi194.stdout:4/567: rmdir d2/d30 39 2024-04-13T10:58:42.353 INFO:tasks.workunit.client.1.smithi194.stdout:4/568: chown d2/d16/d1a/d1c/d54/d5d/d98/f95 364252299 1 2024-04-13T10:58:42.357 INFO:tasks.workunit.client.1.smithi194.stdout:8/620: mkdir d6/d22/d23/d25/d39/d41/d64/dd3 0 2024-04-13T10:58:42.358 INFO:tasks.workunit.client.1.smithi194.stdout:2/549: mknod d2/d3/de/d17/d1e/d42/d52/cb5 0 2024-04-13T10:58:42.360 INFO:tasks.workunit.client.1.smithi194.stdout:5/555: dwrite d3/dc/d10/d38/d46/f65 [0,4194304] 0 2024-04-13T10:58:42.361 INFO:tasks.workunit.client.1.smithi194.stdout:4/569: creat d2/d16/d1a/d1c/d54/d62/d6e/fbe x:0 0 0 2024-04-13T10:58:42.363 INFO:tasks.workunit.client.1.smithi194.stdout:9/512: creat d0/d6/d4a/d74/dae/faf x:0 0 0 2024-04-13T10:58:42.363 INFO:tasks.workunit.client.1.smithi194.stdout:8/621: rmdir d6/dd/d80 39 2024-04-13T10:58:42.366 INFO:tasks.workunit.client.1.smithi194.stdout:9/513: write d0/d11/d1e/f21 [2046148,60616] 0 2024-04-13T10:58:42.366 INFO:tasks.workunit.client.1.smithi194.stdout:4/570: creat d2/d16/d70/d31/fbf x:0 0 0 2024-04-13T10:58:42.369 INFO:tasks.workunit.client.1.smithi194.stdout:9/514: truncate d0/d6/d14/d26/d7f/f8b 298641 0 2024-04-13T10:58:42.370 INFO:tasks.workunit.client.1.smithi194.stdout:0/502: sync 2024-04-13T10:58:42.370 INFO:tasks.workunit.client.1.smithi194.stdout:6/511: sync 2024-04-13T10:58:42.371 INFO:tasks.workunit.client.1.smithi194.stdout:1/535: sync 2024-04-13T10:58:42.371 INFO:tasks.workunit.client.1.smithi194.stdout:4/571: truncate d2/d16/d1a/d1c/d54/d62/d6e/d99/fbd 34902 0 2024-04-13T10:58:42.372 INFO:tasks.workunit.client.1.smithi194.stdout:7/620: dread d1/d2b/d3e/d54/d5a/f78 [0,4194304] 0 2024-04-13T10:58:42.373 INFO:tasks.workunit.client.1.smithi194.stdout:4/572: fdatasync d2/d16/d70/d31/f96 0 2024-04-13T10:58:42.373 INFO:tasks.workunit.client.1.smithi194.stdout:6/512: dread - d0/d26/d2b/d4d/f4f zero size 2024-04-13T10:58:42.374 INFO:tasks.workunit.client.1.smithi194.stdout:6/513: fsync d0/d26/f23 0 2024-04-13T10:58:42.379 INFO:tasks.workunit.client.1.smithi194.stdout:8/622: getdents d6/d22/d23/d25/d39/d41/d5b 0 2024-04-13T10:58:42.379 INFO:tasks.workunit.client.1.smithi194.stdout:0/503: mknod d9/d2b/d6c/ca5 0 2024-04-13T10:58:42.383 INFO:tasks.workunit.client.1.smithi194.stdout:0/504: chown d9/df/d63/c69 288023 1 2024-04-13T10:58:42.384 INFO:tasks.workunit.client.1.smithi194.stdout:1/536: mkdir d12/d13/d1c/d27/d4c/d7f/d8b/db2 0 2024-04-13T10:58:42.386 INFO:tasks.workunit.client.1.smithi194.stdout:6/514: dwrite d0/d26/d2b/d4d/f4f [0,4194304] 0 2024-04-13T10:58:42.386 INFO:tasks.workunit.client.1.smithi194.stdout:7/621: dread d1/d2b/d4c/d4f/f5c [0,4194304] 0 2024-04-13T10:58:42.386 INFO:tasks.workunit.client.1.smithi194.stdout:5/556: truncate d3/dc/d17/d1b/f21 668957 0 2024-04-13T10:58:42.393 INFO:tasks.workunit.client.1.smithi194.stdout:0/505: chown d9/db/d19/d28/l39 513164 1 2024-04-13T10:58:42.394 INFO:tasks.workunit.client.1.smithi194.stdout:1/537: write d12/d13/d44/fa6 [605449,113213] 0 2024-04-13T10:58:42.394 INFO:tasks.workunit.client.1.smithi194.stdout:7/622: chown d1/d2b/d4c/d4f/d6e/l98 20499961 1 2024-04-13T10:58:42.395 INFO:tasks.workunit.client.1.smithi194.stdout:5/557: rename d3/dc/l70 to d3/dc/d10/la6 0 2024-04-13T10:58:42.398 INFO:tasks.workunit.client.1.smithi194.stdout:2/550: read d2/f74 [90993,85154] 0 2024-04-13T10:58:42.398 INFO:tasks.workunit.client.1.smithi194.stdout:5/558: chown d3/dc/d10/d38 152663344 1 2024-04-13T10:58:42.398 INFO:tasks.workunit.client.1.smithi194.stdout:0/506: chown d9/fd 9234465 1 2024-04-13T10:58:42.398 INFO:tasks.workunit.client.1.smithi194.stdout:8/623: dwrite d6/d2a/f34 [4194304,4194304] 0 2024-04-13T10:58:42.400 INFO:tasks.workunit.client.1.smithi194.stdout:1/538: chown d12/d13/d1c/c1e 127917 1 2024-04-13T10:58:42.400 INFO:tasks.workunit.client.1.smithi194.stdout:6/515: rename d0/d26/d2b/d4d/c9a to d0/d42/ca2 0 2024-04-13T10:58:42.401 INFO:tasks.workunit.client.1.smithi194.stdout:0/507: chown d9/db/d3a/f57 5712 1 2024-04-13T10:58:42.401 INFO:tasks.workunit.client.1.smithi194.stdout:2/551: stat d2/d3/de/d17/d36/d3d/l9f 0 2024-04-13T10:58:42.402 INFO:tasks.workunit.client.1.smithi194.stdout:5/559: dread - d3/dc/d10/d38/d59/d7a/f9e zero size 2024-04-13T10:58:42.403 INFO:tasks.workunit.client.1.smithi194.stdout:6/516: write d0/f21 [4991071,17891] 0 2024-04-13T10:58:42.404 INFO:tasks.workunit.client.1.smithi194.stdout:1/539: write d12/d13/d1c/d27/f57 [1808230,128800] 0 2024-04-13T10:58:42.404 INFO:tasks.workunit.client.1.smithi194.stdout:8/624: truncate d6/dd/d80/f8f 605812 0 2024-04-13T10:58:42.406 INFO:tasks.workunit.client.1.smithi194.stdout:7/623: rename d1/d6c/ca0 to d1/d2b/d4c/d4f/d85/cca 0 2024-04-13T10:58:42.409 INFO:tasks.workunit.client.1.smithi194.stdout:7/624: write d1/d2b/d2c/d30/d33/fbd [159348,121493] 0 2024-04-13T10:58:42.410 INFO:tasks.workunit.client.1.smithi194.stdout:0/508: rename d9/fd to d9/db/d19/d30/d73/fa6 0 2024-04-13T10:58:42.411 INFO:tasks.workunit.client.1.smithi194.stdout:2/552: mkdir d2/d3/db6 0 2024-04-13T10:58:42.413 INFO:tasks.workunit.client.1.smithi194.stdout:8/625: unlink d6/d22/d23/f5f 0 2024-04-13T10:58:42.415 INFO:tasks.workunit.client.1.smithi194.stdout:9/515: dread d0/d6/d2c/d68/f71 [0,4194304] 0 2024-04-13T10:58:42.416 INFO:tasks.workunit.client.1.smithi194.stdout:4/573: dread d2/d16/d1a/d1c/d3b/d42/f52 [0,4194304] 0 2024-04-13T10:58:42.416 INFO:tasks.workunit.client.1.smithi194.stdout:1/540: link d12/d13/l16 d12/d13/d1c/d27/d4c/lb3 0 2024-04-13T10:58:42.417 INFO:tasks.workunit.client.1.smithi194.stdout:8/626: write d6/dd/f19 [202240,118282] 0 2024-04-13T10:58:42.419 INFO:tasks.workunit.client.1.smithi194.stdout:8/627: read - d6/d22/d23/d25/d39/d41/f67 zero size 2024-04-13T10:58:42.422 INFO:tasks.workunit.client.1.smithi194.stdout:2/553: symlink d2/d3/de/d17/d36/lb7 0 2024-04-13T10:58:42.423 INFO:tasks.workunit.client.1.smithi194.stdout:9/516: creat d0/d88/fb0 x:0 0 0 2024-04-13T10:58:42.424 INFO:tasks.workunit.client.1.smithi194.stdout:1/541: dwrite d12/f35 [0,4194304] 0 2024-04-13T10:58:42.425 INFO:tasks.workunit.client.1.smithi194.stdout:9/517: chown d0/d11/d79/f84 250324 1 2024-04-13T10:58:42.426 INFO:tasks.workunit.client.1.smithi194.stdout:6/517: rename d0/d42/c44 to d0/d2f/ca3 0 2024-04-13T10:58:42.428 INFO:tasks.workunit.client.1.smithi194.stdout:0/509: creat d9/db/d19/fa7 x:0 0 0 2024-04-13T10:58:42.428 INFO:tasks.workunit.client.1.smithi194.stdout:3/561: sync 2024-04-13T10:58:42.430 INFO:tasks.workunit.client.1.smithi194.stdout:1/542: creat d12/d13/d1c/d27/d5c/fb4 x:0 0 0 2024-04-13T10:58:42.431 INFO:tasks.workunit.client.1.smithi194.stdout:9/518: stat d0/d11/d79/l91 0 2024-04-13T10:58:42.434 INFO:tasks.workunit.client.1.smithi194.stdout:9/519: write d0/d6/d14/d26/d42/f6f [329571,2144] 0 2024-04-13T10:58:42.434 INFO:tasks.workunit.client.1.smithi194.stdout:5/560: dwrite d3/dc/d10/d38/d46/f53 [0,4194304] 0 2024-04-13T10:58:42.436 INFO:tasks.workunit.client.1.smithi194.stdout:4/574: creat d2/fc0 x:0 0 0 2024-04-13T10:58:42.436 INFO:tasks.workunit.client.1.smithi194.stdout:9/520: write d0/d6/d14/d26/f34 [724677,84681] 0 2024-04-13T10:58:42.438 INFO:tasks.workunit.client.1.smithi194.stdout:0/510: rmdir d9/df/d16/d83 39 2024-04-13T10:58:42.438 INFO:tasks.workunit.client.1.smithi194.stdout:0/511: readlink d9/l43 0 2024-04-13T10:58:42.439 INFO:tasks.workunit.client.1.smithi194.stdout:6/518: creat d0/d26/d2b/d4d/d80/fa4 x:0 0 0 2024-04-13T10:58:42.440 INFO:tasks.workunit.client.1.smithi194.stdout:0/512: chown d9/db/d19/d28/f48 0 1 2024-04-13T10:58:42.440 INFO:tasks.workunit.client.1.smithi194.stdout:1/543: mkdir d12/d13/d44/db5 0 2024-04-13T10:58:42.442 INFO:tasks.workunit.client.1.smithi194.stdout:2/554: link d2/d3/de/d17/d1e/f62 d2/d3/de/d17/d1e/d42/d52/d5a/fb8 0 2024-04-13T10:58:42.442 INFO:tasks.workunit.client.1.smithi194.stdout:8/628: link d6/dd/d45/c5d d6/d22/d23/d25/d71/dcc/cd4 0 2024-04-13T10:58:42.443 INFO:tasks.workunit.client.1.smithi194.stdout:2/555: chown d2/d3/de/d3c/c9e 8100553 1 2024-04-13T10:58:42.443 INFO:tasks.workunit.client.1.smithi194.stdout:5/561: symlink d3/dc/d17/d1b/la7 0 2024-04-13T10:58:42.444 INFO:tasks.workunit.client.1.smithi194.stdout:5/562: write d3/dc/d10/f7c [266780,68964] 0 2024-04-13T10:58:42.449 INFO:tasks.workunit.client.1.smithi194.stdout:3/562: fsync d2/fd 0 2024-04-13T10:58:42.449 INFO:tasks.workunit.client.1.smithi194.stdout:5/563: fsync d3/dc/d10/f7c 0 2024-04-13T10:58:42.450 INFO:tasks.workunit.client.1.smithi194.stdout:6/519: mknod d0/d2c/d77/d93/ca5 0 2024-04-13T10:58:42.451 INFO:tasks.workunit.client.1.smithi194.stdout:5/564: read d3/dc/d10/d20/f62 [5969304,114452] 0 2024-04-13T10:58:42.452 INFO:tasks.workunit.client.1.smithi194.stdout:1/544: mkdir d12/d13/d1c/d27/d5c/db6 0 2024-04-13T10:58:42.453 INFO:tasks.workunit.client.1.smithi194.stdout:7/625: rename d1/d2b/d3e/c61 to d1/d2b/d3e/d54/d5a/ccb 0 2024-04-13T10:58:42.453 INFO:tasks.workunit.client.1.smithi194.stdout:5/565: write d3/dc/d2d/f36 [3731235,107092] 0 2024-04-13T10:58:42.457 INFO:tasks.workunit.client.1.smithi194.stdout:4/575: rmdir d2 39 2024-04-13T10:58:42.457 INFO:tasks.workunit.client.1.smithi194.stdout:1/545: dread - d12/d13/d1c/d27/d5c/fb4 zero size 2024-04-13T10:58:42.458 INFO:tasks.workunit.client.1.smithi194.stdout:2/556: write d2/d3/de/f16 [3501297,114663] 0 2024-04-13T10:58:42.459 INFO:tasks.workunit.client.1.smithi194.stdout:3/563: creat d2/d3/d12/d31/d34/d88/d24/d6c/fb5 x:0 0 0 2024-04-13T10:58:42.461 INFO:tasks.workunit.client.1.smithi194.stdout:8/629: mknod d6/d2a/dce/cd5 0 2024-04-13T10:58:42.463 INFO:tasks.workunit.client.1.smithi194.stdout:6/520: dwrite d0/d2c/f6e [0,4194304] 0 2024-04-13T10:58:42.463 INFO:tasks.workunit.client.1.smithi194.stdout:0/513: dwrite d9/df/f23 [0,4194304] 0 2024-04-13T10:58:42.463 INFO:tasks.workunit.client.1.smithi194.stdout:7/626: mknod d1/d2b/d4c/d7e/dab/d96/ccc 0 2024-04-13T10:58:42.464 INFO:tasks.workunit.client.1.smithi194.stdout:5/566: symlink d3/dc/d10/d38/d59/d7a/la8 0 2024-04-13T10:58:42.465 INFO:tasks.workunit.client.1.smithi194.stdout:9/521: write d0/d11/d3d/f5d [519524,43782] 0 2024-04-13T10:58:42.465 INFO:tasks.workunit.client.1.smithi194.stdout:1/546: rmdir d12/d13/d1c/d28 39 2024-04-13T10:58:42.467 INFO:tasks.workunit.client.1.smithi194.stdout:4/576: stat d2/d16/d1a/d1c/d54/d62/d6e/d99/fbd 0 2024-04-13T10:58:42.467 INFO:tasks.workunit.client.1.smithi194.stdout:1/547: dread - d12/fa4 zero size 2024-04-13T10:58:42.467 INFO:tasks.workunit.client.1.smithi194.stdout:3/564: creat d2/de/fb6 x:0 0 0 2024-04-13T10:58:42.469 INFO:tasks.workunit.client.1.smithi194.stdout:9/522: chown d0/d11/d1e/f46 6550 1 2024-04-13T10:58:42.470 INFO:tasks.workunit.client.1.smithi194.stdout:1/548: truncate d12/fa4 931578 0 2024-04-13T10:58:42.471 INFO:tasks.workunit.client.1.smithi194.stdout:8/630: mknod d6/d22/d23/d25/d68/cd6 0 2024-04-13T10:58:42.471 INFO:tasks.workunit.client.1.smithi194.stdout:0/514: rmdir d9/d2b/d6c 39 2024-04-13T10:58:42.472 INFO:tasks.workunit.client.1.smithi194.stdout:0/515: fdatasync d9/d2b/f8b 0 2024-04-13T10:58:42.473 INFO:tasks.workunit.client.1.smithi194.stdout:6/521: mknod d0/d2c/d77/ca6 0 2024-04-13T10:58:42.474 INFO:tasks.workunit.client.1.smithi194.stdout:6/522: write d0/d2c/d77/f8c [651856,95226] 0 2024-04-13T10:58:42.475 INFO:tasks.workunit.client.1.smithi194.stdout:6/523: readlink d0/d53/d78/l85 0 2024-04-13T10:58:42.476 INFO:tasks.workunit.client.1.smithi194.stdout:4/577: creat d2/d16/d1a/d1c/d3b/d8d/fc1 x:0 0 0 2024-04-13T10:58:42.478 INFO:tasks.workunit.client.1.smithi194.stdout:4/578: dread - d2/d16/d70/d31/fbf zero size 2024-04-13T10:58:42.479 INFO:tasks.workunit.client.1.smithi194.stdout:9/523: mknod d0/d6/d9/d70/da4/cb1 0 2024-04-13T10:58:42.481 INFO:tasks.workunit.client.1.smithi194.stdout:8/631: symlink d6/dd/d80/dac/ld7 0 2024-04-13T10:58:42.482 INFO:tasks.workunit.client.1.smithi194.stdout:0/516: mknod d9/db/d3a/ca8 0 2024-04-13T10:58:42.483 INFO:tasks.workunit.client.1.smithi194.stdout:5/567: symlink d3/dc/d10/d38/d59/d49/da4/la9 0 2024-04-13T10:58:42.484 INFO:tasks.workunit.client.1.smithi194.stdout:7/627: creat d1/d2b/d2c/fcd x:0 0 0 2024-04-13T10:58:42.484 INFO:tasks.workunit.client.1.smithi194.stdout:0/517: write d9/db/f15 [4153825,15208] 0 2024-04-13T10:58:42.485 INFO:tasks.workunit.client.1.smithi194.stdout:6/524: chown d0/d26/c6d 5507569 1 2024-04-13T10:58:42.486 INFO:tasks.workunit.client.1.smithi194.stdout:9/524: mknod d0/d6/d4a/d74/dae/cb2 0 2024-04-13T10:58:42.488 INFO:tasks.workunit.client.1.smithi194.stdout:1/549: creat d12/d13/d1c/d28/d41/d50/d96/fb7 x:0 0 0 2024-04-13T10:58:42.489 INFO:tasks.workunit.client.1.smithi194.stdout:7/628: mknod d1/d2b/d4c/d7e/cce 0 2024-04-13T10:58:42.490 INFO:tasks.workunit.client.1.smithi194.stdout:4/579: rename d2/l15 to d2/d16/lc2 0 2024-04-13T10:58:42.492 INFO:tasks.workunit.client.1.smithi194.stdout:8/632: dwrite d6/fc9 [0,4194304] 0 2024-04-13T10:58:42.492 INFO:tasks.workunit.client.1.smithi194.stdout:9/525: write d0/d6/d14/d26/f67 [3663415,52244] 0 2024-04-13T10:58:42.494 INFO:tasks.workunit.client.1.smithi194.stdout:6/525: creat d0/d53/d78/d91/fa7 x:0 0 0 2024-04-13T10:58:42.494 INFO:tasks.workunit.client.1.smithi194.stdout:2/557: dread d2/d3/de/d17/d1e/d42/d52/f5e [0,4194304] 0 2024-04-13T10:58:42.496 INFO:tasks.workunit.client.1.smithi194.stdout:8/633: write d6/d2a/d69/dc4/fd1 [118671,7063] 0 2024-04-13T10:58:42.498 INFO:tasks.workunit.client.1.smithi194.stdout:3/565: write d2/d3/d12/d31/d34/d88/d24/f4c [1289658,47537] 0 2024-04-13T10:58:42.500 INFO:tasks.workunit.client.1.smithi194.stdout:4/580: write d2/d16/d1a/d1c/d3b/d42/f52 [3728996,65753] 0 2024-04-13T10:58:42.507 INFO:tasks.workunit.client.1.smithi194.stdout:6/526: mknod d0/d53/d78/d91/ca8 0 2024-04-13T10:58:42.508 INFO:tasks.workunit.client.1.smithi194.stdout:2/558: creat d2/d3/de/d17/d1e/d42/d52/fb9 x:0 0 0 2024-04-13T10:58:42.509 INFO:tasks.workunit.client.1.smithi194.stdout:8/634: creat d6/dd/d80/fd8 x:0 0 0 2024-04-13T10:58:42.509 INFO:tasks.workunit.client.1.smithi194.stdout:0/518: truncate d9/db/d19/d30/d73/fa6 893915 0 2024-04-13T10:58:42.509 INFO:tasks.workunit.client.1.smithi194.stdout:9/526: mknod d0/d11/d3d/d9b/cb3 0 2024-04-13T10:58:42.509 INFO:tasks.workunit.client.1.smithi194.stdout:6/527: stat d0/d57/d69/f64 0 2024-04-13T10:58:42.514 INFO:tasks.workunit.client.1.smithi194.stdout:3/566: mknod d2/d3/d12/d31/cb7 0 2024-04-13T10:58:42.515 INFO:tasks.workunit.client.1.smithi194.stdout:8/635: creat d6/d2a/d69/da2/fd9 x:0 0 0 2024-04-13T10:58:42.516 INFO:tasks.workunit.client.1.smithi194.stdout:7/629: dread d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f6d [0,4194304] 0 2024-04-13T10:58:42.517 INFO:tasks.workunit.client.1.smithi194.stdout:9/527: write d0/d6/d4a/d74/f93 [193425,17513] 0 2024-04-13T10:58:42.517 INFO:tasks.workunit.client.1.smithi194.stdout:6/528: creat d0/d2c/d77/d93/fa9 x:0 0 0 2024-04-13T10:58:42.519 INFO:tasks.workunit.client.1.smithi194.stdout:4/581: rename d2/d30/f88 to d2/d16/d1a/d1c/d3e/d48/fc3 0 2024-04-13T10:58:42.519 INFO:tasks.workunit.client.1.smithi194.stdout:1/550: dread d12/f32 [0,4194304] 0 2024-04-13T10:58:42.522 INFO:tasks.workunit.client.1.smithi194.stdout:3/567: unlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d57/l99 0 2024-04-13T10:58:42.522 INFO:tasks.workunit.client.1.smithi194.stdout:9/528: dread d0/f37 [0,4194304] 0 2024-04-13T10:58:42.522 INFO:tasks.workunit.client.1.smithi194.stdout:8/636: mknod d6/d22/d23/d3d/cda 0 2024-04-13T10:58:42.523 INFO:tasks.workunit.client.1.smithi194.stdout:9/529: write d0/d6/d9/d70/f77 [455472,80639] 0 2024-04-13T10:58:42.524 INFO:tasks.workunit.client.1.smithi194.stdout:6/529: mkdir d0/d2c/d77/d93/daa 0 2024-04-13T10:58:42.524 INFO:tasks.workunit.client.1.smithi194.stdout:3/568: dread d2/fd [0,4194304] 0 2024-04-13T10:58:42.526 INFO:tasks.workunit.client.1.smithi194.stdout:1/551: creat d12/d13/d1c/d27/d2e/fb8 x:0 0 0 2024-04-13T10:58:42.527 INFO:tasks.workunit.client.1.smithi194.stdout:9/530: dread d0/d6/d2c/f47 [0,4194304] 0 2024-04-13T10:58:42.528 INFO:tasks.workunit.client.1.smithi194.stdout:2/559: truncate d2/d3/de/d33/d47/f50 2712364 0 2024-04-13T10:58:42.529 INFO:tasks.workunit.client.1.smithi194.stdout:0/519: link d9/d2b/l32 d9/d2b/la9 0 2024-04-13T10:58:42.533 INFO:tasks.workunit.client.1.smithi194.stdout:9/531: mknod d0/d11/d58/cb4 0 2024-04-13T10:58:42.535 INFO:tasks.workunit.client.1.smithi194.stdout:3/569: unlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/l5a 0 2024-04-13T10:58:42.536 INFO:tasks.workunit.client.1.smithi194.stdout:2/560: mkdir d2/d3/d12/dba 0 2024-04-13T10:58:42.539 INFO:tasks.workunit.client.1.smithi194.stdout:9/532: mkdir d0/d6/d2c/db5 0 2024-04-13T10:58:42.540 INFO:tasks.workunit.client.1.smithi194.stdout:2/561: dread - d2/d3/de/d17/d1e/d42/d52/f92 zero size 2024-04-13T10:58:42.541 INFO:tasks.workunit.client.1.smithi194.stdout:6/530: dwrite d0/f8 [4194304,4194304] 0 2024-04-13T10:58:42.541 INFO:tasks.workunit.client.1.smithi194.stdout:0/520: creat d9/db/d19/d30/d73/d87/faa x:0 0 0 2024-04-13T10:58:42.543 INFO:tasks.workunit.client.1.smithi194.stdout:3/570: fsync d2/d3/d12/f63 0 2024-04-13T10:58:42.543 INFO:tasks.workunit.client.1.smithi194.stdout:9/533: write d0/d88/fb0 [964951,128048] 0 2024-04-13T10:58:42.543 INFO:tasks.workunit.client.1.smithi194.stdout:6/531: fsync d0/d42/f7d 0 2024-04-13T10:58:42.544 INFO:tasks.workunit.client.1.smithi194.stdout:8/637: dread d6/d2a/d69/f9e [0,4194304] 0 2024-04-13T10:58:42.545 INFO:tasks.workunit.client.1.smithi194.stdout:1/552: creat d12/d13/fb9 x:0 0 0 2024-04-13T10:58:42.547 INFO:tasks.workunit.client.1.smithi194.stdout:6/532: chown d0/d2c/f9c 23523586 1 2024-04-13T10:58:42.547 INFO:tasks.workunit.client.1.smithi194.stdout:7/630: dread d1/d2b/d4c/d4f/d51/f20 [0,4194304] 0 2024-04-13T10:58:42.549 INFO:tasks.workunit.client.1.smithi194.stdout:0/521: creat d9/db/d19/d30/fab x:0 0 0 2024-04-13T10:58:42.552 INFO:tasks.workunit.client.1.smithi194.stdout:2/562: rename d2/d3/de/d17/d1e/d42/d52 to d2/d3/de/d33/d47/dbb 0 2024-04-13T10:58:42.554 INFO:tasks.workunit.client.1.smithi194.stdout:7/631: creat d1/d2b/d3e/d54/fcf x:0 0 0 2024-04-13T10:58:42.558 INFO:tasks.workunit.client.1.smithi194.stdout:3/571: chown d2/d3/d12/d31/d34/d88/d24/d82/laa 74288 1 2024-04-13T10:58:42.559 INFO:tasks.workunit.client.1.smithi194.stdout:3/572: readlink d2/d3/d12/d31/d34/d88/d24/d3a/d65/l8e 0 2024-04-13T10:58:42.561 INFO:tasks.workunit.client.1.smithi194.stdout:9/534: creat d0/d11/d3d/fb6 x:0 0 0 2024-04-13T10:58:42.562 INFO:tasks.workunit.client.1.smithi194.stdout:9/535: dread d0/d6/d2c/f47 [0,4194304] 0 2024-04-13T10:58:42.563 INFO:tasks.workunit.client.1.smithi194.stdout:9/536: chown d0/d11/d1e/fa1 60 1 2024-04-13T10:58:42.563 INFO:tasks.workunit.client.1.smithi194.stdout:8/638: dread d6/d22/d23/f54 [4194304,4194304] 0 2024-04-13T10:58:42.566 INFO:tasks.workunit.client.1.smithi194.stdout:6/533: rename d0/l1e to d0/d26/d2b/lab 0 2024-04-13T10:58:42.567 INFO:tasks.workunit.client.1.smithi194.stdout:3/573: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/fb8 x:0 0 0 2024-04-13T10:58:42.571 INFO:tasks.workunit.client.1.smithi194.stdout:7/632: fdatasync d1/d2b/d4c/d4f/d51/f1f 0 2024-04-13T10:58:42.572 INFO:tasks.workunit.client.1.smithi194.stdout:3/574: chown d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 0 1 2024-04-13T10:58:42.572 INFO:tasks.workunit.client.1.smithi194.stdout:9/537: creat d0/d11/d3d/d9b/fb7 x:0 0 0 2024-04-13T10:58:42.572 INFO:tasks.workunit.client.1.smithi194.stdout:1/553: truncate d12/d13/d1c/d28/d41/f4a 1745474 0 2024-04-13T10:58:42.573 INFO:tasks.workunit.client.1.smithi194.stdout:8/639: unlink d6/d22/d23/d25/d68/c7d 0 2024-04-13T10:58:42.574 INFO:tasks.workunit.client.1.smithi194.stdout:6/534: dwrite d0/d26/d2b/d4d/d80/fa4 [0,4194304] 0 2024-04-13T10:58:42.576 INFO:tasks.workunit.client.1.smithi194.stdout:1/554: write d12/d13/d1c/d27/f86 [222156,104015] 0 2024-04-13T10:58:42.579 INFO:tasks.workunit.client.1.smithi194.stdout:6/535: write d0/d2c/f6e [2435817,23315] 0 2024-04-13T10:58:42.581 INFO:tasks.workunit.client.1.smithi194.stdout:0/522: getdents d9/df/d63 0 2024-04-13T10:58:42.581 INFO:tasks.workunit.client.1.smithi194.stdout:9/538: rename d0/d6/d9/d51/c5b to d0/d6/d9/d51/cb8 0 2024-04-13T10:58:42.583 INFO:tasks.workunit.client.1.smithi194.stdout:3/575: rename d2/d3/d12/d31/d34/d88/d24/d3a/d56/d78 to d2/d3/db9 0 2024-04-13T10:58:42.585 INFO:tasks.workunit.client.1.smithi194.stdout:6/536: mkdir d0/d53/d78/dac 0 2024-04-13T10:58:42.585 INFO:tasks.workunit.client.1.smithi194.stdout:7/633: dwrite d1/d2b/d3e/d54/d5a/d3c/f65 [0,4194304] 0 2024-04-13T10:58:42.587 INFO:tasks.workunit.client.1.smithi194.stdout:8/640: mknod d6/dd/d45/daa/cdb 0 2024-04-13T10:58:42.593 INFO:tasks.workunit.client.1.smithi194.stdout:7/634: creat d1/d2b/d4c/d7e/fd0 x:0 0 0 2024-04-13T10:58:42.594 INFO:tasks.workunit.client.1.smithi194.stdout:8/641: stat d6/d22/d23/d25/d71/da0 0 2024-04-13T10:58:42.598 INFO:tasks.workunit.client.1.smithi194.stdout:1/555: dwrite d12/d13/d1c/d7c/fab [0,4194304] 0 2024-04-13T10:58:42.598 INFO:tasks.workunit.client.1.smithi194.stdout:6/537: link d0/d26/d2b/f76 d0/d2f/fad 0 2024-04-13T10:58:42.599 INFO:tasks.workunit.client.1.smithi194.stdout:0/523: dread d9/db/d19/d28/f2f [0,4194304] 0 2024-04-13T10:58:42.602 INFO:tasks.workunit.client.1.smithi194.stdout:3/576: dwrite d2/d3/d12/d31/f5e [0,4194304] 0 2024-04-13T10:58:42.602 INFO:tasks.workunit.client.1.smithi194.stdout:7/635: mknod d1/d2b/d2c/d30/cd1 0 2024-04-13T10:58:42.605 INFO:tasks.workunit.client.1.smithi194.stdout:1/556: fdatasync d12/d13/d1c/d28/d41/d50/fb1 0 2024-04-13T10:58:42.605 INFO:tasks.workunit.client.1.smithi194.stdout:0/524: rmdir d9/db 39 2024-04-13T10:58:42.608 INFO:tasks.workunit.client.1.smithi194.stdout:3/577: readlink d2/d3/l1b 0 2024-04-13T10:58:42.611 INFO:tasks.workunit.client.1.smithi194.stdout:8/642: dread d6/f52 [0,4194304] 0 2024-04-13T10:58:42.612 INFO:tasks.workunit.client.1.smithi194.stdout:0/525: readlink d9/db/d19/l3b 0 2024-04-13T10:58:42.613 INFO:tasks.workunit.client.1.smithi194.stdout:9/539: dwrite d0/d11/d3d/f3f [0,4194304] 0 2024-04-13T10:58:42.615 INFO:tasks.workunit.client.1.smithi194.stdout:8/643: mkdir d6/d22/d23/d7f/d8c/d8d/ddc 0 2024-04-13T10:58:42.617 INFO:tasks.workunit.client.1.smithi194.stdout:0/526: creat d9/df/d16/d65/fac x:0 0 0 2024-04-13T10:58:42.620 INFO:tasks.workunit.client.1.smithi194.stdout:8/644: mknod d6/dd/d45/daa/cdd 0 2024-04-13T10:58:42.623 INFO:tasks.workunit.client.1.smithi194.stdout:7/636: dwrite d1/d2b/d4c/d7e/dab/d96/fa3 [0,4194304] 0 2024-04-13T10:58:42.624 INFO:tasks.workunit.client.1.smithi194.stdout:9/540: dread d0/d6/d14/d26/f2f [0,4194304] 0 2024-04-13T10:58:42.625 INFO:tasks.workunit.client.1.smithi194.stdout:8/645: unlink d6/d22/d23/d7f/f81 0 2024-04-13T10:58:42.630 INFO:tasks.workunit.client.1.smithi194.stdout:7/637: symlink d1/d2b/d4c/ld2 0 2024-04-13T10:58:42.630 INFO:tasks.workunit.client.1.smithi194.stdout:8/646: truncate d6/d22/d23/d25/d39/d41/f4e 4814829 0 2024-04-13T10:58:42.630 INFO:tasks.workunit.client.1.smithi194.stdout:6/538: write d0/d26/f4e [421975,3000] 0 2024-04-13T10:58:42.630 INFO:tasks.workunit.client.1.smithi194.stdout:6/539: fsync d0/d42/f43 0 2024-04-13T10:58:42.631 INFO:tasks.workunit.client.1.smithi194.stdout:6/540: fsync d0/d2c/f32 0 2024-04-13T10:58:42.633 INFO:tasks.workunit.client.1.smithi194.stdout:3/578: truncate d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 2580007 0 2024-04-13T10:58:42.633 INFO:tasks.workunit.client.1.smithi194.stdout:8/647: write d6/d22/d23/d25/fa8 [357216,69186] 0 2024-04-13T10:58:42.634 INFO:tasks.workunit.client.1.smithi194.stdout:8/648: chown d6/dd/d80/dac 317974 1 2024-04-13T10:58:42.634 INFO:tasks.workunit.client.1.smithi194.stdout:1/557: dread d12/f1a [0,4194304] 0 2024-04-13T10:58:42.635 INFO:tasks.workunit.client.1.smithi194.stdout:7/638: rename d1/d2b/d3e/d54/d6b/c79 to d1/d2b/d2c/d30/d33/cd3 0 2024-04-13T10:58:42.637 INFO:tasks.workunit.client.1.smithi194.stdout:1/558: symlink d12/d3a/d4f/lba 0 2024-04-13T10:58:42.640 INFO:tasks.workunit.client.1.smithi194.stdout:1/559: fsync d12/d3a/f6a 0 2024-04-13T10:58:42.645 INFO:tasks.workunit.client.1.smithi194.stdout:3/579: dwrite d2/d3/d12/d31/d34/d88/d24/d6c/fb5 [0,4194304] 0 2024-04-13T10:58:42.647 INFO:tasks.workunit.client.1.smithi194.stdout:1/560: mkdir d12/d13/d1c/d27/d4c/d7f/d8b/dbb 0 2024-04-13T10:58:42.649 INFO:tasks.workunit.client.1.smithi194.stdout:3/580: read d2/de/f1e [3546579,81681] 0 2024-04-13T10:58:42.650 INFO:tasks.workunit.client.1.smithi194.stdout:8/649: dwrite d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3c [0,4194304] 0 2024-04-13T10:58:42.650 INFO:tasks.workunit.client.1.smithi194.stdout:7/639: dwrite d1/d2b/d4c/d4f/d51/d4d/fc1 [0,4194304] 0 2024-04-13T10:58:42.652 INFO:tasks.workunit.client.1.smithi194.stdout:3/581: write d2/d3/db9/fa4 [586744,51972] 0 2024-04-13T10:58:42.652 INFO:tasks.workunit.client.1.smithi194.stdout:7/640: chown d1/d2b/d2c/f68 8579 1 2024-04-13T10:58:42.656 INFO:tasks.workunit.client.1.smithi194.stdout:1/561: rename d12/d13/d1c/d27/d5c/f68 to d12/d13/d1c/d28/d41/d77/d93/fbc 0 2024-04-13T10:58:42.658 INFO:tasks.workunit.client.1.smithi194.stdout:3/582: symlink d2/d3/d12/d21/lba 0 2024-04-13T10:58:42.660 INFO:tasks.workunit.client.1.smithi194.stdout:7/641: mknod d1/d2b/d4c/cd4 0 2024-04-13T10:58:42.661 INFO:tasks.workunit.client.1.smithi194.stdout:1/562: mkdir d12/d13/d1c/d7c/dbd 0 2024-04-13T10:58:42.663 INFO:tasks.workunit.client.1.smithi194.stdout:1/563: write d12/d13/d3e/f54 [3781984,18916] 0 2024-04-13T10:58:42.664 INFO:tasks.workunit.client.1.smithi194.stdout:3/583: mknod d2/d3/d12/d31/cbb 0 2024-04-13T10:58:42.665 INFO:tasks.workunit.client.1.smithi194.stdout:8/650: link d6/dd/d45/c5d d6/dd/d45/cde 0 2024-04-13T10:58:42.669 INFO:tasks.workunit.client.1.smithi194.stdout:8/651: mkdir d6/dd/d80/dac/ddf 0 2024-04-13T10:58:42.670 INFO:tasks.workunit.client.1.smithi194.stdout:1/564: dwrite d12/d3a/d4f/f63 [4194304,4194304] 0 2024-04-13T10:58:42.671 INFO:tasks.workunit.client.1.smithi194.stdout:3/584: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/fbc x:0 0 0 2024-04-13T10:58:42.674 INFO:tasks.workunit.client.1.smithi194.stdout:3/585: write d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/fac [360842,38642] 0 2024-04-13T10:58:42.674 INFO:tasks.workunit.client.1.smithi194.stdout:1/565: symlink d12/d3a/dad/lbe 0 2024-04-13T10:58:42.675 INFO:tasks.workunit.client.1.smithi194.stdout:1/566: fdatasync d12/d13/d44/f89 0 2024-04-13T10:58:42.678 INFO:tasks.workunit.client.1.smithi194.stdout:3/586: mknod d2/d3/d12/d31/d34/d88/cbd 0 2024-04-13T10:58:42.679 INFO:tasks.workunit.client.1.smithi194.stdout:1/567: unlink c7 0 2024-04-13T10:58:42.681 INFO:tasks.workunit.client.1.smithi194.stdout:3/587: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/fbe x:0 0 0 2024-04-13T10:58:42.681 INFO:tasks.workunit.client.1.smithi194.stdout:3/588: write d2/d3/f3d [1107517,10169] 0 2024-04-13T10:58:42.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:42 smithi134 ceph-mon[39696]: pgmap v25: 65 pgs: 65 active+clean; 953 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 MiB/s rd, 120 MiB/s wr, 238 op/s 2024-04-13T10:58:42.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:42 smithi134 ceph-mon[39696]: Standby manager daemon smithi134.tmanda restarted 2024-04-13T10:58:42.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:42 smithi134 ceph-mon[39696]: Standby manager daemon smithi134.tmanda started 2024-04-13T10:58:42.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:42 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.tmanda/crt"}]: dispatch 2024-04-13T10:58:42.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:42 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T10:58:42.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:42 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.tmanda/key"}]: dispatch 2024-04-13T10:58:42.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:42 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T10:58:42.686 INFO:tasks.workunit.client.1.smithi194.stdout:3/589: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/fbf x:0 0 0 2024-04-13T10:58:42.687 INFO:tasks.workunit.client.1.smithi194.stdout:1/568: dwrite d12/d13/d1c/f21 [4194304,4194304] 0 2024-04-13T10:58:42.688 INFO:tasks.workunit.client.1.smithi194.stdout:8/652: write d6/d22/d23/d25/d39/d41/f74 [2161209,130467] 0 2024-04-13T10:58:42.688 INFO:tasks.workunit.client.1.smithi194.stdout:3/590: chown d2/d7d/f9f 219 1 2024-04-13T10:58:42.689 INFO:tasks.workunit.client.1.smithi194.stdout:8/653: stat d6/d22/d23/d25/d68/cd6 0 2024-04-13T10:58:42.692 INFO:tasks.workunit.client.1.smithi194.stdout:3/591: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/fc0 x:0 0 0 2024-04-13T10:58:42.692 INFO:tasks.workunit.client.1.smithi194.stdout:5/568: sync 2024-04-13T10:58:42.693 INFO:tasks.workunit.client.1.smithi194.stdout:8/654: dread d6/d22/d23/f85 [0,4194304] 0 2024-04-13T10:58:42.695 INFO:tasks.workunit.client.1.smithi194.stdout:1/569: dwrite f1 [0,4194304] 0 2024-04-13T10:58:42.696 INFO:tasks.workunit.client.1.smithi194.stdout:8/655: chown d6/dd/d45/cae 26109 1 2024-04-13T10:58:42.699 INFO:tasks.workunit.client.1.smithi194.stdout:5/569: rename d3/d29/d9c/da1 to d3/dc/d10/d20/daa 0 2024-04-13T10:58:42.702 INFO:tasks.workunit.client.1.smithi194.stdout:3/592: rename d2/de/l50 to d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/lc1 0 2024-04-13T10:58:42.703 INFO:tasks.workunit.client.1.smithi194.stdout:5/570: creat d3/dc/d2d/fab x:0 0 0 2024-04-13T10:58:42.705 INFO:tasks.workunit.client.1.smithi194.stdout:1/570: rename d12/c23 to d12/d13/d1c/d27/d2e/cbf 0 2024-04-13T10:58:42.707 INFO:tasks.workunit.client.1.smithi194.stdout:5/571: creat d3/dc/d17/d1b/d6b/fac x:0 0 0 2024-04-13T10:58:42.708 INFO:tasks.workunit.client.1.smithi194.stdout:5/572: chown d3/dc/d10/c6e 26787215 1 2024-04-13T10:58:42.709 INFO:tasks.workunit.client.1.smithi194.stdout:5/573: readlink d3/dc/d10/d38/d59/d49/l6f 0 2024-04-13T10:58:42.711 INFO:tasks.workunit.client.1.smithi194.stdout:5/574: rmdir d3/dc/d10/d38/d59 39 2024-04-13T10:58:42.711 INFO:tasks.workunit.client.1.smithi194.stdout:5/575: read - d3/dc/d2d/f9f zero size 2024-04-13T10:58:42.714 INFO:tasks.workunit.client.1.smithi194.stdout:5/576: symlink d3/dc/d17/d93/lad 0 2024-04-13T10:58:42.714 INFO:tasks.workunit.client.1.smithi194.stdout:8/656: dread f2 [0,4194304] 0 2024-04-13T10:58:42.716 INFO:tasks.workunit.client.1.smithi194.stdout:5/577: mkdir d3/dc/d10/d20/daa/dae 0 2024-04-13T10:58:42.717 INFO:tasks.workunit.client.1.smithi194.stdout:8/657: write d6/d22/d23/f54 [6685445,104069] 0 2024-04-13T10:58:42.718 INFO:tasks.workunit.client.1.smithi194.stdout:5/578: creat d3/dc/faf x:0 0 0 2024-04-13T10:58:42.720 INFO:tasks.workunit.client.1.smithi194.stdout:8/658: mkdir d6/d22/d23/d25/d39/d41/d5b/d76/dc5/de0 0 2024-04-13T10:58:42.722 INFO:tasks.workunit.client.1.smithi194.stdout:8/659: creat d6/d22/d23/d25/d39/fe1 x:0 0 0 2024-04-13T10:58:42.723 INFO:tasks.workunit.client.1.smithi194.stdout:8/660: write d6/d2a/f34 [5964137,15664] 0 2024-04-13T10:58:42.729 INFO:tasks.workunit.client.1.smithi194.stdout:8/661: dwrite d6/d22/d23/d25/d39/d41/d5b/d76/d33/fab [0,4194304] 0 2024-04-13T10:58:42.733 INFO:tasks.workunit.client.1.smithi194.stdout:5/579: dread d3/dc/d17/d1b/f8a [0,4194304] 0 2024-04-13T10:58:42.736 INFO:tasks.workunit.client.1.smithi194.stdout:5/580: mknod d3/dc/d17/d93/cb0 0 2024-04-13T10:58:42.740 INFO:tasks.workunit.client.1.smithi194.stdout:5/581: rename d3/d29/d9c to d3/dc/d10/d38/d46/db1 0 2024-04-13T10:58:42.743 INFO:tasks.workunit.client.1.smithi194.stdout:8/662: dread d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3a [4194304,4194304] 0 2024-04-13T10:58:42.747 INFO:tasks.workunit.client.1.smithi194.stdout:8/663: getdents d6/d22/d23/d3d 0 2024-04-13T10:58:42.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:42 smithi194 ceph-mon[46737]: pgmap v25: 65 pgs: 65 active+clean; 953 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 MiB/s rd, 120 MiB/s wr, 238 op/s 2024-04-13T10:58:42.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:42 smithi194 ceph-mon[46737]: Standby manager daemon smithi134.tmanda restarted 2024-04-13T10:58:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:42 smithi194 ceph-mon[46737]: Standby manager daemon smithi134.tmanda started 2024-04-13T10:58:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:42 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.tmanda/crt"}]: dispatch 2024-04-13T10:58:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:42 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T10:58:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:42 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.tmanda/key"}]: dispatch 2024-04-13T10:58:42.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:42 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T10:58:42.748 INFO:tasks.workunit.client.1.smithi194.stdout:8/664: mkdir d6/d22/d23/d7f/de2 0 2024-04-13T10:58:42.749 INFO:tasks.workunit.client.1.smithi194.stdout:8/665: write d6/d2a/f34 [4276157,118874] 0 2024-04-13T10:58:42.756 INFO:tasks.workunit.client.1.smithi194.stdout:8/666: truncate d6/dd/f48 967528 0 2024-04-13T10:58:42.759 INFO:tasks.workunit.client.1.smithi194.stdout:8/667: rename d6/d22/d23/d25/d39/d41/d64 to d6/dd/d45/de3 0 2024-04-13T10:58:42.765 INFO:tasks.workunit.client.1.smithi194.stdout:8/668: dwrite d6/d22/d23/d25/f8a [0,4194304] 0 2024-04-13T10:58:42.766 INFO:tasks.workunit.client.1.smithi194.stdout:8/669: chown d6/d2a/dc7/dc8 13 1 2024-04-13T10:58:42.780 INFO:tasks.workunit.client.1.smithi194.stdout:8/670: dread d6/d22/d23/f54 [0,4194304] 0 2024-04-13T10:58:42.781 INFO:tasks.workunit.client.1.smithi194.stdout:8/671: write d6/dd/f9f [396350,125250] 0 2024-04-13T10:58:42.783 INFO:tasks.workunit.client.1.smithi194.stdout:8/672: symlink d6/d22/d23/d25/d39/d41/d5b/d76/d33/le4 0 2024-04-13T10:58:42.789 INFO:tasks.workunit.client.1.smithi194.stdout:8/673: dwrite d6/d22/d23/d7f/f91 [0,4194304] 0 2024-04-13T10:58:42.791 INFO:tasks.workunit.client.1.smithi194.stdout:8/674: fdatasync d6/f52 0 2024-04-13T10:58:42.792 INFO:tasks.workunit.client.1.smithi194.stdout:8/675: chown d6/d22/d23/d25/d78/c7c 421839233 1 2024-04-13T10:58:42.796 INFO:tasks.workunit.client.1.smithi194.stdout:8/676: unlink d6/d22/d23/d25/d39/d41/c9d 0 2024-04-13T10:58:42.799 INFO:tasks.workunit.client.1.smithi194.stdout:8/677: rename d6/d22/d23/d25/d68 to d6/d22/d23/d25/d71/da0/de5 0 2024-04-13T10:58:42.800 INFO:tasks.workunit.client.1.smithi194.stdout:8/678: stat d6/dd/f48 0 2024-04-13T10:58:42.801 INFO:tasks.workunit.client.1.smithi194.stdout:8/679: stat d6/d22/l24 0 2024-04-13T10:58:42.803 INFO:tasks.workunit.client.1.smithi194.stdout:8/680: dread d6/d22/d23/d25/f27 [0,4194304] 0 2024-04-13T10:58:42.806 INFO:tasks.workunit.client.1.smithi194.stdout:8/681: link d6/dd/d45/cae d6/d2a/d69/dc4/ce6 0 2024-04-13T10:58:42.810 INFO:tasks.workunit.client.1.smithi194.stdout:8/682: dread - d6/d22/d23/d25/d39/fa4 zero size 2024-04-13T10:58:42.821 INFO:tasks.workunit.client.1.smithi194.stdout:8/683: dread d6/d22/d23/d25/fa8 [0,4194304] 0 2024-04-13T10:58:42.823 INFO:tasks.workunit.client.1.smithi194.stdout:8/684: unlink d6/d22/d23/d3d/f47 0 2024-04-13T10:58:42.824 INFO:tasks.workunit.client.1.smithi194.stdout:8/685: fsync d6/d2a/d69/dc4/fd1 0 2024-04-13T10:58:42.825 INFO:tasks.workunit.client.1.smithi194.stdout:8/686: mkdir d6/d22/d23/d7f/d8c/de7 0 2024-04-13T10:58:42.827 INFO:tasks.workunit.client.1.smithi194.stdout:8/687: creat d6/d22/d23/d7f/de2/fe8 x:0 0 0 2024-04-13T10:58:42.827 INFO:tasks.workunit.client.1.smithi194.stdout:4/582: sync 2024-04-13T10:58:42.829 INFO:tasks.workunit.client.1.smithi194.stdout:4/583: read d2/d16/d1a/d1c/d3e/d48/f80 [6295950,33983] 0 2024-04-13T10:58:42.831 INFO:tasks.workunit.client.1.smithi194.stdout:4/584: mkdir d2/daf/dc4 0 2024-04-13T10:58:42.832 INFO:tasks.workunit.client.1.smithi194.stdout:4/585: chown d2/d30/lb6 0 1 2024-04-13T10:58:42.833 INFO:tasks.workunit.client.1.smithi194.stdout:8/688: dwrite f2 [0,4194304] 0 2024-04-13T10:58:42.836 INFO:tasks.workunit.client.1.smithi194.stdout:8/689: mkdir d6/dd/d45/de3/de9 0 2024-04-13T10:58:42.838 INFO:tasks.workunit.client.1.smithi194.stdout:8/690: mknod d6/d2a/dce/cea 0 2024-04-13T10:58:42.838 INFO:tasks.workunit.client.1.smithi194.stdout:8/691: read f5 [3224032,45237] 0 2024-04-13T10:58:42.848 INFO:tasks.workunit.client.1.smithi194.stdout:8/692: truncate d6/d22/d23/d25/f8a 1959220 0 2024-04-13T10:58:42.849 INFO:tasks.workunit.client.1.smithi194.stdout:4/586: dwrite d2/d16/d1a/f36 [0,4194304] 0 2024-04-13T10:58:42.850 INFO:tasks.workunit.client.1.smithi194.stdout:4/587: dread - d2/d33/fab zero size 2024-04-13T10:58:42.853 INFO:tasks.workunit.client.1.smithi194.stdout:8/693: rename d6/dd/d80 to d6/d22/d23/d25/d71/da0/de5/deb 0 2024-04-13T10:58:42.856 INFO:tasks.workunit.client.1.smithi194.stdout:8/694: dread d6/f1d [0,4194304] 0 2024-04-13T10:58:42.858 INFO:tasks.workunit.client.1.smithi194.stdout:4/588: link d2/d16/d1a/d1c/d3b/l78 d2/d16/d1a/d1c/d9a/lc5 0 2024-04-13T10:58:42.858 INFO:tasks.workunit.client.1.smithi194.stdout:8/695: readlink d6/d22/d23/d25/d39/d41/d5b/d76/d33/le4 0 2024-04-13T10:58:42.860 INFO:tasks.workunit.client.1.smithi194.stdout:4/589: creat d2/d16/d70/d31/fc6 x:0 0 0 2024-04-13T10:58:42.861 INFO:tasks.workunit.client.1.smithi194.stdout:8/696: readlink d6/d22/d23/d25/laf 0 2024-04-13T10:58:42.862 INFO:tasks.workunit.client.1.smithi194.stdout:4/590: mknod d2/d16/d1a/d1c/d54/d62/cc7 0 2024-04-13T10:58:42.864 INFO:tasks.workunit.client.1.smithi194.stdout:4/591: write d2/d16/d1a/d1c/d54/f5f [3557534,89137] 0 2024-04-13T10:58:42.865 INFO:tasks.workunit.client.1.smithi194.stdout:4/592: chown d2/d16/d1a/d1c/c5b 262 1 2024-04-13T10:58:42.867 INFO:tasks.workunit.client.1.smithi194.stdout:8/697: dread d6/d22/f26 [0,4194304] 0 2024-04-13T10:58:42.868 INFO:tasks.workunit.client.1.smithi194.stdout:4/593: symlink d2/d16/d1a/d1c/d3e/d48/lc8 0 2024-04-13T10:58:42.869 INFO:tasks.workunit.client.1.smithi194.stdout:8/698: symlink d6/d2a/d69/da2/lec 0 2024-04-13T10:58:42.870 INFO:tasks.workunit.client.1.smithi194.stdout:8/699: chown d6/d22/d23/d25/d39/d41/d5b/d76/dc5/ccd 36868358 1 2024-04-13T10:58:42.872 INFO:tasks.workunit.client.1.smithi194.stdout:4/594: truncate d2/d16/d1a/d1c/d9a/fb7 719513 0 2024-04-13T10:58:42.873 INFO:tasks.workunit.client.1.smithi194.stdout:4/595: truncate d2/d16/d1a/d1c/d3b/d8d/fc1 630726 0 2024-04-13T10:58:42.875 INFO:tasks.workunit.client.1.smithi194.stdout:4/596: write d2/d16/d1a/d1c/d3b/d42/fa6 [401664,35541] 0 2024-04-13T10:58:42.877 INFO:tasks.workunit.client.1.smithi194.stdout:8/700: dwrite d6/d22/d23/d25/fa8 [0,4194304] 0 2024-04-13T10:58:42.882 INFO:tasks.workunit.client.1.smithi194.stdout:8/701: unlink d6/d22/d23/d25/d39/d41/f74 0 2024-04-13T10:58:42.883 INFO:tasks.workunit.client.1.smithi194.stdout:8/702: write d6/d2a/d69/da2/fb7 [1370701,114623] 0 2024-04-13T10:58:42.884 INFO:tasks.workunit.client.1.smithi194.stdout:4/597: dwrite d2/d16/d1a/d1c/d3e/d48/f80 [4194304,4194304] 0 2024-04-13T10:58:42.886 INFO:tasks.workunit.client.1.smithi194.stdout:4/598: write d2/d16/d1a/d60/fb3 [97950,126953] 0 2024-04-13T10:58:42.887 INFO:tasks.workunit.client.1.smithi194.stdout:8/703: symlink d6/d2a/d69/da3/led 0 2024-04-13T10:58:42.889 INFO:tasks.workunit.client.1.smithi194.stdout:8/704: fdatasync d6/d22/d23/d25/d39/d41/f4e 0 2024-04-13T10:58:42.890 INFO:tasks.workunit.client.1.smithi194.stdout:4/599: truncate d2/d16/d1a/d1c/d54/d62/d6e/d99/fbd 429696 0 2024-04-13T10:58:42.890 INFO:tasks.workunit.client.1.smithi194.stdout:8/705: write d6/f52 [4146868,125338] 0 2024-04-13T10:58:42.893 INFO:tasks.workunit.client.1.smithi194.stdout:4/600: creat d2/d16/d70/d31/d44/fc9 x:0 0 0 2024-04-13T10:58:42.893 INFO:tasks.workunit.client.1.smithi194.stdout:8/706: mkdir d6/dee 0 2024-04-13T10:58:42.898 INFO:tasks.workunit.client.1.smithi194.stdout:8/707: unlink d6/l5a 0 2024-04-13T10:58:42.900 INFO:tasks.workunit.client.1.smithi194.stdout:4/601: dwrite d2/d16/d1a/f35 [4194304,4194304] 0 2024-04-13T10:58:42.901 INFO:tasks.workunit.client.1.smithi194.stdout:8/708: readlink d6/d22/d23/d25/d71/da0/de5/deb/dac/ld7 0 2024-04-13T10:58:42.902 INFO:tasks.workunit.client.1.smithi194.stdout:8/709: write d6/f52 [3260691,120028] 0 2024-04-13T10:58:42.902 INFO:tasks.workunit.client.1.smithi194.stdout:4/602: write d2/d16/d1a/f22 [3735099,75636] 0 2024-04-13T10:58:42.905 INFO:tasks.workunit.client.1.smithi194.stdout:4/603: dread - d2/d16/d1a/d1c/d54/d62/d6e/fbe zero size 2024-04-13T10:58:42.906 INFO:tasks.workunit.client.1.smithi194.stdout:4/604: chown d2/d16/d1a/f8c 7763575 1 2024-04-13T10:58:42.909 INFO:tasks.workunit.client.1.smithi194.stdout:8/710: dread d6/f1d [0,4194304] 0 2024-04-13T10:58:42.912 INFO:tasks.workunit.client.1.smithi194.stdout:8/711: link d6/d22/c83 d6/d22/d23/d25/d71/da0/de5/cef 0 2024-04-13T10:58:42.921 INFO:tasks.workunit.client.1.smithi194.stdout:9/541: sync 2024-04-13T10:58:42.921 INFO:tasks.workunit.client.1.smithi194.stdout:2/563: sync 2024-04-13T10:58:42.921 INFO:tasks.workunit.client.1.smithi194.stdout:0/527: sync 2024-04-13T10:58:42.923 INFO:tasks.workunit.client.1.smithi194.stdout:9/542: truncate d0/d6/d4a/d74/f7d 476602 0 2024-04-13T10:58:42.926 INFO:tasks.workunit.client.1.smithi194.stdout:9/543: creat d0/d88/fb9 x:0 0 0 2024-04-13T10:58:42.928 INFO:tasks.workunit.client.1.smithi194.stdout:4/605: dread d2/d16/d70/f26 [8388608,4194304] 0 2024-04-13T10:58:42.929 INFO:tasks.workunit.client.1.smithi194.stdout:2/564: write d2/d3/de/d33/d47/f50 [1978963,57405] 0 2024-04-13T10:58:42.929 INFO:tasks.workunit.client.1.smithi194.stdout:0/528: dwrite d9/d2b/f4f [0,4194304] 0 2024-04-13T10:58:42.933 INFO:tasks.workunit.client.1.smithi194.stdout:9/544: dread d0/d6/d14/d26/d3b/f63 [0,4194304] 0 2024-04-13T10:58:42.934 INFO:tasks.workunit.client.1.smithi194.stdout:2/565: stat d2/d3/de/d17/d36/d65/l9a 0 2024-04-13T10:58:42.935 INFO:tasks.workunit.client.1.smithi194.stdout:0/529: mknod d9/df/d16/d65/cad 0 2024-04-13T10:58:42.935 INFO:tasks.workunit.client.1.smithi194.stdout:8/712: dwrite f5 [0,4194304] 0 2024-04-13T10:58:42.936 INFO:tasks.workunit.client.1.smithi194.stdout:9/545: mkdir d0/d6/d2c/dba 0 2024-04-13T10:58:42.936 INFO:tasks.workunit.client.1.smithi194.stdout:0/530: stat d9/db/d3a/l45 0 2024-04-13T10:58:42.937 INFO:tasks.workunit.client.1.smithi194.stdout:9/546: write d0/d6/d2c/f69 [1975357,13979] 0 2024-04-13T10:58:42.938 INFO:tasks.workunit.client.1.smithi194.stdout:4/606: rename d2/d16/d1a/d1c/l84 to d2/d16/d1a/d1c/d54/d5d/d98/lca 0 2024-04-13T10:58:42.943 INFO:tasks.workunit.client.1.smithi194.stdout:8/713: dread d6/d22/d23/d25/d39/d41/d5b/d76/d33/fab [0,4194304] 0 2024-04-13T10:58:42.946 INFO:tasks.workunit.client.1.smithi194.stdout:2/566: creat d2/d3/d12/dba/fbc x:0 0 0 2024-04-13T10:58:42.946 INFO:tasks.workunit.client.1.smithi194.stdout:9/547: creat d0/d11/d79/fbb x:0 0 0 2024-04-13T10:58:42.946 INFO:tasks.workunit.client.1.smithi194.stdout:4/607: fdatasync d2/d16/d1a/d1c/d3e/d48/d7f/fb0 0 2024-04-13T10:58:42.946 INFO:tasks.workunit.client.1.smithi194.stdout:0/531: mkdir d9/df/d16/d83/dae 0 2024-04-13T10:58:42.947 INFO:tasks.workunit.client.1.smithi194.stdout:0/532: truncate d9/f4b 4637544 0 2024-04-13T10:58:42.948 INFO:tasks.workunit.client.1.smithi194.stdout:4/608: dread - d2/d16/d1a/d1c/d3b/d42/f7a zero size 2024-04-13T10:58:42.948 INFO:tasks.workunit.client.1.smithi194.stdout:8/714: readlink d6/d22/d23/d25/d71/da0/de5/dd0/ld2 0 2024-04-13T10:58:42.948 INFO:tasks.workunit.client.1.smithi194.stdout:0/533: write d9/db/f2a [2806154,61996] 0 2024-04-13T10:58:42.949 INFO:tasks.workunit.client.1.smithi194.stdout:2/567: creat d2/d3/de/d17/d36/d8f/fbd x:0 0 0 2024-04-13T10:58:42.950 INFO:tasks.workunit.client.1.smithi194.stdout:4/609: write d2/d33/fab [816247,50042] 0 2024-04-13T10:58:42.951 INFO:tasks.workunit.client.1.smithi194.stdout:8/715: chown d6/dd/d45/de3/de9 418085456 1 2024-04-13T10:58:42.952 INFO:tasks.workunit.client.1.smithi194.stdout:0/534: truncate d9/db/d19/f90 276924 0 2024-04-13T10:58:42.954 INFO:tasks.workunit.client.1.smithi194.stdout:2/568: symlink d2/d3/d6d/dac/lbe 0 2024-04-13T10:58:42.956 INFO:tasks.workunit.client.1.smithi194.stdout:8/716: creat d6/d22/d23/d7f/d8c/d8d/ddc/ff0 x:0 0 0 2024-04-13T10:58:42.956 INFO:tasks.workunit.client.1.smithi194.stdout:8/717: chown d6/d2a/d69 209332 1 2024-04-13T10:58:42.957 INFO:tasks.workunit.client.1.smithi194.stdout:0/535: creat d9/d2b/d6c/faf x:0 0 0 2024-04-13T10:58:42.958 INFO:tasks.workunit.client.1.smithi194.stdout:2/569: rename d2/d3/de/d17/d39/f80 to d2/d3/de/d17/d1e/fbf 0 2024-04-13T10:58:42.960 INFO:tasks.workunit.client.1.smithi194.stdout:8/718: creat d6/d2a/dc7/ff1 x:0 0 0 2024-04-13T10:58:42.961 INFO:tasks.workunit.client.1.smithi194.stdout:0/536: symlink d9/d2b/d5a/lb0 0 2024-04-13T10:58:42.962 INFO:tasks.workunit.client.1.smithi194.stdout:9/548: write d0/d11/f41 [2221567,79391] 0 2024-04-13T10:58:42.964 INFO:tasks.workunit.client.1.smithi194.stdout:2/570: getdents d2/d3/d12 0 2024-04-13T10:58:42.965 INFO:tasks.workunit.client.1.smithi194.stdout:9/549: dread d0/f37 [0,4194304] 0 2024-04-13T10:58:42.968 INFO:tasks.workunit.client.1.smithi194.stdout:9/550: chown d0/d6/d14/d26/d3b/faa 11544 1 2024-04-13T10:58:42.968 INFO:tasks.workunit.client.1.smithi194.stdout:2/571: unlink d2/d3/de/d33/f35 0 2024-04-13T10:58:42.970 INFO:tasks.workunit.client.1.smithi194.stdout:0/537: dwrite d9/db/d3a/f57 [0,4194304] 0 2024-04-13T10:58:42.975 INFO:tasks.workunit.client.1.smithi194.stdout:4/610: dread d2/d16/d70/f68 [0,4194304] 0 2024-04-13T10:58:42.977 INFO:tasks.workunit.client.1.smithi194.stdout:9/551: rename d0/d6/d2c/l80 to d0/d6/d4a/d74/lbc 0 2024-04-13T10:58:42.977 INFO:tasks.workunit.client.1.smithi194.stdout:0/538: dread d9/db/d19/f50 [0,4194304] 0 2024-04-13T10:58:42.980 INFO:tasks.workunit.client.1.smithi194.stdout:4/611: rename d2/d30/d50/f6b to d2/d16/d1a/d1c/d3b/d42/fcb 0 2024-04-13T10:58:42.981 INFO:tasks.workunit.client.1.smithi194.stdout:2/572: getdents d2/d3/de/d17/d1e/d42/d86 0 2024-04-13T10:58:42.981 INFO:tasks.workunit.client.1.smithi194.stdout:2/573: readlink d2/d3/lb 0 2024-04-13T10:58:42.987 INFO:tasks.workunit.client.1.smithi194.stdout:0/539: rename d9/db/d19 to d9/db1 0 2024-04-13T10:58:42.988 INFO:tasks.workunit.client.1.smithi194.stdout:2/574: creat d2/d3/fc0 x:0 0 0 2024-04-13T10:58:42.988 INFO:tasks.workunit.client.1.smithi194.stdout:0/540: dread d9/db1/f90 [0,4194304] 0 2024-04-13T10:58:42.992 INFO:tasks.workunit.client.1.smithi194.stdout:0/541: truncate d9/db/f8a 54740 0 2024-04-13T10:58:42.992 INFO:tasks.workunit.client.1.smithi194.stdout:2/575: dwrite d2/d3/fa4 [0,4194304] 0 2024-04-13T10:58:42.995 INFO:tasks.workunit.client.1.smithi194.stdout:9/552: truncate d0/d11/d58/f5f 2756497 0 2024-04-13T10:58:42.995 INFO:tasks.workunit.client.1.smithi194.stdout:4/612: truncate d2/d16/d1a/f6f 3358643 0 2024-04-13T10:58:42.997 INFO:tasks.workunit.client.1.smithi194.stdout:9/553: rmdir d0/d6/d2c 39 2024-04-13T10:58:42.999 INFO:tasks.workunit.client.1.smithi194.stdout:9/554: chown d0/f37 39 1 2024-04-13T10:58:43.001 INFO:tasks.workunit.client.1.smithi194.stdout:0/542: dwrite d9/d2b/f96 [0,4194304] 0 2024-04-13T10:58:43.002 INFO:tasks.workunit.client.1.smithi194.stdout:9/555: write d0/d11/d79/f84 [2500951,39218] 0 2024-04-13T10:58:43.005 INFO:tasks.workunit.client.1.smithi194.stdout:0/543: chown d9/d2b/l32 461065108 1 2024-04-13T10:58:43.009 INFO:tasks.workunit.client.1.smithi194.stdout:9/556: symlink d0/d11/da3/lbd 0 2024-04-13T10:58:43.013 INFO:tasks.workunit.client.1.smithi194.stdout:0/544: dwrite d9/df/f23 [0,4194304] 0 2024-04-13T10:58:43.018 INFO:tasks.workunit.client.1.smithi194.stdout:9/557: mknod d0/d6/d2c/cbe 0 2024-04-13T10:58:43.019 INFO:tasks.workunit.client.1.smithi194.stdout:4/613: write d2/d16/d1a/d1c/d3e/fb5 [757221,16624] 0 2024-04-13T10:58:43.021 INFO:tasks.workunit.client.1.smithi194.stdout:4/614: truncate d2/d16/d1a/d1c/d3e/f3f 1704399 0 2024-04-13T10:58:43.024 INFO:tasks.workunit.client.1.smithi194.stdout:4/615: mkdir d2/d16/d70/d31/d44/dcc 0 2024-04-13T10:58:43.027 INFO:tasks.workunit.client.1.smithi194.stdout:3/593: sync 2024-04-13T10:58:43.027 INFO:tasks.workunit.client.1.smithi194.stdout:5/582: sync 2024-04-13T10:58:43.028 INFO:tasks.workunit.client.1.smithi194.stdout:7/642: sync 2024-04-13T10:58:43.028 INFO:tasks.workunit.client.1.smithi194.stdout:6/541: sync 2024-04-13T10:58:43.028 INFO:tasks.workunit.client.1.smithi194.stdout:1/571: sync 2024-04-13T10:58:43.032 INFO:tasks.workunit.client.1.smithi194.stdout:7/643: stat d1/d2b/d4c/d4f/f70 0 2024-04-13T10:58:43.033 INFO:tasks.workunit.client.1.smithi194.stdout:6/542: symlink d0/d2f/d6f/lae 0 2024-04-13T10:58:43.035 INFO:tasks.workunit.client.1.smithi194.stdout:1/572: creat d12/d13/d1c/d27/d4c/d7f/d8b/fc0 x:0 0 0 2024-04-13T10:58:43.036 INFO:tasks.workunit.client.1.smithi194.stdout:3/594: mkdir d2/d3/d12/d31/d34/d88/d24/d6c/dc2 0 2024-04-13T10:58:43.036 INFO:tasks.workunit.client.1.smithi194.stdout:9/558: dwrite d0/d6/d9/f48 [0,4194304] 0 2024-04-13T10:58:43.039 INFO:tasks.workunit.client.1.smithi194.stdout:4/616: dwrite d2/d16/d1a/f22 [0,4194304] 0 2024-04-13T10:58:43.041 INFO:tasks.workunit.client.1.smithi194.stdout:5/583: rename d3/lb to d3/dc/d10/d38/d59/d49/da4/lb2 0 2024-04-13T10:58:43.041 INFO:tasks.workunit.client.1.smithi194.stdout:3/595: read d2/fd [27304,121388] 0 2024-04-13T10:58:43.042 INFO:tasks.workunit.client.1.smithi194.stdout:0/545: dread d9/db/d3a/f49 [0,4194304] 0 2024-04-13T10:58:43.045 INFO:tasks.workunit.client.1.smithi194.stdout:7/644: getdents d1/d6c 0 2024-04-13T10:58:43.046 INFO:tasks.workunit.client.1.smithi194.stdout:8/719: sync 2024-04-13T10:58:43.047 INFO:tasks.workunit.client.1.smithi194.stdout:4/617: chown d2/d30/c46 31849 1 2024-04-13T10:58:43.048 INFO:tasks.workunit.client.1.smithi194.stdout:2/576: dread d2/d3/f73 [0,4194304] 0 2024-04-13T10:58:43.050 INFO:tasks.workunit.client.1.smithi194.stdout:3/596: stat d2/d3/d12/d31/d34/d88/d24/d3a/f45 0 2024-04-13T10:58:43.052 INFO:tasks.workunit.client.1.smithi194.stdout:5/584: truncate d3/d29/f3f 1697187 0 2024-04-13T10:58:43.053 INFO:tasks.workunit.client.1.smithi194.stdout:2/577: write d2/d3/fc0 [274561,110256] 0 2024-04-13T10:58:43.054 INFO:tasks.workunit.client.1.smithi194.stdout:7/645: fdatasync d1/d2b/d3e/d54/d5a/d3c/f65 0 2024-04-13T10:58:43.055 INFO:tasks.workunit.client.1.smithi194.stdout:9/559: dread d0/d6/d2c/d68/f6a [0,4194304] 0 2024-04-13T10:58:43.055 INFO:tasks.workunit.client.1.smithi194.stdout:8/720: creat d6/d22/d23/d7f/d8c/d8d/ddc/ff2 x:0 0 0 2024-04-13T10:58:43.056 INFO:tasks.workunit.client.1.smithi194.stdout:4/618: creat d2/d16/d70/d31/d44/fcd x:0 0 0 2024-04-13T10:58:43.059 INFO:tasks.workunit.client.1.smithi194.stdout:3/597: link d2/d7d/l83 d2/de/lc3 0 2024-04-13T10:58:43.060 INFO:tasks.workunit.client.1.smithi194.stdout:6/543: dread d0/d26/f29 [0,4194304] 0 2024-04-13T10:58:43.065 INFO:tasks.workunit.client.1.smithi194.stdout:9/560: chown d0/d6/d14/d26/d3b/fa2 1779863 1 2024-04-13T10:58:43.065 INFO:tasks.workunit.client.1.smithi194.stdout:8/721: creat d6/d22/d23/d25/d71/da0/ff3 x:0 0 0 2024-04-13T10:58:43.065 INFO:tasks.workunit.client.1.smithi194.stdout:0/546: dwrite d9/df/d16/d70/f9d [0,4194304] 0 2024-04-13T10:58:43.067 INFO:tasks.workunit.client.1.smithi194.stdout:6/544: dread - d0/d53/d78/d91/fa7 zero size 2024-04-13T10:58:43.069 INFO:tasks.workunit.client.1.smithi194.stdout:2/578: rename d2/d3/de/d17/d36/d3d/c95 to d2/d3/de/d17/d36/d65/cc1 0 2024-04-13T10:58:43.070 INFO:tasks.workunit.client.1.smithi194.stdout:9/561: chown d0/d11/f41 47301914 1 2024-04-13T10:58:43.073 INFO:tasks.workunit.client.1.smithi194.stdout:4/619: truncate d2/d16/d1a/d1c/d54/d62/d6e/fbe 837626 0 2024-04-13T10:58:43.073 INFO:tasks.workunit.client.1.smithi194.stdout:1/573: dread d12/d13/d1c/d27/d2e/f62 [0,4194304] 0 2024-04-13T10:58:43.074 INFO:tasks.workunit.client.1.smithi194.stdout:8/722: creat d6/dd/d45/de3/ff4 x:0 0 0 2024-04-13T10:58:43.076 INFO:tasks.workunit.client.1.smithi194.stdout:5/585: dwrite d3/dc/d10/d38/d59/d49/f88 [0,4194304] 0 2024-04-13T10:58:43.077 INFO:tasks.workunit.client.1.smithi194.stdout:2/579: chown d2/d3/de/d33/d47/f85 23 1 2024-04-13T10:58:43.077 INFO:tasks.workunit.client.1.smithi194.stdout:9/562: dread - d0/d6/d4a/d74/dae/faf zero size 2024-04-13T10:58:43.079 INFO:tasks.workunit.client.1.smithi194.stdout:7/646: dwrite d1/d2b/d3e/d54/d5a/f58 [0,4194304] 0 2024-04-13T10:58:43.079 INFO:tasks.workunit.client.1.smithi194.stdout:3/598: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95/lc4 0 2024-04-13T10:58:43.081 INFO:tasks.workunit.client.1.smithi194.stdout:5/586: chown d3/dc/d17/d1b/f42 7439 1 2024-04-13T10:58:43.089 INFO:tasks.workunit.client.1.smithi194.stdout:1/574: rmdir d12/d13/d1c/d27/d4c/d7f/d8b 39 2024-04-13T10:58:43.089 INFO:tasks.workunit.client.1.smithi194.stdout:4/620: creat d2/d16/d1a/d1c/d54/fce x:0 0 0 2024-04-13T10:58:43.090 INFO:tasks.workunit.client.1.smithi194.stdout:8/723: creat d6/dd/d45/de3/dd3/ff5 x:0 0 0 2024-04-13T10:58:43.091 INFO:tasks.workunit.client.1.smithi194.stdout:6/545: getdents d0/d26/d2b/d4d 0 2024-04-13T10:58:43.092 INFO:tasks.workunit.client.1.smithi194.stdout:2/580: rename d2/d3/de/d17/c87 to d2/d3/d12/cc2 0 2024-04-13T10:58:43.093 INFO:tasks.workunit.client.1.smithi194.stdout:0/547: dwrite d9/db/f1b [0,4194304] 0 2024-04-13T10:58:43.094 INFO:tasks.workunit.client.1.smithi194.stdout:6/546: chown d0/f73 427 1 2024-04-13T10:58:43.096 INFO:tasks.workunit.client.1.smithi194.stdout:3/599: dwrite d2/d3/d12/d31/f4f [0,4194304] 0 2024-04-13T10:58:43.096 INFO:tasks.workunit.client.1.smithi194.stdout:5/587: mknod d3/dc/d10/d38/d59/cb3 0 2024-04-13T10:58:43.097 INFO:tasks.workunit.client.1.smithi194.stdout:7/647: creat d1/d2b/d3e/d54/d5a/fd5 x:0 0 0 2024-04-13T10:58:43.098 INFO:tasks.workunit.client.1.smithi194.stdout:6/547: dread - d0/d26/f5c zero size 2024-04-13T10:58:43.101 INFO:tasks.workunit.client.1.smithi194.stdout:1/575: unlink d12/d13/d1c/d28/d41/d50/d96/fb7 0 2024-04-13T10:58:43.105 INFO:tasks.workunit.client.1.smithi194.stdout:5/588: symlink d3/dc/d10/lb4 0 2024-04-13T10:58:43.106 INFO:tasks.workunit.client.1.smithi194.stdout:2/581: truncate d2/d3/ff 262094 0 2024-04-13T10:58:43.106 INFO:tasks.workunit.client.1.smithi194.stdout:7/648: dwrite d1/fe [0,4194304] 0 2024-04-13T10:58:43.107 INFO:tasks.workunit.client.1.smithi194.stdout:3/600: readlink d2/d3/d12/d31/l46 0 2024-04-13T10:58:43.109 INFO:tasks.workunit.client.1.smithi194.stdout:0/548: read d9/db1/d28/f2e [1164658,129346] 0 2024-04-13T10:58:43.111 INFO:tasks.workunit.client.1.smithi194.stdout:5/589: mkdir d3/dc/d10/db5 0 2024-04-13T10:58:43.111 INFO:tasks.workunit.client.1.smithi194.stdout:2/582: read d2/d3/de/d33/d47/dbb/f93 [894158,97597] 0 2024-04-13T10:58:43.111 INFO:tasks.workunit.client.1.smithi194.stdout:5/590: stat d3/f9 0 2024-04-13T10:58:43.112 INFO:tasks.workunit.client.1.smithi194.stdout:5/591: chown d3/dc/d2d/f36 2 1 2024-04-13T10:58:43.115 INFO:tasks.workunit.client.1.smithi194.stdout:0/549: mkdir d9/d2b/d6c/db2 0 2024-04-13T10:58:43.117 INFO:tasks.workunit.client.1.smithi194.stdout:7/649: unlink d1/c1e 0 2024-04-13T10:58:43.118 INFO:tasks.workunit.client.1.smithi194.stdout:2/583: readlink d2/d3/de/l11 0 2024-04-13T10:58:43.119 INFO:tasks.workunit.client.1.smithi194.stdout:5/592: unlink l1 0 2024-04-13T10:58:43.119 INFO:tasks.workunit.client.1.smithi194.stdout:2/584: write d2/d3/de/f16 [2343543,64754] 0 2024-04-13T10:58:43.120 INFO:tasks.workunit.client.1.smithi194.stdout:5/593: dread - d3/dc/d2d/f9f zero size 2024-04-13T10:58:43.121 INFO:tasks.workunit.client.1.smithi194.stdout:1/576: link d12/d13/d1c/l4b d12/d13/d1c/d28/d41/d50/d96/lc1 0 2024-04-13T10:58:43.123 INFO:tasks.workunit.client.1.smithi194.stdout:2/585: symlink d2/d3/lc3 0 2024-04-13T10:58:43.125 INFO:tasks.workunit.client.1.smithi194.stdout:5/594: stat d3/dc/d10/d20/l32 0 2024-04-13T10:58:43.125 INFO:tasks.workunit.client.1.smithi194.stdout:0/550: dread d9/df/f14 [0,4194304] 0 2024-04-13T10:58:43.126 INFO:tasks.workunit.client.1.smithi194.stdout:1/577: chown d12/d13/d1c/d27/d2e/cbf 42 1 2024-04-13T10:58:43.127 INFO:tasks.workunit.client.1.smithi194.stdout:5/595: rmdir d3/dc/d10/d38/d59 39 2024-04-13T10:58:43.128 INFO:tasks.workunit.client.1.smithi194.stdout:2/586: read d2/d3/de/d17/d36/d8f/f2f [1435882,52396] 0 2024-04-13T10:58:43.128 INFO:tasks.workunit.client.1.smithi194.stdout:0/551: symlink d9/db/d6b/lb3 0 2024-04-13T10:58:43.129 INFO:tasks.workunit.client.1.smithi194.stdout:4/621: write d2/d16/d1a/f6f [1951206,12268] 0 2024-04-13T10:58:43.130 INFO:tasks.workunit.client.1.smithi194.stdout:1/578: unlink d12/d13/d44/fa6 0 2024-04-13T10:58:43.135 INFO:tasks.workunit.client.1.smithi194.stdout:8/724: truncate d6/dd/d45/f6a 3452713 0 2024-04-13T10:58:43.136 INFO:tasks.workunit.client.1.smithi194.stdout:2/587: mknod d2/d3/de/cc4 0 2024-04-13T10:58:43.137 INFO:tasks.workunit.client.1.smithi194.stdout:1/579: dread d12/d13/d44/f89 [0,4194304] 0 2024-04-13T10:58:43.137 INFO:tasks.workunit.client.1.smithi194.stdout:6/548: truncate d0/f1f 844335 0 2024-04-13T10:58:43.137 INFO:tasks.workunit.client.1.smithi194.stdout:3/601: dread d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/fae [0,4194304] 0 2024-04-13T10:58:43.138 INFO:tasks.workunit.client.1.smithi194.stdout:4/622: rename d2/d16/d70/d31/c69 to d2/d16/d1a/d1c/d54/d62/d9e/ccf 0 2024-04-13T10:58:43.140 INFO:tasks.workunit.client.1.smithi194.stdout:8/725: dread d6/d22/d23/d25/d39/d41/f73 [0,4194304] 0 2024-04-13T10:58:43.141 INFO:tasks.workunit.client.1.smithi194.stdout:2/588: write d2/d37/f5f [703690,112472] 0 2024-04-13T10:58:43.143 INFO:tasks.workunit.client.1.smithi194.stdout:8/726: readlink d6/d22/d23/d25/d71/da0/de5/deb/dac/ld7 0 2024-04-13T10:58:43.144 INFO:tasks.workunit.client.1.smithi194.stdout:5/596: dread d3/f9 [0,4194304] 0 2024-04-13T10:58:43.145 INFO:tasks.workunit.client.1.smithi194.stdout:8/727: readlink d6/d22/d23/d25/d39/d41/d5b/d76/l86 0 2024-04-13T10:58:43.145 INFO:tasks.workunit.client.1.smithi194.stdout:6/549: creat d0/d53/d78/faf x:0 0 0 2024-04-13T10:58:43.147 INFO:tasks.workunit.client.1.smithi194.stdout:0/552: creat d9/d2b/fb4 x:0 0 0 2024-04-13T10:58:43.148 INFO:tasks.workunit.client.1.smithi194.stdout:4/623: mkdir d2/d16/d1a/d1c/d54/d62/d6e/d99/dd0 0 2024-04-13T10:58:43.150 INFO:tasks.workunit.client.1.smithi194.stdout:2/589: dread - d2/d3/de/d17/d1e/d42/f8c zero size 2024-04-13T10:58:43.150 INFO:tasks.workunit.client.1.smithi194.stdout:5/597: creat d3/dc/d10/fb6 x:0 0 0 2024-04-13T10:58:43.151 INFO:tasks.workunit.client.1.smithi194.stdout:2/590: write d2/d37/f5f [238079,60274] 0 2024-04-13T10:58:43.152 INFO:tasks.workunit.client.1.smithi194.stdout:1/580: rmdir d12 39 2024-04-13T10:58:43.152 INFO:tasks.workunit.client.1.smithi194.stdout:6/550: creat d0/d57/fb0 x:0 0 0 2024-04-13T10:58:43.154 INFO:tasks.workunit.client.1.smithi194.stdout:0/553: creat d9/db1/d30/d73/d87/fb5 x:0 0 0 2024-04-13T10:58:43.154 INFO:tasks.workunit.client.1.smithi194.stdout:3/602: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/fc5 x:0 0 0 2024-04-13T10:58:43.159 INFO:tasks.workunit.client.1.smithi194.stdout:8/728: mkdir d6/d22/d23/d25/df6 0 2024-04-13T10:58:43.160 INFO:tasks.workunit.client.1.smithi194.stdout:0/554: dwrite d9/db/f3d [0,4194304] 0 2024-04-13T10:58:43.166 INFO:tasks.workunit.client.1.smithi194.stdout:3/603: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6 0 2024-04-13T10:58:43.169 INFO:tasks.workunit.client.1.smithi194.stdout:8/729: creat d6/d22/d23/d25/d71/ff7 x:0 0 0 2024-04-13T10:58:43.170 INFO:tasks.workunit.client.1.smithi194.stdout:0/555: rename d9/df/d16/d70/c7e to d9/db/d3a/cb6 0 2024-04-13T10:58:43.173 INFO:tasks.workunit.client.1.smithi194.stdout:5/598: creat d3/fb7 x:0 0 0 2024-04-13T10:58:43.173 INFO:tasks.workunit.client.1.smithi194.stdout:2/591: creat d2/d3/de/d17/d1e/d42/fc5 x:0 0 0 2024-04-13T10:58:43.175 INFO:tasks.workunit.client.1.smithi194.stdout:6/551: creat d0/d2f/fb1 x:0 0 0 2024-04-13T10:58:43.177 INFO:tasks.workunit.client.1.smithi194.stdout:4/624: getdents d2/d16/d70/d31 0 2024-04-13T10:58:43.177 INFO:tasks.workunit.client.1.smithi194.stdout:8/730: mkdir d6/dd/d45/de3/de9/df8 0 2024-04-13T10:58:43.178 INFO:tasks.workunit.client.1.smithi194.stdout:1/581: dwrite d12/d13/d1c/f31 [0,4194304] 0 2024-04-13T10:58:43.179 INFO:tasks.workunit.client.1.smithi194.stdout:2/592: dread d2/d37/f5f [0,4194304] 0 2024-04-13T10:58:43.179 INFO:tasks.workunit.client.1.smithi194.stdout:0/556: creat d9/d2b/d6c/db2/fb7 x:0 0 0 2024-04-13T10:58:43.181 INFO:tasks.workunit.client.1.smithi194.stdout:8/731: write d6/d22/d23/d3d/f65 [1907463,43755] 0 2024-04-13T10:58:43.181 INFO:tasks.workunit.client.1.smithi194.stdout:5/599: symlink d3/dc/d17/d1b/d6b/d99/lb8 0 2024-04-13T10:58:43.182 INFO:tasks.workunit.client.1.smithi194.stdout:0/557: chown d9/df/d16 2924 1 2024-04-13T10:58:43.182 INFO:tasks.workunit.client.1.smithi194.stdout:4/625: creat d2/d16/d1a/d1c/d3e/fd1 x:0 0 0 2024-04-13T10:58:43.183 INFO:tasks.workunit.client.1.smithi194.stdout:0/558: chown d9/db/d3a 50 1 2024-04-13T10:58:43.188 INFO:tasks.workunit.client.1.smithi194.stdout:0/559: creat d9/db/d3a/fb8 x:0 0 0 2024-04-13T10:58:43.189 INFO:tasks.workunit.client.1.smithi194.stdout:0/560: chown d9/db/d3a/f57 2008392 1 2024-04-13T10:58:43.190 INFO:tasks.workunit.client.1.smithi194.stdout:5/600: mknod d3/dc/d10/d38/d59/cb9 0 2024-04-13T10:58:43.191 INFO:tasks.workunit.client.1.smithi194.stdout:5/601: chown d3/dc/f18 3698107 1 2024-04-13T10:58:43.192 INFO:tasks.workunit.client.1.smithi194.stdout:2/593: link d2/d3/de/d33/d47/dbb/f5e d2/d3/de/d17/d1e/d42/fc6 0 2024-04-13T10:58:43.193 INFO:tasks.workunit.client.1.smithi194.stdout:4/626: getdents d2/d16/d1a/d1c 0 2024-04-13T10:58:43.193 INFO:tasks.workunit.client.1.smithi194.stdout:0/561: mkdir d9/df/d16/d65/db9 0 2024-04-13T10:58:43.194 INFO:tasks.workunit.client.1.smithi194.stdout:5/602: mknod d3/dc/d17/d93/cba 0 2024-04-13T10:58:43.195 INFO:tasks.workunit.client.1.smithi194.stdout:8/732: rmdir d6/dd/d45 39 2024-04-13T10:58:43.196 INFO:tasks.workunit.client.1.smithi194.stdout:0/562: truncate d9/d2b/f8b 5418222 0 2024-04-13T10:58:43.196 INFO:tasks.workunit.client.1.smithi194.stdout:2/594: creat d2/d3/de/d17/d1e/fc7 x:0 0 0 2024-04-13T10:58:43.198 INFO:tasks.workunit.client.1.smithi194.stdout:8/733: fdatasync d6/d22/d23/d25/d39/d41/fbf 0 2024-04-13T10:58:43.198 INFO:tasks.workunit.client.1.smithi194.stdout:2/595: write d2/d3/fc0 [231680,113576] 0 2024-04-13T10:58:43.199 INFO:tasks.workunit.client.1.smithi194.stdout:5/603: unlink d3/dc/d10/d38/d59/cb9 0 2024-04-13T10:58:43.200 INFO:tasks.workunit.client.1.smithi194.stdout:8/734: read d6/d2a/f57 [2769798,30951] 0 2024-04-13T10:58:43.235 INFO:tasks.workunit.client.1.smithi194.stdout:9/563: sync 2024-04-13T10:58:43.235 INFO:tasks.workunit.client.1.smithi194.stdout:0/563: creat d9/db1/d30/d73/fba x:0 0 0 2024-04-13T10:58:43.235 INFO:tasks.workunit.client.1.smithi194.stdout:2/596: symlink d2/d3/de/d17/lc8 0 2024-04-13T10:58:43.235 INFO:tasks.workunit.client.1.smithi194.stdout:6/552: dread d0/d26/d2b/f3c [0,4194304] 0 2024-04-13T10:58:43.235 INFO:tasks.workunit.client.1.smithi194.stdout:4/627: dread d2/d16/d1a/d1c/d54/f5f [4194304,4194304] 0 2024-04-13T10:58:43.235 INFO:tasks.workunit.client.1.smithi194.stdout:5/604: creat d3/d83/fbb x:0 0 0 2024-04-13T10:58:43.237 INFO:tasks.workunit.client.1.smithi194.stdout:4/628: chown d2/d16/d70 1 1 2024-04-13T10:58:43.237 INFO:tasks.workunit.client.1.smithi194.stdout:6/553: fsync d0/d42/f7d 0 2024-04-13T10:58:43.240 INFO:tasks.workunit.client.1.smithi194.stdout:9/564: creat d0/d11/d3d/fbf x:0 0 0 2024-04-13T10:58:43.240 INFO:tasks.workunit.client.1.smithi194.stdout:6/554: read - d0/d2f/d48/f87 zero size 2024-04-13T10:58:43.241 INFO:tasks.workunit.client.1.smithi194.stdout:2/597: mkdir d2/d3/de/d17/d36/dc9 0 2024-04-13T10:58:43.242 INFO:tasks.workunit.client.1.smithi194.stdout:4/629: mkdir d2/d16/dd2 0 2024-04-13T10:58:43.246 INFO:tasks.workunit.client.1.smithi194.stdout:6/555: write d0/d2c/f41 [2510521,105500] 0 2024-04-13T10:58:43.247 INFO:tasks.workunit.client.1.smithi194.stdout:4/630: chown d2/d30/f49 2461 1 2024-04-13T10:58:43.248 INFO:tasks.workunit.client.1.smithi194.stdout:8/735: dwrite d6/d2a/d69/dc4/fd1 [0,4194304] 0 2024-04-13T10:58:43.254 INFO:tasks.workunit.client.1.smithi194.stdout:0/564: dwrite d9/df/d16/d70/f9d [0,4194304] 0 2024-04-13T10:58:43.254 INFO:tasks.workunit.client.1.smithi194.stdout:8/736: fdatasync d6/d2a/d69/da2/fd9 0 2024-04-13T10:58:43.254 INFO:tasks.workunit.client.1.smithi194.stdout:5/605: dwrite d3/dc/d10/f2e [0,4194304] 0 2024-04-13T10:58:43.257 INFO:tasks.workunit.client.1.smithi194.stdout:5/606: fsync d3/dc/faf 0 2024-04-13T10:58:43.259 INFO:tasks.workunit.client.1.smithi194.stdout:9/565: getdents d0/d6/d4a/d74/dae 0 2024-04-13T10:58:43.264 INFO:tasks.workunit.client.1.smithi194.stdout:5/607: dread - d3/dc/d10/f3b zero size 2024-04-13T10:58:43.264 INFO:tasks.workunit.client.1.smithi194.stdout:4/631: dread d2/d16/d70/f8b [0,4194304] 0 2024-04-13T10:58:43.268 INFO:tasks.workunit.client.1.smithi194.stdout:2/598: dwrite d2/d3/ff [0,4194304] 0 2024-04-13T10:58:43.268 INFO:tasks.workunit.client.1.smithi194.stdout:9/566: getdents d0/d6/d4a/d74/dae 0 2024-04-13T10:58:43.272 INFO:tasks.workunit.client.1.smithi194.stdout:5/608: mknod d3/dc/d17/d93/cbc 0 2024-04-13T10:58:43.272 INFO:tasks.workunit.client.1.smithi194.stdout:8/737: dwrite f2 [0,4194304] 0 2024-04-13T10:58:43.276 INFO:tasks.workunit.client.1.smithi194.stdout:4/632: unlink d2/d16/d1a/d1c/d3b/d8d/fae 0 2024-04-13T10:58:43.277 INFO:tasks.workunit.client.1.smithi194.stdout:9/567: unlink d0/d6/d4a/d74/f93 0 2024-04-13T10:58:43.278 INFO:tasks.workunit.client.1.smithi194.stdout:9/568: chown d0/d6/d2c 3188 1 2024-04-13T10:58:43.280 INFO:tasks.workunit.client.1.smithi194.stdout:8/738: fdatasync d6/d2a/d69/dc4/fd1 0 2024-04-13T10:58:43.281 INFO:tasks.workunit.client.1.smithi194.stdout:5/609: fsync d3/dc/d17/f74 0 2024-04-13T10:58:43.284 INFO:tasks.workunit.client.1.smithi194.stdout:6/556: dread d0/d2c/f41 [0,4194304] 0 2024-04-13T10:58:43.284 INFO:tasks.workunit.client.1.smithi194.stdout:2/599: dread d2/d3/f4a [0,4194304] 0 2024-04-13T10:58:43.285 INFO:tasks.workunit.client.1.smithi194.stdout:9/569: symlink d0/d6/d2c/d68/lc0 0 2024-04-13T10:58:43.286 INFO:tasks.workunit.client.1.smithi194.stdout:6/557: truncate d0/d2c/d77/f8c 811644 0 2024-04-13T10:58:43.286 INFO:tasks.workunit.client.1.smithi194.stdout:8/739: symlink d6/d22/d23/d25/d39/d41/d5b/d76/dc5/lf9 0 2024-04-13T10:58:43.287 INFO:tasks.workunit.client.1.smithi194.stdout:6/558: fsync d0/d57/d69/f8a 0 2024-04-13T10:58:43.287 INFO:tasks.workunit.client.1.smithi194.stdout:5/610: rename d3/dc/d2d/f9f to d3/dc/d10/fbd 0 2024-04-13T10:58:43.289 INFO:tasks.workunit.client.1.smithi194.stdout:9/570: fsync d0/d11/d58/f5f 0 2024-04-13T10:58:43.291 INFO:tasks.workunit.client.1.smithi194.stdout:2/600: link d2/d3/f2d d2/d3/de/d33/d47/dbb/fca 0 2024-04-13T10:58:43.292 INFO:tasks.workunit.client.1.smithi194.stdout:6/559: creat d0/d2f/d48/d83/fb2 x:0 0 0 2024-04-13T10:58:43.295 INFO:tasks.workunit.client.1.smithi194.stdout:5/611: getdents d3/dc/d10/d20 0 2024-04-13T10:58:43.296 INFO:tasks.workunit.client.1.smithi194.stdout:6/560: write d0/d26/f14 [4670651,82969] 0 2024-04-13T10:58:43.296 INFO:tasks.workunit.client.1.smithi194.stdout:8/740: dwrite d6/d22/d23/d25/d39/d41/fbf [0,4194304] 0 2024-04-13T10:58:43.297 INFO:tasks.workunit.client.1.smithi194.stdout:2/601: getdents d2/d3/de/d17/d1e/d42/d86 0 2024-04-13T10:58:43.301 INFO:tasks.workunit.client.1.smithi194.stdout:5/612: creat d3/dc/d17/d1b/d6b/d99/fbe x:0 0 0 2024-04-13T10:58:43.302 INFO:tasks.workunit.client.1.smithi194.stdout:2/602: unlink d2/d3/de/d17/l3b 0 2024-04-13T10:58:43.303 INFO:tasks.workunit.client.1.smithi194.stdout:9/571: dwrite d0/d6/d2c/f69 [4194304,4194304] 0 2024-04-13T10:58:43.303 INFO:tasks.workunit.client.1.smithi194.stdout:7/650: sync 2024-04-13T10:58:43.303 INFO:tasks.workunit.client.1.smithi194.stdout:8/741: symlink d6/d22/d23/lfa 0 2024-04-13T10:58:43.305 INFO:tasks.workunit.client.1.smithi194.stdout:4/633: write d2/d16/d70/d31/f3a [4926155,86071] 0 2024-04-13T10:58:43.309 INFO:tasks.workunit.client.1.smithi194.stdout:5/613: truncate d3/dc/d17/d1b/d6b/fac 300208 0 2024-04-13T10:58:43.309 INFO:tasks.workunit.client.1.smithi194.stdout:9/572: rename d0/d11/la9 to d0/d6/d14/d26/d42/lc1 0 2024-04-13T10:58:43.311 INFO:tasks.workunit.client.1.smithi194.stdout:8/742: chown d6/d22/d23/d25/d39/d41/f4e 1 1 2024-04-13T10:58:43.312 INFO:tasks.workunit.client.1.smithi194.stdout:2/603: truncate d2/d3/de/d17/d1e/d42/fa1 553513 0 2024-04-13T10:58:43.313 INFO:tasks.workunit.client.1.smithi194.stdout:7/651: creat d1/d2b/d4c/d4f/d51/d4d/d5e/fd6 x:0 0 0 2024-04-13T10:58:43.313 INFO:tasks.workunit.client.1.smithi194.stdout:9/573: write d0/d11/d1e/fa1 [174282,83925] 0 2024-04-13T10:58:43.318 INFO:tasks.workunit.client.1.smithi194.stdout:2/604: write d2/d37/f5f [198224,65916] 0 2024-04-13T10:58:43.321 INFO:tasks.workunit.client.1.smithi194.stdout:9/574: creat d0/d11/d3d/fc2 x:0 0 0 2024-04-13T10:58:43.321 INFO:tasks.workunit.client.1.smithi194.stdout:7/652: read d1/d2b/d4c/d4f/d6e/f87 [190508,61703] 0 2024-04-13T10:58:43.322 INFO:tasks.workunit.client.1.smithi194.stdout:4/634: dwrite d2/d30/f49 [0,4194304] 0 2024-04-13T10:58:43.323 INFO:tasks.workunit.client.1.smithi194.stdout:2/605: chown d2/ca7 12773 1 2024-04-13T10:58:43.325 INFO:tasks.workunit.client.1.smithi194.stdout:5/614: dwrite d3/dc/d10/d38/f5b [0,4194304] 0 2024-04-13T10:58:43.326 INFO:tasks.workunit.client.1.smithi194.stdout:9/575: rmdir d0/d6/d4a/d74 39 2024-04-13T10:58:43.326 INFO:tasks.workunit.client.1.smithi194.stdout:5/615: stat d3/d29/c69 0 2024-04-13T10:58:43.328 INFO:tasks.workunit.client.1.smithi194.stdout:7/653: mkdir d1/d2b/d3e/d54/dd7 0 2024-04-13T10:58:43.329 INFO:tasks.workunit.client.1.smithi194.stdout:2/606: mknod d2/d3/d6d/ccb 0 2024-04-13T10:58:43.331 INFO:tasks.workunit.client.1.smithi194.stdout:4/635: creat d2/d16/d1a/d1c/d3b/d8d/fd3 x:0 0 0 2024-04-13T10:58:43.333 INFO:tasks.workunit.client.1.smithi194.stdout:7/654: write d1/d2b/d2c/d30/d33/d39/f66 [3719327,64824] 0 2024-04-13T10:58:43.333 INFO:tasks.workunit.client.1.smithi194.stdout:8/743: truncate d6/d22/d23/d25/fa8 3719486 0 2024-04-13T10:58:43.334 INFO:tasks.workunit.client.1.smithi194.stdout:5/616: dwrite d3/dc/d10/f61 [0,4194304] 0 2024-04-13T10:58:43.339 INFO:tasks.workunit.client.1.smithi194.stdout:7/655: write d1/d2b/d4c/d4f/fbe [609699,99643] 0 2024-04-13T10:58:43.340 INFO:tasks.workunit.client.1.smithi194.stdout:5/617: mkdir d3/dc/d10/d38/d59/d49/dbf 0 2024-04-13T10:58:43.341 INFO:tasks.workunit.client.1.smithi194.stdout:9/576: creat d0/d6/fc3 x:0 0 0 2024-04-13T10:58:43.344 INFO:tasks.workunit.client.1.smithi194.stdout:2/607: getdents d2/d3/de 0 2024-04-13T10:58:43.344 INFO:tasks.workunit.client.1.smithi194.stdout:5/618: symlink d3/d89/lc0 0 2024-04-13T10:58:43.346 INFO:tasks.workunit.client.1.smithi194.stdout:7/656: write d1/d2b/d3e/d54/d5a/d3c/f65 [491211,66850] 0 2024-04-13T10:58:43.347 INFO:tasks.workunit.client.1.smithi194.stdout:2/608: chown d2/d3/de/d33/d47 73845 1 2024-04-13T10:58:43.348 INFO:tasks.workunit.client.1.smithi194.stdout:9/577: mknod d0/d6/d4a/d74/dae/cc4 0 2024-04-13T10:58:43.348 INFO:tasks.workunit.client.1.smithi194.stdout:8/744: dwrite f5 [4194304,4194304] 0 2024-04-13T10:58:43.350 INFO:tasks.workunit.client.1.smithi194.stdout:2/609: dread - d2/d3/de/d17/d36/f9d zero size 2024-04-13T10:58:43.351 INFO:tasks.workunit.client.1.smithi194.stdout:4/636: dread d2/d16/d1a/f35 [0,4194304] 0 2024-04-13T10:58:43.355 INFO:tasks.workunit.client.1.smithi194.stdout:8/745: mkdir d6/d2a/dce/dfb 0 2024-04-13T10:58:43.355 INFO:tasks.workunit.client.1.smithi194.stdout:9/578: creat d0/d11/d58/fc5 x:0 0 0 2024-04-13T10:58:43.356 INFO:tasks.workunit.client.1.smithi194.stdout:7/657: dread d1/d2b/d2c/d30/d33/d39/f62 [0,4194304] 0 2024-04-13T10:58:43.359 INFO:tasks.workunit.client.1.smithi194.stdout:9/579: write d0/d6/d14/d26/f34 [6942,71766] 0 2024-04-13T10:58:43.359 INFO:tasks.workunit.client.1.smithi194.stdout:4/637: truncate d2/d16/d1a/d1c/d54/fb1 4366678 0 2024-04-13T10:58:43.362 INFO:tasks.workunit.client.1.smithi194.stdout:2/610: dwrite d2/d37/f5f [0,4194304] 0 2024-04-13T10:58:43.362 INFO:tasks.workunit.client.1.smithi194.stdout:4/638: fdatasync d2/d16/d70/d31/d44/fcd 0 2024-04-13T10:58:43.363 INFO:tasks.workunit.client.1.smithi194.stdout:2/611: write d2/d3/d12/f22 [3090065,26902] 0 2024-04-13T10:58:43.363 INFO:tasks.workunit.client.1.smithi194.stdout:9/580: creat d0/d6/d9/d70/fc6 x:0 0 0 2024-04-13T10:58:43.402 INFO:tasks.workunit.client.1.smithi194.stdout:3/604: sync 2024-04-13T10:58:43.402 INFO:tasks.workunit.client.1.smithi194.stdout:1/582: sync 2024-04-13T10:58:43.402 INFO:tasks.workunit.client.1.smithi194.stdout:0/565: sync 2024-04-13T10:58:43.419 INFO:tasks.workunit.client.1.smithi194.stdout:4/639: creat d2/d33/fd4 x:0 0 0 2024-04-13T10:58:43.421 INFO:tasks.workunit.client.1.smithi194.stdout:1/583: chown d12/d13/d1c/d28/d41/d77/d93/cae 45110 1 2024-04-13T10:58:43.422 INFO:tasks.workunit.client.1.smithi194.stdout:2/612: mkdir d2/d3/de/d17/d39/dcc 0 2024-04-13T10:58:43.423 INFO:tasks.workunit.client.1.smithi194.stdout:3/605: truncate d2/d3/d12/d31/d34/d88/d24/f7c 693829 0 2024-04-13T10:58:43.423 INFO:tasks.workunit.client.1.smithi194.stdout:9/581: symlink d0/d11/lc7 0 2024-04-13T10:58:43.425 INFO:tasks.workunit.client.1.smithi194.stdout:1/584: creat d12/d3a/fc2 x:0 0 0 2024-04-13T10:58:43.426 INFO:tasks.workunit.client.1.smithi194.stdout:9/582: chown d0/d11/d44 1 1 2024-04-13T10:58:43.426 INFO:tasks.workunit.client.1.smithi194.stdout:0/566: creat d9/df/fbb x:0 0 0 2024-04-13T10:58:43.427 INFO:tasks.workunit.client.1.smithi194.stdout:2/613: mkdir d2/d3/de/d17/d36/d8f/dcd 0 2024-04-13T10:58:43.427 INFO:tasks.workunit.client.1.smithi194.stdout:9/583: fsync d0/d88/fb9 0 2024-04-13T10:58:43.428 INFO:tasks.workunit.client.1.smithi194.stdout:5/619: dread d3/dc/d2d/f36 [0,4194304] 0 2024-04-13T10:58:43.429 INFO:tasks.workunit.client.1.smithi194.stdout:1/585: chown d12/d13/d1c/d27/d4c/d7f/d8b/dbb 123 1 2024-04-13T10:58:43.430 INFO:tasks.workunit.client.1.smithi194.stdout:0/567: creat d9/d2b/d6c/db2/fbc x:0 0 0 2024-04-13T10:58:43.430 INFO:tasks.workunit.client.1.smithi194.stdout:7/658: dread d1/f8 [0,4194304] 0 2024-04-13T10:58:43.431 INFO:tasks.workunit.client.1.smithi194.stdout:3/606: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5/cc7 0 2024-04-13T10:58:43.432 INFO:tasks.workunit.client.1.smithi194.stdout:5/620: symlink d3/dc/d10/d20/daa/lc1 0 2024-04-13T10:58:43.434 INFO:tasks.workunit.client.1.smithi194.stdout:0/568: write d9/db1/d30/fab [607981,24558] 0 2024-04-13T10:58:43.437 INFO:tasks.workunit.client.1.smithi194.stdout:3/607: truncate d2/d3/d12/d31/f84 27140 0 2024-04-13T10:58:43.438 INFO:tasks.workunit.client.1.smithi194.stdout:7/659: dread d1/d2b/d4c/d4f/fbe [0,4194304] 0 2024-04-13T10:58:43.439 INFO:tasks.workunit.client.1.smithi194.stdout:1/586: rename d12/d13/d3e/f34 to d12/d13/d1c/d27/d2e/fc3 0 2024-04-13T10:58:43.442 INFO:tasks.workunit.client.1.smithi194.stdout:4/640: dread d2/d16/d1a/d1c/d3e/dbb/fbc [0,4194304] 0 2024-04-13T10:58:43.442 INFO:tasks.workunit.client.1.smithi194.stdout:7/660: write d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/fa6 [1040618,96645] 0 2024-04-13T10:58:43.442 INFO:tasks.workunit.client.1.smithi194.stdout:5/621: truncate d3/dc/f2c 2366026 0 2024-04-13T10:58:43.444 INFO:tasks.workunit.client.1.smithi194.stdout:5/622: fdatasync d3/d89/f97 0 2024-04-13T10:58:43.446 INFO:tasks.workunit.client.1.smithi194.stdout:1/587: chown d12/d13/d1c/d28/d41/d4e/c7a 180 1 2024-04-13T10:58:43.448 INFO:tasks.workunit.client.1.smithi194.stdout:2/614: dread d2/d3/de/f32 [0,4194304] 0 2024-04-13T10:58:43.449 INFO:tasks.workunit.client.1.smithi194.stdout:4/641: write d2/d16/d70/f26 [3499572,9876] 0 2024-04-13T10:58:43.450 INFO:tasks.workunit.client.1.smithi194.stdout:1/588: readlink d12/d13/d1c/l4b 0 2024-04-13T10:58:43.453 INFO:tasks.workunit.client.1.smithi194.stdout:3/608: link d2/d3/d12/d31/d34/d88/d24/d3a/d56/ca0 d2/d3/d12/d31/cc8 0 2024-04-13T10:58:43.453 INFO:tasks.workunit.client.1.smithi194.stdout:5/623: symlink d3/dc/d10/db5/lc2 0 2024-04-13T10:58:43.455 INFO:tasks.workunit.client.1.smithi194.stdout:9/584: dwrite d0/f3 [0,4194304] 0 2024-04-13T10:58:43.455 INFO:tasks.workunit.client.1.smithi194.stdout:1/589: readlink d12/d13/d1c/d27/d4c/l79 0 2024-04-13T10:58:43.459 INFO:tasks.workunit.client.1.smithi194.stdout:1/590: fdatasync d12/d3a/d4f/f63 0 2024-04-13T10:58:43.459 INFO:tasks.workunit.client.1.smithi194.stdout:7/661: dread d1/f8 [4194304,4194304] 0 2024-04-13T10:58:43.459 INFO:tasks.workunit.client.1.smithi194.stdout:0/569: dwrite d9/db1/f90 [0,4194304] 0 2024-04-13T10:58:43.463 INFO:tasks.workunit.client.1.smithi194.stdout:4/642: rename d2/d16/d1a/f8c to d2/d16/d1a/d1c/d54/d5d/db2/fd5 0 2024-04-13T10:58:43.465 INFO:tasks.workunit.client.1.smithi194.stdout:0/570: write d9/db1/d28/f6e [2122649,109735] 0 2024-04-13T10:58:43.465 INFO:tasks.workunit.client.1.smithi194.stdout:7/662: write d1/d2b/d2c/d30/d33/d39/f3d [355892,25809] 0 2024-04-13T10:58:43.465 INFO:tasks.workunit.client.1.smithi194.stdout:1/591: fdatasync d12/d13/d1c/d28/f9f 0 2024-04-13T10:58:43.469 INFO:tasks.workunit.client.1.smithi194.stdout:5/624: rename d3/dc/d17/d93/la5 to d3/dc/d10/d38/d59/d49/lc3 0 2024-04-13T10:58:43.473 INFO:tasks.workunit.client.1.smithi194.stdout:6/561: sync 2024-04-13T10:58:43.474 INFO:tasks.workunit.client.1.smithi194.stdout:1/592: dwrite d12/d13/d1c/d28/f58 [4194304,4194304] 0 2024-04-13T10:58:43.475 INFO:tasks.workunit.client.1.smithi194.stdout:9/585: link d0/d11/d58/c9d d0/d11/d1e/cc8 0 2024-04-13T10:58:43.476 INFO:tasks.workunit.client.1.smithi194.stdout:5/625: creat d3/d89/fc4 x:0 0 0 2024-04-13T10:58:43.477 INFO:tasks.workunit.client.1.smithi194.stdout:5/626: write d3/d89/fa3 [557690,7232] 0 2024-04-13T10:58:43.479 INFO:tasks.workunit.client.1.smithi194.stdout:0/571: unlink d9/df/d16/f5d 0 2024-04-13T10:58:43.480 INFO:tasks.workunit.client.1.smithi194.stdout:6/562: mknod d0/d26/d2b/cb3 0 2024-04-13T10:58:43.481 INFO:tasks.workunit.client.1.smithi194.stdout:3/609: link d2/d3/d12/d31/d34/d88/d24/d82/caf d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95/cc9 0 2024-04-13T10:58:43.483 INFO:tasks.workunit.client.1.smithi194.stdout:5/627: chown d3/dc/d10/c94 507142 1 2024-04-13T10:58:43.484 INFO:tasks.workunit.client.1.smithi194.stdout:2/615: truncate d2/d3/de/d33/d47/dbb/f99 2935547 0 2024-04-13T10:58:43.484 INFO:tasks.workunit.client.1.smithi194.stdout:5/628: fdatasync d3/dc/d10/d38/d59/f8b 0 2024-04-13T10:58:43.488 INFO:tasks.workunit.client.1.smithi194.stdout:9/586: symlink d0/d11/d44/lc9 0 2024-04-13T10:58:43.489 INFO:tasks.workunit.client.1.smithi194.stdout:9/587: chown d0/d6/d14/d26/d42/c8e 6175 1 2024-04-13T10:58:43.489 INFO:tasks.workunit.client.1.smithi194.stdout:3/610: unlink d2/d3/d12/d21/c81 0 2024-04-13T10:58:43.489 INFO:tasks.workunit.client.1.smithi194.stdout:4/643: write d2/d16/d1a/d1c/d3e/d48/d7f/fb0 [3726548,15279] 0 2024-04-13T10:58:43.490 INFO:tasks.workunit.client.1.smithi194.stdout:9/588: chown d0/d6/d14/d26/f3e 7677 1 2024-04-13T10:58:43.490 INFO:tasks.workunit.client.1.smithi194.stdout:7/663: write d1/d2b/d3e/d54/d5a/d3c/f40 [2388201,24991] 0 2024-04-13T10:58:43.492 INFO:tasks.workunit.client.1.smithi194.stdout:1/593: creat d12/d13/d1c/d28/d41/fc4 x:0 0 0 2024-04-13T10:58:43.492 INFO:tasks.workunit.client.1.smithi194.stdout:5/629: rmdir d3/dc/d10/d38/d59/d49 39 2024-04-13T10:58:43.493 INFO:tasks.workunit.client.1.smithi194.stdout:4/644: stat d2/d16/d1a/d1c/d3e/d48/d7f/fb0 0 2024-04-13T10:58:43.493 INFO:tasks.workunit.client.1.smithi194.stdout:5/630: chown d3/f9 246663 1 2024-04-13T10:58:43.493 INFO:tasks.workunit.client.1.smithi194.stdout:2/616: rename d2/d3/de/d33/d47/dbb/l94 to d2/d3/de/lce 0 2024-04-13T10:58:43.495 INFO:tasks.workunit.client.1.smithi194.stdout:5/631: stat d3/dc/d10/d20/daa/dae 0 2024-04-13T10:58:43.498 INFO:tasks.workunit.client.1.smithi194.stdout:8/746: sync 2024-04-13T10:58:43.498 INFO:tasks.workunit.client.1.smithi194.stdout:1/594: mknod d12/d13/d44/cc5 0 2024-04-13T10:58:43.500 INFO:tasks.workunit.client.1.smithi194.stdout:2/617: symlink d2/d3/d12/lcf 0 2024-04-13T10:58:43.501 INFO:tasks.workunit.client.1.smithi194.stdout:0/572: getdents d9/d6f 0 2024-04-13T10:58:43.503 INFO:tasks.workunit.client.1.smithi194.stdout:3/611: dread d2/d3/d12/d31/d34/d88/d24/f4c [0,4194304] 0 2024-04-13T10:58:43.503 INFO:tasks.workunit.client.1.smithi194.stdout:2/618: chown d2/d3/d6d/lb0 781 1 2024-04-13T10:58:43.503 INFO:tasks.workunit.client.1.smithi194.stdout:9/589: mknod d0/d88/dac/cca 0 2024-04-13T10:58:43.505 INFO:tasks.workunit.client.1.smithi194.stdout:9/590: chown d0/d11/c62 7986980 1 2024-04-13T10:58:43.506 INFO:tasks.workunit.client.1.smithi194.stdout:6/563: dwrite d0/d53/f55 [0,4194304] 0 2024-04-13T10:58:43.512 INFO:tasks.workunit.client.1.smithi194.stdout:9/591: chown d0/d11/d3d/f5d 995094 1 2024-04-13T10:58:43.513 INFO:tasks.workunit.client.1.smithi194.stdout:8/747: unlink d6/d22/d23/d25/fa8 0 2024-04-13T10:58:43.513 INFO:tasks.workunit.client.1.smithi194.stdout:4/645: link d2/d30/c45 d2/d16/d70/d31/cd6 0 2024-04-13T10:58:43.513 INFO:tasks.workunit.client.1.smithi194.stdout:2/619: write d2/d3/d12/f1c [903744,2868] 0 2024-04-13T10:58:43.513 INFO:tasks.workunit.client.1.smithi194.stdout:5/632: rename d3/dc/d17/l56 to d3/dc/d10/d38/lc5 0 2024-04-13T10:58:43.514 INFO:tasks.workunit.client.1.smithi194.stdout:6/564: mkdir d0/d42/d7b/db4 0 2024-04-13T10:58:43.515 INFO:tasks.workunit.client.1.smithi194.stdout:0/573: mkdir d9/d2b/dbd 0 2024-04-13T10:58:43.516 INFO:tasks.workunit.client.1.smithi194.stdout:7/664: link d1/d2b/d4c/d7e/dab/d96/ccc d1/d2b/d4c/d4f/d51/cd8 0 2024-04-13T10:58:43.518 INFO:tasks.workunit.client.1.smithi194.stdout:1/595: rename d12/fac to d12/d13/d1c/d28/d41/d4e/fc6 0 2024-04-13T10:58:43.519 INFO:tasks.workunit.client.1.smithi194.stdout:6/565: read d0/d53/f55 [1237613,66643] 0 2024-04-13T10:58:43.519 INFO:tasks.workunit.client.1.smithi194.stdout:7/665: write d1/f41 [3752760,10320] 0 2024-04-13T10:58:43.521 INFO:tasks.workunit.client.1.smithi194.stdout:8/748: creat d6/dd/ffc x:0 0 0 2024-04-13T10:58:43.523 INFO:tasks.workunit.client.1.smithi194.stdout:3/612: link d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/fae d2/d3/d12/d31/d34/d88/d24/fca 0 2024-04-13T10:58:43.526 INFO:tasks.workunit.client.1.smithi194.stdout:6/566: symlink d0/d26/d2b/lb5 0 2024-04-13T10:58:43.529 INFO:tasks.workunit.client.1.smithi194.stdout:8/749: mkdir d6/d2a/d69/da3/dfd 0 2024-04-13T10:58:43.529 INFO:tasks.workunit.client.1.smithi194.stdout:9/592: dwrite d0/d11/d3d/f7e [0,4194304] 0 2024-04-13T10:58:43.532 INFO:tasks.workunit.client.1.smithi194.stdout:6/567: write d0/d57/d69/f8a [39116,109257] 0 2024-04-13T10:58:43.532 INFO:tasks.workunit.client.1.smithi194.stdout:5/633: link d3/dc/d10/c94 d3/d29/cc6 0 2024-04-13T10:58:43.534 INFO:tasks.workunit.client.1.smithi194.stdout:4/646: dwrite d2/d16/d1a/d1c/d3e/fb5 [0,4194304] 0 2024-04-13T10:58:43.536 INFO:tasks.workunit.client.1.smithi194.stdout:1/596: dwrite d12/f35 [0,4194304] 0 2024-04-13T10:58:43.540 INFO:tasks.workunit.client.1.smithi194.stdout:2/620: truncate d2/d3/d12/f1b 4050650 0 2024-04-13T10:58:43.541 INFO:tasks.workunit.client.1.smithi194.stdout:1/597: write d12/d13/d1c/d27/d4c/d7f/d8b/f8c [779855,82806] 0 2024-04-13T10:58:43.542 INFO:tasks.workunit.client.1.smithi194.stdout:9/593: mknod d0/d6/d4a/d74/ccb 0 2024-04-13T10:58:43.543 INFO:tasks.workunit.client.1.smithi194.stdout:3/613: symlink d2/d3/d12/d31/d34/d88/d24/lcb 0 2024-04-13T10:58:43.547 INFO:tasks.workunit.client.1.smithi194.stdout:7/666: getdents d1/d2b/d4c/d7e 0 2024-04-13T10:58:43.552 INFO:tasks.workunit.client.1.smithi194.stdout:8/750: rmdir d6/d22/d23/d25/df6 0 2024-04-13T10:58:43.552 INFO:tasks.workunit.client.1.smithi194.stdout:0/574: dwrite d9/db1/d28/f2e [0,4194304] 0 2024-04-13T10:58:43.552 INFO:tasks.workunit.client.1.smithi194.stdout:3/614: mknod d2/d3/db9/ccc 0 2024-04-13T10:58:43.554 INFO:tasks.workunit.client.1.smithi194.stdout:4/647: dread d2/d16/d1a/d1c/d3e/dbb/fbc [0,4194304] 0 2024-04-13T10:58:43.555 INFO:tasks.workunit.client.1.smithi194.stdout:6/568: link d0/f12 d0/d26/fb6 0 2024-04-13T10:58:43.556 INFO:tasks.workunit.client.1.smithi194.stdout:5/634: creat d3/dc/d10/d38/d59/fc7 x:0 0 0 2024-04-13T10:58:43.557 INFO:tasks.workunit.client.1.smithi194.stdout:1/598: creat d12/d3a/d4f/da3/daa/fc7 x:0 0 0 2024-04-13T10:58:43.557 INFO:tasks.workunit.client.1.smithi194.stdout:2/621: write d2/d3/de/d33/d71/f75 [14809,16248] 0 2024-04-13T10:58:43.557 INFO:tasks.workunit.client.1.smithi194.stdout:7/667: mkdir d1/dd9 0 2024-04-13T10:58:43.558 INFO:tasks.workunit.client.1.smithi194.stdout:8/751: write d6/d22/d23/d25/d39/d41/f67 [219647,6717] 0 2024-04-13T10:58:43.558 INFO:tasks.workunit.client.1.smithi194.stdout:0/575: symlink d9/d2b/dbd/lbe 0 2024-04-13T10:58:43.559 INFO:tasks.workunit.client.1.smithi194.stdout:3/615: readlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/l68 0 2024-04-13T10:58:43.560 INFO:tasks.workunit.client.1.smithi194.stdout:9/594: dwrite d0/d11/d1e/f6c [0,4194304] 0 2024-04-13T10:58:43.560 INFO:tasks.workunit.client.1.smithi194.stdout:5/635: fdatasync d3/d29/fa2 0 2024-04-13T10:58:43.562 INFO:tasks.workunit.client.1.smithi194.stdout:6/569: truncate d0/d26/fb6 4643954 0 2024-04-13T10:58:43.564 INFO:tasks.workunit.client.1.smithi194.stdout:3/616: readlink d2/de/l5d 0 2024-04-13T10:58:43.564 INFO:tasks.workunit.client.1.smithi194.stdout:7/668: truncate d1/f95 1089974 0 2024-04-13T10:58:43.565 INFO:tasks.workunit.client.1.smithi194.stdout:8/752: write d6/d2a/f34 [4670190,100528] 0 2024-04-13T10:58:43.567 INFO:tasks.workunit.client.1.smithi194.stdout:2/622: chown d2/d3/de/d17/d36/d8f/f4c 7840628 1 2024-04-13T10:58:43.567 INFO:tasks.workunit.client.1.smithi194.stdout:1/599: unlink d12/d13/d1c/d27/d2e/f9b 0 2024-04-13T10:58:43.568 INFO:tasks.workunit.client.1.smithi194.stdout:6/570: mkdir d0/d57/db7 0 2024-04-13T10:58:43.569 INFO:tasks.workunit.client.1.smithi194.stdout:8/753: truncate d6/fc9 4601105 0 2024-04-13T10:58:43.571 INFO:tasks.workunit.client.1.smithi194.stdout:4/648: dread d2/d16/d70/f68 [0,4194304] 0 2024-04-13T10:58:43.572 INFO:tasks.workunit.client.1.smithi194.stdout:9/595: creat d0/d6/d9/d9e/fcc x:0 0 0 2024-04-13T10:58:43.572 INFO:tasks.workunit.client.1.smithi194.stdout:1/600: readlink d12/d13/d1c/d27/d4c/lb3 0 2024-04-13T10:58:43.574 INFO:tasks.workunit.client.1.smithi194.stdout:7/669: creat d1/d2b/d4c/d7e/fda x:0 0 0 2024-04-13T10:58:43.574 INFO:tasks.workunit.client.1.smithi194.stdout:2/623: creat d2/d3/de/d33/d47/fd0 x:0 0 0 2024-04-13T10:58:43.576 INFO:tasks.workunit.client.1.smithi194.stdout:6/571: rmdir d0/d2f/d48 39 2024-04-13T10:58:43.577 INFO:tasks.workunit.client.1.smithi194.stdout:5/636: dwrite d3/dc/d10/d38/d59/f8b [0,4194304] 0 2024-04-13T10:58:43.579 INFO:tasks.workunit.client.1.smithi194.stdout:3/617: unlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/fbf 0 2024-04-13T10:58:43.579 INFO:tasks.workunit.client.1.smithi194.stdout:9/596: read d0/d11/d79/f84 [2917313,38125] 0 2024-04-13T10:58:43.580 INFO:tasks.workunit.client.1.smithi194.stdout:5/637: readlink d3/dc/d2d/l73 0 2024-04-13T10:58:43.583 INFO:tasks.workunit.client.1.smithi194.stdout:4/649: creat d2/d16/d1a/d1c/d3e/d48/fd7 x:0 0 0 2024-04-13T10:58:43.584 INFO:tasks.workunit.client.1.smithi194.stdout:5/638: chown d3/dc/d17/d93 78777 1 2024-04-13T10:58:43.587 INFO:tasks.workunit.client.1.smithi194.stdout:8/754: mknod d6/d22/d23/d7f/d8c/de7/cfe 0 2024-04-13T10:58:43.588 INFO:tasks.workunit.client.1.smithi194.stdout:2/624: dwrite d2/d3/de/d17/d1e/fc7 [0,4194304] 0 2024-04-13T10:58:43.589 INFO:tasks.workunit.client.1.smithi194.stdout:3/618: fdatasync d2/d3/f8 0 2024-04-13T10:58:43.593 INFO:tasks.workunit.client.1.smithi194.stdout:9/597: rename d0/d6/d9/d70 to d0/d6/d14/dcd 0 2024-04-13T10:58:43.595 INFO:tasks.workunit.client.1.smithi194.stdout:4/650: unlink d2/d16/d70/f8b 0 2024-04-13T10:58:43.598 INFO:tasks.workunit.client.1.smithi194.stdout:6/572: dread d0/d26/d2b/f76 [0,4194304] 0 2024-04-13T10:58:43.599 INFO:tasks.workunit.client.1.smithi194.stdout:1/601: link d12/d13/d44/f99 d12/d13/d1c/d27/d2e/fc8 0 2024-04-13T10:58:43.600 INFO:tasks.workunit.client.1.smithi194.stdout:6/573: chown d0/d2c/d77/d93/fa9 81628 1 2024-04-13T10:58:43.601 INFO:tasks.workunit.client.1.smithi194.stdout:8/755: rmdir d6/d2a 39 2024-04-13T10:58:43.601 INFO:tasks.workunit.client.1.smithi194.stdout:6/574: fdatasync d0/d53/d78/faf 0 2024-04-13T10:58:43.602 INFO:tasks.workunit.client.1.smithi194.stdout:0/576: write d9/db1/d30/d73/fa6 [161026,32345] 0 2024-04-13T10:58:43.603 INFO:tasks.workunit.client.1.smithi194.stdout:9/598: dread d0/d11/d3d/f5d [0,4194304] 0 2024-04-13T10:58:43.611 INFO:tasks.workunit.client.1.smithi194.stdout:6/575: rmdir d0/d2f/d6f 39 2024-04-13T10:58:43.612 INFO:tasks.workunit.client.1.smithi194.stdout:0/577: creat d9/df/d16/d75/fbf x:0 0 0 2024-04-13T10:58:43.613 INFO:tasks.workunit.client.1.smithi194.stdout:6/576: dread - d0/d57/fb0 zero size 2024-04-13T10:58:43.613 INFO:tasks.workunit.client.1.smithi194.stdout:5/639: dread d3/dc/d17/d1b/f47 [0,4194304] 0 2024-04-13T10:58:43.614 INFO:tasks.workunit.client.1.smithi194.stdout:4/651: mkdir d2/daf/dc4/dd8 0 2024-04-13T10:58:43.615 INFO:tasks.workunit.client.1.smithi194.stdout:8/756: dwrite d6/d2a/f34 [0,4194304] 0 2024-04-13T10:58:43.616 INFO:tasks.workunit.client.1.smithi194.stdout:7/670: link d1/d2b/d2c/d30/cd1 d1/d2b/d2c/cdb 0 2024-04-13T10:58:43.621 INFO:tasks.workunit.client.1.smithi194.stdout:0/578: creat d9/db/d3a/fc0 x:0 0 0 2024-04-13T10:58:43.621 INFO:tasks.workunit.client.1.smithi194.stdout:9/599: dwrite d0/d6/d2c/d68/f71 [0,4194304] 0 2024-04-13T10:58:43.623 INFO:tasks.workunit.client.1.smithi194.stdout:6/577: creat d0/d53/d78/fb8 x:0 0 0 2024-04-13T10:58:43.623 INFO:tasks.workunit.client.1.smithi194.stdout:3/619: truncate d2/d3/d12/d31/d34/d88/fa9 1881183 0 2024-04-13T10:58:43.625 INFO:tasks.workunit.client.1.smithi194.stdout:7/671: creat d1/d2b/d4c/d4f/d51/d4d/fdc x:0 0 0 2024-04-13T10:58:43.630 INFO:tasks.workunit.client.1.smithi194.stdout:0/579: read d9/df/d63/f80 [400799,8766] 0 2024-04-13T10:58:43.630 INFO:tasks.workunit.client.1.smithi194.stdout:9/600: creat d0/d6/d2c/d68/fce x:0 0 0 2024-04-13T10:58:43.631 INFO:tasks.workunit.client.1.smithi194.stdout:1/602: truncate d12/d13/d1c/d7c/fab 1720509 0 2024-04-13T10:58:43.631 INFO:tasks.workunit.client.1.smithi194.stdout:2/625: dwrite d2/d3/d12/f1b [0,4194304] 0 2024-04-13T10:58:43.634 INFO:tasks.workunit.client.1.smithi194.stdout:3/620: readlink d2/d3/d12/d31/d34/l7f 0 2024-04-13T10:58:43.636 INFO:tasks.workunit.client.1.smithi194.stdout:9/601: unlink d0/d11/d79/l91 0 2024-04-13T10:58:43.638 INFO:tasks.workunit.client.1.smithi194.stdout:4/652: link d2/d16/d1a/d1c/d54/d5d/c5e d2/cd9 0 2024-04-13T10:58:43.639 INFO:tasks.workunit.client.1.smithi194.stdout:0/580: symlink d9/df/d16/lc1 0 2024-04-13T10:58:43.642 INFO:tasks.workunit.client.1.smithi194.stdout:5/640: dwrite d3/dc/d17/d1b/f8a [0,4194304] 0 2024-04-13T10:58:43.642 INFO:tasks.workunit.client.1.smithi194.stdout:2/626: fdatasync d2/d3/de/d17/d1e/f3f 0 2024-04-13T10:58:43.646 INFO:tasks.workunit.client.1.smithi194.stdout:4/653: dread - d2/d16/d70/d31/d44/fc9 zero size 2024-04-13T10:58:43.647 INFO:tasks.workunit.client.1.smithi194.stdout:6/578: dwrite d0/f2a [0,4194304] 0 2024-04-13T10:58:43.647 INFO:tasks.workunit.client.1.smithi194.stdout:1/603: mkdir d12/d13/d1c/d28/d41/d77/d80/dc9 0 2024-04-13T10:58:43.651 INFO:tasks.workunit.client.1.smithi194.stdout:2/627: symlink d2/d3/d6d/dac/ld1 0 2024-04-13T10:58:43.651 INFO:tasks.workunit.client.1.smithi194.stdout:7/672: dwrite d1/d2b/d4c/d4f/d51/d4d/d5e/fc7 [0,4194304] 0 2024-04-13T10:58:43.652 INFO:tasks.workunit.client.1.smithi194.stdout:9/602: mknod d0/d6/d2c/db5/ccf 0 2024-04-13T10:58:43.659 INFO:tasks.workunit.client.1.smithi194.stdout:7/673: readlink d1/d6c/l8e 0 2024-04-13T10:58:43.660 INFO:tasks.workunit.client.1.smithi194.stdout:9/603: chown d0/f3 39902 1 2024-04-13T10:58:43.660 INFO:tasks.workunit.client.1.smithi194.stdout:6/579: write d0/d2f/fb1 [368571,88286] 0 2024-04-13T10:58:43.663 INFO:tasks.workunit.client.1.smithi194.stdout:3/621: write d2/d3/d12/f16 [3719072,99375] 0 2024-04-13T10:58:43.668 INFO:tasks.workunit.client.1.smithi194.stdout:2/628: rename d2/d3/de/l11 to d2/d3/de/d17/d1e/ld2 0 2024-04-13T10:58:43.668 INFO:tasks.workunit.client.1.smithi194.stdout:6/580: truncate d0/d2f/fb1 909976 0 2024-04-13T10:58:43.668 INFO:tasks.workunit.client.1.smithi194.stdout:5/641: dwrite d3/dc/d10/d38/d59/d7a/f9e [0,4194304] 0 2024-04-13T10:58:43.669 INFO:tasks.workunit.client.1.smithi194.stdout:3/622: stat d2/d3/d12/d21/c3f 0 2024-04-13T10:58:43.670 INFO:tasks.workunit.client.1.smithi194.stdout:4/654: dwrite d2/d33/f2e [0,4194304] 0 2024-04-13T10:58:43.672 INFO:tasks.workunit.client.1.smithi194.stdout:6/581: chown d0/d26/f4e 115009580 1 2024-04-13T10:58:43.674 INFO:tasks.workunit.client.1.smithi194.stdout:9/604: rename d0/d11/c62 to d0/d11/d1e/cd0 0 2024-04-13T10:58:43.676 INFO:tasks.workunit.client.1.smithi194.stdout:7/674: link d1/d2b/d4c/d4f/d6e/c97 d1/d2b/d4c/d4f/d51/cdd 0 2024-04-13T10:58:43.678 INFO:tasks.workunit.client.1.smithi194.stdout:5/642: creat d3/dc/d10/d38/d46/fc8 x:0 0 0 2024-04-13T10:58:43.678 INFO:tasks.workunit.client.1.smithi194.stdout:4/655: symlink d2/lda 0 2024-04-13T10:58:43.679 INFO:tasks.workunit.client.1.smithi194.stdout:3/623: readlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95/lc4 0 2024-04-13T10:58:43.683 INFO:tasks.workunit.client.1.smithi194.stdout:0/581: dwrite d9/df/f4c [0,4194304] 0 2024-04-13T10:58:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:43 smithi134 ceph-mon[39696]: mgrmap e25: smithi194.tcpynt(active, since 44s), standbys: smithi134.tmanda 2024-04-13T10:58:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:43 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:58:43.684 INFO:tasks.workunit.client.1.smithi194.stdout:7/675: truncate d1/d2b/d3e/f9f 48708 0 2024-04-13T10:58:43.687 INFO:tasks.workunit.client.1.smithi194.stdout:4/656: rename d2/ff to d2/d16/d1a/d1c/d3b/d8d/fdb 0 2024-04-13T10:58:43.688 INFO:tasks.workunit.client.1.smithi194.stdout:0/582: stat d9/db1/d30/d73/fa6 0 2024-04-13T10:58:43.688 INFO:tasks.workunit.client.1.smithi194.stdout:5/643: creat d3/dc/d17/fc9 x:0 0 0 2024-04-13T10:58:43.690 INFO:tasks.workunit.client.1.smithi194.stdout:1/604: truncate d12/d13/d1c/d7c/fab 1933297 0 2024-04-13T10:58:43.690 INFO:tasks.workunit.client.1.smithi194.stdout:2/629: dwrite d2/d3/d6d/f6f [0,4194304] 0 2024-04-13T10:58:43.691 INFO:tasks.workunit.client.1.smithi194.stdout:7/676: write d1/d2b/d4c/d4f/f70 [872753,57934] 0 2024-04-13T10:58:43.693 INFO:tasks.workunit.client.1.smithi194.stdout:0/583: chown d9/df/d16/d70 43 1 2024-04-13T10:58:43.694 INFO:tasks.workunit.client.1.smithi194.stdout:4/657: fsync d2/d16/d1a/d1c/d3e/d48/f80 0 2024-04-13T10:58:43.697 INFO:tasks.workunit.client.1.smithi194.stdout:1/605: fsync d12/d13/d1c/d27/f74 0 2024-04-13T10:58:43.698 INFO:tasks.workunit.client.1.smithi194.stdout:7/677: fdatasync d1/d2b/d2c/f68 0 2024-04-13T10:58:43.700 INFO:tasks.workunit.client.1.smithi194.stdout:0/584: write d9/db1/d30/d73/d87/faa [386323,126275] 0 2024-04-13T10:58:43.701 INFO:tasks.workunit.client.1.smithi194.stdout:4/658: creat d2/d16/d1a/d1c/d3b/d42/fdc x:0 0 0 2024-04-13T10:58:43.705 INFO:tasks.workunit.client.1.smithi194.stdout:3/624: dwrite d2/d3/d12/d31/d34/d88/d24/f4c [0,4194304] 0 2024-04-13T10:58:43.707 INFO:tasks.workunit.client.1.smithi194.stdout:7/678: creat d1/d2b/d4c/d4f/d6e/fde x:0 0 0 2024-04-13T10:58:43.708 INFO:tasks.workunit.client.1.smithi194.stdout:2/630: getdents d2/d3/d12 0 2024-04-13T10:58:43.713 INFO:tasks.workunit.client.1.smithi194.stdout:9/605: dread d0/d11/d1e/f21 [0,4194304] 0 2024-04-13T10:58:43.713 INFO:tasks.workunit.client.1.smithi194.stdout:3/625: creat d2/de/fcd x:0 0 0 2024-04-13T10:58:43.714 INFO:tasks.workunit.client.1.smithi194.stdout:5/644: dwrite d3/dc/d10/d38/f4d [4194304,4194304] 0 2024-04-13T10:58:43.716 INFO:tasks.workunit.client.1.smithi194.stdout:0/585: unlink d9/db/d3a/d9a/la1 0 2024-04-13T10:58:43.718 INFO:tasks.workunit.client.1.smithi194.stdout:7/679: fdatasync d1/d2b/d4c/d4f/d6e/f87 0 2024-04-13T10:58:43.718 INFO:tasks.workunit.client.1.smithi194.stdout:2/631: unlink d2/d3/de/d17/d36/d8f/fbd 0 2024-04-13T10:58:43.721 INFO:tasks.workunit.client.1.smithi194.stdout:9/606: creat d0/d6/d14/d26/d3b/fd1 x:0 0 0 2024-04-13T10:58:43.723 INFO:tasks.workunit.client.1.smithi194.stdout:4/659: dwrite d2/d16/d1a/d1c/d3b/f72 [0,4194304] 0 2024-04-13T10:58:43.723 INFO:tasks.workunit.client.1.smithi194.stdout:9/607: fdatasync d0/d11/d3d/fbf 0 2024-04-13T10:58:43.724 INFO:tasks.workunit.client.1.smithi194.stdout:3/626: mkdir d2/dce 0 2024-04-13T10:58:43.725 INFO:tasks.workunit.client.1.smithi194.stdout:1/606: truncate d12/fa4 532531 0 2024-04-13T10:58:43.727 INFO:tasks.workunit.client.1.smithi194.stdout:0/586: creat d9/db1/d30/d73/fc2 x:0 0 0 2024-04-13T10:58:43.728 INFO:tasks.workunit.client.1.smithi194.stdout:3/627: stat d2/d3/d12/d31/d34/d88/d24/d6c/cb0 0 2024-04-13T10:58:43.730 INFO:tasks.workunit.client.1.smithi194.stdout:7/680: dwrite d1/d2b/d2c/f7f [0,4194304] 0 2024-04-13T10:58:43.731 INFO:tasks.workunit.client.1.smithi194.stdout:0/587: truncate d9/db1/fa7 403355 0 2024-04-13T10:58:43.732 INFO:tasks.workunit.client.1.smithi194.stdout:3/628: write d2/d3/d12/d31/d34/d88/fad [48971,65334] 0 2024-04-13T10:58:43.732 INFO:tasks.workunit.client.1.smithi194.stdout:4/660: symlink d2/d33/ldd 0 2024-04-13T10:58:43.733 INFO:tasks.workunit.client.1.smithi194.stdout:9/608: mknod d0/d6/d14/d26/d42/cd2 0 2024-04-13T10:58:43.734 INFO:tasks.workunit.client.1.smithi194.stdout:9/609: dread - d0/d11/d3d/fb6 zero size 2024-04-13T10:58:43.736 INFO:tasks.workunit.client.1.smithi194.stdout:9/610: chown d0/d6/d2c/d68/fce 549053889 1 2024-04-13T10:58:43.736 INFO:tasks.workunit.client.1.smithi194.stdout:7/681: readlink d1/d2b/d4c/l52 0 2024-04-13T10:58:43.738 INFO:tasks.workunit.client.1.smithi194.stdout:5/645: getdents d3/d29 0 2024-04-13T10:58:43.739 INFO:tasks.workunit.client.1.smithi194.stdout:5/646: write d3/dc/d17/f74 [1512671,115061] 0 2024-04-13T10:58:43.743 INFO:tasks.workunit.client.1.smithi194.stdout:9/611: creat d0/d6/d4a/d74/fd3 x:0 0 0 2024-04-13T10:58:43.743 INFO:tasks.workunit.client.1.smithi194.stdout:2/632: write d2/d3/de/d17/d39/f64 [1351159,26278] 0 2024-04-13T10:58:43.746 INFO:tasks.workunit.client.1.smithi194.stdout:2/633: write d2/d3/d12/dba/fbc [134978,35990] 0 2024-04-13T10:58:43.748 INFO:tasks.workunit.client.1.smithi194.stdout:3/629: creat d2/d3/d12/d31/d34/d88/d24/d6c/dc2/fcf x:0 0 0 2024-04-13T10:58:43.749 INFO:tasks.workunit.client.1.smithi194.stdout:9/612: mknod d0/d6/d2c/db5/cd4 0 2024-04-13T10:58:43.750 INFO:tasks.workunit.client.1.smithi194.stdout:5/647: readlink d3/dc/d17/d93/l95 0 2024-04-13T10:58:43.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:43 smithi194 ceph-mon[46737]: mgrmap e25: smithi194.tcpynt(active, since 44s), standbys: smithi134.tmanda 2024-04-13T10:58:43.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:43 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:58:43.751 INFO:tasks.workunit.client.1.smithi194.stdout:5/648: fsync d3/d29/fa2 0 2024-04-13T10:58:43.751 INFO:tasks.workunit.client.1.smithi194.stdout:2/634: write d2/d3/de/d17/d36/d8f/f31 [4915049,68033] 0 2024-04-13T10:58:43.753 INFO:tasks.workunit.client.1.smithi194.stdout:7/682: dread d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/fa6 [0,4194304] 0 2024-04-13T10:58:43.754 INFO:tasks.workunit.client.1.smithi194.stdout:1/607: truncate d12/fa4 726918 0 2024-04-13T10:58:43.755 INFO:tasks.workunit.client.1.smithi194.stdout:3/630: rmdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61 39 2024-04-13T10:58:43.758 INFO:tasks.workunit.client.1.smithi194.stdout:9/613: read d0/d6/d14/d26/f67 [2345671,71678] 0 2024-04-13T10:58:43.759 INFO:tasks.workunit.client.1.smithi194.stdout:3/631: chown d2/de/c4d 48 1 2024-04-13T10:58:43.759 INFO:tasks.workunit.client.1.smithi194.stdout:1/608: creat d12/d13/d1c/d7c/fca x:0 0 0 2024-04-13T10:58:43.760 INFO:tasks.workunit.client.1.smithi194.stdout:2/635: unlink d2/d3/de/d17/d1e/l4f 0 2024-04-13T10:58:43.761 INFO:tasks.workunit.client.1.smithi194.stdout:0/588: dread d9/db1/d28/f2f [0,4194304] 0 2024-04-13T10:58:43.762 INFO:tasks.workunit.client.1.smithi194.stdout:7/683: write d1/d2b/d4c/f5d [445779,117848] 0 2024-04-13T10:58:43.763 INFO:tasks.workunit.client.1.smithi194.stdout:4/661: dread d2/d16/d1a/f36 [0,4194304] 0 2024-04-13T10:58:43.791 INFO:tasks.workunit.client.1.smithi194.stdout:1/609: symlink d12/d13/d1c/d27/d5c/lcb 0 2024-04-13T10:58:43.793 INFO:tasks.workunit.client.1.smithi194.stdout:5/649: dwrite d3/dc/d10/d38/d46/fc8 [0,4194304] 0 2024-04-13T10:58:43.794 INFO:tasks.workunit.client.1.smithi194.stdout:0/589: fsync d9/db1/d28/f53 0 2024-04-13T10:58:43.794 INFO:tasks.workunit.client.1.smithi194.stdout:3/632: creat d2/d3/d12/d31/d34/d88/d24/d6c/fd0 x:0 0 0 2024-04-13T10:58:43.794 INFO:tasks.workunit.client.1.smithi194.stdout:7/684: read d1/d8b/f93 [187017,27947] 0 2024-04-13T10:58:43.800 INFO:tasks.workunit.client.1.smithi194.stdout:4/662: rename d2/d16/d70/d31/f3a to d2/d16/d1a/d1c/fde 0 2024-04-13T10:58:43.800 INFO:tasks.workunit.client.1.smithi194.stdout:3/633: fdatasync d2/d3/d12/d31/d34/f39 0 2024-04-13T10:58:43.801 INFO:tasks.workunit.client.1.smithi194.stdout:5/650: truncate d3/dc/d17/f75 565228 0 2024-04-13T10:58:43.801 INFO:tasks.workunit.client.1.smithi194.stdout:0/590: write d9/db1/d28/f2e [528484,95191] 0 2024-04-13T10:58:43.803 INFO:tasks.workunit.client.1.smithi194.stdout:7/685: write d1/d2b/d2c/d30/d33/d39/f66 [1171079,105698] 0 2024-04-13T10:58:43.805 INFO:tasks.workunit.client.1.smithi194.stdout:2/636: dwrite d2/d3/de/d33/d71/fa5 [0,4194304] 0 2024-04-13T10:58:43.808 INFO:tasks.workunit.client.1.smithi194.stdout:1/610: dread d12/f35 [0,4194304] 0 2024-04-13T10:58:43.808 INFO:tasks.workunit.client.1.smithi194.stdout:4/663: rmdir d2/d16/d1a/d1c/d54/d62/d6e 39 2024-04-13T10:58:43.808 INFO:tasks.workunit.client.1.smithi194.stdout:7/686: chown d1/lc 1343335 1 2024-04-13T10:58:43.808 INFO:tasks.workunit.client.1.smithi194.stdout:0/591: mknod d9/df/cc3 0 2024-04-13T10:58:43.811 INFO:tasks.workunit.client.1.smithi194.stdout:4/664: chown d2/d16/d1a/f35 22966660 1 2024-04-13T10:58:43.812 INFO:tasks.workunit.client.1.smithi194.stdout:4/665: chown d2/d33 0 1 2024-04-13T10:58:43.814 INFO:tasks.workunit.client.1.smithi194.stdout:3/634: dwrite d2/d3/db9/fa4 [0,4194304] 0 2024-04-13T10:58:43.814 INFO:tasks.workunit.client.1.smithi194.stdout:0/592: unlink d9/c93 0 2024-04-13T10:58:43.822 INFO:tasks.workunit.client.1.smithi194.stdout:5/651: getdents d3/dc/d10/d38/d46 0 2024-04-13T10:58:43.822 INFO:tasks.workunit.client.1.smithi194.stdout:1/611: dread d12/d13/d3e/f66 [0,4194304] 0 2024-04-13T10:58:43.822 INFO:tasks.workunit.client.1.smithi194.stdout:7/687: rename d1/d2b/d3e/d54 to d1/d2b/d3e/ddf 0 2024-04-13T10:58:43.822 INFO:tasks.workunit.client.1.smithi194.stdout:0/593: creat d9/df/d16/d70/fc4 x:0 0 0 2024-04-13T10:58:43.823 INFO:tasks.workunit.client.1.smithi194.stdout:3/635: fdatasync d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/fae 0 2024-04-13T10:58:43.824 INFO:tasks.workunit.client.1.smithi194.stdout:7/688: rmdir d1/d2b/d3e/ddf/d5a/d7d 39 2024-04-13T10:58:43.827 INFO:tasks.workunit.client.1.smithi194.stdout:5/652: rmdir d3/dc/d10/d38/d59/d49/da4 39 2024-04-13T10:58:43.827 INFO:tasks.workunit.client.1.smithi194.stdout:1/612: dwrite d12/f55 [0,4194304] 0 2024-04-13T10:58:43.833 INFO:tasks.workunit.client.1.smithi194.stdout:0/594: dwrite d9/d2b/d5a/f5b [0,4194304] 0 2024-04-13T10:58:43.839 INFO:tasks.workunit.client.1.smithi194.stdout:0/595: rmdir d9/df/d16/d70 39 2024-04-13T10:58:43.839 INFO:tasks.workunit.client.1.smithi194.stdout:7/689: dwrite d1/d2b/d4c/d4f/f70 [0,4194304] 0 2024-04-13T10:58:43.843 INFO:tasks.workunit.client.1.smithi194.stdout:6/582: sync 2024-04-13T10:58:43.845 INFO:tasks.workunit.client.1.smithi194.stdout:8/757: sync 2024-04-13T10:58:43.845 INFO:tasks.workunit.client.1.smithi194.stdout:2/637: dwrite d2/f74 [0,4194304] 0 2024-04-13T10:58:43.850 INFO:tasks.workunit.client.1.smithi194.stdout:6/583: dread - d0/d2f/d48/d83/fb2 zero size 2024-04-13T10:58:43.851 INFO:tasks.workunit.client.1.smithi194.stdout:2/638: truncate d2/d3/de/d33/d47/dbb/f5e 3365198 0 2024-04-13T10:58:43.853 INFO:tasks.workunit.client.1.smithi194.stdout:8/758: rename d6/d22/d23/d25/d71/dcc to d6/dff 0 2024-04-13T10:58:43.854 INFO:tasks.workunit.client.1.smithi194.stdout:6/584: mknod d0/d26/d2b/d4d/d80/cb9 0 2024-04-13T10:58:43.855 INFO:tasks.workunit.client.1.smithi194.stdout:6/585: chown d0/f21 21026361 1 2024-04-13T10:58:43.856 INFO:tasks.workunit.client.1.smithi194.stdout:2/639: rename d2/f74 to d2/d3/de/d17/d36/d3d/fd3 0 2024-04-13T10:58:43.857 INFO:tasks.workunit.client.1.smithi194.stdout:8/759: dread d6/d22/d23/d3d/f40 [0,4194304] 0 2024-04-13T10:58:43.857 INFO:tasks.workunit.client.1.smithi194.stdout:6/586: truncate d0/d2f/d48/d83/fb2 212438 0 2024-04-13T10:58:43.858 INFO:tasks.workunit.client.1.smithi194.stdout:2/640: read - d2/d3/de/d17/d36/d7a/faa zero size 2024-04-13T10:58:43.859 INFO:tasks.workunit.client.1.smithi194.stdout:8/760: chown d6/d22/d23/d25/d39/d41 669 1 2024-04-13T10:58:43.860 INFO:tasks.workunit.client.1.smithi194.stdout:2/641: mkdir d2/d3/d12/dba/dd4 0 2024-04-13T10:58:43.861 INFO:tasks.workunit.client.1.smithi194.stdout:6/587: mkdir d0/d2c/d77/d7f/dba 0 2024-04-13T10:58:43.864 INFO:tasks.workunit.client.1.smithi194.stdout:8/761: getdents d6/d22/d23/d25 0 2024-04-13T10:58:43.870 INFO:tasks.workunit.client.1.smithi194.stdout:5/653: dread d3/f9 [0,4194304] 0 2024-04-13T10:58:43.870 INFO:tasks.workunit.client.1.smithi194.stdout:8/762: symlink d6/d22/d23/d25/d71/da0/de5/deb/db1/l100 0 2024-04-13T10:58:43.871 INFO:tasks.workunit.client.1.smithi194.stdout:6/588: dwrite d0/d26/d2b/f96 [0,4194304] 0 2024-04-13T10:58:43.873 INFO:tasks.workunit.client.1.smithi194.stdout:7/690: dread d1/fe [0,4194304] 0 2024-04-13T10:58:43.874 INFO:tasks.workunit.client.1.smithi194.stdout:0/596: truncate d9/db/f33 98373 0 2024-04-13T10:58:43.876 INFO:tasks.workunit.client.1.smithi194.stdout:8/763: write d6/f1d [8047600,54275] 0 2024-04-13T10:58:43.879 INFO:tasks.workunit.client.1.smithi194.stdout:8/764: chown d6/d22/d23/d25/d39/fa4 63162 1 2024-04-13T10:58:43.880 INFO:tasks.workunit.client.1.smithi194.stdout:5/654: creat d3/dc/d10/d38/d59/fca x:0 0 0 2024-04-13T10:58:43.881 INFO:tasks.workunit.client.1.smithi194.stdout:0/597: write d9/db1/fa2 [359102,98245] 0 2024-04-13T10:58:43.882 INFO:tasks.workunit.client.1.smithi194.stdout:7/691: write d1/d2b/d2c/d30/d33/d39/f62 [1217972,16995] 0 2024-04-13T10:58:43.882 INFO:tasks.workunit.client.1.smithi194.stdout:2/642: dread d2/d3/de/d17/d1e/fbf [0,4194304] 0 2024-04-13T10:58:43.885 INFO:tasks.workunit.client.1.smithi194.stdout:2/643: chown d2/d3/de/d17/d1e/d42 2818287 1 2024-04-13T10:58:43.885 INFO:tasks.workunit.client.1.smithi194.stdout:0/598: write d9/db1/d28/f2f [1702431,1092] 0 2024-04-13T10:58:43.885 INFO:tasks.workunit.client.1.smithi194.stdout:5/655: mknod d3/dc/d10/d20/ccb 0 2024-04-13T10:58:43.886 INFO:tasks.workunit.client.1.smithi194.stdout:6/589: dread d0/d2c/f9c [0,4194304] 0 2024-04-13T10:58:43.888 INFO:tasks.workunit.client.1.smithi194.stdout:5/656: write d3/d89/fc4 [618609,49161] 0 2024-04-13T10:58:43.888 INFO:tasks.workunit.client.1.smithi194.stdout:0/599: chown d9/db1/fa2 5287 1 2024-04-13T10:58:43.890 INFO:tasks.workunit.client.1.smithi194.stdout:7/692: creat d1/d2b/d4c/d4f/d85/d88/d9b/db8/dc8/fe0 x:0 0 0 2024-04-13T10:58:43.891 INFO:tasks.workunit.client.1.smithi194.stdout:6/590: creat d0/d57/fbb x:0 0 0 2024-04-13T10:58:43.891 INFO:tasks.workunit.client.1.smithi194.stdout:7/693: fdatasync d1/d2b/d4c/d4f/d51/d4d/d5e/fd6 0 2024-04-13T10:58:43.892 INFO:tasks.workunit.client.1.smithi194.stdout:2/644: creat d2/d3/de/d17/d36/d7a/fd5 x:0 0 0 2024-04-13T10:58:43.893 INFO:tasks.workunit.client.1.smithi194.stdout:8/765: truncate f5 1273970 0 2024-04-13T10:58:43.894 INFO:tasks.workunit.client.1.smithi194.stdout:7/694: fsync d1/d2b/d4c/d7e/dab/d96/fa3 0 2024-04-13T10:58:43.895 INFO:tasks.workunit.client.1.smithi194.stdout:2/645: write d2/d3/de/d17/d36/d7a/fd5 [250594,103288] 0 2024-04-13T10:58:43.896 INFO:tasks.workunit.client.1.smithi194.stdout:0/600: creat d9/df/d16/fc5 x:0 0 0 2024-04-13T10:58:43.896 INFO:tasks.workunit.client.1.smithi194.stdout:6/591: dread d0/d26/d2b/f40 [0,4194304] 0 2024-04-13T10:58:43.896 INFO:tasks.workunit.client.1.smithi194.stdout:8/766: chown d6/d2a/f34 88380686 1 2024-04-13T10:58:43.896 INFO:tasks.workunit.client.1.smithi194.stdout:5/657: symlink d3/dc/d10/d20/daa/lcc 0 2024-04-13T10:58:43.898 INFO:tasks.workunit.client.1.smithi194.stdout:7/695: stat d1/d2b/d4c/d4f/d6e/fde 0 2024-04-13T10:58:43.899 INFO:tasks.workunit.client.1.smithi194.stdout:0/601: chown d9/db1/d28 5 1 2024-04-13T10:58:43.899 INFO:tasks.workunit.client.1.smithi194.stdout:6/592: fsync d0/d57/d69/f8a 0 2024-04-13T10:58:43.901 INFO:tasks.workunit.client.1.smithi194.stdout:2/646: fsync d2/d3/de/d17/d36/f88 0 2024-04-13T10:58:43.902 INFO:tasks.workunit.client.1.smithi194.stdout:0/602: mknod d9/db/d3a/cc6 0 2024-04-13T10:58:43.903 INFO:tasks.workunit.client.1.smithi194.stdout:7/696: chown d1/d2b/d4c/d7e/cce 994738 1 2024-04-13T10:58:43.904 INFO:tasks.workunit.client.1.smithi194.stdout:8/767: symlink d6/d22/d23/d7f/d8c/d8d/ddc/l101 0 2024-04-13T10:58:43.908 INFO:tasks.workunit.client.1.smithi194.stdout:8/768: readlink d6/d22/d23/l2b 0 2024-04-13T10:58:43.910 INFO:tasks.workunit.client.1.smithi194.stdout:7/697: rename d1/d2b/d4c/d7e to d1/dd9/de1 0 2024-04-13T10:58:43.910 INFO:tasks.workunit.client.1.smithi194.stdout:5/658: dwrite d3/dc/d2d/f84 [4194304,4194304] 0 2024-04-13T10:58:43.912 INFO:tasks.workunit.client.1.smithi194.stdout:2/647: creat d2/d3/de/d17/d36/d8f/dcd/fd6 x:0 0 0 2024-04-13T10:58:43.913 INFO:tasks.workunit.client.1.smithi194.stdout:6/593: dwrite d0/f21 [4194304,4194304] 0 2024-04-13T10:58:43.914 INFO:tasks.workunit.client.1.smithi194.stdout:8/769: dread - d6/d22/d23/d7f/d8c/d8d/ddc/ff2 zero size 2024-04-13T10:58:43.916 INFO:tasks.workunit.client.1.smithi194.stdout:7/698: write d1/d2b/f47 [2753955,58280] 0 2024-04-13T10:58:43.917 INFO:tasks.workunit.client.1.smithi194.stdout:2/648: write d2/d3/de/d17/d1e/fc7 [562104,65519] 0 2024-04-13T10:58:43.919 INFO:tasks.workunit.client.1.smithi194.stdout:0/603: dwrite d9/df/f4c [0,4194304] 0 2024-04-13T10:58:43.919 INFO:tasks.workunit.client.1.smithi194.stdout:5/659: rmdir d3/dc/d10/d38/d59/d7a 39 2024-04-13T10:58:43.921 INFO:tasks.workunit.client.1.smithi194.stdout:7/699: unlink d1/d2b/d3e/c4a 0 2024-04-13T10:58:43.922 INFO:tasks.workunit.client.1.smithi194.stdout:2/649: stat d2/d3/de/f1a 0 2024-04-13T10:58:43.923 INFO:tasks.workunit.client.1.smithi194.stdout:7/700: chown d1/d2b/d4c/d4f/d85/dbc 1 1 2024-04-13T10:58:43.923 INFO:tasks.workunit.client.1.smithi194.stdout:6/594: mkdir d0/d57/db7/dbc 0 2024-04-13T10:58:43.925 INFO:tasks.workunit.client.1.smithi194.stdout:8/770: truncate d6/d22/d23/d25/d39/fa4 699685 0 2024-04-13T10:58:43.928 INFO:tasks.workunit.client.1.smithi194.stdout:8/771: fdatasync d6/d22/d23/d25/d39/f95 0 2024-04-13T10:58:43.929 INFO:tasks.workunit.client.1.smithi194.stdout:0/604: symlink d9/df/d16/d70/lc7 0 2024-04-13T10:58:43.930 INFO:tasks.workunit.client.1.smithi194.stdout:2/650: read d2/d3/de/f7f [427241,111561] 0 2024-04-13T10:58:43.930 INFO:tasks.workunit.client.1.smithi194.stdout:0/605: readlink d9/df/d63/l72 0 2024-04-13T10:58:43.932 INFO:tasks.workunit.client.1.smithi194.stdout:6/595: dwrite d0/d2c/f3e [0,4194304] 0 2024-04-13T10:58:43.932 INFO:tasks.workunit.client.1.smithi194.stdout:7/701: creat d1/d2b/d2c/d30/fe2 x:0 0 0 2024-04-13T10:58:43.936 INFO:tasks.workunit.client.1.smithi194.stdout:8/772: unlink d6/d22/d23/d25/d39/d41/d5b/d76/dc5/lf9 0 2024-04-13T10:58:43.938 INFO:tasks.workunit.client.1.smithi194.stdout:2/651: creat d2/d3/de/d17/d36/d8f/d57/fd7 x:0 0 0 2024-04-13T10:58:43.938 INFO:tasks.workunit.client.1.smithi194.stdout:9/614: sync 2024-04-13T10:58:43.939 INFO:tasks.workunit.client.1.smithi194.stdout:6/596: creat d0/d26/d2b/d4d/fbd x:0 0 0 2024-04-13T10:58:43.940 INFO:tasks.workunit.client.1.smithi194.stdout:8/773: truncate d6/dd/f48 850873 0 2024-04-13T10:58:43.941 INFO:tasks.workunit.client.1.smithi194.stdout:0/606: symlink d9/df/d16/d65/db9/lc8 0 2024-04-13T10:58:43.942 INFO:tasks.workunit.client.1.smithi194.stdout:8/774: write d6/d22/d23/d7f/d8c/d8d/ddc/ff2 [835419,36667] 0 2024-04-13T10:58:43.943 INFO:tasks.workunit.client.1.smithi194.stdout:8/775: readlink d6/d22/d23/d25/d71/da0/de5/deb/dac/ld7 0 2024-04-13T10:58:43.946 INFO:tasks.workunit.client.1.smithi194.stdout:8/776: symlink d6/d22/d23/d25/d71/l102 0 2024-04-13T10:58:43.947 INFO:tasks.workunit.client.1.smithi194.stdout:8/777: chown d6/fc9 388416703 1 2024-04-13T10:58:43.948 INFO:tasks.workunit.client.1.smithi194.stdout:9/615: rename d0/d6/d4a/d74/dae/cc4 to d0/d11/d3d/cd5 0 2024-04-13T10:58:43.949 INFO:tasks.workunit.client.1.smithi194.stdout:9/616: write d0/d6/fc3 [328037,104422] 0 2024-04-13T10:58:43.952 INFO:tasks.workunit.client.1.smithi194.stdout:8/778: mknod d6/d2a/dc7/dc8/c103 0 2024-04-13T10:58:43.953 INFO:tasks.workunit.client.1.smithi194.stdout:9/617: rmdir d0 39 2024-04-13T10:58:43.954 INFO:tasks.workunit.client.1.smithi194.stdout:9/618: write d0/f4d [762992,13672] 0 2024-04-13T10:58:43.956 INFO:tasks.workunit.client.1.smithi194.stdout:9/619: chown d0/d6/d14/dcd/fc6 64 1 2024-04-13T10:58:43.956 INFO:tasks.workunit.client.1.smithi194.stdout:8/779: fdatasync d6/d22/d23/d25/d39/d41/d5b/d76/f4f 0 2024-04-13T10:58:43.960 INFO:tasks.workunit.client.1.smithi194.stdout:9/620: unlink d0/d6/d14/d26/f34 0 2024-04-13T10:58:43.960 INFO:tasks.workunit.client.1.smithi194.stdout:2/652: dread d2/d3/de/d17/d1e/f3f [0,4194304] 0 2024-04-13T10:58:43.961 INFO:tasks.workunit.client.1.smithi194.stdout:6/597: rename d0/d26/d2b to d0/d42/dbe 0 2024-04-13T10:58:43.964 INFO:tasks.workunit.client.1.smithi194.stdout:9/621: mkdir d0/d6/d14/dcd/dd6 0 2024-04-13T10:58:43.965 INFO:tasks.workunit.client.1.smithi194.stdout:7/702: truncate d1/d2b/d4c/d4f/d51/d4d/d5e/fc7 1293799 0 2024-04-13T10:58:43.965 INFO:tasks.workunit.client.1.smithi194.stdout:2/653: mknod d2/d3/d6d/dac/cd8 0 2024-04-13T10:58:43.966 INFO:tasks.workunit.client.1.smithi194.stdout:2/654: chown d2/d3/de/d17/d1e/f62 164827896 1 2024-04-13T10:58:43.967 INFO:tasks.workunit.client.1.smithi194.stdout:6/598: unlink d0/d53/d78/fb8 0 2024-04-13T10:58:43.967 INFO:tasks.workunit.client.1.smithi194.stdout:6/599: chown d0/f73 2 1 2024-04-13T10:58:43.968 INFO:tasks.workunit.client.1.smithi194.stdout:2/655: write d2/d3/de/d17/d39/f64 [4112832,12153] 0 2024-04-13T10:58:43.969 INFO:tasks.workunit.client.1.smithi194.stdout:0/607: truncate d9/df/f23 2707957 0 2024-04-13T10:58:43.970 INFO:tasks.workunit.client.1.smithi194.stdout:9/622: mkdir d0/d6/d9/dd7 0 2024-04-13T10:58:43.972 INFO:tasks.workunit.client.1.smithi194.stdout:7/703: creat d1/d2b/d4c/d4f/d85/d88/d9b/db8/fe3 x:0 0 0 2024-04-13T10:58:43.975 INFO:tasks.workunit.client.1.smithi194.stdout:0/608: creat d9/df/d16/d83/fc9 x:0 0 0 2024-04-13T10:58:43.976 INFO:tasks.workunit.client.1.smithi194.stdout:9/623: mknod d0/d6/d14/dcd/cd8 0 2024-04-13T10:58:43.976 INFO:tasks.workunit.client.1.smithi194.stdout:0/609: chown d9/df/d16 20 1 2024-04-13T10:58:43.977 INFO:tasks.workunit.client.1.smithi194.stdout:2/656: mknod d2/d3/de/d17/d39/dcc/cd9 0 2024-04-13T10:58:43.978 INFO:tasks.workunit.client.1.smithi194.stdout:7/704: dwrite d1/d2b/d4c/d4f/d6e/fde [0,4194304] 0 2024-04-13T10:58:43.980 INFO:tasks.workunit.client.1.smithi194.stdout:7/705: write d1/f16 [1954452,69776] 0 2024-04-13T10:58:43.983 INFO:tasks.workunit.client.1.smithi194.stdout:8/780: truncate d6/d22/d23/d3d/f65 3714150 0 2024-04-13T10:58:43.984 INFO:tasks.workunit.client.1.smithi194.stdout:8/781: stat d6/dd/l99 0 2024-04-13T10:58:43.985 INFO:tasks.workunit.client.1.smithi194.stdout:6/600: link d0/d57/d84/l8b d0/d2f/d48/d83/lbf 0 2024-04-13T10:58:43.986 INFO:tasks.workunit.client.1.smithi194.stdout:6/601: write d0/d53/d78/d91/fa7 [37870,106853] 0 2024-04-13T10:58:43.989 INFO:tasks.workunit.client.1.smithi194.stdout:7/706: symlink d1/d2b/d4c/d4f/d85/d88/d9b/db8/dc8/le4 0 2024-04-13T10:58:43.990 INFO:tasks.workunit.client.1.smithi194.stdout:7/707: write d1/d2b/d4c/d4f/d85/d88/d9b/db8/dc8/fe0 [723333,100462] 0 2024-04-13T10:58:43.992 INFO:tasks.workunit.client.1.smithi194.stdout:6/602: creat d0/d57/d84/fc0 x:0 0 0 2024-04-13T10:58:43.993 INFO:tasks.workunit.client.1.smithi194.stdout:8/782: rmdir d6/d22/d23/d7f/d8c/d8d/ddc 39 2024-04-13T10:58:43.994 INFO:tasks.workunit.client.1.smithi194.stdout:8/783: readlink d6/d22/d23/d25/d71/da0/de5/deb/db1/lca 0 2024-04-13T10:58:43.995 INFO:tasks.workunit.client.1.smithi194.stdout:0/610: link d9/df/f3c d9/db/d3a/fca 0 2024-04-13T10:58:43.996 INFO:tasks.workunit.client.1.smithi194.stdout:0/611: write d9/db/f36 [629091,126730] 0 2024-04-13T10:58:43.997 INFO:tasks.workunit.client.1.smithi194.stdout:7/708: rmdir d1/d2b/d3e/ddf/d5a 39 2024-04-13T10:58:43.997 INFO:tasks.workunit.client.1.smithi194.stdout:0/612: dread - d9/d2b/fb4 zero size 2024-04-13T10:58:43.997 INFO:tasks.workunit.client.1.smithi194.stdout:6/603: mknod d0/d42/dbe/d4d/d80/cc1 0 2024-04-13T10:58:43.998 INFO:tasks.workunit.client.1.smithi194.stdout:6/604: read d0/d2f/fad [2231480,40669] 0 2024-04-13T10:58:44.000 INFO:tasks.workunit.client.1.smithi194.stdout:9/624: getdents d0/d6/d4a/d74/dae 0 2024-04-13T10:58:44.004 INFO:tasks.workunit.client.1.smithi194.stdout:2/657: write d2/d3/de/d33/d47/dbb/fca [3658906,121965] 0 2024-04-13T10:58:44.005 INFO:tasks.workunit.client.1.smithi194.stdout:0/613: symlink d9/db/d6b/lcb 0 2024-04-13T10:58:44.005 INFO:tasks.workunit.client.1.smithi194.stdout:0/614: dread - d9/db1/d30/d73/fba zero size 2024-04-13T10:58:44.007 INFO:tasks.workunit.client.1.smithi194.stdout:8/784: mknod d6/d22/d23/d7f/d8c/d8d/ddc/c104 0 2024-04-13T10:58:44.007 INFO:tasks.workunit.client.1.smithi194.stdout:8/785: write d6/f1d [2600926,47919] 0 2024-04-13T10:58:44.007 INFO:tasks.workunit.client.1.smithi194.stdout:6/605: symlink d0/d2c/d77/lc2 0 2024-04-13T10:58:44.009 INFO:tasks.workunit.client.1.smithi194.stdout:6/606: write d0/f18 [3878246,113669] 0 2024-04-13T10:58:44.009 INFO:tasks.workunit.client.1.smithi194.stdout:6/607: stat d0/d2f 0 2024-04-13T10:58:44.010 INFO:tasks.workunit.client.1.smithi194.stdout:7/709: mknod d1/d2b/d4c/d4f/d51/ce5 0 2024-04-13T10:58:44.010 INFO:tasks.workunit.client.1.smithi194.stdout:6/608: stat d0/d42/dbe/f40 0 2024-04-13T10:58:44.012 INFO:tasks.workunit.client.1.smithi194.stdout:2/658: creat d2/d3/de/d17/d36/d8f/dcd/fda x:0 0 0 2024-04-13T10:58:44.015 INFO:tasks.workunit.client.1.smithi194.stdout:8/786: mknod d6/d22/d23/d7f/d8c/c105 0 2024-04-13T10:58:44.017 INFO:tasks.workunit.client.1.smithi194.stdout:6/609: creat d0/d2c/d77/d7f/fc3 x:0 0 0 2024-04-13T10:58:44.018 INFO:tasks.workunit.client.1.smithi194.stdout:7/710: mknod d1/d2b/d4c/d4f/d85/d88/d9b/ce6 0 2024-04-13T10:58:44.019 INFO:tasks.workunit.client.1.smithi194.stdout:9/625: symlink d0/d88/ld9 0 2024-04-13T10:58:44.020 INFO:tasks.workunit.client.1.smithi194.stdout:6/610: truncate d0/d53/d78/faf 14524 0 2024-04-13T10:58:44.020 INFO:tasks.workunit.client.1.smithi194.stdout:8/787: mknod d6/d2a/d69/c106 0 2024-04-13T10:58:44.024 INFO:tasks.workunit.client.1.smithi194.stdout:9/626: dread - d0/d6/d2c/f56 zero size 2024-04-13T10:58:44.025 INFO:tasks.workunit.client.1.smithi194.stdout:7/711: dread d1/d2b/d4c/d4f/f64 [0,4194304] 0 2024-04-13T10:58:44.026 INFO:tasks.workunit.client.1.smithi194.stdout:8/788: mkdir d6/dee/d107 0 2024-04-13T10:58:44.026 INFO:tasks.workunit.client.1.smithi194.stdout:0/615: dread d9/d2b/f4f [0,4194304] 0 2024-04-13T10:58:44.029 INFO:tasks.workunit.client.1.smithi194.stdout:7/712: write d1/d2b/d4c/d4f/d51/d4d/fa7 [1816972,95398] 0 2024-04-13T10:58:44.030 INFO:tasks.workunit.client.1.smithi194.stdout:8/789: chown d6/d22/d23/d25/d39/d41/d5b/d76/l86 524199 1 2024-04-13T10:58:44.032 INFO:tasks.workunit.client.1.smithi194.stdout:8/790: chown d6/c61 397358936 1 2024-04-13T10:58:44.032 INFO:tasks.workunit.client.1.smithi194.stdout:2/659: dread d2/d3/de/d17/d36/f88 [0,4194304] 0 2024-04-13T10:58:44.032 INFO:tasks.workunit.client.1.smithi194.stdout:6/611: dread d0/f1a [4194304,4194304] 0 2024-04-13T10:58:44.033 INFO:tasks.workunit.client.1.smithi194.stdout:9/627: truncate d0/d6/d2c/f36 3319199 0 2024-04-13T10:58:44.034 INFO:tasks.workunit.client.1.smithi194.stdout:7/713: chown d1/cb1 495221444 1 2024-04-13T10:58:44.038 INFO:tasks.workunit.client.1.smithi194.stdout:6/612: truncate d0/d57/fbb 393223 0 2024-04-13T10:58:44.038 INFO:tasks.workunit.client.1.smithi194.stdout:6/613: write d0/f99 [602111,75060] 0 2024-04-13T10:58:44.038 INFO:tasks.workunit.client.1.smithi194.stdout:2/660: read d2/d3/de/d17/d1e/d42/d86/f89 [1867521,46594] 0 2024-04-13T10:58:44.038 INFO:tasks.workunit.client.1.smithi194.stdout:9/628: chown d0/d11/d3d/d9b/fb7 54349 1 2024-04-13T10:58:44.039 INFO:tasks.workunit.client.1.smithi194.stdout:0/616: dread d9/d2b/f4a [0,4194304] 0 2024-04-13T10:58:44.040 INFO:tasks.workunit.client.1.smithi194.stdout:8/791: rename d6/d22/d23/d25/d71/da0/de5/cd6 to d6/d22/d23/d7f/d8c/d8d/ddc/c108 0 2024-04-13T10:58:44.040 INFO:tasks.workunit.client.1.smithi194.stdout:9/629: write d0/d6/d14/d26/f3e [744109,56249] 0 2024-04-13T10:58:44.044 INFO:tasks.workunit.client.1.smithi194.stdout:2/661: mkdir d2/d3/de/d33/d71/ddb 0 2024-04-13T10:58:44.045 INFO:tasks.workunit.client.1.smithi194.stdout:0/617: creat d9/df/d63/fcc x:0 0 0 2024-04-13T10:58:44.049 INFO:tasks.workunit.client.1.smithi194.stdout:9/630: write d0/d6/d14/d26/f67 [3589829,89274] 0 2024-04-13T10:58:44.049 INFO:tasks.workunit.client.1.smithi194.stdout:7/714: dwrite d1/d8b/f93 [0,4194304] 0 2024-04-13T10:58:44.052 INFO:tasks.workunit.client.1.smithi194.stdout:0/618: rmdir d9/df/d63 39 2024-04-13T10:58:44.054 INFO:tasks.workunit.client.1.smithi194.stdout:8/792: dwrite d6/d22/d23/d25/f27 [8388608,4194304] 0 2024-04-13T10:58:44.055 INFO:tasks.workunit.client.1.smithi194.stdout:7/715: chown d1/d2b/d2c/d30/d33/d39/l48 4 1 2024-04-13T10:58:44.056 INFO:tasks.workunit.client.1.smithi194.stdout:9/631: dread d0/d11/d3d/f5d [0,4194304] 0 2024-04-13T10:58:44.057 INFO:tasks.workunit.client.1.smithi194.stdout:0/619: chown d9/df/d16/d70/f9d 1325710 1 2024-04-13T10:58:44.058 INFO:tasks.workunit.client.1.smithi194.stdout:8/793: write d6/f1d [7286263,96518] 0 2024-04-13T10:58:44.059 INFO:tasks.workunit.client.1.smithi194.stdout:2/662: truncate d2/d3/d6d/f6f 3245416 0 2024-04-13T10:58:44.061 INFO:tasks.workunit.client.1.smithi194.stdout:6/614: dwrite d0/d42/dbe/f76 [0,4194304] 0 2024-04-13T10:58:44.063 INFO:tasks.workunit.client.1.smithi194.stdout:7/716: chown d1/d6c/ca5 162358 1 2024-04-13T10:58:44.068 INFO:tasks.workunit.client.1.smithi194.stdout:2/663: dread d2/d3/d12/dba/fbc [0,4194304] 0 2024-04-13T10:58:44.069 INFO:tasks.workunit.client.1.smithi194.stdout:6/615: mkdir d0/d57/db7/dbc/dc4 0 2024-04-13T10:58:44.070 INFO:tasks.workunit.client.1.smithi194.stdout:0/620: unlink d9/d2b/d5a/f78 0 2024-04-13T10:58:44.071 INFO:tasks.workunit.client.1.smithi194.stdout:8/794: creat d6/d22/d23/d25/d71/da0/de5/deb/f109 x:0 0 0 2024-04-13T10:58:44.072 INFO:tasks.workunit.client.1.smithi194.stdout:9/632: dwrite d0/d6/d2c/d68/fce [0,4194304] 0 2024-04-13T10:58:44.072 INFO:tasks.workunit.client.1.smithi194.stdout:2/664: write d2/d3/de/d17/d36/d65/f79 [248505,61265] 0 2024-04-13T10:58:44.073 INFO:tasks.workunit.client.1.smithi194.stdout:6/616: dread d0/d53/f60 [0,4194304] 0 2024-04-13T10:58:44.075 INFO:tasks.workunit.client.1.smithi194.stdout:2/665: fdatasync d2/d3/f2d 0 2024-04-13T10:58:44.076 INFO:tasks.workunit.client.1.smithi194.stdout:6/617: write d0/d26/f5c [122340,82545] 0 2024-04-13T10:58:44.076 INFO:tasks.workunit.client.1.smithi194.stdout:4/666: sync 2024-04-13T10:58:44.076 INFO:tasks.workunit.client.1.smithi194.stdout:9/633: stat d0/c72 0 2024-04-13T10:58:44.080 INFO:tasks.workunit.client.1.smithi194.stdout:8/795: symlink d6/d2a/d69/da3/dfd/l10a 0 2024-04-13T10:58:44.083 INFO:tasks.workunit.client.1.smithi194.stdout:2/666: mkdir d2/d3/de/d33/d71/ddc 0 2024-04-13T10:58:44.083 INFO:tasks.workunit.client.1.smithi194.stdout:6/618: rename d0/d42/d7b/c82 to d0/d42/d7b/db4/cc5 0 2024-04-13T10:58:44.084 INFO:tasks.workunit.client.1.smithi194.stdout:0/621: dwrite d9/db1/d30/d73/d87/faa [0,4194304] 0 2024-04-13T10:58:44.086 INFO:tasks.workunit.client.1.smithi194.stdout:2/667: creat d2/d37/fdd x:0 0 0 2024-04-13T10:58:44.088 INFO:tasks.workunit.client.1.smithi194.stdout:8/796: unlink d6/dd/d45/l46 0 2024-04-13T10:58:44.092 INFO:tasks.workunit.client.1.smithi194.stdout:0/622: write d9/df/d16/d65/fac [528766,34450] 0 2024-04-13T10:58:44.093 INFO:tasks.workunit.client.1.smithi194.stdout:8/797: stat d6/d22/d23/d25/d39/fa4 0 2024-04-13T10:58:44.093 INFO:tasks.workunit.client.1.smithi194.stdout:9/634: dwrite d0/f3 [0,4194304] 0 2024-04-13T10:58:44.093 INFO:tasks.workunit.client.1.smithi194.stdout:2/668: creat d2/d37/fde x:0 0 0 2024-04-13T10:58:44.096 INFO:tasks.workunit.client.1.smithi194.stdout:0/623: write d9/df/d16/d65/f79 [687884,42166] 0 2024-04-13T10:58:44.097 INFO:tasks.workunit.client.1.smithi194.stdout:8/798: truncate d6/d2a/f57 1283252 0 2024-04-13T10:58:44.101 INFO:tasks.workunit.client.1.smithi194.stdout:9/635: rename d0/d11/f25 to d0/d6/d9/d51/fda 0 2024-04-13T10:58:44.102 INFO:tasks.workunit.client.1.smithi194.stdout:0/624: creat d9/df/d16/d83/fcd x:0 0 0 2024-04-13T10:58:44.103 INFO:tasks.workunit.client.1.smithi194.stdout:6/619: write d0/f12 [3950180,91104] 0 2024-04-13T10:58:44.105 INFO:tasks.workunit.client.1.smithi194.stdout:8/799: creat d6/d22/d23/d25/d71/da0/f10b x:0 0 0 2024-04-13T10:58:44.107 INFO:tasks.workunit.client.1.smithi194.stdout:0/625: creat d9/d2b/d6c/fce x:0 0 0 2024-04-13T10:58:44.108 INFO:tasks.workunit.client.1.smithi194.stdout:6/620: mknod d0/d2f/d48/d83/cc6 0 2024-04-13T10:58:44.109 INFO:tasks.workunit.client.1.smithi194.stdout:4/667: dread d2/d16/d1a/d1c/fde [0,4194304] 0 2024-04-13T10:58:44.110 INFO:tasks.workunit.client.1.smithi194.stdout:8/800: mkdir d6/d22/d23/d7f/d8c/d8d/d10c 0 2024-04-13T10:58:44.111 INFO:tasks.workunit.client.1.smithi194.stdout:9/636: dwrite d0/d6/d9/f48 [4194304,4194304] 0 2024-04-13T10:58:44.113 INFO:tasks.workunit.client.1.smithi194.stdout:8/801: readlink d6/d22/d23/d25/d71/l102 0 2024-04-13T10:58:44.115 INFO:tasks.workunit.client.1.smithi194.stdout:6/621: rename d0/d57/d84/fc0 to d0/d42/dbe/d4d/d80/fc7 0 2024-04-13T10:58:44.116 INFO:tasks.workunit.client.1.smithi194.stdout:9/637: creat d0/d6/d14/dcd/fdb x:0 0 0 2024-04-13T10:58:44.117 INFO:tasks.workunit.client.1.smithi194.stdout:4/668: dread d2/d16/d1a/f36 [0,4194304] 0 2024-04-13T10:58:44.117 INFO:tasks.workunit.client.1.smithi194.stdout:9/638: chown d0/d6/d4a/d74 1079 1 2024-04-13T10:58:44.117 INFO:tasks.workunit.client.1.smithi194.stdout:8/802: creat d6/d22/d23/d25/d71/da0/de5/deb/dac/f10d x:0 0 0 2024-04-13T10:58:44.118 INFO:tasks.workunit.client.1.smithi194.stdout:6/622: creat d0/d2c/d77/d93/fc8 x:0 0 0 2024-04-13T10:58:44.120 INFO:tasks.workunit.client.1.smithi194.stdout:4/669: mknod d2/d16/d1a/d60/cdf 0 2024-04-13T10:58:44.121 INFO:tasks.workunit.client.1.smithi194.stdout:4/670: write d2/d16/d1a/d1c/d3b/d8d/fd3 [410222,19941] 0 2024-04-13T10:58:44.122 INFO:tasks.workunit.client.1.smithi194.stdout:6/623: write d0/d2f/d6f/f89 [4967658,111910] 0 2024-04-13T10:58:44.123 INFO:tasks.workunit.client.1.smithi194.stdout:4/671: write d2/d30/f49 [3318270,114492] 0 2024-04-13T10:58:44.124 INFO:tasks.workunit.client.1.smithi194.stdout:8/803: creat d6/d2a/dce/dfb/f10e x:0 0 0 2024-04-13T10:58:44.127 INFO:tasks.workunit.client.1.smithi194.stdout:9/639: link d0/d6/d4a/d74/f7d d0/d6/d9/fdc 0 2024-04-13T10:58:44.128 INFO:tasks.workunit.client.1.smithi194.stdout:9/640: dread - d0/d6/d9/d9e/fcc zero size 2024-04-13T10:58:44.130 INFO:tasks.workunit.client.1.smithi194.stdout:8/804: creat d6/d22/d23/d7f/de2/f10f x:0 0 0 2024-04-13T10:58:44.131 INFO:tasks.workunit.client.1.smithi194.stdout:8/805: truncate d6/d22/d23/d3d/f40 1124227 0 2024-04-13T10:58:44.131 INFO:tasks.workunit.client.1.smithi194.stdout:4/672: symlink d2/d16/d1a/d1c/d54/d62/d6e/d99/le0 0 2024-04-13T10:58:44.135 INFO:tasks.workunit.client.1.smithi194.stdout:4/673: symlink d2/d16/d1a/d1c/le1 0 2024-04-13T10:58:44.137 INFO:tasks.workunit.client.1.smithi194.stdout:9/641: truncate d0/d6/d14/d26/d3b/f59 2953578 0 2024-04-13T10:58:44.140 INFO:tasks.workunit.client.1.smithi194.stdout:4/674: rename d2/d30/l38 to d2/d16/d1a/d1c/d3b/d42/le2 0 2024-04-13T10:58:44.141 INFO:tasks.workunit.client.1.smithi194.stdout:8/806: getdents d6/d22/d23/d7f 0 2024-04-13T10:58:44.142 INFO:tasks.workunit.client.1.smithi194.stdout:4/675: write d2/d16/d1a/d1c/d3b/d42/f52 [2296535,34914] 0 2024-04-13T10:58:44.142 INFO:tasks.workunit.client.1.smithi194.stdout:9/642: truncate d0/d11/d58/f5f 3517142 0 2024-04-13T10:58:44.143 INFO:tasks.workunit.client.1.smithi194.stdout:8/807: write d6/d22/d23/d25/d71/ff7 [1041619,18541] 0 2024-04-13T10:58:44.144 INFO:tasks.workunit.client.1.smithi194.stdout:4/676: write d2/d16/d1a/d1c/d54/d62/fa0 [105581,8798] 0 2024-04-13T10:58:44.149 INFO:tasks.workunit.client.1.smithi194.stdout:8/808: unlink d6/c10 0 2024-04-13T10:58:44.151 INFO:tasks.workunit.client.1.smithi194.stdout:9/643: rename d0/d11/d58/f5f to d0/d6/d14/fdd 0 2024-04-13T10:58:44.152 INFO:tasks.workunit.client.1.smithi194.stdout:4/677: creat d2/d16/d1a/d1c/d54/d62/d6e/d99/dd0/fe3 x:0 0 0 2024-04-13T10:58:44.152 INFO:tasks.workunit.client.1.smithi194.stdout:4/678: fsync d2/d30/d50/f5a 0 2024-04-13T10:58:44.153 INFO:tasks.workunit.client.1.smithi194.stdout:8/809: creat d6/d2a/d69/da3/dfd/f110 x:0 0 0 2024-04-13T10:58:44.154 INFO:tasks.workunit.client.1.smithi194.stdout:4/679: write d2/d16/d70/d31/f96 [171193,62274] 0 2024-04-13T10:58:44.154 INFO:tasks.workunit.client.1.smithi194.stdout:9/644: mkdir d0/dde 0 2024-04-13T10:58:44.155 INFO:tasks.workunit.client.1.smithi194.stdout:4/680: chown d2/d16/d1a/d1c/d54 176764 1 2024-04-13T10:58:44.157 INFO:tasks.workunit.client.1.smithi194.stdout:9/645: symlink d0/d6/d9/d9e/ldf 0 2024-04-13T10:58:44.160 INFO:tasks.workunit.client.1.smithi194.stdout:8/810: mkdir d6/dd/d45/de3/de9/df8/d111 0 2024-04-13T10:58:44.167 INFO:tasks.workunit.client.1.smithi194.stdout:4/681: link d2/d16/d1a/f43 d2/d16/d1a/d1c/d9a/fe4 0 2024-04-13T10:58:44.167 INFO:tasks.workunit.client.1.smithi194.stdout:9/646: getdents d0/d11/da3 0 2024-04-13T10:58:44.168 INFO:tasks.workunit.client.1.smithi194.stdout:9/647: chown d0/d6/d14/dcd/cd8 4172274 1 2024-04-13T10:58:44.169 INFO:tasks.workunit.client.1.smithi194.stdout:4/682: rmdir d2/d33 39 2024-04-13T10:58:44.169 INFO:tasks.workunit.client.1.smithi194.stdout:9/648: chown d0/d6/d14/d26/d7f/f8b 142 1 2024-04-13T10:58:44.169 INFO:tasks.workunit.client.1.smithi194.stdout:4/683: rmdir d2/d30 39 2024-04-13T10:58:44.170 INFO:tasks.workunit.client.1.smithi194.stdout:4/684: chown d2/d16/d1a/d1c/d54/cad 1953 1 2024-04-13T10:58:44.171 INFO:tasks.workunit.client.1.smithi194.stdout:9/649: chown d0/f20 90358 1 2024-04-13T10:58:44.172 INFO:tasks.workunit.client.1.smithi194.stdout:8/811: truncate d6/d22/d23/d7f/f91 3433753 0 2024-04-13T10:58:44.172 INFO:tasks.workunit.client.1.smithi194.stdout:8/812: fdatasync d6/f52 0 2024-04-13T10:58:44.173 INFO:tasks.workunit.client.1.smithi194.stdout:4/685: mkdir d2/d16/d1a/d1c/d54/d62/d6e/de5 0 2024-04-13T10:58:44.174 INFO:tasks.workunit.client.1.smithi194.stdout:8/813: mknod d6/dd/d45/de3/de9/c112 0 2024-04-13T10:58:44.175 INFO:tasks.workunit.client.1.smithi194.stdout:4/686: symlink d2/d16/d1a/d1c/d3e/d48/le6 0 2024-04-13T10:58:44.178 INFO:tasks.workunit.client.1.smithi194.stdout:4/687: getdents d2/d16/d70 0 2024-04-13T10:58:44.181 INFO:tasks.workunit.client.1.smithi194.stdout:8/814: dwrite d6/dd/f9f [0,4194304] 0 2024-04-13T10:58:44.182 INFO:tasks.workunit.client.1.smithi194.stdout:3/636: sync 2024-04-13T10:58:44.182 INFO:tasks.workunit.client.1.smithi194.stdout:1/613: sync 2024-04-13T10:58:44.182 INFO:tasks.workunit.client.1.smithi194.stdout:5/660: sync 2024-04-13T10:58:44.183 INFO:tasks.workunit.client.1.smithi194.stdout:4/688: mkdir d2/d16/d1a/d1c/d54/de7 0 2024-04-13T10:58:44.189 INFO:tasks.workunit.client.1.smithi194.stdout:1/614: truncate d12/d13/d1c/d28/d41/fc4 823564 0 2024-04-13T10:58:44.192 INFO:tasks.workunit.client.1.smithi194.stdout:4/689: mkdir d2/d16/d1a/d1c/d54/d62/d6e/d99/dd0/de8 0 2024-04-13T10:58:44.194 INFO:tasks.workunit.client.1.smithi194.stdout:9/650: dread d0/d11/d1e/f6c [0,4194304] 0 2024-04-13T10:58:44.195 INFO:tasks.workunit.client.1.smithi194.stdout:8/815: dwrite d6/d22/d23/d25/f36 [0,4194304] 0 2024-04-13T10:58:44.197 INFO:tasks.workunit.client.1.smithi194.stdout:1/615: write d12/d13/d1c/d27/f57 [4278761,103275] 0 2024-04-13T10:58:44.197 INFO:tasks.workunit.client.1.smithi194.stdout:4/690: chown d2/d33/fab 13 1 2024-04-13T10:58:44.199 INFO:tasks.workunit.client.1.smithi194.stdout:5/661: dwrite d3/dc/d10/d38/d59/d49/f88 [4194304,4194304] 0 2024-04-13T10:58:44.201 INFO:tasks.workunit.client.1.smithi194.stdout:9/651: dread - d0/d11/d3d/d4c/f81 zero size 2024-04-13T10:58:44.201 INFO:tasks.workunit.client.1.smithi194.stdout:3/637: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/f6e [0,4194304] 0 2024-04-13T10:58:44.203 INFO:tasks.workunit.client.1.smithi194.stdout:8/816: creat d6/d22/d23/d25/d71/da0/f113 x:0 0 0 2024-04-13T10:58:44.205 INFO:tasks.workunit.client.1.smithi194.stdout:5/662: dread - d3/dc/d17/f63 zero size 2024-04-13T10:58:44.210 INFO:tasks.workunit.client.1.smithi194.stdout:3/638: write d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d57/f73 [823845,129116] 0 2024-04-13T10:58:44.211 INFO:tasks.workunit.client.1.smithi194.stdout:4/691: rename d2/d16/d1a/d1c/d3b/d42/f7a to d2/d16/d1a/d1c/d3b/fe9 0 2024-04-13T10:58:44.214 INFO:tasks.workunit.client.1.smithi194.stdout:3/639: write d2/f5b [863290,52250] 0 2024-04-13T10:58:44.216 INFO:tasks.workunit.client.1.smithi194.stdout:8/817: rename d6/d2a/d69/dc4/fd1 to d6/d2a/d69/da2/f114 0 2024-04-13T10:58:44.216 INFO:tasks.workunit.client.1.smithi194.stdout:1/616: dread d12/d13/d1c/d28/f9f [0,4194304] 0 2024-04-13T10:58:44.219 INFO:tasks.workunit.client.1.smithi194.stdout:9/652: dwrite d0/d6/d2c/f92 [0,4194304] 0 2024-04-13T10:58:44.221 INFO:tasks.workunit.client.1.smithi194.stdout:5/663: rename d3/dc/d17/d1b/d6b/d99/fbe to d3/dc/d10/d38/d59/d49/dbf/fcd 0 2024-04-13T10:58:44.222 INFO:tasks.workunit.client.1.smithi194.stdout:1/617: write d12/d13/d1c/d27/d2e/fb8 [394292,69843] 0 2024-04-13T10:58:44.226 INFO:tasks.workunit.client.1.smithi194.stdout:4/692: rename d2/d16/d1a/d1c/d54/d62/f71 to d2/d16/dd2/fea 0 2024-04-13T10:58:44.228 INFO:tasks.workunit.client.1.smithi194.stdout:3/640: dwrite d2/d7d/f9f [0,4194304] 0 2024-04-13T10:58:44.228 INFO:tasks.workunit.client.1.smithi194.stdout:4/693: chown d2/d16/dd2 2 1 2024-04-13T10:58:44.228 INFO:tasks.workunit.client.1.smithi194.stdout:9/653: mkdir d0/d6/d14/dcd/da4/de0 0 2024-04-13T10:58:44.233 INFO:tasks.workunit.client.1.smithi194.stdout:5/664: mkdir d3/dc/d17/d1b/dce 0 2024-04-13T10:58:44.237 INFO:tasks.workunit.client.1.smithi194.stdout:8/818: rename d6/d22/d23/d3d/f65 to d6/d22/d23/d25/d71/da0/de5/dd0/f115 0 2024-04-13T10:58:44.238 INFO:tasks.workunit.client.1.smithi194.stdout:1/618: dwrite d12/d13/d1c/d27/f70 [0,4194304] 0 2024-04-13T10:58:44.242 INFO:tasks.workunit.client.1.smithi194.stdout:5/665: creat d3/fcf x:0 0 0 2024-04-13T10:58:44.243 INFO:tasks.workunit.client.1.smithi194.stdout:9/654: dwrite d0/d6/d14/dcd/fc6 [0,4194304] 0 2024-04-13T10:58:44.244 INFO:tasks.workunit.client.1.smithi194.stdout:5/666: fsync d3/dc/d2d/fab 0 2024-04-13T10:58:44.244 INFO:tasks.workunit.client.1.smithi194.stdout:3/641: truncate d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 251651 0 2024-04-13T10:58:44.249 INFO:tasks.workunit.client.1.smithi194.stdout:5/667: fdatasync d3/dc/d10/d38/d46/f80 0 2024-04-13T10:58:44.250 INFO:tasks.workunit.client.1.smithi194.stdout:4/694: write d2/d16/d1a/f2f [244854,73454] 0 2024-04-13T10:58:44.253 INFO:tasks.workunit.client.1.smithi194.stdout:5/668: chown d3/dc/d10/d38/d59 6727492 1 2024-04-13T10:58:44.253 INFO:tasks.workunit.client.1.smithi194.stdout:8/819: dwrite d6/d22/d23/d25/d39/f6b [0,4194304] 0 2024-04-13T10:58:44.253 INFO:tasks.workunit.client.1.smithi194.stdout:9/655: dread d0/d6/d14/d26/f3e [0,4194304] 0 2024-04-13T10:58:44.256 INFO:tasks.workunit.client.1.smithi194.stdout:1/619: link d12/d13/d1c/d28/d41/d50/d96/ca7 d12/d13/d1c/d27/d4c/d90/ccc 0 2024-04-13T10:58:44.259 INFO:tasks.workunit.client.1.smithi194.stdout:1/620: dread - d12/d13/d1c/d28/faf zero size 2024-04-13T10:58:44.262 INFO:tasks.workunit.client.1.smithi194.stdout:1/621: readlink d12/d13/d1c/l3f 0 2024-04-13T10:58:44.264 INFO:tasks.workunit.client.1.smithi194.stdout:3/642: rmdir d2/d3/d12/d31/d34/d88/d24/d3a/d56 39 2024-04-13T10:58:44.267 INFO:tasks.workunit.client.1.smithi194.stdout:9/656: dwrite d0/f20 [4194304,4194304] 0 2024-04-13T10:58:44.270 INFO:tasks.workunit.client.1.smithi194.stdout:5/669: dread d3/dc/d17/d1b/f47 [0,4194304] 0 2024-04-13T10:58:44.274 INFO:tasks.workunit.client.1.smithi194.stdout:4/695: dwrite d2/d30/d50/f5a [0,4194304] 0 2024-04-13T10:58:44.274 INFO:tasks.workunit.client.1.smithi194.stdout:8/820: dwrite d6/dd/f9f [0,4194304] 0 2024-04-13T10:58:44.279 INFO:tasks.workunit.client.1.smithi194.stdout:9/657: fdatasync d0/d6/d14/d26/d3b/faa 0 2024-04-13T10:58:44.280 INFO:tasks.workunit.client.1.smithi194.stdout:4/696: mkdir d2/d30/deb 0 2024-04-13T10:58:44.285 INFO:tasks.workunit.client.1.smithi194.stdout:1/622: dwrite d12/d3a/f6a [0,4194304] 0 2024-04-13T10:58:44.287 INFO:tasks.workunit.client.1.smithi194.stdout:3/643: mknod d2/d3/d12/d31/d34/d88/d24/cd1 0 2024-04-13T10:58:44.291 INFO:tasks.workunit.client.1.smithi194.stdout:3/644: chown d2/de/fb6 507819540 1 2024-04-13T10:58:44.291 INFO:tasks.workunit.client.1.smithi194.stdout:1/623: readlink d12/d13/d1c/d27/d4c/d7d/l7e 0 2024-04-13T10:58:44.292 INFO:tasks.workunit.client.1.smithi194.stdout:9/658: link d0/d11/d3d/f7e d0/d6/d14/d26/fe1 0 2024-04-13T10:58:44.293 INFO:tasks.workunit.client.1.smithi194.stdout:4/697: getdents d2/d16/d1a/d1c/d3e/dbb 0 2024-04-13T10:58:44.294 INFO:tasks.workunit.client.1.smithi194.stdout:5/670: dwrite d3/dc/d10/d20/f43 [0,4194304] 0 2024-04-13T10:58:44.295 INFO:tasks.workunit.client.1.smithi194.stdout:4/698: readlink d2/d16/d1a/d1c/d3b/l97 0 2024-04-13T10:58:44.297 INFO:tasks.workunit.client.1.smithi194.stdout:9/659: symlink d0/d88/le2 0 2024-04-13T10:58:44.298 INFO:tasks.workunit.client.1.smithi194.stdout:9/660: fsync d0/d6/d14/d26/d3b/faa 0 2024-04-13T10:58:44.299 INFO:tasks.workunit.client.1.smithi194.stdout:1/624: read d12/d13/d1c/f21 [2935136,61806] 0 2024-04-13T10:58:44.301 INFO:tasks.workunit.client.1.smithi194.stdout:4/699: getdents d2/d16/d1a/d1c/d54/d62/d6e/d99 0 2024-04-13T10:58:44.304 INFO:tasks.workunit.client.1.smithi194.stdout:9/661: write d0/d6/d9/d51/fda [2401788,118286] 0 2024-04-13T10:58:44.307 INFO:tasks.workunit.client.1.smithi194.stdout:1/625: getdents d12/d13/d1c/d28/d41/d50/d96 0 2024-04-13T10:58:44.308 INFO:tasks.workunit.client.1.smithi194.stdout:4/700: mknod d2/d16/d1a/d1c/d3b/d8d/cec 0 2024-04-13T10:58:44.309 INFO:tasks.workunit.client.1.smithi194.stdout:9/662: creat d0/d6/d9/d9e/fe3 x:0 0 0 2024-04-13T10:58:44.310 INFO:tasks.workunit.client.1.smithi194.stdout:3/645: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/fb8 [0,4194304] 0 2024-04-13T10:58:44.311 INFO:tasks.workunit.client.1.smithi194.stdout:1/626: chown d12/d13/d1c/d27/d5c/l9c 723206 1 2024-04-13T10:58:44.312 INFO:tasks.workunit.client.1.smithi194.stdout:4/701: write d2/d30/d50/f5a [3812749,75553] 0 2024-04-13T10:58:44.316 INFO:tasks.workunit.client.1.smithi194.stdout:1/627: mknod d12/d13/d1c/d28/d41/d50/d96/ccd 0 2024-04-13T10:58:44.317 INFO:tasks.workunit.client.1.smithi194.stdout:1/628: readlink d12/d13/d1c/d27/d4c/lb3 0 2024-04-13T10:58:44.317 INFO:tasks.workunit.client.1.smithi194.stdout:4/702: mknod d2/d16/d70/ced 0 2024-04-13T10:58:44.319 INFO:tasks.workunit.client.1.smithi194.stdout:7/717: sync 2024-04-13T10:58:44.319 INFO:tasks.workunit.client.1.smithi194.stdout:3/646: mkdir d2/d3/d12/d31/d34/d88/d24/dd2 0 2024-04-13T10:58:44.321 INFO:tasks.workunit.client.1.smithi194.stdout:9/663: dread d0/d6/d14/d26/d42/f6f [0,4194304] 0 2024-04-13T10:58:44.321 INFO:tasks.workunit.client.1.smithi194.stdout:1/629: rename d12/d13/d1c/d28/d41/c7b to d12/d13/d1c/d27/d5c/db6/cce 0 2024-04-13T10:58:44.322 INFO:tasks.workunit.client.1.smithi194.stdout:3/647: mknod d2/d3/db9/cd3 0 2024-04-13T10:58:44.323 INFO:tasks.workunit.client.1.smithi194.stdout:7/718: write d1/d2b/d3e/ddf/d5a/fd5 [598295,127674] 0 2024-04-13T10:58:44.323 INFO:tasks.workunit.client.1.smithi194.stdout:8/821: dread d6/dd/d45/de3/f84 [0,4194304] 0 2024-04-13T10:58:44.338 INFO:tasks.workunit.client.1.smithi194.stdout:4/703: rename d2/daf/dc4 to d2/d16/d1a/d1c/d3e/dbb/dee 0 2024-04-13T10:58:44.340 INFO:tasks.workunit.client.1.smithi194.stdout:1/630: creat d12/d13/d1c/d27/d4c/d90/fcf x:0 0 0 2024-04-13T10:58:44.340 INFO:tasks.workunit.client.1.smithi194.stdout:8/822: mkdir d6/d22/d23/d25/d78/d116 0 2024-04-13T10:58:44.341 INFO:tasks.workunit.client.1.smithi194.stdout:7/719: mknod d1/d2b/d4c/d4f/d85/dbc/ce7 0 2024-04-13T10:58:44.342 INFO:tasks.workunit.client.1.smithi194.stdout:9/664: rename d0/d11/d3d/l96 to d0/d11/d79/le4 0 2024-04-13T10:58:44.343 INFO:tasks.workunit.client.1.smithi194.stdout:8/823: chown d6/d22/d23/d25/d39/fe1 1 1 2024-04-13T10:58:44.343 INFO:tasks.workunit.client.1.smithi194.stdout:7/720: fsync d1/d2b/d4c/d4f/d51/d4d/fdc 0 2024-04-13T10:58:44.344 INFO:tasks.workunit.client.1.smithi194.stdout:9/665: dread - d0/d11/d3d/fc2 zero size 2024-04-13T10:58:44.346 INFO:tasks.workunit.client.1.smithi194.stdout:8/824: rmdir d6/d22/d23/d7f 39 2024-04-13T10:58:44.346 INFO:tasks.workunit.client.1.smithi194.stdout:9/666: chown d0/d88/fb0 0 1 2024-04-13T10:58:44.346 INFO:tasks.workunit.client.1.smithi194.stdout:7/721: creat d1/d2b/d4c/d4f/d6e/fe8 x:0 0 0 2024-04-13T10:58:44.348 INFO:tasks.workunit.client.1.smithi194.stdout:1/631: link d12/d3a/d4f/da3/daa/fc7 d12/d13/d1c/d27/d4c/d7f/fd0 0 2024-04-13T10:58:44.349 INFO:tasks.workunit.client.1.smithi194.stdout:4/704: dread d2/d16/d1a/d1c/d3b/d8d/fdb [0,4194304] 0 2024-04-13T10:58:44.349 INFO:tasks.workunit.client.1.smithi194.stdout:3/648: dread d2/f30 [0,4194304] 0 2024-04-13T10:58:44.350 INFO:tasks.workunit.client.1.smithi194.stdout:8/825: mknod d6/dd/d45/de3/de9/df8/c117 0 2024-04-13T10:58:44.351 INFO:tasks.workunit.client.1.smithi194.stdout:8/826: chown d6/fc9 2893 1 2024-04-13T10:58:44.351 INFO:tasks.workunit.client.1.smithi194.stdout:3/649: write d2/d3/f77 [5044606,80653] 0 2024-04-13T10:58:44.357 INFO:tasks.workunit.client.1.smithi194.stdout:3/650: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/ld4 0 2024-04-13T10:58:44.359 INFO:tasks.workunit.client.1.smithi194.stdout:7/722: rename d1/dd9/de1/dab/d96/ccc to d1/d2b/d2c/ce9 0 2024-04-13T10:58:44.360 INFO:tasks.workunit.client.1.smithi194.stdout:8/827: creat d6/dd/f118 x:0 0 0 2024-04-13T10:58:44.361 INFO:tasks.workunit.client.1.smithi194.stdout:1/632: rename d12/d13/d44/f5e to d12/d3a/dad/fd1 0 2024-04-13T10:58:44.362 INFO:tasks.workunit.client.1.smithi194.stdout:1/633: write d12/d13/d1c/f31 [4336042,30525] 0 2024-04-13T10:58:44.364 INFO:tasks.workunit.client.1.smithi194.stdout:1/634: symlink d12/d13/d44/ld2 0 2024-04-13T10:58:44.365 INFO:tasks.workunit.client.1.smithi194.stdout:1/635: symlink d12/d13/d44/ld3 0 2024-04-13T10:58:44.368 INFO:tasks.workunit.client.1.smithi194.stdout:1/636: mkdir d12/d13/d1c/d27/d4c/d7f/d8b/dd4 0 2024-04-13T10:58:44.369 INFO:tasks.workunit.client.1.smithi194.stdout:9/667: truncate d0/d11/d1e/f46 2149782 0 2024-04-13T10:58:44.370 INFO:tasks.workunit.client.1.smithi194.stdout:9/668: chown d0/l2d 5852 1 2024-04-13T10:58:44.370 INFO:tasks.workunit.client.1.smithi194.stdout:1/637: read d12/d13/d1c/d28/d41/f4a [856790,62272] 0 2024-04-13T10:58:44.370 INFO:tasks.workunit.client.1.smithi194.stdout:4/705: truncate d2/d33/fab 460918 0 2024-04-13T10:58:44.373 INFO:tasks.workunit.client.1.smithi194.stdout:4/706: symlink d2/d16/d1a/d1c/d54/lef 0 2024-04-13T10:58:44.374 INFO:tasks.workunit.client.1.smithi194.stdout:4/707: stat d2/d16/d1a/d1c/d54/lef 0 2024-04-13T10:58:44.376 INFO:tasks.workunit.client.1.smithi194.stdout:1/638: link d12/d13/d44/cc5 d12/d13/d1c/d27/d4c/d7f/cd5 0 2024-04-13T10:58:44.377 INFO:tasks.workunit.client.1.smithi194.stdout:9/669: dwrite d0/d11/d3d/f5d [0,4194304] 0 2024-04-13T10:58:44.377 INFO:tasks.workunit.client.1.smithi194.stdout:4/708: dread - d2/d16/d70/d31/fa3 zero size 2024-04-13T10:58:44.378 INFO:tasks.workunit.client.1.smithi194.stdout:9/670: readlink d0/d88/le2 0 2024-04-13T10:58:44.380 INFO:tasks.workunit.client.1.smithi194.stdout:1/639: mknod d12/d13/d1c/d28/d41/d77/d93/cd6 0 2024-04-13T10:58:44.382 INFO:tasks.workunit.client.1.smithi194.stdout:1/640: write d12/d3a/f9a [4218917,33808] 0 2024-04-13T10:58:44.382 INFO:tasks.workunit.client.1.smithi194.stdout:9/671: mkdir d0/d88/de5 0 2024-04-13T10:58:44.386 INFO:tasks.workunit.client.1.smithi194.stdout:1/641: write d12/d13/d1c/d28/d41/f51 [1129577,84435] 0 2024-04-13T10:58:44.386 INFO:tasks.workunit.client.1.smithi194.stdout:1/642: read - d12/d13/d3e/fa8 zero size 2024-04-13T10:58:44.387 INFO:tasks.workunit.client.1.smithi194.stdout:1/643: fsync d12/d13/d1c/d27/f70 0 2024-04-13T10:58:44.388 INFO:tasks.workunit.client.1.smithi194.stdout:9/672: creat d0/d6/d14/d6d/fe6 x:0 0 0 2024-04-13T10:58:44.393 INFO:tasks.workunit.client.1.smithi194.stdout:1/644: mkdir d12/d13/d1c/d27/d4c/dd7 0 2024-04-13T10:58:44.397 INFO:tasks.workunit.client.1.smithi194.stdout:4/709: dread d2/d16/d70/d31/fb8 [0,4194304] 0 2024-04-13T10:58:44.401 INFO:tasks.workunit.client.1.smithi194.stdout:1/645: truncate d12/d3a/f9a 2642547 0 2024-04-13T10:58:44.406 INFO:tasks.workunit.client.1.smithi194.stdout:4/710: dwrite d2/d16/d1a/d1c/d54/d62/f6c [0,4194304] 0 2024-04-13T10:58:44.407 INFO:tasks.workunit.client.1.smithi194.stdout:9/673: dread d0/d6/d2c/f69 [0,4194304] 0 2024-04-13T10:58:44.409 INFO:tasks.workunit.client.1.smithi194.stdout:9/674: write d0/d11/d3d/fb6 [718943,66173] 0 2024-04-13T10:58:44.411 INFO:tasks.workunit.client.1.smithi194.stdout:4/711: rename d2/d33 to d2/d16/d1a/d1c/d3e/dbb/dee/dd8/df0 0 2024-04-13T10:58:44.411 INFO:tasks.workunit.client.1.smithi194.stdout:9/675: write d0/d6/fc3 [611092,48578] 0 2024-04-13T10:58:44.415 INFO:tasks.workunit.client.1.smithi194.stdout:4/712: creat d2/d16/d1a/d1c/d54/d5d/d98/ff1 x:0 0 0 2024-04-13T10:58:44.416 INFO:tasks.workunit.client.1.smithi194.stdout:9/676: creat d0/fe7 x:0 0 0 2024-04-13T10:58:44.418 INFO:tasks.workunit.client.1.smithi194.stdout:4/713: creat d2/d16/d1a/d1c/d54/d62/d6e/d99/dd0/ff2 x:0 0 0 2024-04-13T10:58:44.418 INFO:tasks.workunit.client.1.smithi194.stdout:9/677: creat d0/d6/d14/d26/d3b/fe8 x:0 0 0 2024-04-13T10:58:44.419 INFO:tasks.workunit.client.1.smithi194.stdout:4/714: creat d2/daf/ff3 x:0 0 0 2024-04-13T10:58:44.422 INFO:tasks.workunit.client.1.smithi194.stdout:9/678: getdents d0/d88/dac 0 2024-04-13T10:58:44.424 INFO:tasks.workunit.client.1.smithi194.stdout:4/715: getdents d2/d16/d1a/d1c/d9a 0 2024-04-13T10:58:44.424 INFO:tasks.workunit.client.1.smithi194.stdout:9/679: truncate d0/d6/d9/d9e/fcc 529279 0 2024-04-13T10:58:44.424 INFO:tasks.workunit.client.1.smithi194.stdout:1/646: dread d12/d13/d44/fa1 [0,4194304] 0 2024-04-13T10:58:44.425 INFO:tasks.workunit.client.1.smithi194.stdout:1/647: write d12/d3a/d4f/f71 [901237,95189] 0 2024-04-13T10:58:44.428 INFO:tasks.workunit.client.1.smithi194.stdout:1/648: dread - d12/d13/d1c/d27/d2e/fc8 zero size 2024-04-13T10:58:44.429 INFO:tasks.workunit.client.1.smithi194.stdout:0/626: sync 2024-04-13T10:58:44.429 INFO:tasks.workunit.client.1.smithi194.stdout:6/624: sync 2024-04-13T10:58:44.429 INFO:tasks.workunit.client.1.smithi194.stdout:2/669: sync 2024-04-13T10:58:44.431 INFO:tasks.workunit.client.1.smithi194.stdout:4/716: dwrite d2/d16/d1a/d1c/d54/fb1 [0,4194304] 0 2024-04-13T10:58:44.433 INFO:tasks.workunit.client.1.smithi194.stdout:2/670: symlink d2/d3/de/d33/d47/ldf 0 2024-04-13T10:58:44.434 INFO:tasks.workunit.client.1.smithi194.stdout:0/627: mknod d9/df/d63/ccf 0 2024-04-13T10:58:44.436 INFO:tasks.workunit.client.1.smithi194.stdout:6/625: link d0/f18 d0/d2c/d77/d93/d98/fc9 0 2024-04-13T10:58:44.442 INFO:tasks.workunit.client.1.smithi194.stdout:1/649: dwrite d12/d13/d1c/d27/d4c/d90/fcf [0,4194304] 0 2024-04-13T10:58:44.442 INFO:tasks.workunit.client.1.smithi194.stdout:6/626: mknod d0/d42/d7b/cca 0 2024-04-13T10:58:44.445 INFO:tasks.workunit.client.1.smithi194.stdout:9/680: dwrite d0/d6/d2c/d68/f6a [0,4194304] 0 2024-04-13T10:58:44.446 INFO:tasks.workunit.client.1.smithi194.stdout:0/628: getdents d9/db1 0 2024-04-13T10:58:44.450 INFO:tasks.workunit.client.1.smithi194.stdout:6/627: write d0/d26/fb6 [494160,49132] 0 2024-04-13T10:58:44.454 INFO:tasks.workunit.client.1.smithi194.stdout:0/629: fdatasync d9/db1/d30/d73/d87/fb5 0 2024-04-13T10:58:44.455 INFO:tasks.workunit.client.1.smithi194.stdout:2/671: dwrite d2/d3/de/d17/d1e/d42/fc5 [0,4194304] 0 2024-04-13T10:58:44.460 INFO:tasks.workunit.client.1.smithi194.stdout:0/630: symlink d9/d2b/d5a/ld0 0 2024-04-13T10:58:44.463 INFO:tasks.workunit.client.1.smithi194.stdout:0/631: fsync d9/db1/d28/f48 0 2024-04-13T10:58:44.465 INFO:tasks.workunit.client.1.smithi194.stdout:2/672: getdents d2/d3/de/d17/d39/dcc 0 2024-04-13T10:58:44.466 INFO:tasks.workunit.client.1.smithi194.stdout:0/632: symlink d9/ld1 0 2024-04-13T10:58:44.467 INFO:tasks.workunit.client.1.smithi194.stdout:4/717: dread d2/d16/d1a/d1c/d54/f5f [0,4194304] 0 2024-04-13T10:58:44.468 INFO:tasks.workunit.client.1.smithi194.stdout:2/673: fdatasync d2/d3/de/d33/d47/fd0 0 2024-04-13T10:58:44.469 INFO:tasks.workunit.client.1.smithi194.stdout:0/633: mknod d9/d2b/d6c/db2/cd2 0 2024-04-13T10:58:44.472 INFO:tasks.workunit.client.1.smithi194.stdout:0/634: write d9/db1/d30/d73/d87/fb5 [110849,129213] 0 2024-04-13T10:58:44.473 INFO:tasks.workunit.client.1.smithi194.stdout:9/681: dwrite d0/d6/d2c/f56 [0,4194304] 0 2024-04-13T10:58:44.520 INFO:tasks.workunit.client.1.smithi194.stdout:5/671: sync 2024-04-13T10:58:44.537 INFO:tasks.workunit.client.1.smithi194.stdout:2/674: truncate d2/d3/de/d33/d47/dbb/f92 462843 0 2024-04-13T10:58:44.537 INFO:tasks.workunit.client.1.smithi194.stdout:4/718: dread d2/d16/d1a/d1c/d9a/fb7 [0,4194304] 0 2024-04-13T10:58:44.539 INFO:tasks.workunit.client.1.smithi194.stdout:2/675: chown d2/d3/d6d/f7c 7 1 2024-04-13T10:58:44.539 INFO:tasks.workunit.client.1.smithi194.stdout:4/719: chown d2/d16/dd2/fea 223466391 1 2024-04-13T10:58:44.541 INFO:tasks.workunit.client.1.smithi194.stdout:9/682: creat d0/d88/de5/fe9 x:0 0 0 2024-04-13T10:58:44.542 INFO:tasks.workunit.client.1.smithi194.stdout:4/720: dread - d2/d16/d1a/d1c/d54/d5d/d98/f95 zero size 2024-04-13T10:58:44.543 INFO:tasks.workunit.client.1.smithi194.stdout:0/635: getdents d9/db1/d28 0 2024-04-13T10:58:44.545 INFO:tasks.workunit.client.1.smithi194.stdout:0/636: stat d9/db1/d28/f2f 0 2024-04-13T10:58:44.546 INFO:tasks.workunit.client.1.smithi194.stdout:4/721: mknod d2/d16/dd2/cf4 0 2024-04-13T10:58:44.546 INFO:tasks.workunit.client.1.smithi194.stdout:6/628: dread d0/d42/dbe/f67 [0,4194304] 0 2024-04-13T10:58:44.549 INFO:tasks.workunit.client.1.smithi194.stdout:0/637: mkdir d9/df/d16/d75/dd3 0 2024-04-13T10:58:44.551 INFO:tasks.workunit.client.1.smithi194.stdout:2/676: dwrite d2/d3/de/d17/d1e/d42/fc5 [0,4194304] 0 2024-04-13T10:58:44.551 INFO:tasks.workunit.client.1.smithi194.stdout:9/683: link d0/d6/d9/d51/f94 d0/d6/d14/dcd/da4/de0/fea 0 2024-04-13T10:58:44.553 INFO:tasks.workunit.client.1.smithi194.stdout:5/672: dwrite d3/dc/d17/f1c [0,4194304] 0 2024-04-13T10:58:44.554 INFO:tasks.workunit.client.1.smithi194.stdout:0/638: chown d9/db1/d30/d73/fc2 83156369 1 2024-04-13T10:58:44.556 INFO:tasks.workunit.client.1.smithi194.stdout:5/673: chown d3/dc/faf 899108462 1 2024-04-13T10:58:44.556 INFO:tasks.workunit.client.1.smithi194.stdout:9/684: mkdir d0/d6/d4a/d74/dae/deb 0 2024-04-13T10:58:44.557 INFO:tasks.workunit.client.1.smithi194.stdout:5/674: fdatasync d3/d89/f97 0 2024-04-13T10:58:44.558 INFO:tasks.workunit.client.1.smithi194.stdout:2/677: rename d2/d3/d6d/lb0 to d2/d3/de/d33/d71/le0 0 2024-04-13T10:58:44.560 INFO:tasks.workunit.client.1.smithi194.stdout:4/722: rename d2/d16/d1a/d1c/d3e/dbb/dee/dd8/df0/fab to d2/d16/d1a/d1c/d3e/dbb/dee/dd8/df0/ff5 0 2024-04-13T10:58:44.563 INFO:tasks.workunit.client.1.smithi194.stdout:5/675: unlink d3/dc/d10/f58 0 2024-04-13T10:58:44.565 INFO:tasks.workunit.client.1.smithi194.stdout:4/723: dread d2/d16/d1a/d1c/d3b/d42/fa6 [0,4194304] 0 2024-04-13T10:58:44.566 INFO:tasks.workunit.client.1.smithi194.stdout:4/724: fsync d2/d30/d50/fac 0 2024-04-13T10:58:44.566 INFO:tasks.workunit.client.1.smithi194.stdout:9/685: rename d0/d11/d3d/f3f to d0/dde/fec 0 2024-04-13T10:58:44.567 INFO:tasks.workunit.client.1.smithi194.stdout:6/629: truncate d0/d2c/f6c 699403 0 2024-04-13T10:58:44.569 INFO:tasks.workunit.client.1.smithi194.stdout:4/725: write d2/d16/d1a/d60/fb3 [782132,115783] 0 2024-04-13T10:58:44.570 INFO:tasks.workunit.client.1.smithi194.stdout:9/686: truncate d0/d6/d2c/d68/f71 5118498 0 2024-04-13T10:58:44.570 INFO:tasks.workunit.client.1.smithi194.stdout:5/676: symlink d3/dc/d2d/ld0 0 2024-04-13T10:58:44.573 INFO:tasks.workunit.client.1.smithi194.stdout:0/639: link d9/db1/d30/c46 d9/df/d16/d83/dae/cd4 0 2024-04-13T10:58:44.573 INFO:tasks.workunit.client.1.smithi194.stdout:2/678: truncate d2/d3/de/d90/fb4 735213 0 2024-04-13T10:58:44.574 INFO:tasks.workunit.client.1.smithi194.stdout:4/726: rmdir d2/d16 39 2024-04-13T10:58:44.575 INFO:tasks.workunit.client.1.smithi194.stdout:4/727: write d2/d30/f49 [1415801,27941] 0 2024-04-13T10:58:44.575 INFO:tasks.workunit.client.1.smithi194.stdout:9/687: write d0/d6/d4a/f6e [1000594,891] 0 2024-04-13T10:58:44.582 INFO:tasks.workunit.client.1.smithi194.stdout:5/677: rename d3/dc/d10 to d3/dc/d2d/dd1 0 2024-04-13T10:58:44.584 INFO:tasks.workunit.client.1.smithi194.stdout:5/678: truncate d3/dc/d2d/dd1/fb6 331850 0 2024-04-13T10:58:44.586 INFO:tasks.workunit.client.1.smithi194.stdout:4/728: creat d2/d16/d1a/d1c/d54/d62/d9e/ff6 x:0 0 0 2024-04-13T10:58:44.589 INFO:tasks.workunit.client.1.smithi194.stdout:5/679: creat d3/dc/d17/d1b/d6b/d99/fd2 x:0 0 0 2024-04-13T10:58:44.589 INFO:tasks.workunit.client.1.smithi194.stdout:9/688: link d0/d6/d14/dcd/c8f d0/d6/d2c/db5/ced 0 2024-04-13T10:58:44.591 INFO:tasks.workunit.client.1.smithi194.stdout:4/729: rename d2/d16/d1a/d1c/d54/d5d/l81 to d2/d16/d1a/d1c/d54/d62/d6e/lf7 0 2024-04-13T10:58:44.591 INFO:tasks.workunit.client.1.smithi194.stdout:5/680: write d3/dc/f7d [246720,98669] 0 2024-04-13T10:58:44.593 INFO:tasks.workunit.client.1.smithi194.stdout:0/640: dread d9/df/d16/d65/f79 [0,4194304] 0 2024-04-13T10:58:44.594 INFO:tasks.workunit.client.1.smithi194.stdout:9/689: creat d0/d6/d14/d26/fee x:0 0 0 2024-04-13T10:58:44.596 INFO:tasks.workunit.client.1.smithi194.stdout:5/681: mknod d3/dc/d2d/dd1/cd3 0 2024-04-13T10:58:44.597 INFO:tasks.workunit.client.1.smithi194.stdout:0/641: dread - d9/db1/d28/f48 zero size 2024-04-13T10:58:44.597 INFO:tasks.workunit.client.1.smithi194.stdout:6/630: dwrite d0/d26/f15 [4194304,4194304] 0 2024-04-13T10:58:44.597 INFO:tasks.workunit.client.1.smithi194.stdout:4/730: write d2/d16/d1a/d1c/d3e/dbb/fbc [1084514,102150] 0 2024-04-13T10:58:44.598 INFO:tasks.workunit.client.1.smithi194.stdout:5/682: chown d3/d83/f8f 1087 1 2024-04-13T10:58:44.599 INFO:tasks.workunit.client.1.smithi194.stdout:0/642: readlink d9/la3 0 2024-04-13T10:58:44.599 INFO:tasks.workunit.client.1.smithi194.stdout:9/690: symlink d0/d11/d3d/d9b/lef 0 2024-04-13T10:58:44.602 INFO:tasks.workunit.client.1.smithi194.stdout:6/631: mkdir d0/d26/dcb 0 2024-04-13T10:58:44.603 INFO:tasks.workunit.client.1.smithi194.stdout:2/679: dwrite d2/d3/de/d17/d36/d8f/f1d [0,4194304] 0 2024-04-13T10:58:44.605 INFO:tasks.workunit.client.1.smithi194.stdout:5/683: write d3/dc/d2d/dd1/f3b [12652,69730] 0 2024-04-13T10:58:44.607 INFO:tasks.workunit.client.1.smithi194.stdout:6/632: write d0/d53/d78/d91/fa7 [279203,46780] 0 2024-04-13T10:58:44.607 INFO:tasks.workunit.client.1.smithi194.stdout:0/643: fsync d9/db/d3a/fca 0 2024-04-13T10:58:44.609 INFO:tasks.workunit.client.1.smithi194.stdout:0/644: write d9/db1/f90 [1440691,61578] 0 2024-04-13T10:58:44.609 INFO:tasks.workunit.client.1.smithi194.stdout:9/691: symlink d0/d6/lf0 0 2024-04-13T10:58:44.611 INFO:tasks.workunit.client.1.smithi194.stdout:9/692: fdatasync d0/d11/f41 0 2024-04-13T10:58:44.611 INFO:tasks.workunit.client.1.smithi194.stdout:5/684: readlink d3/dc/d2d/dd1/d20/l32 0 2024-04-13T10:58:44.616 INFO:tasks.workunit.client.1.smithi194.stdout:6/633: link d0/d2c/f41 d0/d53/d78/fcc 0 2024-04-13T10:58:44.617 INFO:tasks.workunit.client.1.smithi194.stdout:7/723: sync 2024-04-13T10:58:44.617 INFO:tasks.workunit.client.1.smithi194.stdout:3/651: sync 2024-04-13T10:58:44.618 INFO:tasks.workunit.client.1.smithi194.stdout:4/731: dread d2/d16/dd2/fea [0,4194304] 0 2024-04-13T10:58:44.618 INFO:tasks.workunit.client.1.smithi194.stdout:9/693: dread d0/d6/d14/d26/d3b/f63 [0,4194304] 0 2024-04-13T10:58:44.618 INFO:tasks.workunit.client.1.smithi194.stdout:6/634: chown d0/d42/d7b/cca 1 1 2024-04-13T10:58:44.622 INFO:tasks.workunit.client.1.smithi194.stdout:2/680: truncate d2/d3/de/f16 3563632 0 2024-04-13T10:58:44.622 INFO:tasks.workunit.client.1.smithi194.stdout:5/685: dwrite d3/dc/d17/d1b/f8a [0,4194304] 0 2024-04-13T10:58:44.622 INFO:tasks.workunit.client.1.smithi194.stdout:4/732: write d2/d16/d1a/f6f [3445149,124752] 0 2024-04-13T10:58:44.624 INFO:tasks.workunit.client.1.smithi194.stdout:9/694: rmdir d0/d6/d14/dcd 39 2024-04-13T10:58:44.624 INFO:tasks.workunit.client.1.smithi194.stdout:3/652: dread - d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/fbc zero size 2024-04-13T10:58:44.624 INFO:tasks.workunit.client.1.smithi194.stdout:7/724: creat d1/d2b/d2c/d30/d33/fea x:0 0 0 2024-04-13T10:58:44.629 INFO:tasks.workunit.client.1.smithi194.stdout:9/695: mkdir d0/d88/de5/df1 0 2024-04-13T10:58:44.632 INFO:tasks.workunit.client.1.smithi194.stdout:6/635: write d0/d57/f63 [518424,46894] 0 2024-04-13T10:58:44.634 INFO:tasks.workunit.client.1.smithi194.stdout:5/686: dwrite d3/d83/f8f [0,4194304] 0 2024-04-13T10:58:44.634 INFO:tasks.workunit.client.1.smithi194.stdout:7/725: symlink d1/dd9/de1/leb 0 2024-04-13T10:58:44.637 INFO:tasks.workunit.client.1.smithi194.stdout:2/681: creat d2/d3/fe1 x:0 0 0 2024-04-13T10:58:44.639 INFO:tasks.workunit.client.1.smithi194.stdout:6/636: symlink d0/d42/dbe/d4d/d80/lcd 0 2024-04-13T10:58:44.639 INFO:tasks.workunit.client.1.smithi194.stdout:4/733: creat d2/d16/d1a/d1c/d54/d62/ff8 x:0 0 0 2024-04-13T10:58:44.640 INFO:tasks.workunit.client.1.smithi194.stdout:9/696: getdents d0/d6/d2c/db5 0 2024-04-13T10:58:44.641 INFO:tasks.workunit.client.1.smithi194.stdout:0/645: dread d9/db/d3a/f58 [0,4194304] 0 2024-04-13T10:58:44.642 INFO:tasks.workunit.client.1.smithi194.stdout:3/653: rename d2/d3/db9/ccc to d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/cd5 0 2024-04-13T10:58:44.649 INFO:tasks.workunit.client.1.smithi194.stdout:4/734: creat d2/d16/d1a/d1c/d54/d5d/d98/d90/ff9 x:0 0 0 2024-04-13T10:58:44.655 INFO:tasks.workunit.client.1.smithi194.stdout:5/687: dwrite d3/dc/d17/d1b/d6b/fac [0,4194304] 0 2024-04-13T10:58:44.655 INFO:tasks.workunit.client.1.smithi194.stdout:7/726: truncate d1/f16 2670241 0 2024-04-13T10:58:44.655 INFO:tasks.workunit.client.1.smithi194.stdout:2/682: dwrite d2/d3/de/d17/d1e/d42/fc5 [0,4194304] 0 2024-04-13T10:58:44.658 INFO:tasks.workunit.client.1.smithi194.stdout:0/646: write d9/df/f3c [1111852,10987] 0 2024-04-13T10:58:44.660 INFO:tasks.workunit.client.1.smithi194.stdout:4/735: creat d2/d16/dd2/ffa x:0 0 0 2024-04-13T10:58:44.662 INFO:tasks.workunit.client.1.smithi194.stdout:6/637: dwrite d0/d26/d4b/f9b [0,4194304] 0 2024-04-13T10:58:44.662 INFO:tasks.workunit.client.1.smithi194.stdout:9/697: dwrite d0/d88/de5/fe9 [0,4194304] 0 2024-04-13T10:58:44.663 INFO:tasks.workunit.client.1.smithi194.stdout:5/688: chown d3/dc/d2d/dd1/l7e 1147 1 2024-04-13T10:58:44.664 INFO:tasks.workunit.client.1.smithi194.stdout:2/683: chown d2/d3/de/d17/d39/dcc 8150 1 2024-04-13T10:58:44.666 INFO:tasks.workunit.client.1.smithi194.stdout:0/647: write d9/d2b/d6c/fce [107952,66171] 0 2024-04-13T10:58:44.668 INFO:tasks.workunit.client.1.smithi194.stdout:5/689: readlink d3/dc/d2d/dd1/l7e 0 2024-04-13T10:58:44.669 INFO:tasks.workunit.client.1.smithi194.stdout:3/654: rename d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/fae to d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/fd6 0 2024-04-13T10:58:44.672 INFO:tasks.workunit.client.1.smithi194.stdout:2/684: creat d2/d3/d6d/fe2 x:0 0 0 2024-04-13T10:58:44.673 INFO:tasks.workunit.client.1.smithi194.stdout:0/648: creat d9/d2b/d6c/db2/fd5 x:0 0 0 2024-04-13T10:58:44.674 INFO:tasks.workunit.client.1.smithi194.stdout:4/736: mknod d2/d16/d70/d31/d44/dcc/cfb 0 2024-04-13T10:58:44.674 INFO:tasks.workunit.client.1.smithi194.stdout:3/655: read d2/d3/f77 [1675401,18895] 0 2024-04-13T10:58:44.675 INFO:tasks.workunit.client.1.smithi194.stdout:9/698: creat d0/d6/d14/ff2 x:0 0 0 2024-04-13T10:58:44.678 INFO:tasks.workunit.client.1.smithi194.stdout:7/727: dwrite d1/d2b/d4c/d4f/f5c [0,4194304] 0 2024-04-13T10:58:44.678 INFO:tasks.workunit.client.1.smithi194.stdout:3/656: chown d2/de/c4d 541 1 2024-04-13T10:58:44.679 INFO:tasks.workunit.client.1.smithi194.stdout:9/699: read d0/d88/de5/fe9 [2150709,26844] 0 2024-04-13T10:58:44.679 INFO:tasks.workunit.client.1.smithi194.stdout:0/649: chown d9/df/d16/d77/c8c 848 1 2024-04-13T10:58:44.681 INFO:tasks.workunit.client.1.smithi194.stdout:2/685: truncate d2/d3/de/d33/d47/dbb/fca 9633721 0 2024-04-13T10:58:44.682 INFO:tasks.workunit.client.1.smithi194.stdout:4/737: write d2/d16/d1a/d1c/d3b/d8d/fd3 [348537,101689] 0 2024-04-13T10:58:44.683 INFO:tasks.workunit.client.1.smithi194.stdout:0/650: write d9/db1/d28/f53 [5733826,62878] 0 2024-04-13T10:58:44.684 INFO:tasks.workunit.client.1.smithi194.stdout:9/700: mknod d0/d11/d1e/cf3 0 2024-04-13T10:58:44.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:44 smithi134 ceph-mon[39696]: pgmap v26: 65 pgs: 65 active+clean; 1.5 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 62 MiB/s rd, 218 MiB/s wr, 436 op/s 2024-04-13T10:58:44.686 INFO:tasks.workunit.client.1.smithi194.stdout:9/701: write d0/d11/d3d/fb6 [1593210,15057] 0 2024-04-13T10:58:44.686 INFO:tasks.workunit.client.1.smithi194.stdout:7/728: creat d1/dd9/de1/dab/d96/fec x:0 0 0 2024-04-13T10:58:44.687 INFO:tasks.workunit.client.1.smithi194.stdout:2/686: mkdir d2/d3/de/d17/d36/d8f/de3 0 2024-04-13T10:58:44.689 INFO:tasks.workunit.client.1.smithi194.stdout:7/729: dread - d1/d2b/d4c/d4f/d85/d88/d9b/db8/fe3 zero size 2024-04-13T10:58:44.690 INFO:tasks.workunit.client.1.smithi194.stdout:9/702: truncate d0/d6/d14/d26/d42/f6f 1201658 0 2024-04-13T10:58:44.690 INFO:tasks.workunit.client.1.smithi194.stdout:3/657: rename d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d57 to d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dd7 0 2024-04-13T10:58:44.691 INFO:tasks.workunit.client.1.smithi194.stdout:9/703: chown d0/d6 0 1 2024-04-13T10:58:44.691 INFO:tasks.workunit.client.1.smithi194.stdout:2/687: chown d2/d3/c20 969 1 2024-04-13T10:58:44.693 INFO:tasks.workunit.client.1.smithi194.stdout:7/730: mknod d1/d2b/d4c/d4f/d85/d88/ced 0 2024-04-13T10:58:44.694 INFO:tasks.workunit.client.1.smithi194.stdout:9/704: chown d0/d6/d9/d51/la0 79 1 2024-04-13T10:58:44.694 INFO:tasks.workunit.client.1.smithi194.stdout:1/650: sync 2024-04-13T10:58:44.694 INFO:tasks.workunit.client.1.smithi194.stdout:8/828: sync 2024-04-13T10:58:44.696 INFO:tasks.workunit.client.1.smithi194.stdout:7/731: chown d1/d2b/d4c/d4f/d85/d88 13 1 2024-04-13T10:58:44.696 INFO:tasks.workunit.client.1.smithi194.stdout:3/658: creat d2/d3/d12/d31/d34/d88/d24/d3a/d72/fd8 x:0 0 0 2024-04-13T10:58:44.696 INFO:tasks.workunit.client.1.smithi194.stdout:0/651: fsync d9/d2b/f3e 0 2024-04-13T10:58:44.697 INFO:tasks.workunit.client.1.smithi194.stdout:2/688: symlink d2/d3/de/d17/d1e/d42/d86/le4 0 2024-04-13T10:58:44.699 INFO:tasks.workunit.client.1.smithi194.stdout:2/689: dread - d2/d3/de/d33/d47/dbb/fa8 zero size 2024-04-13T10:58:44.699 INFO:tasks.workunit.client.1.smithi194.stdout:9/705: symlink d0/d6/d14/d26/d7f/lf4 0 2024-04-13T10:58:44.700 INFO:tasks.workunit.client.1.smithi194.stdout:1/651: mknod d12/d13/d1c/d27/d4c/d7d/cd8 0 2024-04-13T10:58:44.702 INFO:tasks.workunit.client.1.smithi194.stdout:8/829: rmdir d6/d22/d23/d7f/de2 39 2024-04-13T10:58:44.703 INFO:tasks.workunit.client.1.smithi194.stdout:5/690: dread d3/dc/d2d/f36 [0,4194304] 0 2024-04-13T10:58:44.703 INFO:tasks.workunit.client.1.smithi194.stdout:8/830: dread - d6/d22/d23/d25/d71/da0/ff3 zero size 2024-04-13T10:58:44.703 INFO:tasks.workunit.client.1.smithi194.stdout:7/732: symlink d1/lee 0 2024-04-13T10:58:44.704 INFO:tasks.workunit.client.1.smithi194.stdout:7/733: stat d1/d6c 0 2024-04-13T10:58:44.704 INFO:tasks.workunit.client.1.smithi194.stdout:3/659: read - d2/d3/d12/d31/d34/d88/d24/f8a zero size 2024-04-13T10:58:44.705 INFO:tasks.workunit.client.1.smithi194.stdout:2/690: creat d2/d3/de/d33/d71/fe5 x:0 0 0 2024-04-13T10:58:44.707 INFO:tasks.workunit.client.1.smithi194.stdout:5/691: mkdir d3/dc/d2d/dd1/d20/daa/dae/dd4 0 2024-04-13T10:58:44.707 INFO:tasks.workunit.client.1.smithi194.stdout:3/660: write d2/d3/d12/d31/d34/d88/fad [824508,116153] 0 2024-04-13T10:58:44.708 INFO:tasks.workunit.client.1.smithi194.stdout:7/734: mkdir d1/d2b/d3e/ddf/d5a/d3c/def 0 2024-04-13T10:58:44.709 INFO:tasks.workunit.client.1.smithi194.stdout:3/661: read d2/d3/d12/d31/d34/f37 [2455569,105949] 0 2024-04-13T10:58:44.710 INFO:tasks.workunit.client.1.smithi194.stdout:1/652: creat d12/d13/d1c/fd9 x:0 0 0 2024-04-13T10:58:44.712 INFO:tasks.workunit.client.1.smithi194.stdout:5/692: fsync d3/dc/d2d/dd1/d20/f62 0 2024-04-13T10:58:44.714 INFO:tasks.workunit.client.1.smithi194.stdout:7/735: dread d1/d2b/d4c/d4f/f64 [0,4194304] 0 2024-04-13T10:58:44.714 INFO:tasks.workunit.client.1.smithi194.stdout:1/653: write d12/d3a/dad/fd1 [200003,27151] 0 2024-04-13T10:58:44.717 INFO:tasks.workunit.client.1.smithi194.stdout:2/691: dread d2/d3/f73 [0,4194304] 0 2024-04-13T10:58:44.724 INFO:tasks.workunit.client.1.smithi194.stdout:3/662: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/fbe [0,4194304] 0 2024-04-13T10:58:44.724 INFO:tasks.workunit.client.1.smithi194.stdout:2/692: getdents d2/d3/de/d17/d36/d8f/de3 0 2024-04-13T10:58:44.725 INFO:tasks.workunit.client.1.smithi194.stdout:7/736: dread d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f71 [0,4194304] 0 2024-04-13T10:58:44.726 INFO:tasks.workunit.client.1.smithi194.stdout:5/693: dwrite d3/dc/d2d/dd1/d38/f96 [8388608,4194304] 0 2024-04-13T10:58:44.729 INFO:tasks.workunit.client.1.smithi194.stdout:1/654: dread d12/d13/d1c/d27/d4c/d90/fcf [0,4194304] 0 2024-04-13T10:58:44.729 INFO:tasks.workunit.client.1.smithi194.stdout:5/694: chown d3/d83/fbb 127409 1 2024-04-13T10:58:44.731 INFO:tasks.workunit.client.1.smithi194.stdout:2/693: creat d2/d3/de/d17/d36/d3d/fe6 x:0 0 0 2024-04-13T10:58:44.734 INFO:tasks.workunit.client.1.smithi194.stdout:7/737: rename d1/d2b/d2c/f8a to d1/dd9/de1/dab/ff0 0 2024-04-13T10:58:44.734 INFO:tasks.workunit.client.1.smithi194.stdout:2/694: read - d2/d3/de/d17/d36/d7a/faa zero size 2024-04-13T10:58:44.735 INFO:tasks.workunit.client.1.smithi194.stdout:7/738: write d1/d2b/f47 [1348881,114537] 0 2024-04-13T10:58:44.736 INFO:tasks.workunit.client.1.smithi194.stdout:3/663: link d2/d3/d12/d31/f52 d2/d3/d12/d31/d34/d88/d24/d6c/fd9 0 2024-04-13T10:58:44.737 INFO:tasks.workunit.client.1.smithi194.stdout:1/655: truncate d12/d13/d1c/d28/d41/d77/d80/f8a 956294 0 2024-04-13T10:58:44.737 INFO:tasks.workunit.client.1.smithi194.stdout:3/664: readlink d2/d3/l3b 0 2024-04-13T10:58:44.738 INFO:tasks.workunit.client.1.smithi194.stdout:2/695: mknod d2/d3/de/d17/d39/ce7 0 2024-04-13T10:58:44.739 INFO:tasks.workunit.client.1.smithi194.stdout:7/739: truncate d1/d2b/d2c/d30/fe2 262947 0 2024-04-13T10:58:44.740 INFO:tasks.workunit.client.1.smithi194.stdout:1/656: mknod d12/d13/d1c/d27/d4c/d90/cda 0 2024-04-13T10:58:44.742 INFO:tasks.workunit.client.1.smithi194.stdout:1/657: truncate d12/d13/d1c/d7c/fca 99937 0 2024-04-13T10:58:44.743 INFO:tasks.workunit.client.1.smithi194.stdout:7/740: unlink d1/d2b/d3e/f84 0 2024-04-13T10:58:44.744 INFO:tasks.workunit.client.1.smithi194.stdout:3/665: mknod d2/d3/d12/d31/d34/d88/d24/d3a/cda 0 2024-04-13T10:58:44.746 INFO:tasks.workunit.client.1.smithi194.stdout:7/741: rmdir d1/d2b/d4c/d4f/d85 39 2024-04-13T10:58:44.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:44 smithi194 ceph-mon[46737]: pgmap v26: 65 pgs: 65 active+clean; 1.5 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 62 MiB/s rd, 218 MiB/s wr, 436 op/s 2024-04-13T10:58:44.749 INFO:tasks.workunit.client.1.smithi194.stdout:1/658: link d12/d13/d44/f99 d12/d13/d1c/d27/d5c/db6/fdb 0 2024-04-13T10:58:44.752 INFO:tasks.workunit.client.1.smithi194.stdout:3/666: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/fc0 [0,4194304] 0 2024-04-13T10:58:44.753 INFO:tasks.workunit.client.1.smithi194.stdout:5/695: dread d3/dc/d2d/f84 [0,4194304] 0 2024-04-13T10:58:44.755 INFO:tasks.workunit.client.1.smithi194.stdout:3/667: symlink d2/de/ldb 0 2024-04-13T10:58:44.756 INFO:tasks.workunit.client.1.smithi194.stdout:5/696: write d3/dc/d2d/dd1/d38/f60 [8854988,29419] 0 2024-04-13T10:58:44.762 INFO:tasks.workunit.client.1.smithi194.stdout:5/697: rename d3/c5e to d3/dc/d17/d93/cd5 0 2024-04-13T10:58:44.764 INFO:tasks.workunit.client.1.smithi194.stdout:5/698: write d3/dc/d2d/dd1/d38/f4d [7636088,116605] 0 2024-04-13T10:58:44.764 INFO:tasks.workunit.client.1.smithi194.stdout:7/742: dread d1/d2b/d3e/ddf/d5a/d3c/f65 [0,4194304] 0 2024-04-13T10:58:44.771 INFO:tasks.workunit.client.1.smithi194.stdout:7/743: link d1/d2b/d3e/ddf/fcf d1/dd9/de1/dab/ff1 0 2024-04-13T10:58:44.773 INFO:tasks.workunit.client.1.smithi194.stdout:7/744: fsync d1/d2b/d4c/d4f/d85/d88/d9b/db8/fe3 0 2024-04-13T10:58:44.781 INFO:tasks.workunit.client.1.smithi194.stdout:6/638: sync 2024-04-13T10:58:44.795 INFO:tasks.workunit.client.1.smithi194.stdout:6/639: creat d0/d42/dbe/fce x:0 0 0 2024-04-13T10:58:44.796 INFO:tasks.workunit.client.1.smithi194.stdout:7/745: write d1/dd9/de1/dab/d96/fa1 [852889,100457] 0 2024-04-13T10:58:44.796 INFO:tasks.workunit.client.1.smithi194.stdout:2/696: dread d2/d3/de/d17/d36/d7a/f7d [0,4194304] 0 2024-04-13T10:58:44.798 INFO:tasks.workunit.client.1.smithi194.stdout:6/640: mknod d0/d53/d78/d91/ccf 0 2024-04-13T10:58:44.799 INFO:tasks.workunit.client.1.smithi194.stdout:1/659: dread d12/d13/d1c/f72 [0,4194304] 0 2024-04-13T10:58:44.800 INFO:tasks.workunit.client.1.smithi194.stdout:2/697: dread d2/d3/de/d33/d47/dbb/f92 [0,4194304] 0 2024-04-13T10:58:44.800 INFO:tasks.workunit.client.1.smithi194.stdout:2/698: chown d2/d3/de 0 1 2024-04-13T10:58:44.801 INFO:tasks.workunit.client.1.smithi194.stdout:6/641: mkdir d0/d26/d4b/dd0 0 2024-04-13T10:58:44.803 INFO:tasks.workunit.client.1.smithi194.stdout:2/699: chown d2/d3/de/d3c/c83 578504292 1 2024-04-13T10:58:44.805 INFO:tasks.workunit.client.1.smithi194.stdout:5/699: dread d3/dc/d2d/dd1/d38/f51 [0,4194304] 0 2024-04-13T10:58:44.808 INFO:tasks.workunit.client.1.smithi194.stdout:7/746: rename d1/d2b/d3e/ddf/d5a/f49 to d1/dd9/de1/dab/d96/ff2 0 2024-04-13T10:58:44.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/700: unlink d3/d29/cc6 0 2024-04-13T10:58:44.815 INFO:tasks.workunit.client.1.smithi194.stdout:7/747: rename d1/d2b/d4c/d4f/d6e/fe8 to d1/d2b/d4c/d4f/d85/d88/ff3 0 2024-04-13T10:58:44.815 INFO:tasks.workunit.client.1.smithi194.stdout:6/642: dread d0/d2c/f41 [0,4194304] 0 2024-04-13T10:58:44.816 INFO:tasks.workunit.client.1.smithi194.stdout:5/701: read d3/dc/d2d/dd1/d38/d59/f54 [3370942,50444] 0 2024-04-13T10:58:44.817 INFO:tasks.workunit.client.1.smithi194.stdout:2/700: write d2/d3/de/d17/d1e/d42/fc6 [2438753,1667] 0 2024-04-13T10:58:44.818 INFO:tasks.workunit.client.1.smithi194.stdout:7/748: readlink d1/d2b/d3e/ddf/d5a/d7d/lc0 0 2024-04-13T10:58:44.820 INFO:tasks.workunit.client.1.smithi194.stdout:5/702: creat d3/dc/d2d/dd1/d20/daa/dae/dd4/fd6 x:0 0 0 2024-04-13T10:58:44.821 INFO:tasks.workunit.client.1.smithi194.stdout:7/749: unlink d1/d2b/d3e/ddf/d6b/ca4 0 2024-04-13T10:58:44.822 INFO:tasks.workunit.client.1.smithi194.stdout:2/701: creat d2/d3/de/d17/d36/d3d/fe8 x:0 0 0 2024-04-13T10:58:44.822 INFO:tasks.workunit.client.1.smithi194.stdout:5/703: symlink d3/dc/d2d/dd1/d20/daa/ld7 0 2024-04-13T10:58:44.823 INFO:tasks.workunit.client.1.smithi194.stdout:5/704: chown d3/dc/d2d/dd1/f4c 742482914 1 2024-04-13T10:58:44.824 INFO:tasks.workunit.client.1.smithi194.stdout:7/750: creat d1/d2b/d3e/ddf/ff4 x:0 0 0 2024-04-13T10:58:44.824 INFO:tasks.workunit.client.1.smithi194.stdout:6/643: dread d0/d42/dbe/f3c [0,4194304] 0 2024-04-13T10:58:44.825 INFO:tasks.workunit.client.1.smithi194.stdout:2/702: rmdir d2/d3/d12/dba/dd4 0 2024-04-13T10:58:44.826 INFO:tasks.workunit.client.1.smithi194.stdout:7/751: write d1/d2b/d4c/d4f/d51/d4d/d5e/fd6 [885671,6164] 0 2024-04-13T10:58:44.827 INFO:tasks.workunit.client.1.smithi194.stdout:5/705: creat d3/fd8 x:0 0 0 2024-04-13T10:58:44.829 INFO:tasks.workunit.client.1.smithi194.stdout:7/752: read d1/d2b/d4c/d4f/d6e/f87 [238710,7951] 0 2024-04-13T10:58:44.829 INFO:tasks.workunit.client.1.smithi194.stdout:2/703: creat d2/d3/de/d90/fe9 x:0 0 0 2024-04-13T10:58:44.832 INFO:tasks.workunit.client.1.smithi194.stdout:5/706: creat d3/dc/d2d/dd1/d20/daa/dae/fd9 x:0 0 0 2024-04-13T10:58:44.833 INFO:tasks.workunit.client.1.smithi194.stdout:2/704: unlink d2/d3/d12/f1b 0 2024-04-13T10:58:44.833 INFO:tasks.workunit.client.1.smithi194.stdout:6/644: dwrite d0/d2c/f41 [4194304,4194304] 0 2024-04-13T10:58:44.836 INFO:tasks.workunit.client.1.smithi194.stdout:5/707: symlink d3/dc/d17/d1b/dce/lda 0 2024-04-13T10:58:44.839 INFO:tasks.workunit.client.1.smithi194.stdout:7/753: dwrite d1/d2b/d4c/d4f/fbe [0,4194304] 0 2024-04-13T10:58:44.839 INFO:tasks.workunit.client.1.smithi194.stdout:5/708: dread - d3/dc/d2d/dd1/d38/d59/d49/dbf/fcd zero size 2024-04-13T10:58:44.841 INFO:tasks.workunit.client.1.smithi194.stdout:7/754: write d1/d2b/d4c/d4f/f5c [1637311,56836] 0 2024-04-13T10:58:44.843 INFO:tasks.workunit.client.1.smithi194.stdout:2/705: creat d2/d3/de/fea x:0 0 0 2024-04-13T10:58:44.845 INFO:tasks.workunit.client.1.smithi194.stdout:7/755: fsync d1/dd9/de1/dab/d96/fa3 0 2024-04-13T10:58:44.847 INFO:tasks.workunit.client.1.smithi194.stdout:6/645: dread d0/d42/dbe/f47 [0,4194304] 0 2024-04-13T10:58:44.850 INFO:tasks.workunit.client.1.smithi194.stdout:5/709: link d3/dc/d17/d1b/d6b/d99/fd2 d3/dc/d17/d1b/d6b/d99/fdb 0 2024-04-13T10:58:44.850 INFO:tasks.workunit.client.1.smithi194.stdout:2/706: dwrite d2/d3/de/d33/d47/dbb/fca [0,4194304] 0 2024-04-13T10:58:44.851 INFO:tasks.workunit.client.1.smithi194.stdout:5/710: read - d3/dc/faf zero size 2024-04-13T10:58:44.852 INFO:tasks.workunit.client.1.smithi194.stdout:5/711: stat d3/dc/d2d/dd1/d20/daa/ld7 0 2024-04-13T10:58:44.855 INFO:tasks.workunit.client.1.smithi194.stdout:5/712: mkdir d3/dc/ddc 0 2024-04-13T10:58:44.856 INFO:tasks.workunit.client.1.smithi194.stdout:2/707: getdents d2/d3 0 2024-04-13T10:58:44.859 INFO:tasks.workunit.client.1.smithi194.stdout:7/756: fsync d1/d2b/d4c/d4f/fbe 0 2024-04-13T10:58:44.861 INFO:tasks.workunit.client.1.smithi194.stdout:5/713: dwrite d3/dc/d2d/dd1/d38/d59/d49/f88 [4194304,4194304] 0 2024-04-13T10:58:44.864 INFO:tasks.workunit.client.1.smithi194.stdout:5/714: stat d3/dc/d2d/dd1/d38/d59/d49/da4/la9 0 2024-04-13T10:58:44.932 INFO:tasks.workunit.client.1.smithi194.stdout:0/652: sync 2024-04-13T10:58:44.932 INFO:tasks.workunit.client.1.smithi194.stdout:4/738: sync 2024-04-13T10:58:44.945 INFO:tasks.workunit.client.1.smithi194.stdout:7/757: getdents d1/d2b/d4c/d4f/d6e 0 2024-04-13T10:58:44.946 INFO:tasks.workunit.client.1.smithi194.stdout:0/653: chown d9/d2b/f3e 9142 1 2024-04-13T10:58:44.947 INFO:tasks.workunit.client.1.smithi194.stdout:4/739: mkdir d2/d16/d1a/d1c/d54/d5d/db2/dfc 0 2024-04-13T10:58:44.948 INFO:tasks.workunit.client.1.smithi194.stdout:4/740: fsync d2/d16/d1a/d1c/d54/d62/f6c 0 2024-04-13T10:58:44.950 INFO:tasks.workunit.client.1.smithi194.stdout:0/654: creat d9/df/d16/d70/fd6 x:0 0 0 2024-04-13T10:58:44.950 INFO:tasks.workunit.client.1.smithi194.stdout:0/655: chown d9/c4d 12975401 1 2024-04-13T10:58:44.952 INFO:tasks.workunit.client.1.smithi194.stdout:7/758: write d1/d2b/d4c/d4f/d6e/f87 [627796,92760] 0 2024-04-13T10:58:44.954 INFO:tasks.workunit.client.1.smithi194.stdout:2/708: dread d2/d3/de/d33/d47/dbb/f5e [0,4194304] 0 2024-04-13T10:58:44.955 INFO:tasks.workunit.client.1.smithi194.stdout:5/715: dread d3/dc/d2d/dd1/f61 [0,4194304] 0 2024-04-13T10:58:44.955 INFO:tasks.workunit.client.1.smithi194.stdout:0/656: rename d9/db1/d28 to d9/db/d3a/d9a/dd7 0 2024-04-13T10:58:44.955 INFO:tasks.workunit.client.1.smithi194.stdout:2/709: fdatasync d2/d37/f5f 0 2024-04-13T10:58:44.956 INFO:tasks.workunit.client.1.smithi194.stdout:7/759: symlink d1/d2b/d3e/ddf/dd7/lf5 0 2024-04-13T10:58:44.957 INFO:tasks.workunit.client.1.smithi194.stdout:7/760: dread - d1/dd9/de1/dab/ff1 zero size 2024-04-13T10:58:44.958 INFO:tasks.workunit.client.1.smithi194.stdout:5/716: truncate d3/dc/d2d/dd1/fb6 736625 0 2024-04-13T10:58:44.959 INFO:tasks.workunit.client.1.smithi194.stdout:5/717: chown d3/dc/d2d/dd1/fbd 9023447 1 2024-04-13T10:58:44.959 INFO:tasks.workunit.client.1.smithi194.stdout:2/710: mknod d2/d37/ceb 0 2024-04-13T10:58:44.961 INFO:tasks.workunit.client.1.smithi194.stdout:5/718: dread - d3/fd8 zero size 2024-04-13T10:58:44.962 INFO:tasks.workunit.client.1.smithi194.stdout:0/657: mknod d9/df/cd8 0 2024-04-13T10:58:44.963 INFO:tasks.workunit.client.1.smithi194.stdout:7/761: write d1/d2b/d3e/ddf/d5a/d3c/f65 [1356521,31862] 0 2024-04-13T10:58:44.965 INFO:tasks.workunit.client.1.smithi194.stdout:7/762: read d1/d2b/d3e/ddf/d5a/f78 [4994569,90524] 0 2024-04-13T10:58:44.966 INFO:tasks.workunit.client.1.smithi194.stdout:5/719: rename d3/dc/d17/d1b/d6b/fac to d3/dc/d2d/dd1/db5/fdd 0 2024-04-13T10:58:44.968 INFO:tasks.workunit.client.1.smithi194.stdout:0/658: read d9/df/d16/d83/f86 [38950,108344] 0 2024-04-13T10:58:44.968 INFO:tasks.workunit.client.1.smithi194.stdout:4/741: dread d2/d16/d70/f68 [0,4194304] 0 2024-04-13T10:58:44.968 INFO:tasks.workunit.client.1.smithi194.stdout:2/711: mkdir d2/d3/de/d33/d71/ddc/dec 0 2024-04-13T10:58:44.971 INFO:tasks.workunit.client.1.smithi194.stdout:0/659: creat d9/d2b/d6c/db2/fd9 x:0 0 0 2024-04-13T10:58:44.972 INFO:tasks.workunit.client.1.smithi194.stdout:4/742: mkdir d2/d16/d1a/d1c/d54/d62/d9e/dfd 0 2024-04-13T10:58:44.975 INFO:tasks.workunit.client.1.smithi194.stdout:5/720: dwrite d3/dc/d2d/dd1/d38/f5b [4194304,4194304] 0 2024-04-13T10:58:44.975 INFO:tasks.workunit.client.1.smithi194.stdout:4/743: dread - d2/d16/d1a/d1c/d54/d62/d6e/fa7 zero size 2024-04-13T10:58:44.976 INFO:tasks.workunit.client.1.smithi194.stdout:2/712: rename d2/d3/de/d17/d36/d7a/fd5 to d2/d3/de/fed 0 2024-04-13T10:58:44.979 INFO:tasks.workunit.client.1.smithi194.stdout:0/660: dread d9/df/d16/d75/f94 [0,4194304] 0 2024-04-13T10:58:44.982 INFO:tasks.workunit.client.1.smithi194.stdout:0/661: mknod d9/df/d16/d75/dd3/cda 0 2024-04-13T10:58:44.984 INFO:tasks.workunit.client.1.smithi194.stdout:2/713: getdents d2/d3/de 0 2024-04-13T10:58:44.986 INFO:tasks.workunit.client.1.smithi194.stdout:0/662: unlink d9/db/f2a 0 2024-04-13T10:58:44.987 INFO:tasks.workunit.client.1.smithi194.stdout:2/714: mkdir d2/d3/de/dee 0 2024-04-13T10:58:44.987 INFO:tasks.workunit.client.1.smithi194.stdout:4/744: write d2/d16/d70/f51 [2578706,125815] 0 2024-04-13T10:58:44.990 INFO:tasks.workunit.client.1.smithi194.stdout:0/663: dread d9/df/d16/d65/f79 [0,4194304] 0 2024-04-13T10:58:44.991 INFO:tasks.workunit.client.1.smithi194.stdout:2/715: creat d2/d3/de/d17/d39/fef x:0 0 0 2024-04-13T10:58:44.995 INFO:tasks.workunit.client.1.smithi194.stdout:4/745: rmdir d2/d16/d1a/d1c/d54/d62/d6e/d99/dd0/de8 0 2024-04-13T10:58:44.995 INFO:tasks.workunit.client.1.smithi194.stdout:5/721: dread d3/dc/d2d/dd1/d38/d46/f80 [0,4194304] 0 2024-04-13T10:58:44.996 INFO:tasks.workunit.client.1.smithi194.stdout:2/716: readlink d2/d3/de/d33/laf 0 2024-04-13T10:58:44.996 INFO:tasks.workunit.client.1.smithi194.stdout:0/664: dwrite d9/d2b/f96 [0,4194304] 0 2024-04-13T10:58:44.997 INFO:tasks.workunit.client.1.smithi194.stdout:4/746: chown d2/d16/d70/d31/d7b 3083350 1 2024-04-13T10:58:44.998 INFO:tasks.workunit.client.1.smithi194.stdout:0/665: chown d9/c4d 3 1 2024-04-13T10:58:44.998 INFO:tasks.workunit.client.1.smithi194.stdout:5/722: symlink d3/dc/d17/d1b/lde 0 2024-04-13T10:58:45.000 INFO:tasks.workunit.client.1.smithi194.stdout:4/747: mkdir d2/d16/d1a/d1c/d3e/dfe 0 2024-04-13T10:58:45.000 INFO:tasks.workunit.client.1.smithi194.stdout:5/723: stat d3/dc/d2d 0 2024-04-13T10:58:45.002 INFO:tasks.workunit.client.1.smithi194.stdout:4/748: write d2/d16/d1a/d1c/d54/d62/fa0 [1141757,2742] 0 2024-04-13T10:58:45.004 INFO:tasks.workunit.client.1.smithi194.stdout:5/724: dread - d3/dc/d17/d1b/d6b/d99/fdb zero size 2024-04-13T10:58:45.008 INFO:tasks.workunit.client.1.smithi194.stdout:5/725: creat d3/dc/d2d/dd1/db5/fdf x:0 0 0 2024-04-13T10:58:45.011 INFO:tasks.workunit.client.1.smithi194.stdout:5/726: creat d3/dc/d17/d1b/d6b/d99/fe0 x:0 0 0 2024-04-13T10:58:45.011 INFO:tasks.workunit.client.1.smithi194.stdout:2/717: link d2/d3/de/d3c/l41 d2/d3/de/d33/d71/ddc/lf0 0 2024-04-13T10:58:45.013 INFO:tasks.workunit.client.1.smithi194.stdout:5/727: creat d3/dc/d17/d1b/d6b/d99/fe1 x:0 0 0 2024-04-13T10:58:45.015 INFO:tasks.workunit.client.1.smithi194.stdout:0/666: truncate d9/df/d16/d65/f79 2560847 0 2024-04-13T10:58:45.016 INFO:tasks.workunit.client.1.smithi194.stdout:4/749: link d2/cd9 d2/d16/d1a/d1c/d9a/cff 0 2024-04-13T10:58:45.019 INFO:tasks.workunit.client.1.smithi194.stdout:2/718: mkdir d2/d3/de/dee/df1 0 2024-04-13T10:58:45.019 INFO:tasks.workunit.client.1.smithi194.stdout:2/719: chown d2 47820 1 2024-04-13T10:58:45.020 INFO:tasks.workunit.client.1.smithi194.stdout:4/750: chown d2/d16/d1a/d1c/d3e/dfe 1144 1 2024-04-13T10:58:45.020 INFO:tasks.workunit.client.1.smithi194.stdout:0/667: read d9/db1/d30/fab [432675,4655] 0 2024-04-13T10:58:45.022 INFO:tasks.workunit.client.1.smithi194.stdout:2/720: read - d2/d3/de/d17/d36/d8f/f96 zero size 2024-04-13T10:58:45.023 INFO:tasks.workunit.client.1.smithi194.stdout:2/721: write d2/d3/de/d17/d1e/d42/fa1 [393975,48299] 0 2024-04-13T10:58:45.023 INFO:tasks.workunit.client.1.smithi194.stdout:4/751: creat d2/d16/d1a/d1c/d54/d62/d9e/f100 x:0 0 0 2024-04-13T10:58:45.024 INFO:tasks.workunit.client.1.smithi194.stdout:0/668: creat d9/d2b/fdb x:0 0 0 2024-04-13T10:58:45.024 INFO:tasks.workunit.client.1.smithi194.stdout:5/728: fsync d3/dc/d2d/dd1/db5/fdf 0 2024-04-13T10:58:45.026 INFO:tasks.workunit.client.1.smithi194.stdout:4/752: creat d2/d16/d1a/d1c/d54/f101 x:0 0 0 2024-04-13T10:58:45.028 INFO:tasks.workunit.client.1.smithi194.stdout:0/669: mkdir d9/db1/d30/d73/d87/ddc 0 2024-04-13T10:58:45.029 INFO:tasks.workunit.client.1.smithi194.stdout:2/722: creat d2/d3/de/d17/d36/ff2 x:0 0 0 2024-04-13T10:58:45.030 INFO:tasks.workunit.client.1.smithi194.stdout:4/753: rename d2/l87 to d2/d16/d1a/d1c/d54/d62/d6e/l102 0 2024-04-13T10:58:45.032 INFO:tasks.workunit.client.1.smithi194.stdout:5/729: dwrite d3/dc/d17/f75 [0,4194304] 0 2024-04-13T10:58:45.037 INFO:tasks.workunit.client.1.smithi194.stdout:2/723: rename d2/d3/de/d3c/l41 to d2/d3/d12/dba/lf3 0 2024-04-13T10:58:45.038 INFO:tasks.workunit.client.1.smithi194.stdout:5/730: read d3/dc/d2d/dd1/d38/d46/fc8 [188234,81062] 0 2024-04-13T10:58:45.039 INFO:tasks.workunit.client.1.smithi194.stdout:2/724: chown d2/d3/de/d33/d71 61 1 2024-04-13T10:58:45.040 INFO:tasks.workunit.client.1.smithi194.stdout:0/670: dwrite d9/db/d3a/f58 [0,4194304] 0 2024-04-13T10:58:45.042 INFO:tasks.workunit.client.1.smithi194.stdout:4/754: rename d2/d30/c46 to d2/d16/d1a/d1c/d54/d62/d9e/c103 0 2024-04-13T10:58:45.043 INFO:tasks.workunit.client.1.smithi194.stdout:5/731: symlink d3/dc/d2d/dd1/db5/le2 0 2024-04-13T10:58:45.044 INFO:tasks.workunit.client.1.smithi194.stdout:5/732: truncate d3/d89/f97 768383 0 2024-04-13T10:58:45.045 INFO:tasks.workunit.client.1.smithi194.stdout:4/755: mkdir d2/d30/d104 0 2024-04-13T10:58:45.046 INFO:tasks.workunit.client.1.smithi194.stdout:5/733: dread - d3/dc/d2d/dd1/d20/daa/dae/fd9 zero size 2024-04-13T10:58:45.046 INFO:tasks.workunit.client.1.smithi194.stdout:2/725: creat d2/d3/de/d33/d71/ddc/dec/ff4 x:0 0 0 2024-04-13T10:58:45.069 INFO:tasks.workunit.client.1.smithi194.stdout:3/668: sync 2024-04-13T10:58:45.070 INFO:tasks.workunit.client.1.smithi194.stdout:8/831: sync 2024-04-13T10:58:45.070 INFO:tasks.workunit.client.1.smithi194.stdout:9/706: sync 2024-04-13T10:58:45.070 INFO:tasks.workunit.client.1.smithi194.stdout:1/660: sync 2024-04-13T10:58:45.071 INFO:tasks.workunit.client.1.smithi194.stdout:0/671: getdents d9/db/d6b 0 2024-04-13T10:58:45.071 INFO:tasks.workunit.client.1.smithi194.stdout:2/726: dread - d2/d37/fdd zero size 2024-04-13T10:58:45.073 INFO:tasks.workunit.client.1.smithi194.stdout:5/734: chown d3/dc/d17/d1b/d6b/d99/fe1 2 1 2024-04-13T10:58:45.074 INFO:tasks.workunit.client.1.smithi194.stdout:3/669: mkdir d2/dce/ddc 0 2024-04-13T10:58:45.075 INFO:tasks.workunit.client.1.smithi194.stdout:8/832: creat d6/dd/d45/daa/f119 x:0 0 0 2024-04-13T10:58:45.076 INFO:tasks.workunit.client.1.smithi194.stdout:1/661: creat d12/d13/d1c/d27/d4c/d7d/fdc x:0 0 0 2024-04-13T10:58:45.077 INFO:tasks.workunit.client.1.smithi194.stdout:0/672: creat d9/db/d3a/d9a/dd7/fdd x:0 0 0 2024-04-13T10:58:45.077 INFO:tasks.workunit.client.1.smithi194.stdout:2/727: write d2/d3/de/d33/d47/dbb/f5c [331945,62386] 0 2024-04-13T10:58:45.080 INFO:tasks.workunit.client.1.smithi194.stdout:3/670: chown d2/d3/d12/d31/d34/d88/d24/dd2 262 1 2024-04-13T10:58:45.081 INFO:tasks.workunit.client.1.smithi194.stdout:2/728: readlink d2/d3/de/d17/l28 0 2024-04-13T10:58:45.082 INFO:tasks.workunit.client.1.smithi194.stdout:4/756: dwrite d2/d30/f49 [0,4194304] 0 2024-04-13T10:58:45.082 INFO:tasks.workunit.client.1.smithi194.stdout:0/673: creat d9/d9f/fde x:0 0 0 2024-04-13T10:58:45.086 INFO:tasks.workunit.client.1.smithi194.stdout:9/707: dwrite d0/d11/d1e/fa1 [0,4194304] 0 2024-04-13T10:58:45.089 INFO:tasks.workunit.client.1.smithi194.stdout:2/729: unlink d2/d3/de/d17/d36/l49 0 2024-04-13T10:58:45.091 INFO:tasks.workunit.client.1.smithi194.stdout:5/735: dread d3/dc/d17/d1b/f8a [0,4194304] 0 2024-04-13T10:58:45.091 INFO:tasks.workunit.client.1.smithi194.stdout:4/757: write d2/d16/d1a/d1c/d54/d62/d6e/fa7 [717478,45595] 0 2024-04-13T10:58:45.091 INFO:tasks.workunit.client.1.smithi194.stdout:1/662: getdents d12/d3a/d4f/da3 0 2024-04-13T10:58:45.093 INFO:tasks.workunit.client.1.smithi194.stdout:3/671: rename d2/f30 to d2/d3/d12/d31/d34/d88/d24/d82/fdd 0 2024-04-13T10:58:45.094 INFO:tasks.workunit.client.1.smithi194.stdout:4/758: dread - d2/d16/d1a/d1c/d54/d62/ff8 zero size 2024-04-13T10:58:45.096 INFO:tasks.workunit.client.1.smithi194.stdout:8/833: getdents d6/d22/d23/d25/d71 0 2024-04-13T10:58:45.098 INFO:tasks.workunit.client.1.smithi194.stdout:4/759: chown d2/d16/d1a/d1c/d54/de7 367 1 2024-04-13T10:58:45.100 INFO:tasks.workunit.client.1.smithi194.stdout:9/708: creat d0/d6/d14/dcd/da4/de0/ff5 x:0 0 0 2024-04-13T10:58:45.101 INFO:tasks.workunit.client.1.smithi194.stdout:6/646: sync 2024-04-13T10:58:45.102 INFO:tasks.workunit.client.1.smithi194.stdout:9/709: readlink d0/d11/lc7 0 2024-04-13T10:58:45.102 INFO:tasks.workunit.client.1.smithi194.stdout:3/672: rmdir d2/d3/d12/d31/d34/d88/d24/d3a 39 2024-04-13T10:58:45.104 INFO:tasks.workunit.client.1.smithi194.stdout:4/760: mknod d2/d16/d1a/d1c/c105 0 2024-04-13T10:58:45.106 INFO:tasks.workunit.client.1.smithi194.stdout:1/663: dwrite d12/d3a/f6a [0,4194304] 0 2024-04-13T10:58:45.107 INFO:tasks.workunit.client.1.smithi194.stdout:2/730: dwrite d2/d3/de/d17/d1e/f2c [12582912,4194304] 0 2024-04-13T10:58:45.108 INFO:tasks.workunit.client.1.smithi194.stdout:9/710: write d0/d6/d14/d26/d3b/fa2 [1030713,24899] 0 2024-04-13T10:58:45.113 INFO:tasks.workunit.client.1.smithi194.stdout:5/736: truncate d3/dc/d2d/dd1/d38/f51 4100552 0 2024-04-13T10:58:45.113 INFO:tasks.workunit.client.1.smithi194.stdout:3/673: creat d2/d3/d12/d31/d34/d88/d24/d82/fde x:0 0 0 2024-04-13T10:58:45.114 INFO:tasks.workunit.client.1.smithi194.stdout:2/731: unlink d2/d3/de/d33/c43 0 2024-04-13T10:58:45.115 INFO:tasks.workunit.client.1.smithi194.stdout:8/834: getdents d6/dd/d45/de3/de9/df8 0 2024-04-13T10:58:45.118 INFO:tasks.workunit.client.1.smithi194.stdout:6/647: getdents d0 0 2024-04-13T10:58:45.120 INFO:tasks.workunit.client.1.smithi194.stdout:0/674: dread d9/d2b/d5a/f5b [0,4194304] 0 2024-04-13T10:58:45.120 INFO:tasks.workunit.client.1.smithi194.stdout:5/737: symlink d3/dc/d2d/le3 0 2024-04-13T10:58:45.122 INFO:tasks.workunit.client.1.smithi194.stdout:9/711: creat d0/d88/de5/ff6 x:0 0 0 2024-04-13T10:58:45.123 INFO:tasks.workunit.client.1.smithi194.stdout:1/664: dread d12/f1a [0,4194304] 0 2024-04-13T10:58:45.123 INFO:tasks.workunit.client.1.smithi194.stdout:0/675: read - d9/db1/d30/d73/fba zero size 2024-04-13T10:58:45.124 INFO:tasks.workunit.client.1.smithi194.stdout:2/732: creat d2/d3/de/d33/d71/ddc/dec/ff5 x:0 0 0 2024-04-13T10:58:45.124 INFO:tasks.workunit.client.1.smithi194.stdout:9/712: write d0/d11/f40 [4541087,77246] 0 2024-04-13T10:58:45.125 INFO:tasks.workunit.client.1.smithi194.stdout:4/761: getdents d2/d16/d1a/d1c/d54/d62/d9e 0 2024-04-13T10:58:45.126 INFO:tasks.workunit.client.1.smithi194.stdout:8/835: mknod d6/d2a/c11a 0 2024-04-13T10:58:45.127 INFO:tasks.workunit.client.1.smithi194.stdout:0/676: stat d9/d2b/d6c/l7f 0 2024-04-13T10:58:45.128 INFO:tasks.workunit.client.1.smithi194.stdout:9/713: stat d0/d11/d3d/d4c/f81 0 2024-04-13T10:58:45.128 INFO:tasks.workunit.client.1.smithi194.stdout:2/733: readlink d2/d3/de/d17/d39/l48 0 2024-04-13T10:58:45.130 INFO:tasks.workunit.client.1.smithi194.stdout:1/665: chown d12/d13/d1c/d27/d4c/d90/ccc 1860904 1 2024-04-13T10:58:45.130 INFO:tasks.workunit.client.1.smithi194.stdout:9/714: chown d0/d11/f1d 3859 1 2024-04-13T10:58:45.131 INFO:tasks.workunit.client.1.smithi194.stdout:0/677: write d9/df/d16/fc5 [219048,123932] 0 2024-04-13T10:58:45.131 INFO:tasks.workunit.client.1.smithi194.stdout:4/762: mknod d2/d30/d104/c106 0 2024-04-13T10:58:45.132 INFO:tasks.workunit.client.1.smithi194.stdout:5/738: dread d3/dc/d2d/f84 [4194304,4194304] 0 2024-04-13T10:58:45.136 INFO:tasks.workunit.client.1.smithi194.stdout:9/715: rmdir d0/d6/d14/d6d 39 2024-04-13T10:58:45.138 INFO:tasks.workunit.client.1.smithi194.stdout:4/763: mkdir d2/d16/d1a/d60/d107 0 2024-04-13T10:58:45.138 INFO:tasks.workunit.client.1.smithi194.stdout:7/763: sync 2024-04-13T10:58:45.139 INFO:tasks.workunit.client.1.smithi194.stdout:3/674: rename d2/d3/d12/d31/d34/d88/d24/d3a/d56/ca0 to d2/d3/d12/d31/d34/d88/d24/d3a/d72/cdf 0 2024-04-13T10:58:45.140 INFO:tasks.workunit.client.1.smithi194.stdout:7/764: read d1/f95 [191101,47843] 0 2024-04-13T10:58:45.142 INFO:tasks.workunit.client.1.smithi194.stdout:8/836: write d6/d2a/f57 [375719,65915] 0 2024-04-13T10:58:45.145 INFO:tasks.workunit.client.1.smithi194.stdout:5/739: rename d3/dc/d2d/dd1/db5/le2 to d3/dc/ddc/le4 0 2024-04-13T10:58:45.146 INFO:tasks.workunit.client.1.smithi194.stdout:3/675: dread d2/f5b [0,4194304] 0 2024-04-13T10:58:45.147 INFO:tasks.workunit.client.1.smithi194.stdout:6/648: dread d0/d57/d69/f64 [0,4194304] 0 2024-04-13T10:58:45.147 INFO:tasks.workunit.client.1.smithi194.stdout:0/678: truncate d9/db/d3a/f5c 1097655 0 2024-04-13T10:58:45.149 INFO:tasks.workunit.client.1.smithi194.stdout:8/837: write d6/d22/d23/d25/d71/ff7 [831019,83428] 0 2024-04-13T10:58:45.149 INFO:tasks.workunit.client.1.smithi194.stdout:5/740: write d3/d29/f87 [227336,31448] 0 2024-04-13T10:58:45.152 INFO:tasks.workunit.client.1.smithi194.stdout:7/765: dwrite d1/dd9/de1/fda [0,4194304] 0 2024-04-13T10:58:45.153 INFO:tasks.workunit.client.1.smithi194.stdout:8/838: readlink d6/d22/d23/d25/l97 0 2024-04-13T10:58:45.153 INFO:tasks.workunit.client.1.smithi194.stdout:3/676: stat d2/d3/d12/d31/d34/d88/d24/d3a/d65/f66 0 2024-04-13T10:58:45.154 INFO:tasks.workunit.client.1.smithi194.stdout:1/666: dread d12/f32 [0,4194304] 0 2024-04-13T10:58:45.155 INFO:tasks.workunit.client.1.smithi194.stdout:8/839: dread - d6/d22/d23/d7f/d8c/d8d/ddc/ff0 zero size 2024-04-13T10:58:45.159 INFO:tasks.workunit.client.1.smithi194.stdout:5/741: mknod d3/dc/d2d/dd1/ce5 0 2024-04-13T10:58:45.159 INFO:tasks.workunit.client.1.smithi194.stdout:6/649: creat d0/d26/dcb/fd1 x:0 0 0 2024-04-13T10:58:45.160 INFO:tasks.workunit.client.1.smithi194.stdout:6/650: fdatasync d0/f66 0 2024-04-13T10:58:45.161 INFO:tasks.workunit.client.1.smithi194.stdout:4/764: truncate d2/d16/d1a/d1c/d3b/d8d/fdb 885437 0 2024-04-13T10:58:45.163 INFO:tasks.workunit.client.1.smithi194.stdout:6/651: readlink d0/d2c/l79 0 2024-04-13T10:58:45.164 INFO:tasks.workunit.client.1.smithi194.stdout:5/742: write d3/dc/d2d/dd1/db5/fdf [165161,91355] 0 2024-04-13T10:58:45.164 INFO:tasks.workunit.client.1.smithi194.stdout:7/766: dwrite d1/dd9/de1/dab/d96/fa3 [4194304,4194304] 0 2024-04-13T10:58:45.164 INFO:tasks.workunit.client.1.smithi194.stdout:1/667: symlink d12/d13/d1c/d28/d41/ldd 0 2024-04-13T10:58:45.166 INFO:tasks.workunit.client.1.smithi194.stdout:2/734: rename d2/d3/de/d33/d47/dbb/f99 to d2/d3/de/d90/ff6 0 2024-04-13T10:58:45.173 INFO:tasks.workunit.client.1.smithi194.stdout:4/765: unlink d2/d16/d70/d31/f40 0 2024-04-13T10:58:45.174 INFO:tasks.workunit.client.1.smithi194.stdout:2/735: stat d2/d3/de/d17/d36/d8f/dcd/fd6 0 2024-04-13T10:58:45.175 INFO:tasks.workunit.client.1.smithi194.stdout:1/668: chown d12/d13/d1c/d28/d41/d50/d96 1732811 1 2024-04-13T10:58:45.176 INFO:tasks.workunit.client.1.smithi194.stdout:8/840: dwrite d6/d22/d23/d25/f27 [0,4194304] 0 2024-04-13T10:58:45.178 INFO:tasks.workunit.client.1.smithi194.stdout:9/716: rename d0/d11/d1e/f46 to d0/d11/d79/ff7 0 2024-04-13T10:58:45.180 INFO:tasks.workunit.client.1.smithi194.stdout:5/743: mkdir d3/dc/d2d/dd1/d38/d59/de6 0 2024-04-13T10:58:45.181 INFO:tasks.workunit.client.1.smithi194.stdout:0/679: dwrite d9/df/d16/d83/f86 [0,4194304] 0 2024-04-13T10:58:45.182 INFO:tasks.workunit.client.1.smithi194.stdout:4/766: unlink d2/d16/d1a/d1c/d54/fce 0 2024-04-13T10:58:45.182 INFO:tasks.workunit.client.1.smithi194.stdout:1/669: mkdir d12/d3a/d4f/da3/daa/dde 0 2024-04-13T10:58:45.185 INFO:tasks.workunit.client.1.smithi194.stdout:0/680: fdatasync d9/d6f/f81 0 2024-04-13T10:58:45.186 INFO:tasks.workunit.client.1.smithi194.stdout:8/841: creat d6/dd/d45/de3/dd3/f11b x:0 0 0 2024-04-13T10:58:45.186 INFO:tasks.workunit.client.1.smithi194.stdout:5/744: write d3/f1f [4536197,18406] 0 2024-04-13T10:58:45.187 INFO:tasks.workunit.client.1.smithi194.stdout:9/717: unlink d0/d6/d2c/c66 0 2024-04-13T10:58:45.189 INFO:tasks.workunit.client.1.smithi194.stdout:4/767: readlink d2/d16/d1a/d1c/d3b/l47 0 2024-04-13T10:58:45.190 INFO:tasks.workunit.client.1.smithi194.stdout:7/767: dwrite d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/fac [0,4194304] 0 2024-04-13T10:58:45.191 INFO:tasks.workunit.client.1.smithi194.stdout:9/718: chown d0/d11/d79/fa6 721936 1 2024-04-13T10:58:45.192 INFO:tasks.workunit.client.1.smithi194.stdout:3/677: rename d2/d3/d12/d31/d34/d88/d24/d82/caf to d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/ce0 0 2024-04-13T10:58:45.193 INFO:tasks.workunit.client.1.smithi194.stdout:5/745: rmdir d3/d83 39 2024-04-13T10:58:45.195 INFO:tasks.workunit.client.1.smithi194.stdout:4/768: truncate d2/d16/d1a/d1c/d3e/fd1 40214 0 2024-04-13T10:58:45.195 INFO:tasks.workunit.client.1.smithi194.stdout:1/670: dread d12/d3a/f6a [0,4194304] 0 2024-04-13T10:58:45.196 INFO:tasks.workunit.client.1.smithi194.stdout:8/842: unlink d6/d2a/c42 0 2024-04-13T10:58:45.196 INFO:tasks.workunit.client.1.smithi194.stdout:5/746: write d3/dc/d17/fc9 [274172,84148] 0 2024-04-13T10:58:45.197 INFO:tasks.workunit.client.1.smithi194.stdout:1/671: chown d12/d13/d1c/d27/d4c/d7f 5758408 1 2024-04-13T10:58:45.199 INFO:tasks.workunit.client.1.smithi194.stdout:5/747: dread d3/dc/d2d/dd1/f3b [0,4194304] 0 2024-04-13T10:58:45.200 INFO:tasks.workunit.client.1.smithi194.stdout:7/768: fsync d1/f12 0 2024-04-13T10:58:45.204 INFO:tasks.workunit.client.1.smithi194.stdout:0/681: rename d9/df to d9/d2b/d6c/ddf 0 2024-04-13T10:58:45.206 INFO:tasks.workunit.client.1.smithi194.stdout:4/769: creat d2/d16/d1a/d1c/d3e/dbb/f108 x:0 0 0 2024-04-13T10:58:45.206 INFO:tasks.workunit.client.1.smithi194.stdout:4/770: chown d2/d16 18 1 2024-04-13T10:58:45.208 INFO:tasks.workunit.client.1.smithi194.stdout:8/843: mknod d6/d22/d23/d3d/c11c 0 2024-04-13T10:58:45.211 INFO:tasks.workunit.client.1.smithi194.stdout:2/736: write d2/d3/de/d33/d47/dbb/f93 [31605,117738] 0 2024-04-13T10:58:45.213 INFO:tasks.workunit.client.1.smithi194.stdout:2/737: stat d2/d3/de/d17/d36/d8f/dcd/fd6 0 2024-04-13T10:58:45.214 INFO:tasks.workunit.client.1.smithi194.stdout:5/748: creat d3/dc/d2d/dd1/fe7 x:0 0 0 2024-04-13T10:58:45.218 INFO:tasks.workunit.client.1.smithi194.stdout:5/749: dread d3/dc/d17/f74 [0,4194304] 0 2024-04-13T10:58:45.221 INFO:tasks.workunit.client.1.smithi194.stdout:7/769: mknod d1/cf6 0 2024-04-13T10:58:45.222 INFO:tasks.workunit.client.1.smithi194.stdout:9/719: dread d0/d6/f7b [0,4194304] 0 2024-04-13T10:58:45.222 INFO:tasks.workunit.client.1.smithi194.stdout:0/682: dwrite d9/d2b/d6c/ddf/d16/d75/f94 [0,4194304] 0 2024-04-13T10:58:45.223 INFO:tasks.workunit.client.1.smithi194.stdout:5/750: creat d3/dc/d17/d1b/d6b/fe8 x:0 0 0 2024-04-13T10:58:45.225 INFO:tasks.workunit.client.1.smithi194.stdout:3/678: getdents d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80 0 2024-04-13T10:58:45.226 INFO:tasks.workunit.client.1.smithi194.stdout:4/771: creat d2/d16/d70/f109 x:0 0 0 2024-04-13T10:58:45.229 INFO:tasks.workunit.client.1.smithi194.stdout:2/738: dwrite d2/d3/de/d17/d36/d8f/f2f [0,4194304] 0 2024-04-13T10:58:45.230 INFO:tasks.workunit.client.1.smithi194.stdout:1/672: getdents d12/d13/d1c/d28/d41/d77/d93 0 2024-04-13T10:58:45.231 INFO:tasks.workunit.client.1.smithi194.stdout:9/720: mknod d0/d11/d44/cf8 0 2024-04-13T10:58:45.232 INFO:tasks.workunit.client.1.smithi194.stdout:7/770: chown d1/d2b/d4c/d4f/d51/d4d/d5e/fc7 341 1 2024-04-13T10:58:45.233 INFO:tasks.workunit.client.1.smithi194.stdout:0/683: mknod d9/d2b/d6c/ddf/d16/d75/dd3/ce0 0 2024-04-13T10:58:45.234 INFO:tasks.workunit.client.1.smithi194.stdout:5/751: symlink d3/dc/d2d/dd1/d38/d59/d49/dbf/le9 0 2024-04-13T10:58:45.234 INFO:tasks.workunit.client.1.smithi194.stdout:7/771: chown d1/d2b/d4c/d4f/d85/cca 116882 1 2024-04-13T10:58:45.234 INFO:tasks.workunit.client.1.smithi194.stdout:4/772: mknod d2/d16/d1a/d1c/d3e/c10a 0 2024-04-13T10:58:45.235 INFO:tasks.workunit.client.1.smithi194.stdout:7/772: stat d1/d2b/d4c/f5d 0 2024-04-13T10:58:45.237 INFO:tasks.workunit.client.1.smithi194.stdout:2/739: chown d2/d3/de/d90/l9c 37 1 2024-04-13T10:58:45.238 INFO:tasks.workunit.client.1.smithi194.stdout:0/684: unlink d9/d2b/fdb 0 2024-04-13T10:58:45.239 INFO:tasks.workunit.client.1.smithi194.stdout:0/685: stat d9/d2b/dbd/lbe 0 2024-04-13T10:58:45.241 INFO:tasks.workunit.client.1.smithi194.stdout:5/752: dread d3/dc/d17/f75 [0,4194304] 0 2024-04-13T10:58:45.242 INFO:tasks.workunit.client.1.smithi194.stdout:3/679: creat d2/d3/d12/d31/d34/d88/d24/fe1 x:0 0 0 2024-04-13T10:58:45.245 INFO:tasks.workunit.client.1.smithi194.stdout:5/753: chown d3/dc/d2d/f36 29643436 1 2024-04-13T10:58:45.245 INFO:tasks.workunit.client.1.smithi194.stdout:0/686: rmdir d9/d9f 39 2024-04-13T10:58:45.249 INFO:tasks.workunit.client.1.smithi194.stdout:7/773: rename d1/c21 to d1/d2b/d2c/d30/d33/d39/dba/cf7 0 2024-04-13T10:58:45.250 INFO:tasks.workunit.client.1.smithi194.stdout:9/721: dwrite d0/f37 [0,4194304] 0 2024-04-13T10:58:45.251 INFO:tasks.workunit.client.1.smithi194.stdout:4/773: dwrite d2/d16/d1a/d1c/d3b/d42/fcb [0,4194304] 0 2024-04-13T10:58:45.256 INFO:tasks.workunit.client.1.smithi194.stdout:3/680: chown d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/l6f 0 1 2024-04-13T10:58:45.257 INFO:tasks.workunit.client.1.smithi194.stdout:7/774: write d1/d2b/d4c/d4f/d51/d4d/fa7 [3694160,117358] 0 2024-04-13T10:58:45.259 INFO:tasks.workunit.client.1.smithi194.stdout:5/754: rename d3/dc/d2d/dd1/d38/d46 to d3/dc/d2d/dd1/d38/d59/d49/dbf/dea 0 2024-04-13T10:58:45.263 INFO:tasks.workunit.client.1.smithi194.stdout:0/687: creat d9/db1/d30/d73/d87/ddc/fe1 x:0 0 0 2024-04-13T10:58:45.263 INFO:tasks.workunit.client.1.smithi194.stdout:2/740: dread d2/d3/de/d17/d36/d8f/f4c [0,4194304] 0 2024-04-13T10:58:45.267 INFO:tasks.workunit.client.1.smithi194.stdout:9/722: dwrite d0/d11/f1d [0,4194304] 0 2024-04-13T10:58:45.267 INFO:tasks.workunit.client.1.smithi194.stdout:5/755: fsync d3/dc/d2d/dd1/d38/d59/fc7 0 2024-04-13T10:58:45.270 INFO:tasks.workunit.client.1.smithi194.stdout:3/681: write d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dd7/f73 [1574565,93645] 0 2024-04-13T10:58:45.270 INFO:tasks.workunit.client.1.smithi194.stdout:2/741: creat d2/ff7 x:0 0 0 2024-04-13T10:58:45.273 INFO:tasks.workunit.client.1.smithi194.stdout:9/723: chown d0/d11/d79/l8a 16105 1 2024-04-13T10:58:45.275 INFO:tasks.workunit.client.1.smithi194.stdout:4/774: dwrite d2/d16/d1a/f35 [0,4194304] 0 2024-04-13T10:58:45.276 INFO:tasks.workunit.client.1.smithi194.stdout:5/756: dread d3/d89/fa3 [0,4194304] 0 2024-04-13T10:58:45.277 INFO:tasks.workunit.client.1.smithi194.stdout:3/682: write d2/d3/d12/d31/f84 [45439,48897] 0 2024-04-13T10:58:45.277 INFO:tasks.workunit.client.1.smithi194.stdout:2/742: symlink d2/d3/de/d17/d36/d8f/lf8 0 2024-04-13T10:58:45.279 INFO:tasks.workunit.client.1.smithi194.stdout:7/775: dread d1/dd9/de1/dab/d96/fa3 [4194304,4194304] 0 2024-04-13T10:58:45.280 INFO:tasks.workunit.client.1.smithi194.stdout:9/724: unlink d0/d6/d14/d26/f3e 0 2024-04-13T10:58:45.281 INFO:tasks.workunit.client.1.smithi194.stdout:0/688: dwrite d9/db1/d30/d73/fba [0,4194304] 0 2024-04-13T10:58:45.283 INFO:tasks.workunit.client.1.smithi194.stdout:5/757: mknod d3/dc/d17/d93/ceb 0 2024-04-13T10:58:45.284 INFO:tasks.workunit.client.1.smithi194.stdout:3/683: mkdir d2/dce/ddc/de2 0 2024-04-13T10:58:45.288 INFO:tasks.workunit.client.1.smithi194.stdout:0/689: chown d9/d2b/d6c/ddf/c1a 36663996 1 2024-04-13T10:58:45.292 INFO:tasks.workunit.client.1.smithi194.stdout:5/758: write d3/dc/d2d/dd1/d38/d59/fc7 [207129,128428] 0 2024-04-13T10:58:45.293 INFO:tasks.workunit.client.1.smithi194.stdout:2/743: getdents d2/d3/de/d17/d36/d3d 0 2024-04-13T10:58:45.296 INFO:tasks.workunit.client.1.smithi194.stdout:7/776: dwrite d1/d2b/d2c/d30/f32 [0,4194304] 0 2024-04-13T10:58:45.297 INFO:tasks.workunit.client.1.smithi194.stdout:5/759: chown d3/dc/d2d/dd1/d38/f96 6608103 1 2024-04-13T10:58:45.297 INFO:tasks.workunit.client.1.smithi194.stdout:9/725: link d0/d6/d14/fdd d0/dde/ff9 0 2024-04-13T10:58:45.298 INFO:tasks.workunit.client.1.smithi194.stdout:4/775: dwrite d2/d16/d1a/d1c/d54/d5d/db2/fd5 [0,4194304] 0 2024-04-13T10:58:45.299 INFO:tasks.workunit.client.1.smithi194.stdout:2/744: write d2/d3/de/d17/d36/d7a/faa [650283,87452] 0 2024-04-13T10:58:45.300 INFO:tasks.workunit.client.1.smithi194.stdout:0/690: creat d9/d2b/d6c/ddf/d16/d83/dae/fe2 x:0 0 0 2024-04-13T10:58:45.302 INFO:tasks.workunit.client.1.smithi194.stdout:4/776: chown d2/d16/d1a/d1c/d3e/dbb/dee 3 1 2024-04-13T10:58:45.303 INFO:tasks.workunit.client.1.smithi194.stdout:6/652: sync 2024-04-13T10:58:45.306 INFO:tasks.workunit.client.1.smithi194.stdout:6/653: dread d0/d26/d4b/f59 [0,4194304] 0 2024-04-13T10:58:45.308 INFO:tasks.workunit.client.1.smithi194.stdout:2/745: creat d2/d3/de/d17/d39/dcc/ff9 x:0 0 0 2024-04-13T10:58:45.311 INFO:tasks.workunit.client.1.smithi194.stdout:7/777: rename d1/dd9/de1/dab/d96/fa3 to d1/dd9/de1/dab/d96/ff8 0 2024-04-13T10:58:45.312 INFO:tasks.workunit.client.1.smithi194.stdout:5/760: getdents d3/dc/d2d/dd1/d20/daa 0 2024-04-13T10:58:45.314 INFO:tasks.workunit.client.1.smithi194.stdout:7/778: stat d1/d2b/d2c/d30/f32 0 2024-04-13T10:58:45.314 INFO:tasks.workunit.client.1.smithi194.stdout:0/691: link d9/db1/d30/c46 d9/d2b/d6c/ddf/d16/d70/ce3 0 2024-04-13T10:58:45.316 INFO:tasks.workunit.client.1.smithi194.stdout:5/761: chown d3/dc/d2d/dd1/lb4 4034518 1 2024-04-13T10:58:45.316 INFO:tasks.workunit.client.1.smithi194.stdout:6/654: dwrite d0/d42/f43 [0,4194304] 0 2024-04-13T10:58:45.319 INFO:tasks.workunit.client.1.smithi194.stdout:0/692: fdatasync d9/d2b/d6c/ddf/d16/d83/f86 0 2024-04-13T10:58:45.319 INFO:tasks.workunit.client.1.smithi194.stdout:6/655: stat d0/d26/fb6 0 2024-04-13T10:58:45.321 INFO:tasks.workunit.client.1.smithi194.stdout:7/779: symlink d1/d2b/lf9 0 2024-04-13T10:58:45.321 INFO:tasks.workunit.client.1.smithi194.stdout:9/726: write d0/d6/d14/d26/f38 [4357734,46389] 0 2024-04-13T10:58:45.322 INFO:tasks.workunit.client.1.smithi194.stdout:2/746: dwrite d2/d3/de/d17/d36/d8f/d57/fd7 [0,4194304] 0 2024-04-13T10:58:45.324 INFO:tasks.workunit.client.1.smithi194.stdout:4/777: truncate d2/d16/d1a/d1c/d54/f5f 1749280 0 2024-04-13T10:58:45.326 INFO:tasks.workunit.client.1.smithi194.stdout:5/762: truncate d3/d83/f5f 1148377 0 2024-04-13T10:58:45.326 INFO:tasks.workunit.client.1.smithi194.stdout:2/747: rmdir d2/d3 39 2024-04-13T10:58:45.329 INFO:tasks.workunit.client.1.smithi194.stdout:4/778: dread - d2/d16/d1a/d1c/d54/d62/d9e/ff6 zero size 2024-04-13T10:58:45.332 INFO:tasks.workunit.client.1.smithi194.stdout:0/693: dwrite d9/db/f1b [0,4194304] 0 2024-04-13T10:58:45.333 INFO:tasks.workunit.client.1.smithi194.stdout:5/763: truncate d3/dc/d17/d1b/f42 826801 0 2024-04-13T10:58:45.335 INFO:tasks.workunit.client.1.smithi194.stdout:3/684: dread d2/d3/d12/d31/d34/d88/d24/fca [0,4194304] 0 2024-04-13T10:58:45.336 INFO:tasks.workunit.client.1.smithi194.stdout:6/656: rename d0/d42/dbe/f67 to d0/d42/dbe/d4d/fd2 0 2024-04-13T10:58:45.337 INFO:tasks.workunit.client.1.smithi194.stdout:4/779: symlink d2/d16/d1a/d1c/d3e/dbb/dee/l10b 0 2024-04-13T10:58:45.339 INFO:tasks.workunit.client.1.smithi194.stdout:0/694: symlink d9/d2b/d6c/ddf/d16/d77/le4 0 2024-04-13T10:58:45.341 INFO:tasks.workunit.client.1.smithi194.stdout:4/780: chown d2/d16/d1a/d1c/d3b/d8d 231923013 1 2024-04-13T10:58:45.341 INFO:tasks.workunit.client.1.smithi194.stdout:0/695: readlink d9/db1/l60 0 2024-04-13T10:58:45.345 INFO:tasks.workunit.client.1.smithi194.stdout:9/727: link d0/d11/d79/f84 d0/d6/ffa 0 2024-04-13T10:58:45.345 INFO:tasks.workunit.client.1.smithi194.stdout:0/696: write d9/db/f3d [549052,59529] 0 2024-04-13T10:58:45.346 INFO:tasks.workunit.client.1.smithi194.stdout:4/781: chown d2/d16/d1a/d1c/d3e/c10a 1632229650 1 2024-04-13T10:58:45.347 INFO:tasks.workunit.client.1.smithi194.stdout:5/764: dwrite d3/dc/d2d/dd1/d20/f62 [4194304,4194304] 0 2024-04-13T10:58:45.347 INFO:tasks.workunit.client.1.smithi194.stdout:2/748: dwrite d2/d3/de/d33/d71/ddc/dec/ff4 [0,4194304] 0 2024-04-13T10:58:45.352 INFO:tasks.workunit.client.1.smithi194.stdout:0/697: unlink d9/d2b/d6c/ddf/d16/d70/fd6 0 2024-04-13T10:58:45.354 INFO:tasks.workunit.client.1.smithi194.stdout:6/657: dwrite d0/d2c/d77/d93/fc8 [0,4194304] 0 2024-04-13T10:58:45.355 INFO:tasks.workunit.client.1.smithi194.stdout:0/698: fdatasync d9/db1/fa2 0 2024-04-13T10:58:45.356 INFO:tasks.workunit.client.1.smithi194.stdout:5/765: readlink d3/d83/l35 0 2024-04-13T10:58:45.356 INFO:tasks.workunit.client.1.smithi194.stdout:2/749: write d2/d3/de/d17/d1e/d42/fa1 [1237204,126976] 0 2024-04-13T10:58:45.356 INFO:tasks.workunit.client.1.smithi194.stdout:9/728: truncate d0/d6/d4a/d74/fd3 18671 0 2024-04-13T10:58:45.359 INFO:tasks.workunit.client.1.smithi194.stdout:0/699: write d9/d2b/d6c/fce [374822,89203] 0 2024-04-13T10:58:45.362 INFO:tasks.workunit.client.1.smithi194.stdout:6/658: creat d0/d57/db7/dbc/fd3 x:0 0 0 2024-04-13T10:58:45.363 INFO:tasks.workunit.client.1.smithi194.stdout:3/685: write d2/fd [966289,85416] 0 2024-04-13T10:58:45.364 INFO:tasks.workunit.client.1.smithi194.stdout:4/782: rename d2/d16/d70/d31/laa to d2/d16/d70/d31/l10c 0 2024-04-13T10:58:45.364 INFO:tasks.workunit.client.1.smithi194.stdout:2/750: write d2/d3/f4a [454270,121434] 0 2024-04-13T10:58:45.367 INFO:tasks.workunit.client.1.smithi194.stdout:9/729: mknod d0/d6/d14/dcd/dd6/cfb 0 2024-04-13T10:58:45.369 INFO:tasks.workunit.client.1.smithi194.stdout:3/686: write d2/d3/d12/d31/d34/d88/d24/fe1 [879605,129254] 0 2024-04-13T10:58:45.369 INFO:tasks.workunit.client.1.smithi194.stdout:5/766: rename d3/dc/d2d/dd1/d20/l32 to d3/dc/d2d/dd1/d38/d59/lec 0 2024-04-13T10:58:45.370 INFO:tasks.workunit.client.1.smithi194.stdout:2/751: dread - d2/d3/de/d17/d1e/d42/fb1 zero size 2024-04-13T10:58:45.371 INFO:tasks.workunit.client.1.smithi194.stdout:9/730: dread - d0/d6/d14/d26/d3b/fe8 zero size 2024-04-13T10:58:45.374 INFO:tasks.workunit.client.1.smithi194.stdout:0/700: dwrite d9/db1/d30/d73/fba [0,4194304] 0 2024-04-13T10:58:45.374 INFO:tasks.workunit.client.1.smithi194.stdout:9/731: fdatasync d0/d11/d79/fa6 0 2024-04-13T10:58:45.376 INFO:tasks.workunit.client.1.smithi194.stdout:9/732: chown d0/d11/da3 17 1 2024-04-13T10:58:45.377 INFO:tasks.workunit.client.1.smithi194.stdout:4/783: rename d2/d16/d70/d31/d44 to d2/d16/d1a/d1c/d54/d62/d10d 0 2024-04-13T10:58:45.377 INFO:tasks.workunit.client.1.smithi194.stdout:9/733: fdatasync d0/d6/d14/ff2 0 2024-04-13T10:58:45.378 INFO:tasks.workunit.client.1.smithi194.stdout:2/752: mknod d2/d3/de/d17/d1e/cfa 0 2024-04-13T10:58:45.379 INFO:tasks.workunit.client.1.smithi194.stdout:3/687: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/ce3 0 2024-04-13T10:58:45.379 INFO:tasks.workunit.client.1.smithi194.stdout:9/734: dread - d0/d11/d3d/d9b/fb7 zero size 2024-04-13T10:58:45.380 INFO:tasks.workunit.client.1.smithi194.stdout:4/784: read d2/d16/d70/d31/fb8 [93733,65796] 0 2024-04-13T10:58:45.380 INFO:tasks.workunit.client.1.smithi194.stdout:0/701: symlink d9/db1/d30/d73/le5 0 2024-04-13T10:58:45.381 INFO:tasks.workunit.client.1.smithi194.stdout:2/753: write d2/d3/de/d17/d1e/fbf [583978,104332] 0 2024-04-13T10:58:45.383 INFO:tasks.workunit.client.1.smithi194.stdout:8/844: sync 2024-04-13T10:58:45.384 INFO:tasks.workunit.client.1.smithi194.stdout:3/688: symlink d2/d3/d12/d31/d34/d88/d24/d6c/dc2/le4 0 2024-04-13T10:58:45.385 INFO:tasks.workunit.client.1.smithi194.stdout:4/785: fdatasync d2/d16/d1a/d1c/d54/d62/d6e/d99/dd0/ff2 0 2024-04-13T10:58:45.386 INFO:tasks.workunit.client.1.smithi194.stdout:5/767: read d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/fc8 [2593633,126266] 0 2024-04-13T10:58:45.390 INFO:tasks.workunit.client.1.smithi194.stdout:3/689: creat d2/d3/d12/d21/fe5 x:0 0 0 2024-04-13T10:58:45.391 INFO:tasks.workunit.client.1.smithi194.stdout:2/754: mknod d2/d3/de/d33/d71/ddc/dec/cfb 0 2024-04-13T10:58:45.394 INFO:tasks.workunit.client.1.smithi194.stdout:9/735: dwrite d0/d88/de5/ff6 [0,4194304] 0 2024-04-13T10:58:45.396 INFO:tasks.workunit.client.1.smithi194.stdout:3/690: mkdir d2/d7d/de6 0 2024-04-13T10:58:45.398 INFO:tasks.workunit.client.1.smithi194.stdout:6/659: dwrite d0/f1a [0,4194304] 0 2024-04-13T10:58:45.401 INFO:tasks.workunit.client.1.smithi194.stdout:5/768: rename d3/dc/d17/l8e to d3/dc/d2d/dd1/d20/daa/dae/led 0 2024-04-13T10:58:45.401 INFO:tasks.workunit.client.1.smithi194.stdout:4/786: getdents d2/d16/d1a/d1c/d3e/dbb/dee 0 2024-04-13T10:58:45.402 INFO:tasks.workunit.client.1.smithi194.stdout:7/780: sync 2024-04-13T10:58:45.402 INFO:tasks.workunit.client.1.smithi194.stdout:1/673: sync 2024-04-13T10:58:45.404 INFO:tasks.workunit.client.1.smithi194.stdout:9/736: write d0/d11/d3d/f5d [1399352,53263] 0 2024-04-13T10:58:45.405 INFO:tasks.workunit.client.1.smithi194.stdout:4/787: stat d2/d16/d70/f109 0 2024-04-13T10:58:45.405 INFO:tasks.workunit.client.1.smithi194.stdout:8/845: dwrite d6/d22/d23/d25/d39/f6b [0,4194304] 0 2024-04-13T10:58:45.405 INFO:tasks.workunit.client.1.smithi194.stdout:1/674: stat d12/d13/d1c/c9e 0 2024-04-13T10:58:45.408 INFO:tasks.workunit.client.1.smithi194.stdout:4/788: readlink d2/d30/l4f 0 2024-04-13T10:58:45.408 INFO:tasks.workunit.client.1.smithi194.stdout:5/769: creat d3/dc/d2d/dd1/d20/daa/dae/fee x:0 0 0 2024-04-13T10:58:45.412 INFO:tasks.workunit.client.1.smithi194.stdout:2/755: dwrite d2/d3/f2d [0,4194304] 0 2024-04-13T10:58:45.413 INFO:tasks.workunit.client.1.smithi194.stdout:7/781: chown d1/d2b/d4c/d4f/d85/dbc/cc2 1016234 1 2024-04-13T10:58:45.414 INFO:tasks.workunit.client.1.smithi194.stdout:8/846: chown d6/d22/d23/d25/d39/d41 59755 1 2024-04-13T10:58:45.414 INFO:tasks.workunit.client.1.smithi194.stdout:0/702: dread d9/db1/d30/d73/d87/faa [0,4194304] 0 2024-04-13T10:58:45.417 INFO:tasks.workunit.client.1.smithi194.stdout:6/660: write d0/d42/dbe/d4d/d80/fc7 [508480,47256] 0 2024-04-13T10:58:45.418 INFO:tasks.workunit.client.1.smithi194.stdout:1/675: write d12/d13/d1c/d27/d5c/fb4 [141295,31494] 0 2024-04-13T10:58:45.418 INFO:tasks.workunit.client.1.smithi194.stdout:9/737: write d0/d11/d1e/f6c [2774223,121243] 0 2024-04-13T10:58:45.419 INFO:tasks.workunit.client.1.smithi194.stdout:5/770: write d3/d29/f3f [259316,109206] 0 2024-04-13T10:58:45.420 INFO:tasks.workunit.client.1.smithi194.stdout:7/782: chown d1/d2b/d3e/ddf/d5a/d3c/cb4 8829409 1 2024-04-13T10:58:45.421 INFO:tasks.workunit.client.1.smithi194.stdout:8/847: read d6/d22/d23/d25/d39/d41/d5b/d76/f4f [241894,113108] 0 2024-04-13T10:58:45.421 INFO:tasks.workunit.client.1.smithi194.stdout:6/661: chown d0/d2f/l86 52 1 2024-04-13T10:58:45.422 INFO:tasks.workunit.client.1.smithi194.stdout:2/756: write d2/d3/de/d17/d39/f64 [5144883,95828] 0 2024-04-13T10:58:45.423 INFO:tasks.workunit.client.1.smithi194.stdout:0/703: creat d9/d2b/d6c/ddf/d16/d75/fe6 x:0 0 0 2024-04-13T10:58:45.424 INFO:tasks.workunit.client.1.smithi194.stdout:7/783: readlink d1/d2b/d4c/d4f/l89 0 2024-04-13T10:58:45.425 INFO:tasks.workunit.client.1.smithi194.stdout:6/662: write d0/d26/f5c [437983,49018] 0 2024-04-13T10:58:45.425 INFO:tasks.workunit.client.1.smithi194.stdout:1/676: dread d12/d13/d1c/d28/d41/fc4 [0,4194304] 0 2024-04-13T10:58:45.426 INFO:tasks.workunit.client.1.smithi194.stdout:7/784: readlink d1/d2b/d4c/ld2 0 2024-04-13T10:58:45.427 INFO:tasks.workunit.client.1.smithi194.stdout:2/757: truncate d2/d37/f6a 883950 0 2024-04-13T10:58:45.428 INFO:tasks.workunit.client.1.smithi194.stdout:9/738: mknod d0/d6/d14/d26/cfc 0 2024-04-13T10:58:45.428 INFO:tasks.workunit.client.1.smithi194.stdout:4/789: dread d2/d16/d1a/d1c/d9a/fb7 [0,4194304] 0 2024-04-13T10:58:45.430 INFO:tasks.workunit.client.1.smithi194.stdout:7/785: read - d1/dd9/de1/fd0 zero size 2024-04-13T10:58:45.431 INFO:tasks.workunit.client.1.smithi194.stdout:5/771: getdents d3/dc/ddc 0 2024-04-13T10:58:45.433 INFO:tasks.workunit.client.1.smithi194.stdout:2/758: write d2/d3/de/d17/d1e/fc7 [135976,99575] 0 2024-04-13T10:58:45.437 INFO:tasks.workunit.client.1.smithi194.stdout:7/786: readlink d1/d2b/d4c/d4f/d51/d4d/lb3 0 2024-04-13T10:58:45.439 INFO:tasks.workunit.client.1.smithi194.stdout:4/790: chown d2/d16/d1a/d1c/d54/d62/d10d/l7d 62 1 2024-04-13T10:58:45.439 INFO:tasks.workunit.client.1.smithi194.stdout:8/848: dwrite d6/dd/d45/de3/ff4 [0,4194304] 0 2024-04-13T10:58:45.441 INFO:tasks.workunit.client.1.smithi194.stdout:9/739: link d0/d6/d4a/d74/f8c d0/d88/dac/ffd 0 2024-04-13T10:58:45.442 INFO:tasks.workunit.client.1.smithi194.stdout:0/704: dwrite d9/db/d3a/d9a/dd7/fdd [0,4194304] 0 2024-04-13T10:58:45.444 INFO:tasks.workunit.client.1.smithi194.stdout:2/759: write d2/d3/de/d17/d36/d8f/d57/f69 [550434,52864] 0 2024-04-13T10:58:45.445 INFO:tasks.workunit.client.1.smithi194.stdout:5/772: truncate d3/dc/d2d/dd1/d38/d59/fc7 796475 0 2024-04-13T10:58:45.445 INFO:tasks.workunit.client.1.smithi194.stdout:6/663: dwrite d0/d42/f43 [0,4194304] 0 2024-04-13T10:58:45.454 INFO:tasks.workunit.client.1.smithi194.stdout:0/705: unlink d9/d2b/d6c/db2/fb7 0 2024-04-13T10:58:45.454 INFO:tasks.workunit.client.1.smithi194.stdout:9/740: mkdir d0/dfe 0 2024-04-13T10:58:45.455 INFO:tasks.workunit.client.1.smithi194.stdout:8/849: write d6/dd/d45/de3/ff4 [5038500,77658] 0 2024-04-13T10:58:45.457 INFO:tasks.workunit.client.1.smithi194.stdout:6/664: rmdir d0/d2c/d77/d7f 39 2024-04-13T10:58:45.461 INFO:tasks.workunit.client.1.smithi194.stdout:4/791: rename d2/d16/d1a/d1c/d54/d62/d6e/d99/dd0/fe3 to d2/d16/d1a/d1c/d54/d5d/f10e 0 2024-04-13T10:58:45.461 INFO:tasks.workunit.client.1.smithi194.stdout:1/677: truncate d12/d13/d1c/d27/f57 3419859 0 2024-04-13T10:58:45.462 INFO:tasks.workunit.client.1.smithi194.stdout:5/773: mkdir d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/def 0 2024-04-13T10:58:45.462 INFO:tasks.workunit.client.1.smithi194.stdout:7/787: truncate d1/f29 806657 0 2024-04-13T10:58:45.464 INFO:tasks.workunit.client.1.smithi194.stdout:9/741: mkdir d0/d11/d44/dff 0 2024-04-13T10:58:45.466 INFO:tasks.workunit.client.1.smithi194.stdout:0/706: creat d9/db1/d30/d73/d87/ddc/fe7 x:0 0 0 2024-04-13T10:58:45.467 INFO:tasks.workunit.client.1.smithi194.stdout:6/665: rename d0/d2f/d48/c8d to d0/d2f/d48/d83/d9d/cd4 0 2024-04-13T10:58:45.470 INFO:tasks.workunit.client.1.smithi194.stdout:5/774: rmdir d3/dc/d17 39 2024-04-13T10:58:45.470 INFO:tasks.workunit.client.1.smithi194.stdout:8/850: mkdir d6/d11d 0 2024-04-13T10:58:45.473 INFO:tasks.workunit.client.1.smithi194.stdout:4/792: dwrite d2/d16/d70/d31/fc6 [0,4194304] 0 2024-04-13T10:58:45.478 INFO:tasks.workunit.client.1.smithi194.stdout:7/788: dwrite d1/d2b/d4c/d4f/f70 [0,4194304] 0 2024-04-13T10:58:45.481 INFO:tasks.workunit.client.1.smithi194.stdout:5/775: write d3/dc/d17/f63 [666210,99582] 0 2024-04-13T10:58:45.485 INFO:tasks.workunit.client.1.smithi194.stdout:2/760: getdents d2/d3/de/d17 0 2024-04-13T10:58:45.486 INFO:tasks.workunit.client.1.smithi194.stdout:5/776: readlink d3/dc/d2d/dd1/d38/d59/d49/l91 0 2024-04-13T10:58:45.488 INFO:tasks.workunit.client.1.smithi194.stdout:5/777: write d3/d83/f8f [1439857,124658] 0 2024-04-13T10:58:45.488 INFO:tasks.workunit.client.1.smithi194.stdout:4/793: rename d2/d16/d70/d31 to d2/d16/d1a/d60/d107/d10f 0 2024-04-13T10:58:45.492 INFO:tasks.workunit.client.1.smithi194.stdout:5/778: rmdir d3/dc/d2d/dd1/d20 39 2024-04-13T10:58:45.494 INFO:tasks.workunit.client.1.smithi194.stdout:4/794: creat d2/d16/d1a/d1c/d3e/dbb/dee/dd8/f110 x:0 0 0 2024-04-13T10:58:45.495 INFO:tasks.workunit.client.1.smithi194.stdout:4/795: chown d2/d30/l4f 303 1 2024-04-13T10:58:45.497 INFO:tasks.workunit.client.1.smithi194.stdout:5/779: creat d3/d83/ff0 x:0 0 0 2024-04-13T10:58:45.497 INFO:tasks.workunit.client.1.smithi194.stdout:1/678: dread d12/d13/f18 [0,4194304] 0 2024-04-13T10:58:45.497 INFO:tasks.workunit.client.1.smithi194.stdout:7/789: link d1/d2b/d4c/cc6 d1/d2b/d3e/ddf/d5a/cfa 0 2024-04-13T10:58:45.498 INFO:tasks.workunit.client.1.smithi194.stdout:1/679: readlink d12/l39 0 2024-04-13T10:58:45.501 INFO:tasks.workunit.client.1.smithi194.stdout:6/666: truncate d0/d2f/fad 1712243 0 2024-04-13T10:58:45.502 INFO:tasks.workunit.client.1.smithi194.stdout:8/851: truncate d6/d22/d23/d25/f36 474098 0 2024-04-13T10:58:45.503 INFO:tasks.workunit.client.1.smithi194.stdout:7/790: mknod d1/d2b/d2c/d30/d33/d39/cfb 0 2024-04-13T10:58:45.503 INFO:tasks.workunit.client.1.smithi194.stdout:4/796: link c1 d2/d16/d1a/d60/c111 0 2024-04-13T10:58:45.506 INFO:tasks.workunit.client.1.smithi194.stdout:7/791: readlink d1/d2b/d3e/ddf/dd7/lf5 0 2024-04-13T10:58:45.506 INFO:tasks.workunit.client.1.smithi194.stdout:9/742: dread d0/d6/d14/dcd/fc6 [0,4194304] 0 2024-04-13T10:58:45.506 INFO:tasks.workunit.client.1.smithi194.stdout:5/780: link d3/dc/d2d/dd1/d38/d59/f8b d3/dc/ff1 0 2024-04-13T10:58:45.508 INFO:tasks.workunit.client.1.smithi194.stdout:5/781: chown d3/dc/d2d/f84 236 1 2024-04-13T10:58:45.508 INFO:tasks.workunit.client.1.smithi194.stdout:6/667: rename d0/d42/dbe/d4d/d80/cb9 to d0/d2c/d77/d93/d98/cd5 0 2024-04-13T10:58:45.510 INFO:tasks.workunit.client.1.smithi194.stdout:1/680: getdents d12/d13/d1c/d28/d41 0 2024-04-13T10:58:45.511 INFO:tasks.workunit.client.1.smithi194.stdout:9/743: creat d0/d6/d9/d9e/f100 x:0 0 0 2024-04-13T10:58:45.512 INFO:tasks.workunit.client.1.smithi194.stdout:6/668: fdatasync d0/d26/f29 0 2024-04-13T10:58:45.515 INFO:tasks.workunit.client.1.smithi194.stdout:8/852: dwrite d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3a [8388608,4194304] 0 2024-04-13T10:58:45.516 INFO:tasks.workunit.client.1.smithi194.stdout:6/669: chown d0/d26/d4b/f72 0 1 2024-04-13T10:58:45.517 INFO:tasks.workunit.client.1.smithi194.stdout:5/782: mkdir d3/dc/d17/d1b/d6b/d99/df2 0 2024-04-13T10:58:45.519 INFO:tasks.workunit.client.1.smithi194.stdout:1/681: fdatasync d12/d13/d1c/d27/d4c/d7f/fd0 0 2024-04-13T10:58:45.521 INFO:tasks.workunit.client.1.smithi194.stdout:7/792: creat d1/d2b/d2c/ffc x:0 0 0 2024-04-13T10:58:45.523 INFO:tasks.workunit.client.1.smithi194.stdout:9/744: dwrite d0/d6/d2c/d68/fce [0,4194304] 0 2024-04-13T10:58:45.526 INFO:tasks.workunit.client.1.smithi194.stdout:4/797: truncate d2/d16/d1a/f4c 200722 0 2024-04-13T10:58:45.528 INFO:tasks.workunit.client.1.smithi194.stdout:8/853: mknod d6/d22/d23/d25/d71/da0/de5/dd0/c11e 0 2024-04-13T10:58:45.531 INFO:tasks.workunit.client.1.smithi194.stdout:1/682: dwrite d12/d13/d1c/d27/d2e/fb8 [0,4194304] 0 2024-04-13T10:58:45.534 INFO:tasks.workunit.client.1.smithi194.stdout:7/793: fdatasync d1/d2b/d3e/ddf/fcf 0 2024-04-13T10:58:45.535 INFO:tasks.workunit.client.1.smithi194.stdout:9/745: creat d0/d6/d9/f101 x:0 0 0 2024-04-13T10:58:45.535 INFO:tasks.workunit.client.1.smithi194.stdout:1/683: mknod d12/d13/d1c/d28/d41/d77/d93/cdf 0 2024-04-13T10:58:45.536 INFO:tasks.workunit.client.1.smithi194.stdout:6/670: dread d0/d2c/f32 [0,4194304] 0 2024-04-13T10:58:45.544 INFO:tasks.workunit.client.1.smithi194.stdout:4/798: link d2/d16/d1a/d1c/d3b/fe9 d2/d16/d1a/d1c/d54/d62/d9e/f112 0 2024-04-13T10:58:45.545 INFO:tasks.workunit.client.1.smithi194.stdout:9/746: readlink d0/d11/d44/l8d 0 2024-04-13T10:58:45.545 INFO:tasks.workunit.client.1.smithi194.stdout:1/684: read - d12/d13/d1c/d28/faf zero size 2024-04-13T10:58:45.547 INFO:tasks.workunit.client.1.smithi194.stdout:5/783: dread d3/dc/ff1 [0,4194304] 0 2024-04-13T10:58:45.553 INFO:tasks.workunit.client.1.smithi194.stdout:9/747: rename d0/d11/d58/fc5 to d0/d6/d2c/f102 0 2024-04-13T10:58:45.554 INFO:tasks.workunit.client.1.smithi194.stdout:4/799: dread d2/d16/d1a/d1c/d3b/d8d/fd3 [0,4194304] 0 2024-04-13T10:58:45.556 INFO:tasks.workunit.client.1.smithi194.stdout:1/685: getdents d12/d13/d1c/d27/d4c/d7f/d8b/dbb 0 2024-04-13T10:58:45.557 INFO:tasks.workunit.client.1.smithi194.stdout:1/686: write d12/d13/d1c/d27/f74 [303110,49351] 0 2024-04-13T10:58:45.560 INFO:tasks.workunit.client.1.smithi194.stdout:5/784: creat d3/dc/d2d/dd1/d20/daa/dae/dd4/ff3 x:0 0 0 2024-04-13T10:58:45.561 INFO:tasks.workunit.client.1.smithi194.stdout:4/800: creat d2/d16/d1a/d1c/d9a/f113 x:0 0 0 2024-04-13T10:58:45.562 INFO:tasks.workunit.client.1.smithi194.stdout:7/794: dread d1/f41 [0,4194304] 0 2024-04-13T10:58:45.563 INFO:tasks.workunit.client.1.smithi194.stdout:6/671: getdents d0/d2f/d48 0 2024-04-13T10:58:45.564 INFO:tasks.workunit.client.1.smithi194.stdout:1/687: fdatasync d12/d13/d44/fa1 0 2024-04-13T10:58:45.565 INFO:tasks.workunit.client.1.smithi194.stdout:4/801: dread - d2/d16/d1a/d1c/d54/d5d/f7e zero size 2024-04-13T10:58:45.567 INFO:tasks.workunit.client.1.smithi194.stdout:5/785: dwrite d3/d83/fbb [0,4194304] 0 2024-04-13T10:58:45.567 INFO:tasks.workunit.client.1.smithi194.stdout:6/672: creat d0/d26/dcb/fd6 x:0 0 0 2024-04-13T10:58:45.570 INFO:tasks.workunit.client.1.smithi194.stdout:4/802: readlink d2/d16/d1a/d1c/d3b/d42/le2 0 2024-04-13T10:58:45.570 INFO:tasks.workunit.client.1.smithi194.stdout:5/786: stat d3/dc/d2d/dd1/d38/d59/d49/dbf 0 2024-04-13T10:58:45.572 INFO:tasks.workunit.client.1.smithi194.stdout:6/673: creat d0/d57/db7/dbc/dc4/fd7 x:0 0 0 2024-04-13T10:58:45.574 INFO:tasks.workunit.client.1.smithi194.stdout:5/787: truncate d3/dc/faf 700689 0 2024-04-13T10:58:45.575 INFO:tasks.workunit.client.1.smithi194.stdout:1/688: dwrite d12/d13/d1c/d27/d4c/d7f/d8b/fc0 [0,4194304] 0 2024-04-13T10:58:45.577 INFO:tasks.workunit.client.1.smithi194.stdout:4/803: mkdir d2/d16/d1a/d1c/d3b/d114 0 2024-04-13T10:58:45.577 INFO:tasks.workunit.client.1.smithi194.stdout:3/691: sync 2024-04-13T10:58:45.581 INFO:tasks.workunit.client.1.smithi194.stdout:6/674: creat d0/d2f/fd8 x:0 0 0 2024-04-13T10:58:45.584 INFO:tasks.workunit.client.1.smithi194.stdout:5/788: creat d3/dc/d2d/dd1/d20/daa/dae/dd4/ff4 x:0 0 0 2024-04-13T10:58:45.586 INFO:tasks.workunit.client.1.smithi194.stdout:9/748: dwrite d0/d88/dac/ffd [0,4194304] 0 2024-04-13T10:58:45.586 INFO:tasks.workunit.client.1.smithi194.stdout:3/692: rmdir d2/d3/d12/d31/d34/d88 39 2024-04-13T10:58:45.588 INFO:tasks.workunit.client.1.smithi194.stdout:6/675: rmdir d0/d57/db7/dbc 39 2024-04-13T10:58:45.588 INFO:tasks.workunit.client.1.smithi194.stdout:5/789: write d3/d83/f82 [2672111,107754] 0 2024-04-13T10:58:45.588 INFO:tasks.workunit.client.1.smithi194.stdout:9/749: readlink d0/d88/ld9 0 2024-04-13T10:58:45.589 INFO:tasks.workunit.client.1.smithi194.stdout:1/689: creat d12/d13/d1c/d28/d41/db0/fe0 x:0 0 0 2024-04-13T10:58:45.589 INFO:tasks.workunit.client.1.smithi194.stdout:7/795: dwrite d1/d2b/d4c/d4f/d51/d4d/d5e/fc7 [0,4194304] 0 2024-04-13T10:58:45.592 INFO:tasks.workunit.client.1.smithi194.stdout:6/676: readlink d0/d26/l4c 0 2024-04-13T10:58:45.592 INFO:tasks.workunit.client.1.smithi194.stdout:9/750: fdatasync d0/d6/d14/ff2 0 2024-04-13T10:58:45.595 INFO:tasks.workunit.client.1.smithi194.stdout:7/796: write d1/d2b/d4c/d4f/d6e/fde [4086911,40209] 0 2024-04-13T10:58:45.596 INFO:tasks.workunit.client.1.smithi194.stdout:6/677: mknod d0/d42/dbe/d4d/cd9 0 2024-04-13T10:58:45.599 INFO:tasks.workunit.client.1.smithi194.stdout:7/797: write d1/d2b/d3e/f9f [964626,84305] 0 2024-04-13T10:58:45.599 INFO:tasks.workunit.client.1.smithi194.stdout:9/751: mkdir d0/d6/d4a/d74/dae/d103 0 2024-04-13T10:58:45.599 INFO:tasks.workunit.client.1.smithi194.stdout:1/690: getdents d12/d3a/d4f/da3 0 2024-04-13T10:58:45.600 INFO:tasks.workunit.client.1.smithi194.stdout:5/790: mkdir d3/dc/d2d/dd1/d38/d59/d7a/df5 0 2024-04-13T10:58:45.602 INFO:tasks.workunit.client.1.smithi194.stdout:3/693: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/ce7 0 2024-04-13T10:58:45.603 INFO:tasks.workunit.client.1.smithi194.stdout:5/791: read d3/dc/f7d [310132,41383] 0 2024-04-13T10:58:45.603 INFO:tasks.workunit.client.1.smithi194.stdout:9/752: creat d0/d88/dac/f104 x:0 0 0 2024-04-13T10:58:45.604 INFO:tasks.workunit.client.1.smithi194.stdout:6/678: symlink d0/d2c/d77/d7f/lda 0 2024-04-13T10:58:45.606 INFO:tasks.workunit.client.1.smithi194.stdout:6/679: fsync d0/d42/dbe/f7a 0 2024-04-13T10:58:45.607 INFO:tasks.workunit.client.1.smithi194.stdout:5/792: symlink d3/dc/d17/d1b/d6b/lf6 0 2024-04-13T10:58:45.608 INFO:tasks.workunit.client.1.smithi194.stdout:1/691: link d12/d13/d44/ld2 d12/d3a/d4f/da3/le1 0 2024-04-13T10:58:45.609 INFO:tasks.workunit.client.1.smithi194.stdout:9/753: creat d0/d6/d14/dcd/dd6/f105 x:0 0 0 2024-04-13T10:58:45.610 INFO:tasks.workunit.client.1.smithi194.stdout:7/798: dread d1/d2b/d3e/f9f [0,4194304] 0 2024-04-13T10:58:45.611 INFO:tasks.workunit.client.1.smithi194.stdout:1/692: write d12/f5b [547766,10625] 0 2024-04-13T10:58:45.614 INFO:tasks.workunit.client.1.smithi194.stdout:3/694: dwrite d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:45.614 INFO:tasks.workunit.client.1.smithi194.stdout:5/793: mkdir d3/dc/d2d/dd1/df7 0 2024-04-13T10:58:45.614 INFO:tasks.workunit.client.1.smithi194.stdout:6/680: getdents d0/d2c/d77/d7f/dba 0 2024-04-13T10:58:45.616 INFO:tasks.workunit.client.1.smithi194.stdout:4/804: dread d2/d16/d70/f51 [0,4194304] 0 2024-04-13T10:58:45.616 INFO:tasks.workunit.client.1.smithi194.stdout:9/754: write d0/d6/d4a/d74/fd3 [79836,65314] 0 2024-04-13T10:58:45.617 INFO:tasks.workunit.client.1.smithi194.stdout:1/693: mknod d12/d3a/d4f/da3/ce2 0 2024-04-13T10:58:45.618 INFO:tasks.workunit.client.1.smithi194.stdout:7/799: creat d1/d2b/d3e/ddf/d5a/d3c/ffd x:0 0 0 2024-04-13T10:58:45.619 INFO:tasks.workunit.client.1.smithi194.stdout:5/794: chown d3/dc/d2d/dd1/l8d 427 1 2024-04-13T10:58:45.620 INFO:tasks.workunit.client.1.smithi194.stdout:9/755: dread d0/d6/d4a/d74/fd3 [0,4194304] 0 2024-04-13T10:58:45.622 INFO:tasks.workunit.client.1.smithi194.stdout:6/681: rmdir d0/d53/d78 39 2024-04-13T10:58:45.624 INFO:tasks.workunit.client.1.smithi194.stdout:3/695: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5/le8 0 2024-04-13T10:58:45.625 INFO:tasks.workunit.client.1.smithi194.stdout:6/682: dread d0/d26/d4b/f59 [0,4194304] 0 2024-04-13T10:58:45.625 INFO:tasks.workunit.client.1.smithi194.stdout:9/756: dread d0/f3 [0,4194304] 0 2024-04-13T10:58:45.628 INFO:tasks.workunit.client.1.smithi194.stdout:4/805: getdents d2/d16/d1a/d1c/d54/d5d/db2/dfc 0 2024-04-13T10:58:45.629 INFO:tasks.workunit.client.1.smithi194.stdout:1/694: fsync d12/d13/d1c/d27/d5c/db6/fdb 0 2024-04-13T10:58:45.632 INFO:tasks.workunit.client.1.smithi194.stdout:3/696: creat d2/dce/ddc/fe9 x:0 0 0 2024-04-13T10:58:45.633 INFO:tasks.workunit.client.1.smithi194.stdout:6/683: creat d0/d2f/d48/d83/d9d/fdb x:0 0 0 2024-04-13T10:58:45.635 INFO:tasks.workunit.client.1.smithi194.stdout:6/684: chown d0/d53/f60 474189509 1 2024-04-13T10:58:45.636 INFO:tasks.workunit.client.1.smithi194.stdout:4/806: mkdir d2/d16/d1a/d1c/d3b/d8d/d115 0 2024-04-13T10:58:45.636 INFO:tasks.workunit.client.1.smithi194.stdout:1/695: dwrite d12/d13/d3e/fa8 [0,4194304] 0 2024-04-13T10:58:45.637 INFO:tasks.workunit.client.1.smithi194.stdout:5/795: truncate d3/dc/d17/d1b/f47 725681 0 2024-04-13T10:58:45.637 INFO:tasks.workunit.client.1.smithi194.stdout:6/685: chown d0/d2c/d77/d93/fa9 1111276 1 2024-04-13T10:58:45.639 INFO:tasks.workunit.client.1.smithi194.stdout:6/686: chown d0/d2c/d77/ca6 44451891 1 2024-04-13T10:58:45.639 INFO:tasks.workunit.client.1.smithi194.stdout:6/687: chown d0/lf 19690888 1 2024-04-13T10:58:45.640 INFO:tasks.workunit.client.1.smithi194.stdout:6/688: read d0/d53/f60 [111619,123693] 0 2024-04-13T10:58:45.643 INFO:tasks.workunit.client.1.smithi194.stdout:1/696: creat d12/d13/d3e/fe3 x:0 0 0 2024-04-13T10:58:45.645 INFO:tasks.workunit.client.1.smithi194.stdout:4/807: mknod d2/d16/d1a/d1c/d54/d5d/c116 0 2024-04-13T10:58:45.646 INFO:tasks.workunit.client.1.smithi194.stdout:5/796: rmdir d3/dc/d17/d1b/d6b 39 2024-04-13T10:58:45.646 INFO:tasks.workunit.client.1.smithi194.stdout:5/797: chown d3/dc/d2d/f84 230120901 1 2024-04-13T10:58:45.647 INFO:tasks.workunit.client.1.smithi194.stdout:9/757: getdents d0/dde 0 2024-04-13T10:58:45.650 INFO:tasks.workunit.client.1.smithi194.stdout:6/689: creat d0/d2c/d77/d93/daa/fdc x:0 0 0 2024-04-13T10:58:45.650 INFO:tasks.workunit.client.1.smithi194.stdout:9/758: write d0/d6/fc3 [252554,34504] 0 2024-04-13T10:58:45.652 INFO:tasks.workunit.client.1.smithi194.stdout:1/697: mknod d12/d13/d1c/ce4 0 2024-04-13T10:58:45.653 INFO:tasks.workunit.client.1.smithi194.stdout:7/800: dwrite d1/f24 [4194304,4194304] 0 2024-04-13T10:58:45.656 INFO:tasks.workunit.client.1.smithi194.stdout:3/697: write d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/f8b [883023,85721] 0 2024-04-13T10:58:45.656 INFO:tasks.workunit.client.1.smithi194.stdout:6/690: creat d0/d2f/d48/fdd x:0 0 0 2024-04-13T10:58:45.658 INFO:tasks.workunit.client.1.smithi194.stdout:4/808: creat d2/d16/d1a/f117 x:0 0 0 2024-04-13T10:58:45.659 INFO:tasks.workunit.client.1.smithi194.stdout:7/801: rename d1/d2b/d3e/ddf to d1/d2b/d3e/ddf/d5a/d3c/dfe 22 2024-04-13T10:58:45.659 INFO:tasks.workunit.client.1.smithi194.stdout:5/798: dread d3/d83/fbb [0,4194304] 0 2024-04-13T10:58:45.660 INFO:tasks.workunit.client.1.smithi194.stdout:4/809: stat d2/d16/d70/f51 0 2024-04-13T10:58:45.664 INFO:tasks.workunit.client.1.smithi194.stdout:5/799: mkdir d3/dc/ddc/df8 0 2024-04-13T10:58:45.665 INFO:tasks.workunit.client.1.smithi194.stdout:6/691: dwrite d0/d53/f81 [0,4194304] 0 2024-04-13T10:58:45.665 INFO:tasks.workunit.client.1.smithi194.stdout:7/802: rmdir d1/d2b/d4c/d4f/d85/d88 39 2024-04-13T10:58:45.666 INFO:tasks.workunit.client.1.smithi194.stdout:1/698: write d12/d13/d1c/d28/f49 [538098,66834] 0 2024-04-13T10:58:45.666 INFO:tasks.workunit.client.1.smithi194.stdout:3/698: creat d2/dce/ddc/de2/fea x:0 0 0 2024-04-13T10:58:45.668 INFO:tasks.workunit.client.1.smithi194.stdout:4/810: dread d2/d16/d70/f51 [0,4194304] 0 2024-04-13T10:58:45.670 INFO:tasks.workunit.client.1.smithi194.stdout:6/692: unlink d0/d42/dbe/d4d/d80/cc1 0 2024-04-13T10:58:45.670 INFO:tasks.workunit.client.1.smithi194.stdout:9/759: fsync d0/d6/d14/d26/d42/f6f 0 2024-04-13T10:58:45.671 INFO:tasks.workunit.client.1.smithi194.stdout:7/803: symlink d1/dd9/de1/dab/d96/lff 0 2024-04-13T10:58:45.673 INFO:tasks.workunit.client.1.smithi194.stdout:4/811: creat d2/d16/d1a/d1c/d3e/f118 x:0 0 0 2024-04-13T10:58:45.675 INFO:tasks.workunit.client.1.smithi194.stdout:9/760: symlink d0/d6/d14/dcd/da4/l106 0 2024-04-13T10:58:45.677 INFO:tasks.workunit.client.1.smithi194.stdout:9/761: write d0/d11/d3d/d9b/fb7 [649530,20548] 0 2024-04-13T10:58:45.678 INFO:tasks.workunit.client.1.smithi194.stdout:7/804: mknod d1/c100 0 2024-04-13T10:58:45.679 INFO:tasks.workunit.client.1.smithi194.stdout:5/800: link d3/dc/d2d/dd1/d20/c4b d3/dc/d17/d1b/dce/cf9 0 2024-04-13T10:58:45.681 INFO:tasks.workunit.client.1.smithi194.stdout:6/693: dread d0/d2c/f41 [0,4194304] 0 2024-04-13T10:58:45.682 INFO:tasks.workunit.client.1.smithi194.stdout:5/801: symlink d3/dc/d2d/dd1/d38/d59/de6/lfa 0 2024-04-13T10:58:45.683 INFO:tasks.workunit.client.1.smithi194.stdout:7/805: creat d1/d2b/d3e/ddf/d5a/d3c/def/f101 x:0 0 0 2024-04-13T10:58:45.695 INFO:tasks.workunit.client.1.smithi194.stdout:6/694: link d0/d42/dbe/d4d/d80/l92 d0/d53/d78/lde 0 2024-04-13T10:58:45.696 INFO:tasks.workunit.client.1.smithi194.stdout:6/695: chown d0/d53/d78/fcc 0 1 2024-04-13T10:58:45.696 INFO:tasks.workunit.client.1.smithi194.stdout:5/802: write d3/dc/d17/d1b/d6b/d99/fd2 [1026536,83466] 0 2024-04-13T10:58:45.697 INFO:tasks.workunit.client.1.smithi194.stdout:5/803: fsync d3/dc/faf 0 2024-04-13T10:58:45.700 INFO:tasks.workunit.client.1.smithi194.stdout:6/696: symlink d0/d2f/d48/d83/d9d/ldf 0 2024-04-13T10:58:45.700 INFO:tasks.workunit.client.1.smithi194.stdout:6/697: chown d0/d2c/d77 619220 1 2024-04-13T10:58:45.700 INFO:tasks.workunit.client.1.smithi194.stdout:5/804: mkdir d3/dc/d17/d93/dfb 0 2024-04-13T10:58:45.704 INFO:tasks.workunit.client.1.smithi194.stdout:5/805: symlink d3/dc/d2d/dd1/d38/lfc 0 2024-04-13T10:58:45.706 INFO:tasks.workunit.client.1.smithi194.stdout:7/806: dread d1/d8b/f93 [0,4194304] 0 2024-04-13T10:58:45.708 INFO:tasks.workunit.client.1.smithi194.stdout:9/762: dread d0/d6/d9/f48 [0,4194304] 0 2024-04-13T10:58:45.710 INFO:tasks.workunit.client.1.smithi194.stdout:5/806: getdents d3 0 2024-04-13T10:58:45.711 INFO:tasks.workunit.client.1.smithi194.stdout:6/698: dwrite d0/d57/d69/f64 [4194304,4194304] 0 2024-04-13T10:58:45.713 INFO:tasks.workunit.client.1.smithi194.stdout:1/699: dread d12/f81 [0,4194304] 0 2024-04-13T10:58:45.713 INFO:tasks.workunit.client.1.smithi194.stdout:7/807: chown d1/d2b/d4c/d4f/d85/d88/d9b/db8/fe3 1227963199 1 2024-04-13T10:58:45.714 INFO:tasks.workunit.client.1.smithi194.stdout:9/763: creat d0/d6/d2c/f107 x:0 0 0 2024-04-13T10:58:45.714 INFO:tasks.workunit.client.1.smithi194.stdout:6/699: mkdir d0/d42/d7b/db4/de0 0 2024-04-13T10:58:45.718 INFO:tasks.workunit.client.1.smithi194.stdout:9/764: dread - d0/d6/d14/d6d/fe6 zero size 2024-04-13T10:58:45.718 INFO:tasks.workunit.client.1.smithi194.stdout:9/765: truncate d0/d11/d3d/fc2 531984 0 2024-04-13T10:58:45.719 INFO:tasks.workunit.client.1.smithi194.stdout:9/766: stat d0/d6/d14/dcd/da4/l106 0 2024-04-13T10:58:45.721 INFO:tasks.workunit.client.1.smithi194.stdout:6/700: write d0/d2c/f31 [1742154,59036] 0 2024-04-13T10:58:45.721 INFO:tasks.workunit.client.1.smithi194.stdout:1/700: mknod d12/d13/d1c/d27/d4c/dd7/ce5 0 2024-04-13T10:58:45.722 INFO:tasks.workunit.client.1.smithi194.stdout:7/808: truncate d1/fe 190325 0 2024-04-13T10:58:45.724 INFO:tasks.workunit.client.1.smithi194.stdout:7/809: read - d1/d2b/d3e/ddf/d5a/d3c/ffd zero size 2024-04-13T10:58:45.724 INFO:tasks.workunit.client.1.smithi194.stdout:1/701: chown d12/d13/d1c/d27/la2 495088 1 2024-04-13T10:58:45.724 INFO:tasks.workunit.client.1.smithi194.stdout:9/767: mknod d0/d11/c108 0 2024-04-13T10:58:45.725 INFO:tasks.workunit.client.1.smithi194.stdout:5/807: getdents d3/dc/d2d/dd1/d38/d59/d49/dbf/dea 0 2024-04-13T10:58:45.727 INFO:tasks.workunit.client.1.smithi194.stdout:5/808: write d3/dc/d2d/dd1/d38/d59/d49/f88 [4788675,121818] 0 2024-04-13T10:58:45.728 INFO:tasks.workunit.client.1.smithi194.stdout:9/768: creat d0/d6/d9/dd7/f109 x:0 0 0 2024-04-13T10:58:45.733 INFO:tasks.workunit.client.1.smithi194.stdout:6/701: truncate d0/d2f/d6f/f89 3582745 0 2024-04-13T10:58:45.734 INFO:tasks.workunit.client.1.smithi194.stdout:9/769: rename d0/d6/d9/f101 to d0/d6/d14/d26/d7f/f10a 0 2024-04-13T10:58:45.736 INFO:tasks.workunit.client.1.smithi194.stdout:9/770: chown d0/d11/d44/lc9 60085 1 2024-04-13T10:58:45.736 INFO:tasks.workunit.client.1.smithi194.stdout:5/809: dwrite d3/d83/fbb [0,4194304] 0 2024-04-13T10:58:45.736 INFO:tasks.workunit.client.1.smithi194.stdout:7/810: truncate d1/d2b/d2c/d30/d33/d39/f66 2535891 0 2024-04-13T10:58:45.739 INFO:tasks.workunit.client.1.smithi194.stdout:9/771: getdents d0/d6/d2c/dba 0 2024-04-13T10:58:45.744 INFO:tasks.workunit.client.1.smithi194.stdout:9/772: mkdir d0/d11/da3/d10b 0 2024-04-13T10:58:45.745 INFO:tasks.workunit.client.1.smithi194.stdout:6/702: dwrite d0/d53/d78/fcc [0,4194304] 0 2024-04-13T10:58:45.748 INFO:tasks.workunit.client.1.smithi194.stdout:5/810: dwrite d3/dc/d2d/dd1/db5/fdf [0,4194304] 0 2024-04-13T10:58:45.752 INFO:tasks.workunit.client.1.smithi194.stdout:9/773: mknod d0/d11/d79/c10c 0 2024-04-13T10:58:45.752 INFO:tasks.workunit.client.1.smithi194.stdout:5/811: write d3/d83/f82 [4108434,120268] 0 2024-04-13T10:58:45.755 INFO:tasks.workunit.client.1.smithi194.stdout:6/703: creat d0/d53/fe1 x:0 0 0 2024-04-13T10:58:45.758 INFO:tasks.workunit.client.1.smithi194.stdout:5/812: read d3/dc/d2d/dd1/d20/f43 [1797680,123841] 0 2024-04-13T10:58:45.758 INFO:tasks.workunit.client.1.smithi194.stdout:9/774: rename d0/d6/d2c/db5/ced to d0/d11/da3/c10d 0 2024-04-13T10:58:45.761 INFO:tasks.workunit.client.1.smithi194.stdout:7/811: dread d1/d2b/d2c/d30/d33/d39/f4b [0,4194304] 0 2024-04-13T10:58:45.763 INFO:tasks.workunit.client.1.smithi194.stdout:6/704: dwrite d0/d26/f23 [0,4194304] 0 2024-04-13T10:58:45.764 INFO:tasks.workunit.client.1.smithi194.stdout:6/705: chown d0/d42/dbe/d4d/fd2 2240 1 2024-04-13T10:58:45.765 INFO:tasks.workunit.client.1.smithi194.stdout:7/812: rmdir d1/d2b/d2c/d30 39 2024-04-13T10:58:45.766 INFO:tasks.workunit.client.1.smithi194.stdout:5/813: creat d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/db1/ffd x:0 0 0 2024-04-13T10:58:45.771 INFO:tasks.workunit.client.1.smithi194.stdout:7/813: getdents d1/d6c 0 2024-04-13T10:58:45.772 INFO:tasks.workunit.client.1.smithi194.stdout:5/814: getdents d3/dc 0 2024-04-13T10:58:45.774 INFO:tasks.workunit.client.1.smithi194.stdout:7/814: getdents d1/d2b 0 2024-04-13T10:58:45.775 INFO:tasks.workunit.client.1.smithi194.stdout:7/815: chown d1/dd9/de1/dab/d96/fec 1727 1 2024-04-13T10:58:45.775 INFO:tasks.workunit.client.1.smithi194.stdout:5/815: creat d3/dc/d17/d93/dfb/ffe x:0 0 0 2024-04-13T10:58:45.776 INFO:tasks.workunit.client.1.smithi194.stdout:5/816: chown d3/dc/d2d/f36 6 1 2024-04-13T10:58:45.778 INFO:tasks.workunit.client.1.smithi194.stdout:7/816: symlink d1/d2b/d2c/d30/d33/l102 0 2024-04-13T10:58:45.781 INFO:tasks.workunit.client.1.smithi194.stdout:7/817: creat d1/d2b/d4c/d4f/d85/d88/f103 x:0 0 0 2024-04-13T10:58:45.782 INFO:tasks.workunit.client.1.smithi194.stdout:5/817: dwrite d3/d29/f3f [0,4194304] 0 2024-04-13T10:58:45.783 INFO:tasks.workunit.client.1.smithi194.stdout:5/818: write d3/dc/d17/d1b/d6b/d99/fdb [1479637,77496] 0 2024-04-13T10:58:45.784 INFO:tasks.workunit.client.1.smithi194.stdout:5/819: dread - d3/d83/ff0 zero size 2024-04-13T10:58:45.789 INFO:tasks.workunit.client.1.smithi194.stdout:5/820: link d3/dc/d2d/dd1/ce5 d3/dc/d2d/dd1/d38/d59/cff 0 2024-04-13T10:58:45.801 INFO:tasks.workunit.client.1.smithi194.stdout:7/818: dread d1/f12 [0,4194304] 0 2024-04-13T10:58:45.804 INFO:tasks.workunit.client.1.smithi194.stdout:7/819: creat d1/d2b/d3e/ddf/d5a/d7d/f104 x:0 0 0 2024-04-13T10:58:45.805 INFO:tasks.workunit.client.1.smithi194.stdout:5/821: dwrite d3/dc/d2d/dd1/d38/f44 [0,4194304] 0 2024-04-13T10:58:45.809 INFO:tasks.workunit.client.1.smithi194.stdout:7/820: link d1/d2b/d4c/ld2 d1/d2b/d3e/ddf/d5a/d3c/def/l105 0 2024-04-13T10:58:45.810 INFO:tasks.workunit.client.1.smithi194.stdout:7/821: chown d1/d2b/d3e/ddf/c55 12206233 1 2024-04-13T10:58:45.813 INFO:tasks.workunit.client.1.smithi194.stdout:5/822: dwrite d3/dc/d17/d1b/d6b/d99/fd2 [0,4194304] 0 2024-04-13T10:58:45.813 INFO:tasks.workunit.client.1.smithi194.stdout:7/822: write d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f6d [3442200,23101] 0 2024-04-13T10:58:45.815 INFO:tasks.workunit.client.1.smithi194.stdout:5/823: readlink d3/dc/d2d/ld0 0 2024-04-13T10:58:45.816 INFO:tasks.workunit.client.1.smithi194.stdout:5/824: write d3/dc/d17/d1b/d6b/d99/fe0 [402324,102861] 0 2024-04-13T10:58:45.819 INFO:tasks.workunit.client.1.smithi194.stdout:7/823: rename d1/f95 to d1/d2b/d3e/ddf/d5a/f106 0 2024-04-13T10:58:45.831 INFO:tasks.workunit.client.1.smithi194.stdout:7/824: stat d1/d2b/d4c/d4f/d51/l27 0 2024-04-13T10:58:45.831 INFO:tasks.workunit.client.1.smithi194.stdout:5/825: write d3/dc/d2d/dd1/d38/f51 [1195127,91833] 0 2024-04-13T10:58:45.835 INFO:tasks.workunit.client.1.smithi194.stdout:7/825: getdents d1/d2b/d4c/d4f/d85/d88/d9b 0 2024-04-13T10:58:45.837 INFO:tasks.workunit.client.1.smithi194.stdout:7/826: fsync d1/d2b/d3e/ddf/d5a/d3c/ffd 0 2024-04-13T10:58:45.837 INFO:tasks.workunit.client.1.smithi194.stdout:5/826: dwrite d3/dc/d2d/dd1/f2e [0,4194304] 0 2024-04-13T10:58:45.841 INFO:tasks.workunit.client.1.smithi194.stdout:5/827: dread d3/dc/d2d/dd1/d38/f44 [0,4194304] 0 2024-04-13T10:58:45.843 INFO:tasks.workunit.client.1.smithi194.stdout:7/827: creat d1/d2b/d4c/d4f/d51/d4d/d5e/f107 x:0 0 0 2024-04-13T10:58:45.845 INFO:tasks.workunit.client.1.smithi194.stdout:5/828: truncate d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/db1/ffd 401034 0 2024-04-13T10:58:45.854 INFO:tasks.workunit.client.1.smithi194.stdout:5/829: dread d3/dc/d17/f74 [0,4194304] 0 2024-04-13T10:58:45.855 INFO:tasks.workunit.client.1.smithi194.stdout:7/828: dread d1/d2b/d4c/d4f/d51/d4d/fc1 [0,4194304] 0 2024-04-13T10:58:45.858 INFO:tasks.workunit.client.1.smithi194.stdout:5/830: rename d3/dc/d2d/dd1/d20/f43 to d3/dc/d2d/dd1/d38/d59/d7a/f100 0 2024-04-13T10:58:45.860 INFO:tasks.workunit.client.1.smithi194.stdout:7/829: mkdir d1/d2b/d3e/d9c/dc5/d108 0 2024-04-13T10:58:45.861 INFO:tasks.workunit.client.1.smithi194.stdout:5/831: creat d3/dc/d2d/dd1/d38/d59/d7a/f101 x:0 0 0 2024-04-13T10:58:45.862 INFO:tasks.workunit.client.1.smithi194.stdout:7/830: rmdir d1/dd9/de1/dab 39 2024-04-13T10:58:45.863 INFO:tasks.workunit.client.1.smithi194.stdout:5/832: dread d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/db1/ffd [0,4194304] 0 2024-04-13T10:58:45.868 INFO:tasks.workunit.client.1.smithi194.stdout:5/833: dwrite d3/dc/d2d/dd1/d38/d59/fc7 [0,4194304] 0 2024-04-13T10:58:45.870 INFO:tasks.workunit.client.1.smithi194.stdout:5/834: write d3/dc/d2d/dd1/d38/d59/d7a/f9e [71223,6884] 0 2024-04-13T10:58:45.876 INFO:tasks.workunit.client.1.smithi194.stdout:5/835: unlink d3/dc/d17/d1b/f47 0 2024-04-13T10:58:45.877 INFO:tasks.workunit.client.1.smithi194.stdout:5/836: creat d3/d83/f102 x:0 0 0 2024-04-13T10:58:45.878 INFO:tasks.workunit.client.1.smithi194.stdout:5/837: dread - d3/dc/d2d/dd1/d20/daa/dae/dd4/ff3 zero size 2024-04-13T10:58:45.881 INFO:tasks.workunit.client.1.smithi194.stdout:5/838: symlink d3/dc/d17/l103 0 2024-04-13T10:58:45.881 INFO:tasks.workunit.client.1.smithi194.stdout:5/839: dread - d3/fd8 zero size 2024-04-13T10:58:45.887 INFO:tasks.workunit.client.1.smithi194.stdout:5/840: truncate d3/dc/d2d/dd1/d20/f66 155562 0 2024-04-13T10:58:45.888 INFO:tasks.workunit.client.1.smithi194.stdout:5/841: rmdir d3/dc/d2d/dd1/d20 39 2024-04-13T10:58:45.894 INFO:tasks.workunit.client.1.smithi194.stdout:5/842: truncate d3/dc/d2d/dd1/d38/f51 537197 0 2024-04-13T10:58:45.896 INFO:tasks.workunit.client.1.smithi194.stdout:5/843: mkdir d3/dc/d2d/dd1/d38/d59/d7a/d104 0 2024-04-13T10:58:45.896 INFO:tasks.workunit.client.1.smithi194.stdout:5/844: stat d3/d83/c3a 0 2024-04-13T10:58:45.901 INFO:tasks.workunit.client.1.smithi194.stdout:5/845: dwrite d3/dc/d17/d1b/d6b/d99/fe0 [0,4194304] 0 2024-04-13T10:58:45.903 INFO:tasks.workunit.client.1.smithi194.stdout:5/846: chown d3/dc/d2d/dd1/d38/d59/d7a/df5 1772 1 2024-04-13T10:58:45.908 INFO:tasks.workunit.client.1.smithi194.stdout:5/847: rename d3/dc/d17/d1b/dce/cf9 to d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/c105 0 2024-04-13T10:58:45.911 INFO:tasks.workunit.client.1.smithi194.stdout:5/848: dread d3/dc/d2d/dd1/f3b [0,4194304] 0 2024-04-13T10:58:45.912 INFO:tasks.workunit.client.1.smithi194.stdout:5/849: creat d3/d29/f106 x:0 0 0 2024-04-13T10:58:45.914 INFO:tasks.workunit.client.1.smithi194.stdout:5/850: symlink d3/dc/d17/d1b/d6b/d99/df2/l107 0 2024-04-13T10:58:45.917 INFO:tasks.workunit.client.1.smithi194.stdout:5/851: mknod d3/dc/d2d/dd1/d20/c108 0 2024-04-13T10:58:45.918 INFO:tasks.workunit.client.1.smithi194.stdout:5/852: creat d3/d29/f109 x:0 0 0 2024-04-13T10:58:45.920 INFO:tasks.workunit.client.1.smithi194.stdout:5/853: creat d3/dc/d2d/dd1/df7/f10a x:0 0 0 2024-04-13T10:58:45.921 INFO:tasks.workunit.client.1.smithi194.stdout:8/854: sync 2024-04-13T10:58:45.921 INFO:tasks.workunit.client.1.smithi194.stdout:0/707: sync 2024-04-13T10:58:45.921 INFO:tasks.workunit.client.1.smithi194.stdout:2/761: sync 2024-04-13T10:58:45.922 INFO:tasks.workunit.client.1.smithi194.stdout:5/854: truncate d3/dc/d2d/dd1/fe7 668938 0 2024-04-13T10:58:45.923 INFO:tasks.workunit.client.1.smithi194.stdout:2/762: read d2/d3/de/d17/d36/d3d/fd3 [3364474,99561] 0 2024-04-13T10:58:45.924 INFO:tasks.workunit.client.1.smithi194.stdout:5/855: write d3/d29/f109 [307087,64574] 0 2024-04-13T10:58:45.926 INFO:tasks.workunit.client.1.smithi194.stdout:2/763: rmdir d2/d3/de/d33/d47/dbb 39 2024-04-13T10:58:45.928 INFO:tasks.workunit.client.1.smithi194.stdout:5/856: dread d3/dc/d2d/dd1/fb6 [0,4194304] 0 2024-04-13T10:58:45.928 INFO:tasks.workunit.client.1.smithi194.stdout:0/708: dread d9/d2b/d6c/ddf/f14 [0,4194304] 0 2024-04-13T10:58:45.929 INFO:tasks.workunit.client.1.smithi194.stdout:8/855: dwrite d6/dd/fa6 [0,4194304] 0 2024-04-13T10:58:45.930 INFO:tasks.workunit.client.1.smithi194.stdout:0/709: chown d9/d2b/d6c/ddf/f4c 53116000 1 2024-04-13T10:58:45.931 INFO:tasks.workunit.client.1.smithi194.stdout:2/764: creat d2/d3/de/d17/d36/d3d/ffc x:0 0 0 2024-04-13T10:58:45.933 INFO:tasks.workunit.client.1.smithi194.stdout:8/856: symlink d6/d22/d23/d7f/d8c/l11f 0 2024-04-13T10:58:45.933 INFO:tasks.workunit.client.1.smithi194.stdout:8/857: stat d6/d22/cb2 0 2024-04-13T10:58:45.935 INFO:tasks.workunit.client.1.smithi194.stdout:8/858: chown d6/d22/d23/d25/d71/da0/de5/deb/db1/l100 5 1 2024-04-13T10:58:45.935 INFO:tasks.workunit.client.1.smithi194.stdout:5/857: unlink d3/dc/d17/fc9 0 2024-04-13T10:58:45.935 INFO:tasks.workunit.client.1.smithi194.stdout:8/859: fsync d6/dd/f118 0 2024-04-13T10:58:45.939 INFO:tasks.workunit.client.1.smithi194.stdout:2/765: rmdir d2/d3/de/d17/d36/d8f 39 2024-04-13T10:58:45.940 INFO:tasks.workunit.client.1.smithi194.stdout:5/858: mknod d3/dc/d17/d1b/d6b/c10b 0 2024-04-13T10:58:45.942 INFO:tasks.workunit.client.1.smithi194.stdout:8/860: mknod d6/d2a/d69/dc4/c120 0 2024-04-13T10:58:45.942 INFO:tasks.workunit.client.1.smithi194.stdout:2/766: read d2/d3/de/d33/d71/fa5 [3472440,61763] 0 2024-04-13T10:58:45.944 INFO:tasks.workunit.client.1.smithi194.stdout:0/710: creat d9/d2b/d6c/ddf/fe8 x:0 0 0 2024-04-13T10:58:45.949 INFO:tasks.workunit.client.1.smithi194.stdout:8/861: creat d6/d22/d23/d25/d71/da0/de5/deb/dac/f121 x:0 0 0 2024-04-13T10:58:45.949 INFO:tasks.workunit.client.1.smithi194.stdout:5/859: dread d3/dc/d2d/dd1/d38/f51 [0,4194304] 0 2024-04-13T10:58:45.949 INFO:tasks.workunit.client.1.smithi194.stdout:0/711: creat d9/d2b/d6c/ddf/d16/d70/fe9 x:0 0 0 2024-04-13T10:58:45.950 INFO:tasks.workunit.client.1.smithi194.stdout:2/767: creat d2/d3/de/d33/d71/ddb/ffd x:0 0 0 2024-04-13T10:58:45.950 INFO:tasks.workunit.client.1.smithi194.stdout:0/712: stat d9/db/d6b/lcb 0 2024-04-13T10:58:45.951 INFO:tasks.workunit.client.1.smithi194.stdout:5/860: chown d3/dc/d2d/dd1/d38/d59/cb3 253 1 2024-04-13T10:58:45.952 INFO:tasks.workunit.client.1.smithi194.stdout:8/862: chown d6/d22/d23/d25/d78/cbe 16 1 2024-04-13T10:58:45.952 INFO:tasks.workunit.client.1.smithi194.stdout:5/861: rmdir d3 39 2024-04-13T10:58:45.953 INFO:tasks.workunit.client.1.smithi194.stdout:0/713: symlink d9/d2b/d6c/ddf/d16/d77/lea 0 2024-04-13T10:58:45.955 INFO:tasks.workunit.client.1.smithi194.stdout:2/768: mknod d2/d3/de/d17/d36/d8f/de3/cfe 0 2024-04-13T10:58:45.956 INFO:tasks.workunit.client.1.smithi194.stdout:5/862: mkdir d3/dc/d17/d1b/d6b/d99/df2/d10c 0 2024-04-13T10:58:45.958 INFO:tasks.workunit.client.1.smithi194.stdout:5/863: readlink d3/dc/d2d/dd1/l57 0 2024-04-13T10:58:45.959 INFO:tasks.workunit.client.1.smithi194.stdout:0/714: write d9/d2b/f31 [210535,7471] 0 2024-04-13T10:58:45.960 INFO:tasks.workunit.client.1.smithi194.stdout:5/864: write d3/d83/f8f [1574714,106006] 0 2024-04-13T10:58:45.962 INFO:tasks.workunit.client.1.smithi194.stdout:0/715: mknod d9/db/d6b/ceb 0 2024-04-13T10:58:45.964 INFO:tasks.workunit.client.1.smithi194.stdout:0/716: chown d9/d9f/fde 185 1 2024-04-13T10:58:45.964 INFO:tasks.workunit.client.1.smithi194.stdout:5/865: mkdir d3/dc/d2d/dd1/d38/d59/d10d 0 2024-04-13T10:58:45.964 INFO:tasks.workunit.client.1.smithi194.stdout:8/863: dread d6/f52 [0,4194304] 0 2024-04-13T10:58:45.965 INFO:tasks.workunit.client.1.smithi194.stdout:5/866: write d3/d29/f3f [3629357,25002] 0 2024-04-13T10:58:45.966 INFO:tasks.workunit.client.1.smithi194.stdout:2/769: dread d2/d3/de/d33/d47/f50 [0,4194304] 0 2024-04-13T10:58:45.967 INFO:tasks.workunit.client.1.smithi194.stdout:0/717: symlink d9/db1/d30/d73/d87/ddc/lec 0 2024-04-13T10:58:45.972 INFO:tasks.workunit.client.1.smithi194.stdout:2/770: rename d2/f23 to d2/d3/fff 0 2024-04-13T10:58:45.972 INFO:tasks.workunit.client.1.smithi194.stdout:8/864: dwrite d6/d22/d23/d25/d39/d41/d5b/d76/f56 [0,4194304] 0 2024-04-13T10:58:45.974 INFO:tasks.workunit.client.1.smithi194.stdout:0/718: rmdir d9/db1/d30/d73/d87 39 2024-04-13T10:58:45.975 INFO:tasks.workunit.client.1.smithi194.stdout:2/771: readlink d2/d3/de/l60 0 2024-04-13T10:58:45.977 INFO:tasks.workunit.client.1.smithi194.stdout:5/867: rename d3/dc/f18 to d3/dc/d2d/dd1/d20/f10e 0 2024-04-13T10:58:45.977 INFO:tasks.workunit.client.1.smithi194.stdout:0/719: write d9/d2b/d6c/db2/fd5 [997374,42301] 0 2024-04-13T10:58:45.979 INFO:tasks.workunit.client.1.smithi194.stdout:2/772: creat d2/d3/de/d3c/f100 x:0 0 0 2024-04-13T10:58:45.982 INFO:tasks.workunit.client.1.smithi194.stdout:0/720: readlink d9/d2b/d6c/ddf/d16/l92 0 2024-04-13T10:58:45.982 INFO:tasks.workunit.client.1.smithi194.stdout:8/865: dwrite d6/d22/d23/d25/d39/f95 [0,4194304] 0 2024-04-13T10:58:45.983 INFO:tasks.workunit.client.1.smithi194.stdout:2/773: mknod d2/d3/d12/dba/c101 0 2024-04-13T10:58:45.983 INFO:tasks.workunit.client.1.smithi194.stdout:8/866: write d6/d22/d23/d25/d71/da0/f113 [476985,61493] 0 2024-04-13T10:58:45.990 INFO:tasks.workunit.client.1.smithi194.stdout:2/774: write d2/d3/de/fed [1167498,80168] 0 2024-04-13T10:58:45.994 INFO:tasks.workunit.client.1.smithi194.stdout:8/867: dwrite d6/d2a/d69/da2/fb7 [0,4194304] 0 2024-04-13T10:58:46.000 INFO:tasks.workunit.client.1.smithi194.stdout:0/721: dwrite d9/db/d3a/d9a/dd7/f6e [0,4194304] 0 2024-04-13T10:58:46.000 INFO:tasks.workunit.client.1.smithi194.stdout:2/775: write d2/d3/de/f1a [2916754,122606] 0 2024-04-13T10:58:46.003 INFO:tasks.workunit.client.1.smithi194.stdout:0/722: creat d9/db1/fed x:0 0 0 2024-04-13T10:58:46.006 INFO:tasks.workunit.client.1.smithi194.stdout:8/868: link d6/d22/d23/d25/d71/da0/f113 d6/d22/d23/d25/d39/f122 0 2024-04-13T10:58:46.007 INFO:tasks.workunit.client.1.smithi194.stdout:8/869: write d6/f52 [3024484,78865] 0 2024-04-13T10:58:46.010 INFO:tasks.workunit.client.1.smithi194.stdout:0/723: creat d9/db1/d30/d73/d87/fee x:0 0 0 2024-04-13T10:58:46.010 INFO:tasks.workunit.client.1.smithi194.stdout:0/724: stat d9/d2b/d6c/ddf/d16/d77/le4 0 2024-04-13T10:58:46.016 INFO:tasks.workunit.client.1.smithi194.stdout:2/776: write d2/d3/de/f16 [2266334,5326] 0 2024-04-13T10:58:46.016 INFO:tasks.workunit.client.1.smithi194.stdout:0/725: dwrite d9/db/d3a/d9a/dd7/f2e [0,4194304] 0 2024-04-13T10:58:46.020 INFO:tasks.workunit.client.1.smithi194.stdout:0/726: mkdir d9/d2b/d6c/ddf/d63/def 0 2024-04-13T10:58:46.022 INFO:tasks.workunit.client.1.smithi194.stdout:0/727: write d9/db1/f50 [842533,11040] 0 2024-04-13T10:58:46.024 INFO:tasks.workunit.client.1.smithi194.stdout:2/777: link d2/d3/de/d17/d1e/d42/fa1 d2/d3/d12/f102 0 2024-04-13T10:58:46.025 INFO:tasks.workunit.client.1.smithi194.stdout:2/778: dread - d2/d3/de/d33/d71/ddb/ffd zero size 2024-04-13T10:58:46.026 INFO:tasks.workunit.client.1.smithi194.stdout:0/728: fdatasync d9/d2b/d6c/ddf/d16/d65/f79 0 2024-04-13T10:58:46.027 INFO:tasks.workunit.client.1.smithi194.stdout:2/779: creat d2/d3/de/d33/d71/f103 x:0 0 0 2024-04-13T10:58:46.030 INFO:tasks.workunit.client.1.smithi194.stdout:0/729: dread d9/db/d3a/d9a/dd7/f6e [0,4194304] 0 2024-04-13T10:58:46.033 INFO:tasks.workunit.client.1.smithi194.stdout:0/730: creat d9/d2b/d6c/ddf/d16/d65/ff0 x:0 0 0 2024-04-13T10:58:46.037 INFO:tasks.workunit.client.1.smithi194.stdout:0/731: dwrite d9/db1/fa2 [0,4194304] 0 2024-04-13T10:58:46.044 INFO:tasks.workunit.client.1.smithi194.stdout:0/732: dwrite d9/d2b/d6c/fce [0,4194304] 0 2024-04-13T10:58:46.046 INFO:tasks.workunit.client.1.smithi194.stdout:2/780: truncate d2/d3/de/d17/d1e/d42/d86/f89 3998261 0 2024-04-13T10:58:46.048 INFO:tasks.workunit.client.1.smithi194.stdout:2/781: chown d2/d3/de/d17/d36/f88 2528 1 2024-04-13T10:58:46.048 INFO:tasks.workunit.client.1.smithi194.stdout:0/733: read d9/f54 [4797,130183] 0 2024-04-13T10:58:46.054 INFO:tasks.workunit.client.1.smithi194.stdout:0/734: dwrite d9/db/d3a/fb8 [0,4194304] 0 2024-04-13T10:58:46.084 INFO:tasks.workunit.client.1.smithi194.stdout:4/812: sync 2024-04-13T10:58:46.084 INFO:tasks.workunit.client.1.smithi194.stdout:3/699: sync 2024-04-13T10:58:46.084 INFO:tasks.workunit.client.1.smithi194.stdout:1/702: sync 2024-04-13T10:58:46.085 INFO:tasks.workunit.client.1.smithi194.stdout:4/813: stat d2/d16/d1a/d1c/d3b 0 2024-04-13T10:58:46.085 INFO:tasks.workunit.client.1.smithi194.stdout:3/700: chown d2/d3/d12/f63 108 1 2024-04-13T10:58:46.111 INFO:tasks.workunit.client.1.smithi194.stdout:4/814: mknod d2/d16/d1a/d1c/d54/d5d/d98/c119 0 2024-04-13T10:58:46.114 INFO:tasks.workunit.client.1.smithi194.stdout:3/701: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/feb x:0 0 0 2024-04-13T10:58:46.116 INFO:tasks.workunit.client.1.smithi194.stdout:3/702: symlink d2/d3/d12/d31/d34/d88/lec 0 2024-04-13T10:58:46.162 INFO:tasks.workunit.client.1.smithi194.stdout:6/706: sync 2024-04-13T10:58:46.162 INFO:tasks.workunit.client.1.smithi194.stdout:7/831: sync 2024-04-13T10:58:46.162 INFO:tasks.workunit.client.1.smithi194.stdout:9/775: sync 2024-04-13T10:58:46.163 INFO:tasks.workunit.client.1.smithi194.stdout:1/703: rename d12/d13/d1c/d27/d4c/d7f to d12/d13/d1c/d27/d4c/dd7/de6 0 2024-04-13T10:58:46.165 INFO:tasks.workunit.client.1.smithi194.stdout:0/735: symlink d9/d2b/d6c/ddf/d16/lf1 0 2024-04-13T10:58:46.166 INFO:tasks.workunit.client.1.smithi194.stdout:9/776: mkdir d0/dde/d10e 0 2024-04-13T10:58:46.166 INFO:tasks.workunit.client.1.smithi194.stdout:6/707: dread d0/d53/f81 [0,4194304] 0 2024-04-13T10:58:46.166 INFO:tasks.workunit.client.1.smithi194.stdout:7/832: symlink d1/d2b/d2c/d30/d33/d39/dba/l109 0 2024-04-13T10:58:46.167 INFO:tasks.workunit.client.1.smithi194.stdout:9/777: write d0/d6/d14/d26/f38 [4307241,4908] 0 2024-04-13T10:58:46.171 INFO:tasks.workunit.client.1.smithi194.stdout:4/815: rename d2/d16/d1a to d2/d30/d50/d11a 0 2024-04-13T10:58:46.173 INFO:tasks.workunit.client.1.smithi194.stdout:1/704: truncate d12/d13/d3e/f66 659542 0 2024-04-13T10:58:46.174 INFO:tasks.workunit.client.1.smithi194.stdout:6/708: creat d0/fe2 x:0 0 0 2024-04-13T10:58:46.180 INFO:tasks.workunit.client.1.smithi194.stdout:0/736: dread d9/d2b/f3e [0,4194304] 0 2024-04-13T10:58:46.182 INFO:tasks.workunit.client.1.smithi194.stdout:3/703: rename d2/d3/d12/d31/d34/d88/fa9 to d2/d3/d12/d21/fed 0 2024-04-13T10:58:46.183 INFO:tasks.workunit.client.1.smithi194.stdout:3/704: write d2/d3/db9/fa4 [791825,50762] 0 2024-04-13T10:58:46.186 INFO:tasks.workunit.client.1.smithi194.stdout:0/737: creat d9/db1/d30/d73/d87/ddc/ff2 x:0 0 0 2024-04-13T10:58:46.187 INFO:tasks.workunit.client.1.smithi194.stdout:7/833: link d1/d2b/d2c/d30/d33/d39/cfb d1/d2b/d3e/d9c/dc5/d108/c10a 0 2024-04-13T10:58:46.189 INFO:tasks.workunit.client.1.smithi194.stdout:1/705: rmdir d12/d13/d1c/d7c/dbd 0 2024-04-13T10:58:46.190 INFO:tasks.workunit.client.1.smithi194.stdout:3/705: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/dee 0 2024-04-13T10:58:46.192 INFO:tasks.workunit.client.1.smithi194.stdout:3/706: stat d2/d3/d12/d31/d34/d88/d24/d6c/dc2/fcf 0 2024-04-13T10:58:46.192 INFO:tasks.workunit.client.1.smithi194.stdout:0/738: rename d9/d2b/d6c/ddf/d16/lf1 to d9/db1/d30/lf3 0 2024-04-13T10:58:46.193 INFO:tasks.workunit.client.1.smithi194.stdout:3/707: chown d2/d3/d12/d31/d34/d88/d24/d3a/ca1 2086 1 2024-04-13T10:58:46.196 INFO:tasks.workunit.client.1.smithi194.stdout:0/739: mknod d9/d2b/d6c/db2/cf4 0 2024-04-13T10:58:46.197 INFO:tasks.workunit.client.1.smithi194.stdout:9/778: write d0/d6/d2c/f47 [51627,81179] 0 2024-04-13T10:58:46.198 INFO:tasks.workunit.client.1.smithi194.stdout:3/708: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d65/cef 0 2024-04-13T10:58:46.201 INFO:tasks.workunit.client.1.smithi194.stdout:8/870: sync 2024-04-13T10:58:46.201 INFO:tasks.workunit.client.1.smithi194.stdout:2/782: sync 2024-04-13T10:58:46.201 INFO:tasks.workunit.client.1.smithi194.stdout:5/868: sync 2024-04-13T10:58:46.201 INFO:tasks.workunit.client.1.smithi194.stdout:4/816: truncate d2/d16/dd2/fea 493379 0 2024-04-13T10:58:46.202 INFO:tasks.workunit.client.1.smithi194.stdout:1/706: dwrite d12/d13/d1c/f72 [0,4194304] 0 2024-04-13T10:58:46.202 INFO:tasks.workunit.client.1.smithi194.stdout:5/869: chown d3/d83 75 1 2024-04-13T10:58:46.202 INFO:tasks.workunit.client.1.smithi194.stdout:6/709: unlink d0/d53/d78/fcc 0 2024-04-13T10:58:46.203 INFO:tasks.workunit.client.1.smithi194.stdout:9/779: symlink d0/d6/d14/d26/l10f 0 2024-04-13T10:58:46.204 INFO:tasks.workunit.client.1.smithi194.stdout:8/871: fdatasync d6/d2a/d69/da3/dfd/f110 0 2024-04-13T10:58:46.206 INFO:tasks.workunit.client.1.smithi194.stdout:7/834: dread d1/d2b/d2c/d30/f31 [0,4194304] 0 2024-04-13T10:58:46.206 INFO:tasks.workunit.client.1.smithi194.stdout:8/872: write f2 [4232480,123262] 0 2024-04-13T10:58:46.207 INFO:tasks.workunit.client.1.smithi194.stdout:8/873: chown d6/lcb 1 1 2024-04-13T10:58:46.207 INFO:tasks.workunit.client.1.smithi194.stdout:7/835: readlink d1/d2b/d2c/d30/d33/d39/dba/l109 0 2024-04-13T10:58:46.211 INFO:tasks.workunit.client.1.smithi194.stdout:3/709: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df0 0 2024-04-13T10:58:46.213 INFO:tasks.workunit.client.1.smithi194.stdout:9/780: write d0/d6/d14/d26/d7f/f10a [873618,51606] 0 2024-04-13T10:58:46.214 INFO:tasks.workunit.client.1.smithi194.stdout:7/836: write d1/d2b/d4c/d4f/d85/d88/ff3 [513995,39976] 0 2024-04-13T10:58:46.215 INFO:tasks.workunit.client.1.smithi194.stdout:2/783: symlink d2/d3/db6/l104 0 2024-04-13T10:58:46.215 INFO:tasks.workunit.client.1.smithi194.stdout:9/781: write d0/d88/fb0 [721610,6128] 0 2024-04-13T10:58:46.215 INFO:tasks.workunit.client.1.smithi194.stdout:4/817: fsync d2/d30/d50/d11a/d1c/d9a/fe4 0 2024-04-13T10:58:46.219 INFO:tasks.workunit.client.1.smithi194.stdout:2/784: truncate d2/d3/de/d17/d1e/d42/fb1 28386 0 2024-04-13T10:58:46.220 INFO:tasks.workunit.client.1.smithi194.stdout:9/782: creat d0/d11/d44/f110 x:0 0 0 2024-04-13T10:58:46.221 INFO:tasks.workunit.client.1.smithi194.stdout:5/870: symlink d3/dc/d2d/dd1/l10f 0 2024-04-13T10:58:46.221 INFO:tasks.workunit.client.1.smithi194.stdout:9/783: dread - d0/d11/d3d/d4c/f81 zero size 2024-04-13T10:58:46.223 INFO:tasks.workunit.client.1.smithi194.stdout:2/785: fsync d2/d3/f73 0 2024-04-13T10:58:46.224 INFO:tasks.workunit.client.1.smithi194.stdout:2/786: write d2/d3/f4a [555897,92176] 0 2024-04-13T10:58:46.225 INFO:tasks.workunit.client.1.smithi194.stdout:3/710: creat d2/d3/d12/d31/d34/d88/d24/ff1 x:0 0 0 2024-04-13T10:58:46.225 INFO:tasks.workunit.client.1.smithi194.stdout:2/787: write d2/d3/de/d17/d1e/d42/fc5 [1804835,110810] 0 2024-04-13T10:58:46.227 INFO:tasks.workunit.client.1.smithi194.stdout:9/784: write d0/d6/d9/f48 [4109677,604] 0 2024-04-13T10:58:46.228 INFO:tasks.workunit.client.1.smithi194.stdout:5/871: creat d3/dc/d2d/dd1/df7/f110 x:0 0 0 2024-04-13T10:58:46.232 INFO:tasks.workunit.client.1.smithi194.stdout:7/837: rename d1/d2b/d3e/ddf/d5a/d3c/f40 to d1/dd9/de1/f10b 0 2024-04-13T10:58:46.233 INFO:tasks.workunit.client.1.smithi194.stdout:2/788: mkdir d2/d3/de/d33/d105 0 2024-04-13T10:58:46.236 INFO:tasks.workunit.client.1.smithi194.stdout:4/818: rename d2/d30/d50/d11a/d1c/d3b/d42/fa6 to d2/d30/d50/d11a/d1c/d3e/d48/d7f/f11b 0 2024-04-13T10:58:46.239 INFO:tasks.workunit.client.1.smithi194.stdout:8/874: truncate d6/d22/d23/d25/f27 11003650 0 2024-04-13T10:58:46.241 INFO:tasks.workunit.client.1.smithi194.stdout:9/785: dwrite d0/d6/d2c/d68/f71 [4194304,4194304] 0 2024-04-13T10:58:46.243 INFO:tasks.workunit.client.1.smithi194.stdout:3/711: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/feb [0,4194304] 0 2024-04-13T10:58:46.244 INFO:tasks.workunit.client.1.smithi194.stdout:8/875: dread - d6/dd/d45/de3/dd3/ff5 zero size 2024-04-13T10:58:46.249 INFO:tasks.workunit.client.1.smithi194.stdout:5/872: dwrite d3/dc/d2d/dd1/d20/daa/dae/dd4/ff4 [0,4194304] 0 2024-04-13T10:58:46.252 INFO:tasks.workunit.client.1.smithi194.stdout:4/819: write d2/d16/d70/f26 [7705803,40469] 0 2024-04-13T10:58:46.254 INFO:tasks.workunit.client.1.smithi194.stdout:6/710: dwrite d0/d42/dbe/f76 [0,4194304] 0 2024-04-13T10:58:46.255 INFO:tasks.workunit.client.1.smithi194.stdout:3/712: mkdir d2/dce/ddc/df2 0 2024-04-13T10:58:46.255 INFO:tasks.workunit.client.1.smithi194.stdout:5/873: write d3/dc/d2d/dd1/fe7 [1048987,75049] 0 2024-04-13T10:58:46.256 INFO:tasks.workunit.client.1.smithi194.stdout:4/820: chown d2/d30/d50/d11a/d1c/d3e/f3f 12280 1 2024-04-13T10:58:46.257 INFO:tasks.workunit.client.1.smithi194.stdout:2/789: creat d2/d3/de/d17/d1e/d42/f106 x:0 0 0 2024-04-13T10:58:46.265 INFO:tasks.workunit.client.1.smithi194.stdout:7/838: rename d1/d2b/d4c/d4f/d6e to d1/dd9/de1/dab/d96/d10c 0 2024-04-13T10:58:46.266 INFO:tasks.workunit.client.1.smithi194.stdout:9/786: creat d0/d11/d3d/f111 x:0 0 0 2024-04-13T10:58:46.269 INFO:tasks.workunit.client.1.smithi194.stdout:3/713: rename d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/dee to d2/d3/db9/df3 0 2024-04-13T10:58:46.271 INFO:tasks.workunit.client.1.smithi194.stdout:6/711: write d0/d57/db7/dbc/fd3 [556853,54113] 0 2024-04-13T10:58:46.272 INFO:tasks.workunit.client.1.smithi194.stdout:9/787: creat d0/d6/d2c/f112 x:0 0 0 2024-04-13T10:58:46.274 INFO:tasks.workunit.client.1.smithi194.stdout:2/790: dwrite d2/d3/fc0 [0,4194304] 0 2024-04-13T10:58:46.274 INFO:tasks.workunit.client.1.smithi194.stdout:5/874: dwrite d3/dc/d2d/dd1/d38/f5b [4194304,4194304] 0 2024-04-13T10:58:46.275 INFO:tasks.workunit.client.1.smithi194.stdout:8/876: write d6/d22/d23/d25/d39/fa4 [1363665,45927] 0 2024-04-13T10:58:46.278 INFO:tasks.workunit.client.1.smithi194.stdout:7/839: truncate d1/d2b/d3e/ddf/ff4 327750 0 2024-04-13T10:58:46.278 INFO:tasks.workunit.client.1.smithi194.stdout:4/821: dwrite d2/d30/d50/d11a/d60/d107/d10f/fa3 [0,4194304] 0 2024-04-13T10:58:46.278 INFO:tasks.workunit.client.1.smithi194.stdout:9/788: chown d0/fe7 1255884 1 2024-04-13T10:58:46.284 INFO:tasks.workunit.client.1.smithi194.stdout:6/712: symlink d0/d53/d78/d91/le3 0 2024-04-13T10:58:46.284 INFO:tasks.workunit.client.1.smithi194.stdout:3/714: write d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/f79 [2749350,103762] 0 2024-04-13T10:58:46.284 INFO:tasks.workunit.client.1.smithi194.stdout:9/789: write d0/d11/f41 [3741622,31188] 0 2024-04-13T10:58:46.286 INFO:tasks.workunit.client.1.smithi194.stdout:8/877: mknod d6/d22/d23/d25/d39/d41/d5b/d76/c123 0 2024-04-13T10:58:46.286 INFO:tasks.workunit.client.1.smithi194.stdout:5/875: chown d3/l2b 166462646 1 2024-04-13T10:58:46.288 INFO:tasks.workunit.client.1.smithi194.stdout:9/790: readlink d0/d11/d79/l8a 0 2024-04-13T10:58:46.288 INFO:tasks.workunit.client.1.smithi194.stdout:3/715: stat d2/d3/d12/d31/d34/d88/fad 0 2024-04-13T10:58:46.289 INFO:tasks.workunit.client.1.smithi194.stdout:7/840: chown d1/d2b/d2c/d30/cd1 108977681 1 2024-04-13T10:58:46.290 INFO:tasks.workunit.client.1.smithi194.stdout:6/713: fsync d0/d2f/d48/fdd 0 2024-04-13T10:58:46.290 INFO:tasks.workunit.client.1.smithi194.stdout:4/822: mknod d2/d30/d50/d11a/d1c/d54/c11c 0 2024-04-13T10:58:46.291 INFO:tasks.workunit.client.1.smithi194.stdout:8/878: rmdir d6/d22/d23/d7f/d8c/d8d 39 2024-04-13T10:58:46.292 INFO:tasks.workunit.client.1.smithi194.stdout:4/823: chown d2/d30/d104 225154 1 2024-04-13T10:58:46.292 INFO:tasks.workunit.client.1.smithi194.stdout:9/791: write d0/d11/d3d/d9b/fb7 [1360147,17450] 0 2024-04-13T10:58:46.293 INFO:tasks.workunit.client.1.smithi194.stdout:7/841: chown d1/d2b/d2c/ffc 75919770 1 2024-04-13T10:58:46.294 INFO:tasks.workunit.client.1.smithi194.stdout:8/879: fdatasync f2 0 2024-04-13T10:58:46.296 INFO:tasks.workunit.client.1.smithi194.stdout:5/876: getdents d3/d89 0 2024-04-13T10:58:46.297 INFO:tasks.workunit.client.1.smithi194.stdout:7/842: unlink d1/d2b/d3e/f9f 0 2024-04-13T10:58:46.297 INFO:tasks.workunit.client.1.smithi194.stdout:5/877: write d3/dc/d2d/dd1/d38/f96 [8429562,38214] 0 2024-04-13T10:58:46.298 INFO:tasks.workunit.client.1.smithi194.stdout:7/843: stat d1/d2b/d4c/d4f/d51/cc9 0 2024-04-13T10:58:46.300 INFO:tasks.workunit.client.1.smithi194.stdout:3/716: rename d2/d3/d12/d21/lba to d2/d3/d12/d31/d34/d88/d24/d6c/dc2/lf4 0 2024-04-13T10:58:46.301 INFO:tasks.workunit.client.1.smithi194.stdout:6/714: truncate d0/d42/d7b/f88 347258 0 2024-04-13T10:58:46.305 INFO:tasks.workunit.client.1.smithi194.stdout:3/717: write d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/f8b [1039163,125197] 0 2024-04-13T10:58:46.306 INFO:tasks.workunit.client.1.smithi194.stdout:5/878: dwrite d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/f53 [0,4194304] 0 2024-04-13T10:58:46.307 INFO:tasks.workunit.client.1.smithi194.stdout:7/844: symlink d1/d2b/d4c/d4f/d85/dbc/l10d 0 2024-04-13T10:58:46.309 INFO:tasks.workunit.client.1.smithi194.stdout:4/824: rename d2/d30/d50/d11a/d1c/d3e/f118 to d2/d30/d50/d11a/d1c/d54/de7/f11d 0 2024-04-13T10:58:46.310 INFO:tasks.workunit.client.1.smithi194.stdout:9/792: creat d0/d6/d4a/d74/dae/deb/f113 x:0 0 0 2024-04-13T10:58:46.311 INFO:tasks.workunit.client.1.smithi194.stdout:6/715: mkdir d0/d42/d7b/db4/de4 0 2024-04-13T10:58:46.312 INFO:tasks.workunit.client.1.smithi194.stdout:7/845: chown d1/d2b/d4c/d4f/d85/lb2 116322624 1 2024-04-13T10:58:46.313 INFO:tasks.workunit.client.1.smithi194.stdout:4/825: chown d2/d30/d50/d11a/d1c/d3b/d42/le2 44 1 2024-04-13T10:58:46.313 INFO:tasks.workunit.client.1.smithi194.stdout:6/716: write d0/d53/fe1 [1029813,71232] 0 2024-04-13T10:58:46.315 INFO:tasks.workunit.client.1.smithi194.stdout:7/846: read d1/d2b/d2c/d30/fe2 [71701,40464] 0 2024-04-13T10:58:46.315 INFO:tasks.workunit.client.1.smithi194.stdout:8/880: link f2 d6/dd/f124 0 2024-04-13T10:58:46.316 INFO:tasks.workunit.client.1.smithi194.stdout:4/826: read - d2/d30/d50/d11a/d1c/d3e/dbb/dee/dd8/df0/fd4 zero size 2024-04-13T10:58:46.317 INFO:tasks.workunit.client.1.smithi194.stdout:2/791: dread d2/d3/de/d33/d47/dbb/f93 [0,4194304] 0 2024-04-13T10:58:46.317 INFO:tasks.workunit.client.1.smithi194.stdout:3/718: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d65/cf5 0 2024-04-13T10:58:46.319 INFO:tasks.workunit.client.1.smithi194.stdout:5/879: mknod d3/dc/d2d/dd1/d38/d59/de6/c111 0 2024-04-13T10:58:46.320 INFO:tasks.workunit.client.1.smithi194.stdout:9/793: creat d0/d6/d2c/db5/f114 x:0 0 0 2024-04-13T10:58:46.320 INFO:tasks.workunit.client.1.smithi194.stdout:8/881: truncate d6/d22/d23/d25/d71/da0/de5/deb/dac/f10d 533764 0 2024-04-13T10:58:46.321 INFO:tasks.workunit.client.1.smithi194.stdout:6/717: creat d0/d42/d7b/fe5 x:0 0 0 2024-04-13T10:58:46.321 INFO:tasks.workunit.client.1.smithi194.stdout:3/719: mknod d2/de/cf6 0 2024-04-13T10:58:46.322 INFO:tasks.workunit.client.1.smithi194.stdout:7/847: write d1/dd9/de1/dab/d96/ff2 [1551563,43264] 0 2024-04-13T10:58:46.323 INFO:tasks.workunit.client.1.smithi194.stdout:3/720: dread - d2/de/fb6 zero size 2024-04-13T10:58:46.324 INFO:tasks.workunit.client.1.smithi194.stdout:4/827: mkdir d2/d30/deb/d11e 0 2024-04-13T10:58:46.325 INFO:tasks.workunit.client.1.smithi194.stdout:2/792: mknod d2/d3/de/d17/d1e/d42/c107 0 2024-04-13T10:58:46.326 INFO:tasks.workunit.client.1.smithi194.stdout:3/721: dread - d2/de/fb6 zero size 2024-04-13T10:58:46.326 INFO:tasks.workunit.client.1.smithi194.stdout:6/718: mkdir d0/d26/d4b/de6 0 2024-04-13T10:58:46.326 INFO:tasks.workunit.client.1.smithi194.stdout:5/880: read d3/dc/d2d/dd1/d38/d59/f64 [465691,56171] 0 2024-04-13T10:58:46.327 INFO:tasks.workunit.client.1.smithi194.stdout:7/848: mkdir d1/d2b/d2c/d30/d33/d39/dba/d10e 0 2024-04-13T10:58:46.329 INFO:tasks.workunit.client.1.smithi194.stdout:0/740: sync 2024-04-13T10:58:46.329 INFO:tasks.workunit.client.1.smithi194.stdout:1/707: sync 2024-04-13T10:58:46.329 INFO:tasks.workunit.client.1.smithi194.stdout:6/719: chown d0/d26/dcb/fd6 410 1 2024-04-13T10:58:46.330 INFO:tasks.workunit.client.1.smithi194.stdout:4/828: rename d2/d30/d50/d11a/d1c/d54/d62/d6e to d2/d16/dd2/d11f 0 2024-04-13T10:58:46.331 INFO:tasks.workunit.client.1.smithi194.stdout:7/849: dread - d1/d2b/d2c/d30/d33/fea zero size 2024-04-13T10:58:46.331 INFO:tasks.workunit.client.1.smithi194.stdout:2/793: fsync d2/d3/de/d33/fa0 0 2024-04-13T10:58:46.332 INFO:tasks.workunit.client.1.smithi194.stdout:0/741: dread - d9/d2b/d6c/ddf/fe8 zero size 2024-04-13T10:58:46.333 INFO:tasks.workunit.client.1.smithi194.stdout:9/794: dwrite d0/d6/d14/d26/d3b/fa2 [0,4194304] 0 2024-04-13T10:58:46.337 INFO:tasks.workunit.client.1.smithi194.stdout:1/708: dread d12/d13/d1c/d28/d41/d4e/f56 [0,4194304] 0 2024-04-13T10:58:46.338 INFO:tasks.workunit.client.1.smithi194.stdout:5/881: creat d3/dc/d2d/dd1/d38/d59/d7a/df5/f112 x:0 0 0 2024-04-13T10:58:46.338 INFO:tasks.workunit.client.1.smithi194.stdout:6/720: mknod d0/d2c/d77/d93/ce7 0 2024-04-13T10:58:46.340 INFO:tasks.workunit.client.1.smithi194.stdout:3/722: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95/cf7 0 2024-04-13T10:58:46.340 INFO:tasks.workunit.client.1.smithi194.stdout:1/709: chown d12/d13/d3e 17580 1 2024-04-13T10:58:46.345 INFO:tasks.workunit.client.1.smithi194.stdout:1/710: fdatasync d12/d13/d1c/d27/f74 0 2024-04-13T10:58:46.345 INFO:tasks.workunit.client.1.smithi194.stdout:9/795: write d0/d6/d2c/f102 [969941,86494] 0 2024-04-13T10:58:46.352 INFO:tasks.workunit.client.1.smithi194.stdout:0/742: dwrite d9/db1/fa7 [0,4194304] 0 2024-04-13T10:58:46.353 INFO:tasks.workunit.client.1.smithi194.stdout:2/794: truncate d2/d3/de/d17/d36/f88 3589812 0 2024-04-13T10:58:46.354 INFO:tasks.workunit.client.1.smithi194.stdout:4/829: dwrite d2/d30/d50/d11a/d1c/d3b/d42/f52 [0,4194304] 0 2024-04-13T10:58:46.354 INFO:tasks.workunit.client.1.smithi194.stdout:7/850: dwrite d1/d2b/d3e/ddf/d5a/d3c/f65 [0,4194304] 0 2024-04-13T10:58:46.360 INFO:tasks.workunit.client.1.smithi194.stdout:5/882: link d3/dc/d2d/dd1/la6 d3/d89/l113 0 2024-04-13T10:58:46.360 INFO:tasks.workunit.client.1.smithi194.stdout:0/743: write d9/d2b/d6c/ddf/d16/f9c [513529,85845] 0 2024-04-13T10:58:46.365 INFO:tasks.workunit.client.1.smithi194.stdout:2/795: stat d2/d3/de/d17/d36/d8f/f96 0 2024-04-13T10:58:46.368 INFO:tasks.workunit.client.1.smithi194.stdout:5/883: write d3/d83/f102 [93963,110107] 0 2024-04-13T10:58:46.370 INFO:tasks.workunit.client.1.smithi194.stdout:8/882: dwrite d6/d22/d23/d25/d71/da0/de5/dd0/f115 [0,4194304] 0 2024-04-13T10:58:46.372 INFO:tasks.workunit.client.1.smithi194.stdout:9/796: dwrite d0/d6/d14/d26/f67 [0,4194304] 0 2024-04-13T10:58:46.372 INFO:tasks.workunit.client.1.smithi194.stdout:1/711: dread d12/d3a/dad/fd1 [0,4194304] 0 2024-04-13T10:58:46.372 INFO:tasks.workunit.client.1.smithi194.stdout:7/851: symlink d1/d2b/d2c/d30/l10f 0 2024-04-13T10:58:46.372 INFO:tasks.workunit.client.1.smithi194.stdout:2/796: write d2/d3/fa4 [2356486,6457] 0 2024-04-13T10:58:46.377 INFO:tasks.workunit.client.1.smithi194.stdout:6/721: truncate d0/d2c/d77/f8c 389086 0 2024-04-13T10:58:46.378 INFO:tasks.workunit.client.1.smithi194.stdout:1/712: chown d12/f32 74593 1 2024-04-13T10:58:46.378 INFO:tasks.workunit.client.1.smithi194.stdout:3/723: truncate d2/f27 4014482 0 2024-04-13T10:58:46.381 INFO:tasks.workunit.client.1.smithi194.stdout:4/830: mkdir d2/d16/dd2/d11f/de5/d120 0 2024-04-13T10:58:46.382 INFO:tasks.workunit.client.1.smithi194.stdout:0/744: rename d9/db/d3a/d9a/dd7/l44 to d9/d2b/d6c/ddf/d16/d83/dae/lf5 0 2024-04-13T10:58:46.388 INFO:tasks.workunit.client.1.smithi194.stdout:0/745: stat d9/d2b/d6c/ddf/d63/ccf 0 2024-04-13T10:58:46.388 INFO:tasks.workunit.client.1.smithi194.stdout:2/797: symlink d2/d3/de/d17/d36/d8f/d57/l108 0 2024-04-13T10:58:46.391 INFO:tasks.workunit.client.1.smithi194.stdout:5/884: link d3/dc/l27 d3/d89/l114 0 2024-04-13T10:58:46.393 INFO:tasks.workunit.client.1.smithi194.stdout:0/746: mknod d9/d9f/cf6 0 2024-04-13T10:58:46.394 INFO:tasks.workunit.client.1.smithi194.stdout:7/852: dread d1/d2b/d2c/d30/d33/fbd [0,4194304] 0 2024-04-13T10:58:46.398 INFO:tasks.workunit.client.1.smithi194.stdout:8/883: dwrite d6/d2a/f34 [4194304,4194304] 0 2024-04-13T10:58:46.400 INFO:tasks.workunit.client.1.smithi194.stdout:1/713: dread d12/d13/d1c/d27/d4c/dd7/de6/d8b/f8c [0,4194304] 0 2024-04-13T10:58:46.403 INFO:tasks.workunit.client.1.smithi194.stdout:6/722: dwrite d0/d42/f46 [0,4194304] 0 2024-04-13T10:58:46.405 INFO:tasks.workunit.client.1.smithi194.stdout:3/724: dwrite d2/d3/f8 [0,4194304] 0 2024-04-13T10:58:46.407 INFO:tasks.workunit.client.1.smithi194.stdout:7/853: write d1/d2b/f47 [3541354,80122] 0 2024-04-13T10:58:46.412 INFO:tasks.workunit.client.1.smithi194.stdout:9/797: dwrite d0/d6/d14/d26/d3b/f63 [0,4194304] 0 2024-04-13T10:58:46.414 INFO:tasks.workunit.client.1.smithi194.stdout:8/884: chown d6/d22/d23/d25/laf 51822416 1 2024-04-13T10:58:46.415 INFO:tasks.workunit.client.1.smithi194.stdout:4/831: dwrite d2/d30/d50/d11a/d1c/d54/d62/fa0 [0,4194304] 0 2024-04-13T10:58:46.415 INFO:tasks.workunit.client.1.smithi194.stdout:5/885: read d3/dc/d17/d1b/d6b/d99/fd2 [665585,117074] 0 2024-04-13T10:58:46.420 INFO:tasks.workunit.client.1.smithi194.stdout:1/714: mkdir d12/d13/de7 0 2024-04-13T10:58:46.425 INFO:tasks.workunit.client.1.smithi194.stdout:5/886: write d3/d83/fbb [728861,115075] 0 2024-04-13T10:58:46.427 INFO:tasks.workunit.client.1.smithi194.stdout:9/798: rmdir d0/d6/d9/d51 39 2024-04-13T10:58:46.430 INFO:tasks.workunit.client.1.smithi194.stdout:0/747: dwrite d9/db1/d30/d73/fc2 [0,4194304] 0 2024-04-13T10:58:46.430 INFO:tasks.workunit.client.1.smithi194.stdout:1/715: fsync d12/d13/d1c/d27/d4c/dd7/de6/d8b/fc0 0 2024-04-13T10:58:46.430 INFO:tasks.workunit.client.1.smithi194.stdout:4/832: mkdir d2/d30/d50/d11a/d1c/d3b/d8d/d121 0 2024-04-13T10:58:46.431 INFO:tasks.workunit.client.1.smithi194.stdout:2/798: dwrite d2/d3/de/d3c/f76 [0,4194304] 0 2024-04-13T10:58:46.432 INFO:tasks.workunit.client.1.smithi194.stdout:8/885: mkdir d6/d22/d23/d25/d71/da0/de5/deb/d125 0 2024-04-13T10:58:46.433 INFO:tasks.workunit.client.1.smithi194.stdout:3/725: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df8 0 2024-04-13T10:58:46.435 INFO:tasks.workunit.client.1.smithi194.stdout:3/726: stat d2/d3/l1b 0 2024-04-13T10:58:46.436 INFO:tasks.workunit.client.1.smithi194.stdout:5/887: mkdir d3/dc/d2d/dd1/d38/d59/d49/dbf/d115 0 2024-04-13T10:58:46.439 INFO:tasks.workunit.client.1.smithi194.stdout:5/888: fdatasync d3/dc/d2d/dd1/d20/daa/dae/fee 0 2024-04-13T10:58:46.441 INFO:tasks.workunit.client.1.smithi194.stdout:9/799: dread d0/d11/d3d/fb6 [0,4194304] 0 2024-04-13T10:58:46.442 INFO:tasks.workunit.client.1.smithi194.stdout:1/716: rmdir d12/d13/d1c/d53 39 2024-04-13T10:58:46.443 INFO:tasks.workunit.client.1.smithi194.stdout:8/886: truncate d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3c 4377986 0 2024-04-13T10:58:46.443 INFO:tasks.workunit.client.1.smithi194.stdout:4/833: unlink d2/d16/d70/f26 0 2024-04-13T10:58:46.444 INFO:tasks.workunit.client.1.smithi194.stdout:9/800: dread - d0/d6/d2c/f112 zero size 2024-04-13T10:58:46.445 INFO:tasks.workunit.client.1.smithi194.stdout:2/799: unlink d2/d3/de/d17/d36/d3d/l9f 0 2024-04-13T10:58:46.446 INFO:tasks.workunit.client.1.smithi194.stdout:9/801: readlink d0/d6/d2c/d68/lc0 0 2024-04-13T10:58:46.447 INFO:tasks.workunit.client.1.smithi194.stdout:2/800: chown d2/d3/de/d17/f8b 0 1 2024-04-13T10:58:46.447 INFO:tasks.workunit.client.1.smithi194.stdout:9/802: dread - d0/d11/d3d/d4c/f81 zero size 2024-04-13T10:58:46.447 INFO:tasks.workunit.client.1.smithi194.stdout:1/717: mkdir d12/d13/d1c/d28/de8 0 2024-04-13T10:58:46.449 INFO:tasks.workunit.client.1.smithi194.stdout:3/727: symlink d2/d3/d12/d31/d34/d88/d24/d3a/lf9 0 2024-04-13T10:58:46.450 INFO:tasks.workunit.client.1.smithi194.stdout:8/887: rmdir d6/d22/d23/d25/d39/d41/d5b/d76 39 2024-04-13T10:58:46.451 INFO:tasks.workunit.client.1.smithi194.stdout:6/723: dread d0/d42/dbe/d4d/f4f [0,4194304] 0 2024-04-13T10:58:46.452 INFO:tasks.workunit.client.1.smithi194.stdout:3/728: stat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95 0 2024-04-13T10:58:46.452 INFO:tasks.workunit.client.1.smithi194.stdout:5/889: rename d3/dc/d2d/dd1/d38/d59/cff to d3/dc/d17/d1b/d6b/d99/c116 0 2024-04-13T10:58:46.454 INFO:tasks.workunit.client.1.smithi194.stdout:2/801: unlink d2/d3/de/d33/d71/f103 0 2024-04-13T10:58:46.456 INFO:tasks.workunit.client.1.smithi194.stdout:1/718: mkdir d12/d13/d1c/d28/d41/db0/de9 0 2024-04-13T10:58:46.457 INFO:tasks.workunit.client.1.smithi194.stdout:4/834: fdatasync d2/d30/d50/d11a/d1c/d3b/d8d/fdb 0 2024-04-13T10:58:46.457 INFO:tasks.workunit.client.1.smithi194.stdout:1/719: read - d12/d13/d1c/d28/faf zero size 2024-04-13T10:58:46.457 INFO:tasks.workunit.client.1.smithi194.stdout:0/748: write d9/db/d3a/f5c [1538603,35953] 0 2024-04-13T10:58:46.457 INFO:tasks.workunit.client.1.smithi194.stdout:6/724: dwrite d0/d42/dbe/f58 [0,4194304] 0 2024-04-13T10:58:46.459 INFO:tasks.workunit.client.1.smithi194.stdout:0/749: chown d9/d2b/f8b 424741423 1 2024-04-13T10:58:46.461 INFO:tasks.workunit.client.1.smithi194.stdout:8/888: chown d6/d22/d23/d25/d39/d41/d5b/d76/d33/f3c 201 1 2024-04-13T10:58:46.462 INFO:tasks.workunit.client.1.smithi194.stdout:5/890: mknod d3/d89/c117 0 2024-04-13T10:58:46.463 INFO:tasks.workunit.client.1.smithi194.stdout:8/889: chown d6/d2a/d69/da2/lc3 243813382 1 2024-04-13T10:58:46.464 INFO:tasks.workunit.client.1.smithi194.stdout:2/802: mkdir d2/d3/de/d33/d109 0 2024-04-13T10:58:46.467 INFO:tasks.workunit.client.1.smithi194.stdout:6/725: creat d0/d2c/d77/d93/d98/fe8 x:0 0 0 2024-04-13T10:58:46.469 INFO:tasks.workunit.client.1.smithi194.stdout:8/890: chown d6/d22/d23/d25/d39/d41/d5b/d76/dc5/ccd 236625 1 2024-04-13T10:58:46.471 INFO:tasks.workunit.client.1.smithi194.stdout:5/891: mknod d3/d83/c118 0 2024-04-13T10:58:46.472 INFO:tasks.workunit.client.1.smithi194.stdout:0/750: mkdir d9/db/d6b/df7 0 2024-04-13T10:58:46.472 INFO:tasks.workunit.client.1.smithi194.stdout:1/720: dwrite d12/d13/d1c/d27/d4c/dd7/de6/d8b/f8c [0,4194304] 0 2024-04-13T10:58:46.472 INFO:tasks.workunit.client.1.smithi194.stdout:9/803: link d0/d6/lf0 d0/d6/d4a/d74/l115 0 2024-04-13T10:58:46.473 INFO:tasks.workunit.client.1.smithi194.stdout:0/751: write d9/d9f/fde [1013766,43804] 0 2024-04-13T10:58:46.475 INFO:tasks.workunit.client.1.smithi194.stdout:2/803: mkdir d2/d3/de/d33/d71/d10a 0 2024-04-13T10:58:46.476 INFO:tasks.workunit.client.1.smithi194.stdout:2/804: chown d2/d3/de/d33/d71 27089681 1 2024-04-13T10:58:46.480 INFO:tasks.workunit.client.1.smithi194.stdout:1/721: unlink d12/f1a 0 2024-04-13T10:58:46.481 INFO:tasks.workunit.client.1.smithi194.stdout:5/892: mknod d3/dc/d2d/dd1/d38/d59/d49/da4/c119 0 2024-04-13T10:58:46.481 INFO:tasks.workunit.client.1.smithi194.stdout:1/722: chown d12/d13/d1c/d27/d5c/lcb 0 1 2024-04-13T10:58:46.482 INFO:tasks.workunit.client.1.smithi194.stdout:9/804: creat d0/d11/d1e/f116 x:0 0 0 2024-04-13T10:58:46.483 INFO:tasks.workunit.client.1.smithi194.stdout:0/752: mkdir d9/db1/d30/df8 0 2024-04-13T10:58:46.484 INFO:tasks.workunit.client.1.smithi194.stdout:2/805: symlink d2/d3/de/d33/d71/l10b 0 2024-04-13T10:58:46.486 INFO:tasks.workunit.client.1.smithi194.stdout:8/891: creat d6/d22/d23/d7f/de2/f126 x:0 0 0 2024-04-13T10:58:46.486 INFO:tasks.workunit.client.1.smithi194.stdout:5/893: rmdir d3/dc/d17/d93/dfb 39 2024-04-13T10:58:46.487 INFO:tasks.workunit.client.1.smithi194.stdout:2/806: chown d2/d3/fe1 39096337 1 2024-04-13T10:58:46.487 INFO:tasks.workunit.client.1.smithi194.stdout:4/835: getdents d2/d30/d50/d11a/d1c/d54/d5d/db2 0 2024-04-13T10:58:46.489 INFO:tasks.workunit.client.1.smithi194.stdout:1/723: chown d12/d13/d1c/d27/f57 825 1 2024-04-13T10:58:46.490 INFO:tasks.workunit.client.1.smithi194.stdout:3/729: dwrite d2/d3/d12/d31/d34/d88/d24/f28 [0,4194304] 0 2024-04-13T10:58:46.490 INFO:tasks.workunit.client.1.smithi194.stdout:0/753: mkdir d9/db1/d30/df9 0 2024-04-13T10:58:46.491 INFO:tasks.workunit.client.1.smithi194.stdout:4/836: dread - d2/d30/d50/d11a/d1c/d54/f101 zero size 2024-04-13T10:58:46.498 INFO:tasks.workunit.client.1.smithi194.stdout:4/837: stat d2/d16/dd2/d11f/d99/dd0/ff2 0 2024-04-13T10:58:46.498 INFO:tasks.workunit.client.1.smithi194.stdout:1/724: rmdir d12/d13/d1c/d7c 39 2024-04-13T10:58:46.506 INFO:tasks.workunit.client.1.smithi194.stdout:5/894: dwrite d3/dc/d2d/dd1/d38/f60 [0,4194304] 0 2024-04-13T10:58:46.507 INFO:tasks.workunit.client.1.smithi194.stdout:1/725: write d12/f26 [3062725,23753] 0 2024-04-13T10:58:46.507 INFO:tasks.workunit.client.1.smithi194.stdout:8/892: dwrite d6/d22/d23/d25/d71/da0/de5/deb/f8f [0,4194304] 0 2024-04-13T10:58:46.508 INFO:tasks.workunit.client.1.smithi194.stdout:9/805: dwrite d0/d6/f7b [0,4194304] 0 2024-04-13T10:58:46.509 INFO:tasks.workunit.client.1.smithi194.stdout:4/838: write d2/d30/d50/d11a/d1c/d3e/f67 [1746748,42798] 0 2024-04-13T10:58:46.515 INFO:tasks.workunit.client.1.smithi194.stdout:9/806: creat d0/d88/de5/f117 x:0 0 0 2024-04-13T10:58:46.516 INFO:tasks.workunit.client.1.smithi194.stdout:3/730: rename d2/d3/d12/d31/d34/d88/d24/d3a/lf9 to d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5/lfa 0 2024-04-13T10:58:46.517 INFO:tasks.workunit.client.1.smithi194.stdout:1/726: write d12/d13/f18 [108666,9676] 0 2024-04-13T10:58:46.519 INFO:tasks.workunit.client.1.smithi194.stdout:8/893: truncate d6/dd/d45/de3/dd3/ff5 529185 0 2024-04-13T10:58:46.520 INFO:tasks.workunit.client.1.smithi194.stdout:2/807: dread d2/d3/fa4 [0,4194304] 0 2024-04-13T10:58:46.521 INFO:tasks.workunit.client.1.smithi194.stdout:9/807: creat d0/dfe/f118 x:0 0 0 2024-04-13T10:58:46.521 INFO:tasks.workunit.client.1.smithi194.stdout:1/727: chown d12/d13/d1c/d28/l2b 53548975 1 2024-04-13T10:58:46.522 INFO:tasks.workunit.client.1.smithi194.stdout:3/731: chown d2/d3/d12/d31/d34/d88/d24/f90 3 1 2024-04-13T10:58:46.522 INFO:tasks.workunit.client.1.smithi194.stdout:4/839: getdents d2/d30/d50 0 2024-04-13T10:58:46.523 INFO:tasks.workunit.client.1.smithi194.stdout:8/894: chown d6/d22/d23/f54 587 1 2024-04-13T10:58:46.525 INFO:tasks.workunit.client.1.smithi194.stdout:5/895: dwrite d3/dc/d2d/dd1/d38/f5b [0,4194304] 0 2024-04-13T10:58:46.526 INFO:tasks.workunit.client.1.smithi194.stdout:2/808: write d2/d3/de/d17/d36/d8f/dcd/fda [43552,16891] 0 2024-04-13T10:58:46.527 INFO:tasks.workunit.client.1.smithi194.stdout:1/728: dread d12/d13/d1c/d28/d41/fc4 [0,4194304] 0 2024-04-13T10:58:46.528 INFO:tasks.workunit.client.1.smithi194.stdout:8/895: readlink d6/d22/d23/d25/d71/da0/de5/dd0/ld2 0 2024-04-13T10:58:46.529 INFO:tasks.workunit.client.1.smithi194.stdout:8/896: stat d6/d22/d23/lfa 0 2024-04-13T10:58:46.530 INFO:tasks.workunit.client.1.smithi194.stdout:3/732: creat d2/d3/d12/d31/d34/d88/d24/dd2/ffb x:0 0 0 2024-04-13T10:58:46.532 INFO:tasks.workunit.client.1.smithi194.stdout:2/809: unlink d2/d3/c4e 0 2024-04-13T10:58:46.534 INFO:tasks.workunit.client.1.smithi194.stdout:2/810: dread - d2/d3/de/d33/d47/dbb/fa8 zero size 2024-04-13T10:58:46.534 INFO:tasks.workunit.client.1.smithi194.stdout:8/897: mkdir d6/dff/d127 0 2024-04-13T10:58:46.535 INFO:tasks.workunit.client.1.smithi194.stdout:7/854: sync 2024-04-13T10:58:46.535 INFO:tasks.workunit.client.1.smithi194.stdout:3/733: fsync d2/d3/f77 0 2024-04-13T10:58:46.536 INFO:tasks.workunit.client.1.smithi194.stdout:7/855: stat d1/d2b/d4c/d4f/d51 0 2024-04-13T10:58:46.537 INFO:tasks.workunit.client.1.smithi194.stdout:1/729: creat d12/d13/d1c/d7c/fea x:0 0 0 2024-04-13T10:58:46.537 INFO:tasks.workunit.client.1.smithi194.stdout:2/811: mknod d2/d3/de/d17/d39/c10c 0 2024-04-13T10:58:46.538 INFO:tasks.workunit.client.1.smithi194.stdout:9/808: dread d0/d6/d9/d51/f94 [0,4194304] 0 2024-04-13T10:58:46.538 INFO:tasks.workunit.client.1.smithi194.stdout:3/734: dread - d2/d3/d12/d31/d34/d88/d24/d3a/d56/fb3 zero size 2024-04-13T10:58:46.555 INFO:tasks.workunit.client.1.smithi194.stdout:3/735: read d2/d3/f86 [1239057,123984] 0 2024-04-13T10:58:46.556 INFO:tasks.workunit.client.1.smithi194.stdout:1/730: write d12/d13/d1c/d27/d4c/d90/fcf [4655750,16858] 0 2024-04-13T10:58:46.558 INFO:tasks.workunit.client.1.smithi194.stdout:8/898: truncate d6/d22/d23/d7f/d8c/d8d/ddc/ff2 1121675 0 2024-04-13T10:58:46.561 INFO:tasks.workunit.client.1.smithi194.stdout:9/809: getdents d0/d6/d14/dcd/da4/de0 0 2024-04-13T10:58:46.562 INFO:tasks.workunit.client.1.smithi194.stdout:3/736: readlink d2/d3/d12/d31/d34/d88/d24/d3a/d65/l8e 0 2024-04-13T10:58:46.562 INFO:tasks.workunit.client.1.smithi194.stdout:1/731: symlink d12/d13/d1c/d27/d5c/leb 0 2024-04-13T10:58:46.565 INFO:tasks.workunit.client.1.smithi194.stdout:7/856: link d1/d2b/d2c/d30/d33/d39/dba/cf7 d1/d2b/d4c/d4f/d51/d4d/d5e/c110 0 2024-04-13T10:58:46.566 INFO:tasks.workunit.client.1.smithi194.stdout:9/810: symlink d0/d6/d14/d6d/l119 0 2024-04-13T10:58:46.566 INFO:tasks.workunit.client.1.smithi194.stdout:2/812: dwrite d2/d3/de/d17/d36/f9d [0,4194304] 0 2024-04-13T10:58:46.567 INFO:tasks.workunit.client.1.smithi194.stdout:3/737: stat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d 0 2024-04-13T10:58:46.568 INFO:tasks.workunit.client.1.smithi194.stdout:8/899: rename f5 to d6/d22/d23/d7f/de2/f128 0 2024-04-13T10:58:46.570 INFO:tasks.workunit.client.1.smithi194.stdout:1/732: creat d12/d13/d1c/d28/d41/d50/d96/fec x:0 0 0 2024-04-13T10:58:46.572 INFO:tasks.workunit.client.1.smithi194.stdout:1/733: stat d12/d13/d1c/d7c/fa9 0 2024-04-13T10:58:46.572 INFO:tasks.workunit.client.1.smithi194.stdout:7/857: rmdir d1/d2b/d3e 39 2024-04-13T10:58:46.574 INFO:tasks.workunit.client.1.smithi194.stdout:4/840: dread d2/d30/d50/d11a/d1c/d3e/d48/d7f/fb0 [0,4194304] 0 2024-04-13T10:58:46.574 INFO:tasks.workunit.client.1.smithi194.stdout:2/813: mkdir d2/d3/de/d33/d71/ddc/dec/d10d 0 2024-04-13T10:58:46.577 INFO:tasks.workunit.client.1.smithi194.stdout:3/738: rename d2/d3/d12/d31/d34/l7f to d2/d3/d12/d31/d34/d88/d24/d3a/d72/lfc 0 2024-04-13T10:58:46.577 INFO:tasks.workunit.client.1.smithi194.stdout:2/814: chown d2/d3/de/d33/d47/c81 237 1 2024-04-13T10:58:46.578 INFO:tasks.workunit.client.1.smithi194.stdout:8/900: symlink d6/d22/d23/d7f/d8c/l129 0 2024-04-13T10:58:46.579 INFO:tasks.workunit.client.1.smithi194.stdout:2/815: chown d2/d3/de/d17/d39 2 1 2024-04-13T10:58:46.580 INFO:tasks.workunit.client.1.smithi194.stdout:9/811: dwrite d0/dde/fec [0,4194304] 0 2024-04-13T10:58:46.582 INFO:tasks.workunit.client.1.smithi194.stdout:1/734: mkdir d12/d13/d1c/d27/d4c/dd7/de6/d8b/dd4/ded 0 2024-04-13T10:58:46.583 INFO:tasks.workunit.client.1.smithi194.stdout:7/858: fdatasync d1/d2b/d4c/d4f/d85/d88/d9b/faf 0 2024-04-13T10:58:46.583 INFO:tasks.workunit.client.1.smithi194.stdout:2/816: fsync d2/d3/de/d17/d36/d8f/d57/fd7 0 2024-04-13T10:58:46.583 INFO:tasks.workunit.client.1.smithi194.stdout:5/896: dread d3/d83/fbb [0,4194304] 0 2024-04-13T10:58:46.584 INFO:tasks.workunit.client.1.smithi194.stdout:8/901: read - d6/d22/d23/d25/d71/da0/de5/deb/dac/f121 zero size 2024-04-13T10:58:46.586 INFO:tasks.workunit.client.1.smithi194.stdout:3/739: rename d2/d3/d12/d21/l7a to d2/d3/d12/d31/d34/d88/lfd 0 2024-04-13T10:58:46.588 INFO:tasks.workunit.client.1.smithi194.stdout:8/902: dread d6/d22/d23/d25/d39/d41/f67 [0,4194304] 0 2024-04-13T10:58:46.589 INFO:tasks.workunit.client.1.smithi194.stdout:7/859: truncate d1/f12 4643890 0 2024-04-13T10:58:46.591 INFO:tasks.workunit.client.1.smithi194.stdout:2/817: mknod d2/d3/de/d17/d36/d8f/de3/c10e 0 2024-04-13T10:58:46.594 INFO:tasks.workunit.client.1.smithi194.stdout:3/740: stat d2/d3/d12/d31/d34/d88/d24/f38 0 2024-04-13T10:58:46.596 INFO:tasks.workunit.client.1.smithi194.stdout:5/897: rename d3/dc/d17/d1b/d6b/d99 to d3/dc/d2d/dd1/db5/d11a 0 2024-04-13T10:58:46.597 INFO:tasks.workunit.client.1.smithi194.stdout:8/903: dwrite d6/d22/d23/d25/d39/fa4 [0,4194304] 0 2024-04-13T10:58:46.600 INFO:tasks.workunit.client.1.smithi194.stdout:7/860: mkdir d1/dd9/de1/dab/d96/d10c/d111 0 2024-04-13T10:58:46.604 INFO:tasks.workunit.client.1.smithi194.stdout:5/898: symlink d3/dc/d2d/l11b 0 2024-04-13T10:58:46.604 INFO:tasks.workunit.client.1.smithi194.stdout:8/904: fdatasync d6/d22/d23/d25/d71/da0/de5/deb/f109 0 2024-04-13T10:58:46.606 INFO:tasks.workunit.client.1.smithi194.stdout:3/741: dread d2/d7d/f9c [0,4194304] 0 2024-04-13T10:58:46.607 INFO:tasks.workunit.client.1.smithi194.stdout:2/818: dwrite d2/d3/de/d33/d47/fb2 [0,4194304] 0 2024-04-13T10:58:46.607 INFO:tasks.workunit.client.1.smithi194.stdout:7/861: chown d1/dd9/de1/dab/d96/d10c/c74 2 1 2024-04-13T10:58:46.609 INFO:tasks.workunit.client.1.smithi194.stdout:4/841: dread d2/d30/d50/d11a/d60/d107/d10f/f93 [0,4194304] 0 2024-04-13T10:58:46.610 INFO:tasks.workunit.client.1.smithi194.stdout:8/905: creat d6/d22/d23/f12a x:0 0 0 2024-04-13T10:58:46.613 INFO:tasks.workunit.client.1.smithi194.stdout:5/899: creat d3/dc/d17/d1b/f11c x:0 0 0 2024-04-13T10:58:46.614 INFO:tasks.workunit.client.1.smithi194.stdout:5/900: read - d3/dc/d2d/dd1/d38/f76 zero size 2024-04-13T10:58:46.615 INFO:tasks.workunit.client.1.smithi194.stdout:4/842: fsync d2/d16/d70/f68 0 2024-04-13T10:58:46.615 INFO:tasks.workunit.client.1.smithi194.stdout:3/742: write d2/d3/d12/d21/fa7 [666531,109567] 0 2024-04-13T10:58:46.616 INFO:tasks.workunit.client.1.smithi194.stdout:2/819: mkdir d2/d3/de/d33/d109/d10f 0 2024-04-13T10:58:46.618 INFO:tasks.workunit.client.1.smithi194.stdout:4/843: dread - d2/d30/d50/d11a/d60/d107/d10f/fbf zero size 2024-04-13T10:58:46.619 INFO:tasks.workunit.client.1.smithi194.stdout:3/743: truncate d2/dce/ddc/de2/fea 828846 0 2024-04-13T10:58:46.620 INFO:tasks.workunit.client.1.smithi194.stdout:2/820: symlink d2/d3/de/d17/d36/d65/l110 0 2024-04-13T10:58:46.621 INFO:tasks.workunit.client.1.smithi194.stdout:8/906: dread d6/dd/f48 [0,4194304] 0 2024-04-13T10:58:46.623 INFO:tasks.workunit.client.1.smithi194.stdout:2/821: chown d2/d3/de/d17/lc8 127735 1 2024-04-13T10:58:46.624 INFO:tasks.workunit.client.1.smithi194.stdout:8/907: fdatasync d6/dd/d45/de3/dd3/f11b 0 2024-04-13T10:58:46.625 INFO:tasks.workunit.client.1.smithi194.stdout:5/901: dwrite d3/d83/f82 [0,4194304] 0 2024-04-13T10:58:46.626 INFO:tasks.workunit.client.1.smithi194.stdout:2/822: write d2/d3/ff [4045647,37904] 0 2024-04-13T10:58:46.630 INFO:tasks.workunit.client.1.smithi194.stdout:3/744: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95/ffe x:0 0 0 2024-04-13T10:58:46.632 INFO:tasks.workunit.client.1.smithi194.stdout:4/844: dwrite d2/d30/d50/d11a/d1c/d3e/dbb/dee/dd8/df0/fd4 [0,4194304] 0 2024-04-13T10:58:46.633 INFO:tasks.workunit.client.1.smithi194.stdout:8/908: write d6/dd/f124 [2416045,78757] 0 2024-04-13T10:58:46.637 INFO:tasks.workunit.client.1.smithi194.stdout:4/845: read d2/d30/d50/d11a/d1c/d9a/fb7 [550112,24563] 0 2024-04-13T10:58:46.642 INFO:tasks.workunit.client.1.smithi194.stdout:2/823: dwrite d2/d3/de/d17/d1e/d42/fc5 [0,4194304] 0 2024-04-13T10:58:46.646 INFO:tasks.workunit.client.1.smithi194.stdout:2/824: creat d2/d37/f111 x:0 0 0 2024-04-13T10:58:46.648 INFO:tasks.workunit.client.1.smithi194.stdout:4/846: mknod d2/d30/d50/d11a/d1c/d3e/dbb/dee/dd8/c122 0 2024-04-13T10:58:46.648 INFO:tasks.workunit.client.1.smithi194.stdout:8/909: dread d6/d22/d23/f5e [0,4194304] 0 2024-04-13T10:58:46.648 INFO:tasks.workunit.client.1.smithi194.stdout:7/862: dread d1/d2b/d2c/d30/d33/d39/f66 [0,4194304] 0 2024-04-13T10:58:46.650 INFO:tasks.workunit.client.1.smithi194.stdout:7/863: dread - d1/d2b/d4c/d4f/d85/d88/d9b/db8/fe3 zero size 2024-04-13T10:58:46.651 INFO:tasks.workunit.client.1.smithi194.stdout:2/825: unlink d2/d3/de/d17/d36/d8f/d57/l108 0 2024-04-13T10:58:46.652 INFO:tasks.workunit.client.1.smithi194.stdout:8/910: creat d6/d2a/d69/da3/dfd/f12b x:0 0 0 2024-04-13T10:58:46.653 INFO:tasks.workunit.client.1.smithi194.stdout:8/911: write d6/dd/d45/daa/f119 [793912,11698] 0 2024-04-13T10:58:46.653 INFO:tasks.workunit.client.1.smithi194.stdout:4/847: creat d2/d30/d50/d11a/d1c/d3e/dbb/dee/dd8/f123 x:0 0 0 2024-04-13T10:58:46.654 INFO:tasks.workunit.client.1.smithi194.stdout:2/826: creat d2/d3/de/d33/f112 x:0 0 0 2024-04-13T10:58:46.657 INFO:tasks.workunit.client.1.smithi194.stdout:8/912: mkdir d6/d2a/d69/da3/dfd/d12c 0 2024-04-13T10:58:46.659 INFO:tasks.workunit.client.1.smithi194.stdout:2/827: mknod d2/d3/de/d17/d36/dc9/c113 0 2024-04-13T10:58:46.662 INFO:tasks.workunit.client.1.smithi194.stdout:4/848: dwrite d2/d30/d50/d11a/d1c/d54/d62/d9e/f100 [0,4194304] 0 2024-04-13T10:58:46.664 INFO:tasks.workunit.client.1.smithi194.stdout:4/849: write d2/fc0 [957522,102334] 0 2024-04-13T10:58:46.665 INFO:tasks.workunit.client.1.smithi194.stdout:8/913: getdents d6/dd 0 2024-04-13T10:58:46.666 INFO:tasks.workunit.client.1.smithi194.stdout:2/828: rename d2/d3/de/d17/d1e/d42/f8c to d2/d3/de/d17/d36/dc9/f114 0 2024-04-13T10:58:46.669 INFO:tasks.workunit.client.1.smithi194.stdout:2/829: stat d2/d3/de/d33/f112 0 2024-04-13T10:58:46.672 INFO:tasks.workunit.client.1.smithi194.stdout:2/830: mkdir d2/d3/de/d33/d47/d115 0 2024-04-13T10:58:46.673 INFO:tasks.workunit.client.1.smithi194.stdout:8/914: dwrite d6/dd/d45/fb9 [0,4194304] 0 2024-04-13T10:58:46.673 INFO:tasks.workunit.client.1.smithi194.stdout:2/831: creat d2/d37/f116 x:0 0 0 2024-04-13T10:58:46.679 INFO:tasks.workunit.client.1.smithi194.stdout:8/915: creat d6/d22/d23/d25/d71/da0/de5/dd0/f12d x:0 0 0 2024-04-13T10:58:46.680 INFO:tasks.workunit.client.1.smithi194.stdout:2/832: dread d2/d3/de/d17/d36/d8f/f4b [0,4194304] 0 2024-04-13T10:58:46.681 INFO:tasks.workunit.client.1.smithi194.stdout:2/833: stat d2/d3/de/d17/d36/d7a/faa 0 2024-04-13T10:58:46.685 INFO:tasks.workunit.client.1.smithi194.stdout:7/864: dread d1/d2b/d3e/ddf/d5a/f58 [0,4194304] 0 2024-04-13T10:58:46.685 INFO:tasks.workunit.client.1.smithi194.stdout:2/834: mknod d2/d3/de/d33/d71/ddc/dec/d10d/c117 0 2024-04-13T10:58:46.686 INFO:tasks.workunit.client.1.smithi194.stdout:2/835: dread d2/d37/f6a [0,4194304] 0 2024-04-13T10:58:46.755 INFO:tasks.workunit.client.1.smithi194.stdout:6/726: sync 2024-04-13T10:58:46.755 INFO:tasks.workunit.client.1.smithi194.stdout:6/727: chown d0/d57/db7/dbc/dc4 212938129 1 2024-04-13T10:58:46.755 INFO:tasks.workunit.client.1.smithi194.stdout:7/865: dwrite d1/d2b/d4c/d4f/f70 [0,4194304] 0 2024-04-13T10:58:46.755 INFO:tasks.workunit.client.1.smithi194.stdout:2/836: dwrite d2/d37/f6a [0,4194304] 0 2024-04-13T10:58:46.755 INFO:tasks.workunit.client.1.smithi194.stdout:7/866: unlink d1/d2b/d2c/d30/c44 0 2024-04-13T10:58:46.755 INFO:tasks.workunit.client.1.smithi194.stdout:8/916: dread d6/fc9 [0,4194304] 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:6/728: dread d0/d26/f29 [4194304,4194304] 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:2/837: dwrite d2/d37/fdd [0,4194304] 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:8/917: unlink d6/d22/c32 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:6/729: creat d0/d2c/fe9 x:0 0 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:2/838: unlink d2/d37/c82 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:2/839: write d2/d3/de/f16 [2523084,9760] 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:6/730: mkdir d0/d2c/d77/d93/dea 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:2/840: unlink d2/d3/de/d33/d47/dbb/fb9 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:2/841: fdatasync d2/d37/f6a 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:6/731: dwrite d0/d42/dbe/f3c [0,4194304] 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:2/842: symlink d2/d3/de/d3c/l118 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:7/867: dread d1/fa [0,4194304] 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:2/843: chown d2/d3/de/d17/d1e/d42/d86/f89 1495 1 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:6/732: dwrite d0/d42/f43 [0,4194304] 0 2024-04-13T10:58:46.756 INFO:tasks.workunit.client.1.smithi194.stdout:2/844: write d2/d3/de/d17/d39/dcc/ff9 [207403,109164] 0 2024-04-13T10:58:46.757 INFO:tasks.workunit.client.1.smithi194.stdout:6/733: truncate d0/d57/d69/f65 292412 0 2024-04-13T10:58:46.757 INFO:tasks.workunit.client.1.smithi194.stdout:8/918: dread d6/f1d [0,4194304] 0 2024-04-13T10:58:46.757 INFO:tasks.workunit.client.1.smithi194.stdout:8/919: readlink d6/l66 0 2024-04-13T10:58:46.757 INFO:tasks.workunit.client.1.smithi194.stdout:6/734: readlink d0/d57/d84/l8b 0 2024-04-13T10:58:46.757 INFO:tasks.workunit.client.1.smithi194.stdout:2/845: truncate d2/d3/de/d17/d36/f9d 4417989 0 2024-04-13T10:58:46.757 INFO:tasks.workunit.client.1.smithi194.stdout:2/846: chown d2/d3/d6d/fe2 3 1 2024-04-13T10:58:46.757 INFO:tasks.workunit.client.1.smithi194.stdout:8/920: write d6/d22/d23/d25/d71/da0/de5/deb/f8f [1442351,120190] 0 2024-04-13T10:58:46.757 INFO:tasks.workunit.client.1.smithi194.stdout:7/868: dread d1/d2b/d4c/d4f/d51/d4d/d5e/fd6 [0,4194304] 0 2024-04-13T10:58:46.757 INFO:tasks.workunit.client.1.smithi194.stdout:6/735: read d0/d2c/f3e [1294866,105917] 0 2024-04-13T10:58:46.757 INFO:tasks.workunit.client.1.smithi194.stdout:2/847: creat d2/d3/de/d17/d36/d8f/f119 x:0 0 0 2024-04-13T10:58:46.758 INFO:tasks.workunit.client.1.smithi194.stdout:6/736: write d0/d2c/f9c [305016,117469] 0 2024-04-13T10:58:46.758 INFO:tasks.workunit.client.1.smithi194.stdout:8/921: symlink d6/d22/d23/d25/d71/da0/de5/deb/dac/ddf/l12e 0 2024-04-13T10:58:46.758 INFO:tasks.workunit.client.1.smithi194.stdout:6/737: fdatasync d0/d42/f7d 0 2024-04-13T10:58:46.758 INFO:tasks.workunit.client.1.smithi194.stdout:7/869: creat d1/d2b/d4c/d4f/d85/d88/d9b/f112 x:0 0 0 2024-04-13T10:58:46.759 INFO:tasks.workunit.client.1.smithi194.stdout:8/922: dread d6/d22/d23/d25/f36 [0,4194304] 0 2024-04-13T10:58:46.759 INFO:tasks.workunit.client.1.smithi194.stdout:6/738: dwrite d0/d26/f4e [0,4194304] 0 2024-04-13T10:58:46.762 INFO:tasks.workunit.client.1.smithi194.stdout:6/739: rename d0/d2c/f9c to d0/d26/d4b/feb 0 2024-04-13T10:58:46.764 INFO:tasks.workunit.client.1.smithi194.stdout:6/740: rmdir d0/d57/db7 39 2024-04-13T10:58:46.765 INFO:tasks.workunit.client.1.smithi194.stdout:2/848: dread d2/d3/de/d33/d71/fa5 [0,4194304] 0 2024-04-13T10:58:46.769 INFO:tasks.workunit.client.1.smithi194.stdout:8/923: truncate d6/d2a/d69/da2/f114 123601 0 2024-04-13T10:58:46.770 INFO:tasks.workunit.client.1.smithi194.stdout:6/741: link d0/d53/c9e d0/d26/dcb/cec 0 2024-04-13T10:58:46.771 INFO:tasks.workunit.client.1.smithi194.stdout:2/849: mkdir d2/d3/de/d17/d1e/d42/d11a 0 2024-04-13T10:58:46.773 INFO:tasks.workunit.client.1.smithi194.stdout:2/850: rename d2/d3/de/d17/d36/d3d to d2/d3/de/d17/d36/d3d/d11b 22 2024-04-13T10:58:46.775 INFO:tasks.workunit.client.1.smithi194.stdout:6/742: dwrite d0/d53/d78/faf [0,4194304] 0 2024-04-13T10:58:46.782 INFO:tasks.workunit.client.1.smithi194.stdout:6/743: rename d0/d53/c9e to d0/d53/ced 0 2024-04-13T10:58:46.783 INFO:tasks.workunit.client.1.smithi194.stdout:6/744: chown d0/d2c/d77/ca6 1454 1 2024-04-13T10:58:46.784 INFO:tasks.workunit.client.1.smithi194.stdout:6/745: write d0/d2c/d77/d93/daa/fdc [976060,26768] 0 2024-04-13T10:58:46.796 INFO:tasks.workunit.client.1.smithi194.stdout:2/851: dread d2/d3/d6d/f6f [0,4194304] 0 2024-04-13T10:58:46.800 INFO:tasks.workunit.client.1.smithi194.stdout:2/852: write d2/d3/d6d/f7c [1759520,80475] 0 2024-04-13T10:58:46.800 INFO:tasks.workunit.client.1.smithi194.stdout:6/746: dread d0/d2f/d6f/f89 [0,4194304] 0 2024-04-13T10:58:46.802 INFO:tasks.workunit.client.1.smithi194.stdout:2/853: mkdir d2/d3/de/d17/d39/dcc/d11c 0 2024-04-13T10:58:46.803 INFO:tasks.workunit.client.1.smithi194.stdout:6/747: symlink d0/d26/lee 0 2024-04-13T10:58:46.805 INFO:tasks.workunit.client.1.smithi194.stdout:6/748: mknod d0/d57/db7/dbc/cef 0 2024-04-13T10:58:46.806 INFO:tasks.workunit.client.1.smithi194.stdout:6/749: rmdir d0/d53/d78/d91 39 2024-04-13T10:58:46.807 INFO:tasks.workunit.client.1.smithi194.stdout:6/750: chown d0/d42/dbe/fce 114275 1 2024-04-13T10:58:46.809 INFO:tasks.workunit.client.1.smithi194.stdout:6/751: chown d0/d2f/d48/d83/d9d/cd4 184 1 2024-04-13T10:58:46.809 INFO:tasks.workunit.client.1.smithi194.stdout:6/752: stat d0/d26/c3b 0 2024-04-13T10:58:46.811 INFO:tasks.workunit.client.1.smithi194.stdout:6/753: mkdir d0/d2c/d77/d93/df0 0 2024-04-13T10:58:46.812 INFO:tasks.workunit.client.1.smithi194.stdout:6/754: write d0/d57/fbb [586237,109144] 0 2024-04-13T10:58:46.814 INFO:tasks.workunit.client.1.smithi194.stdout:6/755: mkdir d0/d57/d84/df1 0 2024-04-13T10:58:46.814 INFO:tasks.workunit.client.1.smithi194.stdout:2/854: dread d2/d3/de/fae [0,4194304] 0 2024-04-13T10:58:46.816 INFO:tasks.workunit.client.1.smithi194.stdout:2/855: write d2/d3/de/d17/d36/d3d/fd3 [4157144,102387] 0 2024-04-13T10:58:46.816 INFO:tasks.workunit.client.1.smithi194.stdout:6/756: symlink d0/d26/d4b/de6/lf2 0 2024-04-13T10:58:46.818 INFO:tasks.workunit.client.1.smithi194.stdout:6/757: creat d0/d2c/d77/d93/d98/ff3 x:0 0 0 2024-04-13T10:58:46.819 INFO:tasks.workunit.client.1.smithi194.stdout:2/856: creat d2/d3/de/d33/d71/ddc/f11d x:0 0 0 2024-04-13T10:58:46.819 INFO:tasks.workunit.client.1.smithi194.stdout:6/758: chown d0/d2c/f3e 2 1 2024-04-13T10:58:46.820 INFO:tasks.workunit.client.1.smithi194.stdout:6/759: dread - d0/d2c/d77/d93/fa9 zero size 2024-04-13T10:58:46.825 INFO:tasks.workunit.client.1.smithi194.stdout:6/760: dwrite d0/d2c/f32 [0,4194304] 0 2024-04-13T10:58:46.829 INFO:tasks.workunit.client.1.smithi194.stdout:2/857: truncate d2/d3/de/d3c/f76 318767 0 2024-04-13T10:58:46.831 INFO:tasks.workunit.client.1.smithi194.stdout:2/858: symlink d2/d3/de/d90/l11e 0 2024-04-13T10:58:46.834 INFO:tasks.workunit.client.1.smithi194.stdout:6/761: dwrite d0/d53/f60 [0,4194304] 0 2024-04-13T10:58:46.837 INFO:tasks.workunit.client.1.smithi194.stdout:0/754: sync 2024-04-13T10:58:46.839 INFO:tasks.workunit.client.1.smithi194.stdout:6/762: chown d0/d2f/c74 252 1 2024-04-13T10:58:46.839 INFO:tasks.workunit.client.1.smithi194.stdout:2/859: rename d2/d3/de/d33/d71/ddc/lf0 to d2/d3/l11f 0 2024-04-13T10:58:46.840 INFO:tasks.workunit.client.1.smithi194.stdout:6/763: write d0/d42/dbe/f7a [4715134,108158] 0 2024-04-13T10:58:46.841 INFO:tasks.workunit.client.1.smithi194.stdout:6/764: read d0/d26/f4e [3582489,11266] 0 2024-04-13T10:58:46.842 INFO:tasks.workunit.client.1.smithi194.stdout:0/755: unlink d9/d2b/d6c/ddf/d16/d83/f86 0 2024-04-13T10:58:46.843 INFO:tasks.workunit.client.1.smithi194.stdout:2/860: creat d2/d3/de/d33/d71/ddb/f120 x:0 0 0 2024-04-13T10:58:46.843 INFO:tasks.workunit.client.1.smithi194.stdout:0/756: dread - d9/d6f/f81 zero size 2024-04-13T10:58:46.843 INFO:tasks.workunit.client.1.smithi194.stdout:6/765: dread - d0/d2c/d77/d93/fa9 zero size 2024-04-13T10:58:46.846 INFO:tasks.workunit.client.1.smithi194.stdout:0/757: symlink d9/db1/d30/d73/d87/lfa 0 2024-04-13T10:58:46.851 INFO:tasks.workunit.client.1.smithi194.stdout:2/861: rename d2/d3/d12/cc2 to d2/d3/de/d33/d47/c121 0 2024-04-13T10:58:46.851 INFO:tasks.workunit.client.1.smithi194.stdout:0/758: write d9/db1/d30/d73/fba [1020929,71241] 0 2024-04-13T10:58:46.852 INFO:tasks.workunit.client.1.smithi194.stdout:6/766: dwrite d0/d2c/d77/d93/d98/fa1 [0,4194304] 0 2024-04-13T10:58:46.867 INFO:tasks.workunit.client.1.smithi194.stdout:2/862: dread d2/d3/de/f1a [0,4194304] 0 2024-04-13T10:58:46.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:46 smithi134 ceph-mon[39696]: pgmap v27: 65 pgs: 65 active+clean; 1.5 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 61 MiB/s rd, 200 MiB/s wr, 389 op/s 2024-04-13T10:58:46.946 INFO:tasks.workunit.client.1.smithi194.stdout:5/902: sync 2024-04-13T10:58:46.946 INFO:tasks.workunit.client.1.smithi194.stdout:1/735: sync 2024-04-13T10:58:46.946 INFO:tasks.workunit.client.1.smithi194.stdout:9/812: sync 2024-04-13T10:58:46.947 INFO:tasks.workunit.client.1.smithi194.stdout:2/863: rmdir d2/d3/d6d/dac 39 2024-04-13T10:58:46.956 INFO:tasks.workunit.client.1.smithi194.stdout:9/813: dread d0/d6/d2c/f69 [4194304,4194304] 0 2024-04-13T10:58:46.958 INFO:tasks.workunit.client.1.smithi194.stdout:2/864: dread d2/d3/de/d33/d47/dbb/d5a/fb8 [0,4194304] 0 2024-04-13T10:58:46.958 INFO:tasks.workunit.client.1.smithi194.stdout:2/865: chown d2/d3/d12/lcf 817168 1 2024-04-13T10:58:46.963 INFO:tasks.workunit.client.1.smithi194.stdout:6/767: mkdir d0/d53/d78/dac/df4 0 2024-04-13T10:58:46.969 INFO:tasks.workunit.client.1.smithi194.stdout:2/866: rename d2/d3/de/d33/d47/dbb/fca to d2/d3/de/dee/df1/f122 0 2024-04-13T10:58:46.970 INFO:tasks.workunit.client.1.smithi194.stdout:1/736: dread d12/d13/d1c/d7c/fab [0,4194304] 0 2024-04-13T10:58:46.970 INFO:tasks.workunit.client.1.smithi194.stdout:6/768: creat d0/d2c/d77/d93/daa/ff5 x:0 0 0 2024-04-13T10:58:46.973 INFO:tasks.workunit.client.1.smithi194.stdout:2/867: symlink d2/d3/d12/dba/l123 0 2024-04-13T10:58:46.974 INFO:tasks.workunit.client.1.smithi194.stdout:0/759: link d9/db/d3a/cc6 d9/cfb 0 2024-04-13T10:58:46.976 INFO:tasks.workunit.client.1.smithi194.stdout:6/769: fsync d0/f99 0 2024-04-13T10:58:46.976 INFO:tasks.workunit.client.1.smithi194.stdout:5/903: truncate d3/dc/d2d/dd1/d38/f44 3399528 0 2024-04-13T10:58:46.978 INFO:tasks.workunit.client.1.smithi194.stdout:1/737: symlink d12/d13/d1c/d27/lee 0 2024-04-13T10:58:46.978 INFO:tasks.workunit.client.1.smithi194.stdout:1/738: stat d12/d13/d1c/d28/d41/d50/d96/ccd 0 2024-04-13T10:58:46.979 INFO:tasks.workunit.client.1.smithi194.stdout:0/760: rename d9/d2b/d6c/db2/cd2 to d9/d2b/d6c/ddf/d16/d77/cfc 0 2024-04-13T10:58:46.980 INFO:tasks.workunit.client.1.smithi194.stdout:2/868: rmdir d2/d3/d6d/dac 39 2024-04-13T10:58:46.980 INFO:tasks.workunit.client.1.smithi194.stdout:5/904: write d3/dc/faf [922350,24250] 0 2024-04-13T10:58:46.981 INFO:tasks.workunit.client.1.smithi194.stdout:6/770: symlink d0/d57/db7/lf6 0 2024-04-13T10:58:46.983 INFO:tasks.workunit.client.1.smithi194.stdout:1/739: rename d12/d13/d1c/d27/la2 to d12/d13/d1c/d27/d4c/dd7/de6/d8b/dd4/lef 0 2024-04-13T10:58:46.983 INFO:tasks.workunit.client.1.smithi194.stdout:5/905: readlink d3/dc/d2d/dd1/db5/lc2 0 2024-04-13T10:58:46.983 INFO:tasks.workunit.client.1.smithi194.stdout:0/761: dread d9/db1/d30/fab [0,4194304] 0 2024-04-13T10:58:46.984 INFO:tasks.workunit.client.1.smithi194.stdout:2/869: fsync d2/d3/de/d33/fa0 0 2024-04-13T10:58:46.985 INFO:tasks.workunit.client.1.smithi194.stdout:5/906: write d3/fd8 [500733,38271] 0 2024-04-13T10:58:46.987 INFO:tasks.workunit.client.1.smithi194.stdout:6/771: rename d0/d2f/fad to d0/d53/d78/dac/ff7 0 2024-04-13T10:58:46.992 INFO:tasks.workunit.client.1.smithi194.stdout:2/870: creat d2/d3/de/d17/d36/d3d/f124 x:0 0 0 2024-04-13T10:58:46.992 INFO:tasks.workunit.client.1.smithi194.stdout:0/762: dwrite d9/d2b/d6c/ddf/f4c [0,4194304] 0 2024-04-13T10:58:46.995 INFO:tasks.workunit.client.1.smithi194.stdout:2/871: chown d2/d3/de/d17/d36/d8f/de3/cfe 1583280 1 2024-04-13T10:58:46.997 INFO:tasks.workunit.client.1.smithi194.stdout:5/907: dread d3/dc/d2d/f36 [0,4194304] 0 2024-04-13T10:58:46.998 INFO:tasks.workunit.client.1.smithi194.stdout:1/740: getdents d12/d13/d1c/d27/d4c/d7d 0 2024-04-13T10:58:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:46 smithi194 ceph-mon[46737]: pgmap v27: 65 pgs: 65 active+clean; 1.5 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 61 MiB/s rd, 200 MiB/s wr, 389 op/s 2024-04-13T10:58:47.007 INFO:tasks.workunit.client.1.smithi194.stdout:2/872: creat d2/d3/d6d/f125 x:0 0 0 2024-04-13T10:58:47.008 INFO:tasks.workunit.client.1.smithi194.stdout:0/763: truncate d9/d2b/f3e 1156316 0 2024-04-13T10:58:47.008 INFO:tasks.workunit.client.1.smithi194.stdout:5/908: link d3/dc/d17/d93/cb0 d3/dc/d2d/dd1/db5/d11a/df2/d10c/c11d 0 2024-04-13T10:58:47.013 INFO:tasks.workunit.client.1.smithi194.stdout:6/772: dread d0/d42/dbe/d4d/d80/fa4 [0,4194304] 0 2024-04-13T10:58:47.014 INFO:tasks.workunit.client.1.smithi194.stdout:0/764: rename d9/db/f36 to d9/d2b/d6c/ffd 0 2024-04-13T10:58:47.014 INFO:tasks.workunit.client.1.smithi194.stdout:1/741: dwrite d12/d13/d44/fa1 [4194304,4194304] 0 2024-04-13T10:58:47.015 INFO:tasks.workunit.client.1.smithi194.stdout:2/873: dread d2/d3/de/d33/d47/fb2 [0,4194304] 0 2024-04-13T10:58:47.016 INFO:tasks.workunit.client.1.smithi194.stdout:1/742: readlink d12/d13/d1c/d27/lee 0 2024-04-13T10:58:47.018 INFO:tasks.workunit.client.1.smithi194.stdout:2/874: mkdir d2/d3/de/d17/d36/d7a/d126 0 2024-04-13T10:58:47.019 INFO:tasks.workunit.client.1.smithi194.stdout:0/765: creat d9/d2b/d6c/ddf/d16/d65/ffe x:0 0 0 2024-04-13T10:58:47.023 INFO:tasks.workunit.client.1.smithi194.stdout:0/766: fdatasync d9/db/d3a/f58 0 2024-04-13T10:58:47.023 INFO:tasks.workunit.client.1.smithi194.stdout:2/875: creat d2/d3/de/d33/d71/f127 x:0 0 0 2024-04-13T10:58:47.024 INFO:tasks.workunit.client.1.smithi194.stdout:1/743: dwrite d12/d13/d1c/d27/d5c/fb4 [0,4194304] 0 2024-04-13T10:58:47.025 INFO:tasks.workunit.client.1.smithi194.stdout:0/767: truncate d9/f54 5078293 0 2024-04-13T10:58:47.028 INFO:tasks.workunit.client.1.smithi194.stdout:0/768: truncate d9/d2b/d6c/ddf/d16/d83/dae/fe2 331622 0 2024-04-13T10:58:47.028 INFO:tasks.workunit.client.1.smithi194.stdout:1/744: read d12/d13/d1c/f31 [459245,127855] 0 2024-04-13T10:58:47.030 INFO:tasks.workunit.client.1.smithi194.stdout:0/769: fdatasync d9/db/d3a/d9a/dd7/fdd 0 2024-04-13T10:58:47.030 INFO:tasks.workunit.client.1.smithi194.stdout:2/876: rename d2/d3/de/d17/d39/l48 to d2/d3/de/d17/d39/l128 0 2024-04-13T10:58:47.031 INFO:tasks.workunit.client.1.smithi194.stdout:2/877: write d2/d37/fdd [1407037,19833] 0 2024-04-13T10:58:47.031 INFO:tasks.workunit.client.1.smithi194.stdout:0/770: fdatasync d9/db1/d30/d73/d87/ddc/fe1 0 2024-04-13T10:58:47.031 INFO:tasks.workunit.client.1.smithi194.stdout:4/850: sync 2024-04-13T10:58:47.032 INFO:tasks.workunit.client.1.smithi194.stdout:7/870: sync 2024-04-13T10:58:47.032 INFO:tasks.workunit.client.1.smithi194.stdout:8/924: sync 2024-04-13T10:58:47.032 INFO:tasks.workunit.client.1.smithi194.stdout:3/745: sync 2024-04-13T10:58:47.035 INFO:tasks.workunit.client.1.smithi194.stdout:1/745: creat d12/d13/d1c/d28/ff0 x:0 0 0 2024-04-13T10:58:47.036 INFO:tasks.workunit.client.1.smithi194.stdout:3/746: mkdir d2/d7d/dff 0 2024-04-13T10:58:47.039 INFO:tasks.workunit.client.1.smithi194.stdout:4/851: mkdir d2/d30/d50/d11a/d1c/d3e/dbb/d124 0 2024-04-13T10:58:47.039 INFO:tasks.workunit.client.1.smithi194.stdout:3/747: stat d2/dce/ddc 0 2024-04-13T10:58:47.041 INFO:tasks.workunit.client.1.smithi194.stdout:1/746: mkdir d12/d3a/d4f/da3/df1 0 2024-04-13T10:58:47.042 INFO:tasks.workunit.client.1.smithi194.stdout:4/852: chown d2/d16/dd2/cf4 260 1 2024-04-13T10:58:47.042 INFO:tasks.workunit.client.1.smithi194.stdout:2/878: dwrite d2/d3/f73 [0,4194304] 0 2024-04-13T10:58:47.042 INFO:tasks.workunit.client.1.smithi194.stdout:0/771: dwrite d9/db1/d30/d73/fba [0,4194304] 0 2024-04-13T10:58:47.043 INFO:tasks.workunit.client.1.smithi194.stdout:7/871: link d1/d2b/d2c/c43 d1/d2b/d3e/c113 0 2024-04-13T10:58:47.044 INFO:tasks.workunit.client.1.smithi194.stdout:8/925: getdents d6/d2a/dce/dfb 0 2024-04-13T10:58:47.046 INFO:tasks.workunit.client.1.smithi194.stdout:0/772: write d9/db1/d30/d73/d87/fee [386001,24507] 0 2024-04-13T10:58:47.087 INFO:tasks.workunit.client.1.smithi194.stdout:4/853: creat d2/d30/d50/d11a/d1c/f125 x:0 0 0 2024-04-13T10:58:47.088 INFO:tasks.workunit.client.1.smithi194.stdout:8/926: write d6/d2a/d69/da3/dfd/f12b [460749,129710] 0 2024-04-13T10:58:47.088 INFO:tasks.workunit.client.1.smithi194.stdout:6/773: truncate d0/d2c/d77/d93/d98/fa1 1125680 0 2024-04-13T10:58:47.090 INFO:tasks.workunit.client.1.smithi194.stdout:3/748: dread d2/d3/d12/d31/f52 [0,4194304] 0 2024-04-13T10:58:47.091 INFO:tasks.workunit.client.1.smithi194.stdout:6/774: readlink d0/d42/dbe/lb5 0 2024-04-13T10:58:47.091 INFO:tasks.workunit.client.1.smithi194.stdout:7/872: rename d1/c9d to d1/d2b/d3e/ddf/d6b/c114 0 2024-04-13T10:58:47.091 INFO:tasks.workunit.client.1.smithi194.stdout:0/773: rmdir d9/d9f 39 2024-04-13T10:58:47.091 INFO:tasks.workunit.client.1.smithi194.stdout:8/927: mkdir d6/dd/d45/daa/d12f 0 2024-04-13T10:58:47.092 INFO:tasks.workunit.client.1.smithi194.stdout:6/775: readlink d0/d2c/d77/d7f/lda 0 2024-04-13T10:58:47.094 INFO:tasks.workunit.client.1.smithi194.stdout:7/873: truncate d1/d2b/d3e/ddf/d5a/fd5 881805 0 2024-04-13T10:58:47.095 INFO:tasks.workunit.client.1.smithi194.stdout:8/928: mknod d6/d2a/dce/dfb/c130 0 2024-04-13T10:58:47.097 INFO:tasks.workunit.client.1.smithi194.stdout:3/749: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/f100 x:0 0 0 2024-04-13T10:58:47.100 INFO:tasks.workunit.client.1.smithi194.stdout:7/874: truncate d1/d2b/d4c/d4f/d51/d4d/d5e/fd6 1531796 0 2024-04-13T10:58:47.100 INFO:tasks.workunit.client.1.smithi194.stdout:0/774: creat d9/d2b/d6c/ddf/d63/def/fff x:0 0 0 2024-04-13T10:58:47.101 INFO:tasks.workunit.client.1.smithi194.stdout:6/776: dwrite d0/d42/d7b/fe5 [0,4194304] 0 2024-04-13T10:58:47.102 INFO:tasks.workunit.client.1.smithi194.stdout:3/750: stat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dd7/f73 0 2024-04-13T10:58:47.103 INFO:tasks.workunit.client.1.smithi194.stdout:2/879: truncate d2/d3/de/d17/d36/d7a/faa 257171 0 2024-04-13T10:58:47.103 INFO:tasks.workunit.client.1.smithi194.stdout:8/929: mkdir d6/d22/d23/d25/d71/da0/de5/deb/d131 0 2024-04-13T10:58:47.103 INFO:tasks.workunit.client.1.smithi194.stdout:4/854: write d2/d30/d50/d11a/d1c/d3e/dbb/dee/dd8/df0/f17 [1150996,77045] 0 2024-04-13T10:58:47.106 INFO:tasks.workunit.client.1.smithi194.stdout:6/777: mknod d0/d2f/d48/d68/cf8 0 2024-04-13T10:58:47.108 INFO:tasks.workunit.client.1.smithi194.stdout:0/775: symlink d9/db1/d30/df8/l100 0 2024-04-13T10:58:47.108 INFO:tasks.workunit.client.1.smithi194.stdout:3/751: getdents d2/d7d/de6 0 2024-04-13T10:58:47.109 INFO:tasks.workunit.client.1.smithi194.stdout:6/778: creat d0/d53/d78/dac/ff9 x:0 0 0 2024-04-13T10:58:47.110 INFO:tasks.workunit.client.1.smithi194.stdout:4/855: read - d2/d30/d50/d11a/d1c/d54/d62/d10d/fc9 zero size 2024-04-13T10:58:47.110 INFO:tasks.workunit.client.1.smithi194.stdout:7/875: getdents d1/d2b/d3e/ddf 0 2024-04-13T10:58:47.112 INFO:tasks.workunit.client.1.smithi194.stdout:8/930: creat d6/dd/d45/de3/de9/df8/d111/f132 x:0 0 0 2024-04-13T10:58:47.112 INFO:tasks.workunit.client.1.smithi194.stdout:0/776: truncate d9/d2b/d6c/ddf/fbb 474019 0 2024-04-13T10:58:47.113 INFO:tasks.workunit.client.1.smithi194.stdout:6/779: creat d0/d42/dbe/ffa x:0 0 0 2024-04-13T10:58:47.114 INFO:tasks.workunit.client.1.smithi194.stdout:4/856: write d2/d16/d70/f51 [2663476,59628] 0 2024-04-13T10:58:47.118 INFO:tasks.workunit.client.1.smithi194.stdout:8/931: fdatasync d6/d22/d23/d25/d39/d41/f73 0 2024-04-13T10:58:47.119 INFO:tasks.workunit.client.1.smithi194.stdout:4/857: symlink d2/l126 0 2024-04-13T10:58:47.122 INFO:tasks.workunit.client.1.smithi194.stdout:7/876: link d1/d2b/d4c/d4f/d85/dbc/cc2 d1/d2b/d4c/d4f/d51/d4d/d5e/c115 0 2024-04-13T10:58:47.123 INFO:tasks.workunit.client.1.smithi194.stdout:4/858: mknod d2/d30/d50/d11a/d1c/d3e/dfe/c127 0 2024-04-13T10:58:47.128 INFO:tasks.workunit.client.1.smithi194.stdout:8/932: dwrite d6/d2a/dc7/ff1 [0,4194304] 0 2024-04-13T10:58:47.129 INFO:tasks.workunit.client.1.smithi194.stdout:7/877: creat d1/d2b/d3e/ddf/d5a/d3c/def/f116 x:0 0 0 2024-04-13T10:58:47.130 INFO:tasks.workunit.client.1.smithi194.stdout:0/777: dread d9/f54 [0,4194304] 0 2024-04-13T10:58:47.130 INFO:tasks.workunit.client.1.smithi194.stdout:4/859: chown d2/d30/d50/d11a/d1c/d3e/dfe/c127 47358554 1 2024-04-13T10:58:47.132 INFO:tasks.workunit.client.1.smithi194.stdout:2/880: dwrite d2/d3/de/d33/d47/dbb/d5a/fb8 [0,4194304] 0 2024-04-13T10:58:47.132 INFO:tasks.workunit.client.1.smithi194.stdout:9/814: sync 2024-04-13T10:58:47.135 INFO:tasks.workunit.client.1.smithi194.stdout:3/752: dwrite d2/d3/d12/d21/fed [0,4194304] 0 2024-04-13T10:58:47.136 INFO:tasks.workunit.client.1.smithi194.stdout:9/815: write d0/f37 [4963502,71887] 0 2024-04-13T10:58:47.137 INFO:tasks.workunit.client.1.smithi194.stdout:0/778: stat d9/d2b/d6c/ddf/d63/l72 0 2024-04-13T10:58:47.144 INFO:tasks.workunit.client.1.smithi194.stdout:8/933: creat d6/d2a/f133 x:0 0 0 2024-04-13T10:58:47.144 INFO:tasks.workunit.client.1.smithi194.stdout:4/860: truncate d2/d30/d50/d11a/d1c/d54/d62/d10d/fcd 789817 0 2024-04-13T10:58:47.146 INFO:tasks.workunit.client.1.smithi194.stdout:3/753: read d2/d3/d12/d31/d34/d88/d24/fe1 [329683,49969] 0 2024-04-13T10:58:47.147 INFO:tasks.workunit.client.1.smithi194.stdout:4/861: readlink d2/d30/d50/d11a/d1c/d3e/dbb/dee/l10b 0 2024-04-13T10:58:47.147 INFO:tasks.workunit.client.1.smithi194.stdout:0/779: chown d9/d2b/d6c/ddf/d16/d70/ce3 731204618 1 2024-04-13T10:58:47.148 INFO:tasks.workunit.client.1.smithi194.stdout:7/878: rename d1/d2b/d4c/d4f/d51/c86 to d1/d2b/d4c/d4f/d85/c117 0 2024-04-13T10:58:47.149 INFO:tasks.workunit.client.1.smithi194.stdout:9/816: write d0/d6/d14/d26/d7f/f8b [742073,98604] 0 2024-04-13T10:58:47.149 INFO:tasks.workunit.client.1.smithi194.stdout:2/881: truncate d2/d3/de/d17/d36/d7a/faa 1012377 0 2024-04-13T10:58:47.153 INFO:tasks.workunit.client.1.smithi194.stdout:7/879: creat d1/d2b/d3e/ddf/d5a/d7d/f118 x:0 0 0 2024-04-13T10:58:47.154 INFO:tasks.workunit.client.1.smithi194.stdout:9/817: fsync d0/d6/d14/d26/fee 0 2024-04-13T10:58:47.154 INFO:tasks.workunit.client.1.smithi194.stdout:2/882: creat d2/d3/de/d3c/f129 x:0 0 0 2024-04-13T10:58:47.156 INFO:tasks.workunit.client.1.smithi194.stdout:8/934: dread d6/d22/d23/d25/d39/f62 [0,4194304] 0 2024-04-13T10:58:47.157 INFO:tasks.workunit.client.1.smithi194.stdout:9/818: dread - d0/d6/d9/dd7/f109 zero size 2024-04-13T10:58:47.158 INFO:tasks.workunit.client.1.smithi194.stdout:0/780: dwrite d9/db/d3a/fc0 [0,4194304] 0 2024-04-13T10:58:47.159 INFO:tasks.workunit.client.1.smithi194.stdout:2/883: write d2/d3/de/d17/d39/fef [683550,19375] 0 2024-04-13T10:58:47.160 INFO:tasks.workunit.client.1.smithi194.stdout:9/819: dread - d0/d88/fb9 zero size 2024-04-13T10:58:47.162 INFO:tasks.workunit.client.1.smithi194.stdout:8/935: creat d6/d22/d23/d25/d71/da0/f134 x:0 0 0 2024-04-13T10:58:47.162 INFO:tasks.workunit.client.1.smithi194.stdout:7/880: rename d1/dd9/de1/fda to d1/d2b/d2c/d30/f119 0 2024-04-13T10:58:47.164 INFO:tasks.workunit.client.1.smithi194.stdout:9/820: dread - d0/d11/d3d/d4c/f81 zero size 2024-04-13T10:58:47.165 INFO:tasks.workunit.client.1.smithi194.stdout:2/884: rmdir d2/d3/de/d33/d47 39 2024-04-13T10:58:47.167 INFO:tasks.workunit.client.1.smithi194.stdout:8/936: symlink d6/dd/d45/daa/l135 0 2024-04-13T10:58:47.171 INFO:tasks.workunit.client.1.smithi194.stdout:0/781: dwrite d9/db1/d30/fa0 [0,4194304] 0 2024-04-13T10:58:47.176 INFO:tasks.workunit.client.1.smithi194.stdout:7/881: link d1/d2b/d4c/d4f/d85/cbb d1/d2b/d2c/d30/d33/c11a 0 2024-04-13T10:58:47.176 INFO:tasks.workunit.client.1.smithi194.stdout:0/782: stat d9/db/l62 0 2024-04-13T10:58:47.176 INFO:tasks.workunit.client.1.smithi194.stdout:9/821: dwrite d0/d11/d3d/d9b/fb7 [0,4194304] 0 2024-04-13T10:58:47.177 INFO:tasks.workunit.client.1.smithi194.stdout:2/885: getdents d2/d3/de/d17/d36/d7a/d126 0 2024-04-13T10:58:47.177 INFO:tasks.workunit.client.1.smithi194.stdout:8/937: symlink d6/d22/d23/d7f/d8c/d8d/d10c/l136 0 2024-04-13T10:58:47.180 INFO:tasks.workunit.client.1.smithi194.stdout:9/822: creat d0/d11/d58/f11a x:0 0 0 2024-04-13T10:58:47.181 INFO:tasks.workunit.client.1.smithi194.stdout:8/938: readlink d6/d22/d23/d7f/d8c/d8d/d10c/l136 0 2024-04-13T10:58:47.181 INFO:tasks.workunit.client.1.smithi194.stdout:2/886: creat d2/d3/de/d17/d36/d8f/f12a x:0 0 0 2024-04-13T10:58:47.182 INFO:tasks.workunit.client.1.smithi194.stdout:9/823: dread - d0/d6/d14/d6d/fe6 zero size 2024-04-13T10:58:47.183 INFO:tasks.workunit.client.1.smithi194.stdout:0/783: getdents d9/db1/d30 0 2024-04-13T10:58:47.185 INFO:tasks.workunit.client.1.smithi194.stdout:3/754: dread d2/f27 [0,4194304] 0 2024-04-13T10:58:47.185 INFO:tasks.workunit.client.1.smithi194.stdout:7/882: dread d1/d2b/d4c/d4f/f70 [0,4194304] 0 2024-04-13T10:58:47.187 INFO:tasks.workunit.client.1.smithi194.stdout:2/887: mkdir d2/d3/de/d33/d47/dbb/d5a/d12b 0 2024-04-13T10:58:47.189 INFO:tasks.workunit.client.1.smithi194.stdout:2/888: write d2/d3/f4a [104082,10577] 0 2024-04-13T10:58:47.190 INFO:tasks.workunit.client.1.smithi194.stdout:3/755: chown d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/cd5 23736745 1 2024-04-13T10:58:47.192 INFO:tasks.workunit.client.1.smithi194.stdout:8/939: rmdir d6/dd/d45/daa 39 2024-04-13T10:58:47.198 INFO:tasks.workunit.client.1.smithi194.stdout:9/824: getdents d0/d11/d3d 0 2024-04-13T10:58:47.198 INFO:tasks.workunit.client.1.smithi194.stdout:3/756: rmdir d2/d3/d12/d31/d34/d88/d24/d3a 39 2024-04-13T10:58:47.199 INFO:tasks.workunit.client.1.smithi194.stdout:8/940: creat d6/d2a/d69/da3/dfd/f137 x:0 0 0 2024-04-13T10:58:47.200 INFO:tasks.workunit.client.1.smithi194.stdout:8/941: truncate d6/dd/f9f 4394427 0 2024-04-13T10:58:47.201 INFO:tasks.workunit.client.1.smithi194.stdout:7/883: link d1/f16 d1/d2b/d2c/d30/d33/d39/dba/d10e/f11b 0 2024-04-13T10:58:47.201 INFO:tasks.workunit.client.1.smithi194.stdout:0/784: write d9/d2b/f3e [839567,3939] 0 2024-04-13T10:58:47.202 INFO:tasks.workunit.client.1.smithi194.stdout:2/889: write d2/d3/de/d17/d1e/d42/d86/f89 [1707455,112828] 0 2024-04-13T10:58:47.203 INFO:tasks.workunit.client.1.smithi194.stdout:2/890: read d2/d3/d6d/f7c [1262020,57429] 0 2024-04-13T10:58:47.205 INFO:tasks.workunit.client.1.smithi194.stdout:0/785: write d9/db/f3d [1047070,128013] 0 2024-04-13T10:58:47.207 INFO:tasks.workunit.client.1.smithi194.stdout:8/942: rename d6/d2a/d69/dc4/ce6 to d6/d2a/dce/c138 0 2024-04-13T10:58:47.209 INFO:tasks.workunit.client.1.smithi194.stdout:2/891: rename d2/d3/de/d17/d36/d8f/l18 to d2/d3/de/d33/d47/dbb/d5a/l12c 0 2024-04-13T10:58:47.210 INFO:tasks.workunit.client.1.smithi194.stdout:8/943: dread d6/d22/d23/d25/d71/da0/de5/deb/dac/f10d [0,4194304] 0 2024-04-13T10:58:47.213 INFO:tasks.workunit.client.1.smithi194.stdout:8/944: mkdir d6/dd/d45/de3/de9/d139 0 2024-04-13T10:58:47.220 INFO:tasks.workunit.client.1.smithi194.stdout:7/884: dwrite d1/d2b/d4c/d4f/d51/f1f [0,4194304] 0 2024-04-13T10:58:47.221 INFO:tasks.workunit.client.1.smithi194.stdout:0/786: dread d9/d2b/d6c/ddf/d16/d65/f7a [0,4194304] 0 2024-04-13T10:58:47.223 INFO:tasks.workunit.client.1.smithi194.stdout:8/945: dwrite d6/d2a/d69/da3/dfd/f110 [0,4194304] 0 2024-04-13T10:58:47.228 INFO:tasks.workunit.client.1.smithi194.stdout:7/885: mknod d1/dd9/de1/dab/d96/d10c/d111/c11c 0 2024-04-13T10:58:47.230 INFO:tasks.workunit.client.1.smithi194.stdout:2/892: dread d2/d3/d12/f22 [0,4194304] 0 2024-04-13T10:58:47.231 INFO:tasks.workunit.client.1.smithi194.stdout:8/946: unlink d6/d22/d23/d7f/de2/fe8 0 2024-04-13T10:58:47.231 INFO:tasks.workunit.client.1.smithi194.stdout:8/947: readlink d6/d22/lbc 0 2024-04-13T10:58:47.237 INFO:tasks.workunit.client.1.smithi194.stdout:0/787: write d9/d2b/d6c/ddf/d63/f80 [1140449,64079] 0 2024-04-13T10:58:47.238 INFO:tasks.workunit.client.1.smithi194.stdout:2/893: symlink d2/d3/d6d/l12d 0 2024-04-13T10:58:47.239 INFO:tasks.workunit.client.1.smithi194.stdout:8/948: mkdir d6/d22/d23/d25/d13a 0 2024-04-13T10:58:47.239 INFO:tasks.workunit.client.1.smithi194.stdout:8/949: chown d6/dd/l99 873212 1 2024-04-13T10:58:47.240 INFO:tasks.workunit.client.1.smithi194.stdout:8/950: stat d6/d2a/dc7 0 2024-04-13T10:58:47.240 INFO:tasks.workunit.client.1.smithi194.stdout:7/886: rename d1/d2b/d3e/ddf/d5a/fd5 to d1/d2b/d4c/d4f/d51/d4d/d5e/f11d 0 2024-04-13T10:58:47.243 INFO:tasks.workunit.client.1.smithi194.stdout:0/788: mkdir d9/db1/d30/df9/d101 0 2024-04-13T10:58:47.244 INFO:tasks.workunit.client.1.smithi194.stdout:0/789: write d9/d2b/d6c/ddf/fbb [618184,100731] 0 2024-04-13T10:58:47.244 INFO:tasks.workunit.client.1.smithi194.stdout:8/951: creat d6/d2a/dc7/dc8/f13b x:0 0 0 2024-04-13T10:58:47.245 INFO:tasks.workunit.client.1.smithi194.stdout:0/790: fsync d9/db1/d30/d73/fba 0 2024-04-13T10:58:47.245 INFO:tasks.workunit.client.1.smithi194.stdout:7/887: mkdir d1/d2b/d4c/d4f/d85/d11e 0 2024-04-13T10:58:47.247 INFO:tasks.workunit.client.1.smithi194.stdout:2/894: dread d2/d3/de/f7f [0,4194304] 0 2024-04-13T10:58:47.247 INFO:tasks.workunit.client.1.smithi194.stdout:8/952: write d6/d22/d23/f85 [328958,42316] 0 2024-04-13T10:58:47.247 INFO:tasks.workunit.client.1.smithi194.stdout:7/888: write d1/d2b/d4c/d4f/fbe [3121090,91273] 0 2024-04-13T10:58:47.249 INFO:tasks.workunit.client.1.smithi194.stdout:8/953: fdatasync d6/d22/d23/d25/d39/f62 0 2024-04-13T10:58:47.250 INFO:tasks.workunit.client.1.smithi194.stdout:2/895: mkdir d2/d37/d12e 0 2024-04-13T10:58:47.251 INFO:tasks.workunit.client.1.smithi194.stdout:0/791: dread d9/d2b/d6c/ddf/d16/d65/fac [0,4194304] 0 2024-04-13T10:58:47.251 INFO:tasks.workunit.client.1.smithi194.stdout:8/954: readlink d6/d22/d23/d25/d71/da0/de5/lc6 0 2024-04-13T10:58:47.252 INFO:tasks.workunit.client.1.smithi194.stdout:0/792: write d9/db/d3a/d9a/dd7/f2e [368874,126176] 0 2024-04-13T10:58:47.253 INFO:tasks.workunit.client.1.smithi194.stdout:1/747: sync 2024-04-13T10:58:47.253 INFO:tasks.workunit.client.1.smithi194.stdout:5/909: sync 2024-04-13T10:58:47.253 INFO:tasks.workunit.client.1.smithi194.stdout:7/889: creat d1/d2b/d4c/d4f/d51/d4d/d5e/f11f x:0 0 0 2024-04-13T10:58:47.253 INFO:tasks.workunit.client.1.smithi194.stdout:8/955: chown d6/d22/d23/d25/d39/d41/d5b/d76/l86 2061614 1 2024-04-13T10:58:47.254 INFO:tasks.workunit.client.1.smithi194.stdout:0/793: write d9/d2b/f96 [375711,29377] 0 2024-04-13T10:58:47.255 INFO:tasks.workunit.client.1.smithi194.stdout:1/748: write d12/d13/d3e/fa8 [4474112,96392] 0 2024-04-13T10:58:47.256 INFO:tasks.workunit.client.1.smithi194.stdout:8/956: write d6/d2a/f34 [6460975,86158] 0 2024-04-13T10:58:47.258 INFO:tasks.workunit.client.1.smithi194.stdout:8/957: chown d6/d22/l8b 241972 1 2024-04-13T10:58:47.259 INFO:tasks.workunit.client.1.smithi194.stdout:0/794: unlink d9/db1/d30/d73/d87/lfa 0 2024-04-13T10:58:47.260 INFO:tasks.workunit.client.1.smithi194.stdout:0/795: chown d9/db/d3a/d9a/dd7/l82 661 1 2024-04-13T10:58:47.260 INFO:tasks.workunit.client.1.smithi194.stdout:0/796: readlink d9/d2b/d6c/ddf/d16/d70/lc7 0 2024-04-13T10:58:47.261 INFO:tasks.workunit.client.1.smithi194.stdout:8/958: creat d6/d2a/dc7/dc8/f13c x:0 0 0 2024-04-13T10:58:47.262 INFO:tasks.workunit.client.1.smithi194.stdout:0/797: readlink d9/d2b/dbd/lbe 0 2024-04-13T10:58:47.262 INFO:tasks.workunit.client.1.smithi194.stdout:5/910: link d3/dc/d2d/dd1/d20/ccb d3/dc/d2d/dd1/c11e 0 2024-04-13T10:58:47.269 INFO:tasks.workunit.client.1.smithi194.stdout:7/890: dread d1/f2e [0,4194304] 0 2024-04-13T10:58:47.270 INFO:tasks.workunit.client.1.smithi194.stdout:8/959: dwrite d6/d22/d23/d25/d71/da0/de5/dd0/f115 [0,4194304] 0 2024-04-13T10:58:47.275 INFO:tasks.workunit.client.1.smithi194.stdout:8/960: dread d6/dd/d45/fb9 [0,4194304] 0 2024-04-13T10:58:47.275 INFO:tasks.workunit.client.1.smithi194.stdout:7/891: symlink d1/d2b/d3e/ddf/d5a/d7d/l120 0 2024-04-13T10:58:47.278 INFO:tasks.workunit.client.1.smithi194.stdout:1/749: dread d12/f35 [0,4194304] 0 2024-04-13T10:58:47.281 INFO:tasks.workunit.client.1.smithi194.stdout:1/750: truncate d12/d13/d1c/d27/d4c/d7d/f95 390538 0 2024-04-13T10:58:47.284 INFO:tasks.workunit.client.1.smithi194.stdout:1/751: rename d12/d13/d1c/d27/d4c/dd7/de6 to d12/d13/d1c/d28/df2 0 2024-04-13T10:58:47.285 INFO:tasks.workunit.client.1.smithi194.stdout:8/961: truncate d6/d22/d23/d25/d71/da0/de5/dd0/f115 1557128 0 2024-04-13T10:58:47.286 INFO:tasks.workunit.client.1.smithi194.stdout:1/752: symlink d12/d13/d1c/d27/d2e/lf3 0 2024-04-13T10:58:47.287 INFO:tasks.workunit.client.1.smithi194.stdout:8/962: rename d6/fc9 to d6/dd/f13d 0 2024-04-13T10:58:47.291 INFO:tasks.workunit.client.1.smithi194.stdout:8/963: link d6/d22/lbc d6/dff/d127/l13e 0 2024-04-13T10:58:47.294 INFO:tasks.workunit.client.1.smithi194.stdout:8/964: creat d6/d22/d23/d25/d71/dc2/f13f x:0 0 0 2024-04-13T10:58:47.295 INFO:tasks.workunit.client.1.smithi194.stdout:8/965: dread - d6/d22/d23/d25/d71/da0/de5/deb/f109 zero size 2024-04-13T10:58:47.299 INFO:tasks.workunit.client.1.smithi194.stdout:1/753: dwrite d12/d13/d44/f85 [4194304,4194304] 0 2024-04-13T10:58:47.300 INFO:tasks.workunit.client.1.smithi194.stdout:8/966: truncate d6/dd/f48 1166606 0 2024-04-13T10:58:47.304 INFO:tasks.workunit.client.1.smithi194.stdout:1/754: creat d12/d13/de7/ff4 x:0 0 0 2024-04-13T10:58:47.305 INFO:tasks.workunit.client.1.smithi194.stdout:1/755: write d12/d3a/fc2 [357498,82442] 0 2024-04-13T10:58:47.308 INFO:tasks.workunit.client.1.smithi194.stdout:8/967: link d6/dd/f124 d6/d22/d23/d25/d71/da0/de5/deb/d131/f140 0 2024-04-13T10:58:47.309 INFO:tasks.workunit.client.1.smithi194.stdout:1/756: creat d12/d13/d1c/d28/d41/d4e/ff5 x:0 0 0 2024-04-13T10:58:47.310 INFO:tasks.workunit.client.1.smithi194.stdout:1/757: fsync d12/d13/d1c/d28/ff0 0 2024-04-13T10:58:47.310 INFO:tasks.workunit.client.1.smithi194.stdout:8/968: mknod d6/d2a/d69/da3/dfd/d12c/c141 0 2024-04-13T10:58:47.310 INFO:tasks.workunit.client.1.smithi194.stdout:1/758: dread - d12/d13/d1c/fd9 zero size 2024-04-13T10:58:47.312 INFO:tasks.workunit.client.1.smithi194.stdout:8/969: rmdir d6/dd/d45/de3 39 2024-04-13T10:58:47.313 INFO:tasks.workunit.client.1.smithi194.stdout:1/759: mknod d12/d13/d1c/d28/de8/cf6 0 2024-04-13T10:58:47.313 INFO:tasks.workunit.client.1.smithi194.stdout:8/970: dread - d6/d22/d23/d25/d71/da0/de5/deb/fd8 zero size 2024-04-13T10:58:47.314 INFO:tasks.workunit.client.1.smithi194.stdout:1/760: chown d12/d13/d1c/d27/d5c/fb4 895190 1 2024-04-13T10:58:47.314 INFO:tasks.workunit.client.1.smithi194.stdout:8/971: truncate d6/d2a/f57 1822044 0 2024-04-13T10:58:47.315 INFO:tasks.workunit.client.1.smithi194.stdout:1/761: chown d12/d13/d1c/d28/df2/d8b/dd4/ded 457814 1 2024-04-13T10:58:47.316 INFO:tasks.workunit.client.1.smithi194.stdout:8/972: creat d6/d22/d23/d3d/f142 x:0 0 0 2024-04-13T10:58:47.319 INFO:tasks.workunit.client.1.smithi194.stdout:8/973: symlink d6/dd/d45/de3/de9/l143 0 2024-04-13T10:58:47.325 INFO:tasks.workunit.client.1.smithi194.stdout:8/974: dwrite d6/d22/d23/f12a [0,4194304] 0 2024-04-13T10:58:47.325 INFO:tasks.workunit.client.1.smithi194.stdout:1/762: dread d12/d3a/f9a [0,4194304] 0 2024-04-13T10:58:47.326 INFO:tasks.workunit.client.1.smithi194.stdout:1/763: chown d12/d13/d1c/d28/df2/d8b/db2 3368793 1 2024-04-13T10:58:47.327 INFO:tasks.workunit.client.1.smithi194.stdout:1/764: write d12/d13/d44/fa1 [1252067,100229] 0 2024-04-13T10:58:47.331 INFO:tasks.workunit.client.1.smithi194.stdout:1/765: mkdir d12/d13/d1c/d28/df2/d8b/db2/df7 0 2024-04-13T10:58:47.335 INFO:tasks.workunit.client.1.smithi194.stdout:1/766: truncate d12/d13/d1c/d27/f70 373935 0 2024-04-13T10:58:47.335 INFO:tasks.workunit.client.1.smithi194.stdout:8/975: dwrite d6/dd/d45/f6a [0,4194304] 0 2024-04-13T10:58:47.340 INFO:tasks.workunit.client.1.smithi194.stdout:8/976: getdents d6/dd/d45/de3 0 2024-04-13T10:58:47.343 INFO:tasks.workunit.client.1.smithi194.stdout:8/977: truncate d6/dd/f98 8729276 0 2024-04-13T10:58:47.345 INFO:tasks.workunit.client.1.smithi194.stdout:1/767: dwrite d12/d13/d1c/d28/ff0 [0,4194304] 0 2024-04-13T10:58:47.352 INFO:tasks.workunit.client.1.smithi194.stdout:8/978: link d6/dd/d45/de3/ff4 d6/d2a/dce/f144 0 2024-04-13T10:58:47.358 INFO:tasks.workunit.client.1.smithi194.stdout:5/911: dread d3/dc/d2d/dd1/d38/d59/d7a/f9e [0,4194304] 0 2024-04-13T10:58:47.360 INFO:tasks.workunit.client.1.smithi194.stdout:5/912: mknod d3/c11f 0 2024-04-13T10:58:47.362 INFO:tasks.workunit.client.1.smithi194.stdout:5/913: symlink d3/dc/d2d/dd1/db5/l120 0 2024-04-13T10:58:47.365 INFO:tasks.workunit.client.1.smithi194.stdout:5/914: symlink d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/db1/l121 0 2024-04-13T10:58:47.370 INFO:tasks.workunit.client.1.smithi194.stdout:5/915: rename d3/dc/d2d/dd1/d38/d59/d7a/df5 to d3/dc/d2d/dd1/db5/d11a/d122 0 2024-04-13T10:58:47.376 INFO:tasks.workunit.client.1.smithi194.stdout:5/916: rename d3/dc/d2d/dd1/d38/f44 to d3/dc/d2d/dd1/d20/daa/dae/dd4/f123 0 2024-04-13T10:58:47.380 INFO:tasks.workunit.client.1.smithi194.stdout:5/917: rename d3/d29/c69 to d3/dc/d2d/dd1/d20/c124 0 2024-04-13T10:58:47.385 INFO:tasks.workunit.client.1.smithi194.stdout:1/768: dread d12/f5b [0,4194304] 0 2024-04-13T10:58:47.387 INFO:tasks.workunit.client.1.smithi194.stdout:5/918: dread d3/dc/d2d/dd1/f61 [0,4194304] 0 2024-04-13T10:58:47.388 INFO:tasks.workunit.client.1.smithi194.stdout:5/919: chown d3/dc/d2d/l73 47633 1 2024-04-13T10:58:47.390 INFO:tasks.workunit.client.1.smithi194.stdout:5/920: stat d3/dc/d2d/dd1/c11e 0 2024-04-13T10:58:47.390 INFO:tasks.workunit.client.1.smithi194.stdout:5/921: write d3/dc/d2d/dd1/d38/d59/fca [354674,87636] 0 2024-04-13T10:58:47.392 INFO:tasks.workunit.client.1.smithi194.stdout:5/922: write d3/d29/fa2 [102068,38771] 0 2024-04-13T10:58:47.396 INFO:tasks.workunit.client.1.smithi194.stdout:5/923: dread d3/d29/f109 [0,4194304] 0 2024-04-13T10:58:47.398 INFO:tasks.workunit.client.1.smithi194.stdout:5/924: symlink d3/dc/d2d/dd1/d38/d59/l125 0 2024-04-13T10:58:47.401 INFO:tasks.workunit.client.1.smithi194.stdout:5/925: unlink d3/dc/d2d/dd1/f2e 0 2024-04-13T10:58:47.403 INFO:tasks.workunit.client.1.smithi194.stdout:1/769: dread d12/d13/d1c/d28/f58 [4194304,4194304] 0 2024-04-13T10:58:47.403 INFO:tasks.workunit.client.1.smithi194.stdout:5/926: creat d3/dc/d2d/dd1/d38/f126 x:0 0 0 2024-04-13T10:58:47.404 INFO:tasks.workunit.client.1.smithi194.stdout:1/770: chown d12/d13/d1c/d28/d41/d77/d93 14 1 2024-04-13T10:58:47.406 INFO:tasks.workunit.client.1.smithi194.stdout:1/771: creat d12/d13/d1c/d28/d41/ff8 x:0 0 0 2024-04-13T10:58:47.406 INFO:tasks.workunit.client.1.smithi194.stdout:5/927: creat d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/db1/f127 x:0 0 0 2024-04-13T10:58:47.407 INFO:tasks.workunit.client.1.smithi194.stdout:1/772: creat d12/d3a/d4f/da3/df1/ff9 x:0 0 0 2024-04-13T10:58:47.409 INFO:tasks.workunit.client.1.smithi194.stdout:6/780: sync 2024-04-13T10:58:47.409 INFO:tasks.workunit.client.1.smithi194.stdout:6/781: chown d0/d57/d84 1 1 2024-04-13T10:58:47.410 INFO:tasks.workunit.client.1.smithi194.stdout:1/773: creat d12/d13/d44/ffa x:0 0 0 2024-04-13T10:58:47.412 INFO:tasks.workunit.client.1.smithi194.stdout:6/782: creat d0/d26/d4b/de6/ffb x:0 0 0 2024-04-13T10:58:47.412 INFO:tasks.workunit.client.1.smithi194.stdout:1/774: mkdir d12/d13/d1c/d7c/dfb 0 2024-04-13T10:58:47.414 INFO:tasks.workunit.client.1.smithi194.stdout:6/783: symlink d0/d2f/d48/lfc 0 2024-04-13T10:58:47.417 INFO:tasks.workunit.client.1.smithi194.stdout:6/784: creat d0/d42/d7b/db4/de0/ffd x:0 0 0 2024-04-13T10:58:47.419 INFO:tasks.workunit.client.1.smithi194.stdout:6/785: mkdir d0/d57/d84/dfe 0 2024-04-13T10:58:47.419 INFO:tasks.workunit.client.1.smithi194.stdout:5/928: dread d3/dc/d2d/dd1/d38/d59/d49/f88 [4194304,4194304] 0 2024-04-13T10:58:47.422 INFO:tasks.workunit.client.1.smithi194.stdout:6/786: symlink d0/d53/lff 0 2024-04-13T10:58:47.423 INFO:tasks.workunit.client.1.smithi194.stdout:1/775: mkdir d12/d13/d1c/d28/d41/d77/d93/dfc 0 2024-04-13T10:58:47.423 INFO:tasks.workunit.client.1.smithi194.stdout:6/787: fsync d0/d42/dbe/d4d/d80/fa4 0 2024-04-13T10:58:47.504 INFO:tasks.workunit.client.1.smithi194.stdout:1/776: creat d12/d13/d1c/d27/d4c/ffd x:0 0 0 2024-04-13T10:58:47.505 INFO:tasks.workunit.client.1.smithi194.stdout:5/929: dwrite d3/dc/d17/f75 [0,4194304] 0 2024-04-13T10:58:47.505 INFO:tasks.workunit.client.1.smithi194.stdout:6/788: write d0/d42/dbe/d4d/d80/fc7 [1461050,96529] 0 2024-04-13T10:58:47.509 INFO:tasks.workunit.client.1.smithi194.stdout:5/930: creat d3/dc/d2d/dd1/d20/daa/f128 x:0 0 0 2024-04-13T10:58:47.510 INFO:tasks.workunit.client.1.smithi194.stdout:1/777: creat d12/d13/d1c/d7c/dfb/ffe x:0 0 0 2024-04-13T10:58:47.511 INFO:tasks.workunit.client.1.smithi194.stdout:6/789: creat d0/d2c/d77/d7f/dba/f100 x:0 0 0 2024-04-13T10:58:47.511 INFO:tasks.workunit.client.1.smithi194.stdout:5/931: chown d3/dc/d2d/dd1/d38/f60 83 1 2024-04-13T10:58:47.512 INFO:tasks.workunit.client.1.smithi194.stdout:5/932: chown d3/dc/d2d/dd1/d20/daa/ld7 336044 1 2024-04-13T10:58:47.513 INFO:tasks.workunit.client.1.smithi194.stdout:6/790: mkdir d0/d57/d84/dfe/d101 0 2024-04-13T10:58:47.515 INFO:tasks.workunit.client.1.smithi194.stdout:6/791: symlink d0/d57/d84/l102 0 2024-04-13T10:58:47.518 INFO:tasks.workunit.client.1.smithi194.stdout:5/933: rename d3/d83/f102 to d3/dc/d2d/dd1/d38/f129 0 2024-04-13T10:58:47.522 INFO:tasks.workunit.client.1.smithi194.stdout:5/934: rmdir d3/dc 39 2024-04-13T10:58:47.524 INFO:tasks.workunit.client.1.smithi194.stdout:6/792: dwrite d0/d53/f81 [0,4194304] 0 2024-04-13T10:58:47.526 INFO:tasks.workunit.client.1.smithi194.stdout:5/935: creat d3/dc/d2d/dd1/db5/d11a/df2/d10c/f12a x:0 0 0 2024-04-13T10:58:47.526 INFO:tasks.workunit.client.1.smithi194.stdout:1/778: dwrite d12/fa4 [0,4194304] 0 2024-04-13T10:58:47.529 INFO:tasks.workunit.client.1.smithi194.stdout:1/779: mkdir d12/d13/d1c/d27/d4c/dd7/dff 0 2024-04-13T10:58:47.530 INFO:tasks.workunit.client.1.smithi194.stdout:5/936: fsync d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/db1/ffd 0 2024-04-13T10:58:47.532 INFO:tasks.workunit.client.1.smithi194.stdout:6/793: dread d0/d26/d4b/feb [0,4194304] 0 2024-04-13T10:58:47.534 INFO:tasks.workunit.client.1.smithi194.stdout:1/780: truncate d12/f15 3022856 0 2024-04-13T10:58:47.536 INFO:tasks.workunit.client.1.smithi194.stdout:1/781: write d12/d13/d1c/d27/d5c/fb4 [1153546,91396] 0 2024-04-13T10:58:47.536 INFO:tasks.workunit.client.1.smithi194.stdout:6/794: rename d0/d26/c11 to d0/d26/d4b/de6/c103 0 2024-04-13T10:58:47.540 INFO:tasks.workunit.client.1.smithi194.stdout:5/937: creat d3/dc/d17/d1b/f12b x:0 0 0 2024-04-13T10:58:47.541 INFO:tasks.workunit.client.1.smithi194.stdout:6/795: creat d0/d2f/d48/d83/f104 x:0 0 0 2024-04-13T10:58:47.541 INFO:tasks.workunit.client.1.smithi194.stdout:1/782: symlink d12/d13/d1c/d28/d41/d4e/l100 0 2024-04-13T10:58:47.542 INFO:tasks.workunit.client.1.smithi194.stdout:5/938: read - d3/dc/d2d/dd1/d20/daa/dae/dd4/ff3 zero size 2024-04-13T10:58:47.547 INFO:tasks.workunit.client.1.smithi194.stdout:9/825: sync 2024-04-13T10:58:47.547 INFO:tasks.workunit.client.1.smithi194.stdout:4/862: sync 2024-04-13T10:58:47.548 INFO:tasks.workunit.client.1.smithi194.stdout:5/939: creat d3/dc/d17/d1b/f12c x:0 0 0 2024-04-13T10:58:47.548 INFO:tasks.workunit.client.1.smithi194.stdout:6/796: dwrite d0/d2c/f3e [0,4194304] 0 2024-04-13T10:58:47.549 INFO:tasks.workunit.client.1.smithi194.stdout:9/826: write d0/d6/d14/dcd/dd6/f105 [803839,55129] 0 2024-04-13T10:58:47.551 INFO:tasks.workunit.client.1.smithi194.stdout:1/783: rename d12/d13/d1c/d27/d4c/d7d to d12/d13/d1c/d28/df2/d101 0 2024-04-13T10:58:47.555 INFO:tasks.workunit.client.1.smithi194.stdout:4/863: rename d2/d30/d50/d11a/d1c/d54/d5d/c116 to d2/d30/d50/d11a/d60/d107/c128 0 2024-04-13T10:58:47.561 INFO:tasks.workunit.client.1.smithi194.stdout:5/940: mkdir d3/dc/d17/d12d 0 2024-04-13T10:58:47.562 INFO:tasks.workunit.client.1.smithi194.stdout:1/784: read d12/d13/d1c/d27/f86 [229662,74351] 0 2024-04-13T10:58:47.566 INFO:tasks.workunit.client.1.smithi194.stdout:6/797: dwrite d0/d53/f55 [0,4194304] 0 2024-04-13T10:58:47.567 INFO:tasks.workunit.client.1.smithi194.stdout:9/827: dwrite d0/d6/d14/d6d/fe6 [0,4194304] 0 2024-04-13T10:58:47.568 INFO:tasks.workunit.client.1.smithi194.stdout:6/798: write d0/d2c/d77/d93/fa9 [611791,124579] 0 2024-04-13T10:58:47.573 INFO:tasks.workunit.client.1.smithi194.stdout:5/941: creat d3/d89/f12e x:0 0 0 2024-04-13T10:58:47.575 INFO:tasks.workunit.client.1.smithi194.stdout:5/942: dread d3/dc/d17/d1b/f42 [0,4194304] 0 2024-04-13T10:58:47.576 INFO:tasks.workunit.client.1.smithi194.stdout:5/943: write d3/dc/d17/d1b/f12c [253479,4533] 0 2024-04-13T10:58:47.577 INFO:tasks.workunit.client.1.smithi194.stdout:4/864: creat d2/d30/d50/d11a/d1c/d3e/dfe/f129 x:0 0 0 2024-04-13T10:58:47.578 INFO:tasks.workunit.client.1.smithi194.stdout:4/865: chown d2/d30/d50/d11a/d1c/f39 1199184 1 2024-04-13T10:58:47.580 INFO:tasks.workunit.client.1.smithi194.stdout:9/828: creat d0/d6/d14/d26/d3b/f11b x:0 0 0 2024-04-13T10:58:47.581 INFO:tasks.workunit.client.1.smithi194.stdout:6/799: write d0/d42/dbe/d4d/f4f [1291108,103671] 0 2024-04-13T10:58:47.582 INFO:tasks.workunit.client.1.smithi194.stdout:9/829: chown d0/d6/d2c/d68/lc0 954851 1 2024-04-13T10:58:47.584 INFO:tasks.workunit.client.1.smithi194.stdout:1/785: getdents d12/d3a/d4f 0 2024-04-13T10:58:47.585 INFO:tasks.workunit.client.1.smithi194.stdout:6/800: unlink d0/d26/d4b/de6/lf2 0 2024-04-13T10:58:47.586 INFO:tasks.workunit.client.1.smithi194.stdout:4/866: getdents d2/d30 0 2024-04-13T10:58:47.588 INFO:tasks.workunit.client.1.smithi194.stdout:6/801: dread - d0/d26/d4b/de6/ffb zero size 2024-04-13T10:58:47.588 INFO:tasks.workunit.client.1.smithi194.stdout:9/830: truncate d0/d6/d9/dd7/f109 983646 0 2024-04-13T10:58:47.588 INFO:tasks.workunit.client.1.smithi194.stdout:1/786: fsync d12/d13/d44/f89 0 2024-04-13T10:58:47.589 INFO:tasks.workunit.client.1.smithi194.stdout:5/944: dwrite d3/dc/d2d/dd1/d38/d59/d49/dbf/fcd [0,4194304] 0 2024-04-13T10:58:47.591 INFO:tasks.workunit.client.1.smithi194.stdout:9/831: stat d0/d6/d14/d26/d3b/f11b 0 2024-04-13T10:58:47.594 INFO:tasks.workunit.client.1.smithi194.stdout:5/945: fsync d3/dc/d2d/dd1/f4c 0 2024-04-13T10:58:47.597 INFO:tasks.workunit.client.1.smithi194.stdout:4/867: dwrite d2/fc0 [0,4194304] 0 2024-04-13T10:58:47.597 INFO:tasks.workunit.client.1.smithi194.stdout:6/802: rename d0/d57/d84/l8b to d0/d26/dcb/l105 0 2024-04-13T10:58:47.600 INFO:tasks.workunit.client.1.smithi194.stdout:9/832: mknod d0/d6/d14/dcd/c11c 0 2024-04-13T10:58:47.601 INFO:tasks.workunit.client.1.smithi194.stdout:4/868: dread - d2/d30/d50/d11a/d1c/d54/d62/d10d/fc9 zero size 2024-04-13T10:58:47.601 INFO:tasks.workunit.client.1.smithi194.stdout:1/787: creat d12/d13/d1c/d28/d41/d77/d80/dc9/f102 x:0 0 0 2024-04-13T10:58:47.605 INFO:tasks.workunit.client.1.smithi194.stdout:5/946: dwrite d3/fcf [0,4194304] 0 2024-04-13T10:58:47.609 INFO:tasks.workunit.client.1.smithi194.stdout:1/788: unlink d12/d13/d1c/d27/d4c/lb3 0 2024-04-13T10:58:47.611 INFO:tasks.workunit.client.1.smithi194.stdout:9/833: dread d0/d6/d2c/f69 [4194304,4194304] 0 2024-04-13T10:58:47.612 INFO:tasks.workunit.client.1.smithi194.stdout:6/803: dwrite d0/d53/f60 [0,4194304] 0 2024-04-13T10:58:47.612 INFO:tasks.workunit.client.1.smithi194.stdout:5/947: dread - d3/dc/d2d/dd1/d38/d59/d7a/f101 zero size 2024-04-13T10:58:47.613 INFO:tasks.workunit.client.1.smithi194.stdout:9/834: read d0/d11/f3c [595558,49564] 0 2024-04-13T10:58:47.616 INFO:tasks.workunit.client.1.smithi194.stdout:5/948: write d3/dc/d2d/fab [267631,15539] 0 2024-04-13T10:58:47.617 INFO:tasks.workunit.client.1.smithi194.stdout:1/789: read f10 [4215485,39657] 0 2024-04-13T10:58:47.617 INFO:tasks.workunit.client.1.smithi194.stdout:6/804: write d0/d2f/d48/f87 [74146,58496] 0 2024-04-13T10:58:47.618 INFO:tasks.workunit.client.1.smithi194.stdout:9/835: write d0/d11/d3d/fbf [997069,88908] 0 2024-04-13T10:58:47.621 INFO:tasks.workunit.client.1.smithi194.stdout:1/790: dread - d12/d13/d1c/d28/f75 zero size 2024-04-13T10:58:47.621 INFO:tasks.workunit.client.1.smithi194.stdout:3/757: sync 2024-04-13T10:58:47.621 INFO:tasks.workunit.client.1.smithi194.stdout:2/896: sync 2024-04-13T10:58:47.623 INFO:tasks.workunit.client.1.smithi194.stdout:9/836: mknod d0/d6/d2c/c11d 0 2024-04-13T10:58:47.626 INFO:tasks.workunit.client.1.smithi194.stdout:1/791: symlink d12/d13/d1c/d27/d4c/dd7/l103 0 2024-04-13T10:58:47.627 INFO:tasks.workunit.client.1.smithi194.stdout:2/897: write d2/d3/de/d17/d36/d8f/f4c [4320677,117982] 0 2024-04-13T10:58:47.632 INFO:tasks.workunit.client.1.smithi194.stdout:9/837: write d0/d6/ffa [4141734,47758] 0 2024-04-13T10:58:47.635 INFO:tasks.workunit.client.1.smithi194.stdout:6/805: dwrite d0/d42/dbe/f3c [0,4194304] 0 2024-04-13T10:58:47.635 INFO:tasks.workunit.client.1.smithi194.stdout:4/869: dread d2/d30/d50/d11a/d1c/d3e/d48/d7f/fb0 [0,4194304] 0 2024-04-13T10:58:47.636 INFO:tasks.workunit.client.1.smithi194.stdout:2/898: rename d2/d3/de/d17/lc8 to d2/d3/de/d33/d105/l12f 0 2024-04-13T10:58:47.639 INFO:tasks.workunit.client.1.smithi194.stdout:5/949: dwrite d3/dc/d2d/dd1/d20/daa/dae/dd4/f123 [0,4194304] 0 2024-04-13T10:58:47.641 INFO:tasks.workunit.client.1.smithi194.stdout:1/792: rename d12/d13/d1c/d27/d2e/cbf to d12/d13/d1c/d28/d41/d77/d80/c104 0 2024-04-13T10:58:47.643 INFO:tasks.workunit.client.1.smithi194.stdout:9/838: creat d0/d6/d14/d26/f11e x:0 0 0 2024-04-13T10:58:47.644 INFO:tasks.workunit.client.1.smithi194.stdout:2/899: chown d2/d3/d6d/dac/ld1 26 1 2024-04-13T10:58:47.648 INFO:tasks.workunit.client.1.smithi194.stdout:1/793: dwrite d12/f26 [0,4194304] 0 2024-04-13T10:58:47.649 INFO:tasks.workunit.client.1.smithi194.stdout:1/794: read - d12/d13/d44/ffa zero size 2024-04-13T10:58:47.650 INFO:tasks.workunit.client.1.smithi194.stdout:1/795: chown d12/d13/d1c/d28/df2/d8b/db2/df7 43682 1 2024-04-13T10:58:47.651 INFO:tasks.workunit.client.1.smithi194.stdout:5/950: rename d3/dc/d2d/dd1/d38/f96 to d3/d89/f12f 0 2024-04-13T10:58:47.652 INFO:tasks.workunit.client.1.smithi194.stdout:9/839: mkdir d0/d11/d3d/d4c/d11f 0 2024-04-13T10:58:47.655 INFO:tasks.workunit.client.1.smithi194.stdout:6/806: link d0/d2f/c5d d0/d2f/d48/d83/c106 0 2024-04-13T10:58:47.655 INFO:tasks.workunit.client.1.smithi194.stdout:9/840: chown d0/d6/f7b 439841 1 2024-04-13T10:58:47.656 INFO:tasks.workunit.client.1.smithi194.stdout:1/796: creat d12/d13/d1c/d27/d4c/d90/f105 x:0 0 0 2024-04-13T10:58:47.656 INFO:tasks.workunit.client.1.smithi194.stdout:2/900: rename d2/d3/de/d17/d36/lb7 to d2/d3/de/d17/d36/d3d/l130 0 2024-04-13T10:58:47.657 INFO:tasks.workunit.client.1.smithi194.stdout:4/870: getdents d2/d30/d50/d11a/d1c/d54/d62/d9e 0 2024-04-13T10:58:47.658 INFO:tasks.workunit.client.1.smithi194.stdout:9/841: mkdir d0/d6/d2c/d68/d120 0 2024-04-13T10:58:47.659 INFO:tasks.workunit.client.1.smithi194.stdout:1/797: dread - d12/d13/d1c/d27/d4c/ffd zero size 2024-04-13T10:58:47.660 INFO:tasks.workunit.client.1.smithi194.stdout:9/842: chown d0/d11/c108 1619 1 2024-04-13T10:58:47.661 INFO:tasks.workunit.client.1.smithi194.stdout:9/843: readlink d0/d6/d14/l61 0 2024-04-13T10:58:47.661 INFO:tasks.workunit.client.1.smithi194.stdout:1/798: write d12/d13/d1c/d7c/dfb/ffe [684731,14291] 0 2024-04-13T10:58:47.662 INFO:tasks.workunit.client.1.smithi194.stdout:6/807: rename d0/d2f/d48/d83/lbf to d0/d26/dcb/l107 0 2024-04-13T10:58:47.663 INFO:tasks.workunit.client.1.smithi194.stdout:6/808: fsync d0/d2c/d77/d93/daa/ff5 0 2024-04-13T10:58:47.664 INFO:tasks.workunit.client.1.smithi194.stdout:9/844: symlink d0/d6/d2c/l121 0 2024-04-13T10:58:47.665 INFO:tasks.workunit.client.1.smithi194.stdout:9/845: fdatasync d0/d11/d3d/f111 0 2024-04-13T10:58:47.665 INFO:tasks.workunit.client.1.smithi194.stdout:1/799: creat d12/d13/d1c/d27/d5c/f106 x:0 0 0 2024-04-13T10:58:47.667 INFO:tasks.workunit.client.1.smithi194.stdout:9/846: truncate d0/d11/d58/f11a 954854 0 2024-04-13T10:58:47.669 INFO:tasks.workunit.client.1.smithi194.stdout:2/901: rename d2/d3/de/d17/d39/l128 to d2/d3/de/d33/d109/l131 0 2024-04-13T10:58:47.672 INFO:tasks.workunit.client.1.smithi194.stdout:6/809: link d0/d57/d69/f65 d0/d2c/d77/d93/d98/f108 0 2024-04-13T10:58:47.673 INFO:tasks.workunit.client.1.smithi194.stdout:4/871: write d2/d30/d50/d11a/d1c/f39 [330147,60591] 0 2024-04-13T10:58:47.673 INFO:tasks.workunit.client.1.smithi194.stdout:2/902: read d2/d3/de/d17/d1e/d42/fa1 [733946,61264] 0 2024-04-13T10:58:47.676 INFO:tasks.workunit.client.1.smithi194.stdout:1/800: dwrite d12/d13/d1c/d27/d4c/d90/fcf [0,4194304] 0 2024-04-13T10:58:47.676 INFO:tasks.workunit.client.1.smithi194.stdout:6/810: stat d0/d2c/d77/d93/d98/ff3 0 2024-04-13T10:58:47.677 INFO:tasks.workunit.client.1.smithi194.stdout:9/847: dwrite d0/d11/d3d/f111 [0,4194304] 0 2024-04-13T10:58:47.679 INFO:tasks.workunit.client.1.smithi194.stdout:1/801: write d12/d13/d3e/f54 [64359,39627] 0 2024-04-13T10:58:47.681 INFO:tasks.workunit.client.1.smithi194.stdout:1/802: chown d12/d13/de7 10065523 1 2024-04-13T10:58:47.682 INFO:tasks.workunit.client.1.smithi194.stdout:6/811: rename d0/d53/fe1 to d0/d26/d4b/dd0/f109 0 2024-04-13T10:58:47.683 INFO:tasks.workunit.client.1.smithi194.stdout:9/848: stat d0/d6/d14/fdd 0 2024-04-13T10:58:47.685 INFO:tasks.workunit.client.1.smithi194.stdout:9/849: creat d0/d6/d2c/db5/f122 x:0 0 0 2024-04-13T10:58:47.687 INFO:tasks.workunit.client.1.smithi194.stdout:4/872: truncate d2/d30/d50/d11a/d1c/d3e/dbb/dee/dd8/df0/ff5 705961 0 2024-04-13T10:58:47.688 INFO:tasks.workunit.client.1.smithi194.stdout:6/812: rmdir d0/d53/d78/d91 39 2024-04-13T10:58:47.689 INFO:tasks.workunit.client.1.smithi194.stdout:6/813: read d0/d42/dbe/f3c [3031224,91467] 0 2024-04-13T10:58:47.692 INFO:tasks.workunit.client.1.smithi194.stdout:4/873: read d2/d30/d50/d11a/d1c/d54/fb1 [89491,48064] 0 2024-04-13T10:58:47.692 INFO:tasks.workunit.client.1.smithi194.stdout:1/803: truncate d12/d13/d1c/d27/f74 1121774 0 2024-04-13T10:58:47.692 INFO:tasks.workunit.client.1.smithi194.stdout:6/814: rmdir d0/d42/d7b/db4 39 2024-04-13T10:58:47.696 INFO:tasks.workunit.client.1.smithi194.stdout:4/874: creat d2/d30/d50/d11a/d1c/d3e/f12a x:0 0 0 2024-04-13T10:58:47.697 INFO:tasks.workunit.client.1.smithi194.stdout:9/850: link d0/f4d d0/d11/d3d/f123 0 2024-04-13T10:58:47.699 INFO:tasks.workunit.client.1.smithi194.stdout:9/851: fsync d0/d88/de5/fe9 0 2024-04-13T10:58:47.699 INFO:tasks.workunit.client.1.smithi194.stdout:6/815: dwrite d0/d2c/f31 [4194304,4194304] 0 2024-04-13T10:58:47.700 INFO:tasks.workunit.client.1.smithi194.stdout:6/816: fdatasync d0/d53/f60 0 2024-04-13T10:58:47.706 INFO:tasks.workunit.client.1.smithi194.stdout:7/892: sync 2024-04-13T10:58:47.706 INFO:tasks.workunit.client.1.smithi194.stdout:0/798: sync 2024-04-13T10:58:47.706 INFO:tasks.workunit.client.1.smithi194.stdout:8/979: sync 2024-04-13T10:58:47.707 INFO:tasks.workunit.client.1.smithi194.stdout:1/804: truncate d12/d13/d44/fa1 4767771 0 2024-04-13T10:58:47.708 INFO:tasks.workunit.client.1.smithi194.stdout:6/817: rename d0/lf to d0/d2c/d77/d7f/dba/l10a 0 2024-04-13T10:58:47.711 INFO:tasks.workunit.client.1.smithi194.stdout:9/852: creat d0/d6/d14/d26/f124 x:0 0 0 2024-04-13T10:58:47.713 INFO:tasks.workunit.client.1.smithi194.stdout:0/799: write d9/db1/d30/d73/d87/ddc/ff2 [471261,95476] 0 2024-04-13T10:58:47.717 INFO:tasks.workunit.client.1.smithi194.stdout:8/980: dread d6/dd/f48 [0,4194304] 0 2024-04-13T10:58:47.719 INFO:tasks.workunit.client.1.smithi194.stdout:8/981: chown d6/d22/d23/d7f/d8c/d8d/ddc/ff0 3 1 2024-04-13T10:58:47.719 INFO:tasks.workunit.client.1.smithi194.stdout:0/800: symlink d9/db1/l102 0 2024-04-13T10:58:47.722 INFO:tasks.workunit.client.1.smithi194.stdout:0/801: mknod d9/d2b/d6c/ddf/d63/def/c103 0 2024-04-13T10:58:47.723 INFO:tasks.workunit.client.1.smithi194.stdout:6/818: mknod d0/d26/c10b 0 2024-04-13T10:58:47.725 INFO:tasks.workunit.client.1.smithi194.stdout:8/982: getdents d6/d22/d23/d3d 0 2024-04-13T10:58:47.726 INFO:tasks.workunit.client.1.smithi194.stdout:0/802: rename d9/d2b/d6c/ddf/d16/d77/c8c to d9/db1/d30/d73/d87/c104 0 2024-04-13T10:58:47.727 INFO:tasks.workunit.client.1.smithi194.stdout:6/819: mknod d0/d26/c10c 0 2024-04-13T10:58:47.728 INFO:tasks.workunit.client.1.smithi194.stdout:4/875: dread d2/d30/d50/d11a/d1c/d3b/d42/f82 [0,4194304] 0 2024-04-13T10:58:47.730 INFO:tasks.workunit.client.1.smithi194.stdout:1/805: truncate d12/d13/d1c/d28/f58 4892584 0 2024-04-13T10:58:47.730 INFO:tasks.workunit.client.1.smithi194.stdout:0/803: chown d9/d9f/fde 0 1 2024-04-13T10:58:47.731 INFO:tasks.workunit.client.1.smithi194.stdout:6/820: stat d0/d2f/d6f 0 2024-04-13T10:58:47.732 INFO:tasks.workunit.client.1.smithi194.stdout:4/876: fdatasync d2/d30/d50/d11a/d1c/fde 0 2024-04-13T10:58:47.732 INFO:tasks.workunit.client.1.smithi194.stdout:0/804: write d9/d2b/fb4 [937980,90985] 0 2024-04-13T10:58:47.734 INFO:tasks.workunit.client.1.smithi194.stdout:1/806: mkdir d12/d3a/d4f/da3/d107 0 2024-04-13T10:58:47.736 INFO:tasks.workunit.client.1.smithi194.stdout:6/821: dread - d0/d42/dbe/ffa zero size 2024-04-13T10:58:47.736 INFO:tasks.workunit.client.1.smithi194.stdout:1/807: write d12/d13/d1c/d28/df2/d101/fdc [373301,68873] 0 2024-04-13T10:58:47.737 INFO:tasks.workunit.client.1.smithi194.stdout:6/822: chown d0/d42 16124 1 2024-04-13T10:58:47.744 INFO:tasks.workunit.client.1.smithi194.stdout:4/877: link d2/d16/dd2/d11f/lf7 d2/d30/l12b 0 2024-04-13T10:58:47.746 INFO:tasks.workunit.client.1.smithi194.stdout:6/823: dwrite d0/d53/d78/dac/ff9 [0,4194304] 0 2024-04-13T10:58:47.748 INFO:tasks.workunit.client.1.smithi194.stdout:8/983: dread d6/dd/fa6 [0,4194304] 0 2024-04-13T10:58:47.748 INFO:tasks.workunit.client.1.smithi194.stdout:4/878: creat d2/d30/d50/d11a/d60/d107/f12c x:0 0 0 2024-04-13T10:58:47.751 INFO:tasks.workunit.client.1.smithi194.stdout:8/984: mkdir d6/d22/d23/d25/d71/da0/de5/dd0/d145 0 2024-04-13T10:58:47.752 INFO:tasks.workunit.client.1.smithi194.stdout:6/824: mknod d0/d42/d7b/db4/de4/c10d 0 2024-04-13T10:58:47.754 INFO:tasks.workunit.client.1.smithi194.stdout:4/879: symlink d2/d30/d50/d11a/d1c/d54/d5d/db2/dfc/l12d 0 2024-04-13T10:58:47.756 INFO:tasks.workunit.client.1.smithi194.stdout:6/825: chown d0/d42/dbe/lab 158 1 2024-04-13T10:58:47.757 INFO:tasks.workunit.client.1.smithi194.stdout:0/805: dread d9/d2b/f31 [0,4194304] 0 2024-04-13T10:58:47.759 INFO:tasks.workunit.client.1.smithi194.stdout:0/806: chown d9/la3 113060 1 2024-04-13T10:58:47.760 INFO:tasks.workunit.client.1.smithi194.stdout:8/985: dwrite d6/d22/d23/d7f/de2/f126 [0,4194304] 0 2024-04-13T10:58:47.763 INFO:tasks.workunit.client.1.smithi194.stdout:6/826: rmdir d0/d2c/d77/d93/df0 0 2024-04-13T10:58:47.765 INFO:tasks.workunit.client.1.smithi194.stdout:1/808: dread d12/d13/d1c/d28/d41/f4a [0,4194304] 0 2024-04-13T10:58:47.766 INFO:tasks.workunit.client.1.smithi194.stdout:6/827: mkdir d0/d2c/d10e 0 2024-04-13T10:58:47.767 INFO:tasks.workunit.client.1.smithi194.stdout:4/880: dwrite d2/d30/d50/d11a/d1c/d3b/d42/f52 [0,4194304] 0 2024-04-13T10:58:47.768 INFO:tasks.workunit.client.1.smithi194.stdout:1/809: fsync d12/d13/d1c/fd9 0 2024-04-13T10:58:47.770 INFO:tasks.workunit.client.1.smithi194.stdout:0/807: link d9/d2b/d6c/ddf/l61 d9/db/l105 0 2024-04-13T10:58:47.771 INFO:tasks.workunit.client.1.smithi194.stdout:6/828: rmdir d0/d2c/d77/d93/daa 39 2024-04-13T10:58:47.773 INFO:tasks.workunit.client.1.smithi194.stdout:4/881: rmdir d2/d30/d104 39 2024-04-13T10:58:47.774 INFO:tasks.workunit.client.1.smithi194.stdout:8/986: dwrite d6/dd/f118 [0,4194304] 0 2024-04-13T10:58:47.775 INFO:tasks.workunit.client.1.smithi194.stdout:6/829: write d0/f73 [1829440,121898] 0 2024-04-13T10:58:47.775 INFO:tasks.workunit.client.1.smithi194.stdout:0/808: mkdir d9/d2b/d6c/ddf/d16/d77/d106 0 2024-04-13T10:58:47.777 INFO:tasks.workunit.client.1.smithi194.stdout:1/810: rename d12/d13/d1c/d28/d41/d4e to d12/d13/d3e/d108 0 2024-04-13T10:58:47.778 INFO:tasks.workunit.client.1.smithi194.stdout:0/809: write d9/db1/d30/d73/d87/fee [180468,100121] 0 2024-04-13T10:58:47.783 INFO:tasks.workunit.client.1.smithi194.stdout:8/987: creat d6/d22/d23/d25/d39/d41/f146 x:0 0 0 2024-04-13T10:58:47.786 INFO:tasks.workunit.client.1.smithi194.stdout:4/882: dwrite d2/d30/d50/d11a/d1c/d3b/d8d/fd3 [0,4194304] 0 2024-04-13T10:58:47.786 INFO:tasks.workunit.client.1.smithi194.stdout:0/810: creat d9/d2b/d6c/ddf/d16/d75/dd3/f107 x:0 0 0 2024-04-13T10:58:47.788 INFO:tasks.workunit.client.1.smithi194.stdout:0/811: write d9/db1/d30/d73/fc2 [1088074,126196] 0 2024-04-13T10:58:47.792 INFO:tasks.workunit.client.1.smithi194.stdout:8/988: rmdir d6/d22/d23/d25/d13a 0 2024-04-13T10:58:47.793 INFO:tasks.workunit.client.1.smithi194.stdout:8/989: stat d6/d11d 0 2024-04-13T10:58:47.794 INFO:tasks.workunit.client.1.smithi194.stdout:0/812: creat d9/d9f/f108 x:0 0 0 2024-04-13T10:58:47.796 INFO:tasks.workunit.client.1.smithi194.stdout:0/813: stat d9/d2b/d6c/db2 0 2024-04-13T10:58:47.796 INFO:tasks.workunit.client.1.smithi194.stdout:6/830: write d0/d2c/d77/d93/d98/f108 [916105,83298] 0 2024-04-13T10:58:47.798 INFO:tasks.workunit.client.1.smithi194.stdout:8/990: creat d6/dd/d45/de3/f147 x:0 0 0 2024-04-13T10:58:47.800 INFO:tasks.workunit.client.1.smithi194.stdout:6/831: chown d0/d53/f55 29 1 2024-04-13T10:58:47.800 INFO:tasks.workunit.client.1.smithi194.stdout:4/883: dwrite d2/d30/d50/d11a/d60/d107/f12c [0,4194304] 0 2024-04-13T10:58:47.801 INFO:tasks.workunit.client.1.smithi194.stdout:0/814: write d9/db/d3a/f49 [4768377,58892] 0 2024-04-13T10:58:47.803 INFO:tasks.workunit.client.1.smithi194.stdout:8/991: rmdir d6/dff/d127 39 2024-04-13T10:58:47.805 INFO:tasks.workunit.client.1.smithi194.stdout:0/815: chown d9/d2b/f3e 0 1 2024-04-13T10:58:47.805 INFO:tasks.workunit.client.1.smithi194.stdout:4/884: dread - d2/d30/d50/d11a/d1c/d3b/fe9 zero size 2024-04-13T10:58:47.806 INFO:tasks.workunit.client.1.smithi194.stdout:6/832: write d0/d26/fb6 [55107,18921] 0 2024-04-13T10:58:47.808 INFO:tasks.workunit.client.1.smithi194.stdout:1/811: dwrite d12/d13/d1c/d28/d41/db0/fe0 [0,4194304] 0 2024-04-13T10:58:47.811 INFO:tasks.workunit.client.1.smithi194.stdout:6/833: write d0/f12 [4744893,86657] 0 2024-04-13T10:58:47.814 INFO:tasks.workunit.client.1.smithi194.stdout:8/992: rename d6/d22/d23/d25/d71/da0/f113 to d6/d22/d23/d25/d71/da0/de5/f148 0 2024-04-13T10:58:47.818 INFO:tasks.workunit.client.1.smithi194.stdout:6/834: rmdir d0/d42/dbe 39 2024-04-13T10:58:47.822 INFO:tasks.workunit.client.1.smithi194.stdout:0/816: rename d9/d2b/d6c/ddf/d16/d65/f7a to d9/d2b/d6c/ddf/f109 0 2024-04-13T10:58:47.823 INFO:tasks.workunit.client.1.smithi194.stdout:1/812: link d12/d13/d1c/c1f d12/d13/d1c/d28/df2/c109 0 2024-04-13T10:58:47.824 INFO:tasks.workunit.client.1.smithi194.stdout:6/835: read - d0/d42/dbe/ffa zero size 2024-04-13T10:58:47.825 INFO:tasks.workunit.client.1.smithi194.stdout:8/993: dwrite d6/d2a/d69/da3/dfd/f110 [4194304,4194304] 0 2024-04-13T10:58:47.826 INFO:tasks.workunit.client.1.smithi194.stdout:6/836: chown d0/d2f/fd8 3 1 2024-04-13T10:58:47.828 INFO:tasks.workunit.client.1.smithi194.stdout:1/813: dread - d12/d13/d1c/d28/df2/fd0 zero size 2024-04-13T10:58:47.828 INFO:tasks.workunit.client.1.smithi194.stdout:8/994: chown d6/d2a/d69/c106 6 1 2024-04-13T10:58:47.828 INFO:tasks.workunit.client.1.smithi194.stdout:4/885: dwrite d2/d30/d50/d11a/d1c/d3b/fe9 [0,4194304] 0 2024-04-13T10:58:47.835 INFO:tasks.workunit.client.1.smithi194.stdout:6/837: creat d0/d26/d4b/de6/f10f x:0 0 0 2024-04-13T10:58:47.838 INFO:tasks.workunit.client.1.smithi194.stdout:4/886: rename d2/d30/d50/d11a/d1c/d54/d5d to d2/d30/d50/d11a/d1c/d3b/d8d/d12e 0 2024-04-13T10:58:47.840 INFO:tasks.workunit.client.1.smithi194.stdout:1/814: truncate d12/d13/d1c/d28/f58 3841718 0 2024-04-13T10:58:47.841 INFO:tasks.workunit.client.1.smithi194.stdout:4/887: mknod d2/daf/c12f 0 2024-04-13T10:58:47.842 INFO:tasks.workunit.client.1.smithi194.stdout:6/838: truncate d0/d2c/d77/d93/d98/fa1 1307209 0 2024-04-13T10:58:47.843 INFO:tasks.workunit.client.1.smithi194.stdout:1/815: link d12/d13/d1c/f21 d12/d3a/d4f/f10a 0 2024-04-13T10:58:47.844 INFO:tasks.workunit.client.1.smithi194.stdout:4/888: mknod d2/d30/d50/d11a/d1c/d54/c130 0 2024-04-13T10:58:47.844 INFO:tasks.workunit.client.1.smithi194.stdout:6/839: mkdir d0/d2f/d48/d83/d110 0 2024-04-13T10:58:47.845 INFO:tasks.workunit.client.1.smithi194.stdout:1/816: mknod d12/d3a/d4f/da3/daa/dde/c10b 0 2024-04-13T10:58:47.846 INFO:tasks.workunit.client.1.smithi194.stdout:4/889: chown d2/d30/d50/d11a/d1c/d3e/dbb/dee/dd8/f123 20114 1 2024-04-13T10:58:47.847 INFO:tasks.workunit.client.1.smithi194.stdout:6/840: getdents d0/d26/dcb 0 2024-04-13T10:58:47.849 INFO:tasks.workunit.client.1.smithi194.stdout:3/758: sync 2024-04-13T10:58:47.850 INFO:tasks.workunit.client.1.smithi194.stdout:4/890: read d2/d30/d50/d11a/d1c/d54/f5f [1163108,67485] 0 2024-04-13T10:58:47.851 INFO:tasks.workunit.client.1.smithi194.stdout:0/817: truncate d9/db/d3a/f57 320109 0 2024-04-13T10:58:47.853 INFO:tasks.workunit.client.1.smithi194.stdout:8/995: write d6/d22/d23/d25/d71/da0/de5/deb/dac/f10d [249260,102848] 0 2024-04-13T10:58:47.857 INFO:tasks.workunit.client.1.smithi194.stdout:0/818: chown d9/d2b/d6c/ddf/d16/d70/ce3 584910 1 2024-04-13T10:58:47.857 INFO:tasks.workunit.client.1.smithi194.stdout:3/759: truncate d2/d3/d12/d31/d34/d88/d24/dd2/ffb 864702 0 2024-04-13T10:58:47.858 INFO:tasks.workunit.client.1.smithi194.stdout:6/841: dwrite d0/f99 [0,4194304] 0 2024-04-13T10:58:47.860 INFO:tasks.workunit.client.1.smithi194.stdout:0/819: fsync d9/db/d3a/d9a/dd7/f2e 0 2024-04-13T10:58:47.862 INFO:tasks.workunit.client.1.smithi194.stdout:1/817: dread d12/d13/d3e/d108/f67 [0,4194304] 0 2024-04-13T10:58:47.862 INFO:tasks.workunit.client.1.smithi194.stdout:0/820: chown d9/d2b/f4a 843963 1 2024-04-13T10:58:47.867 INFO:tasks.workunit.client.1.smithi194.stdout:8/996: dwrite d6/dd/f124 [4194304,4194304] 0 2024-04-13T10:58:47.868 INFO:tasks.workunit.client.1.smithi194.stdout:8/997: write d6/dd/f124 [70246,21000] 0 2024-04-13T10:58:47.870 INFO:tasks.workunit.client.1.smithi194.stdout:3/760: creat d2/d3/d12/d31/d34/d88/d24/d6c/dc2/f101 x:0 0 0 2024-04-13T10:58:47.873 INFO:tasks.workunit.client.1.smithi194.stdout:8/998: unlink d6/d22/d23/d25/d39/f62 0 2024-04-13T10:58:47.876 INFO:tasks.workunit.client.1.smithi194.stdout:3/761: write d2/d3/d12/d31/d34/d88/d24/d3a/d72/fd8 [302746,125212] 0 2024-04-13T10:58:47.878 INFO:tasks.workunit.client.1.smithi194.stdout:8/999: creat d6/d22/d23/d25/d71/da0/de5/deb/f149 x:0 0 0 2024-04-13T10:58:47.878 INFO:tasks.workunit.client.1.smithi194.stdout:1/818: dwrite d12/f32 [0,4194304] 0 2024-04-13T10:58:47.879 INFO:tasks.workunit.client.1.smithi194.stdout:4/891: truncate d2/d30/d50/d11a/d1c/d9a/fe4 3232516 0 2024-04-13T10:58:47.882 INFO:tasks.workunit.client.1.smithi194.stdout:1/819: readlink d12/d13/l16 0 2024-04-13T10:58:47.889 INFO:tasks.workunit.client.1.smithi194.stdout:1/820: creat d12/d13/d1c/d28/d41/d77/d80/f10c x:0 0 0 2024-04-13T10:58:47.892 INFO:tasks.workunit.client.1.smithi194.stdout:6/842: dwrite d0/d2c/d77/f8c [0,4194304] 0 2024-04-13T10:58:47.892 INFO:tasks.workunit.client.1.smithi194.stdout:4/892: dwrite d2/d30/d50/d11a/d1c/d3e/f12a [0,4194304] 0 2024-04-13T10:58:47.895 INFO:tasks.workunit.client.1.smithi194.stdout:6/843: write d0/d26/f29 [1682747,90855] 0 2024-04-13T10:58:47.896 INFO:tasks.workunit.client.1.smithi194.stdout:3/762: dwrite d2/d3/d12/d31/d34/d88/d24/f90 [0,4194304] 0 2024-04-13T10:58:47.897 INFO:tasks.workunit.client.1.smithi194.stdout:4/893: dread - d2/d30/d50/d11a/d1c/d9a/f113 zero size 2024-04-13T10:58:47.898 INFO:tasks.workunit.client.1.smithi194.stdout:6/844: write d0/d26/d4b/de6/f10f [105661,2363] 0 2024-04-13T10:58:47.898 INFO:tasks.workunit.client.1.smithi194.stdout:1/821: read d12/d3a/dad/fd1 [803953,105851] 0 2024-04-13T10:58:47.901 INFO:tasks.workunit.client.1.smithi194.stdout:1/822: write d12/d13/d1c/d28/faf [1015604,39110] 0 2024-04-13T10:58:47.902 INFO:tasks.workunit.client.1.smithi194.stdout:4/894: chown d2/d30/d50/d11a/d1c/d9a/c9d 23 1 2024-04-13T10:58:47.904 INFO:tasks.workunit.client.1.smithi194.stdout:6/845: dread - d0/d57/db7/dbc/dc4/fd7 zero size 2024-04-13T10:58:47.906 INFO:tasks.workunit.client.1.smithi194.stdout:4/895: write d2/d30/d50/d11a/d1c/d54/de7/f11d [620797,62848] 0 2024-04-13T10:58:47.910 INFO:tasks.workunit.client.1.smithi194.stdout:6/846: chown d0/d53/d78/d91/le3 2789 1 2024-04-13T10:58:47.910 INFO:tasks.workunit.client.1.smithi194.stdout:4/896: creat d2/d16/dd2/d11f/d99/f131 x:0 0 0 2024-04-13T10:58:47.912 INFO:tasks.workunit.client.1.smithi194.stdout:4/897: write d2/d30/d50/d11a/f117 [439499,111901] 0 2024-04-13T10:58:47.913 INFO:tasks.workunit.client.1.smithi194.stdout:6/847: symlink d0/d26/l111 0 2024-04-13T10:58:47.916 INFO:tasks.workunit.client.1.smithi194.stdout:4/898: creat d2/d30/d104/f132 x:0 0 0 2024-04-13T10:58:47.918 INFO:tasks.workunit.client.1.smithi194.stdout:1/823: truncate d12/d13/d1c/d27/d2e/f62 2719751 0 2024-04-13T10:58:47.920 INFO:tasks.workunit.client.1.smithi194.stdout:4/899: truncate d2/d30/d50/d11a/d1c/d3b/d8d/fdb 1560797 0 2024-04-13T10:58:47.923 INFO:tasks.workunit.client.1.smithi194.stdout:1/824: rename d12/d13/d1c/d7c/fa9 to d12/d13/d1c/d28/df2/d8b/f10d 0 2024-04-13T10:58:47.925 INFO:tasks.workunit.client.1.smithi194.stdout:3/763: dread d2/d3/d12/d31/d34/d88/d24/d3a/d56/fbe [0,4194304] 0 2024-04-13T10:58:47.925 INFO:tasks.workunit.client.1.smithi194.stdout:1/825: write d12/d13/d1c/f72 [4126412,44447] 0 2024-04-13T10:58:47.927 INFO:tasks.workunit.client.1.smithi194.stdout:3/764: creat d2/de/f102 x:0 0 0 2024-04-13T10:58:47.930 INFO:tasks.workunit.client.1.smithi194.stdout:3/765: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/d103 0 2024-04-13T10:58:47.931 INFO:tasks.workunit.client.1.smithi194.stdout:6/848: dread d0/d26/f14 [0,4194304] 0 2024-04-13T10:58:47.938 INFO:tasks.workunit.client.1.smithi194.stdout:6/849: truncate d0/d2c/d77/f8c 944863 0 2024-04-13T10:58:47.940 INFO:tasks.workunit.client.1.smithi194.stdout:6/850: truncate d0/d57/fb0 821632 0 2024-04-13T10:58:47.940 INFO:tasks.workunit.client.1.smithi194.stdout:4/900: dwrite d2/d30/d50/d11a/d1c/d3e/dbb/dee/dd8/df0/ff5 [0,4194304] 0 2024-04-13T10:58:47.944 INFO:tasks.workunit.client.1.smithi194.stdout:6/851: creat d0/d2c/d10e/f112 x:0 0 0 2024-04-13T10:58:47.945 INFO:tasks.workunit.client.1.smithi194.stdout:4/901: creat d2/d30/d50/d11a/d60/d107/f133 x:0 0 0 2024-04-13T10:58:47.947 INFO:tasks.workunit.client.1.smithi194.stdout:6/852: mknod d0/d2f/d48/d68/c113 0 2024-04-13T10:58:47.947 INFO:tasks.workunit.client.1.smithi194.stdout:6/853: stat d0/d42/dbe/f96 0 2024-04-13T10:58:47.949 INFO:tasks.workunit.client.1.smithi194.stdout:4/902: dread d2/d30/d50/d11a/d1c/d3e/f12a [0,4194304] 0 2024-04-13T10:58:47.951 INFO:tasks.workunit.client.1.smithi194.stdout:6/854: rename d0/d26/d4b/f59 to d0/d42/dbe/d4d/d80/f114 0 2024-04-13T10:58:47.951 INFO:tasks.workunit.client.1.smithi194.stdout:6/855: readlink d0/d42/dbe/lab 0 2024-04-13T10:58:47.952 INFO:tasks.workunit.client.1.smithi194.stdout:6/856: chown d0/d26/d4b/f72 26 1 2024-04-13T10:58:47.953 INFO:tasks.workunit.client.1.smithi194.stdout:6/857: write d0/d57/db7/dbc/dc4/fd7 [428151,100141] 0 2024-04-13T10:58:47.955 INFO:tasks.workunit.client.1.smithi194.stdout:4/903: link d2/d30/d50/d11a/d1c/d54/c130 d2/d30/d50/d11a/d1c/d54/d62/d9e/dfd/c134 0 2024-04-13T10:58:47.956 INFO:tasks.workunit.client.1.smithi194.stdout:4/904: chown d2/d30/d50/d11a/d1c/d3b/l79 37 1 2024-04-13T10:58:47.958 INFO:tasks.workunit.client.1.smithi194.stdout:6/858: rename d0/d2c/d77/d7f to d0/d57/d115 0 2024-04-13T10:58:47.962 INFO:tasks.workunit.client.1.smithi194.stdout:6/859: mkdir d0/d2c/d77/d93/daa/d116 0 2024-04-13T10:58:47.963 INFO:tasks.workunit.client.1.smithi194.stdout:6/860: readlink d0/d26/lee 0 2024-04-13T10:58:47.964 INFO:tasks.workunit.client.1.smithi194.stdout:4/905: truncate d2/d30/f49 1871817 0 2024-04-13T10:58:47.965 INFO:tasks.workunit.client.1.smithi194.stdout:4/906: mkdir d2/d30/deb/d135 0 2024-04-13T10:58:47.966 INFO:tasks.workunit.client.1.smithi194.stdout:6/861: dread d0/d2f/fb1 [0,4194304] 0 2024-04-13T10:58:47.966 INFO:tasks.workunit.client.1.smithi194.stdout:4/907: mknod d2/d30/deb/d135/c136 0 2024-04-13T10:58:47.969 INFO:tasks.workunit.client.1.smithi194.stdout:4/908: mknod d2/c137 0 2024-04-13T10:58:47.972 INFO:tasks.workunit.client.1.smithi194.stdout:4/909: creat d2/d30/d50/d11a/d1c/d54/d62/d9e/dfd/f138 x:0 0 0 2024-04-13T10:58:47.975 INFO:tasks.workunit.client.1.smithi194.stdout:6/862: truncate d0/f99 2747044 0 2024-04-13T10:58:47.975 INFO:tasks.workunit.client.1.smithi194.stdout:4/910: symlink d2/d30/d50/d11a/d1c/d3b/d8d/d121/l139 0 2024-04-13T10:58:47.977 INFO:tasks.workunit.client.1.smithi194.stdout:6/863: mkdir d0/d42/d117 0 2024-04-13T10:58:47.977 INFO:tasks.workunit.client.1.smithi194.stdout:4/911: mknod d2/d16/dd2/d11f/de5/c13a 0 2024-04-13T10:58:47.978 INFO:tasks.workunit.client.1.smithi194.stdout:6/864: chown d0/d2f/d48/d83/d9d/cd4 52652 1 2024-04-13T10:58:47.978 INFO:tasks.workunit.client.1.smithi194.stdout:4/912: chown d2/d30/d50/d11a/d1c/d3b/d8d/fc1 33 1 2024-04-13T10:58:47.980 INFO:tasks.workunit.client.1.smithi194.stdout:4/913: chown d2/cd9 67 1 2024-04-13T10:58:47.983 INFO:tasks.workunit.client.1.smithi194.stdout:4/914: mknod d2/d30/d50/d11a/d1c/d3b/d8d/d121/c13b 0 2024-04-13T10:58:47.983 INFO:tasks.workunit.client.1.smithi194.stdout:6/865: dwrite d0/d57/d115/dba/f100 [0,4194304] 0 2024-04-13T10:58:47.986 INFO:tasks.workunit.client.1.smithi194.stdout:6/866: creat d0/d57/d115/dba/f118 x:0 0 0 2024-04-13T10:58:47.988 INFO:tasks.workunit.client.1.smithi194.stdout:4/915: mkdir d2/d30/d50/d11a/d1c/d54/d62/d10d/dcc/d13c 0 2024-04-13T10:58:47.990 INFO:tasks.workunit.client.1.smithi194.stdout:6/867: mknod d0/d2c/d77/d93/d98/c119 0 2024-04-13T10:58:47.992 INFO:tasks.workunit.client.1.smithi194.stdout:6/868: symlink d0/d26/d4b/dd0/l11a 0 2024-04-13T10:58:48.006 INFO:tasks.workunit.client.1.smithi194.stdout:6/869: dread d0/d26/f23 [0,4194304] 0 2024-04-13T10:58:48.008 INFO:tasks.workunit.client.1.smithi194.stdout:6/870: creat d0/d53/d78/dac/df4/f11b x:0 0 0 2024-04-13T10:58:48.009 INFO:tasks.workunit.client.1.smithi194.stdout:6/871: write d0/d2f/d48/fdd [574419,113490] 0 2024-04-13T10:58:48.013 INFO:tasks.workunit.client.1.smithi194.stdout:6/872: creat d0/d2f/d48/d83/d9d/f11c x:0 0 0 2024-04-13T10:58:48.015 INFO:tasks.workunit.client.1.smithi194.stdout:6/873: dread d0/d57/db7/dbc/dc4/fd7 [0,4194304] 0 2024-04-13T10:58:48.022 INFO:tasks.workunit.client.1.smithi194.stdout:5/951: sync 2024-04-13T10:58:48.024 INFO:tasks.workunit.client.1.smithi194.stdout:5/952: symlink d3/dc/d2d/dd1/d38/d59/d7a/l130 0 2024-04-13T10:58:48.025 INFO:tasks.workunit.client.1.smithi194.stdout:5/953: write d3/dc/d2d/dd1/d38/d59/f54 [4252719,9330] 0 2024-04-13T10:58:48.026 INFO:tasks.workunit.client.1.smithi194.stdout:5/954: rmdir d3/d89 39 2024-04-13T10:58:48.029 INFO:tasks.workunit.client.1.smithi194.stdout:5/955: creat d3/dc/d17/d1b/f131 x:0 0 0 2024-04-13T10:58:48.030 INFO:tasks.workunit.client.1.smithi194.stdout:5/956: chown d3/dc/d2d/dd1/d38 125554 1 2024-04-13T10:58:48.034 INFO:tasks.workunit.client.1.smithi194.stdout:5/957: rename d3/dc/d2d/dd1/d38/d59/d49/da4/la9 to d3/dc/d2d/dd1/d38/l132 0 2024-04-13T10:58:48.036 INFO:tasks.workunit.client.1.smithi194.stdout:5/958: truncate d3/dc/d2d/dd1/f4c 3722988 0 2024-04-13T10:58:48.039 INFO:tasks.workunit.client.1.smithi194.stdout:5/959: dread d3/dc/d2d/dd1/d38/d59/d7a/f9e [0,4194304] 0 2024-04-13T10:58:48.041 INFO:tasks.workunit.client.1.smithi194.stdout:5/960: mknod d3/dc/d2d/dd1/d38/d59/d49/dbf/d115/c133 0 2024-04-13T10:58:48.044 INFO:tasks.workunit.client.1.smithi194.stdout:5/961: creat d3/dc/d2d/dd1/d38/d59/d49/f134 x:0 0 0 2024-04-13T10:58:48.045 INFO:tasks.workunit.client.1.smithi194.stdout:5/962: read d3/f1f [1982293,56916] 0 2024-04-13T10:58:48.046 INFO:tasks.workunit.client.1.smithi194.stdout:5/963: write d3/dc/d2d/dd1/db5/fdf [3672506,30319] 0 2024-04-13T10:58:48.047 INFO:tasks.workunit.client.1.smithi194.stdout:5/964: dread - d3/dc/d2d/dd1/d20/daa/dae/dd4/fd6 zero size 2024-04-13T10:58:48.048 INFO:tasks.workunit.client.1.smithi194.stdout:5/965: readlink d3/dc/d2d/le3 0 2024-04-13T10:58:48.062 INFO:tasks.workunit.client.1.smithi194.stdout:5/966: dread d3/d29/f3f [0,4194304] 0 2024-04-13T10:58:48.063 INFO:tasks.workunit.client.1.smithi194.stdout:5/967: write d3/dc/d2d/dd1/d38/d59/fca [1270559,110142] 0 2024-04-13T10:58:48.069 INFO:tasks.workunit.client.1.smithi194.stdout:5/968: dwrite d3/dc/d2d/dd1/d38/d59/f8b [0,4194304] 0 2024-04-13T10:58:48.072 INFO:tasks.workunit.client.1.smithi194.stdout:5/969: getdents d3/dc/d2d/dd1/d38/d59/d7a/d104 0 2024-04-13T10:58:48.075 INFO:tasks.workunit.client.1.smithi194.stdout:5/970: mknod d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/def/c135 0 2024-04-13T10:58:48.077 INFO:tasks.workunit.client.1.smithi194.stdout:5/971: mkdir d3/dc/d136 0 2024-04-13T10:58:48.079 INFO:tasks.workunit.client.1.smithi194.stdout:5/972: creat d3/dc/d2d/dd1/d38/d59/de6/f137 x:0 0 0 2024-04-13T10:58:48.094 INFO:tasks.workunit.client.1.smithi194.stdout:5/973: truncate d3/dc/ff1 932991 0 2024-04-13T10:58:48.095 INFO:tasks.workunit.client.1.smithi194.stdout:5/974: write d3/dc/d2d/dd1/df7/f110 [439099,80531] 0 2024-04-13T10:58:48.096 INFO:tasks.workunit.client.1.smithi194.stdout:5/975: chown d3/dc/d17/d1b/lde 6369 1 2024-04-13T10:58:48.102 INFO:tasks.workunit.client.1.smithi194.stdout:5/976: dwrite d3/dc/d2d/dd1/fbd [0,4194304] 0 2024-04-13T10:58:48.105 INFO:tasks.workunit.client.1.smithi194.stdout:5/977: getdents d3/dc/d2d/dd1/d38/d59/d7a/d104 0 2024-04-13T10:58:48.107 INFO:tasks.workunit.client.1.smithi194.stdout:5/978: creat d3/dc/d2d/dd1/db5/d11a/df2/d10c/f138 x:0 0 0 2024-04-13T10:58:48.112 INFO:tasks.workunit.client.1.smithi194.stdout:5/979: rename d3/dc/d2d/dd1/d20/c124 to d3/dc/d2d/dd1/d38/c139 0 2024-04-13T10:58:48.115 INFO:tasks.workunit.client.1.smithi194.stdout:5/980: dread d3/dc/d2d/dd1/d38/f51 [0,4194304] 0 2024-04-13T10:58:48.116 INFO:tasks.workunit.client.1.smithi194.stdout:5/981: chown d3/dc/d2d/dd1/d20/c92 7039391 1 2024-04-13T10:58:48.117 INFO:tasks.workunit.client.1.smithi194.stdout:5/982: write d3/dc/d2d/dd1/d20/f62 [5642674,46822] 0 2024-04-13T10:58:48.118 INFO:tasks.workunit.client.1.smithi194.stdout:5/983: stat d3/dc/d17/d1b/d6b/lf6 0 2024-04-13T10:58:48.119 INFO:tasks.workunit.client.1.smithi194.stdout:5/984: truncate d3/dc/d17/d1b/d6b/fe8 436234 0 2024-04-13T10:58:48.120 INFO:tasks.workunit.client.1.smithi194.stdout:5/985: fsync d3/d89/fa3 0 2024-04-13T10:58:48.123 INFO:tasks.workunit.client.1.smithi194.stdout:5/986: creat d3/dc/d17/d1b/f13a x:0 0 0 2024-04-13T10:58:48.123 INFO:tasks.workunit.client.1.smithi194.stdout:5/987: readlink d3/dc/l27 0 2024-04-13T10:58:48.125 INFO:tasks.workunit.client.1.smithi194.stdout:5/988: creat d3/dc/d2d/dd1/df7/f13b x:0 0 0 2024-04-13T10:58:48.127 INFO:tasks.workunit.client.1.smithi194.stdout:5/989: mknod d3/dc/d2d/dd1/db5/d11a/df2/d10c/c13c 0 2024-04-13T10:58:48.129 INFO:tasks.workunit.client.1.smithi194.stdout:5/990: symlink d3/dc/d2d/dd1/d38/d59/d49/l13d 0 2024-04-13T10:58:48.133 INFO:tasks.workunit.client.1.smithi194.stdout:2/903: sync 2024-04-13T10:58:48.133 INFO:tasks.workunit.client.1.smithi194.stdout:7/893: sync 2024-04-13T10:58:48.133 INFO:tasks.workunit.client.1.smithi194.stdout:0/821: sync 2024-04-13T10:58:48.133 INFO:tasks.workunit.client.1.smithi194.stdout:9/853: sync 2024-04-13T10:58:48.134 INFO:tasks.workunit.client.1.smithi194.stdout:2/904: stat d2/d3/de/d17/d36/d8f/f119 0 2024-04-13T10:58:48.134 INFO:tasks.workunit.client.1.smithi194.stdout:0/822: rmdir d9/db1/d30/df9 39 2024-04-13T10:58:48.134 INFO:tasks.workunit.client.1.smithi194.stdout:7/894: read d1/d2b/d2c/d30/d33/fbd [151047,79241] 0 2024-04-13T10:58:48.138 INFO:tasks.workunit.client.1.smithi194.stdout:9/854: dwrite d0/d6/fc3 [0,4194304] 0 2024-04-13T10:58:48.139 INFO:tasks.workunit.client.1.smithi194.stdout:7/895: mknod d1/d2b/d3e/d9c/dc5/c121 0 2024-04-13T10:58:48.140 INFO:tasks.workunit.client.1.smithi194.stdout:9/855: chown d0/d11 66 1 2024-04-13T10:58:48.140 INFO:tasks.workunit.client.1.smithi194.stdout:2/905: symlink d2/d3/de/d33/d47/dbb/d5a/d12b/l132 0 2024-04-13T10:58:48.144 INFO:tasks.workunit.client.1.smithi194.stdout:7/896: mkdir d1/d2b/d3e/ddf/d5a/d7d/d122 0 2024-04-13T10:58:48.145 INFO:tasks.workunit.client.1.smithi194.stdout:5/991: dwrite d3/dc/d2d/dd1/d38/d59/d49/dbf/dea/db1/ffd [0,4194304] 0 2024-04-13T10:58:48.146 INFO:tasks.workunit.client.1.smithi194.stdout:2/906: mkdir d2/d3/d6d/dac/d133 0 2024-04-13T10:58:48.148 INFO:tasks.workunit.client.1.smithi194.stdout:9/856: creat d0/d11/f125 x:0 0 0 2024-04-13T10:58:48.150 INFO:tasks.workunit.client.1.smithi194.stdout:9/857: write d0/d6/d14/d26/d7f/f10a [369379,690] 0 2024-04-13T10:58:48.150 INFO:tasks.workunit.client.1.smithi194.stdout:0/823: dread d9/d2b/f96 [0,4194304] 0 2024-04-13T10:58:48.153 INFO:tasks.workunit.client.1.smithi194.stdout:5/992: mknod d3/dc/d2d/dd1/d38/d59/d49/dbf/c13e 0 2024-04-13T10:58:48.154 INFO:tasks.workunit.client.1.smithi194.stdout:2/907: mknod d2/d3/de/d33/d71/ddb/c134 0 2024-04-13T10:58:48.154 INFO:tasks.workunit.client.1.smithi194.stdout:7/897: creat d1/d2b/d3e/d9c/db0/f123 x:0 0 0 2024-04-13T10:58:48.155 INFO:tasks.workunit.client.1.smithi194.stdout:2/908: chown d2/d3/lb 34970 1 2024-04-13T10:58:48.158 INFO:tasks.workunit.client.1.smithi194.stdout:9/858: dwrite d0/d6/d9/d51/fda [0,4194304] 0 2024-04-13T10:58:48.158 INFO:tasks.workunit.client.1.smithi194.stdout:7/898: unlink d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/fac 0 2024-04-13T10:58:48.159 INFO:tasks.workunit.client.1.smithi194.stdout:9/859: dread - d0/d6/d14/dcd/fdb zero size 2024-04-13T10:58:48.160 INFO:tasks.workunit.client.1.smithi194.stdout:2/909: unlink d2/d3/d12/dba/l123 0 2024-04-13T10:58:48.162 INFO:tasks.workunit.client.1.smithi194.stdout:2/910: chown d2/d3/c20 2067965765 1 2024-04-13T10:58:48.164 INFO:tasks.workunit.client.1.smithi194.stdout:9/860: rename d0/d6/d14/l49 to d0/dfe/l126 0 2024-04-13T10:58:48.165 INFO:tasks.workunit.client.1.smithi194.stdout:2/911: creat d2/d3/f135 x:0 0 0 2024-04-13T10:58:48.168 INFO:tasks.workunit.client.1.smithi194.stdout:3/766: sync 2024-04-13T10:58:48.168 INFO:tasks.workunit.client.1.smithi194.stdout:4/916: sync 2024-04-13T10:58:48.168 INFO:tasks.workunit.client.1.smithi194.stdout:1/826: sync 2024-04-13T10:58:48.168 INFO:tasks.workunit.client.1.smithi194.stdout:6/874: sync 2024-04-13T10:58:48.168 INFO:tasks.workunit.client.1.smithi194.stdout:2/912: chown d2/d3/d6d/f6f 1106 1 2024-04-13T10:58:48.169 INFO:tasks.workunit.client.1.smithi194.stdout:7/899: dwrite d1/d2b/d4c/d4f/d85/d88/d9b/faf [0,4194304] 0 2024-04-13T10:58:48.171 INFO:tasks.workunit.client.1.smithi194.stdout:9/861: getdents d0/d88/dac 0 2024-04-13T10:58:48.171 INFO:tasks.workunit.client.1.smithi194.stdout:3/767: creat d2/d7d/f104 x:0 0 0 2024-04-13T10:58:48.172 INFO:tasks.workunit.client.1.smithi194.stdout:1/827: rmdir d12/d13/d1c/d27/d4c/dd7 39 2024-04-13T10:58:48.174 INFO:tasks.workunit.client.1.smithi194.stdout:4/917: symlink d2/d16/dd2/d11f/d99/l13d 0 2024-04-13T10:58:48.234 INFO:tasks.workunit.client.1.smithi194.stdout:9/862: fdatasync d0/d6/ffa 0 2024-04-13T10:58:48.234 INFO:tasks.workunit.client.1.smithi194.stdout:3/768: chown d2/d7d/dff 131340263 1 2024-04-13T10:58:48.234 INFO:tasks.workunit.client.1.smithi194.stdout:7/900: dread - d1/d6c/f77 zero size 2024-04-13T10:58:48.236 INFO:tasks.workunit.client.1.smithi194.stdout:9/863: dread - d0/d6/d4a/d74/dae/faf zero size 2024-04-13T10:58:48.236 INFO:tasks.workunit.client.1.smithi194.stdout:0/824: dread d9/db1/d30/d73/fc2 [0,4194304] 0 2024-04-13T10:58:48.238 INFO:tasks.workunit.client.1.smithi194.stdout:6/875: link d0/f1a d0/d42/d7b/db4/de0/f11d 0 2024-04-13T10:58:48.238 INFO:tasks.workunit.client.1.smithi194.stdout:3/769: readlink d2/d3/d12/d31/d34/d88/d24/d82/laa 0 2024-04-13T10:58:48.238 INFO:tasks.workunit.client.1.smithi194.stdout:7/901: mknod d1/d2b/d3e/d9c/db0/c124 0 2024-04-13T10:58:48.238 INFO:tasks.workunit.client.1.smithi194.stdout:1/828: creat d12/d13/d44/db5/f10e x:0 0 0 2024-04-13T10:58:48.239 INFO:tasks.workunit.client.1.smithi194.stdout:6/876: read - d0/d57/d115/fc3 zero size 2024-04-13T10:58:48.240 INFO:tasks.workunit.client.1.smithi194.stdout:0/825: write d9/db/d3a/d9a/dd7/f2f [1686121,87962] 0 2024-04-13T10:58:48.241 INFO:tasks.workunit.client.1.smithi194.stdout:1/829: chown d12/d3a/d4f/da3/df1 2 1 2024-04-13T10:58:48.246 INFO:tasks.workunit.client.1.smithi194.stdout:3/770: dread d2/d3/f3d [0,4194304] 0 2024-04-13T10:58:48.247 INFO:tasks.workunit.client.1.smithi194.stdout:4/918: write d2/d30/d50/d11a/f43 [3443620,80439] 0 2024-04-13T10:58:48.249 INFO:tasks.workunit.client.1.smithi194.stdout:6/877: rename d0/d2f/d48/d83/f104 to d0/d42/dbe/d4d/d80/f11e 0 2024-04-13T10:58:48.250 INFO:tasks.workunit.client.1.smithi194.stdout:0/826: mknod d9/d2b/d6c/ddf/d16/d75/dd3/c10a 0 2024-04-13T10:58:48.250 INFO:tasks.workunit.client.1.smithi194.stdout:9/864: dwrite d0/d6/d14/dcd/dd6/f105 [0,4194304] 0 2024-04-13T10:58:48.252 INFO:tasks.workunit.client.1.smithi194.stdout:6/878: chown d0/d26/f15 200 1 2024-04-13T10:58:48.255 INFO:tasks.workunit.client.1.smithi194.stdout:7/902: dwrite d1/dd9/de1/dab/d96/ff2 [0,4194304] 0 2024-04-13T10:58:48.257 INFO:tasks.workunit.client.1.smithi194.stdout:1/830: dread d12/f26 [0,4194304] 0 2024-04-13T10:58:48.257 INFO:tasks.workunit.client.1.smithi194.stdout:0/827: symlink d9/d2b/d6c/ddf/d16/d83/l10b 0 2024-04-13T10:58:48.257 INFO:tasks.workunit.client.1.smithi194.stdout:5/993: sync 2024-04-13T10:58:48.260 INFO:tasks.workunit.client.1.smithi194.stdout:7/903: write d1/dd9/de1/dab/d96/d10c/f87 [1515837,69324] 0 2024-04-13T10:58:48.260 INFO:tasks.workunit.client.1.smithi194.stdout:3/771: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/f105 x:0 0 0 2024-04-13T10:58:48.261 INFO:tasks.workunit.client.1.smithi194.stdout:9/865: readlink d0/d6/l18 0 2024-04-13T10:58:48.266 INFO:tasks.workunit.client.1.smithi194.stdout:0/828: read d9/d2b/d6c/ddf/f2d [519549,59143] 0 2024-04-13T10:58:48.269 INFO:tasks.workunit.client.1.smithi194.stdout:6/879: getdents d0/d2c/d77/d93 0 2024-04-13T10:58:48.269 INFO:tasks.workunit.client.1.smithi194.stdout:7/904: creat d1/d2b/d4c/d4f/f125 x:0 0 0 2024-04-13T10:58:48.270 INFO:tasks.workunit.client.1.smithi194.stdout:3/772: dwrite d2/d3/d12/d21/fe5 [0,4194304] 0 2024-04-13T10:58:48.271 INFO:tasks.workunit.client.1.smithi194.stdout:6/880: chown d0/d2f/fd8 12 1 2024-04-13T10:58:48.271 INFO:tasks.workunit.client.1.smithi194.stdout:3/773: readlink d2/d3/d12/d31/l33 0 2024-04-13T10:58:48.273 INFO:tasks.workunit.client.1.smithi194.stdout:0/829: mknod d9/db1/d30/df9/c10c 0 2024-04-13T10:58:48.274 INFO:tasks.workunit.client.1.smithi194.stdout:7/905: read d1/d2b/d4c/d4f/d51/d4d/d5e/fd6 [1031293,42444] 0 2024-04-13T10:58:48.275 INFO:tasks.workunit.client.1.smithi194.stdout:6/881: write d0/d57/d69/f64 [8579199,92292] 0 2024-04-13T10:58:48.276 INFO:tasks.workunit.client.1.smithi194.stdout:3/774: rmdir d2/d3 39 2024-04-13T10:58:48.277 INFO:tasks.workunit.client.1.smithi194.stdout:5/994: truncate d3/d83/fbb 306830 0 2024-04-13T10:58:48.278 INFO:tasks.workunit.client.1.smithi194.stdout:7/906: write d1/d2b/d4c/d4f/f64 [650280,53423] 0 2024-04-13T10:58:48.278 INFO:tasks.workunit.client.1.smithi194.stdout:6/882: symlink d0/d57/d115/l11f 0 2024-04-13T10:58:48.280 INFO:tasks.workunit.client.1.smithi194.stdout:0/830: creat d9/d2b/d6c/ddf/d16/d83/f10d x:0 0 0 2024-04-13T10:58:48.281 INFO:tasks.workunit.client.1.smithi194.stdout:3/775: chown d2/d3/d12/d31 5 1 2024-04-13T10:58:48.281 INFO:tasks.workunit.client.1.smithi194.stdout:9/866: truncate d0/d11/d58/f11a 741467 0 2024-04-13T10:58:48.283 INFO:tasks.workunit.client.1.smithi194.stdout:7/907: chown d1/d2b/d4c/d4f/d51/l57 10 1 2024-04-13T10:58:48.288 INFO:tasks.workunit.client.1.smithi194.stdout:7/908: creat d1/d2b/d4c/d4f/d51/d4d/d5e/f126 x:0 0 0 2024-04-13T10:58:48.289 INFO:tasks.workunit.client.1.smithi194.stdout:4/919: dread d2/d30/d50/d11a/d60/d107/d10f/fc6 [0,4194304] 0 2024-04-13T10:58:48.291 INFO:tasks.workunit.client.1.smithi194.stdout:5/995: write d3/dc/d2d/dd1/f7c [502815,21645] 0 2024-04-13T10:58:48.293 INFO:tasks.workunit.client.1.smithi194.stdout:7/909: fsync d1/d2b/d4c/d4f/d51/d4d/d5e/fd6 0 2024-04-13T10:58:48.299 INFO:tasks.workunit.client.1.smithi194.stdout:4/920: dread d2/d30/d50/d11a/d1c/d9a/fb7 [0,4194304] 0 2024-04-13T10:58:48.301 INFO:tasks.workunit.client.1.smithi194.stdout:0/831: dwrite d9/db1/d30/d73/f85 [0,4194304] 0 2024-04-13T10:58:48.303 INFO:tasks.workunit.client.1.smithi194.stdout:7/910: link d1/f16 d1/d2b/d4c/f127 0 2024-04-13T10:58:48.304 INFO:tasks.workunit.client.1.smithi194.stdout:5/996: dwrite d3/dc/d17/d1b/f12b [0,4194304] 0 2024-04-13T10:58:48.306 INFO:tasks.workunit.client.1.smithi194.stdout:4/921: write d2/d30/d50/d11a/d1c/d3e/dbb/f108 [694122,42593] 0 2024-04-13T10:58:48.306 INFO:tasks.workunit.client.1.smithi194.stdout:6/883: dread d0/d2c/f31 [0,4194304] 0 2024-04-13T10:58:48.306 INFO:tasks.workunit.client.1.smithi194.stdout:0/832: symlink d9/db/l10e 0 2024-04-13T10:58:48.308 INFO:tasks.workunit.client.1.smithi194.stdout:4/922: fdatasync d2/d16/dd2/ffa 0 2024-04-13T10:58:48.308 INFO:tasks.workunit.client.1.smithi194.stdout:3/776: dread d2/d3/d12/d31/d34/d88/d24/d3a/f6e [0,4194304] 0 2024-04-13T10:58:48.310 INFO:tasks.workunit.client.1.smithi194.stdout:0/833: write d9/db/f3d [418636,13916] 0 2024-04-13T10:58:48.312 INFO:tasks.workunit.client.1.smithi194.stdout:6/884: symlink d0/d2f/d48/d83/d9d/l120 0 2024-04-13T10:58:48.313 INFO:tasks.workunit.client.1.smithi194.stdout:0/834: chown d9/d9f/l8e 196 1 2024-04-13T10:58:48.317 INFO:tasks.workunit.client.1.smithi194.stdout:6/885: chown d0/d26/dcb/l105 761 1 2024-04-13T10:58:48.318 INFO:tasks.workunit.client.1.smithi194.stdout:7/911: dwrite d1/d2b/d2c/ffc [0,4194304] 0 2024-04-13T10:58:48.321 INFO:tasks.workunit.client.1.smithi194.stdout:4/923: rename d2/d30/d50/d11a/d1c/f125 to d2/d30/d50/d11a/d1c/d3b/d42/f13e 0 2024-04-13T10:58:48.325 INFO:tasks.workunit.client.1.smithi194.stdout:6/886: symlink d0/d53/d78/l121 0 2024-04-13T10:58:48.325 INFO:tasks.workunit.client.1.smithi194.stdout:2/913: sync 2024-04-13T10:58:48.325 INFO:tasks.workunit.client.1.smithi194.stdout:5/997: dread d3/d83/f82 [0,4194304] 0 2024-04-13T10:58:48.327 INFO:tasks.workunit.client.1.smithi194.stdout:4/924: dread d2/d30/d50/d11a/d1c/d3e/fd1 [0,4194304] 0 2024-04-13T10:58:48.329 INFO:tasks.workunit.client.1.smithi194.stdout:0/835: link d9/d2b/c7b d9/d2b/d6c/ddf/d16/d75/c10f 0 2024-04-13T10:58:48.330 INFO:tasks.workunit.client.1.smithi194.stdout:5/998: chown d3/le 1229530021 1 2024-04-13T10:58:48.332 INFO:tasks.workunit.client.1.smithi194.stdout:0/836: chown d9/db1/d30/d73/fc2 2 1 2024-04-13T10:58:48.332 INFO:tasks.workunit.client.1.smithi194.stdout:4/925: symlink d2/d30/d50/d11a/d1c/d3b/d8d/d115/l13f 0 2024-04-13T10:58:48.336 INFO:tasks.workunit.client.1.smithi194.stdout:4/926: fsync d2/d30/d50/d11a/d60/fb3 0 2024-04-13T10:58:48.337 INFO:tasks.workunit.client.1.smithi194.stdout:0/837: dread - d9/d2b/d6c/ddf/d63/def/fff zero size 2024-04-13T10:58:48.338 INFO:tasks.workunit.client.1.smithi194.stdout:6/887: dwrite d0/d57/db7/dbc/fd3 [0,4194304] 0 2024-04-13T10:58:48.341 INFO:tasks.workunit.client.1.smithi194.stdout:2/914: dwrite d2/d3/de/dee/df1/f122 [8388608,4194304] 0 2024-04-13T10:58:48.342 INFO:tasks.workunit.client.1.smithi194.stdout:6/888: write d0/d2c/f32 [1363171,3714] 0 2024-04-13T10:58:48.343 INFO:tasks.workunit.client.1.smithi194.stdout:2/915: chown d2/d3/d6d/f6f 35790 1 2024-04-13T10:58:48.348 INFO:tasks.workunit.client.1.smithi194.stdout:5/999: dwrite d3/dc/d2d/dd1/d38/d59/d7a/f100 [4194304,4194304] 0 2024-04-13T10:58:48.349 INFO:tasks.workunit.client.1.smithi194.stdout:4/927: symlink d2/d30/d50/d11a/d1c/d3b/d8d/d12e/l140 0 2024-04-13T10:58:48.350 INFO:tasks.workunit.client.1.smithi194.stdout:3/777: truncate d2/d3/d12/d21/f49 3986500 0 2024-04-13T10:58:48.359 INFO:tasks.workunit.client.1.smithi194.stdout:0/838: dwrite d9/f4b [0,4194304] 0 2024-04-13T10:58:48.360 INFO:tasks.workunit.client.1.smithi194.stdout:4/928: write d2/d30/d50/d11a/d1c/d3e/dbb/f108 [1071803,79565] 0 2024-04-13T10:58:48.360 INFO:tasks.workunit.client.1.smithi194.stdout:6/889: dwrite d0/d26/f5c [0,4194304] 0 2024-04-13T10:58:48.364 INFO:tasks.workunit.client.1.smithi194.stdout:0/839: chown d9/db1/d30/d73/fba 1668107 1 2024-04-13T10:58:48.369 INFO:tasks.workunit.client.1.smithi194.stdout:3/778: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df0/c106 0 2024-04-13T10:58:48.369 INFO:tasks.workunit.client.1.smithi194.stdout:7/912: dwrite d1/d2b/d4c/d4f/d85/d88/d9b/db8/fc3 [0,4194304] 0 2024-04-13T10:58:48.372 INFO:tasks.workunit.client.1.smithi194.stdout:2/916: dwrite d2/d3/de/d33/d47/dbb/f93 [0,4194304] 0 2024-04-13T10:58:48.373 INFO:tasks.workunit.client.1.smithi194.stdout:2/917: dread - d2/d3/f135 zero size 2024-04-13T10:58:48.377 INFO:tasks.workunit.client.1.smithi194.stdout:6/890: link d0/d42/dbe/ffa d0/d2c/d10e/f122 0 2024-04-13T10:58:48.378 INFO:tasks.workunit.client.1.smithi194.stdout:4/929: rename d2/d30/d50/d11a/d1c/d3e/dbb/dee/dd8/df0/l37 to d2/d16/dd2/d11f/de5/d120/l141 0 2024-04-13T10:58:48.380 INFO:tasks.workunit.client.1.smithi194.stdout:7/913: mknod d1/d2b/d4c/c128 0 2024-04-13T10:58:48.380 INFO:tasks.workunit.client.1.smithi194.stdout:2/918: mkdir d2/d3/de/d17/d36/d136 0 2024-04-13T10:58:48.383 INFO:tasks.workunit.client.1.smithi194.stdout:6/891: symlink d0/d42/dbe/d4d/l123 0 2024-04-13T10:58:48.386 INFO:tasks.workunit.client.1.smithi194.stdout:6/892: mkdir d0/d42/d7b/db4/d124 0 2024-04-13T10:58:48.386 INFO:tasks.workunit.client.1.smithi194.stdout:6/893: chown d0/d26/d4b 630 1 2024-04-13T10:58:48.390 INFO:tasks.workunit.client.1.smithi194.stdout:6/894: rename d0/d57/d69/f65 to d0/d2c/d77/d93/daa/d116/f125 0 2024-04-13T10:58:48.390 INFO:tasks.workunit.client.1.smithi194.stdout:6/895: readlink d0/d26/d4b/dd0/l11a 0 2024-04-13T10:58:48.396 INFO:tasks.workunit.client.1.smithi194.stdout:6/896: dread d0/d2c/d77/d93/daa/fdc [0,4194304] 0 2024-04-13T10:58:48.399 INFO:tasks.workunit.client.1.smithi194.stdout:6/897: unlink d0/d2c/d77/d93/d98/cd5 0 2024-04-13T10:58:48.400 INFO:tasks.workunit.client.1.smithi194.stdout:7/914: truncate d1/d2b/fb6 5892116 0 2024-04-13T10:58:48.401 INFO:tasks.workunit.client.1.smithi194.stdout:0/840: dwrite d9/db/d3a/d9a/dd7/f17 [4194304,4194304] 0 2024-04-13T10:58:48.404 INFO:tasks.workunit.client.1.smithi194.stdout:6/898: write d0/d57/d69/f8a [688513,108769] 0 2024-04-13T10:58:48.404 INFO:tasks.workunit.client.1.smithi194.stdout:7/915: readlink d1/d2b/d4c/d4f/d51/l57 0 2024-04-13T10:58:48.407 INFO:tasks.workunit.client.1.smithi194.stdout:6/899: readlink d0/d26/dcb/l105 0 2024-04-13T10:58:48.408 INFO:tasks.workunit.client.1.smithi194.stdout:4/930: dwrite d2/fc0 [4194304,4194304] 0 2024-04-13T10:58:48.410 INFO:tasks.workunit.client.1.smithi194.stdout:2/919: dwrite d2/d3/de/d33/d47/dbb/f92 [0,4194304] 0 2024-04-13T10:58:48.412 INFO:tasks.workunit.client.1.smithi194.stdout:4/931: write d2/fc0 [4625234,76547] 0 2024-04-13T10:58:48.412 INFO:tasks.workunit.client.1.smithi194.stdout:6/900: symlink d0/l126 0 2024-04-13T10:58:48.417 INFO:tasks.workunit.client.1.smithi194.stdout:4/932: fdatasync d2/d30/d50/d11a/f35 0 2024-04-13T10:58:48.418 INFO:tasks.workunit.client.1.smithi194.stdout:2/920: write d2/d3/de/d17/d36/d8f/f31 [4765026,71460] 0 2024-04-13T10:58:48.418 INFO:tasks.workunit.client.1.smithi194.stdout:0/841: dwrite d9/d2b/d6c/db2/fd9 [0,4194304] 0 2024-04-13T10:58:48.419 INFO:tasks.workunit.client.1.smithi194.stdout:7/916: getdents d1/d2b/d3e/ddf/d5a 0 2024-04-13T10:58:48.421 INFO:tasks.workunit.client.1.smithi194.stdout:4/933: dread - d2/d30/d104/f132 zero size 2024-04-13T10:58:48.425 INFO:tasks.workunit.client.1.smithi194.stdout:6/901: mkdir d0/d53/d78/d91/d127 0 2024-04-13T10:58:48.426 INFO:tasks.workunit.client.1.smithi194.stdout:7/917: creat d1/d2b/d3e/d9c/f129 x:0 0 0 2024-04-13T10:58:48.427 INFO:tasks.workunit.client.1.smithi194.stdout:4/934: stat d2/d16/dd2/fea 0 2024-04-13T10:58:48.427 INFO:tasks.workunit.client.1.smithi194.stdout:2/921: creat d2/d3/de/d33/d71/ddc/f137 x:0 0 0 2024-04-13T10:58:48.428 INFO:tasks.workunit.client.1.smithi194.stdout:0/842: mknod d9/d2b/d6c/ddf/c110 0 2024-04-13T10:58:48.430 INFO:tasks.workunit.client.1.smithi194.stdout:2/922: creat d2/d3/f138 x:0 0 0 2024-04-13T10:58:48.431 INFO:tasks.workunit.client.1.smithi194.stdout:2/923: stat d2/d3/de/fae 0 2024-04-13T10:58:48.432 INFO:tasks.workunit.client.1.smithi194.stdout:7/918: creat d1/d2b/d4c/d4f/d85/f12a x:0 0 0 2024-04-13T10:58:48.433 INFO:tasks.workunit.client.1.smithi194.stdout:6/902: getdents d0/d2c/d77/d93/daa 0 2024-04-13T10:58:48.433 INFO:tasks.workunit.client.1.smithi194.stdout:4/935: link d2/d30/d50/d11a/d1c/d3e/l4e d2/d30/d50/d11a/d60/d107/l142 0 2024-04-13T10:58:48.435 INFO:tasks.workunit.client.1.smithi194.stdout:7/919: dread - d1/d2b/d4c/d4f/d51/d4d/d5e/f107 zero size 2024-04-13T10:58:48.435 INFO:tasks.workunit.client.1.smithi194.stdout:6/903: chown d0/d57/db7/dbc 436 1 2024-04-13T10:58:48.436 INFO:tasks.workunit.client.1.smithi194.stdout:4/936: stat d2/d30/d50/d11a/d60/c111 0 2024-04-13T10:58:48.437 INFO:tasks.workunit.client.1.smithi194.stdout:0/843: dwrite d9/db/d3a/d9a/dd7/f2e [0,4194304] 0 2024-04-13T10:58:48.439 INFO:tasks.workunit.client.1.smithi194.stdout:0/844: fsync d9/d2b/d6c/ddf/d16/d75/fbf 0 2024-04-13T10:58:48.441 INFO:tasks.workunit.client.1.smithi194.stdout:7/920: dread d1/d2b/d2c/d30/d33/fbd [0,4194304] 0 2024-04-13T10:58:48.441 INFO:tasks.workunit.client.1.smithi194.stdout:2/924: link d2/d3/de/d17/d39/dcc/ff9 d2/d3/de/d33/f139 0 2024-04-13T10:58:48.441 INFO:tasks.workunit.client.1.smithi194.stdout:2/925: dread - d2/d3/d6d/f125 zero size 2024-04-13T10:58:48.442 INFO:tasks.workunit.client.1.smithi194.stdout:6/904: symlink d0/d57/db7/l128 0 2024-04-13T10:58:48.444 INFO:tasks.workunit.client.1.smithi194.stdout:6/905: write d0/d57/fb0 [1284091,111896] 0 2024-04-13T10:58:48.446 INFO:tasks.workunit.client.1.smithi194.stdout:0/845: mknod d9/db1/d30/d73/c111 0 2024-04-13T10:58:48.448 INFO:tasks.workunit.client.1.smithi194.stdout:1/831: sync 2024-04-13T10:58:48.449 INFO:tasks.workunit.client.1.smithi194.stdout:7/921: rename d1/dd9/de1/dab/d96/ff2 to d1/d2b/d2c/d30/d33/d39/dba/d10e/f12b 0 2024-04-13T10:58:48.450 INFO:tasks.workunit.client.1.smithi194.stdout:2/926: dwrite d2/d3/de/d33/d71/ddc/f137 [0,4194304] 0 2024-04-13T10:58:48.451 INFO:tasks.workunit.client.1.smithi194.stdout:1/832: write d12/d13/d1c/d28/df2/d8b/fc0 [2544780,116443] 0 2024-04-13T10:58:48.451 INFO:tasks.workunit.client.1.smithi194.stdout:7/922: read - d1/d2b/d4c/d4f/d85/f12a zero size 2024-04-13T10:58:48.456 INFO:tasks.workunit.client.1.smithi194.stdout:0/846: creat d9/d2b/d6c/f112 x:0 0 0 2024-04-13T10:58:48.456 INFO:tasks.workunit.client.1.smithi194.stdout:2/927: write d2/d3/de/d17/d1e/fbf [5211021,117361] 0 2024-04-13T10:58:48.457 INFO:tasks.workunit.client.1.smithi194.stdout:7/923: dread - d1/d2b/d3e/ddf/d5a/d3c/def/f116 zero size 2024-04-13T10:58:48.460 INFO:tasks.workunit.client.1.smithi194.stdout:6/906: dwrite d0/d42/f7d [0,4194304] 0 2024-04-13T10:58:48.460 INFO:tasks.workunit.client.1.smithi194.stdout:1/833: rename d12/d13/d1c/d7c to d12/d3a/d4f/da3/d107/d10f 0 2024-04-13T10:58:48.469 INFO:tasks.workunit.client.1.smithi194.stdout:1/834: dwrite d12/d13/d3e/fa8 [0,4194304] 0 2024-04-13T10:58:48.470 INFO:tasks.workunit.client.1.smithi194.stdout:7/924: mkdir d1/d2b/d3e/ddf/d5a/d7d/d122/d12c 0 2024-04-13T10:58:48.475 INFO:tasks.workunit.client.1.smithi194.stdout:3/779: sync 2024-04-13T10:58:48.475 INFO:tasks.workunit.client.1.smithi194.stdout:9/867: sync 2024-04-13T10:58:48.477 INFO:tasks.workunit.client.1.smithi194.stdout:4/937: dread d2/fb [8388608,4194304] 0 2024-04-13T10:58:48.483 INFO:tasks.workunit.client.1.smithi194.stdout:6/907: creat d0/d42/d7b/f129 x:0 0 0 2024-04-13T10:58:48.484 INFO:tasks.workunit.client.1.smithi194.stdout:7/925: creat d1/d2b/d3e/ddf/d6b/f12d x:0 0 0 2024-04-13T10:58:48.486 INFO:tasks.workunit.client.1.smithi194.stdout:0/847: getdents d9/d2b/d6c/ddf/d16/d75/dd3 0 2024-04-13T10:58:48.487 INFO:tasks.workunit.client.1.smithi194.stdout:6/908: dread d0/d57/fb0 [0,4194304] 0 2024-04-13T10:58:48.488 INFO:tasks.workunit.client.1.smithi194.stdout:3/780: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df0/f107 x:0 0 0 2024-04-13T10:58:48.489 INFO:tasks.workunit.client.1.smithi194.stdout:4/938: fdatasync d2/d30/d50/d11a/d1c/d9a/fb7 0 2024-04-13T10:58:48.493 INFO:tasks.workunit.client.1.smithi194.stdout:7/926: rmdir d1/d2b/d4c/d4f/d85/d88/d9b 39 2024-04-13T10:58:48.494 INFO:tasks.workunit.client.1.smithi194.stdout:2/928: dread d2/d3/de/d17/d1e/f2c [12582912,4194304] 0 2024-04-13T10:58:48.495 INFO:tasks.workunit.client.1.smithi194.stdout:0/848: symlink d9/d2b/d6c/ddf/d16/d65/db9/l113 0 2024-04-13T10:58:48.496 INFO:tasks.workunit.client.1.smithi194.stdout:1/835: rmdir d12 39 2024-04-13T10:58:48.497 INFO:tasks.workunit.client.1.smithi194.stdout:6/909: mknod d0/d57/d115/dba/c12a 0 2024-04-13T10:58:48.499 INFO:tasks.workunit.client.1.smithi194.stdout:3/781: chown d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95/cc9 989168 1 2024-04-13T10:58:48.501 INFO:tasks.workunit.client.1.smithi194.stdout:4/939: write d2/d30/d50/d11a/d1c/d3e/d48/fc3 [1135792,130508] 0 2024-04-13T10:58:48.502 INFO:tasks.workunit.client.1.smithi194.stdout:9/868: dread d0/dde/fec [0,4194304] 0 2024-04-13T10:58:48.503 INFO:tasks.workunit.client.1.smithi194.stdout:9/869: stat d0/d6/d9/c30 0 2024-04-13T10:58:48.507 INFO:tasks.workunit.client.1.smithi194.stdout:2/929: rmdir d2/d3 39 2024-04-13T10:58:48.508 INFO:tasks.workunit.client.1.smithi194.stdout:4/940: dwrite d2/d30/d50/d11a/d1c/fde [4194304,4194304] 0 2024-04-13T10:58:48.509 INFO:tasks.workunit.client.1.smithi194.stdout:7/927: mknod d1/d2b/d2c/d30/d33/d39/c12e 0 2024-04-13T10:58:48.513 INFO:tasks.workunit.client.1.smithi194.stdout:3/782: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5/l108 0 2024-04-13T10:58:48.515 INFO:tasks.workunit.client.1.smithi194.stdout:3/783: chown d2/d3/d12/f16 40 1 2024-04-13T10:58:48.517 INFO:tasks.workunit.client.1.smithi194.stdout:4/941: dwrite d2/d30/d50/d11a/d1c/d3b/d42/f52 [4194304,4194304] 0 2024-04-13T10:58:48.519 INFO:tasks.workunit.client.1.smithi194.stdout:1/836: stat d12/d13/d1c/d28/df2/d8b/dd4/lef 0 2024-04-13T10:58:48.521 INFO:tasks.workunit.client.1.smithi194.stdout:0/849: dread d9/d2b/d6c/ddf/d16/d70/f9d [0,4194304] 0 2024-04-13T10:58:48.522 INFO:tasks.workunit.client.1.smithi194.stdout:6/910: rename d0/d57/d84 to d0/d2f/d48/d83/d110/d12b 0 2024-04-13T10:58:48.523 INFO:tasks.workunit.client.1.smithi194.stdout:9/870: symlink d0/d6/d14/d26/l127 0 2024-04-13T10:58:48.525 INFO:tasks.workunit.client.1.smithi194.stdout:7/928: mkdir d1/d2b/d3e/d9c/dc5/d108/d12f 0 2024-04-13T10:58:48.525 INFO:tasks.workunit.client.1.smithi194.stdout:9/871: read d0/d11/d1e/f21 [3584834,39822] 0 2024-04-13T10:58:48.528 INFO:tasks.workunit.client.1.smithi194.stdout:4/942: symlink d2/d30/d50/d11a/d1c/d3b/d8d/d115/l143 0 2024-04-13T10:58:48.529 INFO:tasks.workunit.client.1.smithi194.stdout:1/837: mknod d12/d13/d1c/d28/d41/db0/c110 0 2024-04-13T10:58:48.529 INFO:tasks.workunit.client.1.smithi194.stdout:0/850: creat d9/d2b/d6c/db2/f114 x:0 0 0 2024-04-13T10:58:48.530 INFO:tasks.workunit.client.1.smithi194.stdout:3/784: creat d2/d7d/de6/f109 x:0 0 0 2024-04-13T10:58:48.531 INFO:tasks.workunit.client.1.smithi194.stdout:2/930: link d2/d3/de/d33/d47/dbb/f92 d2/d3/de/dee/f13a 0 2024-04-13T10:58:48.531 INFO:tasks.workunit.client.1.smithi194.stdout:3/785: read d2/dce/ddc/de2/fea [595229,100940] 0 2024-04-13T10:58:48.532 INFO:tasks.workunit.client.1.smithi194.stdout:9/872: mkdir d0/dfe/d128 0 2024-04-13T10:58:48.532 INFO:tasks.workunit.client.1.smithi194.stdout:7/929: mknod d1/d2b/d3e/ddf/d5a/d7d/c130 0 2024-04-13T10:58:48.533 INFO:tasks.workunit.client.1.smithi194.stdout:4/943: mknod d2/d30/d50/d11a/d1c/d3b/d8d/d121/c144 0 2024-04-13T10:58:48.534 INFO:tasks.workunit.client.1.smithi194.stdout:1/838: fsync d12/d3a/d4f/f10a 0 2024-04-13T10:58:48.537 INFO:tasks.workunit.client.1.smithi194.stdout:2/931: mknod d2/d3/de/dee/df1/c13b 0 2024-04-13T10:58:48.541 INFO:tasks.workunit.client.1.smithi194.stdout:7/930: fdatasync d1/d2b/f47 0 2024-04-13T10:58:48.542 INFO:tasks.workunit.client.1.smithi194.stdout:7/931: chown d1/d2b/d4c/d4f/d85/d88/f103 945788 1 2024-04-13T10:58:48.542 INFO:tasks.workunit.client.1.smithi194.stdout:4/944: dwrite d2/d16/d70/f51 [0,4194304] 0 2024-04-13T10:58:48.542 INFO:tasks.workunit.client.1.smithi194.stdout:9/873: mknod d0/d88/de5/df1/c129 0 2024-04-13T10:58:48.545 INFO:tasks.workunit.client.1.smithi194.stdout:2/932: unlink d2/d3/de/d33/d47/dbb/f5e 0 2024-04-13T10:58:48.548 INFO:tasks.workunit.client.1.smithi194.stdout:0/851: write d9/d2b/d6c/ddf/d16/d83/f9b [755632,1954] 0 2024-04-13T10:58:48.549 INFO:tasks.workunit.client.1.smithi194.stdout:4/945: dwrite d2/d30/d50/d11a/d1c/d54/d62/f6c [0,4194304] 0 2024-04-13T10:58:48.550 INFO:tasks.workunit.client.1.smithi194.stdout:2/933: creat d2/d3/de/d17/d1e/f13c x:0 0 0 2024-04-13T10:58:48.551 INFO:tasks.workunit.client.1.smithi194.stdout:9/874: mkdir d0/dfe/d128/d12a 0 2024-04-13T10:58:48.553 INFO:tasks.workunit.client.1.smithi194.stdout:7/932: creat d1/dd9/de1/dab/d96/f131 x:0 0 0 2024-04-13T10:58:48.555 INFO:tasks.workunit.client.1.smithi194.stdout:2/934: unlink d2/d3/de/d3c/f129 0 2024-04-13T10:58:48.555 INFO:tasks.workunit.client.1.smithi194.stdout:2/935: readlink d2/d3/db6/l104 0 2024-04-13T10:58:48.556 INFO:tasks.workunit.client.1.smithi194.stdout:0/852: truncate d9/db/f52 1313824 0 2024-04-13T10:58:48.557 INFO:tasks.workunit.client.1.smithi194.stdout:2/936: stat d2/d3/de/d33/d71/f75 0 2024-04-13T10:58:48.557 INFO:tasks.workunit.client.1.smithi194.stdout:4/946: getdents d2/d30/d50/d11a/d1c/d54/d62/d9e 0 2024-04-13T10:58:48.557 INFO:tasks.workunit.client.1.smithi194.stdout:7/933: symlink d1/d2b/d3e/l132 0 2024-04-13T10:58:48.559 INFO:tasks.workunit.client.1.smithi194.stdout:2/937: fdatasync d2/d3/de/d17/d39/fef 0 2024-04-13T10:58:48.568 INFO:tasks.workunit.client.1.smithi194.stdout:9/875: creat d0/d6/d4a/d74/dae/d103/f12b x:0 0 0 2024-04-13T10:58:48.568 INFO:tasks.workunit.client.1.smithi194.stdout:3/786: truncate d2/d3/d12/d31/d34/d88/d24/f90 1259448 0 2024-04-13T10:58:48.569 INFO:tasks.workunit.client.1.smithi194.stdout:2/938: creat d2/d37/f13d x:0 0 0 2024-04-13T10:58:48.569 INFO:tasks.workunit.client.1.smithi194.stdout:1/839: truncate d12/d13/d1c/d28/df2/d8b/fc0 3652530 0 2024-04-13T10:58:48.570 INFO:tasks.workunit.client.1.smithi194.stdout:0/853: dwrite d9/db1/f90 [0,4194304] 0 2024-04-13T10:58:48.577 INFO:tasks.workunit.client.1.smithi194.stdout:0/854: dwrite d9/d6f/f81 [0,4194304] 0 2024-04-13T10:58:48.580 INFO:tasks.workunit.client.1.smithi194.stdout:4/947: truncate d2/d30/d50/d11a/d1c/d9a/fb7 1240228 0 2024-04-13T10:58:48.582 INFO:tasks.workunit.client.1.smithi194.stdout:3/787: symlink d2/d7d/de6/l10a 0 2024-04-13T10:58:48.585 INFO:tasks.workunit.client.1.smithi194.stdout:0/855: dwrite d9/d2b/d6c/db2/f114 [0,4194304] 0 2024-04-13T10:58:48.591 INFO:tasks.workunit.client.1.smithi194.stdout:7/934: link d1/d2b/d3e/ddf/d5a/f78 d1/d8b/f133 0 2024-04-13T10:58:48.592 INFO:tasks.workunit.client.1.smithi194.stdout:4/948: mkdir d2/d30/d50/d11a/d1c/d3e/d145 0 2024-04-13T10:58:48.596 INFO:tasks.workunit.client.1.smithi194.stdout:3/788: dwrite d2/d7d/de6/f109 [0,4194304] 0 2024-04-13T10:58:48.603 INFO:tasks.workunit.client.1.smithi194.stdout:7/935: dwrite d1/d2b/d4c/d4f/f125 [0,4194304] 0 2024-04-13T10:58:48.606 INFO:tasks.workunit.client.1.smithi194.stdout:4/949: unlink d2/d30/d50/d11a/d1c/d54/d62/d9e/f112 0 2024-04-13T10:58:48.609 INFO:tasks.workunit.client.1.smithi194.stdout:4/950: dread - d2/d30/d50/d11a/d1c/d3b/d8d/d12e/f7e zero size 2024-04-13T10:58:48.610 INFO:tasks.workunit.client.1.smithi194.stdout:4/951: readlink d2/d30/d50/d11a/d1c/d3b/d8d/d115/l143 0 2024-04-13T10:58:48.611 INFO:tasks.workunit.client.1.smithi194.stdout:7/936: creat d1/dd9/de1/dab/d96/d10c/f134 x:0 0 0 2024-04-13T10:58:48.612 INFO:tasks.workunit.client.1.smithi194.stdout:4/952: read d2/d30/d50/d11a/d1c/d54/fb1 [730608,59913] 0 2024-04-13T10:58:48.613 INFO:tasks.workunit.client.1.smithi194.stdout:7/937: chown d1/dd9/de1/dab/d96/f9e 1 1 2024-04-13T10:58:48.615 INFO:tasks.workunit.client.1.smithi194.stdout:4/953: symlink d2/d16/dd2/d11f/d99/l146 0 2024-04-13T10:58:48.616 INFO:tasks.workunit.client.1.smithi194.stdout:4/954: write d2/d30/d50/d11a/d1c/d3e/d48/fc3 [1277465,53438] 0 2024-04-13T10:58:48.619 INFO:tasks.workunit.client.1.smithi194.stdout:4/955: mknod d2/d30/d50/d11a/d1c/d3e/c147 0 2024-04-13T10:58:48.625 INFO:tasks.workunit.client.1.smithi194.stdout:9/876: write d0/d6/d14/d26/fe1 [5531673,120373] 0 2024-04-13T10:58:48.625 INFO:tasks.workunit.client.1.smithi194.stdout:2/939: write d2/d3/de/f7f [871521,14901] 0 2024-04-13T10:58:48.625 INFO:tasks.workunit.client.1.smithi194.stdout:0/856: fsync d9/d2b/d6c/db2/f114 0 2024-04-13T10:58:48.629 INFO:tasks.workunit.client.1.smithi194.stdout:1/840: write d12/d13/d1c/d28/d41/d50/f8e [636890,68527] 0 2024-04-13T10:58:48.629 INFO:tasks.workunit.client.1.smithi194.stdout:0/857: dread - d9/d2b/d6c/ddf/d16/f27 zero size 2024-04-13T10:58:48.630 INFO:tasks.workunit.client.1.smithi194.stdout:0/858: readlink d9/db1/d30/lf3 0 2024-04-13T10:58:48.631 INFO:tasks.workunit.client.1.smithi194.stdout:2/940: mkdir d2/d3/de/d17/d36/d136/d13e 0 2024-04-13T10:58:48.634 INFO:tasks.workunit.client.1.smithi194.stdout:2/941: chown d2/d3/de/d33/d47/c81 15634 1 2024-04-13T10:58:48.635 INFO:tasks.workunit.client.1.smithi194.stdout:7/938: dread d1/d2b/d2c/d30/d33/d39/dba/d10e/f11b [0,4194304] 0 2024-04-13T10:58:48.640 INFO:tasks.workunit.client.1.smithi194.stdout:9/877: dwrite d0/d11/d3d/d9b/fb7 [0,4194304] 0 2024-04-13T10:58:48.640 INFO:tasks.workunit.client.1.smithi194.stdout:7/939: write d1/f8 [5171521,105473] 0 2024-04-13T10:58:48.641 INFO:tasks.workunit.client.1.smithi194.stdout:0/859: rename d9/d2b/d6c/ddf/d63/def/fff to d9/d2b/d6c/ddf/d16/d75/dd3/f115 0 2024-04-13T10:58:48.644 INFO:tasks.workunit.client.1.smithi194.stdout:3/789: dwrite d2/d3/d12/d31/d34/d88/d24/f4b [0,4194304] 0 2024-04-13T10:58:48.644 INFO:tasks.workunit.client.1.smithi194.stdout:1/841: link d12/d13/d1c/f31 d12/d13/d1c/d28/d41/d77/d93/dfc/f111 0 2024-04-13T10:58:48.647 INFO:tasks.workunit.client.1.smithi194.stdout:0/860: write d9/db/d3a/fca [2982759,39021] 0 2024-04-13T10:58:48.650 INFO:tasks.workunit.client.1.smithi194.stdout:2/942: dwrite d2/d3/f73 [4194304,4194304] 0 2024-04-13T10:58:48.650 INFO:tasks.workunit.client.1.smithi194.stdout:3/790: chown d2/d3/d12/d31/d34/d88/d24/f7c 17571 1 2024-04-13T10:58:48.661 INFO:tasks.workunit.client.1.smithi194.stdout:2/943: write d2/d3/de/d17/d1e/f62 [281661,23449] 0 2024-04-13T10:58:48.666 INFO:tasks.workunit.client.1.smithi194.stdout:0/861: dwrite d9/d2b/d6c/ddf/f4c [0,4194304] 0 2024-04-13T10:58:48.667 INFO:tasks.workunit.client.1.smithi194.stdout:2/944: dread - d2/d3/de/d33/d71/ddc/f11d zero size 2024-04-13T10:58:48.668 INFO:tasks.workunit.client.1.smithi194.stdout:3/791: link d2/d3/d12/d31/d34/d88/d24/d3a/d72/cdf d2/dce/ddc/de2/c10b 0 2024-04-13T10:58:48.672 INFO:tasks.workunit.client.1.smithi194.stdout:1/842: dwrite d12/d13/d1c/d27/f70 [0,4194304] 0 2024-04-13T10:58:48.673 INFO:tasks.workunit.client.1.smithi194.stdout:2/945: symlink d2/d3/de/d17/d36/d3d/l13f 0 2024-04-13T10:58:48.675 INFO:tasks.workunit.client.1.smithi194.stdout:6/911: sync 2024-04-13T10:58:48.676 INFO:tasks.workunit.client.1.smithi194.stdout:9/878: dread d0/f3 [0,4194304] 0 2024-04-13T10:58:48.677 INFO:tasks.workunit.client.1.smithi194.stdout:0/862: symlink d9/db/d6b/l116 0 2024-04-13T10:58:48.679 INFO:tasks.workunit.client.1.smithi194.stdout:2/946: fsync d2/d3/de/d33/d71/fe5 0 2024-04-13T10:58:48.681 INFO:tasks.workunit.client.1.smithi194.stdout:0/863: readlink d9/d2b/d5a/lb0 0 2024-04-13T10:58:48.681 INFO:tasks.workunit.client.1.smithi194.stdout:3/792: dwrite d2/dce/ddc/fe9 [0,4194304] 0 2024-04-13T10:58:48.682 INFO:tasks.workunit.client.1.smithi194.stdout:2/947: chown d2/d3/de/d33/d47/d115 852669 1 2024-04-13T10:58:48.684 INFO:tasks.workunit.client.1.smithi194.stdout:6/912: mkdir d0/d42/d7b/db4/de0/d12c 0 2024-04-13T10:58:48.685 INFO:tasks.workunit.client.1.smithi194.stdout:1/843: truncate d12/d13/d1c/d27/d2e/f62 566484 0 2024-04-13T10:58:48.690 INFO:tasks.workunit.client.1.smithi194.stdout:9/879: creat d0/d6/d4a/f12c x:0 0 0 2024-04-13T10:58:48.690 INFO:tasks.workunit.client.1.smithi194.stdout:3/793: read - d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/fc5 zero size 2024-04-13T10:58:48.691 INFO:tasks.workunit.client.1.smithi194.stdout:2/948: mkdir d2/d3/de/d17/d39/dcc/d140 0 2024-04-13T10:58:48.692 INFO:tasks.workunit.client.1.smithi194.stdout:0/864: dread d9/db1/d30/d73/d87/fee [0,4194304] 0 2024-04-13T10:58:48.693 INFO:tasks.workunit.client.1.smithi194.stdout:1/844: mknod d12/d13/d1c/d27/d4c/dd7/c112 0 2024-04-13T10:58:48.694 INFO:tasks.workunit.client.1.smithi194.stdout:6/913: dread d0/d42/dbe/f40 [0,4194304] 0 2024-04-13T10:58:48.695 INFO:tasks.workunit.client.1.smithi194.stdout:9/880: fdatasync d0/d6/d4a/d74/f7d 0 2024-04-13T10:58:48.695 INFO:tasks.workunit.client.1.smithi194.stdout:2/949: chown d2/d3/d12/f22 0 1 2024-04-13T10:58:48.695 INFO:tasks.workunit.client.1.smithi194.stdout:3/794: write d2/d3/d12/d31/f84 [736690,12770] 0 2024-04-13T10:58:48.696 INFO:tasks.workunit.client.1.smithi194.stdout:7/940: dread d1/d2b/d4c/d4f/f53 [0,4194304] 0 2024-04-13T10:58:48.696 INFO:tasks.workunit.client.1.smithi194.stdout:6/914: fdatasync d0/d2f/fd8 0 2024-04-13T10:58:48.696 INFO:tasks.workunit.client.1.smithi194.stdout:9/881: fsync d0/d11/d1e/f6c 0 2024-04-13T10:58:48.698 INFO:tasks.workunit.client.1.smithi194.stdout:1/845: stat d12/d13/d3e/d108/fc6 0 2024-04-13T10:58:48.700 INFO:tasks.workunit.client.1.smithi194.stdout:6/915: symlink d0/d57/d69/l12d 0 2024-04-13T10:58:48.701 INFO:tasks.workunit.client.1.smithi194.stdout:9/882: symlink d0/d6/d9/l12d 0 2024-04-13T10:58:48.704 INFO:tasks.workunit.client.1.smithi194.stdout:0/865: dwrite d9/d2b/d6c/ddf/fbb [0,4194304] 0 2024-04-13T10:58:48.704 INFO:tasks.workunit.client.1.smithi194.stdout:3/795: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/d103/f10c x:0 0 0 2024-04-13T10:58:48.705 INFO:tasks.workunit.client.1.smithi194.stdout:9/883: chown d0/d6/d14/dcd/da4/la7 4 1 2024-04-13T10:58:48.708 INFO:tasks.workunit.client.1.smithi194.stdout:0/866: symlink d9/db1/d30/df9/l117 0 2024-04-13T10:58:48.710 INFO:tasks.workunit.client.1.smithi194.stdout:1/846: dread d12/d13/d1c/d28/d41/f51 [0,4194304] 0 2024-04-13T10:58:48.711 INFO:tasks.workunit.client.1.smithi194.stdout:1/847: stat d12/d3a/d4f/da3/df1 0 2024-04-13T10:58:48.711 INFO:tasks.workunit.client.1.smithi194.stdout:1/848: chown d12/d13/d1c/c1d 1 1 2024-04-13T10:58:48.714 INFO:tasks.workunit.client.1.smithi194.stdout:0/867: creat d9/d2b/d6c/ddf/d16/d75/dd3/f118 x:0 0 0 2024-04-13T10:58:48.715 INFO:tasks.workunit.client.1.smithi194.stdout:0/868: read - d9/d2b/d6c/ddf/d16/d70/fc4 zero size 2024-04-13T10:58:48.716 INFO:tasks.workunit.client.1.smithi194.stdout:9/884: getdents d0/d6/d14 0 2024-04-13T10:58:48.716 INFO:tasks.workunit.client.1.smithi194.stdout:7/941: write d1/d8b/f133 [572826,9359] 0 2024-04-13T10:58:48.717 INFO:tasks.workunit.client.1.smithi194.stdout:0/869: chown d9/d2b/d6c/db2/fbc 44 1 2024-04-13T10:58:48.717 INFO:tasks.workunit.client.1.smithi194.stdout:3/796: link d2/d3/d12/d31/d34/d88/d24/d3a/d65/l8e d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/l10d 0 2024-04-13T10:58:48.718 INFO:tasks.workunit.client.1.smithi194.stdout:0/870: readlink d9/d2b/la9 0 2024-04-13T10:58:48.718 INFO:tasks.workunit.client.1.smithi194.stdout:7/942: chown d1/d2b/d2c/d30/cd1 368360 1 2024-04-13T10:58:48.720 INFO:tasks.workunit.client.1.smithi194.stdout:0/871: truncate d9/db/d3a/d9a/dd7/fdd 4292975 0 2024-04-13T10:58:48.720 INFO:tasks.workunit.client.1.smithi194.stdout:9/885: mknod d0/d6/c12e 0 2024-04-13T10:58:48.721 INFO:tasks.workunit.client.1.smithi194.stdout:9/886: readlink d0/d6/l65 0 2024-04-13T10:58:48.722 INFO:tasks.workunit.client.1.smithi194.stdout:3/797: mkdir d2/dce/ddc/df2/d10e 0 2024-04-13T10:58:48.722 INFO:tasks.workunit.client.1.smithi194.stdout:0/872: stat d9/db1/d30/d73/d87/ddc 0 2024-04-13T10:58:48.725 INFO:tasks.workunit.client.1.smithi194.stdout:0/873: write d9/d2b/d6c/ddf/d16/d70/f9d [4773601,46018] 0 2024-04-13T10:58:48.725 INFO:tasks.workunit.client.1.smithi194.stdout:7/943: link d1/d2b/d2c/d30/d33/d39/l3a d1/d2b/d2c/d30/d33/d39/dba/d10e/l135 0 2024-04-13T10:58:48.726 INFO:tasks.workunit.client.1.smithi194.stdout:0/874: chown d9/d2b/la9 1728 1 2024-04-13T10:58:48.727 INFO:tasks.workunit.client.1.smithi194.stdout:3/798: mknod d2/d3/d12/d31/c10f 0 2024-04-13T10:58:48.729 INFO:tasks.workunit.client.1.smithi194.stdout:0/875: creat d9/d2b/d6c/ddf/d16/d75/f119 x:0 0 0 2024-04-13T10:58:48.729 INFO:tasks.workunit.client.1.smithi194.stdout:3/799: creat d2/dce/f110 x:0 0 0 2024-04-13T10:58:48.730 INFO:tasks.workunit.client.1.smithi194.stdout:7/944: mkdir d1/d2b/d4c/d4f/d85/d136 0 2024-04-13T10:58:48.741 INFO:tasks.workunit.client.1.smithi194.stdout:0/876: dread d9/db/f15 [0,4194304] 0 2024-04-13T10:58:48.742 INFO:tasks.workunit.client.1.smithi194.stdout:0/877: dread - d9/d2b/d6c/ddf/d16/d75/dd3/f118 zero size 2024-04-13T10:58:48.743 INFO:tasks.workunit.client.1.smithi194.stdout:0/878: write d9/db/d3a/d9a/dd7/f17 [2995654,56699] 0 2024-04-13T10:58:48.745 INFO:tasks.workunit.client.1.smithi194.stdout:0/879: mknod d9/d2b/c11a 0 2024-04-13T10:58:48.750 INFO:tasks.workunit.client.1.smithi194.stdout:0/880: dwrite d9/db/f3d [0,4194304] 0 2024-04-13T10:58:48.750 INFO:tasks.workunit.client.1.smithi194.stdout:0/881: fdatasync d9/db1/fa7 0 2024-04-13T10:58:48.751 INFO:tasks.workunit.client.1.smithi194.stdout:0/882: chown d9/db/d3a/d9a/dd7/f48 94714 1 2024-04-13T10:58:48.755 INFO:tasks.workunit.client.1.smithi194.stdout:0/883: mkdir d9/d2b/d6c/ddf/d16/d11b 0 2024-04-13T10:58:48.761 INFO:tasks.workunit.client.1.smithi194.stdout:1/849: write d12/d13/d1c/d28/d41/d77/d93/dfc/f111 [1949580,51125] 0 2024-04-13T10:58:48.763 INFO:tasks.workunit.client.1.smithi194.stdout:7/945: rename d1/d2b/d2c/d30/d33/d39 to d1/d6c/d137 0 2024-04-13T10:58:48.764 INFO:tasks.workunit.client.1.smithi194.stdout:9/887: truncate d0/dde/fec 4103157 0 2024-04-13T10:58:48.766 INFO:tasks.workunit.client.1.smithi194.stdout:7/946: rmdir d1/d2b/d4c/d4f/d85/d88/d9b 39 2024-04-13T10:58:48.769 INFO:tasks.workunit.client.1.smithi194.stdout:0/884: write d9/d2b/d6c/faf [161355,88408] 0 2024-04-13T10:58:48.769 INFO:tasks.workunit.client.1.smithi194.stdout:7/947: unlink d1/fe 0 2024-04-13T10:58:48.773 INFO:tasks.workunit.client.1.smithi194.stdout:3/800: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 [0,4194304] 0 2024-04-13T10:58:48.775 INFO:tasks.workunit.client.1.smithi194.stdout:7/948: creat d1/d2b/d3e/ddf/d5a/d3c/f138 x:0 0 0 2024-04-13T10:58:48.777 INFO:tasks.workunit.client.1.smithi194.stdout:0/885: mknod d9/d2b/d6c/ddf/d16/d77/c11c 0 2024-04-13T10:58:48.780 INFO:tasks.workunit.client.1.smithi194.stdout:1/850: dread d12/f35 [0,4194304] 0 2024-04-13T10:58:48.780 INFO:tasks.workunit.client.1.smithi194.stdout:3/801: dread d2/d3/f3d [0,4194304] 0 2024-04-13T10:58:48.782 INFO:tasks.workunit.client.1.smithi194.stdout:9/888: dread d0/d6/d2c/d68/fce [0,4194304] 0 2024-04-13T10:58:48.783 INFO:tasks.workunit.client.1.smithi194.stdout:0/886: rename d9/db/d6b/lb3 to d9/db1/l11d 0 2024-04-13T10:58:48.784 INFO:tasks.workunit.client.1.smithi194.stdout:7/949: creat d1/d2b/d2c/d30/f139 x:0 0 0 2024-04-13T10:58:48.786 INFO:tasks.workunit.client.1.smithi194.stdout:1/851: mknod d12/d13/d1c/d28/df2/d8b/c113 0 2024-04-13T10:58:48.787 INFO:tasks.workunit.client.1.smithi194.stdout:0/887: write d9/d2b/d6c/ddf/d16/d75/dd3/f115 [852540,125365] 0 2024-04-13T10:58:48.788 INFO:tasks.workunit.client.1.smithi194.stdout:1/852: chown d12/d13/d3e/f66 437 1 2024-04-13T10:58:48.789 INFO:tasks.workunit.client.1.smithi194.stdout:3/802: dwrite d2/dce/ddc/fe9 [4194304,4194304] 0 2024-04-13T10:58:48.790 INFO:tasks.workunit.client.1.smithi194.stdout:9/889: link d0/d6/d9/dd7/f109 d0/d11/d44/f12f 0 2024-04-13T10:58:48.791 INFO:tasks.workunit.client.1.smithi194.stdout:0/888: write d9/db/d3a/d9a/dd7/f53 [497902,70457] 0 2024-04-13T10:58:48.793 INFO:tasks.workunit.client.1.smithi194.stdout:1/853: creat d12/d13/d1c/d27/d5c/f114 x:0 0 0 2024-04-13T10:58:48.794 INFO:tasks.workunit.client.1.smithi194.stdout:0/889: mknod d9/db1/c11e 0 2024-04-13T10:58:48.797 INFO:tasks.workunit.client.1.smithi194.stdout:7/950: dwrite d1/dd9/de1/f10b [0,4194304] 0 2024-04-13T10:58:48.801 INFO:tasks.workunit.client.1.smithi194.stdout:3/803: getdents d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67 0 2024-04-13T10:58:48.801 INFO:tasks.workunit.client.1.smithi194.stdout:0/890: chown d9/d2b/d6c/ddf/d16/d65/db9/l113 328 1 2024-04-13T10:58:48.802 INFO:tasks.workunit.client.1.smithi194.stdout:1/854: mkdir d12/d3a/d4f/da3/d107/d10f/dfb/d115 0 2024-04-13T10:58:48.805 INFO:tasks.workunit.client.1.smithi194.stdout:0/891: creat d9/d6f/f11f x:0 0 0 2024-04-13T10:58:48.806 INFO:tasks.workunit.client.1.smithi194.stdout:9/890: dwrite d0/d6/d14/d26/d3b/f11b [0,4194304] 0 2024-04-13T10:58:48.811 INFO:tasks.workunit.client.1.smithi194.stdout:0/892: dread - d9/d2b/d6c/ddf/d63/fcc zero size 2024-04-13T10:58:48.811 INFO:tasks.workunit.client.1.smithi194.stdout:1/855: creat d12/d13/d1c/d27/d5c/db6/f116 x:0 0 0 2024-04-13T10:58:48.812 INFO:tasks.workunit.client.1.smithi194.stdout:3/804: truncate d2/d3/d12/d31/d34/d88/d24/d6c/dc2/fcf 333977 0 2024-04-13T10:58:48.813 INFO:tasks.workunit.client.1.smithi194.stdout:4/956: sync 2024-04-13T10:58:48.814 INFO:tasks.workunit.client.1.smithi194.stdout:1/856: dread - d12/d13/de7/ff4 zero size 2024-04-13T10:58:48.815 INFO:tasks.workunit.client.1.smithi194.stdout:0/893: write d9/d2b/d6c/ddf/f14 [348111,123704] 0 2024-04-13T10:58:48.815 INFO:tasks.workunit.client.1.smithi194.stdout:9/891: truncate d0/d6/d14/fdd 456690 0 2024-04-13T10:58:48.815 INFO:tasks.workunit.client.1.smithi194.stdout:4/957: stat d2/d30/d50/d11a/d1c/d3e/d48/le6 0 2024-04-13T10:58:48.816 INFO:tasks.workunit.client.1.smithi194.stdout:1/857: chown d12/d13/d44/cc5 827692 1 2024-04-13T10:58:48.816 INFO:tasks.workunit.client.1.smithi194.stdout:9/892: chown d0/d11/f3c 1141469 1 2024-04-13T10:58:48.819 INFO:tasks.workunit.client.1.smithi194.stdout:0/894: creat d9/d2b/d6c/ddf/d16/d65/f120 x:0 0 0 2024-04-13T10:58:48.820 INFO:tasks.workunit.client.1.smithi194.stdout:1/858: mknod d12/d13/d3e/c117 0 2024-04-13T10:58:48.820 INFO:tasks.workunit.client.1.smithi194.stdout:3/805: getdents d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61 0 2024-04-13T10:58:48.822 INFO:tasks.workunit.client.1.smithi194.stdout:4/958: creat d2/d30/d50/d11a/d1c/d3b/d8d/d12e/d98/f148 x:0 0 0 2024-04-13T10:58:48.826 INFO:tasks.workunit.client.1.smithi194.stdout:9/893: dwrite d0/d6/d2c/f102 [0,4194304] 0 2024-04-13T10:58:48.828 INFO:tasks.workunit.client.1.smithi194.stdout:0/895: write d9/d2b/f8b [3833984,75180] 0 2024-04-13T10:58:48.828 INFO:tasks.workunit.client.1.smithi194.stdout:1/859: truncate d12/d13/d1c/d28/d41/f84 1609008 0 2024-04-13T10:58:48.831 INFO:tasks.workunit.client.1.smithi194.stdout:0/896: truncate d9/db/d3a/fc0 4763923 0 2024-04-13T10:58:48.835 INFO:tasks.workunit.client.1.smithi194.stdout:1/860: rename d12/d13/d1c/d27/d4c/dd7 to d12/d13/d1c/d27/d2e/d118 0 2024-04-13T10:58:48.836 INFO:tasks.workunit.client.1.smithi194.stdout:9/894: dwrite d0/d6/f7b [0,4194304] 0 2024-04-13T10:58:48.837 INFO:tasks.workunit.client.1.smithi194.stdout:1/861: chown d12/d13/d3e/d108/l100 59449716 1 2024-04-13T10:58:48.841 INFO:tasks.workunit.client.1.smithi194.stdout:0/897: link d9/d2b/d6c/ddf/d16/d83/f9b d9/d2b/d6c/ddf/d16/d75/dd3/f121 0 2024-04-13T10:58:48.843 INFO:tasks.workunit.client.1.smithi194.stdout:9/895: rename d0/d11/d1e/f6c to d0/d88/de5/df1/f130 0 2024-04-13T10:58:48.846 INFO:tasks.workunit.client.1.smithi194.stdout:4/959: truncate d2/d30/d50/d11a/d60/d107/d10f/f96 148901 0 2024-04-13T10:58:48.848 INFO:tasks.workunit.client.1.smithi194.stdout:1/862: rename d12/d3a/d4f/da3/ce2 to d12/d3a/d4f/da3/d107/d10f/dfb/d115/c119 0 2024-04-13T10:58:48.850 INFO:tasks.workunit.client.1.smithi194.stdout:9/896: symlink d0/d6/d2c/d68/d120/l131 0 2024-04-13T10:58:48.851 INFO:tasks.workunit.client.1.smithi194.stdout:3/806: dread d2/de/f1e [0,4194304] 0 2024-04-13T10:58:48.852 INFO:tasks.workunit.client.1.smithi194.stdout:0/898: getdents d9/d2b/d6c/db2 0 2024-04-13T10:58:48.853 INFO:tasks.workunit.client.1.smithi194.stdout:0/899: write d9/db/d3a/f5c [1617744,129603] 0 2024-04-13T10:58:48.853 INFO:tasks.workunit.client.1.smithi194.stdout:4/960: rename d2/d30/d50/d11a/d1c/d3b/d8d/d12e/db2 to d2/d30/d149 0 2024-04-13T10:58:48.854 INFO:tasks.workunit.client.1.smithi194.stdout:0/900: chown d9/db1/l3b 5 1 2024-04-13T10:58:48.854 INFO:tasks.workunit.client.1.smithi194.stdout:9/897: mkdir d0/d6/d14/dcd/da4/de0/d132 0 2024-04-13T10:58:48.855 INFO:tasks.workunit.client.1.smithi194.stdout:3/807: symlink d2/d3/l111 0 2024-04-13T10:58:48.856 INFO:tasks.workunit.client.1.smithi194.stdout:9/898: write d0/d6/d14/dcd/da4/de0/ff5 [405980,6712] 0 2024-04-13T10:58:48.858 INFO:tasks.workunit.client.1.smithi194.stdout:4/961: mknod d2/d16/dd2/c14a 0 2024-04-13T10:58:48.863 INFO:tasks.workunit.client.1.smithi194.stdout:4/962: mknod d2/d16/dd2/d11f/de5/c14b 0 2024-04-13T10:58:48.863 INFO:tasks.workunit.client.1.smithi194.stdout:1/863: write d12/d13/d1c/d27/f86 [963858,79131] 0 2024-04-13T10:58:48.866 INFO:tasks.workunit.client.1.smithi194.stdout:0/901: link d9/d2b/d6c/db2/cf4 d9/d2b/d5a/c122 0 2024-04-13T10:58:48.867 INFO:tasks.workunit.client.1.smithi194.stdout:1/864: dread - d12/d13/d44/f94 zero size 2024-04-13T10:58:48.868 INFO:tasks.workunit.client.1.smithi194.stdout:4/963: mknod d2/d30/d50/d11a/d1c/d54/d62/d10d/dcc/c14c 0 2024-04-13T10:58:48.868 INFO:tasks.workunit.client.1.smithi194.stdout:9/899: link d0/d11/d44/l8d d0/dde/d10e/l133 0 2024-04-13T10:58:48.870 INFO:tasks.workunit.client.1.smithi194.stdout:0/902: dread d9/db/d3a/d9a/dd7/f17 [4194304,4194304] 0 2024-04-13T10:58:48.871 INFO:tasks.workunit.client.1.smithi194.stdout:3/808: truncate d2/dce/ddc/fe9 8169910 0 2024-04-13T10:58:48.872 INFO:tasks.workunit.client.1.smithi194.stdout:9/900: unlink d0/d6/d14/d26/f67 0 2024-04-13T10:58:48.874 INFO:tasks.workunit.client.1.smithi194.stdout:0/903: mkdir d9/d2b/d6c/ddf/d63/d123 0 2024-04-13T10:58:48.875 INFO:tasks.workunit.client.1.smithi194.stdout:4/964: symlink d2/d30/d50/d11a/d1c/d3e/dbb/d124/l14d 0 2024-04-13T10:58:48.877 INFO:tasks.workunit.client.1.smithi194.stdout:1/865: link d12/d13/d3e/d108/f67 d12/d13/d1c/d28/df2/f11a 0 2024-04-13T10:58:48.878 INFO:tasks.workunit.client.1.smithi194.stdout:0/904: symlink d9/d2b/d6c/ddf/d16/d75/dd3/l124 0 2024-04-13T10:58:48.880 INFO:tasks.workunit.client.1.smithi194.stdout:9/901: unlink d0/d11/d3d/c57 0 2024-04-13T10:58:48.881 INFO:tasks.workunit.client.1.smithi194.stdout:4/965: creat d2/d30/d50/d11a/d1c/d3b/d42/f14e x:0 0 0 2024-04-13T10:58:48.882 INFO:tasks.workunit.client.1.smithi194.stdout:1/866: creat d12/d13/d1c/d27/d5c/db6/f11b x:0 0 0 2024-04-13T10:58:48.885 INFO:tasks.workunit.client.1.smithi194.stdout:9/902: rename d0/d6/d14/d26/d42/c8e to d0/d6/d9/dd7/c134 0 2024-04-13T10:58:48.885 INFO:tasks.workunit.client.1.smithi194.stdout:3/809: dread d2/d3/d12/d21/fe5 [0,4194304] 0 2024-04-13T10:58:48.887 INFO:tasks.workunit.client.1.smithi194.stdout:4/966: mkdir d2/d30/d50/d11a/d1c/d3b/d8d/d12e/d98/d90/d14f 0 2024-04-13T10:58:48.888 INFO:tasks.workunit.client.1.smithi194.stdout:0/905: dwrite d9/d2b/d6c/ddf/d16/d75/dd3/f118 [0,4194304] 0 2024-04-13T10:58:48.889 INFO:tasks.workunit.client.1.smithi194.stdout:3/810: dread - d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df0/f107 zero size 2024-04-13T10:58:48.890 INFO:tasks.workunit.client.1.smithi194.stdout:9/903: dread d0/d11/d3d/f89 [0,4194304] 0 2024-04-13T10:58:48.892 INFO:tasks.workunit.client.1.smithi194.stdout:9/904: write d0/d6/d14/d26/f11e [429936,130999] 0 2024-04-13T10:58:48.894 INFO:tasks.workunit.client.1.smithi194.stdout:3/811: read d2/d3/d12/d31/d34/d88/d24/d3a/d56/fbe [3109813,106246] 0 2024-04-13T10:58:48.895 INFO:tasks.workunit.client.1.smithi194.stdout:9/905: write d0/dfe/f118 [378742,116295] 0 2024-04-13T10:58:48.898 INFO:tasks.workunit.client.1.smithi194.stdout:3/812: chown d2/d3/d12/d31/cc8 9 1 2024-04-13T10:58:48.898 INFO:tasks.workunit.client.1.smithi194.stdout:0/906: dwrite d9/d6f/f11f [0,4194304] 0 2024-04-13T10:58:48.899 INFO:tasks.workunit.client.1.smithi194.stdout:4/967: truncate d2/d30/d50/d11a/d60/d107/f12c 2897900 0 2024-04-13T10:58:48.900 INFO:tasks.workunit.client.1.smithi194.stdout:9/906: symlink d0/d6/d9/d51/l135 0 2024-04-13T10:58:48.900 INFO:tasks.workunit.client.1.smithi194.stdout:4/968: chown d2/d30/d50/d11a/d1c/d3e/dfe 0 1 2024-04-13T10:58:48.901 INFO:tasks.workunit.client.1.smithi194.stdout:4/969: fsync d2/d16/dd2/d11f/d99/f131 0 2024-04-13T10:58:48.902 INFO:tasks.workunit.client.1.smithi194.stdout:3/813: creat d2/d3/d12/d31/d34/d88/d24/d82/f112 x:0 0 0 2024-04-13T10:58:48.903 INFO:tasks.workunit.client.1.smithi194.stdout:9/907: fsync d0/d11/d1e/f21 0 2024-04-13T10:58:48.908 INFO:tasks.workunit.client.1.smithi194.stdout:3/814: link d2/d3/d12/d31/d34/d88/d24/d82/fde d2/d7d/dff/f113 0 2024-04-13T10:58:48.909 INFO:tasks.workunit.client.1.smithi194.stdout:4/970: rmdir d2/d30/d50/d11a/d60/d107/d10f/d7b 0 2024-04-13T10:58:48.910 INFO:tasks.workunit.client.1.smithi194.stdout:9/908: dwrite d0/fe7 [0,4194304] 0 2024-04-13T10:58:48.911 INFO:tasks.workunit.client.1.smithi194.stdout:4/971: chown d2/d30/d50/d11a/d1c/d9a 372 1 2024-04-13T10:58:48.912 INFO:tasks.workunit.client.1.smithi194.stdout:9/909: readlink d0/d11/d79/l8a 0 2024-04-13T10:58:48.915 INFO:tasks.workunit.client.1.smithi194.stdout:4/972: symlink d2/d30/d50/d11a/d60/d107/d10f/l150 0 2024-04-13T10:58:48.916 INFO:tasks.workunit.client.1.smithi194.stdout:9/910: mknod d0/d6/c136 0 2024-04-13T10:58:48.920 INFO:tasks.workunit.client.1.smithi194.stdout:9/911: unlink d0/d6/d14/d26/f124 0 2024-04-13T10:58:48.923 INFO:tasks.workunit.client.1.smithi194.stdout:9/912: creat d0/d6/d4a/d74/dae/deb/f137 x:0 0 0 2024-04-13T10:58:48.925 INFO:tasks.workunit.client.1.smithi194.stdout:9/913: chown d0/d6/d14/dcd/da4/l106 0 1 2024-04-13T10:58:48.925 INFO:tasks.workunit.client.1.smithi194.stdout:3/815: write d2/d3/d12/d31/d34/d88/d24/d3a/d72/f8c [2204901,6228] 0 2024-04-13T10:58:48.926 INFO:tasks.workunit.client.1.smithi194.stdout:4/973: write d2/d30/d50/d11a/d1c/d3b/d42/f82 [4362993,112177] 0 2024-04-13T10:58:48.926 INFO:tasks.workunit.client.1.smithi194.stdout:0/907: dwrite d9/db/f8a [0,4194304] 0 2024-04-13T10:58:48.928 INFO:tasks.workunit.client.1.smithi194.stdout:9/914: creat d0/d88/dac/f138 x:0 0 0 2024-04-13T10:58:48.928 INFO:tasks.workunit.client.1.smithi194.stdout:3/816: write d2/d7d/f104 [423122,97124] 0 2024-04-13T10:58:48.929 INFO:tasks.workunit.client.1.smithi194.stdout:4/974: fsync d2/d30/d50/d11a/d1c/d9a/fe4 0 2024-04-13T10:58:48.931 INFO:tasks.workunit.client.1.smithi194.stdout:9/915: write d0/d6/d2c/f69 [5082965,12247] 0 2024-04-13T10:58:48.931 INFO:tasks.workunit.client.1.smithi194.stdout:4/975: chown d2/d30/d50/d11a/d1c/d3e/fd1 472278 1 2024-04-13T10:58:48.932 INFO:tasks.workunit.client.1.smithi194.stdout:0/908: mkdir d9/d2b/d6c/ddf/d63/d123/d125 0 2024-04-13T10:58:48.932 INFO:tasks.workunit.client.1.smithi194.stdout:3/817: dread d2/dce/ddc/de2/fea [0,4194304] 0 2024-04-13T10:58:48.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:48 smithi134 ceph-mon[39696]: pgmap v28: 65 pgs: 65 active+clean; 1.5 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 60 MiB/s rd, 183 MiB/s wr, 353 op/s 2024-04-13T10:58:48.934 INFO:tasks.workunit.client.1.smithi194.stdout:0/909: write d9/d9f/f108 [510470,61873] 0 2024-04-13T10:58:48.935 INFO:tasks.workunit.client.1.smithi194.stdout:9/916: mkdir d0/d88/dac/d139 0 2024-04-13T10:58:48.935 INFO:tasks.workunit.client.1.smithi194.stdout:9/917: dread - d0/d11/d44/f110 zero size 2024-04-13T10:58:48.936 INFO:tasks.workunit.client.1.smithi194.stdout:4/976: creat d2/d30/deb/f151 x:0 0 0 2024-04-13T10:58:48.938 INFO:tasks.workunit.client.1.smithi194.stdout:4/977: chown d2/d30/d50/d11a/d1c/d3e/dbb/f108 129467930 1 2024-04-13T10:58:48.941 INFO:tasks.workunit.client.1.smithi194.stdout:4/978: dread - d2/d30/d50/d11a/d1c/d9a/f113 zero size 2024-04-13T10:58:48.944 INFO:tasks.workunit.client.1.smithi194.stdout:0/910: dwrite d9/db1/d30/d73/fa6 [0,4194304] 0 2024-04-13T10:58:48.947 INFO:tasks.workunit.client.1.smithi194.stdout:3/818: write d2/d3/f43 [793505,69436] 0 2024-04-13T10:58:48.953 INFO:tasks.workunit.client.1.smithi194.stdout:4/979: dwrite d2/d30/d50/d11a/d1c/f39 [0,4194304] 0 2024-04-13T10:58:48.954 INFO:tasks.workunit.client.1.smithi194.stdout:3/819: write d2/d3/f3d [2136298,101489] 0 2024-04-13T10:58:48.958 INFO:tasks.workunit.client.1.smithi194.stdout:9/918: dread d0/d11/d1e/fa1 [0,4194304] 0 2024-04-13T10:58:48.959 INFO:tasks.workunit.client.1.smithi194.stdout:4/980: rename d2/d30/d50/d11a/d1c/d3e/dbb/dee/l10b to d2/d16/d70/l152 0 2024-04-13T10:58:48.963 INFO:tasks.workunit.client.1.smithi194.stdout:4/981: creat d2/d30/d50/d11a/d1c/d54/d62/d9e/f153 x:0 0 0 2024-04-13T10:58:48.966 INFO:tasks.workunit.client.1.smithi194.stdout:4/982: unlink d2/d30/d50/d11a/d60/d107/d10f/fc6 0 2024-04-13T10:58:48.968 INFO:tasks.workunit.client.1.smithi194.stdout:3/820: write d2/dce/ddc/fe9 [1251402,45130] 0 2024-04-13T10:58:48.976 INFO:tasks.workunit.client.1.smithi194.stdout:0/911: dwrite d9/db/d3a/d9a/dd7/f48 [0,4194304] 0 2024-04-13T10:58:48.977 INFO:tasks.workunit.client.1.smithi194.stdout:3/821: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/f114 x:0 0 0 2024-04-13T10:58:48.980 INFO:tasks.workunit.client.1.smithi194.stdout:4/983: dwrite d2/d30/d50/d11a/d1c/d3e/f67 [0,4194304] 0 2024-04-13T10:58:48.981 INFO:tasks.workunit.client.1.smithi194.stdout:9/919: dwrite d0/d6/d14/dcd/f77 [0,4194304] 0 2024-04-13T10:58:48.983 INFO:tasks.workunit.client.1.smithi194.stdout:0/912: mkdir d9/d2b/d6c/d126 0 2024-04-13T10:58:48.984 INFO:tasks.workunit.client.1.smithi194.stdout:0/913: dread - d9/d2b/d6c/ddf/d63/fcc zero size 2024-04-13T10:58:48.986 INFO:tasks.workunit.client.1.smithi194.stdout:3/822: rmdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67 39 2024-04-13T10:58:48.986 INFO:tasks.workunit.client.1.smithi194.stdout:9/920: symlink d0/d88/l13a 0 2024-04-13T10:58:48.989 INFO:tasks.workunit.client.1.smithi194.stdout:4/984: rename d2/d30/l4f to d2/d16/dd2/d11f/d99/dd0/l154 0 2024-04-13T10:58:48.993 INFO:tasks.workunit.client.1.smithi194.stdout:4/985: write d2/d16/dd2/d11f/d99/f131 [450021,35897] 0 2024-04-13T10:58:48.993 INFO:tasks.workunit.client.1.smithi194.stdout:2/950: sync 2024-04-13T10:58:48.997 INFO:tasks.workunit.client.1.smithi194.stdout:2/951: stat d2/d3/de/d17/d39/ce7 0 2024-04-13T10:58:48.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:48 smithi194 ceph-mon[46737]: pgmap v28: 65 pgs: 65 active+clean; 1.5 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 60 MiB/s rd, 183 MiB/s wr, 353 op/s 2024-04-13T10:58:49.001 INFO:tasks.workunit.client.1.smithi194.stdout:0/914: dwrite d9/db/f1b [0,4194304] 0 2024-04-13T10:58:49.003 INFO:tasks.workunit.client.1.smithi194.stdout:9/921: dwrite d0/d11/d3d/fbf [0,4194304] 0 2024-04-13T10:58:49.003 INFO:tasks.workunit.client.1.smithi194.stdout:3/823: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/fc0 [4194304,4194304] 0 2024-04-13T10:58:49.010 INFO:tasks.workunit.client.1.smithi194.stdout:0/915: creat d9/db/d3a/d9a/f127 x:0 0 0 2024-04-13T10:58:49.012 INFO:tasks.workunit.client.1.smithi194.stdout:3/824: dread - d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95/ffe zero size 2024-04-13T10:58:49.013 INFO:tasks.workunit.client.1.smithi194.stdout:3/825: chown d2/d3 5298782 1 2024-04-13T10:58:49.013 INFO:tasks.workunit.client.1.smithi194.stdout:2/952: dwrite d2/d3/de/d17/d36/d3d/fe6 [0,4194304] 0 2024-04-13T10:58:49.018 INFO:tasks.workunit.client.1.smithi194.stdout:4/986: link d2/d30/d50/d11a/d1c/d3b/d8d/d12e/d98/f95 d2/d30/d50/d11a/d1c/d3b/d42/f155 0 2024-04-13T10:58:49.019 INFO:tasks.workunit.client.1.smithi194.stdout:2/953: symlink d2/d3/de/d17/d39/dcc/l141 0 2024-04-13T10:58:49.020 INFO:tasks.workunit.client.1.smithi194.stdout:2/954: readlink d2/d3/l15 0 2024-04-13T10:58:49.020 INFO:tasks.workunit.client.1.smithi194.stdout:3/826: symlink d2/d3/d12/d31/d34/d88/d24/d82/l115 0 2024-04-13T10:58:49.022 INFO:tasks.workunit.client.1.smithi194.stdout:0/916: dread d9/d2b/f3e [0,4194304] 0 2024-04-13T10:58:49.023 INFO:tasks.workunit.client.1.smithi194.stdout:2/955: write d2/d3/de/d33/d47/dbb/d5a/fb8 [4321398,87218] 0 2024-04-13T10:58:49.026 INFO:tasks.workunit.client.1.smithi194.stdout:3/827: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/f116 x:0 0 0 2024-04-13T10:58:49.027 INFO:tasks.workunit.client.1.smithi194.stdout:4/987: dwrite d2/d30/d50/d11a/d1c/d3e/dbb/fbc [0,4194304] 0 2024-04-13T10:58:49.028 INFO:tasks.workunit.client.1.smithi194.stdout:0/917: getdents d9/d2b/d6c/ddf/d16/d77 0 2024-04-13T10:58:49.030 INFO:tasks.workunit.client.1.smithi194.stdout:2/956: rename d2/d3/de/d17/d36/d65/c72 to d2/d3/de/d17/d39/c142 0 2024-04-13T10:58:49.030 INFO:tasks.workunit.client.1.smithi194.stdout:3/828: mknod d2/d3/d12/d31/d34/d88/d24/d6c/dc2/c117 0 2024-04-13T10:58:49.032 INFO:tasks.workunit.client.1.smithi194.stdout:4/988: dread - d2/d30/d50/d11a/d1c/d3b/d8d/d12e/d98/ff1 zero size 2024-04-13T10:58:49.032 INFO:tasks.workunit.client.1.smithi194.stdout:2/957: write d2/d3/f4a [1803304,87572] 0 2024-04-13T10:58:49.032 INFO:tasks.workunit.client.1.smithi194.stdout:3/829: stat d2/dce/f110 0 2024-04-13T10:58:49.038 INFO:tasks.workunit.client.1.smithi194.stdout:3/830: dread d2/d3/f43 [0,4194304] 0 2024-04-13T10:58:49.038 INFO:tasks.workunit.client.1.smithi194.stdout:0/918: dwrite d9/d9f/f108 [0,4194304] 0 2024-04-13T10:58:49.039 INFO:tasks.workunit.client.1.smithi194.stdout:4/989: truncate d2/d30/d50/d11a/d1c/d54/d62/d10d/fc9 663209 0 2024-04-13T10:58:49.040 INFO:tasks.workunit.client.1.smithi194.stdout:2/958: link d2/d3/d12/f102 d2/d3/de/d17/d36/d8f/dcd/f143 0 2024-04-13T10:58:49.042 INFO:tasks.workunit.client.1.smithi194.stdout:0/919: unlink d9/db1/d30/d73/fba 0 2024-04-13T10:58:49.043 INFO:tasks.workunit.client.1.smithi194.stdout:0/920: chown d9/d2b/c11a 1012296510 1 2024-04-13T10:58:49.044 INFO:tasks.workunit.client.1.smithi194.stdout:2/959: rename d2/d3/de/dee/f13a to d2/d3/d12/dba/f144 0 2024-04-13T10:58:49.047 INFO:tasks.workunit.client.1.smithi194.stdout:0/921: rmdir d9/db1/d30/d73/d87 39 2024-04-13T10:58:49.096 INFO:tasks.workunit.client.1.smithi194.stdout:4/990: getdents d2/d30/d50/d11a/d1c/d54/d62 0 2024-04-13T10:58:49.097 INFO:tasks.workunit.client.1.smithi194.stdout:4/991: write d2/d16/dd2/d11f/d99/f131 [288626,27795] 0 2024-04-13T10:58:49.098 INFO:tasks.workunit.client.1.smithi194.stdout:0/922: unlink d9/d2b/d6c/ddf/d16/d83/fcd 0 2024-04-13T10:58:49.099 INFO:tasks.workunit.client.1.smithi194.stdout:0/923: fsync d9/d2b/d6c/ddf/f14 0 2024-04-13T10:58:49.099 INFO:tasks.workunit.client.1.smithi194.stdout:2/960: creat d2/d3/d6d/f145 x:0 0 0 2024-04-13T10:58:49.101 INFO:tasks.workunit.client.1.smithi194.stdout:4/992: creat d2/d30/d50/d11a/d1c/d3b/d42/f156 x:0 0 0 2024-04-13T10:58:49.104 INFO:tasks.workunit.client.1.smithi194.stdout:4/993: dread d2/d16/dd2/fea [0,4194304] 0 2024-04-13T10:58:49.105 INFO:tasks.workunit.client.1.smithi194.stdout:2/961: creat d2/d3/de/d90/f146 x:0 0 0 2024-04-13T10:58:49.110 INFO:tasks.workunit.client.1.smithi194.stdout:2/962: getdents d2/d3/de/d17 0 2024-04-13T10:58:49.111 INFO:tasks.workunit.client.1.smithi194.stdout:0/924: truncate d9/db1/f90 2956833 0 2024-04-13T10:58:49.112 INFO:tasks.workunit.client.1.smithi194.stdout:4/994: write d2/d30/f49 [51916,11861] 0 2024-04-13T10:58:49.113 INFO:tasks.workunit.client.1.smithi194.stdout:2/963: truncate d2/d3/de/d17/d36/ff2 136629 0 2024-04-13T10:58:49.113 INFO:tasks.workunit.client.1.smithi194.stdout:0/925: chown d9/db/d3a/d9a/dd7/f53 1547 1 2024-04-13T10:58:49.113 INFO:tasks.workunit.client.1.smithi194.stdout:0/926: fdatasync d9/d9f/f108 0 2024-04-13T10:58:49.114 INFO:tasks.workunit.client.1.smithi194.stdout:4/995: mkdir d2/d30/d50/d11a/d1c/d157 0 2024-04-13T10:58:49.115 INFO:tasks.workunit.client.1.smithi194.stdout:2/964: mkdir d2/d3/de/d33/d71/ddb/d147 0 2024-04-13T10:58:49.116 INFO:tasks.workunit.client.1.smithi194.stdout:0/927: symlink d9/d2b/d6c/ddf/d16/d83/dae/l128 0 2024-04-13T10:58:49.118 INFO:tasks.workunit.client.1.smithi194.stdout:0/928: write d9/d6f/f11f [3821995,48205] 0 2024-04-13T10:58:49.118 INFO:tasks.workunit.client.1.smithi194.stdout:2/965: truncate d2/d3/de/d33/d71/ddb/ffd 242491 0 2024-04-13T10:58:49.121 INFO:tasks.workunit.client.1.smithi194.stdout:0/929: symlink d9/d2b/dbd/l129 0 2024-04-13T10:58:49.122 INFO:tasks.workunit.client.1.smithi194.stdout:2/966: truncate d2/d3/de/d17/d36/d8f/d57/f69 5173771 0 2024-04-13T10:58:49.122 INFO:tasks.workunit.client.1.smithi194.stdout:0/930: symlink d9/db1/l12a 0 2024-04-13T10:58:49.123 INFO:tasks.workunit.client.1.smithi194.stdout:4/996: dwrite d2/d30/d50/d11a/d60/d107/d10f/fb8 [0,4194304] 0 2024-04-13T10:58:49.124 INFO:tasks.workunit.client.1.smithi194.stdout:0/931: fsync d9/d2b/d6c/ddf/d16/d83/f10d 0 2024-04-13T10:58:49.125 INFO:tasks.workunit.client.1.smithi194.stdout:6/916: sync 2024-04-13T10:58:49.127 INFO:tasks.workunit.client.1.smithi194.stdout:4/997: unlink d2/d30/d50/d11a/d1c/d3b/d42/le2 0 2024-04-13T10:58:49.127 INFO:tasks.workunit.client.1.smithi194.stdout:6/917: dread - d0/d42/dbe/ffa zero size 2024-04-13T10:58:49.127 INFO:tasks.workunit.client.1.smithi194.stdout:0/932: write d9/d2b/d6c/ddf/d16/d75/dd3/f107 [66424,110045] 0 2024-04-13T10:58:49.130 INFO:tasks.workunit.client.1.smithi194.stdout:6/918: write d0/d42/d7b/fe5 [3674240,54688] 0 2024-04-13T10:58:49.131 INFO:tasks.workunit.client.1.smithi194.stdout:2/967: dwrite d2/d3/de/d33/d47/dbb/fa8 [0,4194304] 0 2024-04-13T10:58:49.133 INFO:tasks.workunit.client.1.smithi194.stdout:6/919: stat d0/d2c/d77/d93/d98/c119 0 2024-04-13T10:58:49.135 INFO:tasks.workunit.client.1.smithi194.stdout:0/933: rename d9/l43 to d9/d2b/d6c/ddf/l12b 0 2024-04-13T10:58:49.142 INFO:tasks.workunit.client.1.smithi194.stdout:4/998: rename d2/d30/d50/d11a/d1c/d3b/l3d to d2/d30/d50/d11a/d1c/d3b/d42/l158 0 2024-04-13T10:58:49.144 INFO:tasks.workunit.client.1.smithi194.stdout:6/920: dwrite d0/d2c/d77/d93/d98/f108 [0,4194304] 0 2024-04-13T10:58:49.144 INFO:tasks.workunit.client.1.smithi194.stdout:2/968: write d2/d3/de/d33/d71/fa5 [4543176,43765] 0 2024-04-13T10:58:49.146 INFO:tasks.workunit.client.1.smithi194.stdout:2/969: fdatasync d2/d3/de/d33/d71/ddc/f11d 0 2024-04-13T10:58:49.151 INFO:tasks.workunit.client.1.smithi194.stdout:4/999: truncate d2/d30/d50/d11a/d1c/d3b/fe9 1295508 0 2024-04-13T10:58:49.153 INFO:tasks.workunit.client.1.smithi194.stdout:2/970: dwrite d2/d3/de/d17/d36/d3d/fe6 [0,4194304] 0 2024-04-13T10:58:49.156 INFO:tasks.workunit.client.1.smithi194.stdout:0/934: truncate d9/db1/fa2 1480985 0 2024-04-13T10:58:49.158 INFO:tasks.workunit.client.1.smithi194.stdout:2/971: mkdir d2/d3/de/d17/d36/d8f/de3/d148 0 2024-04-13T10:58:49.159 INFO:tasks.workunit.client.1.smithi194.stdout:7/951: sync 2024-04-13T10:58:49.159 INFO:tasks.workunit.client.1.smithi194.stdout:1/867: sync 2024-04-13T10:58:49.159 INFO:tasks.workunit.client.1.smithi194.stdout:9/922: sync 2024-04-13T10:58:49.160 INFO:tasks.workunit.client.1.smithi194.stdout:0/935: dread d9/db/d3a/d9a/dd7/f53 [0,4194304] 0 2024-04-13T10:58:49.161 INFO:tasks.workunit.client.1.smithi194.stdout:2/972: fsync d2/d3/de/d33/d47/fd0 0 2024-04-13T10:58:49.163 INFO:tasks.workunit.client.1.smithi194.stdout:9/923: creat d0/dfe/d128/f13b x:0 0 0 2024-04-13T10:58:49.164 INFO:tasks.workunit.client.1.smithi194.stdout:0/936: creat d9/d2b/dbd/f12c x:0 0 0 2024-04-13T10:58:49.165 INFO:tasks.workunit.client.1.smithi194.stdout:6/921: dwrite d0/d2c/f6e [0,4194304] 0 2024-04-13T10:58:49.165 INFO:tasks.workunit.client.1.smithi194.stdout:9/924: stat d0/d6/d4a/d74/dae/faf 0 2024-04-13T10:58:49.167 INFO:tasks.workunit.client.1.smithi194.stdout:1/868: creat d12/d13/d1c/d28/df2/d8b/dbb/f11c x:0 0 0 2024-04-13T10:58:49.170 INFO:tasks.workunit.client.1.smithi194.stdout:6/922: creat d0/d57/d115/f12e x:0 0 0 2024-04-13T10:58:49.171 INFO:tasks.workunit.client.1.smithi194.stdout:2/973: rename d2/d3/de/d17/d1e/d42/d86 to d2/d3/de/d17/d36/d8f/dcd/d149 0 2024-04-13T10:58:49.174 INFO:tasks.workunit.client.1.smithi194.stdout:0/937: dread d9/db1/d30/d73/d87/ddc/ff2 [0,4194304] 0 2024-04-13T10:58:49.176 INFO:tasks.workunit.client.1.smithi194.stdout:6/923: symlink d0/d2f/d48/l12f 0 2024-04-13T10:58:49.176 INFO:tasks.workunit.client.1.smithi194.stdout:9/925: dwrite d0/d6/d14/d26/d3b/fa2 [0,4194304] 0 2024-04-13T10:58:49.176 INFO:tasks.workunit.client.1.smithi194.stdout:2/974: truncate d2/d3/de/d17/d1e/f13c 493422 0 2024-04-13T10:58:49.177 INFO:tasks.workunit.client.1.smithi194.stdout:7/952: write d1/dd9/de1/dab/d96/f9e [213633,87002] 0 2024-04-13T10:58:49.178 INFO:tasks.workunit.client.1.smithi194.stdout:9/926: chown d0/d6/d4a/d74 1937 1 2024-04-13T10:58:49.178 INFO:tasks.workunit.client.1.smithi194.stdout:2/975: chown d2/d3/de/d33/d105 14055801 1 2024-04-13T10:58:49.179 INFO:tasks.workunit.client.1.smithi194.stdout:1/869: creat d12/d13/d1c/d28/d41/f11d x:0 0 0 2024-04-13T10:58:49.181 INFO:tasks.workunit.client.1.smithi194.stdout:6/924: unlink d0/d42/dbe/d4d/cd9 0 2024-04-13T10:58:49.181 INFO:tasks.workunit.client.1.smithi194.stdout:6/925: fsync d0/d2c/d77/d93/d98/ff3 0 2024-04-13T10:58:49.181 INFO:tasks.workunit.client.1.smithi194.stdout:9/927: mkdir d0/dde/d13c 0 2024-04-13T10:58:49.182 INFO:tasks.workunit.client.1.smithi194.stdout:9/928: fsync d0/d6/d4a/d74/dae/faf 0 2024-04-13T10:58:49.183 INFO:tasks.workunit.client.1.smithi194.stdout:9/929: chown d0/d6/d2c/d68/f71 4 1 2024-04-13T10:58:49.185 INFO:tasks.workunit.client.1.smithi194.stdout:7/953: fsync d1/d2b/d2c/d30/d33/fbd 0 2024-04-13T10:58:49.186 INFO:tasks.workunit.client.1.smithi194.stdout:2/976: creat d2/d3/f14a x:0 0 0 2024-04-13T10:58:49.186 INFO:tasks.workunit.client.1.smithi194.stdout:7/954: readlink d1/d2b/d4c/d4f/d85/lb2 0 2024-04-13T10:58:49.187 INFO:tasks.workunit.client.1.smithi194.stdout:2/977: fsync d2/d3/de/d3c/f100 0 2024-04-13T10:58:49.209 INFO:tasks.workunit.client.1.smithi194.stdout:7/955: readlink d1/d2b/l36 0 2024-04-13T10:58:49.209 INFO:tasks.workunit.client.1.smithi194.stdout:0/938: getdents d9/d2b/d6c/ddf/d16/d83 0 2024-04-13T10:58:49.211 INFO:tasks.workunit.client.1.smithi194.stdout:9/930: creat d0/d6/d4a/f13d x:0 0 0 2024-04-13T10:58:49.213 INFO:tasks.workunit.client.1.smithi194.stdout:0/939: chown d9/d2b/d6c/ddf/d16/c42 6158618 1 2024-04-13T10:58:49.214 INFO:tasks.workunit.client.1.smithi194.stdout:7/956: creat d1/d2b/d4c/d4f/d85/d136/f13a x:0 0 0 2024-04-13T10:58:49.215 INFO:tasks.workunit.client.1.smithi194.stdout:2/978: dwrite d2/d3/de/d17/d36/ff2 [0,4194304] 0 2024-04-13T10:58:49.215 INFO:tasks.workunit.client.1.smithi194.stdout:9/931: rmdir d0/d6/d14/dcd/dd6 39 2024-04-13T10:58:49.219 INFO:tasks.workunit.client.1.smithi194.stdout:0/940: chown d9/d2b/d6c/ddf/d16/d65/f79 1568665 1 2024-04-13T10:58:49.220 INFO:tasks.workunit.client.1.smithi194.stdout:1/870: dwrite d12/d3a/d4f/da3/d107/d10f/fab [0,4194304] 0 2024-04-13T10:58:49.220 INFO:tasks.workunit.client.1.smithi194.stdout:7/957: mknod d1/d2b/d3e/ddf/d5a/d3c/c13b 0 2024-04-13T10:58:49.221 INFO:tasks.workunit.client.1.smithi194.stdout:0/941: stat d9/d6f/f81 0 2024-04-13T10:58:49.222 INFO:tasks.workunit.client.1.smithi194.stdout:9/932: fdatasync d0/d6/d14/dcd/da4/de0/fea 0 2024-04-13T10:58:49.224 INFO:tasks.workunit.client.1.smithi194.stdout:0/942: dread - d9/d2b/d6c/ddf/d16/f27 zero size 2024-04-13T10:58:49.226 INFO:tasks.workunit.client.1.smithi194.stdout:9/933: unlink d0/d6/d14/dcd/c11c 0 2024-04-13T10:58:49.229 INFO:tasks.workunit.client.1.smithi194.stdout:0/943: mkdir d9/db/d6b/df7/d12d 0 2024-04-13T10:58:49.230 INFO:tasks.workunit.client.1.smithi194.stdout:7/958: creat d1/d2b/d4c/d4f/d85/f13c x:0 0 0 2024-04-13T10:58:49.231 INFO:tasks.workunit.client.1.smithi194.stdout:7/959: write d1/dd9/de1/f10b [2271997,115887] 0 2024-04-13T10:58:49.233 INFO:tasks.workunit.client.1.smithi194.stdout:9/934: dread d0/d88/fb0 [0,4194304] 0 2024-04-13T10:58:49.234 INFO:tasks.workunit.client.1.smithi194.stdout:0/944: rename d9/d2b/d6c/ddf/d16 to d9/d2b/dbd/d12e 0 2024-04-13T10:58:49.235 INFO:tasks.workunit.client.1.smithi194.stdout:9/935: write d0/d6/d14/d26/d3b/faa [4147115,69583] 0 2024-04-13T10:58:49.236 INFO:tasks.workunit.client.1.smithi194.stdout:9/936: chown d0/d6/d2c/c11d 4157717 1 2024-04-13T10:58:49.236 INFO:tasks.workunit.client.1.smithi194.stdout:7/960: creat d1/d2b/d4c/d4f/d85/d136/f13d x:0 0 0 2024-04-13T10:58:49.237 INFO:tasks.workunit.client.1.smithi194.stdout:0/945: read d9/d2b/dbd/d12e/d75/dd3/f118 [3454217,109228] 0 2024-04-13T10:58:49.239 INFO:tasks.workunit.client.1.smithi194.stdout:7/961: chown d1/l26 1 1 2024-04-13T10:58:49.240 INFO:tasks.workunit.client.1.smithi194.stdout:9/937: creat d0/d6/d4a/d74/f13e x:0 0 0 2024-04-13T10:58:49.243 INFO:tasks.workunit.client.1.smithi194.stdout:2/979: dread d2/d37/fdd [0,4194304] 0 2024-04-13T10:58:49.245 INFO:tasks.workunit.client.1.smithi194.stdout:9/938: creat d0/dde/d10e/f13f x:0 0 0 2024-04-13T10:58:49.245 INFO:tasks.workunit.client.1.smithi194.stdout:2/980: dread - d2/d3/de/d17/d36/d8f/f12a zero size 2024-04-13T10:58:49.245 INFO:tasks.workunit.client.1.smithi194.stdout:0/946: write d9/d2b/d6c/ddf/f23 [1300781,90965] 0 2024-04-13T10:58:49.246 INFO:tasks.workunit.client.1.smithi194.stdout:9/939: readlink d0/d6/d14/l4e 0 2024-04-13T10:58:49.247 INFO:tasks.workunit.client.1.smithi194.stdout:2/981: creat d2/d3/f14b x:0 0 0 2024-04-13T10:58:49.248 INFO:tasks.workunit.client.1.smithi194.stdout:9/940: write d0/d6/d9/f48 [2396365,12553] 0 2024-04-13T10:58:49.249 INFO:tasks.workunit.client.1.smithi194.stdout:0/947: rename d9/d2b/dbd/d12e/c71 to d9/d9f/c12f 0 2024-04-13T10:58:49.250 INFO:tasks.workunit.client.1.smithi194.stdout:2/982: mkdir d2/d3/de/d17/d36/d65/d14c 0 2024-04-13T10:58:49.250 INFO:tasks.workunit.client.1.smithi194.stdout:2/983: chown d2/d3/d6d/f125 3799433 1 2024-04-13T10:58:49.251 INFO:tasks.workunit.client.1.smithi194.stdout:0/948: creat d9/d2b/d6c/f130 x:0 0 0 2024-04-13T10:58:49.251 INFO:tasks.workunit.client.1.smithi194.stdout:7/962: dread d1/d2b/fb6 [4194304,4194304] 0 2024-04-13T10:58:49.252 INFO:tasks.workunit.client.1.smithi194.stdout:2/984: chown d2/d3/de/d17/d1e/fc7 36 1 2024-04-13T10:58:49.253 INFO:tasks.workunit.client.1.smithi194.stdout:7/963: creat d1/d8b/f13e x:0 0 0 2024-04-13T10:58:49.254 INFO:tasks.workunit.client.1.smithi194.stdout:2/985: creat d2/d3/de/d33/d71/ddb/d147/f14d x:0 0 0 2024-04-13T10:58:49.255 INFO:tasks.workunit.client.1.smithi194.stdout:0/949: rmdir d9/d2b/dbd 39 2024-04-13T10:58:49.256 INFO:tasks.workunit.client.1.smithi194.stdout:2/986: chown d2/d3/de/d33/d71/l98 26696 1 2024-04-13T10:58:49.258 INFO:tasks.workunit.client.1.smithi194.stdout:0/950: creat d9/db/d3a/f131 x:0 0 0 2024-04-13T10:58:49.259 INFO:tasks.workunit.client.1.smithi194.stdout:2/987: symlink d2/d3/d6d/l14e 0 2024-04-13T10:58:49.260 INFO:tasks.workunit.client.1.smithi194.stdout:7/964: dwrite d1/d2b/d2c/d30/d33/fbd [0,4194304] 0 2024-04-13T10:58:49.262 INFO:tasks.workunit.client.1.smithi194.stdout:2/988: read d2/d3/de/f16 [1067537,50550] 0 2024-04-13T10:58:49.264 INFO:tasks.workunit.client.1.smithi194.stdout:0/951: creat d9/db1/d30/d73/f132 x:0 0 0 2024-04-13T10:58:49.264 INFO:tasks.workunit.client.1.smithi194.stdout:7/965: creat d1/d6c/d137/dba/d10e/f13f x:0 0 0 2024-04-13T10:58:49.265 INFO:tasks.workunit.client.1.smithi194.stdout:0/952: chown d9/d2b/f8b 22 1 2024-04-13T10:58:49.268 INFO:tasks.workunit.client.1.smithi194.stdout:2/989: rename d2/d3/de/d17/d39/c10c to d2/d3/de/d90/c14f 0 2024-04-13T10:58:49.270 INFO:tasks.workunit.client.1.smithi194.stdout:2/990: read d2/d3/de/d17/d1e/f13c [389010,4818] 0 2024-04-13T10:58:49.271 INFO:tasks.workunit.client.1.smithi194.stdout:7/966: rename d1/d2b/d4c/d4f/d51/d4d/d5e/f126 to d1/d2b/d4c/d4f/d85/dbc/f140 0 2024-04-13T10:58:49.273 INFO:tasks.workunit.client.1.smithi194.stdout:0/953: dwrite d9/db1/d30/d73/d87/fee [0,4194304] 0 2024-04-13T10:58:49.274 INFO:tasks.workunit.client.1.smithi194.stdout:7/967: fdatasync d1/d2b/fb6 0 2024-04-13T10:58:49.276 INFO:tasks.workunit.client.1.smithi194.stdout:3/831: sync 2024-04-13T10:58:49.277 INFO:tasks.workunit.client.1.smithi194.stdout:0/954: chown d9/d2b/dbd/d12e/d70/f9d 2158 1 2024-04-13T10:58:49.279 INFO:tasks.workunit.client.1.smithi194.stdout:7/968: creat d1/d2b/d4c/d4f/d51/d4d/d5e/d5f/f141 x:0 0 0 2024-04-13T10:58:49.279 INFO:tasks.workunit.client.1.smithi194.stdout:0/955: read - d9/db1/d30/d73/f132 zero size 2024-04-13T10:58:49.281 INFO:tasks.workunit.client.1.smithi194.stdout:2/991: dwrite d2/d3/de/d33/d71/ddc/f137 [4194304,4194304] 0 2024-04-13T10:58:49.287 INFO:tasks.workunit.client.1.smithi194.stdout:3/832: rename d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/fd6 to d2/f118 0 2024-04-13T10:58:49.289 INFO:tasks.workunit.client.1.smithi194.stdout:3/833: read - d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/f116 zero size 2024-04-13T10:58:49.290 INFO:tasks.workunit.client.1.smithi194.stdout:2/992: link d2/d3/de/d3c/l118 d2/d3/de/d17/d36/d8f/de3/d148/l150 0 2024-04-13T10:58:49.292 INFO:tasks.workunit.client.1.smithi194.stdout:2/993: dread d2/d3/de/d90/fb4 [0,4194304] 0 2024-04-13T10:58:49.294 INFO:tasks.workunit.client.1.smithi194.stdout:2/994: mknod d2/d3/de/c151 0 2024-04-13T10:58:49.295 INFO:tasks.workunit.client.1.smithi194.stdout:2/995: fsync d2/d3/de/d33/d71/ddb/ffd 0 2024-04-13T10:58:49.300 INFO:tasks.workunit.client.1.smithi194.stdout:7/969: truncate d1/d6c/d137/dba/d10e/f12b 908438 0 2024-04-13T10:58:49.303 INFO:tasks.workunit.client.1.smithi194.stdout:0/956: truncate d9/db1/d30/d73/fc2 931302 0 2024-04-13T10:58:49.346 INFO:tasks.workunit.client.1.smithi194.stdout:0/957: creat d9/d2b/dbd/d12e/f133 x:0 0 0 2024-04-13T10:58:49.349 INFO:tasks.workunit.client.1.smithi194.stdout:2/996: dwrite d2/d3/de/f1a [4194304,4194304] 0 2024-04-13T10:58:49.349 INFO:tasks.workunit.client.1.smithi194.stdout:0/958: mkdir d9/d2b/dbd/d12e/d77/d134 0 2024-04-13T10:58:49.353 INFO:tasks.workunit.client.1.smithi194.stdout:2/997: rename d2/d3/de/d17/d36/d65 to d2/d3/de/d17/d36/d8f/de3/d152 0 2024-04-13T10:58:49.358 INFO:tasks.workunit.client.1.smithi194.stdout:0/959: dwrite d9/d2b/d6c/ddf/d63/f80 [0,4194304] 0 2024-04-13T10:58:49.359 INFO:tasks.workunit.client.1.smithi194.stdout:2/998: unlink d2/d3/de/d90/ff6 0 2024-04-13T10:58:49.369 INFO:tasks.workunit.client.1.smithi194.stdout:7/970: dread d1/d2b/d4c/d4f/d85/d88/d9b/db8/fc3 [0,4194304] 0 2024-04-13T10:58:49.374 INFO:tasks.workunit.client.1.smithi194.stdout:7/971: read d1/d2b/d4c/d4f/d51/d4d/d5e/fc7 [1355743,114218] 0 2024-04-13T10:58:49.376 INFO:tasks.workunit.client.1.smithi194.stdout:0/960: write d9/db1/f90 [159061,76420] 0 2024-04-13T10:58:49.378 INFO:tasks.workunit.client.1.smithi194.stdout:6/926: sync 2024-04-13T10:58:49.379 INFO:tasks.workunit.client.1.smithi194.stdout:7/972: symlink d1/d2b/d4c/d4f/d85/d88/d9b/db8/dc8/l142 0 2024-04-13T10:58:49.380 INFO:tasks.workunit.client.1.smithi194.stdout:0/961: write d9/d2b/dbd/d12e/d75/dd3/f118 [2398382,117307] 0 2024-04-13T10:58:49.380 INFO:tasks.workunit.client.1.smithi194.stdout:6/927: fsync d0/d42/dbe/f58 0 2024-04-13T10:58:49.382 INFO:tasks.workunit.client.1.smithi194.stdout:2/999: dwrite d2/d3/de/d17/f8b [0,4194304] 0 2024-04-13T10:58:49.383 INFO:tasks.workunit.client.1.smithi194.stdout:0/962: chown d9/d2b/d6c/faf 27645 1 2024-04-13T10:58:49.383 INFO:tasks.workunit.client.1.smithi194.stdout:7/973: truncate d1/d6c/f77 213942 0 2024-04-13T10:58:49.387 INFO:tasks.workunit.client.1.smithi194.stdout:6/928: rename d0/d2c/d77/d93/dea to d0/d42/d7b/d130 0 2024-04-13T10:58:49.388 INFO:tasks.workunit.client.1.smithi194.stdout:7/974: mkdir d1/d2b/d3e/d9c/dc5/d108/d143 0 2024-04-13T10:58:49.391 INFO:tasks.workunit.client.1.smithi194.stdout:6/929: mknod d0/d2c/d77/d93/daa/d116/c131 0 2024-04-13T10:58:49.392 INFO:tasks.workunit.client.1.smithi194.stdout:0/963: dwrite d9/db1/d30/d73/d87/ddc/fe1 [0,4194304] 0 2024-04-13T10:58:49.393 INFO:tasks.workunit.client.1.smithi194.stdout:7/975: creat d1/d2b/d4c/d4f/d85/d88/f144 x:0 0 0 2024-04-13T10:58:49.394 INFO:tasks.workunit.client.1.smithi194.stdout:0/964: write d9/d2b/d6c/ddf/f4c [91899,97430] 0 2024-04-13T10:58:49.399 INFO:tasks.workunit.client.1.smithi194.stdout:0/965: read d9/d2b/d5a/f5b [482500,42171] 0 2024-04-13T10:58:49.399 INFO:tasks.workunit.client.1.smithi194.stdout:6/930: dwrite d0/d53/f55 [0,4194304] 0 2024-04-13T10:58:49.400 INFO:tasks.workunit.client.1.smithi194.stdout:7/976: write d1/fa [2569393,74820] 0 2024-04-13T10:58:49.402 INFO:tasks.workunit.client.1.smithi194.stdout:0/966: mkdir d9/db1/d30/d73/d135 0 2024-04-13T10:58:49.405 INFO:tasks.workunit.client.1.smithi194.stdout:7/977: unlink d1/d2b/fb6 0 2024-04-13T10:58:49.406 INFO:tasks.workunit.client.1.smithi194.stdout:0/967: mknod d9/db1/d30/c136 0 2024-04-13T10:58:49.408 INFO:tasks.workunit.client.1.smithi194.stdout:6/931: getdents d0/d2c/d77 0 2024-04-13T10:58:49.410 INFO:tasks.workunit.client.1.smithi194.stdout:0/968: mkdir d9/db1/d30/d137 0 2024-04-13T10:58:49.411 INFO:tasks.workunit.client.1.smithi194.stdout:7/978: dwrite d1/d2b/d4c/d4f/f5c [4194304,4194304] 0 2024-04-13T10:58:49.418 INFO:tasks.workunit.client.1.smithi194.stdout:7/979: rmdir d1/d2b/d4c/d4f/d51/d4d/d5e 39 2024-04-13T10:58:49.419 INFO:tasks.workunit.client.1.smithi194.stdout:1/871: sync 2024-04-13T10:58:49.419 INFO:tasks.workunit.client.1.smithi194.stdout:9/941: sync 2024-04-13T10:58:49.420 INFO:tasks.workunit.client.1.smithi194.stdout:7/980: mknod d1/d2b/d4c/d4f/d85/d88/d9b/c145 0 2024-04-13T10:58:49.423 INFO:tasks.workunit.client.1.smithi194.stdout:7/981: mknod d1/dd9/de1/c146 0 2024-04-13T10:58:49.425 INFO:tasks.workunit.client.1.smithi194.stdout:0/969: truncate d9/db/d3a/d9a/dd7/f17 6444616 0 2024-04-13T10:58:49.427 INFO:tasks.workunit.client.1.smithi194.stdout:1/872: dwrite d12/d13/d1c/d27/d5c/f114 [0,4194304] 0 2024-04-13T10:58:49.429 INFO:tasks.workunit.client.1.smithi194.stdout:9/942: link d0/f4d d0/d6/d14/dcd/f140 0 2024-04-13T10:58:49.431 INFO:tasks.workunit.client.1.smithi194.stdout:7/982: unlink d1/d2b/d2c/d30/d33/cd3 0 2024-04-13T10:58:49.432 INFO:tasks.workunit.client.1.smithi194.stdout:6/932: dwrite d0/d2c/d77/f8c [0,4194304] 0 2024-04-13T10:58:49.433 INFO:tasks.workunit.client.1.smithi194.stdout:0/970: creat d9/db/d3a/d9a/dd7/f138 x:0 0 0 2024-04-13T10:58:49.434 INFO:tasks.workunit.client.1.smithi194.stdout:7/983: write d1/dd9/de1/dab/d96/d10c/f134 [1028721,119891] 0 2024-04-13T10:58:49.434 INFO:tasks.workunit.client.1.smithi194.stdout:9/943: symlink d0/d6/d14/d26/d42/l141 0 2024-04-13T10:58:49.437 INFO:tasks.workunit.client.1.smithi194.stdout:0/971: write d9/d2b/dbd/d12e/d75/dd3/f118 [2441087,44076] 0 2024-04-13T10:58:49.439 INFO:tasks.workunit.client.1.smithi194.stdout:6/933: rmdir d0/d53/d78/d91 39 2024-04-13T10:58:49.440 INFO:tasks.workunit.client.1.smithi194.stdout:1/873: mkdir d12/d13/d1c/d28/df2/d8b/dd4/ded/d11e 0 2024-04-13T10:58:49.441 INFO:tasks.workunit.client.1.smithi194.stdout:9/944: creat d0/d11/d3d/d9b/f142 x:0 0 0 2024-04-13T10:58:49.443 INFO:tasks.workunit.client.1.smithi194.stdout:9/945: dread - d0/d6/d4a/d74/f13e zero size 2024-04-13T10:58:49.444 INFO:tasks.workunit.client.1.smithi194.stdout:1/874: dread - d12/d13/d1c/d27/d5c/db6/f11b zero size 2024-04-13T10:58:49.444 INFO:tasks.workunit.client.1.smithi194.stdout:6/934: unlink d0/d26/f29 0 2024-04-13T10:58:49.446 INFO:tasks.workunit.client.1.smithi194.stdout:0/972: dwrite d9/d2b/d6c/db2/f114 [0,4194304] 0 2024-04-13T10:58:49.447 INFO:tasks.workunit.client.1.smithi194.stdout:9/946: read d0/d6/d14/d26/d3b/f11b [3222693,117765] 0 2024-04-13T10:58:49.447 INFO:tasks.workunit.client.1.smithi194.stdout:6/935: chown d0/f73 393941715 1 2024-04-13T10:58:49.448 INFO:tasks.workunit.client.1.smithi194.stdout:0/973: fdatasync d9/d9f/f108 0 2024-04-13T10:58:49.448 INFO:tasks.workunit.client.1.smithi194.stdout:9/947: write d0/d11/f1d [4399534,17044] 0 2024-04-13T10:58:49.451 INFO:tasks.workunit.client.1.smithi194.stdout:9/948: chown d0/d6/d2c/f47 1722 1 2024-04-13T10:58:49.453 INFO:tasks.workunit.client.1.smithi194.stdout:6/936: rename d0/d2f/d48/d83/fb2 to d0/d2f/d48/d83/d110/d12b/dfe/d101/f132 0 2024-04-13T10:58:49.458 INFO:tasks.workunit.client.1.smithi194.stdout:6/937: read d0/d42/f43 [181840,28954] 0 2024-04-13T10:58:49.460 INFO:tasks.workunit.client.1.smithi194.stdout:6/938: read d0/f12 [4434466,102880] 0 2024-04-13T10:58:49.460 INFO:tasks.workunit.client.1.smithi194.stdout:9/949: rmdir d0/d88/dac/d139 0 2024-04-13T10:58:49.462 INFO:tasks.workunit.client.1.smithi194.stdout:6/939: creat d0/d2c/d77/d93/f133 x:0 0 0 2024-04-13T10:58:49.463 INFO:tasks.workunit.client.1.smithi194.stdout:9/950: getdents d0/dfe/d128/d12a 0 2024-04-13T10:58:49.464 INFO:tasks.workunit.client.1.smithi194.stdout:0/974: write d9/db/d3a/d9a/dd7/f17 [4217953,77102] 0 2024-04-13T10:58:49.466 INFO:tasks.workunit.client.1.smithi194.stdout:9/951: mknod d0/dfe/d128/d12a/c143 0 2024-04-13T10:58:49.467 INFO:tasks.workunit.client.1.smithi194.stdout:7/984: dread d1/d6c/d137/dba/d10e/f11b [0,4194304] 0 2024-04-13T10:58:49.468 INFO:tasks.workunit.client.1.smithi194.stdout:9/952: readlink d0/d6/d2c/l121 0 2024-04-13T10:58:49.468 INFO:tasks.workunit.client.1.smithi194.stdout:6/940: dread d0/d42/dbe/f47 [0,4194304] 0 2024-04-13T10:58:49.469 INFO:tasks.workunit.client.1.smithi194.stdout:0/975: getdents d9/d2b/dbd/d12e/d83/dae 0 2024-04-13T10:58:49.470 INFO:tasks.workunit.client.1.smithi194.stdout:1/875: dread d12/f55 [0,4194304] 0 2024-04-13T10:58:49.470 INFO:tasks.workunit.client.1.smithi194.stdout:6/941: chown d0/d2c/d10e/f112 5 1 2024-04-13T10:58:49.471 INFO:tasks.workunit.client.1.smithi194.stdout:0/976: stat d9/db1/d30/d73/f132 0 2024-04-13T10:58:49.473 INFO:tasks.workunit.client.1.smithi194.stdout:6/942: write d0/d26/d4b/dd0/f109 [107459,126246] 0 2024-04-13T10:58:49.474 INFO:tasks.workunit.client.1.smithi194.stdout:6/943: stat d0/d42/f7d 0 2024-04-13T10:58:49.474 INFO:tasks.workunit.client.1.smithi194.stdout:0/977: creat d9/d2b/d6c/ddf/d63/def/f139 x:0 0 0 2024-04-13T10:58:49.475 INFO:tasks.workunit.client.1.smithi194.stdout:6/944: chown d0/d42/dbe/d4d/f4f 12490 1 2024-04-13T10:58:49.476 INFO:tasks.workunit.client.1.smithi194.stdout:1/876: mkdir d12/d13/d1c/d28/d41/d77/d80/d11f 0 2024-04-13T10:58:49.477 INFO:tasks.workunit.client.1.smithi194.stdout:1/877: write d12/d13/d1c/d28/d41/d77/d93/dfc/f111 [1755535,57805] 0 2024-04-13T10:58:49.478 INFO:tasks.workunit.client.1.smithi194.stdout:6/945: creat d0/d26/d4b/de6/f134 x:0 0 0 2024-04-13T10:58:49.479 INFO:tasks.workunit.client.1.smithi194.stdout:1/878: write d12/d3a/dad/fd1 [910204,20469] 0 2024-04-13T10:58:49.479 INFO:tasks.workunit.client.1.smithi194.stdout:0/978: creat d9/db/f13a x:0 0 0 2024-04-13T10:58:49.481 INFO:tasks.workunit.client.1.smithi194.stdout:6/946: mknod d0/c135 0 2024-04-13T10:58:49.484 INFO:tasks.workunit.client.1.smithi194.stdout:0/979: mkdir d9/d2b/d6c/ddf/d63/def/d13b 0 2024-04-13T10:58:49.486 INFO:tasks.workunit.client.1.smithi194.stdout:6/947: unlink d0/d2c/d77/d93/fa9 0 2024-04-13T10:58:49.487 INFO:tasks.workunit.client.1.smithi194.stdout:7/985: dwrite d1/d2b/d4c/d4f/d51/f56 [4194304,4194304] 0 2024-04-13T10:58:49.487 INFO:tasks.workunit.client.1.smithi194.stdout:0/980: truncate d9/db/f13a 23156 0 2024-04-13T10:58:49.491 INFO:tasks.workunit.client.1.smithi194.stdout:1/879: dwrite d12/d13/d3e/d108/ff5 [0,4194304] 0 2024-04-13T10:58:49.493 INFO:tasks.workunit.client.1.smithi194.stdout:9/953: dread d0/d6/d2c/d68/f71 [4194304,4194304] 0 2024-04-13T10:58:49.495 INFO:tasks.workunit.client.1.smithi194.stdout:3/834: sync 2024-04-13T10:58:49.496 INFO:tasks.workunit.client.1.smithi194.stdout:7/986: mkdir d1/d2b/d3e/ddf/d5a/d7d/d122/d12c/d147 0 2024-04-13T10:58:49.497 INFO:tasks.workunit.client.1.smithi194.stdout:1/880: mknod d12/d13/d1c/d28/df2/d8b/c120 0 2024-04-13T10:58:49.501 INFO:tasks.workunit.client.1.smithi194.stdout:9/954: rename d0/d6/d14/dcd/fc6 to d0/d11/da3/d10b/f144 0 2024-04-13T10:58:49.502 INFO:tasks.workunit.client.1.smithi194.stdout:7/987: read d1/d2b/d4c/d4f/f53 [3944138,24165] 0 2024-04-13T10:58:49.506 INFO:tasks.workunit.client.1.smithi194.stdout:0/981: dwrite d9/d2b/dbd/d12e/d83/f10d [0,4194304] 0 2024-04-13T10:58:49.506 INFO:tasks.workunit.client.1.smithi194.stdout:9/955: mkdir d0/dde/d145 0 2024-04-13T10:58:49.507 INFO:tasks.workunit.client.1.smithi194.stdout:6/948: dwrite d0/d42/d7b/f88 [0,4194304] 0 2024-04-13T10:58:49.507 INFO:tasks.workunit.client.1.smithi194.stdout:7/988: chown d1/d2b/d4c/d4f/d51/f1f 292110647 1 2024-04-13T10:58:49.510 INFO:tasks.workunit.client.1.smithi194.stdout:9/956: write d0/d6/d2c/f102 [3776970,51159] 0 2024-04-13T10:58:49.514 INFO:tasks.workunit.client.1.smithi194.stdout:6/949: truncate d0/d57/d115/dba/f118 157492 0 2024-04-13T10:58:49.515 INFO:tasks.workunit.client.1.smithi194.stdout:7/989: rmdir d1/d2b/d3e/ddf/dd7 39 2024-04-13T10:58:49.515 INFO:tasks.workunit.client.1.smithi194.stdout:1/881: write f10 [3562264,57887] 0 2024-04-13T10:58:49.517 INFO:tasks.workunit.client.1.smithi194.stdout:9/957: mkdir d0/d6/d4a/d74/d146 0 2024-04-13T10:58:49.518 INFO:tasks.workunit.client.1.smithi194.stdout:6/950: symlink d0/d2c/d77/l136 0 2024-04-13T10:58:49.520 INFO:tasks.workunit.client.1.smithi194.stdout:0/982: dwrite d9/db/d3a/d9a/dd7/f2e [0,4194304] 0 2024-04-13T10:58:49.521 INFO:tasks.workunit.client.1.smithi194.stdout:7/990: mknod d1/d2b/d3e/ddf/d6b/c148 0 2024-04-13T10:58:49.521 INFO:tasks.workunit.client.1.smithi194.stdout:3/835: write d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dd7/fb4 [783577,32261] 0 2024-04-13T10:58:49.522 INFO:tasks.workunit.client.1.smithi194.stdout:1/882: creat d12/d13/d1c/d28/f121 x:0 0 0 2024-04-13T10:58:49.523 INFO:tasks.workunit.client.1.smithi194.stdout:0/983: write d9/d2b/d6c/ddf/f3c [2270283,106651] 0 2024-04-13T10:58:49.527 INFO:tasks.workunit.client.1.smithi194.stdout:3/836: creat d2/f119 x:0 0 0 2024-04-13T10:58:49.530 INFO:tasks.workunit.client.1.smithi194.stdout:1/883: rename d12/d13/d1c/l4b to d12/d13/d1c/d28/df2/d8b/db2/l122 0 2024-04-13T10:58:49.531 INFO:tasks.workunit.client.1.smithi194.stdout:9/958: dread d0/d6/d14/d26/d42/f6f [0,4194304] 0 2024-04-13T10:58:49.534 INFO:tasks.workunit.client.1.smithi194.stdout:1/884: dread - d12/d13/d44/db5/f10e zero size 2024-04-13T10:58:49.535 INFO:tasks.workunit.client.1.smithi194.stdout:7/991: dwrite d1/d2b/d3e/ddf/d5a/d7d/f118 [0,4194304] 0 2024-04-13T10:58:49.536 INFO:tasks.workunit.client.1.smithi194.stdout:0/984: dwrite d9/db/d3a/d9a/dd7/f6e [0,4194304] 0 2024-04-13T10:58:49.537 INFO:tasks.workunit.client.1.smithi194.stdout:3/837: rename d2/d3/db9 to d2/d3/d12/d31/d34/d88/d24/d82/d11a 0 2024-04-13T10:58:49.537 INFO:tasks.workunit.client.1.smithi194.stdout:9/959: symlink d0/d6/d14/d26/d42/l147 0 2024-04-13T10:58:49.539 INFO:tasks.workunit.client.1.smithi194.stdout:9/960: dread - d0/d6/d14/dcd/fdb zero size 2024-04-13T10:58:49.544 INFO:tasks.workunit.client.1.smithi194.stdout:0/985: rename d9/d2b/dbd/d12e/d77/lea to d9/d2b/dbd/d12e/d75/dd3/l13c 0 2024-04-13T10:58:49.547 INFO:tasks.workunit.client.1.smithi194.stdout:9/961: getdents d0/d6/d4a 0 2024-04-13T10:58:49.548 INFO:tasks.workunit.client.1.smithi194.stdout:0/986: mkdir d9/d2b/dbd/d12e/d77/d13d 0 2024-04-13T10:58:49.550 INFO:tasks.workunit.client.1.smithi194.stdout:7/992: dread d1/d6c/d137/f4b [0,4194304] 0 2024-04-13T10:58:49.550 INFO:tasks.workunit.client.1.smithi194.stdout:3/838: link d2/d3/d12/d31/d34/d88/d24/d82/laa d2/d3/d12/d31/d34/d88/d24/d3a/l11b 0 2024-04-13T10:58:49.552 INFO:tasks.workunit.client.1.smithi194.stdout:3/839: chown d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/cd5 13103174 1 2024-04-13T10:58:49.553 INFO:tasks.workunit.client.1.smithi194.stdout:0/987: unlink d9/d2b/dbd/d12e/d75/dd3/cda 0 2024-04-13T10:58:49.553 INFO:tasks.workunit.client.1.smithi194.stdout:6/951: dread d0/d42/dbe/d4d/f4f [0,4194304] 0 2024-04-13T10:58:49.554 INFO:tasks.workunit.client.1.smithi194.stdout:9/962: link d0/fe7 d0/d6/d14/d26/d42/f148 0 2024-04-13T10:58:49.556 INFO:tasks.workunit.client.1.smithi194.stdout:7/993: creat d1/d2b/d3e/d9c/dc5/f149 x:0 0 0 2024-04-13T10:58:49.556 INFO:tasks.workunit.client.1.smithi194.stdout:9/963: read - d0/d88/dac/f104 zero size 2024-04-13T10:58:49.556 INFO:tasks.workunit.client.1.smithi194.stdout:3/840: symlink d2/d3/d12/d31/d34/d88/d24/d82/d11a/df3/l11c 0 2024-04-13T10:58:49.558 INFO:tasks.workunit.client.1.smithi194.stdout:6/952: creat d0/d2f/d48/d83/d110/d12b/f137 x:0 0 0 2024-04-13T10:58:49.559 INFO:tasks.workunit.client.1.smithi194.stdout:0/988: rename d9/d2b/dbd/d12e/d75/dd3/ce0 to d9/d2b/dbd/d12e/d77/d134/c13e 0 2024-04-13T10:58:49.561 INFO:tasks.workunit.client.1.smithi194.stdout:6/953: rename d0/d57/db7/dbc/dc4 to d0/d57/db7/dbc/dc4/d138 22 2024-04-13T10:58:49.562 INFO:tasks.workunit.client.1.smithi194.stdout:0/989: readlink d9/db/d3a/la4 0 2024-04-13T10:58:49.562 INFO:tasks.workunit.client.1.smithi194.stdout:7/994: unlink d1/d2b/d3e/ddf/d5a/d3c/f138 0 2024-04-13T10:58:49.563 INFO:tasks.workunit.client.1.smithi194.stdout:9/964: dwrite d0/d6/d2c/f47 [0,4194304] 0 2024-04-13T10:58:49.564 INFO:tasks.workunit.client.1.smithi194.stdout:7/995: fdatasync d1/d2b/d4c/d4f/d51/f56 0 2024-04-13T10:58:49.565 INFO:tasks.workunit.client.1.smithi194.stdout:3/841: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/c11d 0 2024-04-13T10:58:49.576 INFO:tasks.workunit.client.1.smithi194.stdout:7/996: rmdir d1/d2b/d4c/d4f/d85/d88/d9b 39 2024-04-13T10:58:49.577 INFO:tasks.workunit.client.1.smithi194.stdout:6/954: symlink d0/d42/l139 0 2024-04-13T10:58:49.577 INFO:tasks.workunit.client.1.smithi194.stdout:0/990: mkdir d9/db/d6b/df7/d12d/d13f 0 2024-04-13T10:58:49.578 INFO:tasks.workunit.client.1.smithi194.stdout:6/955: readlink d0/d2c/l79 0 2024-04-13T10:58:49.591 INFO:tasks.workunit.client.1.smithi194.stdout:3/842: write d2/f27 [26755,100995] 0 2024-04-13T10:58:49.614 INFO:tasks.workunit.client.1.smithi194.stdout:9/965: unlink d0/d6/d9/dd7/c134 0 2024-04-13T10:58:49.615 INFO:tasks.workunit.client.1.smithi194.stdout:0/991: symlink d9/d2b/dbd/d12e/d70/l140 0 2024-04-13T10:58:49.617 INFO:tasks.workunit.client.1.smithi194.stdout:0/992: write d9/d2b/dbd/d12e/d75/f119 [744410,69437] 0 2024-04-13T10:58:49.617 INFO:tasks.workunit.client.1.smithi194.stdout:7/997: creat d1/d2b/d4c/d4f/d85/d88/d9b/f14a x:0 0 0 2024-04-13T10:58:49.619 INFO:tasks.workunit.client.1.smithi194.stdout:9/966: dread d0/d6/d14/d26/d3b/f11b [0,4194304] 0 2024-04-13T10:58:49.621 INFO:tasks.workunit.client.1.smithi194.stdout:6/956: creat d0/d53/d78/d91/d127/f13a x:0 0 0 2024-04-13T10:58:49.623 INFO:tasks.workunit.client.1.smithi194.stdout:7/998: creat d1/d6c/f14b x:0 0 0 2024-04-13T10:58:49.627 INFO:tasks.workunit.client.1.smithi194.stdout:0/993: rmdir d9/d2b/dbd/d12e/d77/d106 0 2024-04-13T10:58:49.628 INFO:tasks.workunit.client.1.smithi194.stdout:0/994: chown d9/db1/d30/fa0 1 1 2024-04-13T10:58:49.629 INFO:tasks.workunit.client.1.smithi194.stdout:0/995: chown d9/d2b/d6c/ddf/f4c 20109500 1 2024-04-13T10:58:49.629 INFO:tasks.workunit.client.1.smithi194.stdout:7/999: mknod d1/d2b/d4c/d4f/d85/d11e/c14c 0 2024-04-13T10:58:49.630 INFO:tasks.workunit.client.1.smithi194.stdout:6/957: link d0/d42/d7b/db4/de4/c10d d0/d26/d4b/de6/c13b 0 2024-04-13T10:58:49.631 INFO:tasks.workunit.client.1.smithi194.stdout:6/958: chown d0/d57/db7/dbc/cef 83797 1 2024-04-13T10:58:49.633 INFO:tasks.workunit.client.1.smithi194.stdout:6/959: fsync d0/d42/dbe/d4d/fd2 0 2024-04-13T10:58:49.634 INFO:tasks.workunit.client.1.smithi194.stdout:0/996: dwrite d9/db/d3a/d9a/dd7/f2e [0,4194304] 0 2024-04-13T10:58:49.640 INFO:tasks.workunit.client.1.smithi194.stdout:0/997: dwrite d9/d2b/d6c/db2/f114 [4194304,4194304] 0 2024-04-13T10:58:49.641 INFO:tasks.workunit.client.1.smithi194.stdout:0/998: write d9/d2b/dbd/d12e/d75/dd3/f107 [658414,2388] 0 2024-04-13T10:58:49.649 INFO:tasks.workunit.client.1.smithi194.stdout:0/999: dwrite d9/d2b/dbd/d12e/d70/fc4 [0,4194304] 0 2024-04-13T10:58:49.651 INFO:tasks.workunit.client.1.smithi194.stdout:3/843: truncate d2/d3/d12/d31/d34/d88/d24/d6c/dc2/fcf 141099 0 2024-04-13T10:58:49.654 INFO:tasks.workunit.client.1.smithi194.stdout:3/844: creat d2/dce/ddc/df2/f11e x:0 0 0 2024-04-13T10:58:49.657 INFO:tasks.workunit.client.1.smithi194.stdout:9/967: dwrite d0/d11/d79/ff7 [0,4194304] 0 2024-04-13T10:58:49.658 INFO:tasks.workunit.client.1.smithi194.stdout:9/968: write d0/d6/f7b [916467,104368] 0 2024-04-13T10:58:49.660 INFO:tasks.workunit.client.1.smithi194.stdout:9/969: write d0/d6/d14/d26/d3b/faa [5260907,26047] 0 2024-04-13T10:58:49.664 INFO:tasks.workunit.client.1.smithi194.stdout:9/970: creat d0/d6/d2c/f149 x:0 0 0 2024-04-13T10:58:49.665 INFO:tasks.workunit.client.1.smithi194.stdout:9/971: chown d0/d6/d14/dcd/da4/de0/ff5 13868 1 2024-04-13T10:58:49.667 INFO:tasks.workunit.client.1.smithi194.stdout:9/972: creat d0/dfe/d128/f14a x:0 0 0 2024-04-13T10:58:49.669 INFO:tasks.workunit.client.1.smithi194.stdout:1/885: sync 2024-04-13T10:58:49.670 INFO:tasks.workunit.client.1.smithi194.stdout:3/845: write d2/d3/d12/d31/d34/d88/d24/d3a/d56/fb1 [101372,43027] 0 2024-04-13T10:58:49.671 INFO:tasks.workunit.client.1.smithi194.stdout:9/973: write d0/d6/d14/d6d/fe6 [2517021,75868] 0 2024-04-13T10:58:49.672 INFO:tasks.workunit.client.1.smithi194.stdout:6/960: dwrite d0/d2c/d10e/f122 [0,4194304] 0 2024-04-13T10:58:49.674 INFO:tasks.workunit.client.1.smithi194.stdout:3/846: write d2/d3/d12/d31/d34/d88/d24/f4b [1407171,9446] 0 2024-04-13T10:58:49.674 INFO:tasks.workunit.client.1.smithi194.stdout:9/974: mkdir d0/d6/d9/d9e/d14b 0 2024-04-13T10:58:49.677 INFO:tasks.workunit.client.1.smithi194.stdout:6/961: creat d0/d53/f13c x:0 0 0 2024-04-13T10:58:49.679 INFO:tasks.workunit.client.1.smithi194.stdout:9/975: mkdir d0/d6/d14/dcd/da4/de0/d132/d14c 0 2024-04-13T10:58:49.680 INFO:tasks.workunit.client.1.smithi194.stdout:6/962: symlink d0/d42/d7b/db4/l13d 0 2024-04-13T10:58:49.685 INFO:tasks.workunit.client.1.smithi194.stdout:3/847: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d11f 0 2024-04-13T10:58:49.687 INFO:tasks.workunit.client.1.smithi194.stdout:9/976: getdents d0/d88/de5 0 2024-04-13T10:58:49.689 INFO:tasks.workunit.client.1.smithi194.stdout:6/963: unlink d0/d2c/d77/d93/daa/d116/c131 0 2024-04-13T10:58:49.692 INFO:tasks.workunit.client.1.smithi194.stdout:3/848: rename d2/d3/d12/d31/d34/d88/d24/f4b to d2/de/f120 0 2024-04-13T10:58:49.695 INFO:tasks.workunit.client.1.smithi194.stdout:1/886: dread d12/d13/d44/f85 [0,4194304] 0 2024-04-13T10:58:49.695 INFO:tasks.workunit.client.1.smithi194.stdout:6/964: rmdir d0/d57/db7/dbc/dc4 39 2024-04-13T10:58:49.697 INFO:tasks.workunit.client.1.smithi194.stdout:3/849: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/f121 x:0 0 0 2024-04-13T10:58:49.700 INFO:tasks.workunit.client.1.smithi194.stdout:1/887: dread d12/d3a/f9a [0,4194304] 0 2024-04-13T10:58:49.701 INFO:tasks.workunit.client.1.smithi194.stdout:9/977: write d0/f4d [93235,115696] 0 2024-04-13T10:58:49.701 INFO:tasks.workunit.client.1.smithi194.stdout:6/965: write d0/d53/f60 [3340753,16613] 0 2024-04-13T10:58:49.703 INFO:tasks.workunit.client.1.smithi194.stdout:9/978: stat d0/d11/d79/f84 0 2024-04-13T10:58:49.705 INFO:tasks.workunit.client.1.smithi194.stdout:6/966: chown d0/d57/d69/f8a 43 1 2024-04-13T10:58:49.705 INFO:tasks.workunit.client.1.smithi194.stdout:1/888: stat d12/d3a/d4f/da3/d107/d10f/dfb/d115/c119 0 2024-04-13T10:58:49.707 INFO:tasks.workunit.client.1.smithi194.stdout:9/979: truncate d0/d6/d14/ff2 372083 0 2024-04-13T10:58:49.707 INFO:tasks.workunit.client.1.smithi194.stdout:3/850: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/f91 [0,4194304] 0 2024-04-13T10:58:49.711 INFO:tasks.workunit.client.1.smithi194.stdout:6/967: rename d0/d42/dbe/d4d/fbd to d0/d26/d4b/de6/f13e 0 2024-04-13T10:58:49.714 INFO:tasks.workunit.client.1.smithi194.stdout:6/968: write d0/d57/d115/dba/f118 [633434,49831] 0 2024-04-13T10:58:49.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.715+0000 7f103e9f1700 1 -- 172.21.15.134:0/1576756191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10380ff260 msgr2=0x7f10380ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.715+0000 7f103e9f1700 1 --2- 172.21.15.134:0/1576756191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10380ff260 0x7f10380ff6d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1020009910 tx=0x7f1020009c20 comp rx=0 tx=0).stop 2024-04-13T10:58:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.715+0000 7f103e9f1700 1 -- 172.21.15.134:0/1576756191 shutdown_connections 2024-04-13T10:58:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.715+0000 7f103e9f1700 1 --2- 172.21.15.134:0/1576756191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10380ff260 0x7f10380ff6d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.715+0000 7f103e9f1700 1 --2- 172.21.15.134:0/1576756191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1038100600 0x7f1038100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.715+0000 7f103e9f1700 1 -- 172.21.15.134:0/1576756191 >> 172.21.15.134:0/1576756191 conn(0x7f10380f9d80 msgr2=0x7f10380fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.715+0000 7f103e9f1700 1 -- 172.21.15.134:0/1576756191 shutdown_connections 2024-04-13T10:58:49.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.715+0000 7f103e9f1700 1 -- 172.21.15.134:0/1576756191 wait complete. 2024-04-13T10:58:49.717 INFO:tasks.workunit.client.1.smithi194.stdout:1/889: dwrite d12/d13/d1c/d27/d5c/fb4 [4194304,4194304] 0 2024-04-13T10:58:49.717 INFO:tasks.workunit.client.1.smithi194.stdout:6/969: dread - d0/d53/f13c zero size 2024-04-13T10:58:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f103e9f1700 1 Processor -- start 2024-04-13T10:58:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f103e9f1700 1 -- start start 2024-04-13T10:58:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f103e9f1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10380ff260 0x7f1038194880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f103e9f1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1038100600 0x7f1038194dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:49.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f103e9f1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10381953e0 con 0x7f10380ff260 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f103e9f1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1038195520 con 0x7f1038100600 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f1037fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10380ff260 0x7f1038194880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f1037fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10380ff260 0x7f1038194880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33926/0 (socket says 172.21.15.134:33926) 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f1037fff700 1 -- 172.21.15.134:0/359736009 learned_addr learned my addr 172.21.15.134:0/359736009 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f102f7fe700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1038100600 0x7f1038194dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f1037fff700 1 -- 172.21.15.134:0/359736009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1038100600 msgr2=0x7f1038194dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f1037fff700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1038100600 0x7f1038194dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.716+0000 7f1037fff700 1 -- 172.21.15.134:0/359736009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10200095f0 con 0x7f10380ff260 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.717+0000 7f1037fff700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10380ff260 0x7f1038194880 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f102800b4b0 tx=0x7f102800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.717+0000 7f1035ffb700 1 -- 172.21.15.134:0/359736009 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1028011800 con 0x7f10380ff260 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.717+0000 7f1035ffb700 1 -- 172.21.15.134:0/359736009 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f1028011df0 con 0x7f10380ff260 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.717+0000 7f103e9f1700 1 -- 172.21.15.134:0/359736009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10380fe2f0 con 0x7f10380ff260 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.717+0000 7f1035ffb700 1 -- 172.21.15.134:0/359736009 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1028010e40 con 0x7f10380ff260 2024-04-13T10:58:49.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.717+0000 7f103e9f1700 1 -- 172.21.15.134:0/359736009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10380fe8c0 con 0x7f10380ff260 2024-04-13T10:58:49.720 INFO:tasks.workunit.client.1.smithi194.stdout:9/980: dwrite d0/d6/d14/dcd/dd6/f105 [0,4194304] 0 2024-04-13T10:58:49.722 INFO:tasks.workunit.client.1.smithi194.stdout:9/981: chown d0/d11/d3d/d9b/f142 0 1 2024-04-13T10:58:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.718+0000 7f103e9f1700 1 -- 172.21.15.134:0/359736009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1038107ad0 con 0x7f10380ff260 2024-04-13T10:58:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.719+0000 7f1035ffb700 1 -- 172.21.15.134:0/359736009 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f102801a400 con 0x7f10380ff260 2024-04-13T10:58:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.719+0000 7f1035ffb700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f1024071220 0x7f10240736d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.720+0000 7f1035ffb700 1 -- 172.21.15.134:0/359736009 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f102808c060 con 0x7f10380ff260 2024-04-13T10:58:49.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.720+0000 7f102f7fe700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f1024071220 0x7f10240736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:49.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.721+0000 7f102f7fe700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f1024071220 0x7f10240736d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1020006010 tx=0x7f102000b540 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:49.724 INFO:tasks.workunit.client.1.smithi194.stdout:1/890: creat d12/d3a/d4f/da3/f123 x:0 0 0 2024-04-13T10:58:49.725 INFO:tasks.workunit.client.1.smithi194.stdout:6/970: symlink d0/d2f/d48/d68/l13f 0 2024-04-13T10:58:49.726 INFO:tasks.workunit.client.1.smithi194.stdout:6/971: write d0/d26/dcb/fd6 [483609,91641] 0 2024-04-13T10:58:49.727 INFO:tasks.workunit.client.1.smithi194.stdout:3/851: write d2/d3/d12/d31/f5e [1601531,74761] 0 2024-04-13T10:58:49.728 INFO:tasks.workunit.client.1.smithi194.stdout:1/891: unlink d12/d13/d3e/d108/fc6 0 2024-04-13T10:58:49.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.727+0000 7f1035ffb700 1 -- 172.21.15.134:0/359736009 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f1028059cd0 con 0x7f10380ff260 2024-04-13T10:58:49.729 INFO:tasks.workunit.client.1.smithi194.stdout:1/892: readlink d12/d13/d3e/l83 0 2024-04-13T10:58:49.729 INFO:tasks.workunit.client.1.smithi194.stdout:9/982: mknod d0/d11/d3d/d4c/c14d 0 2024-04-13T10:58:49.730 INFO:tasks.workunit.client.1.smithi194.stdout:6/972: mknod d0/d42/c140 0 2024-04-13T10:58:49.731 INFO:tasks.workunit.client.1.smithi194.stdout:9/983: write d0/d6/d2c/db5/f122 [559073,13853] 0 2024-04-13T10:58:49.731 INFO:tasks.workunit.client.1.smithi194.stdout:1/893: creat d12/d3a/dad/f124 x:0 0 0 2024-04-13T10:58:49.734 INFO:tasks.workunit.client.1.smithi194.stdout:9/984: creat d0/d6/d14/d26/d3b/f14e x:0 0 0 2024-04-13T10:58:49.736 INFO:tasks.workunit.client.1.smithi194.stdout:3/852: read d2/d3/d12/d31/d34/d88/d24/f4c [1892405,95438] 0 2024-04-13T10:58:49.736 INFO:tasks.workunit.client.1.smithi194.stdout:1/894: mknod d12/d13/d1c/d27/d2e/d118/dff/c125 0 2024-04-13T10:58:49.737 INFO:tasks.workunit.client.1.smithi194.stdout:9/985: mknod d0/d6/d9/d51/c14f 0 2024-04-13T10:58:49.739 INFO:tasks.workunit.client.1.smithi194.stdout:6/973: dwrite d0/d53/f55 [4194304,4194304] 0 2024-04-13T10:58:49.739 INFO:tasks.workunit.client.1.smithi194.stdout:1/895: dread - d12/d13/d1c/d27/d2e/f88 zero size 2024-04-13T10:58:49.740 INFO:tasks.workunit.client.1.smithi194.stdout:3/853: stat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75 0 2024-04-13T10:58:49.743 INFO:tasks.workunit.client.1.smithi194.stdout:6/974: creat d0/d26/d4b/f141 x:0 0 0 2024-04-13T10:58:49.743 INFO:tasks.workunit.client.1.smithi194.stdout:6/975: readlink d0/d53/d78/l121 0 2024-04-13T10:58:49.744 INFO:tasks.workunit.client.1.smithi194.stdout:6/976: write d0/d26/f15 [6212532,83716] 0 2024-04-13T10:58:49.744 INFO:tasks.workunit.client.1.smithi194.stdout:9/986: rename d0/d11/d3d/d4c/f81 to d0/d6/d4a/d74/f150 0 2024-04-13T10:58:49.745 INFO:tasks.workunit.client.1.smithi194.stdout:3/854: mknod d2/d3/d12/d31/d34/d88/d24/d6c/c122 0 2024-04-13T10:58:49.746 INFO:tasks.workunit.client.1.smithi194.stdout:6/977: chown d0/d53/d78/dac/ff9 434 1 2024-04-13T10:58:49.747 INFO:tasks.workunit.client.1.smithi194.stdout:9/987: mknod d0/d6/d14/dcd/da4/de0/d132/c151 0 2024-04-13T10:58:49.748 INFO:tasks.workunit.client.1.smithi194.stdout:9/988: chown d0/d6/d14/dcd/fdb 8 1 2024-04-13T10:58:49.751 INFO:tasks.workunit.client.1.smithi194.stdout:6/978: rename d0/f21 to d0/d26/dcb/f142 0 2024-04-13T10:58:49.752 INFO:tasks.workunit.client.1.smithi194.stdout:9/989: rename d0/d6/d4a/d74/ccb to d0/d6/d4a/d74/c152 0 2024-04-13T10:58:49.754 INFO:tasks.workunit.client.1.smithi194.stdout:6/979: getdents d0/d2c/d77/d93/daa 0 2024-04-13T10:58:49.756 INFO:tasks.workunit.client.1.smithi194.stdout:9/990: link d0/c72 d0/d11/d58/c153 0 2024-04-13T10:58:49.758 INFO:tasks.workunit.client.1.smithi194.stdout:6/980: mknod d0/d57/db7/dbc/dc4/c143 0 2024-04-13T10:58:49.758 INFO:tasks.workunit.client.1.smithi194.stdout:9/991: symlink d0/dfe/d128/l154 0 2024-04-13T10:58:49.760 INFO:tasks.workunit.client.1.smithi194.stdout:6/981: truncate d0/d57/db7/dbc/dc4/fd7 991169 0 2024-04-13T10:58:49.760 INFO:tasks.workunit.client.1.smithi194.stdout:1/896: dread d12/f81 [0,4194304] 0 2024-04-13T10:58:49.765 INFO:tasks.workunit.client.1.smithi194.stdout:1/897: creat d12/d13/d1c/d27/d2e/f126 x:0 0 0 2024-04-13T10:58:49.765 INFO:tasks.workunit.client.1.smithi194.stdout:6/982: truncate d0/f99 2887515 0 2024-04-13T10:58:49.766 INFO:tasks.workunit.client.1.smithi194.stdout:1/898: creat d12/d13/d1c/d28/df2/d8b/db2/f127 x:0 0 0 2024-04-13T10:58:49.767 INFO:tasks.workunit.client.1.smithi194.stdout:6/983: creat d0/d53/d78/dac/f144 x:0 0 0 2024-04-13T10:58:49.770 INFO:tasks.workunit.client.1.smithi194.stdout:1/899: creat d12/d13/d1c/d28/d41/d77/d93/f128 x:0 0 0 2024-04-13T10:58:49.770 INFO:tasks.workunit.client.1.smithi194.stdout:6/984: truncate d0/f1f 670825 0 2024-04-13T10:58:49.772 INFO:tasks.workunit.client.1.smithi194.stdout:9/992: dread d0/d6/d4a/d74/f8c [0,4194304] 0 2024-04-13T10:58:49.772 INFO:tasks.workunit.client.1.smithi194.stdout:3/855: dwrite d2/d3/d12/d21/f49 [0,4194304] 0 2024-04-13T10:58:49.779 INFO:tasks.workunit.client.1.smithi194.stdout:6/985: rename d0/d53 to d0/d2f/d48/d145 0 2024-04-13T10:58:49.780 INFO:tasks.workunit.client.1.smithi194.stdout:9/993: dwrite d0/d6/d14/ff2 [0,4194304] 0 2024-04-13T10:58:49.783 INFO:tasks.workunit.client.1.smithi194.stdout:9/994: fsync d0/dfe/d128/f13b 0 2024-04-13T10:58:49.786 INFO:tasks.workunit.client.1.smithi194.stdout:3/856: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/f6e [0,4194304] 0 2024-04-13T10:58:49.788 INFO:tasks.workunit.client.1.smithi194.stdout:1/900: rename d12/d13/d1c/d27/d5c/leb to d12/d13/d1c/l129 0 2024-04-13T10:58:49.789 INFO:tasks.workunit.client.1.smithi194.stdout:6/986: symlink d0/d2f/d48/d83/d110/d12b/df1/l146 0 2024-04-13T10:58:49.790 INFO:tasks.workunit.client.1.smithi194.stdout:1/901: write d12/d13/d44/f89 [1829120,130056] 0 2024-04-13T10:58:49.793 INFO:tasks.workunit.client.1.smithi194.stdout:3/857: mkdir d2/d7d/dff/d123 0 2024-04-13T10:58:49.794 INFO:tasks.workunit.client.1.smithi194.stdout:3/858: chown d2/d3/f43 18 1 2024-04-13T10:58:49.795 INFO:tasks.workunit.client.1.smithi194.stdout:6/987: mknod d0/d2c/d77/d93/daa/c147 0 2024-04-13T10:58:49.796 INFO:tasks.workunit.client.1.smithi194.stdout:9/995: creat d0/d6/f155 x:0 0 0 2024-04-13T10:58:49.800 INFO:tasks.workunit.client.1.smithi194.stdout:9/996: creat d0/dde/d145/f156 x:0 0 0 2024-04-13T10:58:49.801 INFO:tasks.workunit.client.1.smithi194.stdout:9/997: creat d0/dfe/f157 x:0 0 0 2024-04-13T10:58:49.804 INFO:tasks.workunit.client.1.smithi194.stdout:9/998: getdents d0/d6/d14/dcd/da4/de0 0 2024-04-13T10:58:49.808 INFO:tasks.workunit.client.1.smithi194.stdout:9/999: rename d0/d11/d79/c10c to d0/d6/d14/dcd/da4/de0/c158 0 2024-04-13T10:58:49.810 INFO:tasks.workunit.client.1.smithi194.stdout:1/902: write d12/d13/d44/f94 [117252,105550] 0 2024-04-13T10:58:49.814 INFO:tasks.workunit.client.1.smithi194.stdout:1/903: creat d12/d13/d1c/d27/d2e/d118/dff/f12a x:0 0 0 2024-04-13T10:58:49.814 INFO:tasks.workunit.client.1.smithi194.stdout:6/988: dread d0/d2f/d48/d145/f60 [0,4194304] 0 2024-04-13T10:58:49.817 INFO:tasks.workunit.client.1.smithi194.stdout:3/859: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/fb2 [0,4194304] 0 2024-04-13T10:58:49.818 INFO:tasks.workunit.client.1.smithi194.stdout:1/904: unlink d12/d13/d1c/d28/d41/d77/d93/cdf 0 2024-04-13T10:58:49.819 INFO:tasks.workunit.client.1.smithi194.stdout:1/905: dread - d12/d13/d1c/d28/d41/d77/d80/dc9/f102 zero size 2024-04-13T10:58:49.820 INFO:tasks.workunit.client.1.smithi194.stdout:3/860: chown d2/d3/d12/d31/d34/l47 907 1 2024-04-13T10:58:49.821 INFO:tasks.workunit.client.1.smithi194.stdout:6/989: link d0/d42/d7b/f129 d0/d26/d4b/dd0/f148 0 2024-04-13T10:58:49.822 INFO:tasks.workunit.client.1.smithi194.stdout:6/990: dread - d0/d26/d4b/dd0/f148 zero size 2024-04-13T10:58:49.825 INFO:tasks.workunit.client.1.smithi194.stdout:1/906: rename d12/d13/d1c/d28/d41/d77/d80/c104 to d12/d13/d3e/d108/c12b 0 2024-04-13T10:58:49.828 INFO:tasks.workunit.client.1.smithi194.stdout:3/861: rename d2/d3/d12/d31/d34/d88/d24/fe1 to d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dd7/f124 0 2024-04-13T10:58:49.829 INFO:tasks.workunit.client.1.smithi194.stdout:3/862: chown d2/d3/d12/d31/cbb 6 1 2024-04-13T10:58:49.831 INFO:tasks.workunit.client.1.smithi194.stdout:3/863: rename d2/d3/d12/f16 to d2/d7d/dff/d123/f125 0 2024-04-13T10:58:49.832 INFO:tasks.workunit.client.1.smithi194.stdout:3/864: fsync d2/d7d/f9c 0 2024-04-13T10:58:49.835 INFO:tasks.workunit.client.1.smithi194.stdout:3/865: write d2/f5b [330381,27156] 0 2024-04-13T10:58:49.839 INFO:tasks.workunit.client.1.smithi194.stdout:3/866: creat d2/d3/d12/d31/d34/d88/d24/f126 x:0 0 0 2024-04-13T10:58:49.839 INFO:tasks.workunit.client.1.smithi194.stdout:1/907: truncate d12/d13/d1c/d27/d5c/f114 2817205 0 2024-04-13T10:58:49.841 INFO:tasks.workunit.client.1.smithi194.stdout:3/867: fsync d2/d7d/dff/d123/f125 0 2024-04-13T10:58:49.844 INFO:tasks.workunit.client.1.smithi194.stdout:3/868: symlink d2/d3/d12/d31/d34/d88/d24/d82/d11a/l127 0 2024-04-13T10:58:49.847 INFO:tasks.workunit.client.1.smithi194.stdout:3/869: mkdir d2/d3/d12/d31/d128 0 2024-04-13T10:58:49.849 INFO:tasks.workunit.client.1.smithi194.stdout:3/870: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5/l129 0 2024-04-13T10:58:49.852 INFO:tasks.workunit.client.1.smithi194.stdout:3/871: rename d2/d7d/f9c to d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/f12a 0 2024-04-13T10:58:49.853 INFO:tasks.workunit.client.1.smithi194.stdout:3/872: creat d2/dce/f12b x:0 0 0 2024-04-13T10:58:49.855 INFO:tasks.workunit.client.1.smithi194.stdout:3/873: mknod d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/c12c 0 2024-04-13T10:58:49.866 INFO:tasks.workunit.client.1.smithi194.stdout:3/874: dread d2/d3/d12/d31/f4f [0,4194304] 0 2024-04-13T10:58:49.867 INFO:tasks.workunit.client.1.smithi194.stdout:3/875: write d2/de/f102 [798384,19868] 0 2024-04-13T10:58:49.868 INFO:tasks.workunit.client.1.smithi194.stdout:3/876: mkdir d2/d3/d12d 0 2024-04-13T10:58:49.870 INFO:tasks.workunit.client.1.smithi194.stdout:3/877: stat d2/d3/d12/d31/d34/d88/d24/d3a/l11b 0 2024-04-13T10:58:49.872 INFO:tasks.workunit.client.1.smithi194.stdout:3/878: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d12e 0 2024-04-13T10:58:49.873 INFO:tasks.workunit.client.1.smithi194.stdout:3/879: chown d2/d3/c58 715096413 1 2024-04-13T10:58:49.876 INFO:tasks.workunit.client.1.smithi194.stdout:3/880: dread d2/d3/f43 [0,4194304] 0 2024-04-13T10:58:49.877 INFO:tasks.workunit.client.1.smithi194.stdout:3/881: readlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5/l108 0 2024-04-13T10:58:49.879 INFO:tasks.workunit.client.1.smithi194.stdout:3/882: symlink d2/dce/ddc/l12f 0 2024-04-13T10:58:49.879 INFO:tasks.workunit.client.1.smithi194.stdout:3/883: readlink d2/d3/d12/d31/l33 0 2024-04-13T10:58:49.881 INFO:tasks.workunit.client.1.smithi194.stdout:3/884: creat d2/d3/d12/d31/d34/d88/d24/d82/f130 x:0 0 0 2024-04-13T10:58:49.883 INFO:tasks.workunit.client.1.smithi194.stdout:3/885: getdents d2/d3/d12/d31/d34 0 2024-04-13T10:58:49.886 INFO:tasks.workunit.client.1.smithi194.stdout:3/886: unlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95/lc4 0 2024-04-13T10:58:49.887 INFO:tasks.workunit.client.1.smithi194.stdout:3/887: write d2/f27 [3980733,3388] 0 2024-04-13T10:58:49.888 INFO:tasks.workunit.client.1.smithi194.stdout:3/888: write d2/d3/d12/d31/d34/d88/fad [1141059,73312] 0 2024-04-13T10:58:49.889 INFO:tasks.workunit.client.1.smithi194.stdout:3/889: read d2/d3/f8 [1605894,106985] 0 2024-04-13T10:58:49.894 INFO:tasks.workunit.client.1.smithi194.stdout:3/890: link d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5/l108 d2/d3/d12/d31/d34/d88/d24/dd2/l131 0 2024-04-13T10:58:49.961 INFO:tasks.workunit.client.1.smithi194.stdout:6/991: sync 2024-04-13T10:58:49.961 INFO:tasks.workunit.client.1.smithi194.stdout:1/908: sync 2024-04-13T10:58:49.962 INFO:tasks.workunit.client.1.smithi194.stdout:1/909: mkdir d12/d13/d1c/d28/d12c 0 2024-04-13T10:58:49.963 INFO:tasks.workunit.client.1.smithi194.stdout:6/992: unlink d0/d2c/d77/d93/d98/c119 0 2024-04-13T10:58:49.965 INFO:tasks.workunit.client.1.smithi194.stdout:1/910: rename d12/d3a/d4f/da3/d107/d10f/fea to d12/d3a/d4f/da3/df1/f12d 0 2024-04-13T10:58:49.966 INFO:tasks.workunit.client.1.smithi194.stdout:6/993: mkdir d0/d2f/d48/d68/d149 0 2024-04-13T10:58:49.967 INFO:tasks.workunit.client.1.smithi194.stdout:1/911: mknod d12/d13/c12e 0 2024-04-13T10:58:49.968 INFO:tasks.workunit.client.1.smithi194.stdout:6/994: unlink d0/d42/dbe/lb5 0 2024-04-13T10:58:49.969 INFO:tasks.workunit.client.1.smithi194.stdout:6/995: fdatasync d0/d2f/d48/d145/d78/d91/fa7 0 2024-04-13T10:58:49.969 INFO:tasks.workunit.client.1.smithi194.stdout:1/912: mkdir d12/d13/d12f 0 2024-04-13T10:58:49.974 INFO:tasks.workunit.client.1.smithi194.stdout:1/913: getdents d12/d13/d1c/d28/d41/db0 0 2024-04-13T10:58:49.974 INFO:tasks.workunit.client.1.smithi194.stdout:1/914: chown d12/d13/c17 645646 1 2024-04-13T10:58:49.975 INFO:tasks.workunit.client.1.smithi194.stdout:1/915: truncate d12/d13/d1c/d27/d4c/ffd 1018088 0 2024-04-13T10:58:49.977 INFO:tasks.workunit.client.1.smithi194.stdout:1/916: symlink d12/d3a/l130 0 2024-04-13T10:58:49.978 INFO:tasks.workunit.client.1.smithi194.stdout:1/917: fsync d12/d3a/dad/f124 0 2024-04-13T10:58:49.979 INFO:tasks.workunit.client.1.smithi194.stdout:1/918: stat d12/d13/d1c/d27/d2e/fc3 0 2024-04-13T10:58:49.979 INFO:tasks.workunit.client.1.smithi194.stdout:6/996: truncate d0/d2c/d77/f8c 55031 0 2024-04-13T10:58:49.981 INFO:tasks.workunit.client.1.smithi194.stdout:6/997: mknod d0/d26/d4b/de6/c14a 0 2024-04-13T10:58:49.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.981+0000 7f103e9f1700 1 -- 172.21.15.134:0/359736009 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1038104bc0 con 0x7f1024071220 2024-04-13T10:58:49.983 INFO:tasks.workunit.client.1.smithi194.stdout:6/998: write d0/d26/d4b/de6/f134 [726771,13752] 0 2024-04-13T10:58:49.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.982+0000 7f1035ffb700 1 -- 172.21.15.134:0/359736009 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f1038104bc0 con 0x7f1024071220 2024-04-13T10:58:49.983 INFO:tasks.workunit.client.1.smithi194.stdout:1/919: getdents d12/d3a/d4f/da3/daa 0 2024-04-13T10:58:49.984 INFO:tasks.workunit.client.1.smithi194.stdout:1/920: readlink d12/d13/d1c/d28/l2b 0 2024-04-13T10:58:49.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 -- 172.21.15.134:0/359736009 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f1024071220 msgr2=0x7f10240736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:49.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f1024071220 0x7f10240736d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1020006010 tx=0x7f102000b540 comp rx=0 tx=0).stop 2024-04-13T10:58:49.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 -- 172.21.15.134:0/359736009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10380ff260 msgr2=0x7f1038194880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:49.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10380ff260 0x7f1038194880 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f102800b4b0 tx=0x7f102800b870 comp rx=0 tx=0).stop 2024-04-13T10:58:49.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 -- 172.21.15.134:0/359736009 shutdown_connections 2024-04-13T10:58:49.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f1024071220 0x7f10240736d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:49.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10380ff260 0x7f1038194880 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:49.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 --2- 172.21.15.134:0/359736009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1038100600 0x7f1038194dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:49.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 -- 172.21.15.134:0/359736009 >> 172.21.15.134:0/359736009 conn(0x7f10380f9d80 msgr2=0x7f10381034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:49.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 -- 172.21.15.134:0/359736009 shutdown_connections 2024-04-13T10:58:49.987 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:49.985+0000 7f103e9f1700 1 -- 172.21.15.134:0/359736009 wait complete. 2024-04-13T10:58:49.988 INFO:tasks.workunit.client.1.smithi194.stdout:6/999: dread d0/d26/d4b/feb [0,4194304] 0 2024-04-13T10:58:49.990 INFO:tasks.workunit.client.1.smithi194.stdout:1/921: dwrite d12/d13/d3e/f54 [4194304,4194304] 0 2024-04-13T10:58:49.998 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T10:58:50.016 INFO:tasks.workunit.client.1.smithi194.stdout:1/922: dread d12/d13/d1c/d27/d5c/fb4 [0,4194304] 0 2024-04-13T10:58:50.019 INFO:tasks.workunit.client.1.smithi194.stdout:1/923: mknod d12/d13/d1c/d28/d41/d77/d80/dc9/c131 0 2024-04-13T10:58:50.025 INFO:tasks.workunit.client.1.smithi194.stdout:1/924: dwrite d12/d13/d1c/d28/df2/d8b/db2/f127 [0,4194304] 0 2024-04-13T10:58:50.034 INFO:tasks.workunit.client.1.smithi194.stdout:3/891: sync 2024-04-13T10:58:50.035 INFO:tasks.workunit.client.1.smithi194.stdout:1/925: dwrite d12/d13/d1c/d28/d41/d50/fb1 [0,4194304] 0 2024-04-13T10:58:50.037 INFO:tasks.workunit.client.1.smithi194.stdout:3/892: mknod d2/de/c132 0 2024-04-13T10:58:50.038 INFO:tasks.workunit.client.1.smithi194.stdout:3/893: readlink d2/d3/d12/d31/l46 0 2024-04-13T10:58:50.039 INFO:tasks.workunit.client.1.smithi194.stdout:1/926: mkdir d12/d13/d1c/d28/df2/d8b/dd4/ded/d11e/d132 0 2024-04-13T10:58:50.055 INFO:tasks.workunit.client.1.smithi194.stdout:1/927: dread d12/fa4 [0,4194304] 0 2024-04-13T10:58:50.056 INFO:tasks.workunit.client.1.smithi194.stdout:1/928: truncate d12/d13/d1c/d28/d41/d50/f8e 1223312 0 2024-04-13T10:58:50.060 INFO:tasks.workunit.client.1.smithi194.stdout:1/929: link d12/d13/d44/cc5 d12/d13/d1c/d27/d2e/d118/dff/c133 0 2024-04-13T10:58:50.062 INFO:tasks.workunit.client.1.smithi194.stdout:1/930: getdents d12/d13/d1c/d28/d41/d77/d93/dfc 0 2024-04-13T10:58:50.064 INFO:tasks.workunit.client.1.smithi194.stdout:1/931: symlink d12/d13/d1c/d28/df2/d8b/dd4/ded/d11e/l134 0 2024-04-13T10:58:50.066 INFO:tasks.workunit.client.1.smithi194.stdout:1/932: chown d12/d13/d1c/d28/f58 15552 1 2024-04-13T10:58:50.068 INFO:tasks.workunit.client.1.smithi194.stdout:1/933: creat d12/d13/d1c/d53/f135 x:0 0 0 2024-04-13T10:58:50.068 INFO:tasks.workunit.client.1.smithi194.stdout:1/934: chown d12/d3a/f6a 5010 1 2024-04-13T10:58:50.069 INFO:tasks.workunit.client.1.smithi194.stdout:1/935: chown d12/d13/d1c/d28/f49 235 1 2024-04-13T10:58:50.071 INFO:tasks.workunit.client.1.smithi194.stdout:1/936: getdents d12/d13/d1c/d28/df2/d8b/dd4 0 2024-04-13T10:58:50.072 INFO:tasks.workunit.client.1.smithi194.stdout:1/937: dread - d12/d13/d1c/d28/f121 zero size 2024-04-13T10:58:50.077 INFO:tasks.workunit.client.1.smithi194.stdout:1/938: dwrite d12/d13/d1c/f31 [0,4194304] 0 2024-04-13T10:58:50.083 INFO:tasks.workunit.client.1.smithi194.stdout:1/939: dwrite d12/d13/d3e/d108/f56 [0,4194304] 0 2024-04-13T10:58:50.087 INFO:tasks.workunit.client.1.smithi194.stdout:1/940: dread d12/d3a/fc2 [0,4194304] 0 2024-04-13T10:58:50.088 INFO:tasks.workunit.client.1.smithi194.stdout:1/941: chown d12/d13/d44/db5/f10e 159895206 1 2024-04-13T10:58:50.093 INFO:tasks.workunit.client.1.smithi194.stdout:1/942: dread d12/d13/d3e/d108/f56 [0,4194304] 0 2024-04-13T10:58:50.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.112+0000 7fcfc43f3700 1 -- 172.21.15.134:0/552852234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc100be0 msgr2=0x7fcfbc102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:50.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.112+0000 7fcfc43f3700 1 --2- 172.21.15.134:0/552852234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc100be0 0x7fcfbc102fc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009910 tx=0x7fcfb8009c20 comp rx=0 tx=0).stop 2024-04-13T10:58:50.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.112+0000 7fcfc43f3700 1 -- 172.21.15.134:0/552852234 shutdown_connections 2024-04-13T10:58:50.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.112+0000 7fcfc43f3700 1 --2- 172.21.15.134:0/552852234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc103500 0x7fcfbc1058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.112+0000 7fcfc43f3700 1 --2- 172.21.15.134:0/552852234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc100be0 0x7fcfbc102fc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.112+0000 7fcfc43f3700 1 -- 172.21.15.134:0/552852234 >> 172.21.15.134:0/552852234 conn(0x7fcfbc0fa5e0 msgr2=0x7fcfbc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:50.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.112+0000 7fcfc43f3700 1 -- 172.21.15.134:0/552852234 shutdown_connections 2024-04-13T10:58:50.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.112+0000 7fcfc43f3700 1 -- 172.21.15.134:0/552852234 wait complete. 2024-04-13T10:58:50.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.113+0000 7fcfc43f3700 1 Processor -- start 2024-04-13T10:58:50.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.113+0000 7fcfc43f3700 1 -- start start 2024-04-13T10:58:50.115 INFO:tasks.workunit.client.1.smithi194.stdout:1/943: dwrite d12/d3a/d4f/f63 [4194304,4194304] 0 2024-04-13T10:58:50.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.113+0000 7fcfc43f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc100be0 0x7fcfbc195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:50.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.113+0000 7fcfc43f3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc103500 0x7fcfbc195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:50.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.113+0000 7fcfc43f3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc1963a0 con 0x7fcfbc100be0 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.113+0000 7fcfc43f3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc1964e0 con 0x7fcfbc103500 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.113+0000 7fcfc218f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc100be0 0x7fcfbc195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.113+0000 7fcfc218f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc100be0 0x7fcfbc195840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33952/0 (socket says 172.21.15.134:33952) 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.113+0000 7fcfc218f700 1 -- 172.21.15.134:0/4158877394 learned_addr learned my addr 172.21.15.134:0/4158877394 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.113+0000 7fcfc198e700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc103500 0x7fcfbc195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.114+0000 7fcfc218f700 1 -- 172.21.15.134:0/4158877394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc103500 msgr2=0x7fcfbc195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.114+0000 7fcfc218f700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc103500 0x7fcfbc195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.114+0000 7fcfc218f700 1 -- 172.21.15.134:0/4158877394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80095f0 con 0x7fcfbc100be0 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.114+0000 7fcfc218f700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc100be0 0x7fcfbc195840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800bde0 tx=0x7fcfb800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.114+0000 7fcfb37fe700 1 -- 172.21.15.134:0/4158877394 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb801d070 con 0x7fcfbc100be0 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.114+0000 7fcfb37fe700 1 -- 172.21.15.134:0/4158877394 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fcfb8005dc0 con 0x7fcfbc100be0 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.114+0000 7fcfc43f3700 1 -- 172.21.15.134:0/4158877394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc19af30 con 0x7fcfbc100be0 2024-04-13T10:58:50.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.114+0000 7fcfb37fe700 1 -- 172.21.15.134:0/4158877394 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb8003b10 con 0x7fcfbc100be0 2024-04-13T10:58:50.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.114+0000 7fcfc43f3700 1 -- 172.21.15.134:0/4158877394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc19b3c0 con 0x7fcfbc100be0 2024-04-13T10:58:50.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.115+0000 7fcfc43f3700 1 -- 172.21.15.134:0/4158877394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc18fa30 con 0x7fcfbc100be0 2024-04-13T10:58:50.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.116+0000 7fcfb37fe700 1 -- 172.21.15.134:0/4158877394 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 90946+0+0 (secure 0 0 0) 0x7fcfb80048e0 con 0x7fcfbc100be0 2024-04-13T10:58:50.118 INFO:tasks.workunit.client.1.smithi194.stdout:1/944: mkdir d12/d13/d12f/d136 0 2024-04-13T10:58:50.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.116+0000 7fcfb37fe700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fcfa806ce20 0x7fcfa806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:50.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.117+0000 7fcfb37fe700 1 -- 172.21.15.134:0/4158877394 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fcfb808dd90 con 0x7fcfbc100be0 2024-04-13T10:58:50.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.117+0000 7fcfc198e700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fcfa806ce20 0x7fcfa806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:50.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.118+0000 7fcfc198e700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fcfa806ce20 0x7fcfa806f2d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009c60 tx=0x7fcfac009260 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:50.121 INFO:tasks.workunit.client.1.smithi194.stdout:1/945: getdents d12/d13/d1c/d28 0 2024-04-13T10:58:50.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.123+0000 7fcfb37fe700 1 -- 172.21.15.134:0/4158877394 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fcfb805b870 con 0x7fcfbc100be0 2024-04-13T10:58:50.124 INFO:tasks.workunit.client.1.smithi194.stdout:1/946: mkdir d12/d13/d1c/d28/d41/d77/d80/dc9/d137 0 2024-04-13T10:58:50.125 INFO:tasks.workunit.client.1.smithi194.stdout:1/947: chown d12/d13/d1c/d28/df2/d8b 1 1 2024-04-13T10:58:50.127 INFO:tasks.workunit.client.1.smithi194.stdout:3/894: sync 2024-04-13T10:58:50.130 INFO:tasks.workunit.client.1.smithi194.stdout:3/895: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/d103/f133 x:0 0 0 2024-04-13T10:58:50.137 INFO:tasks.workunit.client.1.smithi194.stdout:1/948: dwrite d12/d13/d1c/d28/df2/fd0 [0,4194304] 0 2024-04-13T10:58:50.138 INFO:tasks.workunit.client.1.smithi194.stdout:3/896: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d72/f8c [0,4194304] 0 2024-04-13T10:58:50.139 INFO:tasks.workunit.client.1.smithi194.stdout:1/949: stat d12/d13/d3e/d108/c7a 0 2024-04-13T10:58:50.145 INFO:tasks.workunit.client.1.smithi194.stdout:3/897: dwrite d2/d7d/de6/f109 [0,4194304] 0 2024-04-13T10:58:50.148 INFO:tasks.workunit.client.1.smithi194.stdout:1/950: rename d12/d13/d1c/d28/df2/d8b/dd4/ded/d11e/d132 to d12/d13/d1c/d28/df2/d101/d138 0 2024-04-13T10:58:50.149 INFO:tasks.workunit.client.1.smithi194.stdout:3/898: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/d103/f134 x:0 0 0 2024-04-13T10:58:50.152 INFO:tasks.workunit.client.1.smithi194.stdout:1/951: mkdir d12/d13/d1c/d28/df2/d8b/db2/df7/d139 0 2024-04-13T10:58:50.153 INFO:tasks.workunit.client.1.smithi194.stdout:3/899: mknod d2/d7d/dff/d123/c135 0 2024-04-13T10:58:50.154 INFO:tasks.workunit.client.1.smithi194.stdout:1/952: creat d12/d13/d1c/d28/df2/d8b/dd4/ded/f13a x:0 0 0 2024-04-13T10:58:50.155 INFO:tasks.workunit.client.1.smithi194.stdout:3/900: mknod d2/d3/d12/d31/d34/d88/c136 0 2024-04-13T10:58:50.156 INFO:tasks.workunit.client.1.smithi194.stdout:1/953: unlink d12/d13/d44/f99 0 2024-04-13T10:58:50.157 INFO:tasks.workunit.client.1.smithi194.stdout:1/954: stat d12/d13/d1c/d28/df2/d101/fdc 0 2024-04-13T10:58:50.158 INFO:tasks.workunit.client.1.smithi194.stdout:1/955: chown d12/d13/d1c/d28/d41/d77/d80/dc9 1601841 1 2024-04-13T10:58:50.159 INFO:tasks.workunit.client.1.smithi194.stdout:1/956: read d12/d13/d1c/d28/d41/d77/d93/dfc/f111 [4141230,76053] 0 2024-04-13T10:58:50.173 INFO:tasks.workunit.client.1.smithi194.stdout:3/901: dwrite d2/d3/d12/d31/d34/d88/d24/d6c/fd0 [0,4194304] 0 2024-04-13T10:58:50.173 INFO:tasks.workunit.client.1.smithi194.stdout:1/957: dwrite d12/d13/d3e/f66 [0,4194304] 0 2024-04-13T10:58:50.177 INFO:tasks.workunit.client.1.smithi194.stdout:1/958: fdatasync d12/d3a/d4f/da3/df1/f12d 0 2024-04-13T10:58:50.179 INFO:tasks.workunit.client.1.smithi194.stdout:3/902: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d137 0 2024-04-13T10:58:50.180 INFO:tasks.workunit.client.1.smithi194.stdout:1/959: creat d12/d13/d1c/d28/df2/d101/d138/f13b x:0 0 0 2024-04-13T10:58:50.181 INFO:tasks.workunit.client.1.smithi194.stdout:3/903: fdatasync d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df0/f107 0 2024-04-13T10:58:50.183 INFO:tasks.workunit.client.1.smithi194.stdout:3/904: fdatasync d2/d3/d12/d31/d34/d88/d24/f38 0 2024-04-13T10:58:50.184 INFO:tasks.workunit.client.1.smithi194.stdout:1/960: fdatasync d12/d13/d1c/d28/df2/d101/f95 0 2024-04-13T10:58:50.185 INFO:tasks.workunit.client.1.smithi194.stdout:1/961: stat d12/d3a/d4f/da3/d107 0 2024-04-13T10:58:50.188 INFO:tasks.workunit.client.1.smithi194.stdout:1/962: mknod d12/d13/d1c/d27/d4c/c13c 0 2024-04-13T10:58:50.191 INFO:tasks.workunit.client.1.smithi194.stdout:3/905: dwrite d2/de/f120 [0,4194304] 0 2024-04-13T10:58:50.191 INFO:tasks.workunit.client.1.smithi194.stdout:1/963: symlink d12/d13/d1c/d28/d41/d77/d80/dc9/d137/l13d 0 2024-04-13T10:58:50.197 INFO:tasks.workunit.client.1.smithi194.stdout:3/906: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d11f/f138 x:0 0 0 2024-04-13T10:58:50.199 INFO:tasks.workunit.client.1.smithi194.stdout:3/907: write d2/d3/d12/d31/d34/d88/d24/d82/f112 [154873,59850] 0 2024-04-13T10:58:50.203 INFO:tasks.workunit.client.1.smithi194.stdout:1/964: dwrite d12/d13/fb9 [0,4194304] 0 2024-04-13T10:58:50.210 INFO:tasks.workunit.client.1.smithi194.stdout:3/908: rmdir d2/d3/d12/d31/d34/d88/d24 39 2024-04-13T10:58:50.211 INFO:tasks.workunit.client.1.smithi194.stdout:1/965: dwrite d12/d13/d1c/d28/d41/ff8 [0,4194304] 0 2024-04-13T10:58:50.214 INFO:tasks.workunit.client.1.smithi194.stdout:3/909: mkdir d2/de/d139 0 2024-04-13T10:58:50.219 INFO:tasks.workunit.client.1.smithi194.stdout:1/966: rename d12/d13/d1c/d28/d41/c97 to d12/d3a/c13e 0 2024-04-13T10:58:50.219 INFO:tasks.workunit.client.1.smithi194.stdout:3/910: creat d2/dce/ddc/f13a x:0 0 0 2024-04-13T10:58:50.219 INFO:tasks.workunit.client.1.smithi194.stdout:3/911: chown d2/de 0 1 2024-04-13T10:58:50.225 INFO:tasks.workunit.client.1.smithi194.stdout:3/912: dwrite d2/d3/d12/d21/fa7 [0,4194304] 0 2024-04-13T10:58:50.230 INFO:tasks.workunit.client.1.smithi194.stdout:3/913: getdents d2/d3/d12/d31/d34/d88/d24/d3a/d72 0 2024-04-13T10:58:50.232 INFO:tasks.workunit.client.1.smithi194.stdout:3/914: chown d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/fa3 870364408 1 2024-04-13T10:58:50.235 INFO:tasks.workunit.client.1.smithi194.stdout:3/915: unlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d11f/f138 0 2024-04-13T10:58:50.240 INFO:tasks.workunit.client.1.smithi194.stdout:3/916: dwrite d2/d7d/de6/f109 [0,4194304] 0 2024-04-13T10:58:50.256 INFO:tasks.workunit.client.1.smithi194.stdout:1/967: write d12/d13/d1c/d27/d5c/f114 [2394916,66275] 0 2024-04-13T10:58:50.259 INFO:tasks.workunit.client.1.smithi194.stdout:1/968: fsync d12/d13/d1c/d28/df2/d101/f95 0 2024-04-13T10:58:50.261 INFO:tasks.workunit.client.1.smithi194.stdout:1/969: fsync d12/d13/d1c/d28/d41/d50/d96/fec 0 2024-04-13T10:58:50.262 INFO:tasks.workunit.client.1.smithi194.stdout:3/917: dwrite d2/d3/d12/f63 [0,4194304] 0 2024-04-13T10:58:50.263 INFO:tasks.workunit.client.1.smithi194.stdout:1/970: dread d12/d13/d1c/d28/df2/d101/f95 [0,4194304] 0 2024-04-13T10:58:50.267 INFO:tasks.workunit.client.1.smithi194.stdout:1/971: unlink d12/d13/fb9 0 2024-04-13T10:58:50.270 INFO:tasks.workunit.client.1.smithi194.stdout:1/972: rename d12/d13/d3e/c117 to d12/d3a/d4f/da3/d107/d10f/dfb/d115/c13f 0 2024-04-13T10:58:50.272 INFO:tasks.workunit.client.1.smithi194.stdout:1/973: creat d12/d13/d1c/d27/d5c/db6/f140 x:0 0 0 2024-04-13T10:58:50.277 INFO:tasks.workunit.client.1.smithi194.stdout:1/974: dread d12/d13/d1c/d27/f86 [0,4194304] 0 2024-04-13T10:58:50.283 INFO:tasks.workunit.client.1.smithi194.stdout:1/975: truncate d12/d3a/fc2 89895 0 2024-04-13T10:58:50.284 INFO:tasks.workunit.client.1.smithi194.stdout:3/918: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/fb8 [0,4194304] 0 2024-04-13T10:58:50.285 INFO:tasks.workunit.client.1.smithi194.stdout:1/976: truncate d12/d13/d1c/d28/df2/d101/d138/f13b 625208 0 2024-04-13T10:58:50.286 INFO:tasks.workunit.client.1.smithi194.stdout:3/919: mknod d2/d3/c13b 0 2024-04-13T10:58:50.289 INFO:tasks.workunit.client.1.smithi194.stdout:3/920: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df8/l13c 0 2024-04-13T10:58:50.294 INFO:tasks.workunit.client.1.smithi194.stdout:3/921: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/f13d x:0 0 0 2024-04-13T10:58:50.295 INFO:tasks.workunit.client.1.smithi194.stdout:3/922: write d2/de/f102 [1574303,10055] 0 2024-04-13T10:58:50.296 INFO:tasks.workunit.client.1.smithi194.stdout:3/923: chown d2/d3/d12/d31/d34/d88/d24/d82 56734 1 2024-04-13T10:58:50.299 INFO:tasks.workunit.client.1.smithi194.stdout:3/924: fdatasync d2/d3/d12/d31/d34/d88/d24/d82/fde 0 2024-04-13T10:58:50.301 INFO:tasks.workunit.client.1.smithi194.stdout:3/925: mkdir d2/dce/ddc/df2/d10e/d13e 0 2024-04-13T10:58:50.307 INFO:tasks.workunit.client.1.smithi194.stdout:1/977: dread d12/d13/d1c/d28/df2/d8b/f8c [0,4194304] 0 2024-04-13T10:58:50.307 INFO:tasks.workunit.client.1.smithi194.stdout:3/926: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/fb3 [0,4194304] 0 2024-04-13T10:58:50.309 INFO:tasks.workunit.client.1.smithi194.stdout:3/927: chown d2/d3/d12/d31/d34/l47 19 1 2024-04-13T10:58:50.309 INFO:tasks.workunit.client.1.smithi194.stdout:1/978: getdents d12/d13/d1c/d28/d12c 0 2024-04-13T10:58:50.316 INFO:tasks.workunit.client.1.smithi194.stdout:3/928: rename d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/cd5 to d2/d3/d12/d31/d34/d88/d24/d82/c13f 0 2024-04-13T10:58:50.318 INFO:tasks.workunit.client.1.smithi194.stdout:3/929: symlink d2/d3/d12/d31/d34/l140 0 2024-04-13T10:58:50.326 INFO:tasks.workunit.client.1.smithi194.stdout:3/930: chown d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6 11 1 2024-04-13T10:58:50.327 INFO:tasks.workunit.client.1.smithi194.stdout:1/979: dwrite d12/d13/d1c/d28/df2/d8b/f10d [0,4194304] 0 2024-04-13T10:58:50.332 INFO:tasks.workunit.client.1.smithi194.stdout:3/931: rename d2/d3/d12/d31/d34/d88/lec to d2/d3/d12/d31/d34/d88/d24/dd2/l141 0 2024-04-13T10:58:50.332 INFO:tasks.workunit.client.1.smithi194.stdout:1/980: write d12/d13/d1c/f21 [1243680,110028] 0 2024-04-13T10:58:50.336 INFO:tasks.workunit.client.1.smithi194.stdout:3/932: rename d2/d3/f43 to d2/de/f142 0 2024-04-13T10:58:50.339 INFO:tasks.workunit.client.1.smithi194.stdout:1/981: rename d12/d13/d1c/d28/c91 to d12/d13/d1c/d27/d5c/c141 0 2024-04-13T10:58:50.340 INFO:tasks.workunit.client.1.smithi194.stdout:3/933: mknod d2/d3/d12/d31/d34/d88/d24/d3a/c143 0 2024-04-13T10:58:50.345 INFO:tasks.workunit.client.1.smithi194.stdout:1/982: unlink d12/d13/d1c/d27/d5c/db6/fdb 0 2024-04-13T10:58:50.346 INFO:tasks.workunit.client.1.smithi194.stdout:3/934: rmdir d2/de 39 2024-04-13T10:58:50.348 INFO:tasks.workunit.client.1.smithi194.stdout:1/983: dread d12/d13/d1c/d28/d41/ff8 [0,4194304] 0 2024-04-13T10:58:50.349 INFO:tasks.workunit.client.1.smithi194.stdout:3/935: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5/f144 x:0 0 0 2024-04-13T10:58:50.352 INFO:tasks.workunit.client.1.smithi194.stdout:1/984: rename d12/d13/d1c/d27/d4c/c6f to d12/d13/d1c/d28/d41/d50/c142 0 2024-04-13T10:58:50.353 INFO:tasks.workunit.client.1.smithi194.stdout:1/985: mkdir d12/d3a/d4f/da3/df1/d143 0 2024-04-13T10:58:50.356 INFO:tasks.workunit.client.1.smithi194.stdout:3/936: dread d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/fa3 [0,4194304] 0 2024-04-13T10:58:50.360 INFO:tasks.workunit.client.1.smithi194.stdout:1/986: dwrite d12/d13/d1c/d27/d5c/db6/f140 [0,4194304] 0 2024-04-13T10:58:50.360 INFO:tasks.workunit.client.1.smithi194.stdout:3/937: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d137/f145 x:0 0 0 2024-04-13T10:58:50.362 INFO:tasks.workunit.client.1.smithi194.stdout:1/987: write d12/d13/d1c/d28/d41/d77/d93/f128 [442835,81297] 0 2024-04-13T10:58:50.364 INFO:tasks.workunit.client.1.smithi194.stdout:1/988: write d12/d3a/d4f/da3/df1/ff9 [495344,79561] 0 2024-04-13T10:58:50.365 INFO:tasks.workunit.client.1.smithi194.stdout:3/938: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d12e/l146 0 2024-04-13T10:58:50.367 INFO:tasks.workunit.client.1.smithi194.stdout:1/989: mkdir d12/d13/d44/d144 0 2024-04-13T10:58:50.369 INFO:tasks.workunit.client.1.smithi194.stdout:1/990: readlink d12/d13/d1c/d28/d41/d50/d96/lc1 0 2024-04-13T10:58:50.378 INFO:tasks.workunit.client.1.smithi194.stdout:3/939: dwrite d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/fac [0,4194304] 0 2024-04-13T10:58:50.378 INFO:tasks.workunit.client.1.smithi194.stdout:1/991: dwrite d12/d13/d3e/f2d [0,4194304] 0 2024-04-13T10:58:50.385 INFO:tasks.workunit.client.1.smithi194.stdout:3/940: rename d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/d103/f134 to d2/d3/d12/d21/f147 0 2024-04-13T10:58:50.390 INFO:tasks.workunit.client.1.smithi194.stdout:1/992: dwrite d12/d13/d44/f85 [8388608,4194304] 0 2024-04-13T10:58:50.392 INFO:tasks.workunit.client.1.smithi194.stdout:3/941: fdatasync d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/f12a 0 2024-04-13T10:58:50.394 INFO:tasks.workunit.client.1.smithi194.stdout:1/993: mkdir d12/d13/d12f/d145 0 2024-04-13T10:58:50.395 INFO:tasks.workunit.client.1.smithi194.stdout:3/942: mknod d2/d3/d12/d31/d34/d88/d24/d82/c148 0 2024-04-13T10:58:50.395 INFO:tasks.workunit.client.1.smithi194.stdout:1/994: mknod d12/d3a/d4f/da3/d107/c146 0 2024-04-13T10:58:50.397 INFO:tasks.workunit.client.1.smithi194.stdout:3/943: chown d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/c98 7157126 1 2024-04-13T10:58:50.397 INFO:tasks.workunit.client.1.smithi194.stdout:3/944: dread - d2/d3/d12/d31/d34/d88/d24/d82/fde zero size 2024-04-13T10:58:50.399 INFO:tasks.workunit.client.1.smithi194.stdout:1/995: symlink d12/d13/de7/l147 0 2024-04-13T10:58:50.401 INFO:tasks.workunit.client.1.smithi194.stdout:1/996: rename d12/d13/d1c/d27/d5c/f106 to d12/d3a/d4f/da3/d107/d10f/dfb/d115/f148 0 2024-04-13T10:58:50.403 INFO:tasks.workunit.client.1.smithi194.stdout:3/945: getdents d2/d3/d12/d31/d34/d88/d24/d3a 0 2024-04-13T10:58:50.404 INFO:tasks.workunit.client.1.smithi194.stdout:1/997: symlink d12/d13/d1c/d28/d41/d77/l149 0 2024-04-13T10:58:50.405 INFO:tasks.workunit.client.1.smithi194.stdout:3/946: chown d2/d3/d12/d31/d34/d88/d24/d6c/dc2/lf4 299 1 2024-04-13T10:58:50.406 INFO:tasks.workunit.client.1.smithi194.stdout:1/998: mknod d12/d3a/d4f/da3/d107/c14a 0 2024-04-13T10:58:50.407 INFO:tasks.workunit.client.1.smithi194.stdout:1/999: chown d12/d13/d1c/d28/d41/d77/d80/dc9/f102 1 1 2024-04-13T10:58:50.408 INFO:tasks.workunit.client.1.smithi194.stdout:3/947: dread d2/d3/d12/d31/f4f [0,4194304] 0 2024-04-13T10:58:50.411 INFO:tasks.workunit.client.1.smithi194.stdout:3/948: symlink d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/l149 0 2024-04-13T10:58:50.411 INFO:tasks.workunit.client.1.smithi194.stdout:3/949: dread - d2/f119 zero size 2024-04-13T10:58:50.412 INFO:tasks.workunit.client.1.smithi194.stdout:3/950: chown d2/d3/d12 0 1 2024-04-13T10:58:50.412 INFO:tasks.workunit.client.1.smithi194.stdout:3/951: readlink d2/d3/l111 0 2024-04-13T10:58:50.413 INFO:tasks.workunit.client.1.smithi194.stdout:3/952: chown d2/d3/d12/d31/d34/d88/d24/d82/d11a/cd3 305118 1 2024-04-13T10:58:50.415 INFO:tasks.workunit.client.1.smithi194.stdout:3/953: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df8/d14a 0 2024-04-13T10:58:50.416 INFO:tasks.workunit.client.1.smithi194.stdout:3/954: chown d2/d3/d12/d21/fed 53 1 2024-04-13T10:58:50.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.422+0000 7fcfc43f3700 1 -- 172.21.15.134:0/4158877394 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfbc061190 con 0x7fcfa806ce20 2024-04-13T10:58:50.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.423+0000 7fcfb37fe700 1 -- 172.21.15.134:0/4158877394 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fcfbc061190 con 0x7fcfa806ce20 2024-04-13T10:58:50.425 INFO:tasks.workunit.client.1.smithi194.stdout:3/955: truncate d2/d3/d12/d31/d34/d88/d24/d3a/d56/fbe 423051 0 2024-04-13T10:58:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 -- 172.21.15.134:0/4158877394 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fcfa806ce20 msgr2=0x7fcfa806f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fcfa806ce20 0x7fcfa806f2d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009c60 tx=0x7fcfac009260 comp rx=0 tx=0).stop 2024-04-13T10:58:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 -- 172.21.15.134:0/4158877394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc100be0 msgr2=0x7fcfbc195840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc100be0 0x7fcfbc195840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800bde0 tx=0x7fcfb800be10 comp rx=0 tx=0).stop 2024-04-13T10:58:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 -- 172.21.15.134:0/4158877394 shutdown_connections 2024-04-13T10:58:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fcfa806ce20 0x7fcfa806f2d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc100be0 0x7fcfbc195840 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 --2- 172.21.15.134:0/4158877394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfbc103500 0x7fcfbc195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 -- 172.21.15.134:0/4158877394 >> 172.21.15.134:0/4158877394 conn(0x7fcfbc0fa5e0 msgr2=0x7fcfbc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:50.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 -- 172.21.15.134:0/4158877394 shutdown_connections 2024-04-13T10:58:50.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.425+0000 7fcfc43f3700 1 -- 172.21.15.134:0/4158877394 wait complete. 2024-04-13T10:58:50.434 INFO:tasks.workunit.client.1.smithi194.stdout:3/956: dwrite d2/f118 [0,4194304] 0 2024-04-13T10:58:50.438 INFO:tasks.workunit.client.1.smithi194.stdout:3/957: creat d2/d3/d12/d31/d34/f14b x:0 0 0 2024-04-13T10:58:50.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.533+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3557095920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa178103500 msgr2=0x7fa1781058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:50.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.533+0000 7fa17e3ac700 1 --2- 172.21.15.134:0/3557095920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa178103500 0x7fa1781058e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009910 tx=0x7fa16c009c20 comp rx=0 tx=0).stop 2024-04-13T10:58:50.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.533+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3557095920 shutdown_connections 2024-04-13T10:58:50.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.533+0000 7fa17e3ac700 1 --2- 172.21.15.134:0/3557095920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa178103500 0x7fa1781058e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.533+0000 7fa17e3ac700 1 --2- 172.21.15.134:0/3557095920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa178100be0 0x7fa178102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.533+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3557095920 >> 172.21.15.134:0/3557095920 conn(0x7fa1780fa600 msgr2=0x7fa1780fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:50.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.533+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3557095920 shutdown_connections 2024-04-13T10:58:50.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.533+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3557095920 wait complete. 2024-04-13T10:58:50.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.534+0000 7fa17e3ac700 1 Processor -- start 2024-04-13T10:58:50.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.534+0000 7fa17e3ac700 1 -- start start 2024-04-13T10:58:50.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.534+0000 7fa17e3ac700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa178100be0 0x7fa178195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:50.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.534+0000 7fa17e3ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa178103500 0x7fa178195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:50.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.534+0000 7fa17e3ac700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178196390 con 0x7fa178103500 2024-04-13T10:58:50.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.534+0000 7fa17e3ac700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1781964d0 con 0x7fa178100be0 2024-04-13T10:58:50.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.534+0000 7fa1777fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa178103500 0x7fa178195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:50.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.534+0000 7fa1777fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa178103500 0x7fa178195d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33962/0 (socket says 172.21.15.134:33962) 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.534+0000 7fa1777fe700 1 -- 172.21.15.134:0/3003426814 learned_addr learned my addr 172.21.15.134:0/3003426814 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.534+0000 7fa177fff700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa178100be0 0x7fa178195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.535+0000 7fa1777fe700 1 -- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa178100be0 msgr2=0x7fa178195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.535+0000 7fa1777fe700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa178100be0 0x7fa178195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.535+0000 7fa1777fe700 1 -- 172.21.15.134:0/3003426814 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c0095f0 con 0x7fa178103500 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.535+0000 7fa177fff700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa178100be0 0x7fa178195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.535+0000 7fa1777fe700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa178103500 0x7fa178195d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00bde0 tx=0x7fa16c00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.535+0000 7fa1757fa700 1 -- 172.21.15.134:0/3003426814 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa16c01d070 con 0x7fa178103500 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.535+0000 7fa1757fa700 1 -- 172.21.15.134:0/3003426814 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fa16c005dc0 con 0x7fa178103500 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.535+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3003426814 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17819af20 con 0x7fa178103500 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.535+0000 7fa1757fa700 1 -- 172.21.15.134:0/3003426814 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa16c003b10 con 0x7fa178103500 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.535+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3003426814 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17819b400 con 0x7fa178103500 2024-04-13T10:58:50.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.536+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3003426814 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17818fa30 con 0x7fa178103500 2024-04-13T10:58:50.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.536+0000 7fa1757fa700 1 -- 172.21.15.134:0/3003426814 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 90946+0+0 (secure 0 0 0) 0x7fa16c0048e0 con 0x7fa178103500 2024-04-13T10:58:50.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.537+0000 7fa1757fa700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa16006ce20 0x7fa16006f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:50.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.537+0000 7fa1757fa700 1 -- 172.21.15.134:0/3003426814 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa16c08ddd0 con 0x7fa178103500 2024-04-13T10:58:50.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.537+0000 7fa177fff700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa16006ce20 0x7fa16006f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:50.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.537+0000 7fa177fff700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa16006ce20 0x7fa16006f2d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa168011490 tx=0x7fa168009260 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:50.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.541+0000 7fa1757fa700 1 -- 172.21.15.134:0/3003426814 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fa16c05b850 con 0x7fa178103500 2024-04-13T10:58:50.550 INFO:tasks.workunit.client.1.smithi194.stdout:3/958: sync 2024-04-13T10:58:50.556 INFO:tasks.workunit.client.1.smithi194.stdout:3/959: write d2/d3/d12/d31/d34/d88/d24/f90 [1753681,13447] 0 2024-04-13T10:58:50.558 INFO:tasks.workunit.client.1.smithi194.stdout:3/960: fsync d2/d7d/dff/f113 0 2024-04-13T10:58:50.561 INFO:tasks.workunit.client.1.smithi194.stdout:3/961: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5/f14c x:0 0 0 2024-04-13T10:58:50.563 INFO:tasks.workunit.client.1.smithi194.stdout:3/962: unlink d2/d3/d12/f71 0 2024-04-13T10:58:50.568 INFO:tasks.workunit.client.1.smithi194.stdout:3/963: write d2/d3/d12/d31/d34/d88/d24/d3a/d56/fbe [843015,110676] 0 2024-04-13T10:58:50.569 INFO:tasks.workunit.client.1.smithi194.stdout:3/964: dread - d2/d3/d12/d21/f147 zero size 2024-04-13T10:58:50.571 INFO:tasks.workunit.client.1.smithi194.stdout:3/965: creat d2/d3/d12/d31/d34/d88/d24/d82/d11a/f14d x:0 0 0 2024-04-13T10:58:50.574 INFO:tasks.workunit.client.1.smithi194.stdout:3/966: truncate d2/d3/d12/d31/d34/d88/d24/d3a/d65/f66 2862540 0 2024-04-13T10:58:50.576 INFO:tasks.workunit.client.1.smithi194.stdout:3/967: chown d2/d3/d12/d31/d34/d88/f2e 13 1 2024-04-13T10:58:50.624 INFO:tasks.workunit.client.1.smithi194.stdout:3/968: link d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dc6/ld4 d2/de/l14e 0 2024-04-13T10:58:50.626 INFO:tasks.workunit.client.1.smithi194.stdout:3/969: creat d2/d3/d12/d21/f14f x:0 0 0 2024-04-13T10:58:50.664 INFO:tasks.workunit.client.1.smithi194.stdout:3/970: write d2/d3/d12/f22 [811882,62046] 0 2024-04-13T10:58:50.665 INFO:tasks.workunit.client.1.smithi194.stdout:3/971: readlink d2/de/lc3 0 2024-04-13T10:58:50.668 INFO:tasks.workunit.client.1.smithi194.stdout:3/972: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95/f150 x:0 0 0 2024-04-13T10:58:50.670 INFO:tasks.workunit.client.1.smithi194.stdout:3/973: dread d2/de/f120 [0,4194304] 0 2024-04-13T10:58:50.684 INFO:tasks.workunit.client.1.smithi194.stdout:3/974: dread d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d61/f87 [0,4194304] 0 2024-04-13T10:58:50.684 INFO:tasks.workunit.client.1.smithi194.stdout:3/975: chown d2/d3/d12/d31/d34/d88/c62 2 1 2024-04-13T10:58:50.685 INFO:tasks.workunit.client.1.smithi194.stdout:3/976: write d2/dce/f12b [254931,97705] 0 2024-04-13T10:58:50.688 INFO:tasks.workunit.client.1.smithi194.stdout:3/977: dread d2/d3/d12/d31/d34/d88/d24/d82/f112 [0,4194304] 0 2024-04-13T10:58:50.690 INFO:tasks.workunit.client.1.smithi194.stdout:3/978: symlink d2/d3/d12/d31/d34/d88/d24/d82/l151 0 2024-04-13T10:58:50.692 INFO:tasks.workunit.client.1.smithi194.stdout:3/979: creat d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df0/f152 x:0 0 0 2024-04-13T10:58:50.693 INFO:tasks.workunit.client.1.smithi194.stdout:3/980: write d2/d3/d12/d31/d34/d88/d24/d6c/fd0 [1699163,69699] 0 2024-04-13T10:58:50.697 INFO:tasks.workunit.client.1.smithi194.stdout:3/981: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/d9d/dd7/d153 0 2024-04-13T10:58:50.698 INFO:tasks.workunit.client.1.smithi194.stdout:3/982: chown d2/d3/d12/d31/d34/d88/d24/d6c/l97 8620170 1 2024-04-13T10:58:50.700 INFO:tasks.workunit.client.1.smithi194.stdout:3/983: mkdir d2/dce/ddc/df2/d10e/d13e/d154 0 2024-04-13T10:58:50.701 INFO:tasks.workunit.client.1.smithi194.stdout:3/984: write d2/dce/f12b [634403,110108] 0 2024-04-13T10:58:50.703 INFO:tasks.workunit.client.1.smithi194.stdout:3/985: mkdir d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d6d/d80/da5/d155 0 2024-04-13T10:58:50.704 INFO:tasks.workunit.client.1.smithi194.stdout:3/986: readlink d2/d3/d12/d31/d34/d88/d24/d82/d11a/df3/l11c 0 2024-04-13T10:58:50.705 INFO:tasks.workunit.client.1.smithi194.stdout:3/987: chown d2/c7e 48977745 1 2024-04-13T10:58:50.705 INFO:tasks.workunit.client.1.smithi194.stdout:3/988: chown d2/d3/d12/d21/fe5 1581756 1 2024-04-13T10:58:50.705 INFO:tasks.workunit.client.1.smithi194.stdout:3/989: dread - d2/de/fb6 zero size 2024-04-13T10:58:50.709 INFO:tasks.workunit.client.1.smithi194.stdout:3/990: rename d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df8/l13c to d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/df8/l156 0 2024-04-13T10:58:50.709 INFO:tasks.workunit.client.1.smithi194.stdout:3/991: fsync d2/d3/d12/d31/d34/d88/d24/dd2/ffb 0 2024-04-13T10:58:50.713 INFO:tasks.workunit.client.1.smithi194.stdout:3/992: rename d2/d3/d12/d31/d34/d88/d24/cd1 to d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/d95/c157 0 2024-04-13T10:58:50.716 INFO:tasks.workunit.client.1.smithi194.stdout:3/993: rename d2/d3/d12/d31/d34/d88/d24/d3a/d72/fd8 to d2/d3/d12/d31/d34/d88/d24/d82/f158 0 2024-04-13T10:58:50.723 INFO:tasks.workunit.client.1.smithi194.stdout:3/994: getdents d2/d3/d12/d31/d34/d88/d24 0 2024-04-13T10:58:50.727 INFO:tasks.workunit.client.1.smithi194.stdout:3/995: truncate d2/f27 2970478 0 2024-04-13T10:58:50.729 INFO:tasks.workunit.client.1.smithi194.stdout:3/996: symlink d2/d3/d12/d21/l159 0 2024-04-13T10:58:50.732 INFO:tasks.workunit.client.1.smithi194.stdout:3/997: dread d2/d3/d12/d31/d34/d88/d24/d3a/f45 [0,4194304] 0 2024-04-13T10:58:50.735 INFO:tasks.workunit.client.1.smithi194.stdout:3/998: getdents d2/d7d/de6 0 2024-04-13T10:58:50.737 INFO:tasks.workunit.client.1.smithi194.stdout:3/999: truncate d2/d3/d12/d31/d34/d88/d24/d3a/d56/d67/d75/f105 766892 0 2024-04-13T10:58:50.740 INFO:tasks.workunit.client.1.smithi194.stderr:+ rm -rf -- ./tmp.RfMdsL6l8w 2024-04-13T10:58:50.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.807+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3003426814 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa178061190 con 0x7fa16006ce20 2024-04-13T10:58:50.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.818+0000 7fa1757fa700 1 -- 172.21.15.134:0/3003426814 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa178061190 con 0x7fa16006ce20 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (7m) 43s ago 9m 24.8M - 0.25.0 c8568f914cd2 8d2cf34cad2a 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (9m) 43s ago 9m 7734k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (8m) 46s ago 8m 7356k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (9m) 43s ago 9m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (8m) 46s ago 8m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (7m) 43s ago 8m 87.2M - 9.4.7 954c08fa6188 1038718f4fd4 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (3m) 43s ago 3m 98.9M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (3m) 43s ago 2m 123M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (2m) 46s ago 2m 13.0M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (3m) 46s ago 3m 16.8M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 starting - - - - 2024-04-13T10:58:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (63s) 46s ago 8m 480M - 18.2.2-1173-g5108bc67 3464fd31103e 870bcc3bd872 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (10m) 43s ago 10m 48.8M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (7m) 46s ago 7m 40.5M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (9m) 43s ago 9m 15.5M - 1.5.0 0da6a335fe13 da23f14cbdef 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (8m) 46s ago 8m 18.2M - 1.5.0 0da6a335fe13 242da19a461b 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (7m) 43s ago 7m 71.9M 1227M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (6m) 43s ago 6m 70.6M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (6m) 43s ago 6m 66.4M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (5m) 46s ago 5m 73.6M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (5m) 46s ago 5m 68.9M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (4m) 46s ago 4m 71.7M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T10:58:50.821 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 starting - - - - 2024-04-13T10:58:50.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa16006ce20 msgr2=0x7fa16006f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:50.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa16006ce20 0x7fa16006f2d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa168011490 tx=0x7fa168009260 comp rx=0 tx=0).stop 2024-04-13T10:58:50.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3003426814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa178103500 msgr2=0x7fa178195d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:50.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa178103500 0x7fa178195d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00bde0 tx=0x7fa16c00be10 comp rx=0 tx=0).stop 2024-04-13T10:58:50.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3003426814 shutdown_connections 2024-04-13T10:58:50.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa16006ce20 0x7fa16006f2d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa178100be0 0x7fa178195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 --2- 172.21.15.134:0/3003426814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa178103500 0x7fa178195d70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3003426814 >> 172.21.15.134:0/3003426814 conn(0x7fa1780fa600 msgr2=0x7fa1780fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:50.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3003426814 shutdown_connections 2024-04-13T10:58:50.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.821+0000 7fa17e3ac700 1 -- 172.21.15.134:0/3003426814 wait complete. 2024-04-13T10:58:50.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:50 smithi134 ceph-mon[39696]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 103 MiB/s rd, 278 MiB/s wr, 551 op/s 2024-04-13T10:58:50.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.957+0000 7f327b8f3700 1 -- 172.21.15.134:0/2212473296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740fea50 msgr2=0x7f32740fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.957+0000 7f327b8f3700 1 --2- 172.21.15.134:0/2212473296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740fea50 0x7f32740fee60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3270009910 tx=0x7f3270009c20 comp rx=0 tx=0).stop 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.957+0000 7f327b8f3700 1 -- 172.21.15.134:0/2212473296 shutdown_connections 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.957+0000 7f327b8f3700 1 --2- 172.21.15.134:0/2212473296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff3a0 0x7f32740ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.957+0000 7f327b8f3700 1 --2- 172.21.15.134:0/2212473296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740fea50 0x7f32740fee60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.957+0000 7f327b8f3700 1 -- 172.21.15.134:0/2212473296 >> 172.21.15.134:0/2212473296 conn(0x7f32740fa5e0 msgr2=0x7f32740fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327b8f3700 1 -- 172.21.15.134:0/2212473296 shutdown_connections 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327b8f3700 1 -- 172.21.15.134:0/2212473296 wait complete. 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327b8f3700 1 Processor -- start 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327b8f3700 1 -- start start 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327b8f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740fea50 0x7f3274197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327b8f3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff3a0 0x7f3274197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:50.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327b8f3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32741985e0 con 0x7f32740fea50 2024-04-13T10:58:50.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327b8f3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3274198720 con 0x7f32740ff3a0 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327968f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740fea50 0x7f3274197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327968f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740fea50 0x7f3274197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33980/0 (socket says 172.21.15.134:33980) 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.958+0000 7f327968f700 1 -- 172.21.15.134:0/870098433 learned_addr learned my addr 172.21.15.134:0/870098433 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.959+0000 7f3278e8e700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff3a0 0x7f3274197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.959+0000 7f327968f700 1 -- 172.21.15.134:0/870098433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff3a0 msgr2=0x7f3274197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.959+0000 7f327968f700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff3a0 0x7f3274197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.959+0000 7f327968f700 1 -- 172.21.15.134:0/870098433 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32700095f0 con 0x7f32740fea50 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.959+0000 7f327968f700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740fea50 0x7f3274197a80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f327000bde0 tx=0x7f327000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.959+0000 7f326a7fc700 1 -- 172.21.15.134:0/870098433 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327001d070 con 0x7f32740fea50 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.959+0000 7f327b8f3700 1 -- 172.21.15.134:0/870098433 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327419d170 con 0x7f32740fea50 2024-04-13T10:58:50.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.959+0000 7f326a7fc700 1 -- 172.21.15.134:0/870098433 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f3270005dc0 con 0x7f32740fea50 2024-04-13T10:58:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.959+0000 7f326a7fc700 1 -- 172.21.15.134:0/870098433 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3270003b10 con 0x7f32740fea50 2024-04-13T10:58:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.959+0000 7f327b8f3700 1 -- 172.21.15.134:0/870098433 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327419d680 con 0x7f32740fea50 2024-04-13T10:58:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.960+0000 7f327b8f3700 1 -- 172.21.15.134:0/870098433 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327410ad40 con 0x7f32740fea50 2024-04-13T10:58:50.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.961+0000 7f326a7fc700 1 -- 172.21.15.134:0/870098433 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f32700048e0 con 0x7f32740fea50 2024-04-13T10:58:50.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.961+0000 7f326a7fc700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f326006ce20 0x7f326006f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:50.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.962+0000 7f326a7fc700 1 -- 172.21.15.134:0/870098433 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f327008dd60 con 0x7f32740fea50 2024-04-13T10:58:50.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.962+0000 7f3278e8e700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f326006ce20 0x7f326006f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:50.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.962+0000 7f3278e8e700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f326006ce20 0x7f326006f2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3264009c60 tx=0x7f3264009260 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:50.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:50.966+0000 7f326a7fc700 1 -- 172.21.15.134:0/870098433 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f327005b840 con 0x7f32740fea50 2024-04-13T10:58:50.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:50 smithi194 ceph-mon[46737]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 103 MiB/s rd, 278 MiB/s wr, 551 op/s 2024-04-13T10:58:51.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.385+0000 7f327b8f3700 1 -- 172.21.15.134:0/870098433 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f327419dd20 con 0x7f32740fea50 2024-04-13T10:58:51.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.385+0000 7f326a7fc700 1 -- 172.21.15.134:0/870098433 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f327005b3d0 con 0x7f32740fea50 2024-04-13T10:58:51.386 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:58:51.386 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T10:58:51.386 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T10:58:51.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:58:51.386 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T10:58:51.386 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T10:58:51.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:58:51.386 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T10:58:51.386 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T10:58:51.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:58:51.387 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T10:58:51.387 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T10:58:51.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:58:51.387 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T10:58:51.387 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-04-13T10:58:51.387 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T10:58:51.387 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T10:58:51.387 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:58:51.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 -- 172.21.15.134:0/870098433 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f326006ce20 msgr2=0x7f326006f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:51.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f326006ce20 0x7f326006f2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3264009c60 tx=0x7f3264009260 comp rx=0 tx=0).stop 2024-04-13T10:58:51.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 -- 172.21.15.134:0/870098433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740fea50 msgr2=0x7f3274197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:51.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740fea50 0x7f3274197a80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f327000bde0 tx=0x7f327000be10 comp rx=0 tx=0).stop 2024-04-13T10:58:51.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 -- 172.21.15.134:0/870098433 shutdown_connections 2024-04-13T10:58:51.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f326006ce20 0x7f326006f2d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:51.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740fea50 0x7f3274197a80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:51.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 --2- 172.21.15.134:0/870098433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff3a0 0x7f3274197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:51.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 -- 172.21.15.134:0/870098433 >> 172.21.15.134:0/870098433 conn(0x7f32740fa5e0 msgr2=0x7f3274107080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:51.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 -- 172.21.15.134:0/870098433 shutdown_connections 2024-04-13T10:58:51.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.388+0000 7f327b8f3700 1 -- 172.21.15.134:0/870098433 wait complete. 2024-04-13T10:58:51.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.509+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/135960087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f48100bb0 msgr2=0x7f4f48102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:51.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.509+0000 7f4f4d8ee700 1 --2- 172.21.15.134:0/135960087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f48100bb0 0x7f4f48102f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009910 tx=0x7f4f38009c20 comp rx=0 tx=0).stop 2024-04-13T10:58:51.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.509+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/135960087 shutdown_connections 2024-04-13T10:58:51.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.509+0000 7f4f4d8ee700 1 --2- 172.21.15.134:0/135960087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f481034d0 0x7f4f481058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:51.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.509+0000 7f4f4d8ee700 1 --2- 172.21.15.134:0/135960087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f48100bb0 0x7f4f48102f90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:51.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.509+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/135960087 >> 172.21.15.134:0/135960087 conn(0x7f4f480fa5f0 msgr2=0x7f4f480fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:51.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.509+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/135960087 shutdown_connections 2024-04-13T10:58:51.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.510+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/135960087 wait complete. 2024-04-13T10:58:51.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.510+0000 7f4f4d8ee700 1 Processor -- start 2024-04-13T10:58:51.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.510+0000 7f4f4d8ee700 1 -- start start 2024-04-13T10:58:51.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f4d8ee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f48100bb0 0x7f4f48195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:51.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f4d8ee700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f481034d0 0x7f4f48195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:51.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f4d8ee700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f481963a0 con 0x7f4f48100bb0 2024-04-13T10:58:51.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f4d8ee700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f481964e0 con 0x7f4f481034d0 2024-04-13T10:58:51.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f46ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f48100bb0 0x7f4f48195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:51.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f46ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f48100bb0 0x7f4f48195840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34000/0 (socket says 172.21.15.134:34000) 2024-04-13T10:58:51.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f467fc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f481034d0 0x7f4f48195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:51.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f46ffd700 1 -- 172.21.15.134:0/1213914824 learned_addr learned my addr 172.21.15.134:0/1213914824 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:58:51.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f467fc700 1 -- 172.21.15.134:0/1213914824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f48100bb0 msgr2=0x7f4f48195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:51.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f467fc700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f48100bb0 0x7f4f48195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:51.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f467fc700 1 -- 172.21.15.134:0/1213914824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f380095f0 con 0x7f4f481034d0 2024-04-13T10:58:51.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f46ffd700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f48100bb0 0x7f4f48195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T10:58:51.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.511+0000 7f4f467fc700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f481034d0 0x7f4f48195d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00e970 tx=0x7f4f3c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:51.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.512+0000 7f4f4c8ec700 1 -- 172.21.15.134:0/1213914824 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f3c00c9d0 con 0x7f4f481034d0 2024-04-13T10:58:51.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.512+0000 7f4f4c8ec700 1 -- 172.21.15.134:0/1213914824 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f4f3c010430 con 0x7f4f481034d0 2024-04-13T10:58:51.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.512+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/1213914824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4819af90 con 0x7f4f481034d0 2024-04-13T10:58:51.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.512+0000 7f4f4c8ec700 1 -- 172.21.15.134:0/1213914824 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f3c018630 con 0x7f4f481034d0 2024-04-13T10:58:51.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.512+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/1213914824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4819b530 con 0x7f4f481034d0 2024-04-13T10:58:51.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.513+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/1213914824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4818fa00 con 0x7f4f481034d0 2024-04-13T10:58:51.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.513+0000 7f4f4c8ec700 1 -- 172.21.15.134:0/1213914824 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f4f3c0105a0 con 0x7f4f481034d0 2024-04-13T10:58:51.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.514+0000 7f4f4c8ec700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f4f3006ce10 0x7f4f3006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:58:51.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.514+0000 7f4f4c8ec700 1 -- 172.21.15.134:0/1213914824 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4f3c014070 con 0x7f4f481034d0 2024-04-13T10:58:51.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.514+0000 7f4f46ffd700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f4f3006ce10 0x7f4f3006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:58:51.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.514+0000 7f4f46ffd700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f4f3006ce10 0x7f4f3006f2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009fd0 tx=0x7f4f3800b5a0 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:58:51.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.520+0000 7f4f4c8ec700 1 -- 172.21.15.134:0/1213914824 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f4f3c052990 con 0x7f4f481034d0 2024-04-13T10:58:51.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.841+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/1213914824 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f48061190 con 0x7f4f3006ce10 2024-04-13T10:58:51.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.842+0000 7f4f4c8ec700 1 -- 172.21.15.134:0/1213914824 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f4f48061190 con 0x7f4f3006ce10 2024-04-13T10:58:51.843 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:58:51.843 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T10:58:51.843 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T10:58:51.843 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-13T10:58:51.843 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-04-13T10:58:51.843 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "", 2024-04-13T10:58:51.843 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mgr daemons", 2024-04-13T10:58:51.843 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T10:58:51.843 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/1213914824 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f4f3006ce10 msgr2=0x7f4f3006f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f4f3006ce10 0x7f4f3006f2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009fd0 tx=0x7f4f3800b5a0 comp rx=0 tx=0).stop 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/1213914824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f481034d0 msgr2=0x7f4f48195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f481034d0 0x7f4f48195d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00e970 tx=0x7f4f3c00ec80 comp rx=0 tx=0).stop 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/1213914824 shutdown_connections 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f4f3006ce10 0x7f4f3006f2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f48100bb0 0x7f4f48195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 --2- 172.21.15.134:0/1213914824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f481034d0 0x7f4f48195d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/1213914824 >> 172.21.15.134:0/1213914824 conn(0x7f4f480fa5f0 msgr2=0x7f4f480fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/1213914824 shutdown_connections 2024-04-13T10:58:51.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:58:51.844+0000 7f4f4d8ee700 1 -- 172.21.15.134:0/1213914824 wait complete. 2024-04-13T10:58:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:51 smithi134 ceph-mon[39696]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:51 smithi134 ceph-mon[39696]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:51 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/870098433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:58:51.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:51 smithi194 ceph-mon[46737]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:51 smithi194 ceph-mon[46737]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:51 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/870098433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:58:52.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:52 smithi134 ceph-mon[39696]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:52.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:52 smithi134 ceph-mon[39696]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 84 MiB/s rd, 192 MiB/s wr, 396 op/s 2024-04-13T10:58:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:52 smithi194 ceph-mon[46737]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:52 smithi194 ceph-mon[46737]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 84 MiB/s rd, 192 MiB/s wr, 396 op/s 2024-04-13T10:58:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:53 smithi134 ceph-mon[39696]: from='client.24417 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:53.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:53 smithi194 ceph-mon[46737]: from='client.24417 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:58:54.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:54 smithi134 ceph-mon[39696]: pgmap v31: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 96 MiB/s rd, 229 MiB/s wr, 501 op/s 2024-04-13T10:58:54.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:54 smithi194 ceph-mon[46737]: pgmap v31: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 96 MiB/s rd, 229 MiB/s wr, 501 op/s 2024-04-13T10:58:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:56 smithi134 ceph-mon[39696]: pgmap v32: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 54 MiB/s rd, 132 MiB/s wr, 302 op/s 2024-04-13T10:58:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:56 smithi194 ceph-mon[46737]: pgmap v32: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 54 MiB/s rd, 132 MiB/s wr, 302 op/s 2024-04-13T10:58:57.948 INFO:tasks.workunit.client.0.smithi134.stdout:4/7: sync 2024-04-13T10:58:57.949 INFO:tasks.workunit.client.0.smithi134.stdout:4/8: truncate - no filename 2024-04-13T10:58:57.949 INFO:tasks.workunit.client.0.smithi134.stdout:4/9: fdatasync - no filename 2024-04-13T10:58:57.949 INFO:tasks.workunit.client.0.smithi134.stdout:4/10: dwrite - no filename 2024-04-13T10:58:57.949 INFO:tasks.workunit.client.0.smithi134.stdout:4/11: truncate - no filename 2024-04-13T10:58:57.949 INFO:tasks.workunit.client.0.smithi134.stdout:0/11: sync 2024-04-13T10:58:57.950 INFO:tasks.workunit.client.0.smithi134.stdout:6/38: sync 2024-04-13T10:58:57.950 INFO:tasks.workunit.client.0.smithi134.stdout:2/49: sync 2024-04-13T10:58:57.950 INFO:tasks.workunit.client.0.smithi134.stdout:9/8: sync 2024-04-13T10:58:57.950 INFO:tasks.workunit.client.0.smithi134.stdout:5/33: sync 2024-04-13T10:58:57.950 INFO:tasks.workunit.client.0.smithi134.stdout:3/39: sync 2024-04-13T10:58:57.950 INFO:tasks.workunit.client.0.smithi134.stdout:7/26: sync 2024-04-13T10:58:57.950 INFO:tasks.workunit.client.0.smithi134.stdout:1/25: sync 2024-04-13T10:58:57.950 INFO:tasks.workunit.client.0.smithi134.stdout:8/9: sync 2024-04-13T10:58:57.951 INFO:tasks.workunit.client.0.smithi134.stdout:7/27: rename da to da/dc 22 2024-04-13T10:58:57.951 INFO:tasks.workunit.client.0.smithi134.stdout:2/50: chown l2 3013 1 2024-04-13T10:58:57.951 INFO:tasks.workunit.client.0.smithi134.stdout:4/12: rename l0 to l1 0 2024-04-13T10:58:57.952 INFO:tasks.workunit.client.0.smithi134.stdout:4/13: rmdir - no directory 2024-04-13T10:58:57.952 INFO:tasks.workunit.client.0.smithi134.stdout:7/28: rename da to da/dd 22 2024-04-13T10:58:57.953 INFO:tasks.workunit.client.0.smithi134.stdout:0/12: mknod c3 0 2024-04-13T10:58:57.962 INFO:tasks.workunit.client.0.smithi134.stdout:5/34: dread f6 [0,4194304] 0 2024-04-13T10:58:57.962 INFO:tasks.workunit.client.0.smithi134.stdout:5/35: stat l4 0 2024-04-13T10:58:57.964 INFO:tasks.workunit.client.0.smithi134.stdout:4/14: readlink l1 0 2024-04-13T10:58:57.964 INFO:tasks.workunit.client.0.smithi134.stdout:4/15: dwrite - no filename 2024-04-13T10:58:57.964 INFO:tasks.workunit.client.0.smithi134.stdout:4/16: dwrite - no filename 2024-04-13T10:58:57.964 INFO:tasks.workunit.client.0.smithi134.stdout:4/17: dwrite - no filename 2024-04-13T10:58:57.964 INFO:tasks.workunit.client.0.smithi134.stdout:4/18: dwrite - no filename 2024-04-13T10:58:57.967 INFO:tasks.workunit.client.0.smithi134.stdout:9/9: rename l2 to l3 0 2024-04-13T10:58:57.970 INFO:tasks.workunit.client.0.smithi134.stdout:0/13: mkdir d4 0 2024-04-13T10:58:57.971 INFO:tasks.workunit.client.0.smithi134.stdout:2/51: write d5/d6/f8 [2269956,4010] 0 2024-04-13T10:58:57.974 INFO:tasks.workunit.client.0.smithi134.stdout:3/40: creat dc/fd x:0 0 0 2024-04-13T10:58:57.975 INFO:tasks.workunit.client.0.smithi134.stdout:5/36: symlink l7 0 2024-04-13T10:58:57.976 INFO:tasks.workunit.client.0.smithi134.stdout:3/41: stat f7 0 2024-04-13T10:58:57.977 INFO:tasks.workunit.client.0.smithi134.stdout:4/19: stat l1 0 2024-04-13T10:58:57.977 INFO:tasks.workunit.client.0.smithi134.stdout:4/20: truncate - no filename 2024-04-13T10:58:57.978 INFO:tasks.workunit.client.0.smithi134.stdout:9/10: creat f4 x:0 0 0 2024-04-13T10:58:57.979 INFO:tasks.workunit.client.0.smithi134.stdout:7/29: mknod da/ce 0 2024-04-13T10:58:57.981 INFO:tasks.workunit.client.0.smithi134.stdout:8/10: dwrite f0 [0,4194304] 0 2024-04-13T10:58:57.984 INFO:tasks.workunit.client.0.smithi134.stdout:9/11: write f4 [590495,94092] 0 2024-04-13T10:58:57.985 INFO:tasks.workunit.client.0.smithi134.stdout:0/14: chown c0 1 1 2024-04-13T10:58:57.986 INFO:tasks.workunit.client.0.smithi134.stdout:5/37: creat f8 x:0 0 0 2024-04-13T10:58:57.987 INFO:tasks.workunit.client.0.smithi134.stdout:1/26: dwrite f1 [0,4194304] 0 2024-04-13T10:58:57.988 INFO:tasks.workunit.client.0.smithi134.stdout:4/21: rename l1 to l2 0 2024-04-13T10:58:57.988 INFO:tasks.workunit.client.0.smithi134.stdout:6/39: dwrite d4/f6 [0,4194304] 0 2024-04-13T10:58:57.989 INFO:tasks.workunit.client.0.smithi134.stdout:3/42: read f0 [3283313,21979] 0 2024-04-13T10:58:57.992 INFO:tasks.workunit.client.0.smithi134.stdout:8/11: mknod c2 0 2024-04-13T10:58:57.993 INFO:tasks.workunit.client.0.smithi134.stdout:7/30: symlink da/lf 0 2024-04-13T10:58:57.998 INFO:tasks.workunit.client.0.smithi134.stdout:9/12: dread f4 [0,4194304] 0 2024-04-13T10:58:58.001 INFO:tasks.workunit.client.0.smithi134.stdout:1/27: dwrite f1 [0,4194304] 0 2024-04-13T10:58:58.003 INFO:tasks.workunit.client.0.smithi134.stdout:5/38: truncate f6 1086857 0 2024-04-13T10:58:58.007 INFO:tasks.workunit.client.0.smithi134.stdout:8/12: dwrite f0 [4194304,4194304] 0 2024-04-13T10:58:58.007 INFO:tasks.workunit.client.0.smithi134.stdout:2/52: write f1 [1034133,24968] 0 2024-04-13T10:58:58.009 INFO:tasks.workunit.client.0.smithi134.stdout:3/43: rename f5 to dc/fe 0 2024-04-13T10:58:58.012 INFO:tasks.workunit.client.0.smithi134.stdout:7/31: dread - f6 zero size 2024-04-13T10:58:58.014 INFO:tasks.workunit.client.0.smithi134.stdout:0/15: symlink d4/l5 0 2024-04-13T10:58:58.018 INFO:tasks.workunit.client.0.smithi134.stdout:4/22: rename l2 to l3 0 2024-04-13T10:58:58.018 INFO:tasks.workunit.client.0.smithi134.stdout:6/40: dread d4/f5 [0,4194304] 0 2024-04-13T10:58:58.022 INFO:tasks.workunit.client.0.smithi134.stdout:9/13: write f4 [667902,63602] 0 2024-04-13T10:58:58.022 INFO:tasks.workunit.client.0.smithi134.stdout:8/13: dread f0 [0,4194304] 0 2024-04-13T10:58:58.023 INFO:tasks.workunit.client.0.smithi134.stdout:2/53: dwrite d5/fd [0,4194304] 0 2024-04-13T10:58:58.024 INFO:tasks.workunit.client.0.smithi134.stdout:7/32: fdatasync f4 0 2024-04-13T10:58:58.024 INFO:tasks.workunit.client.0.smithi134.stdout:3/44: read fb [1381869,73157] 0 2024-04-13T10:58:58.027 INFO:tasks.workunit.client.0.smithi134.stdout:6/41: creat d4/f7 x:0 0 0 2024-04-13T10:58:58.027 INFO:tasks.workunit.client.0.smithi134.stdout:9/14: write f4 [1281551,117218] 0 2024-04-13T10:58:58.033 INFO:tasks.workunit.client.0.smithi134.stdout:2/54: dread d5/d6/f8 [0,4194304] 0 2024-04-13T10:58:58.034 INFO:tasks.workunit.client.0.smithi134.stdout:6/42: dread d4/f5 [4194304,4194304] 0 2024-04-13T10:58:58.038 INFO:tasks.workunit.client.0.smithi134.stdout:5/39: getdents . 0 2024-04-13T10:58:58.038 INFO:tasks.workunit.client.0.smithi134.stdout:5/40: fdatasync f8 0 2024-04-13T10:58:58.040 INFO:tasks.workunit.client.0.smithi134.stdout:3/45: truncate f4 5133952 0 2024-04-13T10:58:58.040 INFO:tasks.workunit.client.0.smithi134.stdout:3/46: chown c6 0 1 2024-04-13T10:58:58.043 INFO:tasks.workunit.client.0.smithi134.stdout:8/14: truncate f0 5929750 0 2024-04-13T10:58:58.046 INFO:tasks.workunit.client.0.smithi134.stdout:6/43: symlink d4/l8 0 2024-04-13T10:58:58.047 INFO:tasks.workunit.client.0.smithi134.stdout:1/28: dwrite f2 [0,4194304] 0 2024-04-13T10:58:58.048 INFO:tasks.workunit.client.0.smithi134.stdout:0/16: write f2 [895968,101303] 0 2024-04-13T10:58:58.051 INFO:tasks.workunit.client.0.smithi134.stdout:5/41: creat f9 x:0 0 0 2024-04-13T10:58:58.054 INFO:tasks.workunit.client.0.smithi134.stdout:3/47: mkdir dc/df 0 2024-04-13T10:58:58.063 INFO:tasks.workunit.client.0.smithi134.stdout:2/55: mkdir d5/de 0 2024-04-13T10:58:58.076 INFO:tasks.workunit.client.0.smithi134.stdout:1/29: mknod d3/ca 0 2024-04-13T10:58:58.076 INFO:tasks.workunit.client.0.smithi134.stdout:1/30: chown d3/d6 1165779 1 2024-04-13T10:58:58.076 INFO:tasks.workunit.client.0.smithi134.stdout:9/15: truncate f4 112127 0 2024-04-13T10:58:58.080 INFO:tasks.workunit.client.0.smithi134.stdout:5/42: symlink la 0 2024-04-13T10:58:58.083 INFO:tasks.workunit.client.0.smithi134.stdout:5/43: dread f2 [0,4194304] 0 2024-04-13T10:58:58.083 INFO:tasks.workunit.client.0.smithi134.stdout:2/56: unlink d5/d6/f8 0 2024-04-13T10:58:58.087 INFO:tasks.workunit.client.0.smithi134.stdout:6/44: write d4/f5 [5708228,110898] 0 2024-04-13T10:58:58.090 INFO:tasks.workunit.client.0.smithi134.stdout:1/31: truncate d3/f8 313870 0 2024-04-13T10:58:58.091 INFO:tasks.workunit.client.0.smithi134.stdout:6/45: dread d4/f6 [0,4194304] 0 2024-04-13T10:58:58.091 INFO:tasks.workunit.client.0.smithi134.stdout:6/46: readlink d4/l8 0 2024-04-13T10:58:58.095 INFO:tasks.workunit.client.0.smithi134.stdout:2/57: rmdir d5 39 2024-04-13T10:58:58.096 INFO:tasks.workunit.client.0.smithi134.stdout:1/32: dread f1 [4194304,4194304] 0 2024-04-13T10:58:58.098 INFO:tasks.workunit.client.0.smithi134.stdout:0/17: link c1 d4/c6 0 2024-04-13T10:58:58.100 INFO:tasks.workunit.client.0.smithi134.stdout:6/47: dwrite d4/f5 [8388608,4194304] 0 2024-04-13T10:58:58.103 INFO:tasks.workunit.client.0.smithi134.stdout:3/48: link fb dc/f10 0 2024-04-13T10:58:58.106 INFO:tasks.workunit.client.0.smithi134.stdout:1/33: dread f1 [4194304,4194304] 0 2024-04-13T10:58:58.106 INFO:tasks.workunit.client.0.smithi134.stdout:1/34: readlink - no filename 2024-04-13T10:58:58.106 INFO:tasks.workunit.client.0.smithi134.stdout:0/18: dread f2 [0,4194304] 0 2024-04-13T10:58:58.107 INFO:tasks.workunit.client.0.smithi134.stdout:1/35: chown f2 3 1 2024-04-13T10:58:58.107 INFO:tasks.workunit.client.0.smithi134.stdout:1/36: readlink - no filename 2024-04-13T10:58:58.115 INFO:tasks.workunit.client.0.smithi134.stdout:3/49: symlink dc/l11 0 2024-04-13T10:58:58.117 INFO:tasks.workunit.client.0.smithi134.stdout:8/15: truncate f0 5550835 0 2024-04-13T10:58:58.119 INFO:tasks.workunit.client.0.smithi134.stdout:6/48: fsync d4/f5 0 2024-04-13T10:58:58.121 INFO:tasks.workunit.client.0.smithi134.stdout:9/16: dwrite f4 [0,4194304] 0 2024-04-13T10:58:58.123 INFO:tasks.workunit.client.0.smithi134.stdout:0/19: mkdir d4/d7 0 2024-04-13T10:58:58.126 INFO:tasks.workunit.client.0.smithi134.stdout:2/58: mkdir d5/d6/df 0 2024-04-13T10:58:58.130 INFO:tasks.workunit.client.0.smithi134.stdout:3/50: dread f0 [0,4194304] 0 2024-04-13T10:58:58.131 INFO:tasks.workunit.client.0.smithi134.stdout:5/44: write f2 [4751962,71329] 0 2024-04-13T10:58:58.133 INFO:tasks.workunit.client.0.smithi134.stdout:6/49: mknod d4/c9 0 2024-04-13T10:58:58.136 INFO:tasks.workunit.client.0.smithi134.stdout:9/17: fsync f4 0 2024-04-13T10:58:58.137 INFO:tasks.workunit.client.0.smithi134.stdout:0/20: symlink d4/l8 0 2024-04-13T10:58:58.142 INFO:tasks.workunit.client.0.smithi134.stdout:5/45: creat fb x:0 0 0 2024-04-13T10:58:58.144 INFO:tasks.workunit.client.0.smithi134.stdout:6/50: mkdir d4/da 0 2024-04-13T10:58:58.145 INFO:tasks.workunit.client.0.smithi134.stdout:9/18: creat f5 x:0 0 0 2024-04-13T10:58:58.147 INFO:tasks.workunit.client.0.smithi134.stdout:0/21: mknod d4/c9 0 2024-04-13T10:58:58.148 INFO:tasks.workunit.client.0.smithi134.stdout:2/59: creat d5/de/f10 x:0 0 0 2024-04-13T10:58:58.149 INFO:tasks.workunit.client.0.smithi134.stdout:1/37: truncate d3/f8 1196426 0 2024-04-13T10:58:58.152 INFO:tasks.workunit.client.0.smithi134.stdout:9/19: stat l1 0 2024-04-13T10:58:58.152 INFO:tasks.workunit.client.0.smithi134.stdout:9/20: write f4 [234261,127267] 0 2024-04-13T10:58:58.153 INFO:tasks.workunit.client.0.smithi134.stdout:9/21: truncate f5 343325 0 2024-04-13T10:58:58.218 INFO:tasks.workunit.client.0.smithi134.stdout:0/22: write f2 [1914188,81140] 0 2024-04-13T10:58:58.221 INFO:tasks.workunit.client.0.smithi134.stdout:2/60: mknod d5/de/c11 0 2024-04-13T10:58:58.223 INFO:tasks.workunit.client.0.smithi134.stdout:1/38: creat d3/fb x:0 0 0 2024-04-13T10:58:58.224 INFO:tasks.workunit.client.0.smithi134.stdout:1/39: chown d3/d6 50728516 1 2024-04-13T10:58:58.224 INFO:tasks.workunit.client.0.smithi134.stdout:1/40: readlink - no filename 2024-04-13T10:58:58.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/23: dwrite f2 [0,4194304] 0 2024-04-13T10:58:58.227 INFO:tasks.workunit.client.0.smithi134.stdout:6/51: symlink d4/da/lb 0 2024-04-13T10:58:58.231 INFO:tasks.workunit.client.0.smithi134.stdout:9/22: creat f6 x:0 0 0 2024-04-13T10:58:58.231 INFO:tasks.workunit.client.0.smithi134.stdout:9/23: dread - f6 zero size 2024-04-13T10:58:58.232 INFO:tasks.workunit.client.0.smithi134.stdout:9/24: fdatasync f5 0 2024-04-13T10:58:58.236 INFO:tasks.workunit.client.0.smithi134.stdout:2/61: mkdir d5/de/d12 0 2024-04-13T10:58:58.237 INFO:tasks.workunit.client.0.smithi134.stdout:1/41: creat d3/d6/fc x:0 0 0 2024-04-13T10:58:58.237 INFO:tasks.workunit.client.0.smithi134.stdout:2/62: chown d5/d6/f9 1 1 2024-04-13T10:58:58.240 INFO:tasks.workunit.client.0.smithi134.stdout:6/52: symlink d4/lc 0 2024-04-13T10:58:58.242 INFO:tasks.workunit.client.0.smithi134.stdout:9/25: symlink l7 0 2024-04-13T10:58:58.243 INFO:tasks.workunit.client.0.smithi134.stdout:9/26: chown l3 444 1 2024-04-13T10:58:58.243 INFO:tasks.workunit.client.0.smithi134.stdout:9/27: readlink l0 0 2024-04-13T10:58:58.244 INFO:tasks.workunit.client.0.smithi134.stdout:1/42: mkdir d3/d6/dd 0 2024-04-13T10:58:58.245 INFO:tasks.workunit.client.0.smithi134.stdout:6/53: creat d4/fd x:0 0 0 2024-04-13T10:58:58.246 INFO:tasks.workunit.client.0.smithi134.stdout:6/54: dread - d4/f7 zero size 2024-04-13T10:58:58.246 INFO:tasks.workunit.client.0.smithi134.stdout:0/24: mkdir d4/d7/da 0 2024-04-13T10:58:58.246 INFO:tasks.workunit.client.0.smithi134.stdout:6/55: chown d4/da 1303 1 2024-04-13T10:58:58.247 INFO:tasks.workunit.client.0.smithi134.stdout:0/25: fsync f2 0 2024-04-13T10:58:58.247 INFO:tasks.workunit.client.0.smithi134.stdout:6/56: chown d4/l8 11 1 2024-04-13T10:58:58.251 INFO:tasks.workunit.client.0.smithi134.stdout:9/28: link f6 f8 0 2024-04-13T10:58:58.252 INFO:tasks.workunit.client.0.smithi134.stdout:9/29: read f4 [1502680,40267] 0 2024-04-13T10:58:58.255 INFO:tasks.workunit.client.0.smithi134.stdout:6/57: dwrite d4/f5 [4194304,4194304] 0 2024-04-13T10:58:58.257 INFO:tasks.workunit.client.0.smithi134.stdout:6/58: read - d4/fd zero size 2024-04-13T10:58:58.261 INFO:tasks.workunit.client.0.smithi134.stdout:3/51: dwrite f7 [0,4194304] 0 2024-04-13T10:58:58.261 INFO:tasks.workunit.client.0.smithi134.stdout:0/26: write f2 [961540,92924] 0 2024-04-13T10:58:58.264 INFO:tasks.workunit.client.0.smithi134.stdout:8/16: write f0 [5269881,37237] 0 2024-04-13T10:58:58.266 INFO:tasks.workunit.client.0.smithi134.stdout:3/52: rename f0 to dc/df/f12 0 2024-04-13T10:58:58.271 INFO:tasks.workunit.client.0.smithi134.stdout:8/17: dread f0 [0,4194304] 0 2024-04-13T10:58:58.272 INFO:tasks.workunit.client.0.smithi134.stdout:3/53: symlink dc/df/l13 0 2024-04-13T10:58:58.273 INFO:tasks.workunit.client.0.smithi134.stdout:5/46: write f1 [542034,97573] 0 2024-04-13T10:58:58.274 INFO:tasks.workunit.client.0.smithi134.stdout:5/47: dread - f9 zero size 2024-04-13T10:58:58.274 INFO:tasks.workunit.client.0.smithi134.stdout:5/48: dread - f9 zero size 2024-04-13T10:58:58.274 INFO:tasks.workunit.client.0.smithi134.stdout:5/49: rmdir - no directory 2024-04-13T10:58:58.276 INFO:tasks.workunit.client.0.smithi134.stdout:8/18: creat f3 x:0 0 0 2024-04-13T10:58:58.278 INFO:tasks.workunit.client.0.smithi134.stdout:3/54: dread f7 [0,4194304] 0 2024-04-13T10:58:58.278 INFO:tasks.workunit.client.0.smithi134.stdout:0/27: link c1 d4/cb 0 2024-04-13T10:58:58.279 INFO:tasks.workunit.client.0.smithi134.stdout:5/50: mkdir dc 0 2024-04-13T10:58:58.281 INFO:tasks.workunit.client.0.smithi134.stdout:8/19: creat f4 x:0 0 0 2024-04-13T10:58:58.283 INFO:tasks.workunit.client.0.smithi134.stdout:0/28: creat d4/fc x:0 0 0 2024-04-13T10:58:58.286 INFO:tasks.workunit.client.0.smithi134.stdout:5/51: getdents dc 0 2024-04-13T10:58:58.290 INFO:tasks.workunit.client.0.smithi134.stdout:5/52: symlink dc/ld 0 2024-04-13T10:58:58.293 INFO:tasks.workunit.client.0.smithi134.stdout:0/29: dwrite d4/fc [0,4194304] 0 2024-04-13T10:58:58.296 INFO:tasks.workunit.client.0.smithi134.stdout:0/30: read d4/fc [1050210,52087] 0 2024-04-13T10:58:58.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/20: dwrite f0 [0,4194304] 0 2024-04-13T10:58:58.300 INFO:tasks.workunit.client.0.smithi134.stdout:2/63: write f1 [5169657,76966] 0 2024-04-13T10:58:58.302 INFO:tasks.workunit.client.0.smithi134.stdout:5/53: dwrite f9 [0,4194304] 0 2024-04-13T10:58:58.303 INFO:tasks.workunit.client.0.smithi134.stdout:8/21: creat f5 x:0 0 0 2024-04-13T10:58:58.310 INFO:tasks.workunit.client.0.smithi134.stdout:5/54: creat dc/fe x:0 0 0 2024-04-13T10:58:58.316 INFO:tasks.workunit.client.0.smithi134.stdout:1/43: write d3/f9 [161359,65308] 0 2024-04-13T10:58:58.319 INFO:tasks.workunit.client.0.smithi134.stdout:5/55: rename la to dc/lf 0 2024-04-13T10:58:58.321 INFO:tasks.workunit.client.0.smithi134.stdout:0/31: getdents d4/d7 0 2024-04-13T10:58:58.321 INFO:tasks.workunit.client.0.smithi134.stdout:2/64: link d5/de/c11 d5/de/d12/c13 0 2024-04-13T10:58:58.323 INFO:tasks.workunit.client.0.smithi134.stdout:0/32: chown f2 31384621 1 2024-04-13T10:58:58.325 INFO:tasks.workunit.client.0.smithi134.stdout:1/44: symlink d3/d6/dd/le 0 2024-04-13T10:58:58.327 INFO:tasks.workunit.client.0.smithi134.stdout:1/45: chown f1 147027 1 2024-04-13T10:58:58.332 INFO:tasks.workunit.client.0.smithi134.stdout:1/46: creat d3/ff x:0 0 0 2024-04-13T10:58:58.333 INFO:tasks.workunit.client.0.smithi134.stdout:9/30: truncate f4 3727944 0 2024-04-13T10:58:58.337 INFO:tasks.workunit.client.0.smithi134.stdout:1/47: read d3/f8 [535474,96798] 0 2024-04-13T10:58:58.338 INFO:tasks.workunit.client.0.smithi134.stdout:5/56: dwrite f6 [0,4194304] 0 2024-04-13T10:58:58.351 INFO:tasks.workunit.client.0.smithi134.stdout:1/48: link d3/d6/f7 d3/d6/f10 0 2024-04-13T10:58:58.355 INFO:tasks.workunit.client.0.smithi134.stdout:3/55: dread dc/df/f12 [0,4194304] 0 2024-04-13T10:58:58.360 INFO:tasks.workunit.client.0.smithi134.stdout:2/65: rmdir d5/de 39 2024-04-13T10:58:58.362 INFO:tasks.workunit.client.0.smithi134.stdout:5/57: readlink dc/lf 0 2024-04-13T10:58:58.366 INFO:tasks.workunit.client.0.smithi134.stdout:3/56: fsync f7 0 2024-04-13T10:58:58.366 INFO:tasks.workunit.client.0.smithi134.stdout:0/33: truncate f2 1802985 0 2024-04-13T10:58:58.366 INFO:tasks.workunit.client.0.smithi134.stdout:1/49: dwrite d3/fb [0,4194304] 0 2024-04-13T10:58:58.369 INFO:tasks.workunit.client.0.smithi134.stdout:5/58: creat dc/f10 x:0 0 0 2024-04-13T10:58:58.370 INFO:tasks.workunit.client.0.smithi134.stdout:5/59: dread - fb zero size 2024-04-13T10:58:58.373 INFO:tasks.workunit.client.0.smithi134.stdout:1/50: symlink d3/d6/l11 0 2024-04-13T10:58:58.379 INFO:tasks.workunit.client.0.smithi134.stdout:9/31: dwrite f6 [0,4194304] 0 2024-04-13T10:58:58.380 INFO:tasks.workunit.client.0.smithi134.stdout:5/60: symlink dc/l11 0 2024-04-13T10:58:58.385 INFO:tasks.workunit.client.0.smithi134.stdout:2/66: getdents d5/d6/df 0 2024-04-13T10:58:58.386 INFO:tasks.workunit.client.0.smithi134.stdout:9/32: creat f9 x:0 0 0 2024-04-13T10:58:58.391 INFO:tasks.workunit.client.0.smithi134.stdout:2/67: unlink d5/fc 0 2024-04-13T10:58:58.391 INFO:tasks.workunit.client.0.smithi134.stdout:3/57: getdents dc/df 0 2024-04-13T10:58:58.395 INFO:tasks.workunit.client.0.smithi134.stdout:9/33: symlink la 0 2024-04-13T10:58:58.397 INFO:tasks.workunit.client.0.smithi134.stdout:3/58: unlink l1 0 2024-04-13T10:58:58.397 INFO:tasks.workunit.client.0.smithi134.stdout:1/51: dwrite d3/fb [0,4194304] 0 2024-04-13T10:58:58.399 INFO:tasks.workunit.client.0.smithi134.stdout:1/52: readlink d3/d6/l11 0 2024-04-13T10:58:58.401 INFO:tasks.workunit.client.0.smithi134.stdout:1/53: write f2 [5173931,6449] 0 2024-04-13T10:58:58.402 INFO:tasks.workunit.client.0.smithi134.stdout:9/34: mknod cb 0 2024-04-13T10:58:58.403 INFO:tasks.workunit.client.0.smithi134.stdout:5/61: dwrite f2 [0,4194304] 0 2024-04-13T10:58:58.404 INFO:tasks.workunit.client.0.smithi134.stdout:5/62: dread - fb zero size 2024-04-13T10:58:58.405 INFO:tasks.workunit.client.0.smithi134.stdout:9/35: write f9 [153898,107825] 0 2024-04-13T10:58:58.407 INFO:tasks.workunit.client.0.smithi134.stdout:9/36: write f8 [3709400,115046] 0 2024-04-13T10:58:58.407 INFO:tasks.workunit.client.0.smithi134.stdout:5/63: write f8 [261206,94846] 0 2024-04-13T10:58:58.415 INFO:tasks.workunit.client.0.smithi134.stdout:5/64: dread f6 [0,4194304] 0 2024-04-13T10:58:58.418 INFO:tasks.workunit.client.0.smithi134.stdout:3/59: stat f4 0 2024-04-13T10:58:58.420 INFO:tasks.workunit.client.0.smithi134.stdout:1/54: rmdir d3/d6/dd 39 2024-04-13T10:58:58.420 INFO:tasks.workunit.client.0.smithi134.stdout:5/65: dread f6 [0,4194304] 0 2024-04-13T10:58:58.422 INFO:tasks.workunit.client.0.smithi134.stdout:9/37: creat fc x:0 0 0 2024-04-13T10:58:58.422 INFO:tasks.workunit.client.0.smithi134.stdout:1/55: fsync d3/d6/fc 0 2024-04-13T10:58:58.422 INFO:tasks.workunit.client.0.smithi134.stdout:9/38: readlink l1 0 2024-04-13T10:58:58.423 INFO:tasks.workunit.client.0.smithi134.stdout:9/39: write f6 [2158010,85421] 0 2024-04-13T10:58:58.424 INFO:tasks.workunit.client.0.smithi134.stdout:9/40: write fc [1013019,2324] 0 2024-04-13T10:58:58.424 INFO:tasks.workunit.client.0.smithi134.stdout:0/34: truncate d4/fc 34839 0 2024-04-13T10:58:58.424 INFO:tasks.workunit.client.0.smithi134.stdout:9/41: rmdir - no directory 2024-04-13T10:58:58.426 INFO:tasks.workunit.client.0.smithi134.stdout:9/42: write fc [466306,84524] 0 2024-04-13T10:58:58.430 INFO:tasks.workunit.client.0.smithi134.stdout:5/66: mknod dc/c12 0 2024-04-13T10:58:58.431 INFO:tasks.workunit.client.0.smithi134.stdout:5/67: dread - dc/f10 zero size 2024-04-13T10:58:58.432 INFO:tasks.workunit.client.0.smithi134.stdout:5/68: readlink l4 0 2024-04-13T10:58:58.434 INFO:tasks.workunit.client.0.smithi134.stdout:5/69: dread - dc/f10 zero size 2024-04-13T10:58:58.434 INFO:tasks.workunit.client.0.smithi134.stdout:5/70: fdatasync dc/fe 0 2024-04-13T10:58:58.441 INFO:tasks.workunit.client.0.smithi134.stdout:9/43: creat fd x:0 0 0 2024-04-13T10:58:58.442 INFO:tasks.workunit.client.0.smithi134.stdout:9/44: write f5 [1238810,52827] 0 2024-04-13T10:58:58.443 INFO:tasks.workunit.client.0.smithi134.stdout:9/45: fdatasync f8 0 2024-04-13T10:58:58.444 INFO:tasks.workunit.client.0.smithi134.stdout:9/46: rmdir - no directory 2024-04-13T10:58:58.444 INFO:tasks.workunit.client.0.smithi134.stdout:5/71: creat dc/f13 x:0 0 0 2024-04-13T10:58:58.445 INFO:tasks.workunit.client.0.smithi134.stdout:1/56: symlink d3/d6/dd/l12 0 2024-04-13T10:58:58.445 INFO:tasks.workunit.client.0.smithi134.stdout:1/57: stat d3/d6 0 2024-04-13T10:58:58.446 INFO:tasks.workunit.client.0.smithi134.stdout:0/35: fsync f2 0 2024-04-13T10:58:58.446 INFO:tasks.workunit.client.0.smithi134.stdout:1/58: dread - d3/d6/fc zero size 2024-04-13T10:58:58.447 INFO:tasks.workunit.client.0.smithi134.stdout:1/59: read - d3/d6/fc zero size 2024-04-13T10:58:58.451 INFO:tasks.workunit.client.0.smithi134.stdout:9/47: rename f5 to fe 0 2024-04-13T10:58:58.454 INFO:tasks.workunit.client.0.smithi134.stdout:5/72: creat dc/f14 x:0 0 0 2024-04-13T10:58:58.455 INFO:tasks.workunit.client.0.smithi134.stdout:5/73: write f2 [222169,95053] 0 2024-04-13T10:58:58.455 INFO:tasks.workunit.client.0.smithi134.stdout:5/74: dread - dc/f14 zero size 2024-04-13T10:58:58.456 INFO:tasks.workunit.client.0.smithi134.stdout:5/75: fdatasync f8 0 2024-04-13T10:58:58.459 INFO:tasks.workunit.client.0.smithi134.stdout:2/68: write f1 [6042705,122127] 0 2024-04-13T10:58:58.460 INFO:tasks.workunit.client.0.smithi134.stdout:2/69: write d5/fd [6807785,127808] 0 2024-04-13T10:58:58.463 INFO:tasks.workunit.client.0.smithi134.stdout:1/60: creat d3/f13 x:0 0 0 2024-04-13T10:58:58.465 INFO:tasks.workunit.client.0.smithi134.stdout:9/48: rename l3 to lf 0 2024-04-13T10:58:58.466 INFO:tasks.workunit.client.0.smithi134.stdout:4/23: sync 2024-04-13T10:58:58.469 INFO:tasks.workunit.client.0.smithi134.stdout:9/49: dread f8 [0,4194304] 0 2024-04-13T10:58:58.469 INFO:tasks.workunit.client.0.smithi134.stdout:9/50: fdatasync f9 0 2024-04-13T10:58:58.470 INFO:tasks.workunit.client.0.smithi134.stdout:5/76: fdatasync f6 0 2024-04-13T10:58:58.475 INFO:tasks.workunit.client.0.smithi134.stdout:9/51: dread f6 [0,4194304] 0 2024-04-13T10:58:58.476 INFO:tasks.workunit.client.0.smithi134.stdout:1/61: symlink d3/l14 0 2024-04-13T10:58:58.476 INFO:tasks.workunit.client.0.smithi134.stdout:4/24: mkdir d4 0 2024-04-13T10:58:58.476 INFO:tasks.workunit.client.0.smithi134.stdout:5/77: dwrite f2 [0,4194304] 0 2024-04-13T10:58:58.484 INFO:tasks.workunit.client.0.smithi134.stdout:5/78: dread f2 [0,4194304] 0 2024-04-13T10:58:58.484 INFO:tasks.workunit.client.0.smithi134.stdout:1/62: dwrite f2 [0,4194304] 0 2024-04-13T10:58:58.484 INFO:tasks.workunit.client.0.smithi134.stdout:5/79: chown f1 103 1 2024-04-13T10:58:58.520 INFO:tasks.workunit.client.0.smithi134.stdout:2/70: creat d5/d6/df/f14 x:0 0 0 2024-04-13T10:58:58.523 INFO:tasks.workunit.client.0.smithi134.stdout:1/63: unlink d3/ca 0 2024-04-13T10:58:58.524 INFO:tasks.workunit.client.0.smithi134.stdout:1/64: chown d3/ff 45321532 1 2024-04-13T10:58:58.525 INFO:tasks.workunit.client.0.smithi134.stdout:5/80: mkdir dc/d15 0 2024-04-13T10:58:58.527 INFO:tasks.workunit.client.0.smithi134.stdout:5/81: write dc/f10 [746699,109587] 0 2024-04-13T10:58:58.529 INFO:tasks.workunit.client.0.smithi134.stdout:4/25: mknod d4/c5 0 2024-04-13T10:58:58.533 INFO:tasks.workunit.client.0.smithi134.stdout:0/36: dwrite d4/fc [0,4194304] 0 2024-04-13T10:58:58.536 INFO:tasks.workunit.client.0.smithi134.stdout:0/37: dread f2 [0,4194304] 0 2024-04-13T10:58:58.538 INFO:tasks.workunit.client.0.smithi134.stdout:0/38: dread f2 [0,4194304] 0 2024-04-13T10:58:58.538 INFO:tasks.workunit.client.0.smithi134.stdout:0/39: readlink d4/l8 0 2024-04-13T10:58:58.538 INFO:tasks.workunit.client.0.smithi134.stdout:4/26: mknod d4/c6 0 2024-04-13T10:58:58.539 INFO:tasks.workunit.client.0.smithi134.stdout:4/27: write - no filename 2024-04-13T10:58:58.543 INFO:tasks.workunit.client.0.smithi134.stdout:2/71: symlink d5/de/d12/l15 0 2024-04-13T10:58:58.547 INFO:tasks.workunit.client.0.smithi134.stdout:0/40: creat d4/d7/fd x:0 0 0 2024-04-13T10:58:58.550 INFO:tasks.workunit.client.0.smithi134.stdout:1/65: rename f1 to d3/d6/f15 0 2024-04-13T10:58:58.550 INFO:tasks.workunit.client.0.smithi134.stdout:9/52: write f4 [2954530,24579] 0 2024-04-13T10:58:58.551 INFO:tasks.workunit.client.0.smithi134.stdout:2/72: creat d5/de/f16 x:0 0 0 2024-04-13T10:58:58.552 INFO:tasks.workunit.client.0.smithi134.stdout:9/53: chown fd 922 1 2024-04-13T10:58:58.555 INFO:tasks.workunit.client.0.smithi134.stdout:4/28: unlink l3 0 2024-04-13T10:58:58.560 INFO:tasks.workunit.client.0.smithi134.stdout:5/82: rename f6 to dc/f16 0 2024-04-13T10:58:58.567 INFO:tasks.workunit.client.0.smithi134.stdout:9/54: creat f10 x:0 0 0 2024-04-13T10:58:58.569 INFO:tasks.workunit.client.0.smithi134.stdout:1/66: mkdir d3/d6/d16 0 2024-04-13T10:58:58.570 INFO:tasks.workunit.client.0.smithi134.stdout:1/67: read - d3/f13 zero size 2024-04-13T10:58:58.574 INFO:tasks.workunit.client.0.smithi134.stdout:0/41: rename f2 to d4/d7/da/fe 0 2024-04-13T10:58:58.574 INFO:tasks.workunit.client.0.smithi134.stdout:4/29: rename d4 to d4/d7 22 2024-04-13T10:58:58.575 INFO:tasks.workunit.client.0.smithi134.stdout:0/42: fsync d4/fc 0 2024-04-13T10:58:58.575 INFO:tasks.workunit.client.0.smithi134.stdout:4/30: stat d4/c6 0 2024-04-13T10:58:58.575 INFO:tasks.workunit.client.0.smithi134.stdout:4/31: dread - no filename 2024-04-13T10:58:58.575 INFO:tasks.workunit.client.0.smithi134.stdout:4/32: dread - no filename 2024-04-13T10:58:58.575 INFO:tasks.workunit.client.0.smithi134.stdout:4/33: dwrite - no filename 2024-04-13T10:58:58.575 INFO:tasks.workunit.client.0.smithi134.stdout:4/34: chown d4 247024 1 2024-04-13T10:58:58.576 INFO:tasks.workunit.client.0.smithi134.stdout:5/83: creat dc/f17 x:0 0 0 2024-04-13T10:58:58.577 INFO:tasks.workunit.client.0.smithi134.stdout:2/73: symlink d5/d6/l17 0 2024-04-13T10:58:58.581 INFO:tasks.workunit.client.0.smithi134.stdout:0/43: mknod d4/cf 0 2024-04-13T10:58:58.583 INFO:tasks.workunit.client.0.smithi134.stdout:4/35: mknod d4/c8 0 2024-04-13T10:58:58.583 INFO:tasks.workunit.client.0.smithi134.stdout:4/36: dwrite - no filename 2024-04-13T10:58:58.585 INFO:tasks.workunit.client.0.smithi134.stdout:2/74: mkdir d5/de/d18 0 2024-04-13T10:58:58.587 INFO:tasks.workunit.client.0.smithi134.stdout:2/75: chown d5/cb 23934362 1 2024-04-13T10:58:58.587 INFO:tasks.workunit.client.0.smithi134.stdout:9/55: rename l1 to l11 0 2024-04-13T10:58:58.587 INFO:tasks.workunit.client.0.smithi134.stdout:9/56: stat la 0 2024-04-13T10:58:58.588 INFO:tasks.workunit.client.0.smithi134.stdout:0/44: creat d4/d7/da/f10 x:0 0 0 2024-04-13T10:58:58.589 INFO:tasks.workunit.client.0.smithi134.stdout:4/37: rmdir d4 39 2024-04-13T10:58:58.589 INFO:tasks.workunit.client.0.smithi134.stdout:4/38: dread - no filename 2024-04-13T10:58:58.589 INFO:tasks.workunit.client.0.smithi134.stdout:9/57: read - fd zero size 2024-04-13T10:58:58.590 INFO:tasks.workunit.client.0.smithi134.stdout:5/84: symlink dc/d15/l18 0 2024-04-13T10:58:58.592 INFO:tasks.workunit.client.0.smithi134.stdout:1/68: dwrite d3/f9 [0,4194304] 0 2024-04-13T10:58:58.593 INFO:tasks.workunit.client.0.smithi134.stdout:5/85: truncate dc/fe 1032638 0 2024-04-13T10:58:58.594 INFO:tasks.workunit.client.0.smithi134.stdout:0/45: creat d4/f11 x:0 0 0 2024-04-13T10:58:58.594 INFO:tasks.workunit.client.0.smithi134.stdout:1/69: write d3/d6/f10 [3395570,77187] 0 2024-04-13T10:58:58.596 INFO:tasks.workunit.client.0.smithi134.stdout:2/76: dread f1 [0,4194304] 0 2024-04-13T10:58:58.597 INFO:tasks.workunit.client.0.smithi134.stdout:9/58: symlink l12 0 2024-04-13T10:58:58.597 INFO:tasks.workunit.client.0.smithi134.stdout:9/59: rmdir - no directory 2024-04-13T10:58:58.597 INFO:tasks.workunit.client.0.smithi134.stdout:9/60: dread - fd zero size 2024-04-13T10:58:58.598 INFO:tasks.workunit.client.0.smithi134.stdout:9/61: write fd [957365,122761] 0 2024-04-13T10:58:58.600 INFO:tasks.workunit.client.0.smithi134.stdout:4/39: unlink d4/c6 0 2024-04-13T10:58:58.603 INFO:tasks.workunit.client.0.smithi134.stdout:9/62: dread f8 [0,4194304] 0 2024-04-13T10:58:58.687 INFO:tasks.workunit.client.0.smithi134.stdout:4/40: creat d4/f9 x:0 0 0 2024-04-13T10:58:58.691 INFO:tasks.workunit.client.0.smithi134.stdout:2/77: dwrite d5/d6/f9 [0,4194304] 0 2024-04-13T10:58:58.693 INFO:tasks.workunit.client.0.smithi134.stdout:9/63: mkdir d13 0 2024-04-13T10:58:58.698 INFO:tasks.workunit.client.0.smithi134.stdout:4/41: unlink d4/f9 0 2024-04-13T10:58:58.698 INFO:tasks.workunit.client.0.smithi134.stdout:4/42: fdatasync - no filename 2024-04-13T10:58:58.698 INFO:tasks.workunit.client.0.smithi134.stdout:9/64: dread fe [0,4194304] 0 2024-04-13T10:58:58.700 INFO:tasks.workunit.client.0.smithi134.stdout:2/78: dwrite d5/fd [0,4194304] 0 2024-04-13T10:58:58.701 INFO:tasks.workunit.client.0.smithi134.stdout:2/79: read f1 [5818368,55558] 0 2024-04-13T10:58:58.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/80: write d5/d6/f9 [6863138,30612] 0 2024-04-13T10:58:58.702 INFO:tasks.workunit.client.0.smithi134.stdout:0/46: write d4/d7/da/fe [1571602,19385] 0 2024-04-13T10:58:58.704 INFO:tasks.workunit.client.0.smithi134.stdout:9/65: symlink d13/l14 0 2024-04-13T10:58:58.710 INFO:tasks.workunit.client.0.smithi134.stdout:2/81: dread d5/d6/fa [0,4194304] 0 2024-04-13T10:58:58.711 INFO:tasks.workunit.client.0.smithi134.stdout:0/47: link d4/cf d4/d7/c12 0 2024-04-13T10:58:58.714 INFO:tasks.workunit.client.0.smithi134.stdout:2/82: unlink d5/cb 0 2024-04-13T10:58:58.714 INFO:tasks.workunit.client.0.smithi134.stdout:9/66: link l0 d13/l15 0 2024-04-13T10:58:58.715 INFO:tasks.workunit.client.0.smithi134.stdout:2/83: write d5/de/f10 [218212,10448] 0 2024-04-13T10:58:58.716 INFO:tasks.workunit.client.0.smithi134.stdout:0/48: creat d4/f13 x:0 0 0 2024-04-13T10:58:58.716 INFO:tasks.workunit.client.0.smithi134.stdout:2/84: readlink l2 0 2024-04-13T10:58:58.718 INFO:tasks.workunit.client.0.smithi134.stdout:2/85: write d5/de/f10 [750255,40664] 0 2024-04-13T10:58:58.720 INFO:tasks.workunit.client.0.smithi134.stdout:2/86: dread - d5/de/f16 zero size 2024-04-13T10:58:58.721 INFO:tasks.workunit.client.0.smithi134.stdout:9/67: truncate f6 3754680 0 2024-04-13T10:58:58.724 INFO:tasks.workunit.client.0.smithi134.stdout:2/87: creat d5/de/f19 x:0 0 0 2024-04-13T10:58:58.726 INFO:tasks.workunit.client.0.smithi134.stdout:0/49: dwrite d4/d7/da/f10 [0,4194304] 0 2024-04-13T10:58:58.737 INFO:tasks.workunit.client.0.smithi134.stdout:9/68: dwrite fc [0,4194304] 0 2024-04-13T10:58:58.744 INFO:tasks.workunit.client.0.smithi134.stdout:0/50: dwrite d4/d7/fd [0,4194304] 0 2024-04-13T10:58:58.745 INFO:tasks.workunit.client.0.smithi134.stdout:2/88: dwrite f1 [4194304,4194304] 0 2024-04-13T10:58:58.746 INFO:tasks.workunit.client.0.smithi134.stdout:0/51: fsync d4/f11 0 2024-04-13T10:58:58.789 INFO:tasks.workunit.client.0.smithi134.stdout:2/89: symlink d5/d6/df/l1a 0 2024-04-13T10:58:58.792 INFO:tasks.workunit.client.0.smithi134.stdout:9/69: dwrite fd [0,4194304] 0 2024-04-13T10:58:58.793 INFO:tasks.workunit.client.0.smithi134.stdout:2/90: symlink d5/d6/df/l1b 0 2024-04-13T10:58:58.795 INFO:tasks.workunit.client.0.smithi134.stdout:0/52: dread d4/d7/da/f10 [0,4194304] 0 2024-04-13T10:58:58.797 INFO:tasks.workunit.client.0.smithi134.stdout:9/70: creat d13/f16 x:0 0 0 2024-04-13T10:58:58.797 INFO:tasks.workunit.client.0.smithi134.stdout:2/91: symlink d5/d6/df/l1c 0 2024-04-13T10:58:58.798 INFO:tasks.workunit.client.0.smithi134.stdout:2/92: stat d5/d6/f9 0 2024-04-13T10:58:58.798 INFO:tasks.workunit.client.0.smithi134.stdout:0/53: creat d4/d7/f14 x:0 0 0 2024-04-13T10:58:58.802 INFO:tasks.workunit.client.0.smithi134.stdout:0/54: unlink c1 0 2024-04-13T10:58:58.802 INFO:tasks.workunit.client.0.smithi134.stdout:2/93: dread d5/d6/fa [0,4194304] 0 2024-04-13T10:58:58.804 INFO:tasks.workunit.client.0.smithi134.stdout:0/55: creat d4/d7/da/f15 x:0 0 0 2024-04-13T10:58:58.805 INFO:tasks.workunit.client.0.smithi134.stdout:0/56: write d4/d7/da/fe [430825,111156] 0 2024-04-13T10:58:58.812 INFO:tasks.workunit.client.0.smithi134.stdout:2/94: getdents d5/de 0 2024-04-13T10:58:58.817 INFO:tasks.workunit.client.0.smithi134.stdout:0/57: getdents d4 0 2024-04-13T10:58:58.818 INFO:tasks.workunit.client.0.smithi134.stdout:0/58: fdatasync d4/d7/da/fe 0 2024-04-13T10:58:58.818 INFO:tasks.workunit.client.0.smithi134.stdout:2/95: link d5/de/f10 d5/de/d12/f1d 0 2024-04-13T10:58:58.819 INFO:tasks.workunit.client.0.smithi134.stdout:2/96: chown l2 2781662 1 2024-04-13T10:58:58.820 INFO:tasks.workunit.client.0.smithi134.stdout:0/59: mknod d4/d7/c16 0 2024-04-13T10:58:58.821 INFO:tasks.workunit.client.0.smithi134.stdout:0/60: chown d4/d7/da/f10 640055 1 2024-04-13T10:58:58.826 INFO:tasks.workunit.client.0.smithi134.stdout:2/97: dwrite d5/de/f10 [0,4194304] 0 2024-04-13T10:58:58.830 INFO:tasks.workunit.client.0.smithi134.stdout:2/98: rmdir d5/de/d18 0 2024-04-13T10:58:58.832 INFO:tasks.workunit.client.0.smithi134.stdout:2/99: creat d5/d6/f1e x:0 0 0 2024-04-13T10:58:58.836 INFO:tasks.workunit.client.0.smithi134.stdout:2/100: dread d5/de/f10 [0,4194304] 0 2024-04-13T10:58:58.842 INFO:tasks.workunit.client.0.smithi134.stdout:2/101: dwrite d5/de/f19 [0,4194304] 0 2024-04-13T10:58:58.853 INFO:tasks.workunit.client.0.smithi134.stdout:2/102: dwrite d5/d6/f1e [0,4194304] 0 2024-04-13T10:58:58.933 INFO:tasks.workunit.client.0.smithi134.stdout:8/22: sync 2024-04-13T10:58:58.933 INFO:tasks.workunit.client.0.smithi134.stdout:3/60: sync 2024-04-13T10:58:58.933 INFO:tasks.workunit.client.0.smithi134.stdout:7/33: sync 2024-04-13T10:58:58.933 INFO:tasks.workunit.client.0.smithi134.stdout:6/59: sync 2024-04-13T10:58:58.934 INFO:tasks.workunit.client.0.smithi134.stdout:2/103: mknod d5/d6/c1f 0 2024-04-13T10:58:58.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:58 smithi134 ceph-mon[39696]: pgmap v33: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 54 MiB/s rd, 132 MiB/s wr, 302 op/s 2024-04-13T10:58:58.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:58:58 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:58:58.934 INFO:tasks.workunit.client.0.smithi134.stdout:6/60: write d4/f5 [326475,117561] 0 2024-04-13T10:58:58.938 INFO:tasks.workunit.client.0.smithi134.stdout:8/23: dread f0 [4194304,4194304] 0 2024-04-13T10:58:58.939 INFO:tasks.workunit.client.0.smithi134.stdout:7/34: fdatasync f4 0 2024-04-13T10:58:58.940 INFO:tasks.workunit.client.0.smithi134.stdout:7/35: readlink da/lf 0 2024-04-13T10:58:58.943 INFO:tasks.workunit.client.0.smithi134.stdout:2/104: dwrite d5/fd [0,4194304] 0 2024-04-13T10:58:58.947 INFO:tasks.workunit.client.0.smithi134.stdout:0/61: rename d4/d7 to d4/d17 0 2024-04-13T10:58:58.948 INFO:tasks.workunit.client.0.smithi134.stdout:2/105: dread d5/de/f19 [0,4194304] 0 2024-04-13T10:58:58.949 INFO:tasks.workunit.client.0.smithi134.stdout:2/106: chown d5/d6/df/l1b 47680202 1 2024-04-13T10:58:58.954 INFO:tasks.workunit.client.0.smithi134.stdout:8/24: mknod c6 0 2024-04-13T10:58:58.954 INFO:tasks.workunit.client.0.smithi134.stdout:8/25: dread - f4 zero size 2024-04-13T10:58:58.956 INFO:tasks.workunit.client.0.smithi134.stdout:6/61: rename d4/c9 to d4/da/ce 0 2024-04-13T10:58:58.959 INFO:tasks.workunit.client.0.smithi134.stdout:8/26: dread f0 [0,4194304] 0 2024-04-13T10:58:58.959 INFO:tasks.workunit.client.0.smithi134.stdout:7/36: creat da/f10 x:0 0 0 2024-04-13T10:58:58.962 INFO:tasks.workunit.client.0.smithi134.stdout:0/62: symlink d4/d17/l18 0 2024-04-13T10:58:58.963 INFO:tasks.workunit.client.0.smithi134.stdout:3/61: dwrite f2 [0,4194304] 0 2024-04-13T10:58:58.966 INFO:tasks.workunit.client.0.smithi134.stdout:2/107: mknod d5/de/c20 0 2024-04-13T10:58:58.967 INFO:tasks.workunit.client.0.smithi134.stdout:2/108: fdatasync f1 0 2024-04-13T10:58:58.971 INFO:tasks.workunit.client.0.smithi134.stdout:6/62: symlink d4/lf 0 2024-04-13T10:58:58.972 INFO:tasks.workunit.client.0.smithi134.stdout:0/63: dwrite d4/f13 [0,4194304] 0 2024-04-13T10:58:58.974 INFO:tasks.workunit.client.0.smithi134.stdout:0/64: write d4/d17/f14 [993610,84922] 0 2024-04-13T10:58:58.976 INFO:tasks.workunit.client.0.smithi134.stdout:8/27: mknod c7 0 2024-04-13T10:58:58.976 INFO:tasks.workunit.client.0.smithi134.stdout:8/28: chown l1 3335 1 2024-04-13T10:58:58.977 INFO:tasks.workunit.client.0.smithi134.stdout:7/37: creat da/f11 x:0 0 0 2024-04-13T10:58:58.977 INFO:tasks.workunit.client.0.smithi134.stdout:7/38: chown f0 132106554 1 2024-04-13T10:58:58.978 INFO:tasks.workunit.client.0.smithi134.stdout:7/39: truncate f7 304810 0 2024-04-13T10:58:58.978 INFO:tasks.workunit.client.0.smithi134.stdout:7/40: chown da/f11 8302480 1 2024-04-13T10:58:58.981 INFO:tasks.workunit.client.0.smithi134.stdout:2/109: fsync d5/de/f19 0 2024-04-13T10:58:58.984 INFO:tasks.workunit.client.0.smithi134.stdout:0/65: rename d4/l5 to d4/d17/da/l19 0 2024-04-13T10:58:58.985 INFO:tasks.workunit.client.0.smithi134.stdout:8/29: mkdir d8 0 2024-04-13T10:58:58.985 INFO:tasks.workunit.client.0.smithi134.stdout:0/66: truncate d4/d17/fd 4396415 0 2024-04-13T10:58:58.986 INFO:tasks.workunit.client.0.smithi134.stdout:0/67: chown d4/d17/da 82722802 1 2024-04-13T10:58:58.987 INFO:tasks.workunit.client.0.smithi134.stdout:0/68: read d4/d17/f14 [318129,90854] 0 2024-04-13T10:58:58.987 INFO:tasks.workunit.client.0.smithi134.stdout:0/69: chown d4/fc 1 1 2024-04-13T10:58:58.988 INFO:tasks.workunit.client.0.smithi134.stdout:3/62: truncate dc/fe 294571 0 2024-04-13T10:58:58.989 INFO:tasks.workunit.client.0.smithi134.stdout:0/70: write d4/fc [4721271,24536] 0 2024-04-13T10:58:58.992 INFO:tasks.workunit.client.0.smithi134.stdout:7/41: rename f6 to da/f12 0 2024-04-13T10:58:58.996 INFO:tasks.workunit.client.0.smithi134.stdout:0/71: mkdir d4/d17/d1a 0 2024-04-13T10:58:58.996 INFO:tasks.workunit.client.0.smithi134.stdout:0/72: write d4/d17/fd [329240,78123] 0 2024-04-13T10:58:58.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:58 smithi194 ceph-mon[46737]: pgmap v33: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 54 MiB/s rd, 132 MiB/s wr, 302 op/s 2024-04-13T10:58:58.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:58:58 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:58:58.998 INFO:tasks.workunit.client.0.smithi134.stdout:2/110: mkdir d5/d6/d21 0 2024-04-13T10:58:58.999 INFO:tasks.workunit.client.0.smithi134.stdout:0/73: truncate d4/d17/da/fe 2315439 0 2024-04-13T10:58:58.999 INFO:tasks.workunit.client.0.smithi134.stdout:2/111: write d5/d6/f1e [4840272,89545] 0 2024-04-13T10:58:59.000 INFO:tasks.workunit.client.0.smithi134.stdout:7/42: creat da/f13 x:0 0 0 2024-04-13T10:58:59.004 INFO:tasks.workunit.client.0.smithi134.stdout:2/112: dread f1 [4194304,4194304] 0 2024-04-13T10:58:59.005 INFO:tasks.workunit.client.0.smithi134.stdout:3/63: write f4 [5451778,128637] 0 2024-04-13T10:58:59.006 INFO:tasks.workunit.client.0.smithi134.stdout:2/113: stat d5/de/d12/l15 0 2024-04-13T10:58:59.006 INFO:tasks.workunit.client.0.smithi134.stdout:6/63: getdents d4/da 0 2024-04-13T10:58:59.006 INFO:tasks.workunit.client.0.smithi134.stdout:6/64: dread - d4/fd zero size 2024-04-13T10:58:59.009 INFO:tasks.workunit.client.0.smithi134.stdout:3/64: dread f7 [0,4194304] 0 2024-04-13T10:58:59.012 INFO:tasks.workunit.client.0.smithi134.stdout:0/74: creat d4/d17/da/f1b x:0 0 0 2024-04-13T10:58:59.016 INFO:tasks.workunit.client.0.smithi134.stdout:2/114: rename d5/d6/fa to d5/de/f22 0 2024-04-13T10:58:59.017 INFO:tasks.workunit.client.0.smithi134.stdout:2/115: chown d5/de/f10 0 1 2024-04-13T10:58:59.019 INFO:tasks.workunit.client.0.smithi134.stdout:3/65: unlink f7 0 2024-04-13T10:58:59.019 INFO:tasks.workunit.client.0.smithi134.stdout:3/66: chown dc/df 0 1 2024-04-13T10:58:59.021 INFO:tasks.workunit.client.0.smithi134.stdout:0/75: mknod d4/d17/c1c 0 2024-04-13T10:58:59.022 INFO:tasks.workunit.client.0.smithi134.stdout:7/43: write f8 [131252,51279] 0 2024-04-13T10:58:59.024 INFO:tasks.workunit.client.0.smithi134.stdout:2/116: write d5/de/d12/f1d [4894463,25449] 0 2024-04-13T10:58:59.026 INFO:tasks.workunit.client.0.smithi134.stdout:2/117: chown d5/fd 4954778 1 2024-04-13T10:58:59.027 INFO:tasks.workunit.client.0.smithi134.stdout:3/67: creat dc/df/f14 x:0 0 0 2024-04-13T10:58:59.028 INFO:tasks.workunit.client.0.smithi134.stdout:7/44: read - da/f12 zero size 2024-04-13T10:58:59.029 INFO:tasks.workunit.client.0.smithi134.stdout:3/68: dread - dc/df/f14 zero size 2024-04-13T10:58:59.029 INFO:tasks.workunit.client.0.smithi134.stdout:6/65: dwrite d4/f6 [0,4194304] 0 2024-04-13T10:58:59.030 INFO:tasks.workunit.client.0.smithi134.stdout:0/76: mknod d4/d17/d1a/c1d 0 2024-04-13T10:58:59.031 INFO:tasks.workunit.client.0.smithi134.stdout:6/66: read - d4/fd zero size 2024-04-13T10:58:59.033 INFO:tasks.workunit.client.0.smithi134.stdout:2/118: mknod d5/d6/d21/c23 0 2024-04-13T10:58:59.033 INFO:tasks.workunit.client.0.smithi134.stdout:7/45: read f5 [2831542,107148] 0 2024-04-13T10:58:59.035 INFO:tasks.workunit.client.0.smithi134.stdout:7/46: dread - da/f10 zero size 2024-04-13T10:58:59.035 INFO:tasks.workunit.client.0.smithi134.stdout:6/67: creat d4/f10 x:0 0 0 2024-04-13T10:58:59.037 INFO:tasks.workunit.client.0.smithi134.stdout:6/68: chown l3 674501 1 2024-04-13T10:58:59.040 INFO:tasks.workunit.client.0.smithi134.stdout:7/47: dread f7 [0,4194304] 0 2024-04-13T10:58:59.041 INFO:tasks.workunit.client.0.smithi134.stdout:2/119: rename d5/de/d12/l15 to d5/de/d12/l24 0 2024-04-13T10:58:59.044 INFO:tasks.workunit.client.0.smithi134.stdout:0/77: dwrite d4/f11 [0,4194304] 0 2024-04-13T10:58:59.044 INFO:tasks.workunit.client.0.smithi134.stdout:3/69: dwrite f2 [0,4194304] 0 2024-04-13T10:58:59.045 INFO:tasks.workunit.client.0.smithi134.stdout:3/70: chown l3 3 1 2024-04-13T10:58:59.046 INFO:tasks.workunit.client.0.smithi134.stdout:7/48: mknod da/c14 0 2024-04-13T10:58:59.049 INFO:tasks.workunit.client.0.smithi134.stdout:2/120: creat d5/de/d12/f25 x:0 0 0 2024-04-13T10:58:59.051 INFO:tasks.workunit.client.0.smithi134.stdout:0/78: mkdir d4/d17/d1a/d1e 0 2024-04-13T10:58:59.053 INFO:tasks.workunit.client.0.smithi134.stdout:0/79: chown d4/l8 16200 1 2024-04-13T10:58:59.053 INFO:tasks.workunit.client.0.smithi134.stdout:3/71: rename f4 to dc/f15 0 2024-04-13T10:58:59.054 INFO:tasks.workunit.client.0.smithi134.stdout:2/121: write d5/d6/df/f14 [303218,30752] 0 2024-04-13T10:58:59.054 INFO:tasks.workunit.client.0.smithi134.stdout:0/80: readlink d4/l8 0 2024-04-13T10:58:59.055 INFO:tasks.workunit.client.0.smithi134.stdout:6/69: dwrite d4/f7 [0,4194304] 0 2024-04-13T10:58:59.060 INFO:tasks.workunit.client.0.smithi134.stdout:6/70: write d4/f10 [9500,84819] 0 2024-04-13T10:58:59.061 INFO:tasks.workunit.client.0.smithi134.stdout:2/122: readlink d5/d6/df/l1b 0 2024-04-13T10:58:59.062 INFO:tasks.workunit.client.0.smithi134.stdout:3/72: chown dc/f10 83134 1 2024-04-13T10:58:59.070 INFO:tasks.workunit.client.0.smithi134.stdout:0/81: dwrite d4/fc [0,4194304] 0 2024-04-13T10:58:59.074 INFO:tasks.workunit.client.0.smithi134.stdout:6/71: dwrite d4/f6 [0,4194304] 0 2024-04-13T10:58:59.077 INFO:tasks.workunit.client.0.smithi134.stdout:2/123: symlink d5/d6/df/l26 0 2024-04-13T10:58:59.078 INFO:tasks.workunit.client.0.smithi134.stdout:2/124: chown d5/de 35 1 2024-04-13T10:58:59.079 INFO:tasks.workunit.client.0.smithi134.stdout:3/73: unlink dc/df/f12 0 2024-04-13T10:58:59.079 INFO:tasks.workunit.client.0.smithi134.stdout:3/74: read - dc/df/f14 zero size 2024-04-13T10:58:59.083 INFO:tasks.workunit.client.0.smithi134.stdout:7/49: rmdir da 39 2024-04-13T10:58:59.083 INFO:tasks.workunit.client.0.smithi134.stdout:0/82: read d4/d17/f14 [490526,16743] 0 2024-04-13T10:58:59.084 INFO:tasks.workunit.client.0.smithi134.stdout:6/72: creat d4/da/f11 x:0 0 0 2024-04-13T10:58:59.089 INFO:tasks.workunit.client.0.smithi134.stdout:3/75: dwrite dc/df/f14 [0,4194304] 0 2024-04-13T10:58:59.096 INFO:tasks.workunit.client.0.smithi134.stdout:3/76: creat dc/f16 x:0 0 0 2024-04-13T10:58:59.097 INFO:tasks.workunit.client.0.smithi134.stdout:2/125: rename l2 to d5/l27 0 2024-04-13T10:58:59.099 INFO:tasks.workunit.client.0.smithi134.stdout:2/126: write d5/de/f19 [4006718,28772] 0 2024-04-13T10:58:59.099 INFO:tasks.workunit.client.0.smithi134.stdout:2/127: read - d5/de/f16 zero size 2024-04-13T10:58:59.100 INFO:tasks.workunit.client.0.smithi134.stdout:0/83: rename d4/d17/d1a/d1e to d4/d1f 0 2024-04-13T10:58:59.102 INFO:tasks.workunit.client.0.smithi134.stdout:0/84: unlink d4/fc 0 2024-04-13T10:58:59.108 INFO:tasks.workunit.client.0.smithi134.stdout:3/77: rename f2 to dc/f17 0 2024-04-13T10:58:59.110 INFO:tasks.workunit.client.0.smithi134.stdout:2/128: creat d5/d6/d21/f28 x:0 0 0 2024-04-13T10:58:59.114 INFO:tasks.workunit.client.0.smithi134.stdout:3/78: creat dc/df/f18 x:0 0 0 2024-04-13T10:58:59.115 INFO:tasks.workunit.client.0.smithi134.stdout:2/129: mkdir d5/d6/d21/d29 0 2024-04-13T10:58:59.119 INFO:tasks.workunit.client.0.smithi134.stdout:3/79: unlink dc/f16 0 2024-04-13T10:58:59.120 INFO:tasks.workunit.client.0.smithi134.stdout:3/80: chown dc/df/f14 0 1 2024-04-13T10:58:59.120 INFO:tasks.workunit.client.0.smithi134.stdout:3/81: chown dc/df/f14 1956 1 2024-04-13T10:58:59.124 INFO:tasks.workunit.client.0.smithi134.stdout:6/73: rmdir d4/da 39 2024-04-13T10:58:59.126 INFO:tasks.workunit.client.0.smithi134.stdout:6/74: readlink d4/da/lb 0 2024-04-13T10:58:59.134 INFO:tasks.workunit.client.0.smithi134.stdout:7/50: dwrite f7 [0,4194304] 0 2024-04-13T10:58:59.135 INFO:tasks.workunit.client.0.smithi134.stdout:6/75: link d4/da/lb d4/da/l12 0 2024-04-13T10:58:59.135 INFO:tasks.workunit.client.0.smithi134.stdout:3/82: write dc/df/f14 [4124334,119630] 0 2024-04-13T10:58:59.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/83: mkdir dc/df/d19 0 2024-04-13T10:58:59.145 INFO:tasks.workunit.client.0.smithi134.stdout:3/84: chown dc/l11 3 1 2024-04-13T10:58:59.146 INFO:tasks.workunit.client.0.smithi134.stdout:6/76: dwrite d4/fd [0,4194304] 0 2024-04-13T10:58:59.146 INFO:tasks.workunit.client.0.smithi134.stdout:7/51: mkdir da/d15 0 2024-04-13T10:58:59.147 INFO:tasks.workunit.client.0.smithi134.stdout:7/52: chown da/f13 10820669 1 2024-04-13T10:58:59.149 INFO:tasks.workunit.client.0.smithi134.stdout:3/85: unlink fb 0 2024-04-13T10:58:59.151 INFO:tasks.workunit.client.0.smithi134.stdout:6/77: mknod d4/da/c13 0 2024-04-13T10:58:59.151 INFO:tasks.workunit.client.0.smithi134.stdout:6/78: chown d4/fd 464002 1 2024-04-13T10:58:59.156 INFO:tasks.workunit.client.0.smithi134.stdout:6/79: creat d4/da/f14 x:0 0 0 2024-04-13T10:58:59.158 INFO:tasks.workunit.client.0.smithi134.stdout:3/86: stat dc/f10 0 2024-04-13T10:58:59.158 INFO:tasks.workunit.client.0.smithi134.stdout:3/87: readlink l9 0 2024-04-13T10:58:59.160 INFO:tasks.workunit.client.0.smithi134.stdout:7/53: link c9 da/d15/c16 0 2024-04-13T10:58:59.161 INFO:tasks.workunit.client.0.smithi134.stdout:7/54: write da/f10 [557422,67916] 0 2024-04-13T10:58:59.161 INFO:tasks.workunit.client.0.smithi134.stdout:6/80: mkdir d4/da/d15 0 2024-04-13T10:58:59.164 INFO:tasks.workunit.client.0.smithi134.stdout:6/81: read d4/f10 [28480,76157] 0 2024-04-13T10:58:59.165 INFO:tasks.workunit.client.0.smithi134.stdout:3/88: rename dc/f15 to dc/f1a 0 2024-04-13T10:58:59.166 INFO:tasks.workunit.client.0.smithi134.stdout:3/89: readlink l9 0 2024-04-13T10:58:59.167 INFO:tasks.workunit.client.0.smithi134.stdout:7/55: fsync f4 0 2024-04-13T10:58:59.170 INFO:tasks.workunit.client.0.smithi134.stdout:6/82: rename d4/da/c13 to d4/da/d15/c16 0 2024-04-13T10:58:59.178 INFO:tasks.workunit.client.0.smithi134.stdout:6/83: mkdir d4/d17 0 2024-04-13T10:58:59.179 INFO:tasks.workunit.client.0.smithi134.stdout:6/84: fdatasync d4/da/f14 0 2024-04-13T10:58:59.180 INFO:tasks.workunit.client.0.smithi134.stdout:0/85: truncate d4/d17/fd 3587928 0 2024-04-13T10:58:59.181 INFO:tasks.workunit.client.0.smithi134.stdout:0/86: write d4/d17/da/f1b [911809,115782] 0 2024-04-13T10:58:59.183 INFO:tasks.workunit.client.0.smithi134.stdout:0/87: dread - d4/d17/da/f15 zero size 2024-04-13T10:58:59.185 INFO:tasks.workunit.client.0.smithi134.stdout:0/88: write d4/d17/da/f1b [1831395,116762] 0 2024-04-13T10:58:59.186 INFO:tasks.workunit.client.0.smithi134.stdout:0/89: truncate d4/f11 4871932 0 2024-04-13T10:58:59.193 INFO:tasks.workunit.client.0.smithi134.stdout:0/90: rmdir d4/d1f 0 2024-04-13T10:58:59.195 INFO:tasks.workunit.client.0.smithi134.stdout:0/91: write d4/d17/da/f10 [4344589,120783] 0 2024-04-13T10:58:59.196 INFO:tasks.workunit.client.0.smithi134.stdout:0/92: write d4/f13 [326988,57200] 0 2024-04-13T10:58:59.197 INFO:tasks.workunit.client.0.smithi134.stdout:0/93: read - d4/d17/da/f15 zero size 2024-04-13T10:58:59.198 INFO:tasks.workunit.client.0.smithi134.stdout:0/94: chown d4/d17 0 1 2024-04-13T10:58:59.201 INFO:tasks.workunit.client.0.smithi134.stdout:0/95: unlink d4/d17/f14 0 2024-04-13T10:58:59.206 INFO:tasks.workunit.client.0.smithi134.stdout:0/96: chown d4/d17/fd 6439 1 2024-04-13T10:58:59.208 INFO:tasks.workunit.client.0.smithi134.stdout:0/97: mkdir d4/d17/d20 0 2024-04-13T10:58:59.209 INFO:tasks.workunit.client.0.smithi134.stdout:0/98: chown d4 13952458 1 2024-04-13T10:58:59.210 INFO:tasks.workunit.client.0.smithi134.stdout:0/99: write d4/d17/da/f10 [4329170,88978] 0 2024-04-13T10:58:59.211 INFO:tasks.workunit.client.0.smithi134.stdout:0/100: fsync d4/f13 0 2024-04-13T10:58:59.214 INFO:tasks.workunit.client.0.smithi134.stdout:0/101: rename c3 to d4/c21 0 2024-04-13T10:58:59.227 INFO:tasks.workunit.client.0.smithi134.stdout:7/56: write f0 [2407675,82839] 0 2024-04-13T10:58:59.231 INFO:tasks.workunit.client.0.smithi134.stdout:3/90: write dc/fe [713345,22016] 0 2024-04-13T10:58:59.233 INFO:tasks.workunit.client.0.smithi134.stdout:7/57: dread f7 [0,4194304] 0 2024-04-13T10:58:59.318 INFO:tasks.workunit.client.0.smithi134.stdout:1/70: sync 2024-04-13T10:58:59.318 INFO:tasks.workunit.client.0.smithi134.stdout:5/86: sync 2024-04-13T10:58:59.319 INFO:tasks.workunit.client.0.smithi134.stdout:1/71: dread - d3/f13 zero size 2024-04-13T10:58:59.322 INFO:tasks.workunit.client.0.smithi134.stdout:5/87: dread dc/f16 [0,4194304] 0 2024-04-13T10:58:59.323 INFO:tasks.workunit.client.0.smithi134.stdout:5/88: mknod dc/c19 0 2024-04-13T10:58:59.327 INFO:tasks.workunit.client.0.smithi134.stdout:5/89: dread f9 [0,4194304] 0 2024-04-13T10:58:59.340 INFO:tasks.workunit.client.0.smithi134.stdout:5/90: dwrite dc/f13 [0,4194304] 0 2024-04-13T10:58:59.342 INFO:tasks.workunit.client.0.smithi134.stdout:5/91: chown l4 474509071 1 2024-04-13T10:58:59.342 INFO:tasks.workunit.client.0.smithi134.stdout:5/92: fdatasync dc/f14 0 2024-04-13T10:58:59.343 INFO:tasks.workunit.client.0.smithi134.stdout:5/93: chown dc 15778215 1 2024-04-13T10:58:59.343 INFO:tasks.workunit.client.0.smithi134.stdout:5/94: chown dc 67714 1 2024-04-13T10:58:59.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/95: fdatasync fb 0 2024-04-13T10:58:59.351 INFO:tasks.workunit.client.0.smithi134.stdout:5/96: creat dc/f1a x:0 0 0 2024-04-13T10:58:59.351 INFO:tasks.workunit.client.0.smithi134.stdout:3/91: write dc/df/f18 [328272,77370] 0 2024-04-13T10:58:59.356 INFO:tasks.workunit.client.0.smithi134.stdout:5/97: creat dc/f1b x:0 0 0 2024-04-13T10:58:59.359 INFO:tasks.workunit.client.0.smithi134.stdout:3/92: read dc/f1a [4490944,121736] 0 2024-04-13T10:58:59.359 INFO:tasks.workunit.client.0.smithi134.stdout:5/98: symlink dc/l1c 0 2024-04-13T10:58:59.362 INFO:tasks.workunit.client.0.smithi134.stdout:5/99: mkdir dc/d1d 0 2024-04-13T10:58:59.369 INFO:tasks.workunit.client.0.smithi134.stdout:7/58: write f4 [414763,97974] 0 2024-04-13T10:58:59.370 INFO:tasks.workunit.client.0.smithi134.stdout:3/93: creat dc/f1b x:0 0 0 2024-04-13T10:58:59.371 INFO:tasks.workunit.client.0.smithi134.stdout:7/59: truncate f8 1176517 0 2024-04-13T10:58:59.371 INFO:tasks.workunit.client.0.smithi134.stdout:5/100: dread dc/f13 [0,4194304] 0 2024-04-13T10:58:59.371 INFO:tasks.workunit.client.0.smithi134.stdout:7/60: chown da/ce 8239 1 2024-04-13T10:58:59.373 INFO:tasks.workunit.client.0.smithi134.stdout:7/61: chown f4 7 1 2024-04-13T10:58:59.374 INFO:tasks.workunit.client.0.smithi134.stdout:5/101: write f8 [720801,111286] 0 2024-04-13T10:58:59.376 INFO:tasks.workunit.client.0.smithi134.stdout:5/102: dread - dc/f17 zero size 2024-04-13T10:58:59.377 INFO:tasks.workunit.client.0.smithi134.stdout:7/62: rmdir da 39 2024-04-13T10:58:59.378 INFO:tasks.workunit.client.0.smithi134.stdout:3/94: creat dc/df/d19/f1c x:0 0 0 2024-04-13T10:58:59.379 INFO:tasks.workunit.client.0.smithi134.stdout:5/103: chown dc/f14 2733770 1 2024-04-13T10:58:59.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/104: rename dc/c19 to dc/c1e 0 2024-04-13T10:58:59.391 INFO:tasks.workunit.client.0.smithi134.stdout:5/105: rename f2 to dc/d1d/f1f 0 2024-04-13T10:58:59.392 INFO:tasks.workunit.client.0.smithi134.stdout:7/63: dwrite f0 [4194304,4194304] 0 2024-04-13T10:58:59.400 INFO:tasks.workunit.client.0.smithi134.stdout:5/106: mkdir dc/d1d/d20 0 2024-04-13T10:58:59.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/64: mknod da/c17 0 2024-04-13T10:58:59.407 INFO:tasks.workunit.client.0.smithi134.stdout:5/107: write dc/f16 [4583770,52091] 0 2024-04-13T10:58:59.408 INFO:tasks.workunit.client.0.smithi134.stdout:7/65: mknod da/c18 0 2024-04-13T10:58:59.410 INFO:tasks.workunit.client.0.smithi134.stdout:5/108: truncate dc/f17 775913 0 2024-04-13T10:58:59.412 INFO:tasks.workunit.client.0.smithi134.stdout:7/66: rename f7 to da/d15/f19 0 2024-04-13T10:58:59.420 INFO:tasks.workunit.client.0.smithi134.stdout:7/67: dwrite da/d15/f19 [0,4194304] 0 2024-04-13T10:58:59.523 INFO:tasks.workunit.client.0.smithi134.stdout:4/43: sync 2024-04-13T10:58:59.524 INFO:tasks.workunit.client.0.smithi134.stdout:9/71: sync 2024-04-13T10:58:59.524 INFO:tasks.workunit.client.0.smithi134.stdout:2/130: sync 2024-04-13T10:58:59.524 INFO:tasks.workunit.client.0.smithi134.stdout:8/30: sync 2024-04-13T10:58:59.528 INFO:tasks.workunit.client.0.smithi134.stdout:4/44: chown d4 882571389 1 2024-04-13T10:58:59.529 INFO:tasks.workunit.client.0.smithi134.stdout:4/45: truncate - no filename 2024-04-13T10:58:59.529 INFO:tasks.workunit.client.0.smithi134.stdout:7/68: creat da/d15/f1a x:0 0 0 2024-04-13T10:58:59.531 INFO:tasks.workunit.client.0.smithi134.stdout:9/72: chown lf 95807228 1 2024-04-13T10:58:59.533 INFO:tasks.workunit.client.0.smithi134.stdout:4/46: mkdir d4/da 0 2024-04-13T10:58:59.534 INFO:tasks.workunit.client.0.smithi134.stdout:4/47: chown d4/c5 10410 1 2024-04-13T10:58:59.536 INFO:tasks.workunit.client.0.smithi134.stdout:8/31: symlink d8/l9 0 2024-04-13T10:58:59.536 INFO:tasks.workunit.client.0.smithi134.stdout:9/73: dread - d13/f16 zero size 2024-04-13T10:58:59.536 INFO:tasks.workunit.client.0.smithi134.stdout:7/69: mknod da/d15/c1b 0 2024-04-13T10:58:59.539 INFO:tasks.workunit.client.0.smithi134.stdout:8/32: truncate f5 65321 0 2024-04-13T10:58:59.539 INFO:tasks.workunit.client.0.smithi134.stdout:2/131: dwrite d5/d6/f9 [0,4194304] 0 2024-04-13T10:58:59.541 INFO:tasks.workunit.client.0.smithi134.stdout:7/70: write da/d15/f1a [1035307,2119] 0 2024-04-13T10:58:59.549 INFO:tasks.workunit.client.0.smithi134.stdout:5/109: truncate f8 445483 0 2024-04-13T10:58:59.551 INFO:tasks.workunit.client.0.smithi134.stdout:2/132: dread d5/de/f10 [0,4194304] 0 2024-04-13T10:58:59.552 INFO:tasks.workunit.client.0.smithi134.stdout:5/110: dread - dc/f1a zero size 2024-04-13T10:58:59.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/33: dwrite f5 [0,4194304] 0 2024-04-13T10:58:59.553 INFO:tasks.workunit.client.0.smithi134.stdout:8/34: readlink l1 0 2024-04-13T10:58:59.553 INFO:tasks.workunit.client.0.smithi134.stdout:8/35: stat c2 0 2024-04-13T10:58:59.554 INFO:tasks.workunit.client.0.smithi134.stdout:9/74: link fc d13/f17 0 2024-04-13T10:58:59.555 INFO:tasks.workunit.client.0.smithi134.stdout:2/133: chown d5/de/c11 9 1 2024-04-13T10:58:59.555 INFO:tasks.workunit.client.0.smithi134.stdout:5/111: symlink dc/d15/l21 0 2024-04-13T10:58:59.556 INFO:tasks.workunit.client.0.smithi134.stdout:8/36: mknod d8/ca 0 2024-04-13T10:58:59.557 INFO:tasks.workunit.client.0.smithi134.stdout:8/37: chown f4 0 1 2024-04-13T10:58:59.557 INFO:tasks.workunit.client.0.smithi134.stdout:8/38: dread - f3 zero size 2024-04-13T10:58:59.558 INFO:tasks.workunit.client.0.smithi134.stdout:9/75: mknod d13/c18 0 2024-04-13T10:58:59.558 INFO:tasks.workunit.client.0.smithi134.stdout:8/39: write f5 [1781368,124795] 0 2024-04-13T10:58:59.559 INFO:tasks.workunit.client.0.smithi134.stdout:9/76: read f9 [181539,83040] 0 2024-04-13T10:58:59.560 INFO:tasks.workunit.client.0.smithi134.stdout:5/112: rmdir dc/d15 39 2024-04-13T10:58:59.562 INFO:tasks.workunit.client.0.smithi134.stdout:9/77: mknod d13/c19 0 2024-04-13T10:58:59.562 INFO:tasks.workunit.client.0.smithi134.stdout:5/113: write dc/f1a [942013,83938] 0 2024-04-13T10:58:59.565 INFO:tasks.workunit.client.0.smithi134.stdout:9/78: creat d13/f1a x:0 0 0 2024-04-13T10:58:59.567 INFO:tasks.workunit.client.0.smithi134.stdout:8/40: dwrite f3 [0,4194304] 0 2024-04-13T10:58:59.572 INFO:tasks.workunit.client.0.smithi134.stdout:5/114: rename dc/d15/l21 to dc/d1d/d20/l22 0 2024-04-13T10:58:59.578 INFO:tasks.workunit.client.0.smithi134.stdout:8/41: rename f4 to d8/fb 0 2024-04-13T10:58:59.581 INFO:tasks.workunit.client.0.smithi134.stdout:5/115: mkdir dc/d1d/d20/d23 0 2024-04-13T10:58:59.585 INFO:tasks.workunit.client.0.smithi134.stdout:8/42: write d8/fb [722084,110618] 0 2024-04-13T10:58:59.586 INFO:tasks.workunit.client.0.smithi134.stdout:8/43: write d8/fb [1778637,60274] 0 2024-04-13T10:58:59.586 INFO:tasks.workunit.client.0.smithi134.stdout:5/116: mkdir dc/d15/d24 0 2024-04-13T10:58:59.589 INFO:tasks.workunit.client.0.smithi134.stdout:5/117: creat dc/d1d/d20/d23/f25 x:0 0 0 2024-04-13T10:58:59.589 INFO:tasks.workunit.client.0.smithi134.stdout:5/118: fdatasync dc/f16 0 2024-04-13T10:58:59.590 INFO:tasks.workunit.client.0.smithi134.stdout:9/79: getdents d13 0 2024-04-13T10:58:59.594 INFO:tasks.workunit.client.0.smithi134.stdout:9/80: fdatasync f6 0 2024-04-13T10:58:59.597 INFO:tasks.workunit.client.0.smithi134.stdout:9/81: dread - d13/f16 zero size 2024-04-13T10:58:59.599 INFO:tasks.workunit.client.0.smithi134.stdout:9/82: mknod d13/c1b 0 2024-04-13T10:58:59.600 INFO:tasks.workunit.client.0.smithi134.stdout:9/83: chown f6 3378 1 2024-04-13T10:58:59.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/119: getdents dc/d1d/d20 0 2024-04-13T10:58:59.601 INFO:tasks.workunit.client.0.smithi134.stdout:9/84: write d13/f16 [704310,15573] 0 2024-04-13T10:58:59.603 INFO:tasks.workunit.client.0.smithi134.stdout:5/120: creat dc/d1d/d20/d23/f26 x:0 0 0 2024-04-13T10:58:59.604 INFO:tasks.workunit.client.0.smithi134.stdout:9/85: mknod d13/c1c 0 2024-04-13T10:58:59.604 INFO:tasks.workunit.client.0.smithi134.stdout:5/121: dread - dc/d1d/d20/d23/f26 zero size 2024-04-13T10:58:59.613 INFO:tasks.workunit.client.0.smithi134.stdout:9/86: dwrite f10 [0,4194304] 0 2024-04-13T10:58:59.614 INFO:tasks.workunit.client.0.smithi134.stdout:5/122: dwrite dc/d1d/d20/d23/f26 [0,4194304] 0 2024-04-13T10:58:59.616 INFO:tasks.workunit.client.0.smithi134.stdout:9/87: symlink d13/l1d 0 2024-04-13T10:58:59.623 INFO:tasks.workunit.client.0.smithi134.stdout:5/123: dwrite dc/f10 [0,4194304] 0 2024-04-13T10:58:59.624 INFO:tasks.workunit.client.0.smithi134.stdout:5/124: write dc/fe [1276926,61573] 0 2024-04-13T10:58:59.629 INFO:tasks.workunit.client.0.smithi134.stdout:5/125: rename dc/d1d/d20/l22 to dc/d1d/l27 0 2024-04-13T10:58:59.657 INFO:tasks.workunit.client.0.smithi134.stdout:5/126: write f8 [928968,100960] 0 2024-04-13T10:58:59.660 INFO:tasks.workunit.client.0.smithi134.stdout:9/88: dwrite fc [4194304,4194304] 0 2024-04-13T10:58:59.663 INFO:tasks.workunit.client.0.smithi134.stdout:5/127: dread dc/f16 [0,4194304] 0 2024-04-13T10:58:59.665 INFO:tasks.workunit.client.0.smithi134.stdout:9/89: unlink d13/l1d 0 2024-04-13T10:58:59.666 INFO:tasks.workunit.client.0.smithi134.stdout:9/90: chown fc 77574980 1 2024-04-13T10:58:59.669 INFO:tasks.workunit.client.0.smithi134.stdout:9/91: unlink d13/l14 0 2024-04-13T10:58:59.671 INFO:tasks.workunit.client.0.smithi134.stdout:5/128: creat dc/f28 x:0 0 0 2024-04-13T10:58:59.673 INFO:tasks.workunit.client.0.smithi134.stdout:5/129: dread dc/f17 [0,4194304] 0 2024-04-13T10:58:59.674 INFO:tasks.workunit.client.0.smithi134.stdout:9/92: rename fe to d13/f1e 0 2024-04-13T10:58:59.675 INFO:tasks.workunit.client.0.smithi134.stdout:5/130: mknod dc/d15/c29 0 2024-04-13T10:58:59.677 INFO:tasks.workunit.client.0.smithi134.stdout:9/93: readlink l0 0 2024-04-13T10:58:59.677 INFO:tasks.workunit.client.0.smithi134.stdout:9/94: chown d13/c18 5313 1 2024-04-13T10:58:59.678 INFO:tasks.workunit.client.0.smithi134.stdout:9/95: fsync d13/f17 0 2024-04-13T10:58:59.680 INFO:tasks.workunit.client.0.smithi134.stdout:5/131: rename dc/fe to dc/d1d/d20/d23/f2a 0 2024-04-13T10:58:59.680 INFO:tasks.workunit.client.0.smithi134.stdout:9/96: write f10 [3964551,34648] 0 2024-04-13T10:58:59.681 INFO:tasks.workunit.client.0.smithi134.stdout:9/97: write d13/f16 [445564,69979] 0 2024-04-13T10:58:59.683 INFO:tasks.workunit.client.0.smithi134.stdout:5/132: write dc/f17 [1160473,3724] 0 2024-04-13T10:58:59.686 INFO:tasks.workunit.client.0.smithi134.stdout:5/133: mkdir dc/d1d/d2b 0 2024-04-13T10:58:59.690 INFO:tasks.workunit.client.0.smithi134.stdout:9/98: dwrite d13/f16 [0,4194304] 0 2024-04-13T10:58:59.691 INFO:tasks.workunit.client.0.smithi134.stdout:5/134: creat dc/d15/d24/f2c x:0 0 0 2024-04-13T10:58:59.695 INFO:tasks.workunit.client.0.smithi134.stdout:9/99: symlink d13/l1f 0 2024-04-13T10:58:59.697 INFO:tasks.workunit.client.0.smithi134.stdout:5/135: creat dc/d1d/d20/f2d x:0 0 0 2024-04-13T10:58:59.699 INFO:tasks.workunit.client.0.smithi134.stdout:9/100: rename l11 to d13/l20 0 2024-04-13T10:58:59.700 INFO:tasks.workunit.client.0.smithi134.stdout:9/101: write fd [3128685,7204] 0 2024-04-13T10:58:59.707 INFO:tasks.workunit.client.0.smithi134.stdout:5/136: dwrite dc/d1d/d20/d23/f25 [0,4194304] 0 2024-04-13T10:58:59.708 INFO:tasks.workunit.client.0.smithi134.stdout:5/137: write dc/f28 [243986,93705] 0 2024-04-13T10:58:59.717 INFO:tasks.workunit.client.0.smithi134.stdout:5/138: dwrite dc/f16 [4194304,4194304] 0 2024-04-13T10:58:59.720 INFO:tasks.workunit.client.0.smithi134.stdout:5/139: readlink dc/d1d/l27 0 2024-04-13T10:58:59.723 INFO:tasks.workunit.client.0.smithi134.stdout:9/102: dwrite f6 [0,4194304] 0 2024-04-13T10:58:59.724 INFO:tasks.workunit.client.0.smithi134.stdout:9/103: fdatasync d13/f16 0 2024-04-13T10:58:59.729 INFO:tasks.workunit.client.0.smithi134.stdout:9/104: dread f10 [0,4194304] 0 2024-04-13T10:58:59.731 INFO:tasks.workunit.client.0.smithi134.stdout:9/105: dread d13/f1e [0,4194304] 0 2024-04-13T10:58:59.732 INFO:tasks.workunit.client.0.smithi134.stdout:9/106: fdatasync d13/f1e 0 2024-04-13T10:58:59.733 INFO:tasks.workunit.client.0.smithi134.stdout:9/107: chown fc 6532955 1 2024-04-13T10:58:59.734 INFO:tasks.workunit.client.0.smithi134.stdout:5/140: truncate dc/f10 1269208 0 2024-04-13T10:58:59.734 INFO:tasks.workunit.client.0.smithi134.stdout:5/141: chown dc/d1d 945791 1 2024-04-13T10:58:59.737 INFO:tasks.workunit.client.0.smithi134.stdout:9/108: truncate d13/f17 849081 0 2024-04-13T10:58:59.737 INFO:tasks.workunit.client.0.smithi134.stdout:9/109: write fd [3864395,41297] 0 2024-04-13T10:58:59.741 INFO:tasks.workunit.client.0.smithi134.stdout:6/85: sync 2024-04-13T10:58:59.742 INFO:tasks.workunit.client.0.smithi134.stdout:6/86: dread - d4/da/f14 zero size 2024-04-13T10:58:59.748 INFO:tasks.workunit.client.0.smithi134.stdout:5/142: dread dc/f10 [0,4194304] 0 2024-04-13T10:58:59.749 INFO:tasks.workunit.client.0.smithi134.stdout:6/87: rename d4/f7 to d4/f18 0 2024-04-13T10:58:59.754 INFO:tasks.workunit.client.0.smithi134.stdout:5/143: chown dc/d1d/f1f 1061712123 1 2024-04-13T10:58:59.758 INFO:tasks.workunit.client.0.smithi134.stdout:6/88: rmdir d4 39 2024-04-13T10:58:59.761 INFO:tasks.workunit.client.0.smithi134.stdout:5/144: creat dc/d1d/d20/f2e x:0 0 0 2024-04-13T10:58:59.763 INFO:tasks.workunit.client.0.smithi134.stdout:5/145: chown dc/f13 12 1 2024-04-13T10:58:59.765 INFO:tasks.workunit.client.0.smithi134.stdout:9/110: dwrite fc [0,4194304] 0 2024-04-13T10:58:59.771 INFO:tasks.workunit.client.0.smithi134.stdout:9/111: creat d13/f21 x:0 0 0 2024-04-13T10:58:59.774 INFO:tasks.workunit.client.0.smithi134.stdout:5/146: dwrite dc/d1d/d20/d23/f26 [0,4194304] 0 2024-04-13T10:58:59.775 INFO:tasks.workunit.client.0.smithi134.stdout:5/147: stat dc 0 2024-04-13T10:58:59.779 INFO:tasks.workunit.client.0.smithi134.stdout:6/89: dwrite d4/f10 [0,4194304] 0 2024-04-13T10:58:59.783 INFO:tasks.workunit.client.0.smithi134.stdout:5/148: dwrite f1 [0,4194304] 0 2024-04-13T10:58:59.787 INFO:tasks.workunit.client.0.smithi134.stdout:5/149: mkdir dc/d1d/d2f 0 2024-04-13T10:58:59.791 INFO:tasks.workunit.client.0.smithi134.stdout:5/150: unlink dc/d15/d24/f2c 0 2024-04-13T10:58:59.807 INFO:tasks.workunit.client.0.smithi134.stdout:6/90: truncate d4/f5 223948 0 2024-04-13T10:58:59.808 INFO:tasks.workunit.client.0.smithi134.stdout:5/151: rename dc/d15/d24 to dc/d1d/d2b/d30 0 2024-04-13T10:58:59.809 INFO:tasks.workunit.client.0.smithi134.stdout:5/152: chown dc/d15/c29 0 1 2024-04-13T10:58:59.809 INFO:tasks.workunit.client.0.smithi134.stdout:6/91: symlink d4/da/d15/l19 0 2024-04-13T10:58:59.810 INFO:tasks.workunit.client.0.smithi134.stdout:6/92: write d4/fd [3313673,20308] 0 2024-04-13T10:58:59.811 INFO:tasks.workunit.client.0.smithi134.stdout:5/153: symlink dc/d1d/d20/l31 0 2024-04-13T10:58:59.814 INFO:tasks.workunit.client.0.smithi134.stdout:6/93: mkdir d4/da/d1a 0 2024-04-13T10:58:59.817 INFO:tasks.workunit.client.0.smithi134.stdout:6/94: stat d4/lf 0 2024-04-13T10:58:59.819 INFO:tasks.workunit.client.0.smithi134.stdout:5/154: dwrite dc/f17 [0,4194304] 0 2024-04-13T10:58:59.819 INFO:tasks.workunit.client.0.smithi134.stdout:6/95: write d4/da/f14 [152421,79907] 0 2024-04-13T10:58:59.820 INFO:tasks.workunit.client.0.smithi134.stdout:5/155: chown dc/f1a 152825 1 2024-04-13T10:58:59.824 INFO:tasks.workunit.client.0.smithi134.stdout:5/156: write dc/f10 [1998287,22530] 0 2024-04-13T10:58:59.828 INFO:tasks.workunit.client.0.smithi134.stdout:5/157: rmdir dc 39 2024-04-13T10:58:59.830 INFO:tasks.workunit.client.0.smithi134.stdout:6/96: creat d4/f1b x:0 0 0 2024-04-13T10:58:59.831 INFO:tasks.workunit.client.0.smithi134.stdout:6/97: read - d4/f1b zero size 2024-04-13T10:58:59.834 INFO:tasks.workunit.client.0.smithi134.stdout:5/158: creat dc/d1d/d20/d23/f32 x:0 0 0 2024-04-13T10:58:59.835 INFO:tasks.workunit.client.0.smithi134.stdout:6/98: creat d4/da/d15/f1c x:0 0 0 2024-04-13T10:58:59.838 INFO:tasks.workunit.client.0.smithi134.stdout:5/159: mkdir dc/d1d/d20/d33 0 2024-04-13T10:58:59.838 INFO:tasks.workunit.client.0.smithi134.stdout:5/160: chown dc/d1d/d20/d23/f2a 2 1 2024-04-13T10:58:59.839 INFO:tasks.workunit.client.0.smithi134.stdout:6/99: unlink l3 0 2024-04-13T10:58:59.839 INFO:tasks.workunit.client.0.smithi134.stdout:5/161: write dc/f16 [5026570,125950] 0 2024-04-13T10:58:59.841 INFO:tasks.workunit.client.0.smithi134.stdout:5/162: fsync dc/d1d/d20/d23/f25 0 2024-04-13T10:58:59.845 INFO:tasks.workunit.client.0.smithi134.stdout:6/100: dread d4/f10 [0,4194304] 0 2024-04-13T10:58:59.848 INFO:tasks.workunit.client.0.smithi134.stdout:5/163: dwrite f1 [4194304,4194304] 0 2024-04-13T10:58:59.849 INFO:tasks.workunit.client.0.smithi134.stdout:6/101: truncate d4/f5 72877 0 2024-04-13T10:58:59.850 INFO:tasks.workunit.client.0.smithi134.stdout:6/102: chown d4/da/f11 6538 1 2024-04-13T10:58:59.852 INFO:tasks.workunit.client.0.smithi134.stdout:6/103: truncate d4/da/f11 920778 0 2024-04-13T10:58:59.852 INFO:tasks.workunit.client.0.smithi134.stdout:5/164: dread dc/f13 [0,4194304] 0 2024-04-13T10:58:59.853 INFO:tasks.workunit.client.0.smithi134.stdout:6/104: chown d4/lc 0 1 2024-04-13T10:58:59.853 INFO:tasks.workunit.client.0.smithi134.stdout:5/165: read - dc/f14 zero size 2024-04-13T10:58:59.854 INFO:tasks.workunit.client.0.smithi134.stdout:6/105: stat d4/da/d1a 0 2024-04-13T10:58:59.854 INFO:tasks.workunit.client.0.smithi134.stdout:6/106: dread - d4/da/d15/f1c zero size 2024-04-13T10:58:59.856 INFO:tasks.workunit.client.0.smithi134.stdout:5/166: mknod dc/d15/c34 0 2024-04-13T10:58:59.857 INFO:tasks.workunit.client.0.smithi134.stdout:6/107: rmdir d4/da 39 2024-04-13T10:58:59.859 INFO:tasks.workunit.client.0.smithi134.stdout:5/167: mknod dc/c35 0 2024-04-13T10:58:59.860 INFO:tasks.workunit.client.0.smithi134.stdout:6/108: symlink d4/da/d1a/l1d 0 2024-04-13T10:58:59.861 INFO:tasks.workunit.client.0.smithi134.stdout:6/109: fsync d4/da/f11 0 2024-04-13T10:58:59.862 INFO:tasks.workunit.client.0.smithi134.stdout:5/168: mkdir dc/d1d/d20/d23/d36 0 2024-04-13T10:58:59.862 INFO:tasks.workunit.client.0.smithi134.stdout:6/110: rmdir d4/da/d1a 39 2024-04-13T10:58:59.864 INFO:tasks.workunit.client.0.smithi134.stdout:5/169: mkdir dc/d37 0 2024-04-13T10:58:59.868 INFO:tasks.workunit.client.0.smithi134.stdout:5/170: dread f9 [0,4194304] 0 2024-04-13T10:58:59.869 INFO:tasks.workunit.client.0.smithi134.stdout:5/171: fdatasync dc/f1a 0 2024-04-13T10:58:59.869 INFO:tasks.workunit.client.0.smithi134.stdout:6/111: truncate d4/f5 166496 0 2024-04-13T10:58:59.872 INFO:tasks.workunit.client.0.smithi134.stdout:5/172: mkdir dc/d1d/d20/d23/d38 0 2024-04-13T10:58:59.873 INFO:tasks.workunit.client.0.smithi134.stdout:5/173: write dc/f1a [1944761,99416] 0 2024-04-13T10:58:59.874 INFO:tasks.workunit.client.0.smithi134.stdout:6/112: creat d4/da/d15/f1e x:0 0 0 2024-04-13T10:58:59.875 INFO:tasks.workunit.client.0.smithi134.stdout:6/113: write d4/fd [645401,59886] 0 2024-04-13T10:58:59.876 INFO:tasks.workunit.client.0.smithi134.stdout:6/114: fdatasync d4/da/f11 0 2024-04-13T10:58:59.877 INFO:tasks.workunit.client.0.smithi134.stdout:6/115: write d4/f6 [2379064,47331] 0 2024-04-13T10:58:59.882 INFO:tasks.workunit.client.0.smithi134.stdout:6/116: mkdir d4/da/d15/d1f 0 2024-04-13T10:58:59.885 INFO:tasks.workunit.client.0.smithi134.stdout:5/174: rename dc/d37 to dc/d39 0 2024-04-13T10:58:59.886 INFO:tasks.workunit.client.0.smithi134.stdout:5/175: chown dc/d1d/d20/d23/f2a 3 1 2024-04-13T10:58:59.889 INFO:tasks.workunit.client.0.smithi134.stdout:6/117: dwrite d4/da/d15/f1c [0,4194304] 0 2024-04-13T10:58:59.890 INFO:tasks.workunit.client.0.smithi134.stdout:6/118: write d4/da/d15/f1e [826627,82013] 0 2024-04-13T10:58:59.895 INFO:tasks.workunit.client.0.smithi134.stdout:5/176: dread dc/f13 [0,4194304] 0 2024-04-13T10:58:59.897 INFO:tasks.workunit.client.0.smithi134.stdout:5/177: write dc/f1b [998892,96637] 0 2024-04-13T10:58:59.898 INFO:tasks.workunit.client.0.smithi134.stdout:5/178: write f1 [2568917,40477] 0 2024-04-13T10:58:59.900 INFO:tasks.workunit.client.0.smithi134.stdout:5/179: chown dc/d1d/d20/d23/d38 12195 1 2024-04-13T10:58:59.901 INFO:tasks.workunit.client.0.smithi134.stdout:6/119: rmdir d4/d17 0 2024-04-13T10:58:59.903 INFO:tasks.workunit.client.0.smithi134.stdout:5/180: mkdir dc/d1d/d20/d23/d38/d3a 0 2024-04-13T10:58:59.905 INFO:tasks.workunit.client.0.smithi134.stdout:5/181: write dc/f13 [3914795,108665] 0 2024-04-13T10:58:59.909 INFO:tasks.workunit.client.0.smithi134.stdout:5/182: mkdir dc/d1d/d2f/d3b 0 2024-04-13T10:58:59.909 INFO:tasks.workunit.client.0.smithi134.stdout:5/183: readlink l7 0 2024-04-13T10:58:59.913 INFO:tasks.workunit.client.0.smithi134.stdout:5/184: mkdir dc/d1d/d2f/d3b/d3c 0 2024-04-13T10:58:59.913 INFO:tasks.workunit.client.0.smithi134.stdout:6/120: truncate d4/f18 3883931 0 2024-04-13T10:58:59.913 INFO:tasks.workunit.client.0.smithi134.stdout:5/185: chown dc/ld 924181848 1 2024-04-13T10:58:59.916 INFO:tasks.workunit.client.0.smithi134.stdout:6/121: symlink d4/l20 0 2024-04-13T10:58:59.917 INFO:tasks.workunit.client.0.smithi134.stdout:6/122: chown d4/da 1484026 1 2024-04-13T10:58:59.921 INFO:tasks.workunit.client.0.smithi134.stdout:5/186: dwrite dc/d1d/d20/f2d [0,4194304] 0 2024-04-13T10:58:59.923 INFO:tasks.workunit.client.0.smithi134.stdout:5/187: dread - dc/f14 zero size 2024-04-13T10:58:59.923 INFO:tasks.workunit.client.0.smithi134.stdout:6/123: unlink d4/da/d15/l19 0 2024-04-13T10:58:59.927 INFO:tasks.workunit.client.0.smithi134.stdout:6/124: chown d4/f5 3401962 1 2024-04-13T10:58:59.931 INFO:tasks.workunit.client.0.smithi134.stdout:6/125: dread d4/da/f14 [0,4194304] 0 2024-04-13T10:58:59.933 INFO:tasks.workunit.client.0.smithi134.stdout:5/188: dwrite dc/f1b [0,4194304] 0 2024-04-13T10:58:59.934 INFO:tasks.workunit.client.0.smithi134.stdout:5/189: fdatasync dc/d1d/d20/d23/f25 0 2024-04-13T10:58:59.935 INFO:tasks.workunit.client.0.smithi134.stdout:6/126: creat d4/da/d15/d1f/f21 x:0 0 0 2024-04-13T10:58:59.936 INFO:tasks.workunit.client.0.smithi134.stdout:6/127: fsync d4/f1b 0 2024-04-13T10:58:59.937 INFO:tasks.workunit.client.0.smithi134.stdout:5/190: symlink dc/d1d/d20/d33/l3d 0 2024-04-13T10:58:59.938 INFO:tasks.workunit.client.0.smithi134.stdout:6/128: mknod d4/da/d15/c22 0 2024-04-13T10:58:59.941 INFO:tasks.workunit.client.0.smithi134.stdout:6/129: unlink d4/f10 0 2024-04-13T10:58:59.944 INFO:tasks.workunit.client.0.smithi134.stdout:6/130: write d4/da/d15/f1e [1436772,10276] 0 2024-04-13T10:58:59.945 INFO:tasks.workunit.client.0.smithi134.stdout:5/191: dwrite dc/f10 [0,4194304] 0 2024-04-13T10:58:59.946 INFO:tasks.workunit.client.0.smithi134.stdout:5/192: chown dc/f13 7196 1 2024-04-13T10:58:59.950 INFO:tasks.workunit.client.0.smithi134.stdout:5/193: mkdir dc/d1d/d2b/d30/d3e 0 2024-04-13T10:58:59.952 INFO:tasks.workunit.client.0.smithi134.stdout:6/131: rename d4/da/l12 to d4/da/l23 0 2024-04-13T10:58:59.953 INFO:tasks.workunit.client.0.smithi134.stdout:6/132: fsync d4/fd 0 2024-04-13T10:58:59.953 INFO:tasks.workunit.client.0.smithi134.stdout:5/194: rename dc/l1c to dc/d1d/d20/d23/d36/l3f 0 2024-04-13T10:58:59.957 INFO:tasks.workunit.client.0.smithi134.stdout:5/195: symlink dc/d1d/d20/l40 0 2024-04-13T10:58:59.966 INFO:tasks.workunit.client.0.smithi134.stdout:0/102: sync 2024-04-13T10:58:59.966 INFO:tasks.workunit.client.0.smithi134.stdout:1/72: sync 2024-04-13T10:58:59.968 INFO:tasks.workunit.client.0.smithi134.stdout:5/196: dwrite dc/d1d/d20/d23/f2a [0,4194304] 0 2024-04-13T10:58:59.973 INFO:tasks.workunit.client.0.smithi134.stdout:1/73: truncate d3/f8 1063362 0 2024-04-13T10:58:59.975 INFO:tasks.workunit.client.0.smithi134.stdout:5/197: creat dc/d39/f41 x:0 0 0 2024-04-13T10:58:59.976 INFO:tasks.workunit.client.0.smithi134.stdout:1/74: creat d3/f17 x:0 0 0 2024-04-13T10:58:59.978 INFO:tasks.workunit.client.0.smithi134.stdout:5/198: creat dc/d1d/d20/d23/f42 x:0 0 0 2024-04-13T10:58:59.979 INFO:tasks.workunit.client.0.smithi134.stdout:0/103: dwrite d4/f11 [0,4194304] 0 2024-04-13T10:58:59.981 INFO:tasks.workunit.client.0.smithi134.stdout:1/75: rename f2 to d3/f18 0 2024-04-13T10:58:59.984 INFO:tasks.workunit.client.0.smithi134.stdout:0/104: rmdir d4/d17 39 2024-04-13T10:58:59.988 INFO:tasks.workunit.client.0.smithi134.stdout:0/105: dread d4/f13 [0,4194304] 0 2024-04-13T10:58:59.991 INFO:tasks.workunit.client.0.smithi134.stdout:0/106: chown d4/d17/d1a/c1d 262 1 2024-04-13T10:58:59.994 INFO:tasks.workunit.client.0.smithi134.stdout:0/107: mkdir d4/d17/da/d22 0 2024-04-13T10:58:59.995 INFO:tasks.workunit.client.0.smithi134.stdout:6/133: dwrite d4/f18 [0,4194304] 0 2024-04-13T10:58:59.999 INFO:tasks.workunit.client.0.smithi134.stdout:0/108: mkdir d4/d17/d23 0 2024-04-13T10:58:59.999 INFO:tasks.workunit.client.0.smithi134.stdout:6/134: mkdir d4/da/d15/d1f/d24 0 2024-04-13T10:59:00.002 INFO:tasks.workunit.client.0.smithi134.stdout:0/109: creat d4/d17/d1a/f24 x:0 0 0 2024-04-13T10:59:00.010 INFO:tasks.workunit.client.0.smithi134.stdout:6/135: dwrite d4/da/f14 [0,4194304] 0 2024-04-13T10:59:00.010 INFO:tasks.workunit.client.0.smithi134.stdout:0/110: link d4/d17/da/f15 d4/d17/da/d22/f25 0 2024-04-13T10:59:00.011 INFO:tasks.workunit.client.0.smithi134.stdout:0/111: rename d4/d17 to d4/d17/d20/d26 22 2024-04-13T10:59:00.021 INFO:tasks.workunit.client.0.smithi134.stdout:0/112: link d4/f13 d4/d17/da/f27 0 2024-04-13T10:59:00.025 INFO:tasks.workunit.client.0.smithi134.stdout:0/113: link d4/d17/l18 d4/d17/da/l28 0 2024-04-13T10:59:00.028 INFO:tasks.workunit.client.0.smithi134.stdout:6/136: truncate d4/f6 3264693 0 2024-04-13T10:59:00.029 INFO:tasks.workunit.client.0.smithi134.stdout:0/114: mkdir d4/d17/d20/d29 0 2024-04-13T10:59:00.032 INFO:tasks.workunit.client.0.smithi134.stdout:7/71: sync 2024-04-13T10:59:00.032 INFO:tasks.workunit.client.0.smithi134.stdout:4/48: sync 2024-04-13T10:59:00.033 INFO:tasks.workunit.client.0.smithi134.stdout:4/49: dread - no filename 2024-04-13T10:59:00.033 INFO:tasks.workunit.client.0.smithi134.stdout:9/112: sync 2024-04-13T10:59:00.033 INFO:tasks.workunit.client.0.smithi134.stdout:2/134: sync 2024-04-13T10:59:00.033 INFO:tasks.workunit.client.0.smithi134.stdout:8/44: sync 2024-04-13T10:59:00.033 INFO:tasks.workunit.client.0.smithi134.stdout:3/95: sync 2024-04-13T10:59:00.034 INFO:tasks.workunit.client.0.smithi134.stdout:2/135: stat d5/de/c20 0 2024-04-13T10:59:00.034 INFO:tasks.workunit.client.0.smithi134.stdout:6/137: link d4/fd d4/da/f25 0 2024-04-13T10:59:00.035 INFO:tasks.workunit.client.0.smithi134.stdout:6/138: chown d4/l8 63267022 1 2024-04-13T10:59:00.036 INFO:tasks.workunit.client.0.smithi134.stdout:0/115: rename d4/d17/da/l28 to d4/d17/da/d22/l2a 0 2024-04-13T10:59:00.038 INFO:tasks.workunit.client.0.smithi134.stdout:7/72: dread da/d15/f19 [0,4194304] 0 2024-04-13T10:59:00.039 INFO:tasks.workunit.client.0.smithi134.stdout:8/45: mkdir d8/dc 0 2024-04-13T10:59:00.040 INFO:tasks.workunit.client.0.smithi134.stdout:9/113: mknod d13/c22 0 2024-04-13T10:59:00.041 INFO:tasks.workunit.client.0.smithi134.stdout:9/114: fdatasync d13/f17 0 2024-04-13T10:59:00.045 INFO:tasks.workunit.client.0.smithi134.stdout:0/116: mknod d4/d17/d20/c2b 0 2024-04-13T10:59:00.047 INFO:tasks.workunit.client.0.smithi134.stdout:3/96: mkdir dc/d1d 0 2024-04-13T10:59:00.047 INFO:tasks.workunit.client.0.smithi134.stdout:9/115: dwrite d13/f16 [0,4194304] 0 2024-04-13T10:59:00.048 INFO:tasks.workunit.client.0.smithi134.stdout:9/116: truncate d13/f21 823508 0 2024-04-13T10:59:00.052 INFO:tasks.workunit.client.0.smithi134.stdout:7/73: chown da/d15/c16 383886566 1 2024-04-13T10:59:00.052 INFO:tasks.workunit.client.0.smithi134.stdout:0/117: dread d4/d17/da/f10 [0,4194304] 0 2024-04-13T10:59:00.054 INFO:tasks.workunit.client.0.smithi134.stdout:4/50: symlink d4/da/lb 0 2024-04-13T10:59:00.056 INFO:tasks.workunit.client.0.smithi134.stdout:2/136: symlink d5/d6/l2a 0 2024-04-13T10:59:00.059 INFO:tasks.workunit.client.0.smithi134.stdout:9/117: creat d13/f23 x:0 0 0 2024-04-13T10:59:00.062 INFO:tasks.workunit.client.0.smithi134.stdout:8/46: symlink d8/dc/ld 0 2024-04-13T10:59:00.062 INFO:tasks.workunit.client.0.smithi134.stdout:7/74: symlink da/l1c 0 2024-04-13T10:59:00.063 INFO:tasks.workunit.client.0.smithi134.stdout:7/75: fdatasync da/f11 0 2024-04-13T10:59:00.064 INFO:tasks.workunit.client.0.smithi134.stdout:0/118: rmdir d4/d17/da 39 2024-04-13T10:59:00.069 INFO:tasks.workunit.client.0.smithi134.stdout:9/118: creat d13/f24 x:0 0 0 2024-04-13T10:59:00.070 INFO:tasks.workunit.client.0.smithi134.stdout:8/47: mknod d8/ce 0 2024-04-13T10:59:00.071 INFO:tasks.workunit.client.0.smithi134.stdout:4/51: rmdir d4 39 2024-04-13T10:59:00.071 INFO:tasks.workunit.client.0.smithi134.stdout:4/52: truncate - no filename 2024-04-13T10:59:00.073 INFO:tasks.workunit.client.0.smithi134.stdout:0/119: write d4/d17/da/fe [78260,50308] 0 2024-04-13T10:59:00.074 INFO:tasks.workunit.client.0.smithi134.stdout:6/139: rename d4/da/d15/c16 to d4/da/c26 0 2024-04-13T10:59:00.074 INFO:tasks.workunit.client.0.smithi134.stdout:0/120: write d4/d17/da/fe [3109664,128707] 0 2024-04-13T10:59:00.075 INFO:tasks.workunit.client.0.smithi134.stdout:3/97: rename dc/df to dc/df/d19/d1e 22 2024-04-13T10:59:00.075 INFO:tasks.workunit.client.0.smithi134.stdout:6/140: chown d4/da/d15 0 1 2024-04-13T10:59:00.077 INFO:tasks.workunit.client.0.smithi134.stdout:7/76: dread f4 [0,4194304] 0 2024-04-13T10:59:00.077 INFO:tasks.workunit.client.0.smithi134.stdout:7/77: readlink da/lf 0 2024-04-13T10:59:00.082 INFO:tasks.workunit.client.0.smithi134.stdout:3/98: dwrite dc/f1b [0,4194304] 0 2024-04-13T10:59:00.085 INFO:tasks.workunit.client.0.smithi134.stdout:7/78: dwrite da/f13 [0,4194304] 0 2024-04-13T10:59:00.089 INFO:tasks.workunit.client.0.smithi134.stdout:7/79: dread f5 [4194304,4194304] 0 2024-04-13T10:59:00.090 INFO:tasks.workunit.client.0.smithi134.stdout:7/80: write f8 [595043,118884] 0 2024-04-13T10:59:00.091 INFO:tasks.workunit.client.0.smithi134.stdout:7/81: chown f0 9 1 2024-04-13T10:59:00.107 INFO:tasks.workunit.client.0.smithi134.stdout:9/119: unlink d13/f1a 0 2024-04-13T10:59:00.113 INFO:tasks.workunit.client.0.smithi134.stdout:8/48: rename f5 to d8/ff 0 2024-04-13T10:59:00.114 INFO:tasks.workunit.client.0.smithi134.stdout:8/49: chown d8/ca 156127205 1 2024-04-13T10:59:00.120 INFO:tasks.workunit.client.0.smithi134.stdout:3/99: mkdir dc/df/d1f 0 2024-04-13T10:59:00.124 INFO:tasks.workunit.client.0.smithi134.stdout:3/100: dread dc/df/f18 [0,4194304] 0 2024-04-13T10:59:00.129 INFO:tasks.workunit.client.0.smithi134.stdout:4/53: creat d4/fc x:0 0 0 2024-04-13T10:59:00.130 INFO:tasks.workunit.client.0.smithi134.stdout:0/121: mknod d4/c2c 0 2024-04-13T10:59:00.137 INFO:tasks.workunit.client.0.smithi134.stdout:8/50: rmdir d8 39 2024-04-13T10:59:00.138 INFO:tasks.workunit.client.0.smithi134.stdout:6/141: mknod d4/c27 0 2024-04-13T10:59:00.144 INFO:tasks.workunit.client.0.smithi134.stdout:2/137: getdents d5 0 2024-04-13T10:59:00.146 INFO:tasks.workunit.client.0.smithi134.stdout:3/101: read dc/f10 [3190754,79666] 0 2024-04-13T10:59:00.148 INFO:tasks.workunit.client.0.smithi134.stdout:9/120: rename d13/l20 to d13/l25 0 2024-04-13T10:59:00.148 INFO:tasks.workunit.client.0.smithi134.stdout:9/121: chown d13/c19 700874048 1 2024-04-13T10:59:00.148 INFO:tasks.workunit.client.0.smithi134.stdout:4/54: mkdir d4/dd 0 2024-04-13T10:59:00.151 INFO:tasks.workunit.client.0.smithi134.stdout:0/122: chown d4/d17/fd 122537850 1 2024-04-13T10:59:00.153 INFO:tasks.workunit.client.0.smithi134.stdout:7/82: rename f0 to da/f1d 0 2024-04-13T10:59:00.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/122: dwrite d13/f17 [0,4194304] 0 2024-04-13T10:59:00.155 INFO:tasks.workunit.client.0.smithi134.stdout:9/123: read f8 [1453163,118924] 0 2024-04-13T10:59:00.162 INFO:tasks.workunit.client.0.smithi134.stdout:0/123: rename d4/d17/d1a/c1d to d4/d17/d20/c2d 0 2024-04-13T10:59:00.163 INFO:tasks.workunit.client.0.smithi134.stdout:0/124: chown d4/d17 2513 1 2024-04-13T10:59:00.164 INFO:tasks.workunit.client.0.smithi134.stdout:7/83: symlink da/l1e 0 2024-04-13T10:59:00.167 INFO:tasks.workunit.client.0.smithi134.stdout:9/124: mknod d13/c26 0 2024-04-13T10:59:00.168 INFO:tasks.workunit.client.0.smithi134.stdout:7/84: dread da/fb [0,4194304] 0 2024-04-13T10:59:00.169 INFO:tasks.workunit.client.0.smithi134.stdout:9/125: dread d13/f1e [0,4194304] 0 2024-04-13T10:59:00.169 INFO:tasks.workunit.client.0.smithi134.stdout:2/138: symlink d5/d6/d21/d29/l2b 0 2024-04-13T10:59:00.170 INFO:tasks.workunit.client.0.smithi134.stdout:3/102: creat dc/df/d1f/f20 x:0 0 0 2024-04-13T10:59:00.171 INFO:tasks.workunit.client.0.smithi134.stdout:4/55: getdents d4/dd 0 2024-04-13T10:59:00.174 INFO:tasks.workunit.client.0.smithi134.stdout:2/139: dread d5/de/f19 [0,4194304] 0 2024-04-13T10:59:00.175 INFO:tasks.workunit.client.0.smithi134.stdout:2/140: read d5/fd [3952134,8792] 0 2024-04-13T10:59:00.176 INFO:tasks.workunit.client.0.smithi134.stdout:2/141: dread - d5/de/f16 zero size 2024-04-13T10:59:00.179 INFO:tasks.workunit.client.0.smithi134.stdout:3/103: creat dc/df/f21 x:0 0 0 2024-04-13T10:59:00.180 INFO:tasks.workunit.client.0.smithi134.stdout:9/126: dread f6 [0,4194304] 0 2024-04-13T10:59:00.180 INFO:tasks.workunit.client.0.smithi134.stdout:9/127: readlink l0 0 2024-04-13T10:59:00.181 INFO:tasks.workunit.client.0.smithi134.stdout:6/142: getdents d4/da/d15 0 2024-04-13T10:59:00.188 INFO:tasks.workunit.client.0.smithi134.stdout:4/56: symlink d4/dd/le 0 2024-04-13T10:59:00.188 INFO:tasks.workunit.client.0.smithi134.stdout:6/143: dread d4/da/d15/f1e [0,4194304] 0 2024-04-13T10:59:00.188 INFO:tasks.workunit.client.0.smithi134.stdout:9/128: dwrite d13/f21 [0,4194304] 0 2024-04-13T10:59:00.189 INFO:tasks.workunit.client.0.smithi134.stdout:8/51: getdents d8 0 2024-04-13T10:59:00.190 INFO:tasks.workunit.client.0.smithi134.stdout:4/57: chown d4/dd/le 110 1 2024-04-13T10:59:00.190 INFO:tasks.workunit.client.0.smithi134.stdout:9/129: read f9 [146421,54506] 0 2024-04-13T10:59:00.191 INFO:tasks.workunit.client.0.smithi134.stdout:4/58: fdatasync d4/fc 0 2024-04-13T10:59:00.192 INFO:tasks.workunit.client.0.smithi134.stdout:9/130: write d13/f21 [3521224,69620] 0 2024-04-13T10:59:00.192 INFO:tasks.workunit.client.0.smithi134.stdout:9/131: stat d13/c1b 0 2024-04-13T10:59:00.196 INFO:tasks.workunit.client.0.smithi134.stdout:2/142: rename d5/de/d12/l24 to d5/d6/df/l2c 0 2024-04-13T10:59:00.198 INFO:tasks.workunit.client.0.smithi134.stdout:6/144: symlink d4/da/d15/l28 0 2024-04-13T10:59:00.199 INFO:tasks.workunit.client.0.smithi134.stdout:9/132: dwrite fd [0,4194304] 0 2024-04-13T10:59:00.199 INFO:tasks.workunit.client.0.smithi134.stdout:3/104: mknod dc/d1d/c22 0 2024-04-13T10:59:00.213 INFO:tasks.workunit.client.0.smithi134.stdout:9/133: mknod d13/c27 0 2024-04-13T10:59:00.214 INFO:tasks.workunit.client.0.smithi134.stdout:9/134: read d13/f21 [1059700,43618] 0 2024-04-13T10:59:00.215 INFO:tasks.workunit.client.0.smithi134.stdout:2/143: dwrite f1 [0,4194304] 0 2024-04-13T10:59:00.215 INFO:tasks.workunit.client.0.smithi134.stdout:9/135: read d13/f17 [533762,4817] 0 2024-04-13T10:59:00.221 INFO:tasks.workunit.client.0.smithi134.stdout:9/136: creat d13/f28 x:0 0 0 2024-04-13T10:59:00.223 INFO:tasks.workunit.client.0.smithi134.stdout:3/105: dread dc/fe [0,4194304] 0 2024-04-13T10:59:00.226 INFO:tasks.workunit.client.0.smithi134.stdout:2/144: symlink d5/d6/l2d 0 2024-04-13T10:59:00.231 INFO:tasks.workunit.client.0.smithi134.stdout:9/137: symlink d13/l29 0 2024-04-13T10:59:00.232 INFO:tasks.workunit.client.0.smithi134.stdout:3/106: mkdir dc/df/d19/d23 0 2024-04-13T10:59:00.237 INFO:tasks.workunit.client.0.smithi134.stdout:0/125: unlink d4/d17/d20/c2d 0 2024-04-13T10:59:00.240 INFO:tasks.workunit.client.0.smithi134.stdout:2/145: mkdir d5/de/d2e 0 2024-04-13T10:59:00.252 INFO:tasks.workunit.client.0.smithi134.stdout:2/146: mkdir d5/de/d12/d2f 0 2024-04-13T10:59:00.256 INFO:tasks.workunit.client.0.smithi134.stdout:3/107: dwrite dc/fe [0,4194304] 0 2024-04-13T10:59:00.259 INFO:tasks.workunit.client.0.smithi134.stdout:2/147: truncate d5/d6/df/f14 866337 0 2024-04-13T10:59:00.260 INFO:tasks.workunit.client.0.smithi134.stdout:7/85: truncate da/f13 3177666 0 2024-04-13T10:59:00.261 INFO:tasks.workunit.client.0.smithi134.stdout:4/59: rmdir d4 39 2024-04-13T10:59:00.268 INFO:tasks.workunit.client.0.smithi134.stdout:7/86: truncate da/f12 655539 0 2024-04-13T10:59:00.268 INFO:tasks.workunit.client.0.smithi134.stdout:0/126: link d4/d17/l18 d4/d17/da/l2e 0 2024-04-13T10:59:00.273 INFO:tasks.workunit.client.0.smithi134.stdout:0/127: fsync d4/f11 0 2024-04-13T10:59:00.273 INFO:tasks.workunit.client.0.smithi134.stdout:4/60: fdatasync d4/fc 0 2024-04-13T10:59:00.273 INFO:tasks.workunit.client.0.smithi134.stdout:2/148: mkdir d5/de/d12/d2f/d30 0 2024-04-13T10:59:00.275 INFO:tasks.workunit.client.0.smithi134.stdout:8/52: truncate f0 1319269 0 2024-04-13T10:59:00.277 INFO:tasks.workunit.client.0.smithi134.stdout:7/87: rename da/l1c to da/d15/l1f 0 2024-04-13T10:59:00.279 INFO:tasks.workunit.client.0.smithi134.stdout:0/128: chown d4/c6 785 1 2024-04-13T10:59:00.284 INFO:tasks.workunit.client.0.smithi134.stdout:6/145: dwrite d4/f5 [0,4194304] 0 2024-04-13T10:59:00.285 INFO:tasks.workunit.client.0.smithi134.stdout:6/146: stat d4/da/d15/c22 0 2024-04-13T10:59:00.293 INFO:tasks.workunit.client.0.smithi134.stdout:1/76: sync 2024-04-13T10:59:00.293 INFO:tasks.workunit.client.0.smithi134.stdout:5/199: sync 2024-04-13T10:59:00.293 INFO:tasks.workunit.client.0.smithi134.stdout:8/53: dwrite d8/fb [0,4194304] 0 2024-04-13T10:59:00.293 INFO:tasks.workunit.client.0.smithi134.stdout:6/147: readlink d4/da/d15/l28 0 2024-04-13T10:59:00.293 INFO:tasks.workunit.client.0.smithi134.stdout:8/54: write f3 [5129038,80836] 0 2024-04-13T10:59:00.295 INFO:tasks.workunit.client.0.smithi134.stdout:0/129: unlink d4/d17/fd 0 2024-04-13T10:59:00.299 INFO:tasks.workunit.client.0.smithi134.stdout:5/200: fsync f9 0 2024-04-13T10:59:00.299 INFO:tasks.workunit.client.0.smithi134.stdout:8/55: write d8/fb [1276725,76473] 0 2024-04-13T10:59:00.300 INFO:tasks.workunit.client.0.smithi134.stdout:9/138: rmdir d13 39 2024-04-13T10:59:00.305 INFO:tasks.workunit.client.0.smithi134.stdout:5/201: dread f9 [0,4194304] 0 2024-04-13T10:59:00.308 INFO:tasks.workunit.client.0.smithi134.stdout:1/77: creat d3/d6/d16/f19 x:0 0 0 2024-04-13T10:59:00.308 INFO:tasks.workunit.client.0.smithi134.stdout:7/88: read da/f13 [2789939,37780] 0 2024-04-13T10:59:00.308 INFO:tasks.workunit.client.0.smithi134.stdout:4/61: getdents d4 0 2024-04-13T10:59:00.309 INFO:tasks.workunit.client.0.smithi134.stdout:1/78: dread - d3/d6/fc zero size 2024-04-13T10:59:00.309 INFO:tasks.workunit.client.0.smithi134.stdout:4/62: readlink d4/da/lb 0 2024-04-13T10:59:00.310 INFO:tasks.workunit.client.0.smithi134.stdout:4/63: truncate d4/fc 679777 0 2024-04-13T10:59:00.311 INFO:tasks.workunit.client.0.smithi134.stdout:8/56: unlink d8/fb 0 2024-04-13T10:59:00.312 INFO:tasks.workunit.client.0.smithi134.stdout:8/57: truncate f3 5634410 0 2024-04-13T10:59:00.312 INFO:tasks.workunit.client.0.smithi134.stdout:8/58: chown d8/ce 31752 1 2024-04-13T10:59:00.313 INFO:tasks.workunit.client.0.smithi134.stdout:9/139: chown lf 25336144 1 2024-04-13T10:59:00.314 INFO:tasks.workunit.client.0.smithi134.stdout:3/108: truncate dc/f1b 1455224 0 2024-04-13T10:59:00.314 INFO:tasks.workunit.client.0.smithi134.stdout:9/140: fsync fd 0 2024-04-13T10:59:00.317 INFO:tasks.workunit.client.0.smithi134.stdout:3/109: truncate dc/df/d19/f1c 1014714 0 2024-04-13T10:59:00.317 INFO:tasks.workunit.client.0.smithi134.stdout:6/148: creat d4/da/d1a/f29 x:0 0 0 2024-04-13T10:59:00.318 INFO:tasks.workunit.client.0.smithi134.stdout:6/149: write d4/f5 [2146383,72434] 0 2024-04-13T10:59:00.319 INFO:tasks.workunit.client.0.smithi134.stdout:5/202: creat dc/d15/f43 x:0 0 0 2024-04-13T10:59:00.321 INFO:tasks.workunit.client.0.smithi134.stdout:7/89: fsync da/d15/f19 0 2024-04-13T10:59:00.321 INFO:tasks.workunit.client.0.smithi134.stdout:2/149: write d5/de/f19 [3231194,123430] 0 2024-04-13T10:59:00.324 INFO:tasks.workunit.client.0.smithi134.stdout:1/79: symlink d3/l1a 0 2024-04-13T10:59:00.327 INFO:tasks.workunit.client.0.smithi134.stdout:5/203: dread f1 [0,4194304] 0 2024-04-13T10:59:00.328 INFO:tasks.workunit.client.0.smithi134.stdout:8/59: creat d8/f10 x:0 0 0 2024-04-13T10:59:00.334 INFO:tasks.workunit.client.0.smithi134.stdout:0/130: creat d4/d17/d23/f2f x:0 0 0 2024-04-13T10:59:00.335 INFO:tasks.workunit.client.0.smithi134.stdout:5/204: dread dc/f1b [0,4194304] 0 2024-04-13T10:59:00.337 INFO:tasks.workunit.client.0.smithi134.stdout:6/150: creat d4/da/d15/d1f/f2a x:0 0 0 2024-04-13T10:59:00.337 INFO:tasks.workunit.client.0.smithi134.stdout:6/151: write d4/da/f11 [796249,75662] 0 2024-04-13T10:59:00.341 INFO:tasks.workunit.client.0.smithi134.stdout:7/90: symlink da/l20 0 2024-04-13T10:59:00.348 INFO:tasks.workunit.client.0.smithi134.stdout:9/141: mkdir d13/d2a 0 2024-04-13T10:59:00.351 INFO:tasks.workunit.client.0.smithi134.stdout:1/80: dwrite d3/f18 [0,4194304] 0 2024-04-13T10:59:00.352 INFO:tasks.workunit.client.0.smithi134.stdout:7/91: dwrite da/d15/f19 [0,4194304] 0 2024-04-13T10:59:00.352 INFO:tasks.workunit.client.0.smithi134.stdout:1/81: fdatasync d3/d6/f10 0 2024-04-13T10:59:00.354 INFO:tasks.workunit.client.0.smithi134.stdout:0/131: unlink d4/f13 0 2024-04-13T10:59:00.361 INFO:tasks.workunit.client.0.smithi134.stdout:5/205: creat dc/d1d/f44 x:0 0 0 2024-04-13T10:59:00.364 INFO:tasks.workunit.client.0.smithi134.stdout:3/110: rename dc/df/f21 to dc/f24 0 2024-04-13T10:59:00.365 INFO:tasks.workunit.client.0.smithi134.stdout:9/142: truncate d13/f21 4845707 0 2024-04-13T10:59:00.368 INFO:tasks.workunit.client.0.smithi134.stdout:7/92: symlink da/l21 0 2024-04-13T10:59:00.371 INFO:tasks.workunit.client.0.smithi134.stdout:6/152: mkdir d4/da/d15/d1f/d24/d2b 0 2024-04-13T10:59:00.372 INFO:tasks.workunit.client.0.smithi134.stdout:6/153: fsync d4/f1b 0 2024-04-13T10:59:00.373 INFO:tasks.workunit.client.0.smithi134.stdout:3/111: dwrite dc/df/d19/f1c [0,4194304] 0 2024-04-13T10:59:00.373 INFO:tasks.workunit.client.0.smithi134.stdout:8/60: link d8/dc/ld d8/dc/l11 0 2024-04-13T10:59:00.374 INFO:tasks.workunit.client.0.smithi134.stdout:5/206: rename dc/d1d/f44 to dc/d1d/d2f/d3b/f45 0 2024-04-13T10:59:00.375 INFO:tasks.workunit.client.0.smithi134.stdout:9/143: truncate d13/f17 613778 0 2024-04-13T10:59:00.376 INFO:tasks.workunit.client.0.smithi134.stdout:1/82: mknod d3/d6/c1b 0 2024-04-13T10:59:00.376 INFO:tasks.workunit.client.0.smithi134.stdout:0/132: dread d4/d17/da/f27 [0,4194304] 0 2024-04-13T10:59:00.377 INFO:tasks.workunit.client.0.smithi134.stdout:7/93: creat da/d15/f22 x:0 0 0 2024-04-13T10:59:00.377 INFO:tasks.workunit.client.0.smithi134.stdout:1/83: readlink d3/d6/dd/l12 0 2024-04-13T10:59:00.378 INFO:tasks.workunit.client.0.smithi134.stdout:7/94: chown da/c17 408 1 2024-04-13T10:59:00.379 INFO:tasks.workunit.client.0.smithi134.stdout:7/95: chown da/d15/f19 8 1 2024-04-13T10:59:00.381 INFO:tasks.workunit.client.0.smithi134.stdout:3/112: write dc/fd [241293,19409] 0 2024-04-13T10:59:00.381 INFO:tasks.workunit.client.0.smithi134.stdout:8/61: creat d8/dc/f12 x:0 0 0 2024-04-13T10:59:00.381 INFO:tasks.workunit.client.0.smithi134.stdout:7/96: dread - da/d15/f22 zero size 2024-04-13T10:59:00.386 INFO:tasks.workunit.client.0.smithi134.stdout:1/84: symlink d3/d6/dd/l1c 0 2024-04-13T10:59:00.388 INFO:tasks.workunit.client.0.smithi134.stdout:6/154: mknod d4/c2c 0 2024-04-13T10:59:00.391 INFO:tasks.workunit.client.0.smithi134.stdout:8/62: mkdir d8/dc/d13 0 2024-04-13T10:59:00.392 INFO:tasks.workunit.client.0.smithi134.stdout:6/155: dread d4/f5 [0,4194304] 0 2024-04-13T10:59:00.392 INFO:tasks.workunit.client.0.smithi134.stdout:6/156: stat d4 0 2024-04-13T10:59:00.394 INFO:tasks.workunit.client.0.smithi134.stdout:3/113: mkdir dc/df/d1f/d25 0 2024-04-13T10:59:00.394 INFO:tasks.workunit.client.0.smithi134.stdout:7/97: mknod da/c23 0 2024-04-13T10:59:00.395 INFO:tasks.workunit.client.0.smithi134.stdout:7/98: chown da/lf 444 1 2024-04-13T10:59:00.403 INFO:tasks.workunit.client.0.smithi134.stdout:0/133: write d4/d17/da/f10 [2828800,78147] 0 2024-04-13T10:59:00.405 INFO:tasks.workunit.client.0.smithi134.stdout:0/134: chown d4/d17/d23/f2f 275 1 2024-04-13T10:59:00.406 INFO:tasks.workunit.client.0.smithi134.stdout:9/144: rmdir d13/d2a 0 2024-04-13T10:59:00.407 INFO:tasks.workunit.client.0.smithi134.stdout:6/157: rename d4 to d4/d2d 22 2024-04-13T10:59:00.411 INFO:tasks.workunit.client.0.smithi134.stdout:8/63: dwrite d8/ff [0,4194304] 0 2024-04-13T10:59:00.412 INFO:tasks.workunit.client.0.smithi134.stdout:7/99: creat da/d15/f24 x:0 0 0 2024-04-13T10:59:00.413 INFO:tasks.workunit.client.0.smithi134.stdout:8/64: write f3 [644598,82971] 0 2024-04-13T10:59:00.417 INFO:tasks.workunit.client.0.smithi134.stdout:3/114: dwrite dc/f24 [0,4194304] 0 2024-04-13T10:59:00.423 INFO:tasks.workunit.client.0.smithi134.stdout:1/85: truncate d3/f18 1755159 0 2024-04-13T10:59:00.424 INFO:tasks.workunit.client.0.smithi134.stdout:5/207: getdents dc/d1d/d2f/d3b 0 2024-04-13T10:59:00.424 INFO:tasks.workunit.client.0.smithi134.stdout:1/86: write d3/f9 [1970003,63925] 0 2024-04-13T10:59:00.425 INFO:tasks.workunit.client.0.smithi134.stdout:1/87: dread - d3/ff zero size 2024-04-13T10:59:00.425 INFO:tasks.workunit.client.0.smithi134.stdout:1/88: dread - d3/d6/d16/f19 zero size 2024-04-13T10:59:00.426 INFO:tasks.workunit.client.0.smithi134.stdout:1/89: write d3/d6/f10 [3564541,47800] 0 2024-04-13T10:59:00.428 INFO:tasks.workunit.client.0.smithi134.stdout:1/90: chown d3/d6/dd/l1c 4645 1 2024-04-13T10:59:00.429 INFO:tasks.workunit.client.0.smithi134.stdout:1/91: write d3/d6/fc [900441,22035] 0 2024-04-13T10:59:00.431 INFO:tasks.workunit.client.0.smithi134.stdout:6/158: unlink d4/da/d15/f1c 0 2024-04-13T10:59:00.432 INFO:tasks.workunit.client.0.smithi134.stdout:1/92: truncate d3/f17 865046 0 2024-04-13T10:59:00.433 INFO:tasks.workunit.client.0.smithi134.stdout:9/145: dread d13/f21 [0,4194304] 0 2024-04-13T10:59:00.435 INFO:tasks.workunit.client.0.smithi134.stdout:9/146: write d13/f1e [748586,123680] 0 2024-04-13T10:59:00.436 INFO:tasks.workunit.client.0.smithi134.stdout:9/147: fdatasync fd 0 2024-04-13T10:59:00.437 INFO:tasks.workunit.client.0.smithi134.stdout:3/115: dread dc/f1b [0,4194304] 0 2024-04-13T10:59:00.438 INFO:tasks.workunit.client.0.smithi134.stdout:8/65: fsync f0 0 2024-04-13T10:59:00.439 INFO:tasks.workunit.client.0.smithi134.stdout:1/93: mkdir d3/d6/d16/d1d 0 2024-04-13T10:59:00.442 INFO:tasks.workunit.client.0.smithi134.stdout:3/116: unlink dc/f1a 0 2024-04-13T10:59:00.445 INFO:tasks.workunit.client.0.smithi134.stdout:1/94: mkdir d3/d1e 0 2024-04-13T10:59:00.445 INFO:tasks.workunit.client.0.smithi134.stdout:5/208: truncate f9 1098680 0 2024-04-13T10:59:00.446 INFO:tasks.workunit.client.0.smithi134.stdout:5/209: chown dc/d1d/d20/f2e 9 1 2024-04-13T10:59:00.446 INFO:tasks.workunit.client.0.smithi134.stdout:6/159: creat d4/da/d15/d1f/d24/d2b/f2e x:0 0 0 2024-04-13T10:59:00.447 INFO:tasks.workunit.client.0.smithi134.stdout:6/160: write d4/da/f14 [5212392,36099] 0 2024-04-13T10:59:00.448 INFO:tasks.workunit.client.0.smithi134.stdout:3/117: rmdir dc/df 39 2024-04-13T10:59:00.450 INFO:tasks.workunit.client.0.smithi134.stdout:8/66: creat d8/dc/d13/f14 x:0 0 0 2024-04-13T10:59:00.451 INFO:tasks.workunit.client.0.smithi134.stdout:8/67: stat d8/dc/f12 0 2024-04-13T10:59:00.452 INFO:tasks.workunit.client.0.smithi134.stdout:5/210: mkdir dc/d1d/d46 0 2024-04-13T10:59:00.453 INFO:tasks.workunit.client.0.smithi134.stdout:6/161: dread d4/da/f11 [0,4194304] 0 2024-04-13T10:59:00.459 INFO:tasks.workunit.client.0.smithi134.stdout:1/95: link d3/f9 d3/f1f 0 2024-04-13T10:59:00.461 INFO:tasks.workunit.client.0.smithi134.stdout:7/100: write da/f12 [304772,22595] 0 2024-04-13T10:59:00.462 INFO:tasks.workunit.client.0.smithi134.stdout:8/68: creat d8/dc/f15 x:0 0 0 2024-04-13T10:59:00.463 INFO:tasks.workunit.client.0.smithi134.stdout:6/162: fdatasync d4/fd 0 2024-04-13T10:59:00.467 INFO:tasks.workunit.client.0.smithi134.stdout:0/135: write d4/d17/da/f15 [1028753,123964] 0 2024-04-13T10:59:00.468 INFO:tasks.workunit.client.0.smithi134.stdout:3/118: mknod dc/df/c26 0 2024-04-13T10:59:00.468 INFO:tasks.workunit.client.0.smithi134.stdout:3/119: chown l9 6546848 1 2024-04-13T10:59:00.468 INFO:tasks.workunit.client.0.smithi134.stdout:0/136: dread - d4/d17/d23/f2f zero size 2024-04-13T10:59:00.469 INFO:tasks.workunit.client.0.smithi134.stdout:3/120: readlink l9 0 2024-04-13T10:59:00.470 INFO:tasks.workunit.client.0.smithi134.stdout:3/121: chown l9 140301 1 2024-04-13T10:59:00.472 INFO:tasks.workunit.client.0.smithi134.stdout:8/69: mkdir d8/dc/d16 0 2024-04-13T10:59:00.472 INFO:tasks.workunit.client.0.smithi134.stdout:7/101: write f4 [2594527,116308] 0 2024-04-13T10:59:00.472 INFO:tasks.workunit.client.0.smithi134.stdout:1/96: write d3/d6/f15 [342937,129656] 0 2024-04-13T10:59:00.474 INFO:tasks.workunit.client.0.smithi134.stdout:1/97: readlink d3/l14 0 2024-04-13T10:59:00.474 INFO:tasks.workunit.client.0.smithi134.stdout:8/70: write d8/dc/d13/f14 [902117,83757] 0 2024-04-13T10:59:00.476 INFO:tasks.workunit.client.0.smithi134.stdout:7/102: dread da/f10 [0,4194304] 0 2024-04-13T10:59:00.481 INFO:tasks.workunit.client.0.smithi134.stdout:7/103: dwrite da/d15/f19 [0,4194304] 0 2024-04-13T10:59:00.482 INFO:tasks.workunit.client.0.smithi134.stdout:7/104: truncate da/f12 1048976 0 2024-04-13T10:59:00.539 INFO:tasks.workunit.client.0.smithi134.stdout:7/105: symlink da/l25 0 2024-04-13T10:59:00.542 INFO:tasks.workunit.client.0.smithi134.stdout:7/106: truncate da/d15/f22 760366 0 2024-04-13T10:59:00.542 INFO:tasks.workunit.client.0.smithi134.stdout:0/137: mkdir d4/d17/d20/d29/d30 0 2024-04-13T10:59:00.544 INFO:tasks.workunit.client.0.smithi134.stdout:9/148: dwrite fc [0,4194304] 0 2024-04-13T10:59:00.545 INFO:tasks.workunit.client.0.smithi134.stdout:9/149: write d13/f28 [40555,75514] 0 2024-04-13T10:59:00.546 INFO:tasks.workunit.client.0.smithi134.stdout:9/150: chown d13/f23 19470212 1 2024-04-13T10:59:00.546 INFO:tasks.workunit.client.0.smithi134.stdout:6/163: creat d4/da/f2f x:0 0 0 2024-04-13T10:59:00.546 INFO:tasks.workunit.client.0.smithi134.stdout:9/151: readlink l12 0 2024-04-13T10:59:00.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/152: fsync f4 0 2024-04-13T10:59:00.547 INFO:tasks.workunit.client.0.smithi134.stdout:1/98: mkdir d3/d6/d20 0 2024-04-13T10:59:00.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/153: chown d13 73954763 1 2024-04-13T10:59:00.548 INFO:tasks.workunit.client.0.smithi134.stdout:1/99: stat d3/f9 0 2024-04-13T10:59:00.548 INFO:tasks.workunit.client.0.smithi134.stdout:1/100: stat d3/d6/f7 0 2024-04-13T10:59:00.549 INFO:tasks.workunit.client.0.smithi134.stdout:1/101: write d3/d6/d16/f19 [732950,51589] 0 2024-04-13T10:59:00.551 INFO:tasks.workunit.client.0.smithi134.stdout:8/71: link f3 d8/dc/d16/f17 0 2024-04-13T10:59:00.554 INFO:tasks.workunit.client.0.smithi134.stdout:7/107: mkdir da/d15/d26 0 2024-04-13T10:59:00.554 INFO:tasks.workunit.client.0.smithi134.stdout:7/108: fdatasync da/d15/f19 0 2024-04-13T10:59:00.557 INFO:tasks.workunit.client.0.smithi134.stdout:3/122: rename dc/df to dc/d27 0 2024-04-13T10:59:00.557 INFO:tasks.workunit.client.0.smithi134.stdout:6/164: rename d4 to d4/da/d30 22 2024-04-13T10:59:00.559 INFO:tasks.workunit.client.0.smithi134.stdout:9/154: mknod d13/c2b 0 2024-04-13T10:59:00.561 INFO:tasks.workunit.client.0.smithi134.stdout:1/102: creat d3/d6/dd/f21 x:0 0 0 2024-04-13T10:59:00.562 INFO:tasks.workunit.client.0.smithi134.stdout:1/103: write d3/fb [603356,60482] 0 2024-04-13T10:59:00.563 INFO:tasks.workunit.client.0.smithi134.stdout:8/72: write d8/dc/d16/f17 [443480,4841] 0 2024-04-13T10:59:00.565 INFO:tasks.workunit.client.0.smithi134.stdout:8/73: fsync d8/f10 0 2024-04-13T10:59:00.567 INFO:tasks.workunit.client.0.smithi134.stdout:9/155: dwrite d13/f23 [0,4194304] 0 2024-04-13T10:59:00.569 INFO:tasks.workunit.client.0.smithi134.stdout:0/138: truncate d4/d17/da/f27 2104493 0 2024-04-13T10:59:00.571 INFO:tasks.workunit.client.0.smithi134.stdout:3/123: creat dc/d1d/f28 x:0 0 0 2024-04-13T10:59:00.580 INFO:tasks.workunit.client.0.smithi134.stdout:8/74: symlink d8/l18 0 2024-04-13T10:59:00.580 INFO:tasks.workunit.client.0.smithi134.stdout:8/75: stat d8/l18 0 2024-04-13T10:59:00.582 INFO:tasks.workunit.client.0.smithi134.stdout:7/109: mkdir da/d15/d26/d27 0 2024-04-13T10:59:00.583 INFO:tasks.workunit.client.0.smithi134.stdout:7/110: readlink da/l1e 0 2024-04-13T10:59:00.583 INFO:tasks.workunit.client.0.smithi134.stdout:9/156: symlink d13/l2c 0 2024-04-13T10:59:00.586 INFO:tasks.workunit.client.0.smithi134.stdout:0/139: unlink d4/d17/c1c 0 2024-04-13T10:59:00.588 INFO:tasks.workunit.client.0.smithi134.stdout:3/124: mknod dc/d1d/c29 0 2024-04-13T10:59:00.590 INFO:tasks.workunit.client.0.smithi134.stdout:6/165: write d4/fd [3352632,20791] 0 2024-04-13T10:59:00.595 INFO:tasks.workunit.client.0.smithi134.stdout:8/76: creat d8/f19 x:0 0 0 2024-04-13T10:59:00.598 INFO:tasks.workunit.client.0.smithi134.stdout:6/166: dwrite d4/fd [0,4194304] 0 2024-04-13T10:59:00.603 INFO:tasks.workunit.client.0.smithi134.stdout:3/125: rmdir dc/d27/d19 39 2024-04-13T10:59:00.606 INFO:tasks.workunit.client.0.smithi134.stdout:6/167: dwrite d4/da/d15/d1f/f2a [0,4194304] 0 2024-04-13T10:59:00.612 INFO:tasks.workunit.client.0.smithi134.stdout:0/140: creat d4/d17/da/d22/f31 x:0 0 0 2024-04-13T10:59:00.612 INFO:tasks.workunit.client.0.smithi134.stdout:7/111: write f5 [9060168,125697] 0 2024-04-13T10:59:00.616 INFO:tasks.workunit.client.0.smithi134.stdout:9/157: write f6 [2683745,83864] 0 2024-04-13T10:59:00.617 INFO:tasks.workunit.client.0.smithi134.stdout:6/168: rename d4/da/d1a/l1d to d4/da/d1a/l31 0 2024-04-13T10:59:00.618 INFO:tasks.workunit.client.0.smithi134.stdout:1/104: dwrite d3/f18 [0,4194304] 0 2024-04-13T10:59:00.620 INFO:tasks.workunit.client.0.smithi134.stdout:0/141: truncate d4/d17/da/f15 1637866 0 2024-04-13T10:59:00.625 INFO:tasks.workunit.client.0.smithi134.stdout:7/112: write da/fb [509219,91348] 0 2024-04-13T10:59:00.628 INFO:tasks.workunit.client.0.smithi134.stdout:0/142: mknod d4/d17/d23/c32 0 2024-04-13T10:59:00.628 INFO:tasks.workunit.client.0.smithi134.stdout:0/143: readlink d4/l8 0 2024-04-13T10:59:00.631 INFO:tasks.workunit.client.0.smithi134.stdout:7/113: creat da/d15/d26/f28 x:0 0 0 2024-04-13T10:59:00.632 INFO:tasks.workunit.client.0.smithi134.stdout:3/126: write dc/f1b [1757041,111922] 0 2024-04-13T10:59:00.633 INFO:tasks.workunit.client.0.smithi134.stdout:7/114: fdatasync f4 0 2024-04-13T10:59:00.633 INFO:tasks.workunit.client.0.smithi134.stdout:8/77: dwrite f0 [0,4194304] 0 2024-04-13T10:59:00.634 INFO:tasks.workunit.client.0.smithi134.stdout:6/169: dread d4/da/d15/d1f/f2a [0,4194304] 0 2024-04-13T10:59:00.636 INFO:tasks.workunit.client.0.smithi134.stdout:6/170: chown d4/da/f14 118 1 2024-04-13T10:59:00.637 INFO:tasks.workunit.client.0.smithi134.stdout:0/144: chown d4/d17/da/f1b 1017916 1 2024-04-13T10:59:00.640 INFO:tasks.workunit.client.0.smithi134.stdout:6/171: write d4/da/d15/d1f/f21 [157312,84797] 0 2024-04-13T10:59:00.643 INFO:tasks.workunit.client.0.smithi134.stdout:9/158: dread f4 [0,4194304] 0 2024-04-13T10:59:00.645 INFO:tasks.workunit.client.0.smithi134.stdout:8/78: dwrite d8/dc/f15 [0,4194304] 0 2024-04-13T10:59:00.646 INFO:tasks.workunit.client.0.smithi134.stdout:7/115: creat da/d15/f29 x:0 0 0 2024-04-13T10:59:00.646 INFO:tasks.workunit.client.0.smithi134.stdout:8/79: dread - d8/dc/f12 zero size 2024-04-13T10:59:00.647 INFO:tasks.workunit.client.0.smithi134.stdout:1/105: link d3/f13 d3/d6/d16/d1d/f22 0 2024-04-13T10:59:00.648 INFO:tasks.workunit.client.0.smithi134.stdout:1/106: rename d3/d6 to d3/d6/dd/d23 22 2024-04-13T10:59:00.649 INFO:tasks.workunit.client.0.smithi134.stdout:0/145: unlink d4/l8 0 2024-04-13T10:59:00.651 INFO:tasks.workunit.client.0.smithi134.stdout:3/127: mkdir dc/d2a 0 2024-04-13T10:59:00.651 INFO:tasks.workunit.client.0.smithi134.stdout:1/107: chown d3/d6/dd/f21 1020 1 2024-04-13T10:59:00.652 INFO:tasks.workunit.client.0.smithi134.stdout:9/159: creat d13/f2d x:0 0 0 2024-04-13T10:59:00.653 INFO:tasks.workunit.client.0.smithi134.stdout:6/172: symlink d4/da/d15/d1f/d24/l32 0 2024-04-13T10:59:00.654 INFO:tasks.workunit.client.0.smithi134.stdout:8/80: dwrite f3 [0,4194304] 0 2024-04-13T10:59:00.656 INFO:tasks.workunit.client.0.smithi134.stdout:0/146: chown d4/d17/da/f10 43611187 1 2024-04-13T10:59:00.657 INFO:tasks.workunit.client.0.smithi134.stdout:3/128: creat dc/d27/d1f/f2b x:0 0 0 2024-04-13T10:59:00.659 INFO:tasks.workunit.client.0.smithi134.stdout:9/160: mkdir d13/d2e 0 2024-04-13T10:59:00.660 INFO:tasks.workunit.client.0.smithi134.stdout:8/81: dread d8/dc/f15 [0,4194304] 0 2024-04-13T10:59:00.663 INFO:tasks.workunit.client.0.smithi134.stdout:6/173: symlink d4/da/d15/d1f/d24/d2b/l33 0 2024-04-13T10:59:00.665 INFO:tasks.workunit.client.0.smithi134.stdout:9/161: dread d13/f17 [0,4194304] 0 2024-04-13T10:59:00.665 INFO:tasks.workunit.client.0.smithi134.stdout:8/82: dread f3 [0,4194304] 0 2024-04-13T10:59:00.666 INFO:tasks.workunit.client.0.smithi134.stdout:8/83: dread - d8/f19 zero size 2024-04-13T10:59:00.668 INFO:tasks.workunit.client.0.smithi134.stdout:6/174: dread d4/f18 [0,4194304] 0 2024-04-13T10:59:00.669 INFO:tasks.workunit.client.0.smithi134.stdout:9/162: dread f8 [0,4194304] 0 2024-04-13T10:59:00.671 INFO:tasks.workunit.client.0.smithi134.stdout:9/163: dread d13/f1e [0,4194304] 0 2024-04-13T10:59:00.763 INFO:tasks.workunit.client.0.smithi134.stdout:1/108: creat d3/d6/d20/f24 x:0 0 0 2024-04-13T10:59:00.793 INFO:tasks.workunit.client.0.smithi134.stdout:8/84: creat d8/dc/f1a x:0 0 0 2024-04-13T10:59:00.793 INFO:tasks.workunit.client.0.smithi134.stdout:8/85: write f0 [4765309,94910] 0 2024-04-13T10:59:00.794 INFO:tasks.workunit.client.0.smithi134.stdout:6/175: creat d4/da/d15/d1f/f34 x:0 0 0 2024-04-13T10:59:00.795 INFO:tasks.workunit.client.0.smithi134.stdout:8/86: write d8/ff [3527407,48968] 0 2024-04-13T10:59:00.797 INFO:tasks.workunit.client.0.smithi134.stdout:9/164: mkdir d13/d2f 0 2024-04-13T10:59:00.797 INFO:tasks.workunit.client.0.smithi134.stdout:9/165: stat l12 0 2024-04-13T10:59:00.803 INFO:tasks.workunit.client.0.smithi134.stdout:8/87: dwrite d8/dc/f1a [0,4194304] 0 2024-04-13T10:59:00.810 INFO:tasks.workunit.client.0.smithi134.stdout:1/109: creat d3/d1e/f25 x:0 0 0 2024-04-13T10:59:00.812 INFO:tasks.workunit.client.0.smithi134.stdout:9/166: rename cb to d13/d2f/c30 0 2024-04-13T10:59:00.813 INFO:tasks.workunit.client.0.smithi134.stdout:9/167: read - d13/f24 zero size 2024-04-13T10:59:00.814 INFO:tasks.workunit.client.0.smithi134.stdout:0/147: getdents d4/d17/da 0 2024-04-13T10:59:00.818 INFO:tasks.workunit.client.0.smithi134.stdout:3/129: getdents dc/d27 0 2024-04-13T10:59:00.822 INFO:tasks.workunit.client.0.smithi134.stdout:0/148: creat d4/d17/d20/f33 x:0 0 0 2024-04-13T10:59:00.823 INFO:tasks.workunit.client.0.smithi134.stdout:1/110: creat d3/d6/d16/d1d/f26 x:0 0 0 2024-04-13T10:59:00.825 INFO:tasks.workunit.client.0.smithi134.stdout:6/176: dwrite d4/da/f11 [0,4194304] 0 2024-04-13T10:59:00.830 INFO:tasks.workunit.client.0.smithi134.stdout:3/130: symlink dc/l2c 0 2024-04-13T10:59:00.831 INFO:tasks.workunit.client.0.smithi134.stdout:8/88: dwrite d8/dc/f15 [4194304,4194304] 0 2024-04-13T10:59:00.832 INFO:tasks.workunit.client.0.smithi134.stdout:6/177: chown d4/da/d15/f1e 8 1 2024-04-13T10:59:00.832 INFO:tasks.workunit.client.0.smithi134.stdout:3/131: read dc/f1b [1391661,34272] 0 2024-04-13T10:59:00.832 INFO:tasks.workunit.client.0.smithi134.stdout:9/168: getdents d13/d2f 0 2024-04-13T10:59:00.832 INFO:tasks.workunit.client.0.smithi134.stdout:8/89: chown d8/dc/f12 7956137 1 2024-04-13T10:59:00.835 INFO:tasks.workunit.client.0.smithi134.stdout:6/178: creat d4/da/d15/f35 x:0 0 0 2024-04-13T10:59:00.836 INFO:tasks.workunit.client.0.smithi134.stdout:1/111: creat d3/d6/f27 x:0 0 0 2024-04-13T10:59:00.839 INFO:tasks.workunit.client.0.smithi134.stdout:3/132: creat dc/d27/d1f/f2d x:0 0 0 2024-04-13T10:59:00.839 INFO:tasks.workunit.client.0.smithi134.stdout:3/133: stat dc/d27/d1f 0 2024-04-13T10:59:00.840 INFO:tasks.workunit.client.0.smithi134.stdout:8/90: rename d8/f19 to d8/dc/d16/f1b 0 2024-04-13T10:59:00.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/134: chown dc/d27/f18 280 1 2024-04-13T10:59:00.845 INFO:tasks.workunit.client.0.smithi134.stdout:6/179: creat d4/da/d15/d1f/d24/d2b/f36 x:0 0 0 2024-04-13T10:59:00.845 INFO:tasks.workunit.client.0.smithi134.stdout:6/180: readlink d4/lf 0 2024-04-13T10:59:00.846 INFO:tasks.workunit.client.0.smithi134.stdout:1/112: mkdir d3/d6/d20/d28 0 2024-04-13T10:59:00.849 INFO:tasks.workunit.client.0.smithi134.stdout:3/135: mknod dc/d27/d19/c2e 0 2024-04-13T10:59:00.851 INFO:tasks.workunit.client.0.smithi134.stdout:0/149: link d4/d17/da/l19 d4/d17/l34 0 2024-04-13T10:59:00.851 INFO:tasks.workunit.client.0.smithi134.stdout:9/169: dwrite d13/f21 [0,4194304] 0 2024-04-13T10:59:00.853 INFO:tasks.workunit.client.0.smithi134.stdout:1/113: mknod d3/c29 0 2024-04-13T10:59:00.853 INFO:tasks.workunit.client.0.smithi134.stdout:0/150: fsync d4/d17/da/f15 0 2024-04-13T10:59:00.856 INFO:tasks.workunit.client.0.smithi134.stdout:6/181: rename d4/c2c to d4/da/d15/d1f/d24/c37 0 2024-04-13T10:59:00.857 INFO:tasks.workunit.client.0.smithi134.stdout:3/136: dwrite dc/d27/d19/f1c [0,4194304] 0 2024-04-13T10:59:00.862 INFO:tasks.workunit.client.0.smithi134.stdout:1/114: symlink d3/d1e/l2a 0 2024-04-13T10:59:00.866 INFO:tasks.workunit.client.0.smithi134.stdout:1/115: truncate d3/d6/d20/f24 91045 0 2024-04-13T10:59:00.867 INFO:tasks.workunit.client.0.smithi134.stdout:1/116: stat d3/l1a 0 2024-04-13T10:59:00.868 INFO:tasks.workunit.client.0.smithi134.stdout:3/137: dwrite dc/d1d/f28 [0,4194304] 0 2024-04-13T10:59:00.869 INFO:tasks.workunit.client.0.smithi134.stdout:1/117: write d3/f17 [380380,23893] 0 2024-04-13T10:59:00.869 INFO:tasks.workunit.client.0.smithi134.stdout:3/138: readlink l3 0 2024-04-13T10:59:00.870 INFO:tasks.workunit.client.0.smithi134.stdout:6/182: fsync d4/da/d15/d1f/d24/d2b/f36 0 2024-04-13T10:59:00.870 INFO:tasks.workunit.client.0.smithi134.stdout:1/118: fdatasync d3/d6/d16/f19 0 2024-04-13T10:59:00.871 INFO:tasks.workunit.client.0.smithi134.stdout:6/183: read d4/f18 [1148638,34740] 0 2024-04-13T10:59:00.880 INFO:tasks.workunit.client.0.smithi134.stdout:6/184: read d4/f5 [2765131,7748] 0 2024-04-13T10:59:00.881 INFO:tasks.workunit.client.0.smithi134.stdout:8/91: truncate d8/ff 73021 0 2024-04-13T10:59:00.881 INFO:tasks.workunit.client.0.smithi134.stdout:8/92: chown f3 165 1 2024-04-13T10:59:00.881 INFO:tasks.workunit.client.0.smithi134.stdout:9/170: write f6 [1986822,28422] 0 2024-04-13T10:59:00.885 INFO:tasks.workunit.client.0.smithi134.stdout:1/119: link d3/d6/dd/f21 d3/d6/d20/d28/f2b 0 2024-04-13T10:59:00.886 INFO:tasks.workunit.client.0.smithi134.stdout:0/151: write d4/d17/da/f27 [2279808,19428] 0 2024-04-13T10:59:00.886 INFO:tasks.workunit.client.0.smithi134.stdout:9/171: dread fd [0,4194304] 0 2024-04-13T10:59:00.887 INFO:tasks.workunit.client.0.smithi134.stdout:6/185: symlink d4/da/d15/d1f/l38 0 2024-04-13T10:59:00.889 INFO:tasks.workunit.client.0.smithi134.stdout:6/186: chown d4/lc 110775 1 2024-04-13T10:59:00.890 INFO:tasks.workunit.client.0.smithi134.stdout:9/172: symlink d13/l31 0 2024-04-13T10:59:00.893 INFO:tasks.workunit.client.0.smithi134.stdout:3/139: truncate dc/d27/f14 688125 0 2024-04-13T10:59:00.895 INFO:tasks.workunit.client.0.smithi134.stdout:0/152: dwrite d4/d17/da/f1b [0,4194304] 0 2024-04-13T10:59:00.896 INFO:tasks.workunit.client.0.smithi134.stdout:2/150: sync 2024-04-13T10:59:00.896 INFO:tasks.workunit.client.0.smithi134.stdout:7/116: sync 2024-04-13T10:59:00.896 INFO:tasks.workunit.client.0.smithi134.stdout:4/64: sync 2024-04-13T10:59:00.896 INFO:tasks.workunit.client.0.smithi134.stdout:5/211: sync 2024-04-13T10:59:00.896 INFO:tasks.workunit.client.0.smithi134.stdout:6/187: chown d4/da/d15/d1f/d24/c37 501 1 2024-04-13T10:59:00.897 INFO:tasks.workunit.client.0.smithi134.stdout:9/173: mkdir d13/d32 0 2024-04-13T10:59:00.898 INFO:tasks.workunit.client.0.smithi134.stdout:4/65: readlink d4/da/lb 0 2024-04-13T10:59:00.901 INFO:tasks.workunit.client.0.smithi134.stdout:5/212: read dc/d1d/d20/d23/f25 [1715703,57625] 0 2024-04-13T10:59:00.901 INFO:tasks.workunit.client.0.smithi134.stdout:7/117: write f5 [3131844,24425] 0 2024-04-13T10:59:00.902 INFO:tasks.workunit.client.0.smithi134.stdout:2/151: write d5/de/d12/f25 [993850,81567] 0 2024-04-13T10:59:00.902 INFO:tasks.workunit.client.0.smithi134.stdout:4/66: chown d4/da/lb 58877 1 2024-04-13T10:59:00.903 INFO:tasks.workunit.client.0.smithi134.stdout:3/140: rmdir dc/d27 39 2024-04-13T10:59:00.905 INFO:tasks.workunit.client.0.smithi134.stdout:3/141: chown c8 1854 1 2024-04-13T10:59:00.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/174: write f10 [4494964,47515] 0 2024-04-13T10:59:00.910 INFO:tasks.workunit.client.0.smithi134.stdout:9/175: stat fc 0 2024-04-13T10:59:00.911 INFO:tasks.workunit.client.0.smithi134.stdout:0/153: symlink d4/d17/d20/d29/l35 0 2024-04-13T10:59:00.911 INFO:tasks.workunit.client.0.smithi134.stdout:7/118: rename da/f10 to da/f2a 0 2024-04-13T10:59:00.912 INFO:tasks.workunit.client.0.smithi134.stdout:8/93: dwrite d8/ff [0,4194304] 0 2024-04-13T10:59:00.914 INFO:tasks.workunit.client.0.smithi134.stdout:7/119: write da/d15/f1a [1887155,127880] 0 2024-04-13T10:59:00.914 INFO:tasks.workunit.client.0.smithi134.stdout:2/152: unlink d5/d6/l17 0 2024-04-13T10:59:00.915 INFO:tasks.workunit.client.0.smithi134.stdout:8/94: chown d8/ff 93 1 2024-04-13T10:59:00.918 INFO:tasks.workunit.client.0.smithi134.stdout:1/120: dread d3/fb [0,4194304] 0 2024-04-13T10:59:00.919 INFO:tasks.workunit.client.0.smithi134.stdout:2/153: chown d5/d6/d21/d29/l2b 223169 1 2024-04-13T10:59:00.919 INFO:tasks.workunit.client.0.smithi134.stdout:3/142: dread dc/f24 [0,4194304] 0 2024-04-13T10:59:00.922 INFO:tasks.workunit.client.0.smithi134.stdout:5/213: creat dc/d1d/d46/f47 x:0 0 0 2024-04-13T10:59:00.926 INFO:tasks.workunit.client.0.smithi134.stdout:8/95: creat d8/dc/d16/f1c x:0 0 0 2024-04-13T10:59:00.934 INFO:tasks.workunit.client.0.smithi134.stdout:6/188: dwrite d4/f6 [0,4194304] 0 2024-04-13T10:59:00.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:00 smithi134 ceph-mon[39696]: pgmap v34: 65 pgs: 65 active+clean; 1.3 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 55 MiB/s rd, 139 MiB/s wr, 370 op/s 2024-04-13T10:59:00.935 INFO:tasks.workunit.client.0.smithi134.stdout:6/189: read - d4/da/d15/f35 zero size 2024-04-13T10:59:00.935 INFO:tasks.workunit.client.0.smithi134.stdout:2/154: mkdir d5/de/d12/d2f/d31 0 2024-04-13T10:59:00.936 INFO:tasks.workunit.client.0.smithi134.stdout:0/154: mkdir d4/d17/d36 0 2024-04-13T10:59:00.939 INFO:tasks.workunit.client.0.smithi134.stdout:8/96: creat d8/dc/d16/f1d x:0 0 0 2024-04-13T10:59:00.940 INFO:tasks.workunit.client.0.smithi134.stdout:8/97: chown d8/dc/f12 333 1 2024-04-13T10:59:00.940 INFO:tasks.workunit.client.0.smithi134.stdout:7/120: symlink da/d15/d26/d27/l2b 0 2024-04-13T10:59:00.941 INFO:tasks.workunit.client.0.smithi134.stdout:7/121: write da/d15/f19 [2064370,14306] 0 2024-04-13T10:59:00.942 INFO:tasks.workunit.client.0.smithi134.stdout:4/67: truncate d4/fc 231371 0 2024-04-13T10:59:00.942 INFO:tasks.workunit.client.0.smithi134.stdout:3/143: write dc/f10 [2832993,62171] 0 2024-04-13T10:59:00.943 INFO:tasks.workunit.client.0.smithi134.stdout:1/121: write d3/d6/d20/d28/f2b [991364,40338] 0 2024-04-13T10:59:00.944 INFO:tasks.workunit.client.0.smithi134.stdout:6/190: mknod d4/da/d15/d1f/c39 0 2024-04-13T10:59:00.946 INFO:tasks.workunit.client.0.smithi134.stdout:9/176: truncate d13/f16 2490989 0 2024-04-13T10:59:00.948 INFO:tasks.workunit.client.0.smithi134.stdout:0/155: mkdir d4/d17/da/d22/d37 0 2024-04-13T10:59:00.949 INFO:tasks.workunit.client.0.smithi134.stdout:0/156: chown d4/d17/d20/f33 143830 1 2024-04-13T10:59:00.950 INFO:tasks.workunit.client.0.smithi134.stdout:8/98: rmdir d8/dc/d13 39 2024-04-13T10:59:00.951 INFO:tasks.workunit.client.0.smithi134.stdout:8/99: dread - d8/dc/f12 zero size 2024-04-13T10:59:00.954 INFO:tasks.workunit.client.0.smithi134.stdout:7/122: symlink da/d15/l2c 0 2024-04-13T10:59:00.957 INFO:tasks.workunit.client.0.smithi134.stdout:0/157: dwrite d4/d17/da/f1b [0,4194304] 0 2024-04-13T10:59:00.957 INFO:tasks.workunit.client.0.smithi134.stdout:2/155: symlink d5/de/d12/d2f/d30/l32 0 2024-04-13T10:59:00.960 INFO:tasks.workunit.client.0.smithi134.stdout:6/191: chown d4/da/l23 6528368 1 2024-04-13T10:59:00.965 INFO:tasks.workunit.client.0.smithi134.stdout:3/144: dwrite dc/d27/d1f/f20 [0,4194304] 0 2024-04-13T10:59:00.968 INFO:tasks.workunit.client.0.smithi134.stdout:5/214: truncate dc/d1d/d20/d23/f26 901535 0 2024-04-13T10:59:00.969 INFO:tasks.workunit.client.0.smithi134.stdout:1/122: write d3/f9 [5091500,50642] 0 2024-04-13T10:59:00.971 INFO:tasks.workunit.client.0.smithi134.stdout:7/123: creat da/d15/d26/d27/f2d x:0 0 0 2024-04-13T10:59:00.971 INFO:tasks.workunit.client.0.smithi134.stdout:1/123: stat d3/l14 0 2024-04-13T10:59:00.972 INFO:tasks.workunit.client.0.smithi134.stdout:1/124: readlink d3/d6/dd/le 0 2024-04-13T10:59:00.972 INFO:tasks.workunit.client.0.smithi134.stdout:6/192: dwrite d4/fd [0,4194304] 0 2024-04-13T10:59:00.974 INFO:tasks.workunit.client.0.smithi134.stdout:1/125: write d3/d6/f15 [2436419,107314] 0 2024-04-13T10:59:00.976 INFO:tasks.workunit.client.0.smithi134.stdout:1/126: fsync d3/d6/f10 0 2024-04-13T10:59:00.976 INFO:tasks.workunit.client.0.smithi134.stdout:9/177: getdents d13/d2f 0 2024-04-13T10:59:00.977 INFO:tasks.workunit.client.0.smithi134.stdout:3/145: symlink dc/d27/d19/l2f 0 2024-04-13T10:59:00.978 INFO:tasks.workunit.client.0.smithi134.stdout:3/146: write dc/d1d/f28 [2699912,13072] 0 2024-04-13T10:59:00.980 INFO:tasks.workunit.client.0.smithi134.stdout:8/100: creat d8/dc/d13/f1e x:0 0 0 2024-04-13T10:59:00.981 INFO:tasks.workunit.client.0.smithi134.stdout:4/68: dread d4/fc [0,4194304] 0 2024-04-13T10:59:00.982 INFO:tasks.workunit.client.0.smithi134.stdout:7/124: creat da/d15/f2e x:0 0 0 2024-04-13T10:59:00.985 INFO:tasks.workunit.client.0.smithi134.stdout:6/193: rename d4/f6 to d4/da/d15/d1f/d24/f3a 0 2024-04-13T10:59:00.988 INFO:tasks.workunit.client.0.smithi134.stdout:9/178: unlink d13/c18 0 2024-04-13T10:59:00.991 INFO:tasks.workunit.client.0.smithi134.stdout:7/125: dwrite f8 [0,4194304] 0 2024-04-13T10:59:00.992 INFO:tasks.workunit.client.0.smithi134.stdout:8/101: write d8/dc/d16/f1b [966318,26477] 0 2024-04-13T10:59:00.992 INFO:tasks.workunit.client.0.smithi134.stdout:4/69: rmdir d4/da 39 2024-04-13T10:59:00.993 INFO:tasks.workunit.client.0.smithi134.stdout:8/102: fdatasync d8/dc/f15 0 2024-04-13T10:59:00.994 INFO:tasks.workunit.client.0.smithi134.stdout:4/70: chown d4/dd/le 115272706 1 2024-04-13T10:59:00.996 INFO:tasks.workunit.client.0.smithi134.stdout:0/158: truncate d4/d17/da/d22/f25 253807 0 2024-04-13T10:59:00.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:00 smithi194 ceph-mon[46737]: pgmap v34: 65 pgs: 65 active+clean; 1.3 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 55 MiB/s rd, 139 MiB/s wr, 370 op/s 2024-04-13T10:59:00.999 INFO:tasks.workunit.client.0.smithi134.stdout:2/156: dread d5/d6/f1e [0,4194304] 0 2024-04-13T10:59:01.001 INFO:tasks.workunit.client.0.smithi134.stdout:3/147: rename l3 to dc/d1d/l30 0 2024-04-13T10:59:01.002 INFO:tasks.workunit.client.0.smithi134.stdout:6/194: symlink d4/da/d15/l3b 0 2024-04-13T10:59:01.004 INFO:tasks.workunit.client.0.smithi134.stdout:9/179: symlink d13/l33 0 2024-04-13T10:59:01.010 INFO:tasks.workunit.client.0.smithi134.stdout:8/103: symlink d8/dc/d16/l1f 0 2024-04-13T10:59:01.010 INFO:tasks.workunit.client.0.smithi134.stdout:8/104: write f0 [1311596,111499] 0 2024-04-13T10:59:01.011 INFO:tasks.workunit.client.0.smithi134.stdout:8/105: fsync d8/dc/f15 0 2024-04-13T10:59:01.012 INFO:tasks.workunit.client.0.smithi134.stdout:4/71: chown d4/da/lb 273 1 2024-04-13T10:59:01.013 INFO:tasks.workunit.client.0.smithi134.stdout:0/159: chown d4/d17/l18 42 1 2024-04-13T10:59:01.019 INFO:tasks.workunit.client.0.smithi134.stdout:5/215: write f9 [2122395,102549] 0 2024-04-13T10:59:01.020 INFO:tasks.workunit.client.0.smithi134.stdout:0/160: dwrite d4/d17/da/f10 [4194304,4194304] 0 2024-04-13T10:59:01.021 INFO:tasks.workunit.client.0.smithi134.stdout:6/195: mkdir d4/da/d15/d1f/d3c 0 2024-04-13T10:59:01.023 INFO:tasks.workunit.client.0.smithi134.stdout:5/216: rename dc/d1d/d2b to dc/d1d/d2b/d30/d3e/d48 22 2024-04-13T10:59:01.026 INFO:tasks.workunit.client.0.smithi134.stdout:9/180: symlink d13/d2f/l34 0 2024-04-13T10:59:01.026 INFO:tasks.workunit.client.0.smithi134.stdout:9/181: stat d13/l15 0 2024-04-13T10:59:01.035 INFO:tasks.workunit.client.0.smithi134.stdout:6/196: dwrite d4/da/d1a/f29 [0,4194304] 0 2024-04-13T10:59:01.036 INFO:tasks.workunit.client.0.smithi134.stdout:9/182: dwrite d13/f24 [0,4194304] 0 2024-04-13T10:59:01.090 INFO:tasks.workunit.client.0.smithi134.stdout:4/72: dwrite d4/fc [0,4194304] 0 2024-04-13T10:59:01.108 INFO:tasks.workunit.client.0.smithi134.stdout:3/148: unlink dc/d27/f14 0 2024-04-13T10:59:01.108 INFO:tasks.workunit.client.0.smithi134.stdout:1/127: getdents d3 0 2024-04-13T10:59:01.130 INFO:tasks.workunit.client.0.smithi134.stdout:8/106: rmdir d8 39 2024-04-13T10:59:01.131 INFO:tasks.workunit.client.0.smithi134.stdout:6/197: truncate d4/da/d15/f1e 1334260 0 2024-04-13T10:59:01.132 INFO:tasks.workunit.client.0.smithi134.stdout:7/126: write da/f2a [844644,13588] 0 2024-04-13T10:59:01.135 INFO:tasks.workunit.client.0.smithi134.stdout:5/217: link dc/f14 dc/d1d/f49 0 2024-04-13T10:59:01.136 INFO:tasks.workunit.client.0.smithi134.stdout:3/149: write dc/f24 [3845614,113110] 0 2024-04-13T10:59:01.137 INFO:tasks.workunit.client.0.smithi134.stdout:6/198: chown d4/da/d15/c22 1 1 2024-04-13T10:59:01.137 INFO:tasks.workunit.client.0.smithi134.stdout:7/127: write da/d15/f1a [579701,126296] 0 2024-04-13T10:59:01.139 INFO:tasks.workunit.client.0.smithi134.stdout:7/128: fsync da/f1d 0 2024-04-13T10:59:01.140 INFO:tasks.workunit.client.0.smithi134.stdout:6/199: truncate d4/da/f2f 185297 0 2024-04-13T10:59:01.145 INFO:tasks.workunit.client.0.smithi134.stdout:8/107: dwrite d8/ff [0,4194304] 0 2024-04-13T10:59:01.167 INFO:tasks.workunit.client.0.smithi134.stdout:2/157: getdents d5/d6 0 2024-04-13T10:59:01.168 INFO:tasks.workunit.client.0.smithi134.stdout:2/158: chown d5/d6/df/f14 6700 1 2024-04-13T10:59:01.169 INFO:tasks.workunit.client.0.smithi134.stdout:2/159: fsync d5/d6/df/f14 0 2024-04-13T10:59:01.170 INFO:tasks.workunit.client.0.smithi134.stdout:9/183: truncate d13/f16 3202218 0 2024-04-13T10:59:01.171 INFO:tasks.workunit.client.0.smithi134.stdout:9/184: write d13/f28 [896542,126818] 0 2024-04-13T10:59:01.171 INFO:tasks.workunit.client.0.smithi134.stdout:5/218: mknod dc/d1d/d2f/c4a 0 2024-04-13T10:59:01.173 INFO:tasks.workunit.client.0.smithi134.stdout:9/185: chown lf 6 1 2024-04-13T10:59:01.177 INFO:tasks.workunit.client.0.smithi134.stdout:2/160: dwrite d5/de/d12/f25 [0,4194304] 0 2024-04-13T10:59:01.178 INFO:tasks.workunit.client.0.smithi134.stdout:2/161: chown d5/de/f16 7 1 2024-04-13T10:59:01.180 INFO:tasks.workunit.client.0.smithi134.stdout:7/129: rename da/d15/l2c to da/l2f 0 2024-04-13T10:59:01.193 INFO:tasks.workunit.client.0.smithi134.stdout:8/108: rename l1 to d8/dc/d13/l20 0 2024-04-13T10:59:01.197 INFO:tasks.workunit.client.0.smithi134.stdout:4/73: write d4/fc [4537616,32873] 0 2024-04-13T10:59:01.197 INFO:tasks.workunit.client.0.smithi134.stdout:7/130: creat da/d15/d26/f30 x:0 0 0 2024-04-13T10:59:01.198 INFO:tasks.workunit.client.0.smithi134.stdout:1/128: getdents d3 0 2024-04-13T10:59:01.199 INFO:tasks.workunit.client.0.smithi134.stdout:5/219: mkdir dc/d1d/d20/d23/d38/d3a/d4b 0 2024-04-13T10:59:01.200 INFO:tasks.workunit.client.0.smithi134.stdout:3/150: link dc/d27/c26 dc/d27/d1f/d25/c31 0 2024-04-13T10:59:01.201 INFO:tasks.workunit.client.0.smithi134.stdout:4/74: dread d4/fc [0,4194304] 0 2024-04-13T10:59:01.203 INFO:tasks.workunit.client.0.smithi134.stdout:9/186: rename d13/d32 to d13/d2e/d35 0 2024-04-13T10:59:01.203 INFO:tasks.workunit.client.0.smithi134.stdout:8/109: mknod d8/dc/d13/c21 0 2024-04-13T10:59:01.206 INFO:tasks.workunit.client.0.smithi134.stdout:1/129: creat d3/f2c x:0 0 0 2024-04-13T10:59:01.206 INFO:tasks.workunit.client.0.smithi134.stdout:9/187: dread fd [0,4194304] 0 2024-04-13T10:59:01.313 INFO:tasks.workunit.client.0.smithi134.stdout:7/131: symlink da/d15/d26/l31 0 2024-04-13T10:59:01.318 INFO:tasks.workunit.client.0.smithi134.stdout:1/130: fsync d3/fb 0 2024-04-13T10:59:01.320 INFO:tasks.workunit.client.0.smithi134.stdout:9/188: rename d13/c1b to d13/d2f/c36 0 2024-04-13T10:59:01.320 INFO:tasks.workunit.client.0.smithi134.stdout:9/189: fsync d13/f24 0 2024-04-13T10:59:01.322 INFO:tasks.workunit.client.0.smithi134.stdout:7/132: mkdir da/d15/d32 0 2024-04-13T10:59:01.323 INFO:tasks.workunit.client.0.smithi134.stdout:2/162: getdents d5/d6/d21 0 2024-04-13T10:59:01.327 INFO:tasks.workunit.client.0.smithi134.stdout:3/151: creat dc/d27/d19/d23/f32 x:0 0 0 2024-04-13T10:59:01.332 INFO:tasks.workunit.client.0.smithi134.stdout:2/163: mknod d5/d6/c33 0 2024-04-13T10:59:01.334 INFO:tasks.workunit.client.0.smithi134.stdout:3/152: unlink dc/d27/d19/f1c 0 2024-04-13T10:59:01.337 INFO:tasks.workunit.client.0.smithi134.stdout:8/110: creat d8/dc/f22 x:0 0 0 2024-04-13T10:59:01.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/164: mkdir d5/d6/d34 0 2024-04-13T10:59:01.344 INFO:tasks.workunit.client.0.smithi134.stdout:3/153: dread dc/d27/d1f/f20 [0,4194304] 0 2024-04-13T10:59:01.350 INFO:tasks.workunit.client.0.smithi134.stdout:7/133: rmdir da/d15/d32 0 2024-04-13T10:59:01.352 INFO:tasks.workunit.client.0.smithi134.stdout:3/154: creat dc/d1d/f33 x:0 0 0 2024-04-13T10:59:01.354 INFO:tasks.workunit.client.0.smithi134.stdout:3/155: creat dc/d27/d19/d23/f34 x:0 0 0 2024-04-13T10:59:01.357 INFO:tasks.workunit.client.0.smithi134.stdout:7/134: dwrite da/d15/f2e [0,4194304] 0 2024-04-13T10:59:01.358 INFO:tasks.workunit.client.0.smithi134.stdout:3/156: truncate dc/d27/f18 312070 0 2024-04-13T10:59:01.359 INFO:tasks.workunit.client.0.smithi134.stdout:7/135: write da/f1d [3810238,108584] 0 2024-04-13T10:59:01.363 INFO:tasks.workunit.client.0.smithi134.stdout:7/136: creat da/f33 x:0 0 0 2024-04-13T10:59:01.364 INFO:tasks.workunit.client.0.smithi134.stdout:3/157: truncate dc/f1b 2473549 0 2024-04-13T10:59:01.368 INFO:tasks.workunit.client.0.smithi134.stdout:3/158: write dc/d27/d19/d23/f34 [847143,108665] 0 2024-04-13T10:59:01.371 INFO:tasks.workunit.client.0.smithi134.stdout:6/200: truncate d4/da/d15/d1f/d24/f3a 2566360 0 2024-04-13T10:59:01.372 INFO:tasks.workunit.client.0.smithi134.stdout:3/159: symlink dc/d27/d19/d23/l35 0 2024-04-13T10:59:01.374 INFO:tasks.workunit.client.0.smithi134.stdout:3/160: read dc/fe [2016676,80737] 0 2024-04-13T10:59:01.381 INFO:tasks.workunit.client.0.smithi134.stdout:6/201: dwrite d4/da/d15/d1f/d24/d2b/f36 [0,4194304] 0 2024-04-13T10:59:01.387 INFO:tasks.workunit.client.0.smithi134.stdout:9/190: rename d13/d2f to d13/d37 0 2024-04-13T10:59:01.387 INFO:tasks.workunit.client.0.smithi134.stdout:5/220: truncate dc/f13 2371818 0 2024-04-13T10:59:01.391 INFO:tasks.workunit.client.0.smithi134.stdout:9/191: symlink d13/d2e/l38 0 2024-04-13T10:59:01.394 INFO:tasks.workunit.client.0.smithi134.stdout:9/192: unlink f10 0 2024-04-13T10:59:01.396 INFO:tasks.workunit.client.0.smithi134.stdout:5/221: link dc/d15/f43 dc/d1d/d46/f4c 0 2024-04-13T10:59:01.400 INFO:tasks.workunit.client.0.smithi134.stdout:5/222: getdents dc/d1d/d20/d23/d38/d3a/d4b 0 2024-04-13T10:59:01.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/111: write f3 [2018787,57202] 0 2024-04-13T10:59:01.403 INFO:tasks.workunit.client.0.smithi134.stdout:5/223: creat dc/d1d/d2b/d30/d3e/f4d x:0 0 0 2024-04-13T10:59:01.405 INFO:tasks.workunit.client.0.smithi134.stdout:5/224: fsync dc/d1d/d20/d23/f42 0 2024-04-13T10:59:01.407 INFO:tasks.workunit.client.0.smithi134.stdout:8/112: chown d8/dc/d13/l20 19834027 1 2024-04-13T10:59:01.408 INFO:tasks.workunit.client.0.smithi134.stdout:3/161: truncate dc/d27/d1f/f20 4077609 0 2024-04-13T10:59:01.411 INFO:tasks.workunit.client.0.smithi134.stdout:8/113: symlink d8/dc/d16/l23 0 2024-04-13T10:59:01.412 INFO:tasks.workunit.client.0.smithi134.stdout:2/165: dwrite d5/de/f10 [0,4194304] 0 2024-04-13T10:59:01.421 INFO:tasks.workunit.client.0.smithi134.stdout:2/166: write d5/d6/f9 [3293213,59672] 0 2024-04-13T10:59:01.422 INFO:tasks.workunit.client.0.smithi134.stdout:3/162: dwrite dc/fe [0,4194304] 0 2024-04-13T10:59:01.423 INFO:tasks.workunit.client.0.smithi134.stdout:2/167: rmdir d5/de/d12/d2f/d30 39 2024-04-13T10:59:01.424 INFO:tasks.workunit.client.0.smithi134.stdout:3/163: write dc/fd [45842,109044] 0 2024-04-13T10:59:01.429 INFO:tasks.workunit.client.0.smithi134.stdout:2/168: rename d5/d6/df/l1a to d5/l35 0 2024-04-13T10:59:01.431 INFO:tasks.workunit.client.0.smithi134.stdout:9/193: rename d13/d37 to d13/d39 0 2024-04-13T10:59:01.435 INFO:tasks.workunit.client.0.smithi134.stdout:2/169: rename d5/d6/df/l26 to d5/de/d12/d2f/d31/l36 0 2024-04-13T10:59:01.436 INFO:tasks.workunit.client.0.smithi134.stdout:9/194: dread fd [0,4194304] 0 2024-04-13T10:59:01.441 INFO:tasks.workunit.client.0.smithi134.stdout:2/170: dwrite f1 [0,4194304] 0 2024-04-13T10:59:01.448 INFO:tasks.workunit.client.0.smithi134.stdout:5/225: dwrite dc/f17 [4194304,4194304] 0 2024-04-13T10:59:01.449 INFO:tasks.workunit.client.0.smithi134.stdout:2/171: link d5/de/d12/f1d d5/de/f37 0 2024-04-13T10:59:01.449 INFO:tasks.workunit.client.0.smithi134.stdout:5/226: stat dc/d1d/d20/f2e 0 2024-04-13T10:59:01.450 INFO:tasks.workunit.client.0.smithi134.stdout:9/195: link d13/l1f d13/l3a 0 2024-04-13T10:59:01.451 INFO:tasks.workunit.client.0.smithi134.stdout:0/161: sync 2024-04-13T10:59:01.458 INFO:tasks.workunit.client.0.smithi134.stdout:0/162: mkdir d4/d17/da/d22/d38 0 2024-04-13T10:59:01.461 INFO:tasks.workunit.client.0.smithi134.stdout:3/164: truncate dc/f10 2718472 0 2024-04-13T10:59:01.462 INFO:tasks.workunit.client.0.smithi134.stdout:0/163: mknod d4/d17/d20/c39 0 2024-04-13T10:59:01.464 INFO:tasks.workunit.client.0.smithi134.stdout:3/165: creat dc/d27/d19/f36 x:0 0 0 2024-04-13T10:59:01.465 INFO:tasks.workunit.client.0.smithi134.stdout:3/166: stat dc/d27/d19/c2e 0 2024-04-13T10:59:01.475 INFO:tasks.workunit.client.0.smithi134.stdout:2/172: dread d5/fd [4194304,4194304] 0 2024-04-13T10:59:01.493 INFO:tasks.workunit.client.0.smithi134.stdout:0/164: fsync d4/d17/da/d22/f25 0 2024-04-13T10:59:01.496 INFO:tasks.workunit.client.0.smithi134.stdout:5/227: truncate dc/f13 1832530 0 2024-04-13T10:59:01.501 INFO:tasks.workunit.client.0.smithi134.stdout:2/173: rename d5/d6/df/f14 to d5/d6/d34/f38 0 2024-04-13T10:59:01.503 INFO:tasks.workunit.client.0.smithi134.stdout:9/196: truncate d13/f28 76658 0 2024-04-13T10:59:01.504 INFO:tasks.workunit.client.0.smithi134.stdout:9/197: stat l0 0 2024-04-13T10:59:01.504 INFO:tasks.workunit.client.0.smithi134.stdout:5/228: mknod dc/d1d/d2f/d3b/c4e 0 2024-04-13T10:59:01.507 INFO:tasks.workunit.client.0.smithi134.stdout:5/229: chown dc/d1d/d2b 134 1 2024-04-13T10:59:01.507 INFO:tasks.workunit.client.0.smithi134.stdout:9/198: chown f4 1 1 2024-04-13T10:59:01.507 INFO:tasks.workunit.client.0.smithi134.stdout:3/167: dread dc/f17 [0,4194304] 0 2024-04-13T10:59:01.508 INFO:tasks.workunit.client.0.smithi134.stdout:5/230: dread - dc/d1d/f49 zero size 2024-04-13T10:59:01.508 INFO:tasks.workunit.client.0.smithi134.stdout:3/168: chown dc/d1d/f33 12467 1 2024-04-13T10:59:01.509 INFO:tasks.workunit.client.0.smithi134.stdout:3/169: write dc/fd [830248,44998] 0 2024-04-13T10:59:01.517 INFO:tasks.workunit.client.0.smithi134.stdout:0/165: truncate d4/f11 102722 0 2024-04-13T10:59:01.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/174: write d5/de/f10 [937903,22965] 0 2024-04-13T10:59:01.519 INFO:tasks.workunit.client.0.smithi134.stdout:2/175: truncate d5/de/f16 281549 0 2024-04-13T10:59:01.523 INFO:tasks.workunit.client.0.smithi134.stdout:0/166: creat d4/d17/d20/f3a x:0 0 0 2024-04-13T10:59:01.525 INFO:tasks.workunit.client.0.smithi134.stdout:2/176: mknod d5/de/d12/c39 0 2024-04-13T10:59:01.527 INFO:tasks.workunit.client.0.smithi134.stdout:0/167: creat d4/d17/d23/f3b x:0 0 0 2024-04-13T10:59:01.532 INFO:tasks.workunit.client.0.smithi134.stdout:3/170: getdents dc/d1d 0 2024-04-13T10:59:01.533 INFO:tasks.workunit.client.0.smithi134.stdout:2/177: truncate d5/de/f22 4874267 0 2024-04-13T10:59:01.534 INFO:tasks.workunit.client.0.smithi134.stdout:2/178: write d5/de/d12/f1d [22454,85961] 0 2024-04-13T10:59:01.535 INFO:tasks.workunit.client.0.smithi134.stdout:2/179: stat d5/de/d12/d2f 0 2024-04-13T10:59:01.536 INFO:tasks.workunit.client.0.smithi134.stdout:3/171: rmdir dc/d27/d19 39 2024-04-13T10:59:01.538 INFO:tasks.workunit.client.0.smithi134.stdout:0/168: symlink d4/d17/da/d22/d37/l3c 0 2024-04-13T10:59:01.540 INFO:tasks.workunit.client.0.smithi134.stdout:5/231: write dc/f13 [588645,103545] 0 2024-04-13T10:59:01.542 INFO:tasks.workunit.client.0.smithi134.stdout:3/172: dread dc/d27/f18 [0,4194304] 0 2024-04-13T10:59:01.543 INFO:tasks.workunit.client.0.smithi134.stdout:3/173: stat dc/f24 0 2024-04-13T10:59:01.543 INFO:tasks.workunit.client.0.smithi134.stdout:0/169: truncate d4/d17/da/d22/f25 246645 0 2024-04-13T10:59:01.545 INFO:tasks.workunit.client.0.smithi134.stdout:5/232: symlink dc/l4f 0 2024-04-13T10:59:01.546 INFO:tasks.workunit.client.0.smithi134.stdout:2/180: creat d5/de/d12/d2f/f3a x:0 0 0 2024-04-13T10:59:01.548 INFO:tasks.workunit.client.0.smithi134.stdout:5/233: unlink dc/d1d/l27 0 2024-04-13T10:59:01.550 INFO:tasks.workunit.client.0.smithi134.stdout:2/181: mknod d5/d6/df/c3b 0 2024-04-13T10:59:01.554 INFO:tasks.workunit.client.0.smithi134.stdout:3/174: rename dc/d27/d1f/d25/c31 to dc/d27/d19/c37 0 2024-04-13T10:59:01.557 INFO:tasks.workunit.client.0.smithi134.stdout:3/175: write dc/d27/d1f/f2d [1000589,72112] 0 2024-04-13T10:59:01.558 INFO:tasks.workunit.client.0.smithi134.stdout:2/182: dwrite d5/de/f37 [4194304,4194304] 0 2024-04-13T10:59:01.558 INFO:tasks.workunit.client.0.smithi134.stdout:5/234: dread f1 [0,4194304] 0 2024-04-13T10:59:01.560 INFO:tasks.workunit.client.0.smithi134.stdout:5/235: fdatasync dc/d1d/d20/f2e 0 2024-04-13T10:59:01.562 INFO:tasks.workunit.client.0.smithi134.stdout:2/183: symlink d5/d6/l3c 0 2024-04-13T10:59:01.565 INFO:tasks.workunit.client.0.smithi134.stdout:5/236: mkdir dc/d15/d50 0 2024-04-13T10:59:01.565 INFO:tasks.workunit.client.0.smithi134.stdout:0/170: truncate d4/d17/da/f10 2785662 0 2024-04-13T10:59:01.566 INFO:tasks.workunit.client.0.smithi134.stdout:3/176: mkdir dc/d2a/d38 0 2024-04-13T10:59:01.567 INFO:tasks.workunit.client.0.smithi134.stdout:3/177: stat dc/fe 0 2024-04-13T10:59:01.568 INFO:tasks.workunit.client.0.smithi134.stdout:2/184: symlink d5/d6/d21/l3d 0 2024-04-13T10:59:01.569 INFO:tasks.workunit.client.0.smithi134.stdout:2/185: write d5/de/f16 [1220638,85469] 0 2024-04-13T10:59:01.569 INFO:tasks.workunit.client.0.smithi134.stdout:0/171: symlink d4/d17/da/l3d 0 2024-04-13T10:59:01.571 INFO:tasks.workunit.client.0.smithi134.stdout:5/237: creat dc/d1d/d2f/d3b/f51 x:0 0 0 2024-04-13T10:59:01.574 INFO:tasks.workunit.client.0.smithi134.stdout:2/186: mknod d5/d6/d21/d29/c3e 0 2024-04-13T10:59:01.576 INFO:tasks.workunit.client.0.smithi134.stdout:3/178: fsync dc/f10 0 2024-04-13T10:59:01.577 INFO:tasks.workunit.client.0.smithi134.stdout:5/238: rename dc/d1d/d20/f2e to dc/d1d/d2f/d3b/f52 0 2024-04-13T10:59:01.579 INFO:tasks.workunit.client.0.smithi134.stdout:3/179: truncate dc/d27/d1f/f2d 1441989 0 2024-04-13T10:59:01.579 INFO:tasks.workunit.client.0.smithi134.stdout:2/187: dread d5/de/f19 [0,4194304] 0 2024-04-13T10:59:01.580 INFO:tasks.workunit.client.0.smithi134.stdout:2/188: stat d5/de/d12/d2f 0 2024-04-13T10:59:01.581 INFO:tasks.workunit.client.0.smithi134.stdout:0/172: mkdir d4/d17/d20/d29/d30/d3e 0 2024-04-13T10:59:01.585 INFO:tasks.workunit.client.0.smithi134.stdout:5/239: creat dc/d1d/d2f/d3b/f53 x:0 0 0 2024-04-13T10:59:01.586 INFO:tasks.workunit.client.0.smithi134.stdout:5/240: chown dc/d1d/d2f/d3b/f51 223727859 1 2024-04-13T10:59:01.586 INFO:tasks.workunit.client.0.smithi134.stdout:5/241: dread - dc/d1d/d46/f4c zero size 2024-04-13T10:59:01.588 INFO:tasks.workunit.client.0.smithi134.stdout:3/180: creat dc/d1d/f39 x:0 0 0 2024-04-13T10:59:01.589 INFO:tasks.workunit.client.0.smithi134.stdout:2/189: mknod d5/d6/d21/c3f 0 2024-04-13T10:59:01.593 INFO:tasks.workunit.client.0.smithi134.stdout:5/242: rename dc/d1d/d2f/d3b/f45 to dc/d1d/d2b/d30/f54 0 2024-04-13T10:59:01.595 INFO:tasks.workunit.client.0.smithi134.stdout:2/190: stat d5/d6/df/l2c 0 2024-04-13T10:59:01.599 INFO:tasks.workunit.client.0.smithi134.stdout:0/173: getdents d4/d17/d1a 0 2024-04-13T10:59:01.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/243: dwrite dc/f13 [0,4194304] 0 2024-04-13T10:59:01.601 INFO:tasks.workunit.client.0.smithi134.stdout:5/244: read - fb zero size 2024-04-13T10:59:01.601 INFO:tasks.workunit.client.0.smithi134.stdout:0/174: write d4/d17/da/f27 [651939,101140] 0 2024-04-13T10:59:01.602 INFO:tasks.workunit.client.0.smithi134.stdout:0/175: chown c0 56366 1 2024-04-13T10:59:01.607 INFO:tasks.workunit.client.0.smithi134.stdout:5/245: creat dc/d1d/d20/d23/f55 x:0 0 0 2024-04-13T10:59:01.608 INFO:tasks.workunit.client.0.smithi134.stdout:0/176: creat d4/d17/d20/f3f x:0 0 0 2024-04-13T10:59:01.610 INFO:tasks.workunit.client.0.smithi134.stdout:2/191: link d5/d6/d21/c23 d5/c40 0 2024-04-13T10:59:01.612 INFO:tasks.workunit.client.0.smithi134.stdout:0/177: rename d4/d17/d1a/f24 to d4/d17/da/d22/d37/f40 0 2024-04-13T10:59:01.614 INFO:tasks.workunit.client.0.smithi134.stdout:2/192: mknod d5/d6/c41 0 2024-04-13T10:59:01.615 INFO:tasks.workunit.client.0.smithi134.stdout:5/246: dwrite fb [0,4194304] 0 2024-04-13T10:59:01.622 INFO:tasks.workunit.client.0.smithi134.stdout:5/247: creat dc/d1d/d2f/d3b/f56 x:0 0 0 2024-04-13T10:59:01.623 INFO:tasks.workunit.client.0.smithi134.stdout:5/248: chown f1 977211335 1 2024-04-13T10:59:01.625 INFO:tasks.workunit.client.0.smithi134.stdout:2/193: rename d5/d6/d34/f38 to d5/de/d12/d2f/d30/f42 0 2024-04-13T10:59:01.626 INFO:tasks.workunit.client.0.smithi134.stdout:0/178: dwrite d4/d17/d23/f2f [0,4194304] 0 2024-04-13T10:59:01.627 INFO:tasks.workunit.client.0.smithi134.stdout:0/179: stat d4 0 2024-04-13T10:59:01.630 INFO:tasks.workunit.client.0.smithi134.stdout:5/249: rename dc/f16 to dc/d1d/d2f/d3b/d3c/f57 0 2024-04-13T10:59:01.634 INFO:tasks.workunit.client.0.smithi134.stdout:5/250: symlink dc/d1d/l58 0 2024-04-13T10:59:01.635 INFO:tasks.workunit.client.0.smithi134.stdout:5/251: chown dc/c35 460768 1 2024-04-13T10:59:01.635 INFO:tasks.workunit.client.0.smithi134.stdout:5/252: readlink dc/d1d/l58 0 2024-04-13T10:59:01.636 INFO:tasks.workunit.client.0.smithi134.stdout:5/253: dread - dc/d1d/d46/f4c zero size 2024-04-13T10:59:01.643 INFO:tasks.workunit.client.0.smithi134.stdout:5/254: dwrite dc/d1d/d2f/d3b/f53 [0,4194304] 0 2024-04-13T10:59:01.645 INFO:tasks.workunit.client.0.smithi134.stdout:5/255: write dc/d1d/d20/d23/f2a [536828,101979] 0 2024-04-13T10:59:01.653 INFO:tasks.workunit.client.0.smithi134.stdout:2/194: dread d5/de/f22 [0,4194304] 0 2024-04-13T10:59:01.744 INFO:tasks.workunit.client.0.smithi134.stdout:1/131: sync 2024-04-13T10:59:01.744 INFO:tasks.workunit.client.0.smithi134.stdout:4/75: sync 2024-04-13T10:59:01.746 INFO:tasks.workunit.client.0.smithi134.stdout:1/132: read d3/d6/dd/f21 [76576,105915] 0 2024-04-13T10:59:01.750 INFO:tasks.workunit.client.0.smithi134.stdout:1/133: dread d3/d6/f7 [4194304,4194304] 0 2024-04-13T10:59:01.751 INFO:tasks.workunit.client.0.smithi134.stdout:5/256: rename dc/f13 to dc/d1d/d20/f59 0 2024-04-13T10:59:01.752 INFO:tasks.workunit.client.0.smithi134.stdout:0/180: truncate d4/d17/d23/f2f 2892389 0 2024-04-13T10:59:01.752 INFO:tasks.workunit.client.0.smithi134.stdout:1/134: chown d3/c5 32884835 1 2024-04-13T10:59:01.757 INFO:tasks.workunit.client.0.smithi134.stdout:4/76: rename d4/fc to d4/da/ff 0 2024-04-13T10:59:01.758 INFO:tasks.workunit.client.0.smithi134.stdout:5/257: fsync dc/d1d/d46/f4c 0 2024-04-13T10:59:01.761 INFO:tasks.workunit.client.0.smithi134.stdout:4/77: chown d4/dd/le 46 1 2024-04-13T10:59:01.762 INFO:tasks.workunit.client.0.smithi134.stdout:1/135: mknod d3/c2d 0 2024-04-13T10:59:01.762 INFO:tasks.workunit.client.0.smithi134.stdout:5/258: chown dc/f28 7 1 2024-04-13T10:59:01.763 INFO:tasks.workunit.client.0.smithi134.stdout:2/195: dwrite d5/de/f19 [0,4194304] 0 2024-04-13T10:59:01.763 INFO:tasks.workunit.client.0.smithi134.stdout:4/78: rename d4 to d4/dd/d10 22 2024-04-13T10:59:01.763 INFO:tasks.workunit.client.0.smithi134.stdout:0/181: dwrite d4/d17/d20/f3a [0,4194304] 0 2024-04-13T10:59:01.772 INFO:tasks.workunit.client.0.smithi134.stdout:2/196: creat d5/de/d12/f43 x:0 0 0 2024-04-13T10:59:01.773 INFO:tasks.workunit.client.0.smithi134.stdout:1/136: dwrite d3/d6/f27 [0,4194304] 0 2024-04-13T10:59:01.775 INFO:tasks.workunit.client.0.smithi134.stdout:4/79: fdatasync d4/da/ff 0 2024-04-13T10:59:01.776 INFO:tasks.workunit.client.0.smithi134.stdout:0/182: chown d4/c21 10529 1 2024-04-13T10:59:01.777 INFO:tasks.workunit.client.0.smithi134.stdout:5/259: dread dc/f28 [0,4194304] 0 2024-04-13T10:59:01.779 INFO:tasks.workunit.client.0.smithi134.stdout:1/137: symlink d3/d6/l2e 0 2024-04-13T10:59:01.781 INFO:tasks.workunit.client.0.smithi134.stdout:4/80: rename d4/dd/le to d4/dd/l11 0 2024-04-13T10:59:01.782 INFO:tasks.workunit.client.0.smithi134.stdout:2/197: creat d5/de/d12/d2f/f44 x:0 0 0 2024-04-13T10:59:01.783 INFO:tasks.workunit.client.0.smithi134.stdout:4/81: chown d4/c8 91 1 2024-04-13T10:59:01.784 INFO:tasks.workunit.client.0.smithi134.stdout:2/198: fdatasync d5/de/d12/f43 0 2024-04-13T10:59:01.786 INFO:tasks.workunit.client.0.smithi134.stdout:5/260: dwrite dc/d1d/d20/f2d [0,4194304] 0 2024-04-13T10:59:01.787 INFO:tasks.workunit.client.0.smithi134.stdout:2/199: truncate d5/de/d12/d2f/f3a 730187 0 2024-04-13T10:59:01.789 INFO:tasks.workunit.client.0.smithi134.stdout:2/200: chown d5/c7 122 1 2024-04-13T10:59:01.791 INFO:tasks.workunit.client.0.smithi134.stdout:5/261: mkdir dc/d1d/d20/d23/d5a 0 2024-04-13T10:59:01.791 INFO:tasks.workunit.client.0.smithi134.stdout:2/201: chown d5/d6/c1f 2704 1 2024-04-13T10:59:01.791 INFO:tasks.workunit.client.0.smithi134.stdout:4/82: dread d4/da/ff [0,4194304] 0 2024-04-13T10:59:01.792 INFO:tasks.workunit.client.0.smithi134.stdout:2/202: write d5/de/f19 [59889,128444] 0 2024-04-13T10:59:01.792 INFO:tasks.workunit.client.0.smithi134.stdout:1/138: mknod d3/d6/c2f 0 2024-04-13T10:59:01.793 INFO:tasks.workunit.client.0.smithi134.stdout:1/139: chown d3/f8 13 1 2024-04-13T10:59:01.793 INFO:tasks.workunit.client.0.smithi134.stdout:2/203: read - d5/de/d12/f43 zero size 2024-04-13T10:59:01.796 INFO:tasks.workunit.client.0.smithi134.stdout:1/140: truncate d3/f2c 473645 0 2024-04-13T10:59:01.799 INFO:tasks.workunit.client.0.smithi134.stdout:1/141: mkdir d3/d30 0 2024-04-13T10:59:01.800 INFO:tasks.workunit.client.0.smithi134.stdout:4/83: write d4/da/ff [4556824,1247] 0 2024-04-13T10:59:01.803 INFO:tasks.workunit.client.0.smithi134.stdout:2/204: dwrite d5/d6/d21/f28 [0,4194304] 0 2024-04-13T10:59:01.806 INFO:tasks.workunit.client.0.smithi134.stdout:1/142: creat d3/d6/f31 x:0 0 0 2024-04-13T10:59:01.807 INFO:tasks.workunit.client.0.smithi134.stdout:2/205: mknod d5/d6/c45 0 2024-04-13T10:59:01.809 INFO:tasks.workunit.client.0.smithi134.stdout:2/206: read d5/de/f10 [6839002,50707] 0 2024-04-13T10:59:01.813 INFO:tasks.workunit.client.0.smithi134.stdout:1/143: mknod d3/d6/d16/d1d/c32 0 2024-04-13T10:59:01.815 INFO:tasks.workunit.client.0.smithi134.stdout:2/207: dread d5/de/f16 [0,4194304] 0 2024-04-13T10:59:01.816 INFO:tasks.workunit.client.0.smithi134.stdout:0/183: dwrite d4/d17/da/d22/f25 [0,4194304] 0 2024-04-13T10:59:01.816 INFO:tasks.workunit.client.0.smithi134.stdout:4/84: link d4/da/lb d4/dd/l12 0 2024-04-13T10:59:01.818 INFO:tasks.workunit.client.0.smithi134.stdout:2/208: chown d5/de/d12/d2f/d30/l32 3 1 2024-04-13T10:59:01.821 INFO:tasks.workunit.client.0.smithi134.stdout:2/209: chown d5 322546 1 2024-04-13T10:59:01.822 INFO:tasks.workunit.client.0.smithi134.stdout:1/144: symlink d3/d1e/l33 0 2024-04-13T10:59:01.824 INFO:tasks.workunit.client.0.smithi134.stdout:4/85: mknod d4/da/c13 0 2024-04-13T10:59:01.824 INFO:tasks.workunit.client.0.smithi134.stdout:2/210: fdatasync d5/d6/d21/f28 0 2024-04-13T10:59:01.826 INFO:tasks.workunit.client.0.smithi134.stdout:0/184: mkdir d4/d17/da/d22/d41 0 2024-04-13T10:59:01.829 INFO:tasks.workunit.client.0.smithi134.stdout:1/145: mknod d3/d6/d16/d1d/c34 0 2024-04-13T10:59:01.830 INFO:tasks.workunit.client.0.smithi134.stdout:4/86: rmdir d4/da 39 2024-04-13T10:59:01.831 INFO:tasks.workunit.client.0.smithi134.stdout:0/185: mknod d4/d17/d20/c42 0 2024-04-13T10:59:01.833 INFO:tasks.workunit.client.0.smithi134.stdout:4/87: chown d4/dd/l12 202 1 2024-04-13T10:59:01.834 INFO:tasks.workunit.client.0.smithi134.stdout:0/186: symlink d4/d17/da/d22/l43 0 2024-04-13T10:59:01.838 INFO:tasks.workunit.client.0.smithi134.stdout:0/187: creat d4/d17/da/d22/d38/f44 x:0 0 0 2024-04-13T10:59:01.841 INFO:tasks.workunit.client.0.smithi134.stdout:0/188: mknod d4/d17/d20/d29/d30/d3e/c45 0 2024-04-13T10:59:01.844 INFO:tasks.workunit.client.0.smithi134.stdout:1/146: truncate d3/f17 380558 0 2024-04-13T10:59:01.845 INFO:tasks.workunit.client.0.smithi134.stdout:4/88: truncate d4/da/ff 2498063 0 2024-04-13T10:59:01.847 INFO:tasks.workunit.client.0.smithi134.stdout:1/147: rename d3/d6/dd/f21 to d3/d6/d16/f35 0 2024-04-13T10:59:01.849 INFO:tasks.workunit.client.0.smithi134.stdout:4/89: mknod d4/dd/c14 0 2024-04-13T10:59:01.849 INFO:tasks.workunit.client.0.smithi134.stdout:1/148: creat d3/d6/d16/f36 x:0 0 0 2024-04-13T10:59:01.850 INFO:tasks.workunit.client.0.smithi134.stdout:4/90: mknod d4/dd/c15 0 2024-04-13T10:59:01.852 INFO:tasks.workunit.client.0.smithi134.stdout:1/149: creat d3/d6/d20/d28/f37 x:0 0 0 2024-04-13T10:59:01.855 INFO:tasks.workunit.client.0.smithi134.stdout:1/150: creat d3/d6/d20/f38 x:0 0 0 2024-04-13T10:59:01.857 INFO:tasks.workunit.client.0.smithi134.stdout:1/151: fsync d3/d6/d20/f24 0 2024-04-13T10:59:01.862 INFO:tasks.workunit.client.0.smithi134.stdout:4/91: truncate d4/da/ff 3061032 0 2024-04-13T10:59:01.957 INFO:tasks.workunit.client.0.smithi134.stdout:6/202: sync 2024-04-13T10:59:01.958 INFO:tasks.workunit.client.0.smithi134.stdout:7/137: sync 2024-04-13T10:59:01.958 INFO:tasks.workunit.client.0.smithi134.stdout:1/152: dwrite d3/f8 [0,4194304] 0 2024-04-13T10:59:01.960 INFO:tasks.workunit.client.0.smithi134.stdout:4/92: dwrite d4/da/ff [0,4194304] 0 2024-04-13T10:59:01.960 INFO:tasks.workunit.client.0.smithi134.stdout:7/138: write da/f2a [1360323,73686] 0 2024-04-13T10:59:01.961 INFO:tasks.workunit.client.0.smithi134.stdout:4/93: chown d4/dd/c14 11286 1 2024-04-13T10:59:01.962 INFO:tasks.workunit.client.0.smithi134.stdout:1/153: mkdir d3/d39 0 2024-04-13T10:59:01.967 INFO:tasks.workunit.client.0.smithi134.stdout:6/203: symlink d4/da/d15/d1f/d24/d2b/l3d 0 2024-04-13T10:59:01.973 INFO:tasks.workunit.client.0.smithi134.stdout:6/204: truncate d4/da/d15/d1f/f34 967219 0 2024-04-13T10:59:01.975 INFO:tasks.workunit.client.0.smithi134.stdout:1/154: dwrite d3/d1e/f25 [0,4194304] 0 2024-04-13T10:59:01.975 INFO:tasks.workunit.client.0.smithi134.stdout:7/139: getdents da/d15 0 2024-04-13T10:59:01.975 INFO:tasks.workunit.client.0.smithi134.stdout:4/94: dwrite d4/da/ff [0,4194304] 0 2024-04-13T10:59:01.976 INFO:tasks.workunit.client.0.smithi134.stdout:1/155: fsync d3/d6/f31 0 2024-04-13T10:59:01.979 INFO:tasks.workunit.client.0.smithi134.stdout:6/205: unlink d4/da/d15/d1f/f34 0 2024-04-13T10:59:01.980 INFO:tasks.workunit.client.0.smithi134.stdout:4/95: creat d4/da/f16 x:0 0 0 2024-04-13T10:59:01.986 INFO:tasks.workunit.client.0.smithi134.stdout:6/206: creat d4/da/d15/d1f/d24/f3e x:0 0 0 2024-04-13T10:59:01.990 INFO:tasks.workunit.client.0.smithi134.stdout:7/140: link da/d15/f2e da/d15/d26/d27/f34 0 2024-04-13T10:59:01.991 INFO:tasks.workunit.client.0.smithi134.stdout:4/96: mkdir d4/d17 0 2024-04-13T10:59:01.992 INFO:tasks.workunit.client.0.smithi134.stdout:7/141: write da/d15/d26/d27/f2d [478804,13541] 0 2024-04-13T10:59:01.994 INFO:tasks.workunit.client.0.smithi134.stdout:7/142: chown da/l1e 4 1 2024-04-13T10:59:01.995 INFO:tasks.workunit.client.0.smithi134.stdout:6/207: dwrite d4/da/d1a/f29 [0,4194304] 0 2024-04-13T10:59:01.996 INFO:tasks.workunit.client.0.smithi134.stdout:1/156: creat d3/d6/f3a x:0 0 0 2024-04-13T10:59:02.000 INFO:tasks.workunit.client.0.smithi134.stdout:7/143: creat da/d15/d26/f35 x:0 0 0 2024-04-13T10:59:02.004 INFO:tasks.workunit.client.0.smithi134.stdout:6/208: rename d4/da/d15/d1f/f21 to d4/da/d15/d1f/d24/d2b/f3f 0 2024-04-13T10:59:02.005 INFO:tasks.workunit.client.0.smithi134.stdout:4/97: symlink d4/l18 0 2024-04-13T10:59:02.006 INFO:tasks.workunit.client.0.smithi134.stdout:4/98: read - d4/da/f16 zero size 2024-04-13T10:59:02.006 INFO:tasks.workunit.client.0.smithi134.stdout:4/99: fsync d4/da/ff 0 2024-04-13T10:59:02.009 INFO:tasks.workunit.client.0.smithi134.stdout:7/144: creat da/f36 x:0 0 0 2024-04-13T10:59:02.011 INFO:tasks.workunit.client.0.smithi134.stdout:6/209: creat d4/da/d15/d1f/d24/d2b/f40 x:0 0 0 2024-04-13T10:59:02.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/210: fdatasync d4/da/d15/f35 0 2024-04-13T10:59:02.014 INFO:tasks.workunit.client.0.smithi134.stdout:4/100: unlink d4/c8 0 2024-04-13T10:59:02.015 INFO:tasks.workunit.client.0.smithi134.stdout:4/101: read - d4/da/f16 zero size 2024-04-13T10:59:02.019 INFO:tasks.workunit.client.0.smithi134.stdout:4/102: creat d4/da/f19 x:0 0 0 2024-04-13T10:59:02.020 INFO:tasks.workunit.client.0.smithi134.stdout:7/145: link da/d15/d26/d27/l2b da/d15/l37 0 2024-04-13T10:59:02.022 INFO:tasks.workunit.client.0.smithi134.stdout:4/103: creat d4/dd/f1a x:0 0 0 2024-04-13T10:59:02.024 INFO:tasks.workunit.client.0.smithi134.stdout:6/211: creat d4/da/f41 x:0 0 0 2024-04-13T10:59:02.027 INFO:tasks.workunit.client.0.smithi134.stdout:1/157: dread d3/d6/f15 [0,4194304] 0 2024-04-13T10:59:02.028 INFO:tasks.workunit.client.0.smithi134.stdout:6/212: creat d4/da/d15/d1f/d24/f42 x:0 0 0 2024-04-13T10:59:02.031 INFO:tasks.workunit.client.0.smithi134.stdout:4/104: dwrite d4/da/ff [0,4194304] 0 2024-04-13T10:59:02.031 INFO:tasks.workunit.client.0.smithi134.stdout:1/158: write d3/d6/f27 [1951372,25374] 0 2024-04-13T10:59:02.033 INFO:tasks.workunit.client.0.smithi134.stdout:4/105: write d4/da/ff [3727512,124818] 0 2024-04-13T10:59:02.034 INFO:tasks.workunit.client.0.smithi134.stdout:1/159: truncate d3/d6/d16/d1d/f22 702319 0 2024-04-13T10:59:02.034 INFO:tasks.workunit.client.0.smithi134.stdout:6/213: rmdir d4/da/d1a 39 2024-04-13T10:59:02.034 INFO:tasks.workunit.client.0.smithi134.stdout:1/160: readlink d3/l14 0 2024-04-13T10:59:02.035 INFO:tasks.workunit.client.0.smithi134.stdout:4/106: truncate d4/da/f19 191454 0 2024-04-13T10:59:02.041 INFO:tasks.workunit.client.0.smithi134.stdout:1/161: dwrite d3/f1f [0,4194304] 0 2024-04-13T10:59:02.042 INFO:tasks.workunit.client.0.smithi134.stdout:6/214: rename d4/c27 to d4/da/d15/c43 0 2024-04-13T10:59:02.043 INFO:tasks.workunit.client.0.smithi134.stdout:6/215: fdatasync d4/fd 0 2024-04-13T10:59:02.047 INFO:tasks.workunit.client.0.smithi134.stdout:6/216: write d4/da/d15/d1f/d24/d2b/f2e [740687,12097] 0 2024-04-13T10:59:02.086 INFO:tasks.workunit.client.0.smithi134.stdout:8/114: sync 2024-04-13T10:59:02.091 INFO:tasks.workunit.client.0.smithi134.stdout:6/217: unlink d4/da/lb 0 2024-04-13T10:59:02.092 INFO:tasks.workunit.client.0.smithi134.stdout:1/162: symlink d3/d39/l3b 0 2024-04-13T10:59:02.092 INFO:tasks.workunit.client.0.smithi134.stdout:4/107: rmdir d4/d17 0 2024-04-13T10:59:02.096 INFO:tasks.workunit.client.0.smithi134.stdout:7/146: dwrite da/d15/f2e [0,4194304] 0 2024-04-13T10:59:02.101 INFO:tasks.workunit.client.0.smithi134.stdout:4/108: mkdir d4/d1b 0 2024-04-13T10:59:02.102 INFO:tasks.workunit.client.0.smithi134.stdout:7/147: dread da/f12 [0,4194304] 0 2024-04-13T10:59:02.102 INFO:tasks.workunit.client.0.smithi134.stdout:4/109: write d4/da/f19 [806554,24118] 0 2024-04-13T10:59:02.103 INFO:tasks.workunit.client.0.smithi134.stdout:1/163: unlink d3/d6/d20/d28/f2b 0 2024-04-13T10:59:02.104 INFO:tasks.workunit.client.0.smithi134.stdout:4/110: dread - d4/dd/f1a zero size 2024-04-13T10:59:02.104 INFO:tasks.workunit.client.0.smithi134.stdout:1/164: dread - d3/d6/f31 zero size 2024-04-13T10:59:02.111 INFO:tasks.workunit.client.0.smithi134.stdout:7/148: mkdir da/d15/d26/d38 0 2024-04-13T10:59:02.120 INFO:tasks.workunit.client.0.smithi134.stdout:6/218: write d4/f5 [19673,79973] 0 2024-04-13T10:59:02.123 INFO:tasks.workunit.client.0.smithi134.stdout:1/165: mkdir d3/d6/d16/d1d/d3c 0 2024-04-13T10:59:02.124 INFO:tasks.workunit.client.0.smithi134.stdout:1/166: write d3/d1e/f25 [4184509,129590] 0 2024-04-13T10:59:02.128 INFO:tasks.workunit.client.0.smithi134.stdout:4/111: creat d4/d1b/f1c x:0 0 0 2024-04-13T10:59:02.148 INFO:tasks.workunit.client.0.smithi134.stdout:4/112: getdents d4 0 2024-04-13T10:59:02.149 INFO:tasks.workunit.client.0.smithi134.stdout:7/149: truncate da/f13 1219282 0 2024-04-13T10:59:02.151 INFO:tasks.workunit.client.0.smithi134.stdout:4/113: rename d4/dd/f1a to d4/d1b/f1d 0 2024-04-13T10:59:02.154 INFO:tasks.workunit.client.0.smithi134.stdout:4/114: mknod d4/dd/c1e 0 2024-04-13T10:59:02.155 INFO:tasks.workunit.client.0.smithi134.stdout:7/150: creat da/d15/d26/d38/f39 x:0 0 0 2024-04-13T10:59:02.155 INFO:tasks.workunit.client.0.smithi134.stdout:1/167: write d3/d6/d16/f35 [1984778,115843] 0 2024-04-13T10:59:02.156 INFO:tasks.workunit.client.0.smithi134.stdout:1/168: readlink d3/l1a 0 2024-04-13T10:59:02.157 INFO:tasks.workunit.client.0.smithi134.stdout:4/115: mkdir d4/d1f 0 2024-04-13T10:59:02.157 INFO:tasks.workunit.client.0.smithi134.stdout:1/169: chown d3/d6/c1b 33095 1 2024-04-13T10:59:02.157 INFO:tasks.workunit.client.0.smithi134.stdout:7/151: write da/d15/f22 [383129,67065] 0 2024-04-13T10:59:02.160 INFO:tasks.workunit.client.0.smithi134.stdout:1/170: symlink d3/d6/d20/l3d 0 2024-04-13T10:59:02.162 INFO:tasks.workunit.client.0.smithi134.stdout:6/219: truncate d4/da/f14 1035957 0 2024-04-13T10:59:02.164 INFO:tasks.workunit.client.0.smithi134.stdout:1/171: rename d3/f9 to d3/d6/d20/d28/f3e 0 2024-04-13T10:59:02.165 INFO:tasks.workunit.client.0.smithi134.stdout:1/172: fsync d3/d6/d20/f24 0 2024-04-13T10:59:02.166 INFO:tasks.workunit.client.0.smithi134.stdout:6/220: write d4/da/f25 [3698911,103498] 0 2024-04-13T10:59:02.170 INFO:tasks.workunit.client.0.smithi134.stdout:1/173: mknod d3/d6/d20/d28/c3f 0 2024-04-13T10:59:02.171 INFO:tasks.workunit.client.0.smithi134.stdout:6/221: write d4/da/f2f [197301,1566] 0 2024-04-13T10:59:02.173 INFO:tasks.workunit.client.0.smithi134.stdout:1/174: creat d3/d1e/f40 x:0 0 0 2024-04-13T10:59:02.179 INFO:tasks.workunit.client.0.smithi134.stdout:6/222: creat d4/da/d1a/f44 x:0 0 0 2024-04-13T10:59:02.181 INFO:tasks.workunit.client.0.smithi134.stdout:1/175: dwrite d3/f1f [0,4194304] 0 2024-04-13T10:59:02.188 INFO:tasks.workunit.client.0.smithi134.stdout:4/116: chown d4/dd 7 1 2024-04-13T10:59:02.189 INFO:tasks.workunit.client.0.smithi134.stdout:1/176: creat d3/f41 x:0 0 0 2024-04-13T10:59:02.190 INFO:tasks.workunit.client.0.smithi134.stdout:1/177: chown d3/d6/f3a 989 1 2024-04-13T10:59:02.191 INFO:tasks.workunit.client.0.smithi134.stdout:1/178: truncate d3/d6/d16/f36 233764 0 2024-04-13T10:59:02.192 INFO:tasks.workunit.client.0.smithi134.stdout:6/223: rename d4/da/d15/f35 to d4/da/d15/d1f/d3c/f45 0 2024-04-13T10:59:02.193 INFO:tasks.workunit.client.0.smithi134.stdout:4/117: mknod d4/dd/c20 0 2024-04-13T10:59:02.196 INFO:tasks.workunit.client.0.smithi134.stdout:1/179: rmdir d3/d6/dd 39 2024-04-13T10:59:02.197 INFO:tasks.workunit.client.0.smithi134.stdout:1/180: write d3/d6/d16/f19 [775379,55551] 0 2024-04-13T10:59:02.198 INFO:tasks.workunit.client.0.smithi134.stdout:1/181: chown d3/c2d 1917 1 2024-04-13T10:59:02.201 INFO:tasks.workunit.client.0.smithi134.stdout:4/118: read - d4/d1b/f1c zero size 2024-04-13T10:59:02.205 INFO:tasks.workunit.client.0.smithi134.stdout:6/224: dwrite d4/f18 [4194304,4194304] 0 2024-04-13T10:59:02.206 INFO:tasks.workunit.client.0.smithi134.stdout:1/182: dread d3/d6/d16/f19 [0,4194304] 0 2024-04-13T10:59:02.207 INFO:tasks.workunit.client.0.smithi134.stdout:1/183: dread - d3/d6/f3a zero size 2024-04-13T10:59:02.212 INFO:tasks.workunit.client.0.smithi134.stdout:4/119: unlink d4/da/lb 0 2024-04-13T10:59:02.216 INFO:tasks.workunit.client.0.smithi134.stdout:1/184: creat d3/d6/d20/f42 x:0 0 0 2024-04-13T10:59:02.226 INFO:tasks.workunit.client.0.smithi134.stdout:6/225: link d4/l8 d4/da/d15/d1f/l46 0 2024-04-13T10:59:02.226 INFO:tasks.workunit.client.0.smithi134.stdout:4/120: chown d4/dd/l12 564 1 2024-04-13T10:59:02.230 INFO:tasks.workunit.client.0.smithi134.stdout:4/121: write d4/da/f19 [481551,117594] 0 2024-04-13T10:59:02.230 INFO:tasks.workunit.client.0.smithi134.stdout:6/226: fdatasync d4/da/d15/d1f/d24/f3e 0 2024-04-13T10:59:02.233 INFO:tasks.workunit.client.0.smithi134.stdout:6/227: chown d4/da/d15/d1f/c39 37142158 1 2024-04-13T10:59:02.234 INFO:tasks.workunit.client.0.smithi134.stdout:1/185: dwrite d3/d6/fc [0,4194304] 0 2024-04-13T10:59:02.241 INFO:tasks.workunit.client.0.smithi134.stdout:6/228: mknod d4/da/c47 0 2024-04-13T10:59:02.246 INFO:tasks.workunit.client.0.smithi134.stdout:6/229: symlink d4/da/d1a/l48 0 2024-04-13T10:59:02.248 INFO:tasks.workunit.client.0.smithi134.stdout:4/122: getdents d4/dd 0 2024-04-13T10:59:02.250 INFO:tasks.workunit.client.0.smithi134.stdout:4/123: write d4/da/ff [367054,43550] 0 2024-04-13T10:59:02.253 INFO:tasks.workunit.client.0.smithi134.stdout:6/230: mkdir d4/da/d15/d1f/d24/d49 0 2024-04-13T10:59:02.254 INFO:tasks.workunit.client.0.smithi134.stdout:1/186: dwrite d3/d6/d16/f19 [0,4194304] 0 2024-04-13T10:59:02.255 INFO:tasks.workunit.client.0.smithi134.stdout:4/124: readlink d4/l18 0 2024-04-13T10:59:02.258 INFO:tasks.workunit.client.0.smithi134.stdout:6/231: truncate d4/da/d15/d1f/d24/f42 203681 0 2024-04-13T10:59:02.258 INFO:tasks.workunit.client.0.smithi134.stdout:1/187: creat d3/d30/f43 x:0 0 0 2024-04-13T10:59:02.260 INFO:tasks.workunit.client.0.smithi134.stdout:6/232: read d4/da/d15/d1f/d24/d2b/f2e [251708,126421] 0 2024-04-13T10:59:02.263 INFO:tasks.workunit.client.0.smithi134.stdout:6/233: write d4/da/d1a/f29 [1929444,19878] 0 2024-04-13T10:59:02.268 INFO:tasks.workunit.client.0.smithi134.stdout:1/188: dwrite d3/f8 [4194304,4194304] 0 2024-04-13T10:59:02.272 INFO:tasks.workunit.client.0.smithi134.stdout:6/234: dread d4/da/d1a/f29 [0,4194304] 0 2024-04-13T10:59:02.274 INFO:tasks.workunit.client.0.smithi134.stdout:4/125: getdents d4/da 0 2024-04-13T10:59:02.280 INFO:tasks.workunit.client.0.smithi134.stdout:6/235: dwrite d4/f1b [0,4194304] 0 2024-04-13T10:59:02.282 INFO:tasks.workunit.client.0.smithi134.stdout:6/236: truncate d4/da/d15/d1f/d24/d2b/f3f 720127 0 2024-04-13T10:59:02.284 INFO:tasks.workunit.client.0.smithi134.stdout:1/189: fsync d3/f8 0 2024-04-13T10:59:02.292 INFO:tasks.workunit.client.0.smithi134.stdout:4/126: creat d4/d1f/f21 x:0 0 0 2024-04-13T10:59:02.294 INFO:tasks.workunit.client.0.smithi134.stdout:1/190: dwrite d3/d6/f3a [0,4194304] 0 2024-04-13T10:59:02.301 INFO:tasks.workunit.client.0.smithi134.stdout:6/237: dwrite d4/da/f41 [0,4194304] 0 2024-04-13T10:59:02.304 INFO:tasks.workunit.client.0.smithi134.stdout:1/191: truncate d3/d6/f7 4559886 0 2024-04-13T10:59:02.308 INFO:tasks.workunit.client.0.smithi134.stdout:4/127: creat d4/dd/f22 x:0 0 0 2024-04-13T10:59:02.314 INFO:tasks.workunit.client.0.smithi134.stdout:6/238: getdents d4/da/d15 0 2024-04-13T10:59:02.314 INFO:tasks.workunit.client.0.smithi134.stdout:1/192: dwrite d3/d6/d16/f36 [0,4194304] 0 2024-04-13T10:59:02.315 INFO:tasks.workunit.client.0.smithi134.stdout:1/193: dread - d3/d6/d20/f42 zero size 2024-04-13T10:59:02.316 INFO:tasks.workunit.client.0.smithi134.stdout:6/239: dread - d4/da/d15/d1f/d3c/f45 zero size 2024-04-13T10:59:02.319 INFO:tasks.workunit.client.0.smithi134.stdout:1/194: symlink d3/d39/l44 0 2024-04-13T10:59:02.321 INFO:tasks.workunit.client.0.smithi134.stdout:1/195: creat d3/f45 x:0 0 0 2024-04-13T10:59:02.322 INFO:tasks.workunit.client.0.smithi134.stdout:6/240: link d4/lc d4/l4a 0 2024-04-13T10:59:02.323 INFO:tasks.workunit.client.0.smithi134.stdout:1/196: creat d3/d1e/f46 x:0 0 0 2024-04-13T10:59:02.324 INFO:tasks.workunit.client.0.smithi134.stdout:6/241: creat d4/da/d15/d1f/f4b x:0 0 0 2024-04-13T10:59:02.324 INFO:tasks.workunit.client.0.smithi134.stdout:1/197: truncate d3/d1e/f46 893831 0 2024-04-13T10:59:02.331 INFO:tasks.workunit.client.0.smithi134.stdout:6/242: dwrite d4/da/d15/d1f/d24/d2b/f3f [0,4194304] 0 2024-04-13T10:59:02.339 INFO:tasks.workunit.client.0.smithi134.stdout:1/198: unlink d3/d6/f10 0 2024-04-13T10:59:02.340 INFO:tasks.workunit.client.0.smithi134.stdout:6/243: dread d4/da/d15/d1f/d24/f3a [0,4194304] 0 2024-04-13T10:59:02.341 INFO:tasks.workunit.client.0.smithi134.stdout:1/199: chown d3/f17 518203792 1 2024-04-13T10:59:02.346 INFO:tasks.workunit.client.0.smithi134.stdout:4/128: rename d4/dd/f22 to d4/d1f/f23 0 2024-04-13T10:59:02.347 INFO:tasks.workunit.client.0.smithi134.stdout:4/129: dread - d4/d1b/f1c zero size 2024-04-13T10:59:02.352 INFO:tasks.workunit.client.0.smithi134.stdout:4/130: symlink d4/l24 0 2024-04-13T10:59:02.356 INFO:tasks.workunit.client.0.smithi134.stdout:6/244: getdents d4/da/d15/d1f 0 2024-04-13T10:59:02.366 INFO:tasks.workunit.client.0.smithi134.stdout:1/200: dwrite d3/f17 [0,4194304] 0 2024-04-13T10:59:02.367 INFO:tasks.workunit.client.0.smithi134.stdout:4/131: truncate d4/da/ff 2243298 0 2024-04-13T10:59:02.370 INFO:tasks.workunit.client.0.smithi134.stdout:6/245: dread d4/f5 [0,4194304] 0 2024-04-13T10:59:02.373 INFO:tasks.workunit.client.0.smithi134.stdout:4/132: mknod d4/d1b/c25 0 2024-04-13T10:59:02.374 INFO:tasks.workunit.client.0.smithi134.stdout:4/133: write d4/d1f/f21 [393143,122194] 0 2024-04-13T10:59:02.375 INFO:tasks.workunit.client.0.smithi134.stdout:6/246: dread d4/fd [0,4194304] 0 2024-04-13T10:59:02.376 INFO:tasks.workunit.client.0.smithi134.stdout:1/201: rename d3/d6/d20/l3d to d3/d6/l47 0 2024-04-13T10:59:02.377 INFO:tasks.workunit.client.0.smithi134.stdout:4/134: write d4/d1b/f1d [381900,9144] 0 2024-04-13T10:59:02.378 INFO:tasks.workunit.client.0.smithi134.stdout:1/202: write d3/d6/d20/f24 [777686,8099] 0 2024-04-13T10:59:02.381 INFO:tasks.workunit.client.0.smithi134.stdout:4/135: mkdir d4/d1b/d26 0 2024-04-13T10:59:02.383 INFO:tasks.workunit.client.0.smithi134.stdout:1/203: creat d3/d30/f48 x:0 0 0 2024-04-13T10:59:02.384 INFO:tasks.workunit.client.0.smithi134.stdout:4/136: write d4/da/f19 [1808184,56591] 0 2024-04-13T10:59:02.386 INFO:tasks.workunit.client.0.smithi134.stdout:1/204: write d3/d6/d16/f36 [1084997,94528] 0 2024-04-13T10:59:02.390 INFO:tasks.workunit.client.0.smithi134.stdout:4/137: rename d4/d1b/d26 to d4/d1f/d27 0 2024-04-13T10:59:02.396 INFO:tasks.workunit.client.0.smithi134.stdout:6/247: dwrite d4/da/d15/d1f/f2a [0,4194304] 0 2024-04-13T10:59:02.399 INFO:tasks.workunit.client.0.smithi134.stdout:6/248: truncate d4/da/d15/d1f/d24/f3e 985679 0 2024-04-13T10:59:02.399 INFO:tasks.workunit.client.0.smithi134.stdout:4/138: rename d4/d1f/f21 to d4/d1b/f28 0 2024-04-13T10:59:02.400 INFO:tasks.workunit.client.0.smithi134.stdout:1/205: link d3/d1e/l33 d3/d39/l49 0 2024-04-13T10:59:02.404 INFO:tasks.workunit.client.0.smithi134.stdout:4/139: write d4/d1b/f28 [338802,87795] 0 2024-04-13T10:59:02.405 INFO:tasks.workunit.client.0.smithi134.stdout:6/249: symlink d4/da/d15/d1f/d24/d2b/l4c 0 2024-04-13T10:59:02.414 INFO:tasks.workunit.client.0.smithi134.stdout:1/206: getdents d3/d6/d16/d1d/d3c 0 2024-04-13T10:59:02.414 INFO:tasks.workunit.client.0.smithi134.stdout:1/207: stat d3/d6/l2e 0 2024-04-13T10:59:02.415 INFO:tasks.workunit.client.0.smithi134.stdout:1/208: fdatasync d3/d6/d20/f24 0 2024-04-13T10:59:02.416 INFO:tasks.workunit.client.0.smithi134.stdout:1/209: dread - d3/d6/d20/f42 zero size 2024-04-13T10:59:02.416 INFO:tasks.workunit.client.0.smithi134.stdout:1/210: fdatasync d3/d6/d16/f19 0 2024-04-13T10:59:02.418 INFO:tasks.workunit.client.0.smithi134.stdout:1/211: chown d3/d39/l44 3 1 2024-04-13T10:59:02.420 INFO:tasks.workunit.client.0.smithi134.stdout:4/140: write d4/da/ff [879347,77865] 0 2024-04-13T10:59:02.425 INFO:tasks.workunit.client.0.smithi134.stdout:6/250: creat d4/f4d x:0 0 0 2024-04-13T10:59:02.432 INFO:tasks.workunit.client.0.smithi134.stdout:6/251: rename d4/da/d15/d1f/d24/d2b/l4c to d4/da/d15/d1f/d3c/l4e 0 2024-04-13T10:59:02.433 INFO:tasks.workunit.client.0.smithi134.stdout:4/141: getdents d4/d1f/d27 0 2024-04-13T10:59:02.433 INFO:tasks.workunit.client.0.smithi134.stdout:6/252: write d4/da/f2f [794604,87799] 0 2024-04-13T10:59:02.434 INFO:tasks.workunit.client.0.smithi134.stdout:6/253: chown d4/da/c47 212784637 1 2024-04-13T10:59:02.434 INFO:tasks.workunit.client.0.smithi134.stdout:6/254: chown d4/da/f41 0 1 2024-04-13T10:59:02.436 INFO:tasks.workunit.client.0.smithi134.stdout:1/212: truncate d3/f18 1667917 0 2024-04-13T10:59:02.437 INFO:tasks.workunit.client.0.smithi134.stdout:1/213: chown d3/d6/d20/d28/f37 22909679 1 2024-04-13T10:59:02.437 INFO:tasks.workunit.client.0.smithi134.stdout:1/214: read d3/f8 [4060388,104357] 0 2024-04-13T10:59:02.438 INFO:tasks.workunit.client.0.smithi134.stdout:4/142: symlink d4/d1f/l29 0 2024-04-13T10:59:02.440 INFO:tasks.workunit.client.0.smithi134.stdout:6/255: symlink d4/da/d15/l4f 0 2024-04-13T10:59:02.449 INFO:tasks.workunit.client.0.smithi134.stdout:1/215: symlink d3/d6/dd/l4a 0 2024-04-13T10:59:02.449 INFO:tasks.workunit.client.0.smithi134.stdout:1/216: readlink d3/d39/l3b 0 2024-04-13T10:59:02.450 INFO:tasks.workunit.client.0.smithi134.stdout:1/217: dread - d3/d6/f31 zero size 2024-04-13T10:59:02.451 INFO:tasks.workunit.client.0.smithi134.stdout:1/218: stat d3/d6/d16/d1d/c34 0 2024-04-13T10:59:02.452 INFO:tasks.workunit.client.0.smithi134.stdout:6/256: creat d4/da/d15/d1f/d24/d49/f50 x:0 0 0 2024-04-13T10:59:02.456 INFO:tasks.workunit.client.0.smithi134.stdout:4/143: creat d4/f2a x:0 0 0 2024-04-13T10:59:02.457 INFO:tasks.workunit.client.0.smithi134.stdout:1/219: creat d3/d30/f4b x:0 0 0 2024-04-13T10:59:02.457 INFO:tasks.workunit.client.0.smithi134.stdout:4/144: dread - d4/d1f/f23 zero size 2024-04-13T10:59:02.461 INFO:tasks.workunit.client.0.smithi134.stdout:6/257: creat d4/da/d15/d1f/d24/d2b/f51 x:0 0 0 2024-04-13T10:59:02.462 INFO:tasks.workunit.client.0.smithi134.stdout:4/145: rename d4/d1f/l29 to d4/d1b/l2b 0 2024-04-13T10:59:02.469 INFO:tasks.workunit.client.0.smithi134.stdout:1/220: link d3/d6/dd/l4a d3/d39/l4c 0 2024-04-13T10:59:02.474 INFO:tasks.workunit.client.0.smithi134.stdout:4/146: rename d4/dd/c14 to d4/d1b/c2c 0 2024-04-13T10:59:02.475 INFO:tasks.workunit.client.0.smithi134.stdout:1/221: dread d3/d1e/f46 [0,4194304] 0 2024-04-13T10:59:02.475 INFO:tasks.workunit.client.0.smithi134.stdout:6/258: dread d4/da/f14 [0,4194304] 0 2024-04-13T10:59:02.475 INFO:tasks.workunit.client.0.smithi134.stdout:6/259: stat d4/da/f2f 0 2024-04-13T10:59:02.477 INFO:tasks.workunit.client.0.smithi134.stdout:6/260: dread - d4/da/d15/d1f/d24/d2b/f51 zero size 2024-04-13T10:59:02.477 INFO:tasks.workunit.client.0.smithi134.stdout:1/222: mkdir d3/d6/d16/d4d 0 2024-04-13T10:59:02.478 INFO:tasks.workunit.client.0.smithi134.stdout:1/223: chown d3/d6/f3a 130977 1 2024-04-13T10:59:02.479 INFO:tasks.workunit.client.0.smithi134.stdout:4/147: creat d4/dd/f2d x:0 0 0 2024-04-13T10:59:02.479 INFO:tasks.workunit.client.0.smithi134.stdout:6/261: stat d4/l4a 0 2024-04-13T10:59:02.480 INFO:tasks.workunit.client.0.smithi134.stdout:6/262: chown d4/da/d15/d1f 1010086 1 2024-04-13T10:59:02.481 INFO:tasks.workunit.client.0.smithi134.stdout:1/224: unlink d3/f17 0 2024-04-13T10:59:02.483 INFO:tasks.workunit.client.0.smithi134.stdout:4/148: mkdir d4/d1f/d27/d2e 0 2024-04-13T10:59:02.511 INFO:tasks.workunit.client.0.smithi134.stdout:4/149: getdents d4/d1f/d27 0 2024-04-13T10:59:02.512 INFO:tasks.workunit.client.0.smithi134.stdout:4/150: fsync d4/d1b/f1d 0 2024-04-13T10:59:02.512 INFO:tasks.workunit.client.0.smithi134.stdout:1/225: write d3/f13 [567666,89122] 0 2024-04-13T10:59:02.514 INFO:tasks.workunit.client.0.smithi134.stdout:1/226: chown d3/c29 190 1 2024-04-13T10:59:02.514 INFO:tasks.workunit.client.0.smithi134.stdout:1/227: fdatasync d3/d6/d20/d28/f37 0 2024-04-13T10:59:02.516 INFO:tasks.workunit.client.0.smithi134.stdout:1/228: dread - d3/d6/d20/d28/f37 zero size 2024-04-13T10:59:02.519 INFO:tasks.workunit.client.0.smithi134.stdout:1/229: creat d3/d39/f4e x:0 0 0 2024-04-13T10:59:02.520 INFO:tasks.workunit.client.0.smithi134.stdout:4/151: dwrite d4/d1f/f23 [0,4194304] 0 2024-04-13T10:59:02.521 INFO:tasks.workunit.client.0.smithi134.stdout:1/230: write d3/f13 [1216786,31722] 0 2024-04-13T10:59:02.526 INFO:tasks.workunit.client.0.smithi134.stdout:4/152: mkdir d4/d1f/d27/d2f 0 2024-04-13T10:59:02.528 INFO:tasks.workunit.client.0.smithi134.stdout:4/153: fsync d4/d1b/f1d 0 2024-04-13T10:59:02.528 INFO:tasks.workunit.client.0.smithi134.stdout:1/231: write d3/d30/f48 [495189,42924] 0 2024-04-13T10:59:02.532 INFO:tasks.workunit.client.0.smithi134.stdout:4/154: symlink d4/dd/l30 0 2024-04-13T10:59:02.532 INFO:tasks.workunit.client.0.smithi134.stdout:4/155: dread - d4/d1b/f1c zero size 2024-04-13T10:59:02.534 INFO:tasks.workunit.client.0.smithi134.stdout:1/232: creat d3/d6/f4f x:0 0 0 2024-04-13T10:59:02.535 INFO:tasks.workunit.client.0.smithi134.stdout:4/156: rename d4/dd/f2d to d4/d1f/d27/d2f/f31 0 2024-04-13T10:59:02.540 INFO:tasks.workunit.client.0.smithi134.stdout:1/233: getdents d3/d1e 0 2024-04-13T10:59:02.543 INFO:tasks.workunit.client.0.smithi134.stdout:1/234: write d3/d6/d16/f35 [2852938,96208] 0 2024-04-13T10:59:02.543 INFO:tasks.workunit.client.0.smithi134.stdout:4/157: dwrite d4/f2a [0,4194304] 0 2024-04-13T10:59:02.545 INFO:tasks.workunit.client.0.smithi134.stdout:1/235: dread d3/f2c [0,4194304] 0 2024-04-13T10:59:02.546 INFO:tasks.workunit.client.0.smithi134.stdout:1/236: dread - d3/d6/f4f zero size 2024-04-13T10:59:02.548 INFO:tasks.workunit.client.0.smithi134.stdout:4/158: mkdir d4/d1b/d32 0 2024-04-13T10:59:02.552 INFO:tasks.workunit.client.0.smithi134.stdout:1/237: rename d3/d6/l2e to d3/d6/d16/d1d/d3c/l50 0 2024-04-13T10:59:02.552 INFO:tasks.workunit.client.0.smithi134.stdout:1/238: stat d3/d1e 0 2024-04-13T10:59:02.555 INFO:tasks.workunit.client.0.smithi134.stdout:1/239: mknod d3/d30/c51 0 2024-04-13T10:59:02.556 INFO:tasks.workunit.client.0.smithi134.stdout:1/240: symlink d3/d39/l52 0 2024-04-13T10:59:02.557 INFO:tasks.workunit.client.0.smithi134.stdout:1/241: fdatasync d3/d6/d16/d1d/f22 0 2024-04-13T10:59:02.562 INFO:tasks.workunit.client.0.smithi134.stdout:1/242: rename d3/f1f to d3/d6/d16/d1d/d3c/f53 0 2024-04-13T10:59:02.564 INFO:tasks.workunit.client.0.smithi134.stdout:1/243: symlink d3/d6/d20/l54 0 2024-04-13T10:59:02.570 INFO:tasks.workunit.client.0.smithi134.stdout:1/244: dwrite d3/f8 [0,4194304] 0 2024-04-13T10:59:02.572 INFO:tasks.workunit.client.0.smithi134.stdout:9/199: sync 2024-04-13T10:59:02.573 INFO:tasks.workunit.client.0.smithi134.stdout:9/200: write f6 [3359574,78780] 0 2024-04-13T10:59:02.574 INFO:tasks.workunit.client.0.smithi134.stdout:9/201: write d13/f2d [804880,121503] 0 2024-04-13T10:59:02.574 INFO:tasks.workunit.client.0.smithi134.stdout:9/202: readlink la 0 2024-04-13T10:59:02.575 INFO:tasks.workunit.client.0.smithi134.stdout:9/203: chown l12 21636469 1 2024-04-13T10:59:02.575 INFO:tasks.workunit.client.0.smithi134.stdout:1/245: unlink d3/d1e/f40 0 2024-04-13T10:59:02.576 INFO:tasks.workunit.client.0.smithi134.stdout:1/246: readlink d3/d6/dd/l12 0 2024-04-13T10:59:02.577 INFO:tasks.workunit.client.0.smithi134.stdout:1/247: write d3/ff [897007,3169] 0 2024-04-13T10:59:02.578 INFO:tasks.workunit.client.0.smithi134.stdout:1/248: fdatasync d3/d6/d16/d1d/f26 0 2024-04-13T10:59:02.628 INFO:tasks.workunit.client.0.smithi134.stdout:9/204: creat d13/d39/f3b x:0 0 0 2024-04-13T10:59:02.630 INFO:tasks.workunit.client.0.smithi134.stdout:9/205: rename l7 to d13/d39/l3c 0 2024-04-13T10:59:02.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:02 smithi134 ceph-mon[39696]: pgmap v35: 65 pgs: 65 active+clean; 1.3 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 12 MiB/s rd, 44 MiB/s wr, 173 op/s 2024-04-13T10:59:02.727 INFO:tasks.workunit.client.0.smithi134.stdout:1/249: creat d3/d6/f55 x:0 0 0 2024-04-13T10:59:02.727 INFO:tasks.workunit.client.0.smithi134.stdout:1/250: stat d3 0 2024-04-13T10:59:02.731 INFO:tasks.workunit.client.0.smithi134.stdout:1/251: rename d3/f2c to d3/d6/dd/f56 0 2024-04-13T10:59:02.732 INFO:tasks.workunit.client.0.smithi134.stdout:1/252: chown d3/d1e/l2a 30098821 1 2024-04-13T10:59:02.733 INFO:tasks.workunit.client.0.smithi134.stdout:1/253: chown d3/l14 11 1 2024-04-13T10:59:02.736 INFO:tasks.workunit.client.0.smithi134.stdout:1/254: mkdir d3/d6/d16/d1d/d57 0 2024-04-13T10:59:02.737 INFO:tasks.workunit.client.0.smithi134.stdout:9/206: write d13/f28 [24162,92403] 0 2024-04-13T10:59:02.738 INFO:tasks.workunit.client.0.smithi134.stdout:9/207: stat l12 0 2024-04-13T10:59:02.740 INFO:tasks.workunit.client.0.smithi134.stdout:9/208: write d13/f17 [4509347,59101] 0 2024-04-13T10:59:02.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:02 smithi194 ceph-mon[46737]: pgmap v35: 65 pgs: 65 active+clean; 1.3 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 12 MiB/s rd, 44 MiB/s wr, 173 op/s 2024-04-13T10:59:02.748 INFO:tasks.workunit.client.0.smithi134.stdout:1/255: truncate d3/d6/f3a 2493035 0 2024-04-13T10:59:02.750 INFO:tasks.workunit.client.0.smithi134.stdout:1/256: creat d3/d6/d16/d1d/f58 x:0 0 0 2024-04-13T10:59:02.750 INFO:tasks.workunit.client.0.smithi134.stdout:9/209: link d13/l1f d13/l3d 0 2024-04-13T10:59:02.756 INFO:tasks.workunit.client.0.smithi134.stdout:1/257: link d3/l1a d3/d6/d20/d28/l59 0 2024-04-13T10:59:02.756 INFO:tasks.workunit.client.0.smithi134.stdout:9/210: dwrite f4 [0,4194304] 0 2024-04-13T10:59:02.757 INFO:tasks.workunit.client.0.smithi134.stdout:1/258: fdatasync d3/d6/d20/f42 0 2024-04-13T10:59:02.758 INFO:tasks.workunit.client.0.smithi134.stdout:1/259: write d3/d6/d20/f38 [481863,21112] 0 2024-04-13T10:59:02.762 INFO:tasks.workunit.client.0.smithi134.stdout:9/211: creat d13/d2e/f3e x:0 0 0 2024-04-13T10:59:02.762 INFO:tasks.workunit.client.0.smithi134.stdout:1/260: mknod d3/d6/d16/c5a 0 2024-04-13T10:59:02.765 INFO:tasks.workunit.client.0.smithi134.stdout:9/212: rmdir d13/d39 39 2024-04-13T10:59:02.778 INFO:tasks.workunit.client.0.smithi134.stdout:9/213: creat d13/f3f x:0 0 0 2024-04-13T10:59:02.779 INFO:tasks.workunit.client.0.smithi134.stdout:5/262: sync 2024-04-13T10:59:02.779 INFO:tasks.workunit.client.0.smithi134.stdout:3/181: sync 2024-04-13T10:59:02.781 INFO:tasks.workunit.client.0.smithi134.stdout:3/182: fdatasync dc/d27/d1f/f2d 0 2024-04-13T10:59:02.785 INFO:tasks.workunit.client.0.smithi134.stdout:1/261: dwrite d3/d6/d16/d1d/d3c/f53 [4194304,4194304] 0 2024-04-13T10:59:02.787 INFO:tasks.workunit.client.0.smithi134.stdout:5/263: dread fb [0,4194304] 0 2024-04-13T10:59:02.788 INFO:tasks.workunit.client.0.smithi134.stdout:1/262: fsync d3/d6/d16/d1d/f26 0 2024-04-13T10:59:02.789 INFO:tasks.workunit.client.0.smithi134.stdout:9/214: truncate fd 4125833 0 2024-04-13T10:59:02.793 INFO:tasks.workunit.client.0.smithi134.stdout:3/183: link dc/d27/l13 dc/d2a/l3a 0 2024-04-13T10:59:02.794 INFO:tasks.workunit.client.0.smithi134.stdout:9/215: mkdir d13/d40 0 2024-04-13T10:59:02.795 INFO:tasks.workunit.client.0.smithi134.stdout:3/184: creat dc/d27/d19/f3b x:0 0 0 2024-04-13T10:59:02.795 INFO:tasks.workunit.client.0.smithi134.stdout:3/185: chown dc 164295094 1 2024-04-13T10:59:02.797 INFO:tasks.workunit.client.0.smithi134.stdout:5/264: getdents dc/d1d/d20/d23/d38/d3a 0 2024-04-13T10:59:02.797 INFO:tasks.workunit.client.0.smithi134.stdout:5/265: chown dc/d1d/d20/d23/d5a 11 1 2024-04-13T10:59:02.798 INFO:tasks.workunit.client.0.smithi134.stdout:9/216: symlink d13/d2e/l41 0 2024-04-13T10:59:02.798 INFO:tasks.workunit.client.0.smithi134.stdout:3/186: creat dc/d27/d1f/d25/f3c x:0 0 0 2024-04-13T10:59:02.800 INFO:tasks.workunit.client.0.smithi134.stdout:5/266: mknod dc/d1d/d2b/d30/d3e/c5b 0 2024-04-13T10:59:02.903 INFO:tasks.workunit.client.0.smithi134.stdout:9/217: creat d13/d40/f42 x:0 0 0 2024-04-13T10:59:02.904 INFO:tasks.workunit.client.0.smithi134.stdout:5/267: dread - dc/d1d/d2f/d3b/f52 zero size 2024-04-13T10:59:02.908 INFO:tasks.workunit.client.0.smithi134.stdout:3/187: dwrite dc/f17 [0,4194304] 0 2024-04-13T10:59:02.909 INFO:tasks.workunit.client.0.smithi134.stdout:5/268: mkdir dc/d15/d5c 0 2024-04-13T10:59:02.911 INFO:tasks.workunit.client.0.smithi134.stdout:5/269: truncate dc/d1d/d2b/d30/d3e/f4d 558486 0 2024-04-13T10:59:02.911 INFO:tasks.workunit.client.0.smithi134.stdout:3/188: truncate dc/d27/d19/d23/f32 369145 0 2024-04-13T10:59:02.914 INFO:tasks.workunit.client.0.smithi134.stdout:9/218: getdents d13/d39 0 2024-04-13T10:59:02.916 INFO:tasks.workunit.client.0.smithi134.stdout:5/270: creat dc/d1d/d2f/d3b/d3c/f5d x:0 0 0 2024-04-13T10:59:02.919 INFO:tasks.workunit.client.0.smithi134.stdout:5/271: read dc/d1d/d2b/d30/d3e/f4d [28758,104090] 0 2024-04-13T10:59:02.920 INFO:tasks.workunit.client.0.smithi134.stdout:3/189: dwrite dc/d27/d19/f3b [0,4194304] 0 2024-04-13T10:59:02.927 INFO:tasks.workunit.client.0.smithi134.stdout:9/219: truncate d13/f2d 29031 0 2024-04-13T10:59:02.929 INFO:tasks.workunit.client.0.smithi134.stdout:3/190: fsync dc/d27/d1f/f20 0 2024-04-13T10:59:02.930 INFO:tasks.workunit.client.0.smithi134.stdout:9/220: chown d13/l33 425113093 1 2024-04-13T10:59:02.930 INFO:tasks.workunit.client.0.smithi134.stdout:5/272: dwrite dc/f1b [0,4194304] 0 2024-04-13T10:59:02.933 INFO:tasks.workunit.client.0.smithi134.stdout:5/273: chown fb 119594387 1 2024-04-13T10:59:02.935 INFO:tasks.workunit.client.0.smithi134.stdout:3/191: symlink dc/d27/l3d 0 2024-04-13T10:59:02.939 INFO:tasks.workunit.client.0.smithi134.stdout:9/221: dwrite d13/f24 [0,4194304] 0 2024-04-13T10:59:02.942 INFO:tasks.workunit.client.0.smithi134.stdout:3/192: dread dc/fe [0,4194304] 0 2024-04-13T10:59:02.947 INFO:tasks.workunit.client.0.smithi134.stdout:3/193: read dc/f17 [1325225,12074] 0 2024-04-13T10:59:02.951 INFO:tasks.workunit.client.0.smithi134.stdout:3/194: creat dc/d27/d1f/d25/f3e x:0 0 0 2024-04-13T10:59:02.952 INFO:tasks.workunit.client.0.smithi134.stdout:3/195: write dc/d27/d19/d23/f32 [1219235,41039] 0 2024-04-13T10:59:02.954 INFO:tasks.workunit.client.0.smithi134.stdout:5/274: truncate dc/f17 3835860 0 2024-04-13T10:59:02.957 INFO:tasks.workunit.client.0.smithi134.stdout:5/275: symlink dc/d1d/d2b/d30/d3e/l5e 0 2024-04-13T10:59:02.960 INFO:tasks.workunit.client.0.smithi134.stdout:3/196: dwrite dc/f17 [0,4194304] 0 2024-04-13T10:59:02.961 INFO:tasks.workunit.client.0.smithi134.stdout:5/276: rename dc/ld to dc/d1d/l5f 0 2024-04-13T10:59:02.966 INFO:tasks.workunit.client.0.smithi134.stdout:9/222: dread d13/f23 [0,4194304] 0 2024-04-13T10:59:02.966 INFO:tasks.workunit.client.0.smithi134.stdout:3/197: mknod dc/d27/d19/d23/c3f 0 2024-04-13T10:59:02.970 INFO:tasks.workunit.client.0.smithi134.stdout:3/198: truncate dc/f10 901201 0 2024-04-13T10:59:02.975 INFO:tasks.workunit.client.0.smithi134.stdout:5/277: dwrite fb [0,4194304] 0 2024-04-13T10:59:02.975 INFO:tasks.workunit.client.0.smithi134.stdout:9/223: dwrite fc [0,4194304] 0 2024-04-13T10:59:02.977 INFO:tasks.workunit.client.0.smithi134.stdout:5/278: chown dc/d1d/f1f 2069 1 2024-04-13T10:59:02.977 INFO:tasks.workunit.client.0.smithi134.stdout:3/199: dread dc/fe [0,4194304] 0 2024-04-13T10:59:02.980 INFO:tasks.workunit.client.0.smithi134.stdout:9/224: creat d13/d2e/d35/f43 x:0 0 0 2024-04-13T10:59:02.980 INFO:tasks.workunit.client.0.smithi134.stdout:9/225: stat d13/f17 0 2024-04-13T10:59:02.982 INFO:tasks.workunit.client.0.smithi134.stdout:9/226: dread - d13/d2e/f3e zero size 2024-04-13T10:59:02.988 INFO:tasks.workunit.client.0.smithi134.stdout:8/115: sync 2024-04-13T10:59:02.988 INFO:tasks.workunit.client.0.smithi134.stdout:2/211: sync 2024-04-13T10:59:02.988 INFO:tasks.workunit.client.0.smithi134.stdout:0/189: sync 2024-04-13T10:59:02.988 INFO:tasks.workunit.client.0.smithi134.stdout:7/152: sync 2024-04-13T10:59:02.988 INFO:tasks.workunit.client.0.smithi134.stdout:8/116: rmdir d8/dc/d16 39 2024-04-13T10:59:02.991 INFO:tasks.workunit.client.0.smithi134.stdout:5/279: dwrite dc/d1d/d2f/d3b/d3c/f5d [0,4194304] 0 2024-04-13T10:59:02.991 INFO:tasks.workunit.client.0.smithi134.stdout:8/117: chown d8/f10 2 1 2024-04-13T10:59:02.994 INFO:tasks.workunit.client.0.smithi134.stdout:7/153: creat da/d15/f3a x:0 0 0 2024-04-13T10:59:02.994 INFO:tasks.workunit.client.0.smithi134.stdout:2/212: dread d5/d6/f9 [0,4194304] 0 2024-04-13T10:59:02.999 INFO:tasks.workunit.client.0.smithi134.stdout:0/190: getdents d4/d17/d20 0 2024-04-13T10:59:03.003 INFO:tasks.workunit.client.0.smithi134.stdout:5/280: creat dc/d15/f60 x:0 0 0 2024-04-13T10:59:03.005 INFO:tasks.workunit.client.0.smithi134.stdout:0/191: fdatasync d4/d17/d23/f2f 0 2024-04-13T10:59:03.006 INFO:tasks.workunit.client.0.smithi134.stdout:5/281: dread - dc/d1d/d20/d23/f55 zero size 2024-04-13T10:59:03.006 INFO:tasks.workunit.client.0.smithi134.stdout:7/154: dwrite da/f1d [4194304,4194304] 0 2024-04-13T10:59:03.007 INFO:tasks.workunit.client.0.smithi134.stdout:0/192: read d4/d17/d23/f2f [1302213,14517] 0 2024-04-13T10:59:03.008 INFO:tasks.workunit.client.0.smithi134.stdout:5/282: mknod dc/d1d/d2f/c61 0 2024-04-13T10:59:03.011 INFO:tasks.workunit.client.0.smithi134.stdout:0/193: chown d4/d17/d23/c32 469 1 2024-04-13T10:59:03.013 INFO:tasks.workunit.client.0.smithi134.stdout:7/155: symlink da/d15/d26/l3b 0 2024-04-13T10:59:03.017 INFO:tasks.workunit.client.0.smithi134.stdout:8/118: dread d8/ff [0,4194304] 0 2024-04-13T10:59:03.018 INFO:tasks.workunit.client.0.smithi134.stdout:7/156: chown da/f13 137 1 2024-04-13T10:59:03.020 INFO:tasks.workunit.client.0.smithi134.stdout:0/194: rename d4/d17/c16 to d4/d17/da/d22/d37/c46 0 2024-04-13T10:59:03.022 INFO:tasks.workunit.client.0.smithi134.stdout:0/195: stat d4/d17/d23/c32 0 2024-04-13T10:59:03.024 INFO:tasks.workunit.client.0.smithi134.stdout:5/283: rmdir dc/d1d/d20/d23/d38/d3a/d4b 0 2024-04-13T10:59:03.026 INFO:tasks.workunit.client.0.smithi134.stdout:7/157: dwrite da/d15/f24 [0,4194304] 0 2024-04-13T10:59:03.027 INFO:tasks.workunit.client.0.smithi134.stdout:8/119: symlink d8/dc/d16/l24 0 2024-04-13T10:59:03.029 INFO:tasks.workunit.client.0.smithi134.stdout:5/284: creat dc/d1d/d20/f62 x:0 0 0 2024-04-13T10:59:03.031 INFO:tasks.workunit.client.0.smithi134.stdout:8/120: mknod d8/dc/d13/c25 0 2024-04-13T10:59:03.033 INFO:tasks.workunit.client.0.smithi134.stdout:5/285: dread dc/f28 [0,4194304] 0 2024-04-13T10:59:03.034 INFO:tasks.workunit.client.0.smithi134.stdout:0/196: dwrite d4/d17/d20/f3f [0,4194304] 0 2024-04-13T10:59:03.034 INFO:tasks.workunit.client.0.smithi134.stdout:8/121: write d8/dc/d16/f1d [400375,15161] 0 2024-04-13T10:59:03.036 INFO:tasks.workunit.client.0.smithi134.stdout:8/122: dread - d8/dc/d13/f1e zero size 2024-04-13T10:59:03.043 INFO:tasks.workunit.client.0.smithi134.stdout:5/286: dwrite dc/d1d/d20/d23/f55 [0,4194304] 0 2024-04-13T10:59:03.050 INFO:tasks.workunit.client.0.smithi134.stdout:9/227: fsync d13/f17 0 2024-04-13T10:59:03.051 INFO:tasks.workunit.client.0.smithi134.stdout:9/228: read f4 [3688192,61778] 0 2024-04-13T10:59:03.128 INFO:tasks.workunit.client.0.smithi134.stdout:8/123: symlink d8/dc/d16/l26 0 2024-04-13T10:59:03.128 INFO:tasks.workunit.client.0.smithi134.stdout:8/124: chown d8/dc/d13/c21 6 1 2024-04-13T10:59:03.129 INFO:tasks.workunit.client.0.smithi134.stdout:8/125: fdatasync d8/dc/d16/f1c 0 2024-04-13T10:59:03.138 INFO:tasks.workunit.client.0.smithi134.stdout:0/197: getdents d4/d17/d23 0 2024-04-13T10:59:03.139 INFO:tasks.workunit.client.0.smithi134.stdout:5/287: dwrite dc/f28 [0,4194304] 0 2024-04-13T10:59:03.139 INFO:tasks.workunit.client.0.smithi134.stdout:8/126: symlink d8/dc/d13/l27 0 2024-04-13T10:59:03.149 INFO:tasks.workunit.client.0.smithi134.stdout:9/229: mknod d13/c44 0 2024-04-13T10:59:03.150 INFO:tasks.workunit.client.0.smithi134.stdout:9/230: dread - d13/d39/f3b zero size 2024-04-13T10:59:03.155 INFO:tasks.workunit.client.0.smithi134.stdout:0/198: mkdir d4/d17/da/d22/d37/d47 0 2024-04-13T10:59:03.163 INFO:tasks.workunit.client.0.smithi134.stdout:0/199: mkdir d4/d17/da/d48 0 2024-04-13T10:59:03.164 INFO:tasks.workunit.client.0.smithi134.stdout:8/127: symlink d8/dc/l28 0 2024-04-13T10:59:03.166 INFO:tasks.workunit.client.0.smithi134.stdout:9/231: rename d13/f16 to d13/d39/f45 0 2024-04-13T10:59:03.167 INFO:tasks.workunit.client.0.smithi134.stdout:9/232: stat lf 0 2024-04-13T10:59:03.167 INFO:tasks.workunit.client.0.smithi134.stdout:2/213: write d5/de/f22 [4308746,99227] 0 2024-04-13T10:59:03.171 INFO:tasks.workunit.client.0.smithi134.stdout:8/128: dread d8/dc/d16/f1b [0,4194304] 0 2024-04-13T10:59:03.171 INFO:tasks.workunit.client.0.smithi134.stdout:2/214: chown d5/d6/d21/d29/c3e 1652 1 2024-04-13T10:59:03.171 INFO:tasks.workunit.client.0.smithi134.stdout:9/233: dread fc [4194304,4194304] 0 2024-04-13T10:59:03.172 INFO:tasks.workunit.client.0.smithi134.stdout:0/200: dwrite d4/d17/d23/f3b [0,4194304] 0 2024-04-13T10:59:03.173 INFO:tasks.workunit.client.0.smithi134.stdout:0/201: chown d4/d17/da/d22/d38 1932537375 1 2024-04-13T10:59:03.174 INFO:tasks.workunit.client.0.smithi134.stdout:4/159: sync 2024-04-13T10:59:03.174 INFO:tasks.workunit.client.0.smithi134.stdout:6/263: sync 2024-04-13T10:59:03.176 INFO:tasks.workunit.client.0.smithi134.stdout:4/160: dread - d4/d1b/f1c zero size 2024-04-13T10:59:03.177 INFO:tasks.workunit.client.0.smithi134.stdout:2/215: creat d5/d6/d21/d29/f46 x:0 0 0 2024-04-13T10:59:03.179 INFO:tasks.workunit.client.0.smithi134.stdout:9/234: dread fc [0,4194304] 0 2024-04-13T10:59:03.180 INFO:tasks.workunit.client.0.smithi134.stdout:0/202: mkdir d4/d17/d1a/d49 0 2024-04-13T10:59:03.180 INFO:tasks.workunit.client.0.smithi134.stdout:0/203: stat d4/d17/d1a 0 2024-04-13T10:59:03.182 INFO:tasks.workunit.client.0.smithi134.stdout:6/264: mknod d4/da/d15/d1f/d24/c52 0 2024-04-13T10:59:03.183 INFO:tasks.workunit.client.0.smithi134.stdout:6/265: chown d4/da/d15/d1f/d3c 5 1 2024-04-13T10:59:03.184 INFO:tasks.workunit.client.0.smithi134.stdout:8/129: creat d8/dc/f29 x:0 0 0 2024-04-13T10:59:03.185 INFO:tasks.workunit.client.0.smithi134.stdout:8/130: write f3 [5057460,31820] 0 2024-04-13T10:59:03.185 INFO:tasks.workunit.client.0.smithi134.stdout:2/216: symlink d5/de/d12/d2f/d31/l47 0 2024-04-13T10:59:03.187 INFO:tasks.workunit.client.0.smithi134.stdout:9/235: stat d13/l3d 0 2024-04-13T10:59:03.187 INFO:tasks.workunit.client.0.smithi134.stdout:9/236: read - d13/f3f zero size 2024-04-13T10:59:03.189 INFO:tasks.workunit.client.0.smithi134.stdout:4/161: mknod d4/dd/c33 0 2024-04-13T10:59:03.189 INFO:tasks.workunit.client.0.smithi134.stdout:9/237: read f9 [3751,55007] 0 2024-04-13T10:59:03.193 INFO:tasks.workunit.client.0.smithi134.stdout:8/131: creat d8/dc/d16/f2a x:0 0 0 2024-04-13T10:59:03.198 INFO:tasks.workunit.client.0.smithi134.stdout:4/162: truncate d4/d1b/f1d 691618 0 2024-04-13T10:59:03.198 INFO:tasks.workunit.client.0.smithi134.stdout:8/132: creat d8/f2b x:0 0 0 2024-04-13T10:59:03.200 INFO:tasks.workunit.client.0.smithi134.stdout:8/133: write d8/dc/f12 [683167,22807] 0 2024-04-13T10:59:03.200 INFO:tasks.workunit.client.0.smithi134.stdout:2/217: link d5/d6/f1e d5/de/f48 0 2024-04-13T10:59:03.201 INFO:tasks.workunit.client.0.smithi134.stdout:0/204: creat d4/d17/f4a x:0 0 0 2024-04-13T10:59:03.204 INFO:tasks.workunit.client.0.smithi134.stdout:0/205: fsync d4/d17/da/fe 0 2024-04-13T10:59:03.209 INFO:tasks.workunit.client.0.smithi134.stdout:2/218: write f1 [8785872,85398] 0 2024-04-13T10:59:03.213 INFO:tasks.workunit.client.0.smithi134.stdout:8/134: mkdir d8/dc/d2c 0 2024-04-13T10:59:03.213 INFO:tasks.workunit.client.0.smithi134.stdout:3/200: dwrite dc/f10 [0,4194304] 0 2024-04-13T10:59:03.215 INFO:tasks.workunit.client.0.smithi134.stdout:4/163: link d4/da/c13 d4/c34 0 2024-04-13T10:59:03.219 INFO:tasks.workunit.client.0.smithi134.stdout:6/266: dread d4/f18 [0,4194304] 0 2024-04-13T10:59:03.222 INFO:tasks.workunit.client.0.smithi134.stdout:0/206: link d4/d17/d23/f2f d4/d17/da/d22/d41/f4b 0 2024-04-13T10:59:03.222 INFO:tasks.workunit.client.0.smithi134.stdout:6/267: dread - d4/da/d15/d1f/f4b zero size 2024-04-13T10:59:03.223 INFO:tasks.workunit.client.0.smithi134.stdout:4/164: creat d4/d1b/f35 x:0 0 0 2024-04-13T10:59:03.223 INFO:tasks.workunit.client.0.smithi134.stdout:2/219: dread d5/de/d12/d2f/d30/f42 [0,4194304] 0 2024-04-13T10:59:03.227 INFO:tasks.workunit.client.0.smithi134.stdout:4/165: creat d4/da/f36 x:0 0 0 2024-04-13T10:59:03.227 INFO:tasks.workunit.client.0.smithi134.stdout:8/135: dwrite d8/dc/d13/f1e [0,4194304] 0 2024-04-13T10:59:03.228 INFO:tasks.workunit.client.0.smithi134.stdout:4/166: fdatasync d4/f2a 0 2024-04-13T10:59:03.231 INFO:tasks.workunit.client.0.smithi134.stdout:2/220: creat d5/d6/d21/f49 x:0 0 0 2024-04-13T10:59:03.232 INFO:tasks.workunit.client.0.smithi134.stdout:0/207: mknod d4/d17/d20/d29/d30/d3e/c4c 0 2024-04-13T10:59:03.238 INFO:tasks.workunit.client.0.smithi134.stdout:5/288: dwrite f1 [8388608,4194304] 0 2024-04-13T10:59:03.244 INFO:tasks.workunit.client.0.smithi134.stdout:5/289: dread dc/d1d/d20/d23/f55 [0,4194304] 0 2024-04-13T10:59:03.244 INFO:tasks.workunit.client.0.smithi134.stdout:5/290: fdatasync fb 0 2024-04-13T10:59:03.246 INFO:tasks.workunit.client.0.smithi134.stdout:4/167: unlink d4/dd/l12 0 2024-04-13T10:59:03.247 INFO:tasks.workunit.client.0.smithi134.stdout:0/208: creat d4/d17/da/d22/d37/f4d x:0 0 0 2024-04-13T10:59:03.251 INFO:tasks.workunit.client.0.smithi134.stdout:5/291: truncate dc/f14 282062 0 2024-04-13T10:59:03.257 INFO:tasks.workunit.client.0.smithi134.stdout:8/136: getdents d8/dc/d13 0 2024-04-13T10:59:03.258 INFO:tasks.workunit.client.0.smithi134.stdout:5/292: mkdir dc/d39/d63 0 2024-04-13T10:59:03.260 INFO:tasks.workunit.client.0.smithi134.stdout:4/168: dwrite d4/d1f/d27/d2f/f31 [0,4194304] 0 2024-04-13T10:59:03.263 INFO:tasks.workunit.client.0.smithi134.stdout:4/169: chown d4 297679880 1 2024-04-13T10:59:03.264 INFO:tasks.workunit.client.0.smithi134.stdout:4/170: truncate d4/da/f19 2519445 0 2024-04-13T10:59:03.264 INFO:tasks.workunit.client.0.smithi134.stdout:5/293: mkdir dc/d1d/d20/d23/d64 0 2024-04-13T10:59:03.264 INFO:tasks.workunit.client.0.smithi134.stdout:0/209: link d4/d17/d20/d29/d30/d3e/c4c d4/d17/d20/d29/d30/d3e/c4e 0 2024-04-13T10:59:03.268 INFO:tasks.workunit.client.0.smithi134.stdout:8/137: dwrite d8/dc/f29 [0,4194304] 0 2024-04-13T10:59:03.274 INFO:tasks.workunit.client.0.smithi134.stdout:8/138: read d8/dc/d16/f1d [178168,101679] 0 2024-04-13T10:59:03.283 INFO:tasks.workunit.client.0.smithi134.stdout:3/201: dwrite dc/d27/d1f/f20 [0,4194304] 0 2024-04-13T10:59:03.285 INFO:tasks.workunit.client.0.smithi134.stdout:8/139: creat d8/dc/d16/f2d x:0 0 0 2024-04-13T10:59:03.285 INFO:tasks.workunit.client.0.smithi134.stdout:8/140: chown d8/dc/f1a 989 1 2024-04-13T10:59:03.286 INFO:tasks.workunit.client.0.smithi134.stdout:5/294: rmdir dc/d1d/d20/d23/d64 0 2024-04-13T10:59:03.286 INFO:tasks.workunit.client.0.smithi134.stdout:8/141: write d8/f2b [674784,105254] 0 2024-04-13T10:59:03.293 INFO:tasks.workunit.client.0.smithi134.stdout:3/202: link dc/d1d/c22 dc/d27/d19/d23/c40 0 2024-04-13T10:59:03.296 INFO:tasks.workunit.client.0.smithi134.stdout:5/295: dwrite dc/d1d/d2f/d3b/f51 [0,4194304] 0 2024-04-13T10:59:03.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/142: dread d8/dc/d13/f14 [0,4194304] 0 2024-04-13T10:59:03.297 INFO:tasks.workunit.client.0.smithi134.stdout:3/203: mknod dc/d1d/c41 0 2024-04-13T10:59:03.298 INFO:tasks.workunit.client.0.smithi134.stdout:8/143: readlink d8/l9 0 2024-04-13T10:59:03.299 INFO:tasks.workunit.client.0.smithi134.stdout:8/144: chown d8/l18 1822461727 1 2024-04-13T10:59:03.304 INFO:tasks.workunit.client.0.smithi134.stdout:9/238: dwrite d13/d39/f45 [0,4194304] 0 2024-04-13T10:59:03.307 INFO:tasks.workunit.client.0.smithi134.stdout:0/210: write d4/f11 [594183,90894] 0 2024-04-13T10:59:03.307 INFO:tasks.workunit.client.0.smithi134.stdout:9/239: chown d13/f2d 405170 1 2024-04-13T10:59:03.311 INFO:tasks.workunit.client.0.smithi134.stdout:4/171: truncate d4/da/f19 2111172 0 2024-04-13T10:59:03.313 INFO:tasks.workunit.client.0.smithi134.stdout:8/145: rename d8/dc/d16/l26 to d8/dc/l2e 0 2024-04-13T10:59:03.313 INFO:tasks.workunit.client.0.smithi134.stdout:0/211: rename d4/d17 to d4/d17/da/d22/d4f 22 2024-04-13T10:59:03.314 INFO:tasks.workunit.client.0.smithi134.stdout:8/146: read - d8/dc/f22 zero size 2024-04-13T10:59:03.314 INFO:tasks.workunit.client.0.smithi134.stdout:0/212: fsync d4/d17/f4a 0 2024-04-13T10:59:03.314 INFO:tasks.workunit.client.0.smithi134.stdout:9/240: creat d13/d2e/d35/f46 x:0 0 0 2024-04-13T10:59:03.317 INFO:tasks.workunit.client.0.smithi134.stdout:4/172: creat d4/d1f/d27/f37 x:0 0 0 2024-04-13T10:59:03.319 INFO:tasks.workunit.client.0.smithi134.stdout:4/173: write d4/d1b/f1c [1047491,9033] 0 2024-04-13T10:59:03.322 INFO:tasks.workunit.client.0.smithi134.stdout:4/174: chown d4/d1b/f35 128 1 2024-04-13T10:59:03.322 INFO:tasks.workunit.client.0.smithi134.stdout:9/241: dwrite fc [0,4194304] 0 2024-04-13T10:59:03.323 INFO:tasks.workunit.client.0.smithi134.stdout:4/175: dread - d4/d1b/f35 zero size 2024-04-13T10:59:03.326 INFO:tasks.workunit.client.0.smithi134.stdout:3/204: truncate dc/d27/d1f/f20 4024248 0 2024-04-13T10:59:03.330 INFO:tasks.workunit.client.0.smithi134.stdout:5/296: dread dc/d1d/d20/d23/f2a [0,4194304] 0 2024-04-13T10:59:03.331 INFO:tasks.workunit.client.0.smithi134.stdout:4/176: mkdir d4/d1f/d27/d2f/d38 0 2024-04-13T10:59:03.333 INFO:tasks.workunit.client.0.smithi134.stdout:8/147: link c6 d8/dc/d16/c2f 0 2024-04-13T10:59:03.337 INFO:tasks.workunit.client.0.smithi134.stdout:5/297: unlink dc/d15/f60 0 2024-04-13T10:59:03.340 INFO:tasks.workunit.client.0.smithi134.stdout:0/213: dwrite d4/d17/d23/f2f [0,4194304] 0 2024-04-13T10:59:03.342 INFO:tasks.workunit.client.0.smithi134.stdout:8/148: dwrite d8/dc/f12 [0,4194304] 0 2024-04-13T10:59:03.344 INFO:tasks.workunit.client.0.smithi134.stdout:0/214: truncate d4/d17/f4a 525945 0 2024-04-13T10:59:03.432 INFO:tasks.workunit.client.0.smithi134.stdout:1/263: sync 2024-04-13T10:59:03.432 INFO:tasks.workunit.client.0.smithi134.stdout:1/264: fsync d3/d6/d20/f42 0 2024-04-13T10:59:03.434 INFO:tasks.workunit.client.0.smithi134.stdout:5/298: mkdir dc/d15/d65 0 2024-04-13T10:59:03.436 INFO:tasks.workunit.client.0.smithi134.stdout:8/149: chown c6 21 1 2024-04-13T10:59:03.439 INFO:tasks.workunit.client.0.smithi134.stdout:3/205: link dc/d1d/f33 dc/f42 0 2024-04-13T10:59:03.440 INFO:tasks.workunit.client.0.smithi134.stdout:1/265: symlink d3/d6/d16/d1d/l5b 0 2024-04-13T10:59:03.442 INFO:tasks.workunit.client.0.smithi134.stdout:9/242: dwrite fd [0,4194304] 0 2024-04-13T10:59:03.443 INFO:tasks.workunit.client.0.smithi134.stdout:0/215: link d4/d17/d23/f3b d4/d17/d20/d29/d30/d3e/f50 0 2024-04-13T10:59:03.447 INFO:tasks.workunit.client.0.smithi134.stdout:3/206: dwrite dc/d27/d19/d23/f32 [0,4194304] 0 2024-04-13T10:59:03.456 INFO:tasks.workunit.client.0.smithi134.stdout:9/243: write d13/f23 [1604807,62955] 0 2024-04-13T10:59:03.458 INFO:tasks.workunit.client.0.smithi134.stdout:8/150: creat d8/dc/f30 x:0 0 0 2024-04-13T10:59:03.462 INFO:tasks.workunit.client.0.smithi134.stdout:9/244: mkdir d13/d2e/d47 0 2024-04-13T10:59:03.463 INFO:tasks.workunit.client.0.smithi134.stdout:3/207: dwrite dc/d27/d19/f36 [0,4194304] 0 2024-04-13T10:59:03.464 INFO:tasks.workunit.client.0.smithi134.stdout:1/266: dwrite d3/d6/f15 [0,4194304] 0 2024-04-13T10:59:03.465 INFO:tasks.workunit.client.0.smithi134.stdout:9/245: write f9 [1004218,82870] 0 2024-04-13T10:59:03.466 INFO:tasks.workunit.client.0.smithi134.stdout:1/267: fdatasync d3/d6/f7 0 2024-04-13T10:59:03.471 INFO:tasks.workunit.client.0.smithi134.stdout:8/151: dread d8/dc/f29 [0,4194304] 0 2024-04-13T10:59:03.472 INFO:tasks.workunit.client.0.smithi134.stdout:9/246: creat d13/d40/f48 x:0 0 0 2024-04-13T10:59:03.473 INFO:tasks.workunit.client.0.smithi134.stdout:1/268: mkdir d3/d6/d16/d1d/d5c 0 2024-04-13T10:59:03.480 INFO:tasks.workunit.client.0.smithi134.stdout:9/247: rename d13/f24 to d13/d2e/d35/f49 0 2024-04-13T10:59:03.481 INFO:tasks.workunit.client.0.smithi134.stdout:9/248: readlink d13/l29 0 2024-04-13T10:59:03.482 INFO:tasks.workunit.client.0.smithi134.stdout:1/269: creat d3/d6/d16/d1d/d5c/f5d x:0 0 0 2024-04-13T10:59:03.482 INFO:tasks.workunit.client.0.smithi134.stdout:8/152: dwrite d8/dc/d16/f2d [0,4194304] 0 2024-04-13T10:59:03.484 INFO:tasks.workunit.client.0.smithi134.stdout:5/299: truncate dc/d1d/d2f/d3b/f51 3019819 0 2024-04-13T10:59:03.490 INFO:tasks.workunit.client.0.smithi134.stdout:1/270: dread d3/d6/dd/f56 [0,4194304] 0 2024-04-13T10:59:03.491 INFO:tasks.workunit.client.0.smithi134.stdout:8/153: rename d8/dc/d13/l20 to d8/dc/d2c/l31 0 2024-04-13T10:59:03.493 INFO:tasks.workunit.client.0.smithi134.stdout:5/300: unlink dc/f1a 0 2024-04-13T10:59:03.499 INFO:tasks.workunit.client.0.smithi134.stdout:0/216: dwrite d4/d17/da/f10 [0,4194304] 0 2024-04-13T10:59:03.499 INFO:tasks.workunit.client.0.smithi134.stdout:1/271: mkdir d3/d30/d5e 0 2024-04-13T10:59:03.502 INFO:tasks.workunit.client.0.smithi134.stdout:1/272: write d3/d1e/f25 [4267885,119823] 0 2024-04-13T10:59:03.504 INFO:tasks.workunit.client.0.smithi134.stdout:1/273: write d3/d6/d16/f35 [3715989,125962] 0 2024-04-13T10:59:03.506 INFO:tasks.workunit.client.0.smithi134.stdout:3/208: dwrite dc/d27/f18 [0,4194304] 0 2024-04-13T10:59:03.516 INFO:tasks.workunit.client.0.smithi134.stdout:8/154: dread d8/dc/f1a [0,4194304] 0 2024-04-13T10:59:03.522 INFO:tasks.workunit.client.0.smithi134.stdout:0/217: mkdir d4/d17/d23/d51 0 2024-04-13T10:59:03.528 INFO:tasks.workunit.client.0.smithi134.stdout:9/249: getdents d13/d2e/d35 0 2024-04-13T10:59:03.528 INFO:tasks.workunit.client.0.smithi134.stdout:9/250: chown d13/d2e/d35/f49 404135487 1 2024-04-13T10:59:03.529 INFO:tasks.workunit.client.0.smithi134.stdout:9/251: read - d13/d40/f48 zero size 2024-04-13T10:59:03.531 INFO:tasks.workunit.client.0.smithi134.stdout:8/155: creat d8/dc/d13/f32 x:0 0 0 2024-04-13T10:59:03.532 INFO:tasks.workunit.client.0.smithi134.stdout:8/156: chown d8/l9 240146 1 2024-04-13T10:59:03.533 INFO:tasks.workunit.client.0.smithi134.stdout:8/157: fsync d8/dc/f22 0 2024-04-13T10:59:03.534 INFO:tasks.workunit.client.0.smithi134.stdout:0/218: rmdir d4/d17/d20/d29 39 2024-04-13T10:59:03.535 INFO:tasks.workunit.client.0.smithi134.stdout:3/209: write dc/f42 [307033,43889] 0 2024-04-13T10:59:03.540 INFO:tasks.workunit.client.0.smithi134.stdout:8/158: mknod d8/c33 0 2024-04-13T10:59:03.542 INFO:tasks.workunit.client.0.smithi134.stdout:8/159: read d8/dc/d16/f1b [49485,96648] 0 2024-04-13T10:59:03.545 INFO:tasks.workunit.client.0.smithi134.stdout:9/252: write d13/f1e [2239348,78613] 0 2024-04-13T10:59:03.546 INFO:tasks.workunit.client.0.smithi134.stdout:3/210: creat dc/d27/d19/d23/f43 x:0 0 0 2024-04-13T10:59:03.547 INFO:tasks.workunit.client.0.smithi134.stdout:3/211: fdatasync dc/d27/d1f/f2b 0 2024-04-13T10:59:03.548 INFO:tasks.workunit.client.0.smithi134.stdout:5/301: getdents dc/d1d/d2f/d3b 0 2024-04-13T10:59:03.549 INFO:tasks.workunit.client.0.smithi134.stdout:5/302: truncate dc/f1b 4684497 0 2024-04-13T10:59:03.550 INFO:tasks.workunit.client.0.smithi134.stdout:1/274: getdents d3/d6/d16/d1d 0 2024-04-13T10:59:03.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/160: rename d8/dc/d13/c25 to d8/dc/d13/c34 0 2024-04-13T10:59:03.554 INFO:tasks.workunit.client.0.smithi134.stdout:0/219: mknod d4/d17/d20/c52 0 2024-04-13T10:59:03.554 INFO:tasks.workunit.client.0.smithi134.stdout:9/253: symlink d13/d39/l4a 0 2024-04-13T10:59:03.556 INFO:tasks.workunit.client.0.smithi134.stdout:3/212: write dc/fe [3873260,45711] 0 2024-04-13T10:59:03.560 INFO:tasks.workunit.client.0.smithi134.stdout:8/161: rmdir d8/dc/d13 39 2024-04-13T10:59:03.561 INFO:tasks.workunit.client.0.smithi134.stdout:3/213: dread dc/d27/d19/f36 [0,4194304] 0 2024-04-13T10:59:03.564 INFO:tasks.workunit.client.0.smithi134.stdout:9/254: creat d13/d2e/d35/f4b x:0 0 0 2024-04-13T10:59:03.567 INFO:tasks.workunit.client.0.smithi134.stdout:1/275: creat d3/d6/d16/d4d/f5f x:0 0 0 2024-04-13T10:59:03.571 INFO:tasks.workunit.client.0.smithi134.stdout:1/276: rename d3/d6/d16 to d3/d6/d16/d1d/d60 22 2024-04-13T10:59:03.571 INFO:tasks.workunit.client.0.smithi134.stdout:3/214: dwrite dc/d27/d1f/d25/f3c [0,4194304] 0 2024-04-13T10:59:03.573 INFO:tasks.workunit.client.0.smithi134.stdout:5/303: link dc/d15/l18 dc/d1d/d20/l66 0 2024-04-13T10:59:03.575 INFO:tasks.workunit.client.0.smithi134.stdout:9/255: dwrite d13/d40/f48 [0,4194304] 0 2024-04-13T10:59:03.576 INFO:tasks.workunit.client.0.smithi134.stdout:1/277: rename d3/d6/d16/d1d/d57 to d3/d6/d16/d1d/d57/d61 22 2024-04-13T10:59:03.577 INFO:tasks.workunit.client.0.smithi134.stdout:9/256: dread - d13/d40/f42 zero size 2024-04-13T10:59:03.579 INFO:tasks.workunit.client.0.smithi134.stdout:1/278: write d3/d6/fc [2281287,129616] 0 2024-04-13T10:59:03.581 INFO:tasks.workunit.client.0.smithi134.stdout:9/257: read d13/f28 [87235,44981] 0 2024-04-13T10:59:03.581 INFO:tasks.workunit.client.0.smithi134.stdout:3/215: dread dc/fe [0,4194304] 0 2024-04-13T10:59:03.582 INFO:tasks.workunit.client.0.smithi134.stdout:9/258: chown d13/d39/c36 6047282 1 2024-04-13T10:59:03.582 INFO:tasks.workunit.client.0.smithi134.stdout:1/279: write d3/d6/d16/d1d/f26 [697067,116580] 0 2024-04-13T10:59:03.587 INFO:tasks.workunit.client.0.smithi134.stdout:8/162: link d8/f10 d8/dc/f35 0 2024-04-13T10:59:03.590 INFO:tasks.workunit.client.0.smithi134.stdout:6/268: sync 2024-04-13T10:59:03.590 INFO:tasks.workunit.client.0.smithi134.stdout:2/221: sync 2024-04-13T10:59:03.590 INFO:tasks.workunit.client.0.smithi134.stdout:7/158: sync 2024-04-13T10:59:03.591 INFO:tasks.workunit.client.0.smithi134.stdout:3/216: mknod dc/d2a/c44 0 2024-04-13T10:59:03.591 INFO:tasks.workunit.client.0.smithi134.stdout:9/259: dwrite d13/f17 [0,4194304] 0 2024-04-13T10:59:03.592 INFO:tasks.workunit.client.0.smithi134.stdout:6/269: write d4/da/d1a/f44 [363369,18513] 0 2024-04-13T10:59:03.593 INFO:tasks.workunit.client.0.smithi134.stdout:1/280: mknod d3/c62 0 2024-04-13T10:59:03.594 INFO:tasks.workunit.client.0.smithi134.stdout:7/159: write da/d15/d26/f28 [921150,109538] 0 2024-04-13T10:59:03.594 INFO:tasks.workunit.client.0.smithi134.stdout:5/304: write dc/d1d/d2f/d3b/f51 [1158963,104325] 0 2024-04-13T10:59:03.598 INFO:tasks.workunit.client.0.smithi134.stdout:0/220: link d4/d17/da/d22/d37/c46 d4/d17/d20/d29/c53 0 2024-04-13T10:59:03.604 INFO:tasks.workunit.client.0.smithi134.stdout:5/305: dwrite dc/d1d/d46/f47 [0,4194304] 0 2024-04-13T10:59:03.604 INFO:tasks.workunit.client.0.smithi134.stdout:3/217: write dc/fe [3840592,3209] 0 2024-04-13T10:59:03.607 INFO:tasks.workunit.client.0.smithi134.stdout:1/281: mknod d3/d30/c63 0 2024-04-13T10:59:03.607 INFO:tasks.workunit.client.0.smithi134.stdout:7/160: mknod da/d15/c3c 0 2024-04-13T10:59:03.608 INFO:tasks.workunit.client.0.smithi134.stdout:6/270: symlink d4/da/d15/d1f/d24/d49/l53 0 2024-04-13T10:59:03.609 INFO:tasks.workunit.client.0.smithi134.stdout:7/161: write da/f11 [438003,105379] 0 2024-04-13T10:59:03.611 INFO:tasks.workunit.client.0.smithi134.stdout:8/163: creat d8/dc/d13/f36 x:0 0 0 2024-04-13T10:59:03.617 INFO:tasks.workunit.client.0.smithi134.stdout:3/218: chown dc/l11 1288 1 2024-04-13T10:59:03.618 INFO:tasks.workunit.client.0.smithi134.stdout:5/306: mkdir dc/d1d/d67 0 2024-04-13T10:59:03.619 INFO:tasks.workunit.client.0.smithi134.stdout:5/307: chown f1 0 1 2024-04-13T10:59:03.619 INFO:tasks.workunit.client.0.smithi134.stdout:1/282: symlink d3/d30/l64 0 2024-04-13T10:59:03.620 INFO:tasks.workunit.client.0.smithi134.stdout:1/283: dread - d3/d6/f31 zero size 2024-04-13T10:59:03.623 INFO:tasks.workunit.client.0.smithi134.stdout:2/222: creat d5/de/d12/d2f/f4a x:0 0 0 2024-04-13T10:59:03.624 INFO:tasks.workunit.client.0.smithi134.stdout:4/177: sync 2024-04-13T10:59:03.625 INFO:tasks.workunit.client.0.smithi134.stdout:7/162: rmdir da 39 2024-04-13T10:59:03.628 INFO:tasks.workunit.client.0.smithi134.stdout:9/260: rename f8 to d13/f4c 0 2024-04-13T10:59:03.631 INFO:tasks.workunit.client.0.smithi134.stdout:6/271: mkdir d4/da/d54 0 2024-04-13T10:59:03.632 INFO:tasks.workunit.client.0.smithi134.stdout:1/284: stat d3/d6/dd/l4a 0 2024-04-13T10:59:03.634 INFO:tasks.workunit.client.0.smithi134.stdout:8/164: mkdir d8/dc/d37 0 2024-04-13T10:59:03.636 INFO:tasks.workunit.client.0.smithi134.stdout:7/163: fsync da/d15/f3a 0 2024-04-13T10:59:03.638 INFO:tasks.workunit.client.0.smithi134.stdout:7/164: read f8 [219396,127494] 0 2024-04-13T10:59:03.638 INFO:tasks.workunit.client.0.smithi134.stdout:7/165: chown da/c14 3021903 1 2024-04-13T10:59:03.639 INFO:tasks.workunit.client.0.smithi134.stdout:0/221: truncate d4/f11 657082 0 2024-04-13T10:59:03.640 INFO:tasks.workunit.client.0.smithi134.stdout:9/261: rename f9 to d13/d39/f4d 0 2024-04-13T10:59:03.643 INFO:tasks.workunit.client.0.smithi134.stdout:3/219: mknod dc/d27/c45 0 2024-04-13T10:59:03.643 INFO:tasks.workunit.client.0.smithi134.stdout:5/308: write dc/d1d/d2b/d30/d3e/f4d [1059114,77299] 0 2024-04-13T10:59:03.644 INFO:tasks.workunit.client.0.smithi134.stdout:5/309: dread - dc/d1d/d20/d23/f32 zero size 2024-04-13T10:59:03.645 INFO:tasks.workunit.client.0.smithi134.stdout:5/310: write dc/f28 [236848,84377] 0 2024-04-13T10:59:03.646 INFO:tasks.workunit.client.0.smithi134.stdout:5/311: readlink l7 0 2024-04-13T10:59:03.649 INFO:tasks.workunit.client.0.smithi134.stdout:6/272: fsync d4/da/d15/f1e 0 2024-04-13T10:59:03.650 INFO:tasks.workunit.client.0.smithi134.stdout:1/285: mkdir d3/d6/d16/d4d/d65 0 2024-04-13T10:59:03.652 INFO:tasks.workunit.client.0.smithi134.stdout:8/165: creat d8/dc/d16/f38 x:0 0 0 2024-04-13T10:59:03.652 INFO:tasks.workunit.client.0.smithi134.stdout:3/220: dwrite dc/f24 [0,4194304] 0 2024-04-13T10:59:03.655 INFO:tasks.workunit.client.0.smithi134.stdout:6/273: dread d4/da/d15/d1f/d24/f42 [0,4194304] 0 2024-04-13T10:59:03.659 INFO:tasks.workunit.client.0.smithi134.stdout:3/221: stat dc/d27/d19/f36 0 2024-04-13T10:59:03.660 INFO:tasks.workunit.client.0.smithi134.stdout:2/223: dwrite d5/de/f16 [0,4194304] 0 2024-04-13T10:59:03.663 INFO:tasks.workunit.client.0.smithi134.stdout:0/222: creat d4/d17/da/f54 x:0 0 0 2024-04-13T10:59:03.666 INFO:tasks.workunit.client.0.smithi134.stdout:7/166: mkdir da/d15/d26/d27/d3d 0 2024-04-13T10:59:03.668 INFO:tasks.workunit.client.0.smithi134.stdout:1/286: dwrite d3/f13 [0,4194304] 0 2024-04-13T10:59:03.669 INFO:tasks.workunit.client.0.smithi134.stdout:9/262: creat d13/d39/f4e x:0 0 0 2024-04-13T10:59:03.669 INFO:tasks.workunit.client.0.smithi134.stdout:3/222: dread dc/fe [0,4194304] 0 2024-04-13T10:59:03.670 INFO:tasks.workunit.client.0.smithi134.stdout:3/223: fdatasync dc/f42 0 2024-04-13T10:59:03.790 INFO:tasks.workunit.client.0.smithi134.stdout:5/312: rename dc/d1d/d20/d23/f25 to dc/d1d/d20/d23/f68 0 2024-04-13T10:59:03.795 INFO:tasks.workunit.client.0.smithi134.stdout:8/166: creat d8/dc/d2c/f39 x:0 0 0 2024-04-13T10:59:03.796 INFO:tasks.workunit.client.0.smithi134.stdout:8/167: truncate d8/dc/d2c/f39 560966 0 2024-04-13T10:59:03.797 INFO:tasks.workunit.client.0.smithi134.stdout:6/274: write d4/f5 [4453611,123125] 0 2024-04-13T10:59:03.800 INFO:tasks.workunit.client.0.smithi134.stdout:2/224: mknod d5/d6/c4b 0 2024-04-13T10:59:03.802 INFO:tasks.workunit.client.0.smithi134.stdout:7/167: mknod da/d15/c3e 0 2024-04-13T10:59:03.804 INFO:tasks.workunit.client.0.smithi134.stdout:1/287: mknod d3/d6/d20/c66 0 2024-04-13T10:59:03.806 INFO:tasks.workunit.client.0.smithi134.stdout:9/263: symlink d13/d2e/d35/l4f 0 2024-04-13T10:59:03.806 INFO:tasks.workunit.client.0.smithi134.stdout:3/224: creat dc/d27/d1f/d25/f46 x:0 0 0 2024-04-13T10:59:03.809 INFO:tasks.workunit.client.0.smithi134.stdout:8/168: unlink f3 0 2024-04-13T10:59:03.810 INFO:tasks.workunit.client.0.smithi134.stdout:8/169: readlink d8/l18 0 2024-04-13T10:59:03.813 INFO:tasks.workunit.client.0.smithi134.stdout:1/288: dwrite d3/d6/d20/f38 [0,4194304] 0 2024-04-13T10:59:03.814 INFO:tasks.workunit.client.0.smithi134.stdout:1/289: truncate d3/d6/f31 967466 0 2024-04-13T10:59:03.816 INFO:tasks.workunit.client.0.smithi134.stdout:7/168: mknod da/d15/d26/d27/c3f 0 2024-04-13T10:59:03.821 INFO:tasks.workunit.client.0.smithi134.stdout:9/264: mkdir d13/d2e/d35/d50 0 2024-04-13T10:59:03.822 INFO:tasks.workunit.client.0.smithi134.stdout:1/290: dwrite d3/d6/d20/d28/f3e [0,4194304] 0 2024-04-13T10:59:03.824 INFO:tasks.workunit.client.0.smithi134.stdout:5/313: mkdir dc/d1d/d67/d69 0 2024-04-13T10:59:03.826 INFO:tasks.workunit.client.0.smithi134.stdout:3/225: creat dc/d27/d1f/d25/f47 x:0 0 0 2024-04-13T10:59:03.829 INFO:tasks.workunit.client.0.smithi134.stdout:7/169: mknod da/c40 0 2024-04-13T10:59:03.829 INFO:tasks.workunit.client.0.smithi134.stdout:3/226: fsync dc/d1d/f28 0 2024-04-13T10:59:03.832 INFO:tasks.workunit.client.0.smithi134.stdout:6/275: dwrite d4/da/f14 [0,4194304] 0 2024-04-13T10:59:03.837 INFO:tasks.workunit.client.0.smithi134.stdout:8/170: creat d8/dc/d37/f3a x:0 0 0 2024-04-13T10:59:03.837 INFO:tasks.workunit.client.0.smithi134.stdout:9/265: dwrite d13/f21 [0,4194304] 0 2024-04-13T10:59:03.843 INFO:tasks.workunit.client.0.smithi134.stdout:6/276: dwrite d4/da/d15/d1f/d24/d2b/f36 [0,4194304] 0 2024-04-13T10:59:03.851 INFO:tasks.workunit.client.0.smithi134.stdout:7/170: rmdir da/d15/d26 39 2024-04-13T10:59:03.851 INFO:tasks.workunit.client.0.smithi134.stdout:3/227: mkdir dc/d27/d19/d48 0 2024-04-13T10:59:03.852 INFO:tasks.workunit.client.0.smithi134.stdout:2/225: getdents d5/de/d12/d2f/d30 0 2024-04-13T10:59:03.853 INFO:tasks.workunit.client.0.smithi134.stdout:3/228: dread - dc/d27/d1f/d25/f3e zero size 2024-04-13T10:59:03.855 INFO:tasks.workunit.client.0.smithi134.stdout:8/171: rename d8/dc/f22 to d8/dc/d37/f3b 0 2024-04-13T10:59:03.861 INFO:tasks.workunit.client.0.smithi134.stdout:9/266: creat d13/f51 x:0 0 0 2024-04-13T10:59:03.863 INFO:tasks.workunit.client.0.smithi134.stdout:6/277: rename d4/da/d15/d1f/d24/c52 to d4/da/d15/c55 0 2024-04-13T10:59:03.865 INFO:tasks.workunit.client.0.smithi134.stdout:6/278: write d4/da/d15/d1f/d24/d2b/f40 [941932,4343] 0 2024-04-13T10:59:03.865 INFO:tasks.workunit.client.0.smithi134.stdout:8/172: creat d8/dc/d37/f3c x:0 0 0 2024-04-13T10:59:03.866 INFO:tasks.workunit.client.0.smithi134.stdout:9/267: dread d13/f21 [0,4194304] 0 2024-04-13T10:59:03.870 INFO:tasks.workunit.client.0.smithi134.stdout:2/226: link d5/d6/c1f d5/d6/d34/c4c 0 2024-04-13T10:59:03.870 INFO:tasks.workunit.client.0.smithi134.stdout:7/171: dread f4 [0,4194304] 0 2024-04-13T10:59:03.871 INFO:tasks.workunit.client.0.smithi134.stdout:3/229: rmdir dc 39 2024-04-13T10:59:03.874 INFO:tasks.workunit.client.0.smithi134.stdout:9/268: dwrite fc [4194304,4194304] 0 2024-04-13T10:59:03.875 INFO:tasks.workunit.client.0.smithi134.stdout:8/173: fsync d8/dc/d13/f14 0 2024-04-13T10:59:03.876 INFO:tasks.workunit.client.0.smithi134.stdout:8/174: chown d8/dc/d37/f3a 21839992 1 2024-04-13T10:59:03.881 INFO:tasks.workunit.client.0.smithi134.stdout:7/172: symlink da/l41 0 2024-04-13T10:59:03.882 INFO:tasks.workunit.client.0.smithi134.stdout:2/227: rename d5/de/f19 to d5/d6/d21/f4d 0 2024-04-13T10:59:03.883 INFO:tasks.workunit.client.0.smithi134.stdout:2/228: readlink d5/d6/df/l2c 0 2024-04-13T10:59:03.886 INFO:tasks.workunit.client.0.smithi134.stdout:9/269: mkdir d13/d39/d52 0 2024-04-13T10:59:03.888 INFO:tasks.workunit.client.0.smithi134.stdout:9/270: fsync d13/d40/f48 0 2024-04-13T10:59:03.889 INFO:tasks.workunit.client.0.smithi134.stdout:6/279: link d4/lf d4/da/d1a/l56 0 2024-04-13T10:59:03.889 INFO:tasks.workunit.client.0.smithi134.stdout:3/230: dwrite dc/d27/d1f/d25/f46 [0,4194304] 0 2024-04-13T10:59:03.889 INFO:tasks.workunit.client.0.smithi134.stdout:8/175: mknod d8/dc/c3d 0 2024-04-13T10:59:03.894 INFO:tasks.workunit.client.0.smithi134.stdout:3/231: truncate dc/d27/d19/d23/f43 520373 0 2024-04-13T10:59:03.897 INFO:tasks.workunit.client.0.smithi134.stdout:9/271: symlink d13/d2e/d35/l53 0 2024-04-13T10:59:03.902 INFO:tasks.workunit.client.0.smithi134.stdout:8/176: dwrite d8/dc/d37/f3c [0,4194304] 0 2024-04-13T10:59:03.908 INFO:tasks.workunit.client.0.smithi134.stdout:7/173: getdents da/d15/d26/d38 0 2024-04-13T10:59:03.908 INFO:tasks.workunit.client.0.smithi134.stdout:6/280: dwrite d4/f18 [0,4194304] 0 2024-04-13T10:59:03.911 INFO:tasks.workunit.client.0.smithi134.stdout:2/229: dread d5/de/f37 [4194304,4194304] 0 2024-04-13T10:59:03.911 INFO:tasks.workunit.client.0.smithi134.stdout:9/272: mknod d13/d39/d52/c54 0 2024-04-13T10:59:03.912 INFO:tasks.workunit.client.0.smithi134.stdout:7/174: write da/d15/f3a [1000952,72112] 0 2024-04-13T10:59:03.914 INFO:tasks.workunit.client.0.smithi134.stdout:7/175: stat da/d15 0 2024-04-13T10:59:03.919 INFO:tasks.workunit.client.0.smithi134.stdout:8/177: dwrite d8/dc/d37/f3c [0,4194304] 0 2024-04-13T10:59:03.919 INFO:tasks.workunit.client.0.smithi134.stdout:2/230: write d5/de/d12/d2f/d30/f42 [1392217,74175] 0 2024-04-13T10:59:03.922 INFO:tasks.workunit.client.0.smithi134.stdout:7/176: mknod da/d15/d26/c42 0 2024-04-13T10:59:03.924 INFO:tasks.workunit.client.0.smithi134.stdout:9/273: link lf d13/d2e/d47/l55 0 2024-04-13T10:59:03.924 INFO:tasks.workunit.client.0.smithi134.stdout:8/178: truncate d8/dc/d13/f36 918448 0 2024-04-13T10:59:03.925 INFO:tasks.workunit.client.0.smithi134.stdout:6/281: dwrite d4/f1b [0,4194304] 0 2024-04-13T10:59:03.926 INFO:tasks.workunit.client.0.smithi134.stdout:2/231: truncate d5/d6/d21/d29/f46 52952 0 2024-04-13T10:59:03.930 INFO:tasks.workunit.client.0.smithi134.stdout:8/179: write d8/ff [1884078,39146] 0 2024-04-13T10:59:03.931 INFO:tasks.workunit.client.0.smithi134.stdout:6/282: write d4/da/f25 [2728318,129912] 0 2024-04-13T10:59:03.933 INFO:tasks.workunit.client.0.smithi134.stdout:7/177: dwrite da/fb [0,4194304] 0 2024-04-13T10:59:03.935 INFO:tasks.workunit.client.0.smithi134.stdout:8/180: creat d8/dc/f3e x:0 0 0 2024-04-13T10:59:03.938 INFO:tasks.workunit.client.0.smithi134.stdout:7/178: dread da/f11 [0,4194304] 0 2024-04-13T10:59:03.938 INFO:tasks.workunit.client.0.smithi134.stdout:6/283: rmdir d4/da/d54 0 2024-04-13T10:59:03.940 INFO:tasks.workunit.client.0.smithi134.stdout:6/284: fdatasync d4/da/f14 0 2024-04-13T10:59:03.940 INFO:tasks.workunit.client.0.smithi134.stdout:8/181: mkdir d8/dc/d37/d3f 0 2024-04-13T10:59:03.940 INFO:tasks.workunit.client.0.smithi134.stdout:8/182: chown d8/dc/f30 48155729 1 2024-04-13T10:59:03.942 INFO:tasks.workunit.client.0.smithi134.stdout:6/285: mkdir d4/da/d15/d57 0 2024-04-13T10:59:03.943 INFO:tasks.workunit.client.0.smithi134.stdout:7/179: symlink da/d15/d26/l43 0 2024-04-13T10:59:03.943 INFO:tasks.workunit.client.0.smithi134.stdout:8/183: creat d8/dc/d13/f40 x:0 0 0 2024-04-13T10:59:03.944 INFO:tasks.workunit.client.0.smithi134.stdout:6/286: symlink d4/da/d15/l58 0 2024-04-13T10:59:03.945 INFO:tasks.workunit.client.0.smithi134.stdout:6/287: chown d4/da/d15/c22 131389147 1 2024-04-13T10:59:03.945 INFO:tasks.workunit.client.0.smithi134.stdout:7/180: symlink da/l44 0 2024-04-13T10:59:03.947 INFO:tasks.workunit.client.0.smithi134.stdout:8/184: fdatasync d8/dc/d16/f2d 0 2024-04-13T10:59:03.949 INFO:tasks.workunit.client.0.smithi134.stdout:8/185: write d8/dc/f30 [334602,54194] 0 2024-04-13T10:59:04.005 INFO:tasks.workunit.client.0.smithi134.stdout:9/274: rmdir d13 39 2024-04-13T10:59:04.008 INFO:tasks.workunit.client.0.smithi134.stdout:9/275: chown d13/c1c 0 1 2024-04-13T10:59:04.012 INFO:tasks.workunit.client.0.smithi134.stdout:2/232: dwrite d5/de/f37 [8388608,4194304] 0 2024-04-13T10:59:04.013 INFO:tasks.workunit.client.0.smithi134.stdout:2/233: write d5/de/f10 [5146122,126805] 0 2024-04-13T10:59:04.015 INFO:tasks.workunit.client.0.smithi134.stdout:6/288: truncate d4/da/f14 1795173 0 2024-04-13T10:59:04.016 INFO:tasks.workunit.client.0.smithi134.stdout:2/234: stat d5/d6/d21/d29/c3e 0 2024-04-13T10:59:04.019 INFO:tasks.workunit.client.0.smithi134.stdout:9/276: link d13/l29 d13/l56 0 2024-04-13T10:59:04.020 INFO:tasks.workunit.client.0.smithi134.stdout:9/277: fdatasync d13/d39/f45 0 2024-04-13T10:59:04.021 INFO:tasks.workunit.client.0.smithi134.stdout:6/289: creat d4/da/d15/d1f/d3c/f59 x:0 0 0 2024-04-13T10:59:04.022 INFO:tasks.workunit.client.0.smithi134.stdout:6/290: fsync d4/da/d15/d1f/f2a 0 2024-04-13T10:59:04.023 INFO:tasks.workunit.client.0.smithi134.stdout:6/291: stat d4/da/f41 0 2024-04-13T10:59:04.024 INFO:tasks.workunit.client.0.smithi134.stdout:2/235: rename d5/de/d12/d2f to d5/de/d2e/d4e 0 2024-04-13T10:59:04.027 INFO:tasks.workunit.client.0.smithi134.stdout:8/186: truncate d8/ff 3201501 0 2024-04-13T10:59:04.034 INFO:tasks.workunit.client.0.smithi134.stdout:2/236: write d5/d6/d21/f4d [4231307,37462] 0 2024-04-13T10:59:04.035 INFO:tasks.workunit.client.0.smithi134.stdout:2/237: chown d5/de/d2e/d4e/f4a 536 1 2024-04-13T10:59:04.038 INFO:tasks.workunit.client.0.smithi134.stdout:8/187: rmdir d8/dc 39 2024-04-13T10:59:04.041 INFO:tasks.workunit.client.0.smithi134.stdout:6/292: creat d4/da/d15/d57/f5a x:0 0 0 2024-04-13T10:59:04.041 INFO:tasks.workunit.client.0.smithi134.stdout:6/293: chown d4 60699277 1 2024-04-13T10:59:04.042 INFO:tasks.workunit.client.0.smithi134.stdout:2/238: chown d5/l35 1908268906 1 2024-04-13T10:59:04.045 INFO:tasks.workunit.client.0.smithi134.stdout:9/278: link d13/d39/f3b d13/f57 0 2024-04-13T10:59:04.047 INFO:tasks.workunit.client.0.smithi134.stdout:6/294: rmdir d4/da/d15/d1f/d24/d49 39 2024-04-13T10:59:04.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/239: creat d5/de/d2e/d4e/d30/f4f x:0 0 0 2024-04-13T10:59:04.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/240: fsync d5/de/f16 0 2024-04-13T10:59:04.051 INFO:tasks.workunit.client.0.smithi134.stdout:9/279: mkdir d13/d39/d58 0 2024-04-13T10:59:04.051 INFO:tasks.workunit.client.0.smithi134.stdout:2/241: fdatasync d5/de/f22 0 2024-04-13T10:59:04.053 INFO:tasks.workunit.client.0.smithi134.stdout:8/188: symlink d8/dc/d13/l41 0 2024-04-13T10:59:04.053 INFO:tasks.workunit.client.0.smithi134.stdout:8/189: stat f0 0 2024-04-13T10:59:04.058 INFO:tasks.workunit.client.0.smithi134.stdout:2/242: mkdir d5/de/d50 0 2024-04-13T10:59:04.058 INFO:tasks.workunit.client.0.smithi134.stdout:2/243: stat d5/de/c11 0 2024-04-13T10:59:04.061 INFO:tasks.workunit.client.0.smithi134.stdout:8/190: dread - d8/dc/d16/f1c zero size 2024-04-13T10:59:04.062 INFO:tasks.workunit.client.0.smithi134.stdout:9/280: mkdir d13/d2e/d35/d50/d59 0 2024-04-13T10:59:04.063 INFO:tasks.workunit.client.0.smithi134.stdout:2/244: mknod d5/de/d2e/d4e/d31/c51 0 2024-04-13T10:59:04.064 INFO:tasks.workunit.client.0.smithi134.stdout:9/281: mknod d13/d39/d58/c5a 0 2024-04-13T10:59:04.065 INFO:tasks.workunit.client.0.smithi134.stdout:9/282: chown d13/d2e/f3e 1485414 1 2024-04-13T10:59:04.066 INFO:tasks.workunit.client.0.smithi134.stdout:6/295: truncate d4/fd 900056 0 2024-04-13T10:59:04.070 INFO:tasks.workunit.client.0.smithi134.stdout:9/283: mknod d13/d2e/d35/d50/d59/c5b 0 2024-04-13T10:59:04.072 INFO:tasks.workunit.client.0.smithi134.stdout:4/178: sync 2024-04-13T10:59:04.073 INFO:tasks.workunit.client.0.smithi134.stdout:9/284: creat d13/d39/d58/f5c x:0 0 0 2024-04-13T10:59:04.073 INFO:tasks.workunit.client.0.smithi134.stdout:2/245: dwrite d5/de/d2e/d4e/d30/f42 [0,4194304] 0 2024-04-13T10:59:04.074 INFO:tasks.workunit.client.0.smithi134.stdout:4/179: dread - d4/d1b/f35 zero size 2024-04-13T10:59:04.076 INFO:tasks.workunit.client.0.smithi134.stdout:9/285: rmdir d13/d40 39 2024-04-13T10:59:04.078 INFO:tasks.workunit.client.0.smithi134.stdout:4/180: rmdir d4/d1b 39 2024-04-13T10:59:04.080 INFO:tasks.workunit.client.0.smithi134.stdout:9/286: rename d13/d39/d52/c54 to d13/d2e/d35/d50/c5d 0 2024-04-13T10:59:04.081 INFO:tasks.workunit.client.0.smithi134.stdout:2/246: mknod d5/de/d2e/d4e/c52 0 2024-04-13T10:59:04.082 INFO:tasks.workunit.client.0.smithi134.stdout:9/287: rmdir d13 39 2024-04-13T10:59:04.127 INFO:tasks.workunit.client.0.smithi134.stdout:2/247: write d5/de/d2e/d4e/d30/f4f [652729,13528] 0 2024-04-13T10:59:04.128 INFO:tasks.workunit.client.0.smithi134.stdout:6/296: truncate d4/da/d15/d1f/d24/f3e 296392 0 2024-04-13T10:59:04.130 INFO:tasks.workunit.client.0.smithi134.stdout:9/288: truncate d13/f57 501213 0 2024-04-13T10:59:04.136 INFO:tasks.workunit.client.0.smithi134.stdout:6/297: unlink d4/da/d15/d1f/d24/f42 0 2024-04-13T10:59:04.139 INFO:tasks.workunit.client.0.smithi134.stdout:4/181: rename d4/d1f/d27/f37 to d4/dd/f39 0 2024-04-13T10:59:04.143 INFO:tasks.workunit.client.0.smithi134.stdout:4/182: mkdir d4/d1f/d27/d3a 0 2024-04-13T10:59:04.146 INFO:tasks.workunit.client.0.smithi134.stdout:6/298: mkdir d4/da/d15/d1f/d24/d5b 0 2024-04-13T10:59:04.147 INFO:tasks.workunit.client.0.smithi134.stdout:2/248: link d5/d6/c41 d5/de/d2e/d4e/c53 0 2024-04-13T10:59:04.150 INFO:tasks.workunit.client.0.smithi134.stdout:2/249: mknod d5/de/d12/c54 0 2024-04-13T10:59:04.151 INFO:tasks.workunit.client.0.smithi134.stdout:2/250: write d5/de/d12/f1d [3033639,76654] 0 2024-04-13T10:59:04.152 INFO:tasks.workunit.client.0.smithi134.stdout:6/299: mknod d4/da/c5c 0 2024-04-13T10:59:04.153 INFO:tasks.workunit.client.0.smithi134.stdout:4/183: creat d4/d1b/d32/f3b x:0 0 0 2024-04-13T10:59:04.157 INFO:tasks.workunit.client.0.smithi134.stdout:4/184: mknod d4/d1f/c3c 0 2024-04-13T10:59:04.161 INFO:tasks.workunit.client.0.smithi134.stdout:4/185: dread d4/d1f/d27/d2f/f31 [0,4194304] 0 2024-04-13T10:59:04.168 INFO:tasks.workunit.client.0.smithi134.stdout:4/186: dwrite d4/d1b/f28 [0,4194304] 0 2024-04-13T10:59:04.169 INFO:tasks.workunit.client.0.smithi134.stdout:2/251: getdents d5/d6/d21 0 2024-04-13T10:59:04.173 INFO:tasks.workunit.client.0.smithi134.stdout:6/300: link d4/lf d4/da/l5d 0 2024-04-13T10:59:04.177 INFO:tasks.workunit.client.0.smithi134.stdout:2/252: dwrite d5/d6/f9 [4194304,4194304] 0 2024-04-13T10:59:04.185 INFO:tasks.workunit.client.0.smithi134.stdout:2/253: mkdir d5/de/d55 0 2024-04-13T10:59:04.186 INFO:tasks.workunit.client.0.smithi134.stdout:6/301: dwrite d4/da/f41 [0,4194304] 0 2024-04-13T10:59:04.187 INFO:tasks.workunit.client.0.smithi134.stdout:2/254: chown d5/de/d2e/d4e/c52 107507 1 2024-04-13T10:59:04.189 INFO:tasks.workunit.client.0.smithi134.stdout:4/187: getdents d4/d1f/d27/d2f 0 2024-04-13T10:59:04.196 INFO:tasks.workunit.client.0.smithi134.stdout:6/302: link d4/f18 d4/da/d15/d1f/d3c/f5e 0 2024-04-13T10:59:04.197 INFO:tasks.workunit.client.0.smithi134.stdout:2/255: creat d5/de/d50/f56 x:0 0 0 2024-04-13T10:59:04.199 INFO:tasks.workunit.client.0.smithi134.stdout:4/188: mknod d4/d1f/d27/d2e/c3d 0 2024-04-13T10:59:04.201 INFO:tasks.workunit.client.0.smithi134.stdout:6/303: mkdir d4/da/d15/d5f 0 2024-04-13T10:59:04.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/256: rmdir d5/d6/df 39 2024-04-13T10:59:04.210 INFO:tasks.workunit.client.0.smithi134.stdout:4/189: symlink d4/d1f/d27/d3a/l3e 0 2024-04-13T10:59:04.211 INFO:tasks.workunit.client.0.smithi134.stdout:6/304: mknod d4/da/d15/d1f/d24/d5b/c60 0 2024-04-13T10:59:04.211 INFO:tasks.workunit.client.0.smithi134.stdout:2/257: dwrite d5/de/d2e/d4e/d30/f42 [0,4194304] 0 2024-04-13T10:59:04.213 INFO:tasks.workunit.client.0.smithi134.stdout:4/190: fdatasync d4/d1f/d27/d2f/f31 0 2024-04-13T10:59:04.214 INFO:tasks.workunit.client.0.smithi134.stdout:4/191: chown d4/d1f 7 1 2024-04-13T10:59:04.218 INFO:tasks.workunit.client.0.smithi134.stdout:6/305: unlink d4/da/d15/d1f/d24/d2b/f36 0 2024-04-13T10:59:04.223 INFO:tasks.workunit.client.0.smithi134.stdout:2/258: rename d5/de/d2e/d4e/d31 to d5/d6/d57 0 2024-04-13T10:59:04.225 INFO:tasks.workunit.client.0.smithi134.stdout:4/192: creat d4/dd/f3f x:0 0 0 2024-04-13T10:59:04.226 INFO:tasks.workunit.client.0.smithi134.stdout:6/306: link d4/da/c5c d4/da/d15/d57/c61 0 2024-04-13T10:59:04.227 INFO:tasks.workunit.client.0.smithi134.stdout:4/193: write d4/d1b/f35 [889066,104413] 0 2024-04-13T10:59:04.229 INFO:tasks.workunit.client.0.smithi134.stdout:4/194: fdatasync d4/da/f36 0 2024-04-13T10:59:04.247 INFO:tasks.workunit.client.0.smithi134.stdout:4/195: link d4/d1f/f23 d4/d1f/d27/d2f/f40 0 2024-04-13T10:59:04.254 INFO:tasks.workunit.client.0.smithi134.stdout:4/196: creat d4/d1f/d27/d2f/d38/f41 x:0 0 0 2024-04-13T10:59:04.257 INFO:tasks.workunit.client.0.smithi134.stdout:4/197: mkdir d4/d1f/d27/d2f/d38/d42 0 2024-04-13T10:59:04.260 INFO:tasks.workunit.client.0.smithi134.stdout:2/259: truncate d5/fd 6463718 0 2024-04-13T10:59:04.264 INFO:tasks.workunit.client.0.smithi134.stdout:2/260: chown d5/de/d2e/d4e 4061 1 2024-04-13T10:59:04.266 INFO:tasks.workunit.client.0.smithi134.stdout:4/198: mknod d4/d1f/d27/d2f/d38/c43 0 2024-04-13T10:59:04.269 INFO:tasks.workunit.client.0.smithi134.stdout:6/307: dwrite d4/da/d15/d1f/d24/f3a [0,4194304] 0 2024-04-13T10:59:04.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/261: mkdir d5/de/d2e/d4e/d30/d58 0 2024-04-13T10:59:04.272 INFO:tasks.workunit.client.0.smithi134.stdout:6/308: fdatasync d4/da/d15/d1f/d24/d49/f50 0 2024-04-13T10:59:04.275 INFO:tasks.workunit.client.0.smithi134.stdout:6/309: rmdir d4/da/d15/d1f/d3c 39 2024-04-13T10:59:04.275 INFO:tasks.workunit.client.0.smithi134.stdout:2/262: dread d5/de/f16 [0,4194304] 0 2024-04-13T10:59:04.279 INFO:tasks.workunit.client.0.smithi134.stdout:2/263: mkdir d5/de/d2e/d4e/d30/d58/d59 0 2024-04-13T10:59:04.280 INFO:tasks.workunit.client.0.smithi134.stdout:2/264: fdatasync d5/de/d50/f56 0 2024-04-13T10:59:04.281 INFO:tasks.workunit.client.0.smithi134.stdout:6/310: creat d4/da/d15/d1f/d24/f62 x:0 0 0 2024-04-13T10:59:04.283 INFO:tasks.workunit.client.0.smithi134.stdout:6/311: write d4/da/d15/d1f/f4b [48244,103749] 0 2024-04-13T10:59:04.287 INFO:tasks.workunit.client.0.smithi134.stdout:6/312: mkdir d4/da/d15/d5f/d63 0 2024-04-13T10:59:04.288 INFO:tasks.workunit.client.0.smithi134.stdout:2/265: dwrite d5/de/f37 [8388608,4194304] 0 2024-04-13T10:59:04.291 INFO:tasks.workunit.client.0.smithi134.stdout:6/313: symlink d4/da/l64 0 2024-04-13T10:59:04.292 INFO:tasks.workunit.client.0.smithi134.stdout:6/314: write d4/f5 [4355202,74866] 0 2024-04-13T10:59:04.293 INFO:tasks.workunit.client.0.smithi134.stdout:6/315: chown d4/da/d15/d1f/d24/d2b/l3d 38990 1 2024-04-13T10:59:04.298 INFO:tasks.workunit.client.0.smithi134.stdout:6/316: getdents d4/da/d15/d1f 0 2024-04-13T10:59:04.300 INFO:tasks.workunit.client.0.smithi134.stdout:6/317: chown d4/da/c5c 35 1 2024-04-13T10:59:04.300 INFO:tasks.workunit.client.0.smithi134.stdout:6/318: chown d4 649 1 2024-04-13T10:59:04.305 INFO:tasks.workunit.client.0.smithi134.stdout:6/319: link d4/lc d4/da/d15/d1f/l65 0 2024-04-13T10:59:04.392 INFO:tasks.workunit.client.0.smithi134.stdout:0/223: sync 2024-04-13T10:59:04.392 INFO:tasks.workunit.client.0.smithi134.stdout:5/314: sync 2024-04-13T10:59:04.392 INFO:tasks.workunit.client.0.smithi134.stdout:1/291: sync 2024-04-13T10:59:04.393 INFO:tasks.workunit.client.0.smithi134.stdout:1/292: creat d3/d6/dd/f67 x:0 0 0 2024-04-13T10:59:04.395 INFO:tasks.workunit.client.0.smithi134.stdout:1/293: chown d3/d6/d16/d1d/f58 3471 1 2024-04-13T10:59:04.395 INFO:tasks.workunit.client.0.smithi134.stdout:5/315: mkdir dc/d1d/d2f/d3b/d6a 0 2024-04-13T10:59:04.396 INFO:tasks.workunit.client.0.smithi134.stdout:0/224: mknod d4/d17/d20/c55 0 2024-04-13T10:59:04.399 INFO:tasks.workunit.client.0.smithi134.stdout:1/294: rename d3/d6/d16/d1d/d5c to d3/d6/d16/d1d/d68 0 2024-04-13T10:59:04.402 INFO:tasks.workunit.client.0.smithi134.stdout:5/316: dwrite dc/d1d/d20/d23/f2a [0,4194304] 0 2024-04-13T10:59:04.404 INFO:tasks.workunit.client.0.smithi134.stdout:1/295: mknod d3/d6/c69 0 2024-04-13T10:59:04.409 INFO:tasks.workunit.client.0.smithi134.stdout:1/296: mkdir d3/d6/d6a 0 2024-04-13T10:59:04.411 INFO:tasks.workunit.client.0.smithi134.stdout:1/297: write d3/d6/d16/d1d/d68/f5d [347499,109699] 0 2024-04-13T10:59:04.412 INFO:tasks.workunit.client.0.smithi134.stdout:5/317: dwrite dc/f1b [4194304,4194304] 0 2024-04-13T10:59:04.418 INFO:tasks.workunit.client.0.smithi134.stdout:1/298: dread d3/d6/d20/f38 [0,4194304] 0 2024-04-13T10:59:04.423 INFO:tasks.workunit.client.0.smithi134.stdout:1/299: fdatasync d3/d6/f15 0 2024-04-13T10:59:04.423 INFO:tasks.workunit.client.0.smithi134.stdout:5/318: dwrite dc/d1d/d20/d23/f42 [0,4194304] 0 2024-04-13T10:59:04.425 INFO:tasks.workunit.client.0.smithi134.stdout:1/300: read d3/d6/d16/d1d/f22 [2306543,39882] 0 2024-04-13T10:59:04.431 INFO:tasks.workunit.client.0.smithi134.stdout:5/319: dread dc/d1d/d20/d23/f42 [0,4194304] 0 2024-04-13T10:59:04.443 INFO:tasks.workunit.client.0.smithi134.stdout:1/301: dread d3/fb [0,4194304] 0 2024-04-13T10:59:04.444 INFO:tasks.workunit.client.0.smithi134.stdout:1/302: chown d3/d6/d16/d1d/f26 35176797 1 2024-04-13T10:59:04.444 INFO:tasks.workunit.client.0.smithi134.stdout:5/320: truncate dc/d1d/d20/d23/f42 1018921 0 2024-04-13T10:59:04.445 INFO:tasks.workunit.client.0.smithi134.stdout:5/321: chown dc/l4f 57151 1 2024-04-13T10:59:04.448 INFO:tasks.workunit.client.0.smithi134.stdout:1/303: rename d3/f8 to d3/d6/d20/f6b 0 2024-04-13T10:59:04.449 INFO:tasks.workunit.client.0.smithi134.stdout:1/304: truncate d3/d6/d20/d28/f37 486187 0 2024-04-13T10:59:04.453 INFO:tasks.workunit.client.0.smithi134.stdout:1/305: creat d3/d6/d6a/f6c x:0 0 0 2024-04-13T10:59:04.457 INFO:tasks.workunit.client.0.smithi134.stdout:1/306: stat d3/d6/l47 0 2024-04-13T10:59:04.457 INFO:tasks.workunit.client.0.smithi134.stdout:1/307: dread - d3/f41 zero size 2024-04-13T10:59:04.459 INFO:tasks.workunit.client.0.smithi134.stdout:5/322: truncate dc/d1d/d2f/d3b/d3c/f5d 3640886 0 2024-04-13T10:59:04.469 INFO:tasks.workunit.client.0.smithi134.stdout:1/308: dread d3/d6/d16/f35 [0,4194304] 0 2024-04-13T10:59:04.469 INFO:tasks.workunit.client.0.smithi134.stdout:1/309: read - d3/d30/f4b zero size 2024-04-13T10:59:04.475 INFO:tasks.workunit.client.0.smithi134.stdout:5/323: creat dc/d1d/d2f/d3b/d6a/f6b x:0 0 0 2024-04-13T10:59:04.476 INFO:tasks.workunit.client.0.smithi134.stdout:5/324: read dc/d1d/d20/d23/f42 [1001644,96189] 0 2024-04-13T10:59:04.479 INFO:tasks.workunit.client.0.smithi134.stdout:1/310: chown d3/d6/d20/d28/l59 49 1 2024-04-13T10:59:04.479 INFO:tasks.workunit.client.0.smithi134.stdout:1/311: chown d3/d6 1304 1 2024-04-13T10:59:04.482 INFO:tasks.workunit.client.0.smithi134.stdout:5/325: creat dc/d15/d65/f6c x:0 0 0 2024-04-13T10:59:04.484 INFO:tasks.workunit.client.0.smithi134.stdout:5/326: write dc/d1d/d2b/d30/d3e/f4d [2149354,34206] 0 2024-04-13T10:59:04.486 INFO:tasks.workunit.client.0.smithi134.stdout:5/327: creat dc/d15/d65/f6d x:0 0 0 2024-04-13T10:59:04.489 INFO:tasks.workunit.client.0.smithi134.stdout:5/328: link dc/d1d/d20/d23/f32 dc/d1d/d20/d23/d5a/f6e 0 2024-04-13T10:59:04.490 INFO:tasks.workunit.client.0.smithi134.stdout:5/329: chown dc/d1d/d20/f2d 1650574 1 2024-04-13T10:59:04.493 INFO:tasks.workunit.client.0.smithi134.stdout:5/330: dread dc/d1d/d2f/d3b/f51 [0,4194304] 0 2024-04-13T10:59:04.495 INFO:tasks.workunit.client.0.smithi134.stdout:5/331: creat dc/d1d/d2f/f6f x:0 0 0 2024-04-13T10:59:04.496 INFO:tasks.workunit.client.0.smithi134.stdout:5/332: rmdir dc/d1d/d2f/d3b 39 2024-04-13T10:59:04.497 INFO:tasks.workunit.client.0.smithi134.stdout:5/333: chown f1 796234 1 2024-04-13T10:59:04.498 INFO:tasks.workunit.client.0.smithi134.stdout:5/334: getdents dc/d15/d5c 0 2024-04-13T10:59:04.500 INFO:tasks.workunit.client.0.smithi134.stdout:5/335: fsync dc/d15/f43 0 2024-04-13T10:59:04.502 INFO:tasks.workunit.client.0.smithi134.stdout:5/336: creat dc/d1d/d46/f70 x:0 0 0 2024-04-13T10:59:04.503 INFO:tasks.workunit.client.0.smithi134.stdout:5/337: readlink dc/d1d/d20/l31 0 2024-04-13T10:59:04.509 INFO:tasks.workunit.client.0.smithi134.stdout:5/338: rmdir dc/d15/d5c 0 2024-04-13T10:59:04.511 INFO:tasks.workunit.client.0.smithi134.stdout:5/339: read - dc/d1d/d2f/d3b/f56 zero size 2024-04-13T10:59:04.516 INFO:tasks.workunit.client.0.smithi134.stdout:5/340: rename dc/d1d/f49 to dc/d1d/d2b/d30/d3e/f71 0 2024-04-13T10:59:04.517 INFO:tasks.workunit.client.0.smithi134.stdout:5/341: truncate dc/d1d/d2f/d3b/f52 503763 0 2024-04-13T10:59:04.524 INFO:tasks.workunit.client.0.smithi134.stdout:5/342: dwrite dc/d1d/d2f/d3b/f52 [0,4194304] 0 2024-04-13T10:59:04.542 INFO:tasks.workunit.client.0.smithi134.stdout:5/343: dwrite dc/d15/f43 [0,4194304] 0 2024-04-13T10:59:04.544 INFO:tasks.workunit.client.0.smithi134.stdout:5/344: write dc/d1d/d46/f4c [1521928,126606] 0 2024-04-13T10:59:04.559 INFO:tasks.workunit.client.0.smithi134.stdout:5/345: dwrite dc/d1d/d20/d23/f26 [0,4194304] 0 2024-04-13T10:59:04.578 INFO:tasks.workunit.client.0.smithi134.stdout:5/346: dread f9 [0,4194304] 0 2024-04-13T10:59:04.585 INFO:tasks.workunit.client.0.smithi134.stdout:5/347: dwrite dc/d1d/d20/d23/f26 [0,4194304] 0 2024-04-13T10:59:04.589 INFO:tasks.workunit.client.0.smithi134.stdout:5/348: symlink dc/d39/l72 0 2024-04-13T10:59:04.590 INFO:tasks.workunit.client.0.smithi134.stdout:5/349: chown dc/d1d/d20/d23/f55 18 1 2024-04-13T10:59:04.593 INFO:tasks.workunit.client.0.smithi134.stdout:5/350: read dc/d1d/d2f/d3b/d3c/f5d [1668193,84878] 0 2024-04-13T10:59:04.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/351: dwrite dc/d1d/d46/f47 [0,4194304] 0 2024-04-13T10:59:04.608 INFO:tasks.workunit.client.0.smithi134.stdout:5/352: link dc/d15/d65/f6c dc/d1d/d20/d23/d36/f73 0 2024-04-13T10:59:04.611 INFO:tasks.workunit.client.0.smithi134.stdout:5/353: rmdir dc/d1d/d20/d23/d36 39 2024-04-13T10:59:04.627 INFO:tasks.workunit.client.0.smithi134.stdout:5/354: dread dc/f17 [0,4194304] 0 2024-04-13T10:59:04.645 INFO:tasks.workunit.client.0.smithi134.stdout:7/181: sync 2024-04-13T10:59:04.645 INFO:tasks.workunit.client.0.smithi134.stdout:8/191: sync 2024-04-13T10:59:04.645 INFO:tasks.workunit.client.0.smithi134.stdout:3/232: sync 2024-04-13T10:59:04.646 INFO:tasks.workunit.client.0.smithi134.stdout:7/182: stat da/d15 0 2024-04-13T10:59:04.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/183: chown da/l20 18628 1 2024-04-13T10:59:04.647 INFO:tasks.workunit.client.0.smithi134.stdout:3/233: truncate dc/f42 921582 0 2024-04-13T10:59:04.651 INFO:tasks.workunit.client.0.smithi134.stdout:7/184: rmdir da/d15/d26/d38 39 2024-04-13T10:59:04.654 INFO:tasks.workunit.client.0.smithi134.stdout:5/355: dwrite dc/d1d/d20/f2d [0,4194304] 0 2024-04-13T10:59:04.657 INFO:tasks.workunit.client.0.smithi134.stdout:5/356: read - dc/d1d/d20/d23/f32 zero size 2024-04-13T10:59:04.657 INFO:tasks.workunit.client.0.smithi134.stdout:3/234: dread dc/d27/d1f/f20 [0,4194304] 0 2024-04-13T10:59:04.658 INFO:tasks.workunit.client.0.smithi134.stdout:7/185: dread da/d15/d26/f28 [0,4194304] 0 2024-04-13T10:59:04.659 INFO:tasks.workunit.client.0.smithi134.stdout:7/186: read - da/f36 zero size 2024-04-13T10:59:04.659 INFO:tasks.workunit.client.0.smithi134.stdout:5/357: chown dc/d1d/d2f/d3b/d3c 979038232 1 2024-04-13T10:59:04.661 INFO:tasks.workunit.client.0.smithi134.stdout:5/358: write dc/d1d/d46/f4c [1533761,126001] 0 2024-04-13T10:59:04.667 INFO:tasks.workunit.client.0.smithi134.stdout:8/192: truncate f0 2961663 0 2024-04-13T10:59:04.671 INFO:tasks.workunit.client.0.smithi134.stdout:3/235: mkdir dc/d27/d19/d48/d49 0 2024-04-13T10:59:04.672 INFO:tasks.workunit.client.0.smithi134.stdout:7/187: creat da/d15/d26/d27/d3d/f45 x:0 0 0 2024-04-13T10:59:04.672 INFO:tasks.workunit.client.0.smithi134.stdout:8/193: mknod d8/c42 0 2024-04-13T10:59:04.676 INFO:tasks.workunit.client.0.smithi134.stdout:8/194: fdatasync d8/dc/d37/f3b 0 2024-04-13T10:59:04.678 INFO:tasks.workunit.client.0.smithi134.stdout:7/188: mkdir da/d15/d26/d27/d3d/d46 0 2024-04-13T10:59:04.680 INFO:tasks.workunit.client.0.smithi134.stdout:3/236: dwrite dc/d27/d19/f3b [0,4194304] 0 2024-04-13T10:59:04.682 INFO:tasks.workunit.client.0.smithi134.stdout:7/189: truncate da/d15/d26/d27/d3d/f45 314102 0 2024-04-13T10:59:04.684 INFO:tasks.workunit.client.0.smithi134.stdout:8/195: readlink d8/dc/d16/l1f 0 2024-04-13T10:59:04.688 INFO:tasks.workunit.client.0.smithi134.stdout:5/359: dread fb [0,4194304] 0 2024-04-13T10:59:04.690 INFO:tasks.workunit.client.0.smithi134.stdout:5/360: fdatasync dc/d1d/d20/d23/f26 0 2024-04-13T10:59:04.691 INFO:tasks.workunit.client.0.smithi134.stdout:5/361: fsync dc/d1d/d2f/d3b/d6a/f6b 0 2024-04-13T10:59:04.692 INFO:tasks.workunit.client.0.smithi134.stdout:5/362: readlink dc/d39/l72 0 2024-04-13T10:59:04.693 INFO:tasks.workunit.client.0.smithi134.stdout:8/196: mknod d8/dc/d16/c43 0 2024-04-13T10:59:04.693 INFO:tasks.workunit.client.0.smithi134.stdout:8/197: chown d8/dc/d37/f3c 240939 1 2024-04-13T10:59:04.695 INFO:tasks.workunit.client.0.smithi134.stdout:3/237: link dc/d27/c45 dc/d27/d19/d23/c4a 0 2024-04-13T10:59:04.696 INFO:tasks.workunit.client.0.smithi134.stdout:5/363: creat dc/d1d/d46/f74 x:0 0 0 2024-04-13T10:59:04.700 INFO:tasks.workunit.client.0.smithi134.stdout:3/238: mkdir dc/d27/d19/d4b 0 2024-04-13T10:59:04.703 INFO:tasks.workunit.client.0.smithi134.stdout:5/364: creat dc/f75 x:0 0 0 2024-04-13T10:59:04.704 INFO:tasks.workunit.client.0.smithi134.stdout:8/198: rename d8/dc/d16/f38 to d8/f44 0 2024-04-13T10:59:04.705 INFO:tasks.workunit.client.0.smithi134.stdout:7/190: dwrite da/f12 [0,4194304] 0 2024-04-13T10:59:04.712 INFO:tasks.workunit.client.0.smithi134.stdout:8/199: fdatasync f0 0 2024-04-13T10:59:04.713 INFO:tasks.workunit.client.0.smithi134.stdout:7/191: mkdir da/d15/d26/d27/d47 0 2024-04-13T10:59:04.715 INFO:tasks.workunit.client.0.smithi134.stdout:5/365: dwrite dc/d1d/d20/f2d [0,4194304] 0 2024-04-13T10:59:04.715 INFO:tasks.workunit.client.0.smithi134.stdout:8/200: write d8/dc/d13/f1e [4780726,86831] 0 2024-04-13T10:59:04.715 INFO:tasks.workunit.client.0.smithi134.stdout:7/192: stat da/d15/d26/d27/d3d/d46 0 2024-04-13T10:59:04.717 INFO:tasks.workunit.client.0.smithi134.stdout:7/193: write f4 [943376,30316] 0 2024-04-13T10:59:04.721 INFO:tasks.workunit.client.0.smithi134.stdout:7/194: chown da/d15/d26 5006378 1 2024-04-13T10:59:04.721 INFO:tasks.workunit.client.0.smithi134.stdout:5/366: creat dc/d1d/f76 x:0 0 0 2024-04-13T10:59:04.722 INFO:tasks.workunit.client.0.smithi134.stdout:8/201: dread - d8/dc/d16/f2a zero size 2024-04-13T10:59:04.724 INFO:tasks.workunit.client.0.smithi134.stdout:7/195: write da/d15/f22 [577936,81135] 0 2024-04-13T10:59:04.724 INFO:tasks.workunit.client.0.smithi134.stdout:8/202: read d8/dc/f12 [3488866,65925] 0 2024-04-13T10:59:04.726 INFO:tasks.workunit.client.0.smithi134.stdout:8/203: chown d8/dc/f30 96127099 1 2024-04-13T10:59:04.726 INFO:tasks.workunit.client.0.smithi134.stdout:5/367: dread dc/d1d/d2b/d30/d3e/f71 [0,4194304] 0 2024-04-13T10:59:04.727 INFO:tasks.workunit.client.0.smithi134.stdout:5/368: stat dc/l11 0 2024-04-13T10:59:04.727 INFO:tasks.workunit.client.0.smithi134.stdout:8/204: fsync d8/dc/d16/f2a 0 2024-04-13T10:59:04.731 INFO:tasks.workunit.client.0.smithi134.stdout:5/369: creat dc/d1d/d2f/d3b/f77 x:0 0 0 2024-04-13T10:59:04.733 INFO:tasks.workunit.client.0.smithi134.stdout:7/196: mkdir da/d15/d26/d27/d47/d48 0 2024-04-13T10:59:04.734 INFO:tasks.workunit.client.0.smithi134.stdout:7/197: readlink da/d15/d26/l43 0 2024-04-13T10:59:04.735 INFO:tasks.workunit.client.0.smithi134.stdout:7/198: dread - da/f36 zero size 2024-04-13T10:59:04.736 INFO:tasks.workunit.client.0.smithi134.stdout:7/199: readlink da/l25 0 2024-04-13T10:59:04.737 INFO:tasks.workunit.client.0.smithi134.stdout:7/200: chown da/c40 78 1 2024-04-13T10:59:04.738 INFO:tasks.workunit.client.0.smithi134.stdout:5/370: dwrite f8 [0,4194304] 0 2024-04-13T10:59:04.739 INFO:tasks.workunit.client.0.smithi134.stdout:7/201: truncate da/d15/f3a 1557032 0 2024-04-13T10:59:04.740 INFO:tasks.workunit.client.0.smithi134.stdout:7/202: stat da/d15/d26/d27/d3d/f45 0 2024-04-13T10:59:04.741 INFO:tasks.workunit.client.0.smithi134.stdout:7/203: chown da/f12 756561709 1 2024-04-13T10:59:04.742 INFO:tasks.workunit.client.0.smithi134.stdout:7/204: read da/f12 [1407317,124289] 0 2024-04-13T10:59:04.745 INFO:tasks.workunit.client.0.smithi134.stdout:7/205: fsync da/f2a 0 2024-04-13T10:59:04.747 INFO:tasks.workunit.client.0.smithi134.stdout:7/206: truncate da/f36 923651 0 2024-04-13T10:59:04.750 INFO:tasks.workunit.client.0.smithi134.stdout:5/371: dwrite dc/f28 [4194304,4194304] 0 2024-04-13T10:59:04.751 INFO:tasks.workunit.client.0.smithi134.stdout:8/205: dwrite d8/ff [0,4194304] 0 2024-04-13T10:59:04.751 INFO:tasks.workunit.client.0.smithi134.stdout:5/372: stat dc/d1d/d2f/d3b 0 2024-04-13T10:59:04.754 INFO:tasks.workunit.client.0.smithi134.stdout:7/207: creat da/d15/d26/d27/d47/f49 x:0 0 0 2024-04-13T10:59:04.760 INFO:tasks.workunit.client.0.smithi134.stdout:8/206: creat d8/dc/f45 x:0 0 0 2024-04-13T10:59:04.760 INFO:tasks.workunit.client.0.smithi134.stdout:7/208: mkdir da/d15/d26/d4a 0 2024-04-13T10:59:04.761 INFO:tasks.workunit.client.0.smithi134.stdout:8/207: truncate d8/dc/f35 536936 0 2024-04-13T10:59:04.762 INFO:tasks.workunit.client.0.smithi134.stdout:5/373: link dc/c12 dc/d1d/d2f/d3b/d6a/c78 0 2024-04-13T10:59:04.763 INFO:tasks.workunit.client.0.smithi134.stdout:8/208: dread d8/dc/f35 [0,4194304] 0 2024-04-13T10:59:04.766 INFO:tasks.workunit.client.0.smithi134.stdout:8/209: write d8/dc/d16/f1c [1013711,63858] 0 2024-04-13T10:59:04.768 INFO:tasks.workunit.client.0.smithi134.stdout:5/374: symlink dc/d1d/d2f/d3b/d6a/l79 0 2024-04-13T10:59:04.769 INFO:tasks.workunit.client.0.smithi134.stdout:7/209: dwrite da/d15/f24 [0,4194304] 0 2024-04-13T10:59:04.775 INFO:tasks.workunit.client.0.smithi134.stdout:5/375: rename dc/d1d/d2f/d3b/f56 to dc/d1d/d2b/d30/f7a 0 2024-04-13T10:59:04.777 INFO:tasks.workunit.client.0.smithi134.stdout:8/210: creat d8/dc/f46 x:0 0 0 2024-04-13T10:59:04.780 INFO:tasks.workunit.client.0.smithi134.stdout:5/376: dwrite f1 [0,4194304] 0 2024-04-13T10:59:04.781 INFO:tasks.workunit.client.0.smithi134.stdout:7/210: unlink da/d15/d26/d27/l2b 0 2024-04-13T10:59:04.784 INFO:tasks.workunit.client.0.smithi134.stdout:5/377: truncate dc/d1d/d46/f47 5035664 0 2024-04-13T10:59:04.787 INFO:tasks.workunit.client.0.smithi134.stdout:5/378: truncate dc/d1d/d46/f74 119915 0 2024-04-13T10:59:04.788 INFO:tasks.workunit.client.0.smithi134.stdout:5/379: dread - dc/d1d/d2f/d3b/f77 zero size 2024-04-13T10:59:04.790 INFO:tasks.workunit.client.0.smithi134.stdout:7/211: dwrite f4 [0,4194304] 0 2024-04-13T10:59:04.790 INFO:tasks.workunit.client.0.smithi134.stdout:8/211: getdents d8 0 2024-04-13T10:59:04.791 INFO:tasks.workunit.client.0.smithi134.stdout:7/212: readlink da/d15/d26/l31 0 2024-04-13T10:59:04.792 INFO:tasks.workunit.client.0.smithi134.stdout:7/213: fdatasync da/d15/f19 0 2024-04-13T10:59:04.797 INFO:tasks.workunit.client.0.smithi134.stdout:8/212: rmdir d8/dc/d2c 39 2024-04-13T10:59:04.800 INFO:tasks.workunit.client.0.smithi134.stdout:7/214: creat da/d15/d26/d27/d3d/d46/f4b x:0 0 0 2024-04-13T10:59:04.801 INFO:tasks.workunit.client.0.smithi134.stdout:8/213: mknod d8/dc/c47 0 2024-04-13T10:59:04.802 INFO:tasks.workunit.client.0.smithi134.stdout:7/215: rmdir da/d15/d26 39 2024-04-13T10:59:04.853 INFO:tasks.workunit.client.0.smithi134.stdout:8/214: unlink d8/dc/d13/f14 0 2024-04-13T10:59:04.853 INFO:tasks.workunit.client.0.smithi134.stdout:9/289: sync 2024-04-13T10:59:04.856 INFO:tasks.workunit.client.0.smithi134.stdout:8/215: mkdir d8/d48 0 2024-04-13T10:59:04.857 INFO:tasks.workunit.client.0.smithi134.stdout:9/290: creat d13/d39/f5e x:0 0 0 2024-04-13T10:59:04.861 INFO:tasks.workunit.client.0.smithi134.stdout:7/216: mknod da/d15/d26/c4c 0 2024-04-13T10:59:04.864 INFO:tasks.workunit.client.0.smithi134.stdout:5/380: dwrite dc/f17 [0,4194304] 0 2024-04-13T10:59:04.871 INFO:tasks.workunit.client.0.smithi134.stdout:5/381: fdatasync dc/d1d/d20/d23/f55 0 2024-04-13T10:59:04.877 INFO:tasks.workunit.client.0.smithi134.stdout:8/216: readlink d8/dc/l11 0 2024-04-13T10:59:04.879 INFO:tasks.workunit.client.0.smithi134.stdout:5/382: creat dc/d1d/d67/d69/f7b x:0 0 0 2024-04-13T10:59:04.882 INFO:tasks.workunit.client.0.smithi134.stdout:7/217: truncate da/d15/f29 311694 0 2024-04-13T10:59:04.883 INFO:tasks.workunit.client.0.smithi134.stdout:5/383: mknod dc/d1d/d67/c7c 0 2024-04-13T10:59:04.883 INFO:tasks.workunit.client.0.smithi134.stdout:7/218: chown da/f36 138 1 2024-04-13T10:59:04.884 INFO:tasks.workunit.client.0.smithi134.stdout:8/217: symlink d8/dc/d2c/l49 0 2024-04-13T10:59:04.885 INFO:tasks.workunit.client.0.smithi134.stdout:8/218: readlink d8/dc/d13/l27 0 2024-04-13T10:59:04.887 INFO:tasks.workunit.client.0.smithi134.stdout:7/219: dread f4 [0,4194304] 0 2024-04-13T10:59:04.887 INFO:tasks.workunit.client.0.smithi134.stdout:5/384: mkdir dc/d1d/d20/d33/d7d 0 2024-04-13T10:59:04.891 INFO:tasks.workunit.client.0.smithi134.stdout:5/385: dread dc/d1d/d2f/d3b/f52 [0,4194304] 0 2024-04-13T10:59:04.898 INFO:tasks.workunit.client.0.smithi134.stdout:5/386: unlink dc/d39/l72 0 2024-04-13T10:59:04.904 INFO:tasks.workunit.client.0.smithi134.stdout:5/387: fdatasync dc/d1d/d20/d23/f42 0 2024-04-13T10:59:04.906 INFO:tasks.workunit.client.0.smithi134.stdout:7/220: creat da/d15/d26/f4d x:0 0 0 2024-04-13T10:59:04.914 INFO:tasks.workunit.client.0.smithi134.stdout:5/388: dwrite dc/d1d/d2f/d3b/f77 [0,4194304] 0 2024-04-13T10:59:04.914 INFO:tasks.workunit.client.0.smithi134.stdout:8/219: dwrite d8/f10 [0,4194304] 0 2024-04-13T10:59:04.914 INFO:tasks.workunit.client.0.smithi134.stdout:5/389: chown dc/d15/d65/f6d 8917214 1 2024-04-13T10:59:04.921 INFO:tasks.workunit.client.0.smithi134.stdout:5/390: dwrite dc/f10 [0,4194304] 0 2024-04-13T10:59:04.922 INFO:tasks.workunit.client.0.smithi134.stdout:5/391: chown dc/d1d/d20/f59 2859167 1 2024-04-13T10:59:04.924 INFO:tasks.workunit.client.0.smithi134.stdout:5/392: write dc/d1d/d20/d23/f26 [3676747,115246] 0 2024-04-13T10:59:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:04 smithi134 ceph-mon[39696]: pgmap v36: 65 pgs: 65 active+clean; 1.2 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 85 MiB/s wr, 223 op/s 2024-04-13T10:59:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:04 smithi194 ceph-mon[46737]: pgmap v36: 65 pgs: 65 active+clean; 1.2 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 85 MiB/s wr, 223 op/s 2024-04-13T10:59:05.005 INFO:tasks.workunit.client.0.smithi134.stdout:8/220: mknod d8/dc/d13/c4a 0 2024-04-13T10:59:05.005 INFO:tasks.workunit.client.0.smithi134.stdout:7/221: dwrite da/f12 [0,4194304] 0 2024-04-13T10:59:05.007 INFO:tasks.workunit.client.0.smithi134.stdout:5/393: mknod dc/d1d/d2f/d3b/d3c/c7e 0 2024-04-13T10:59:05.010 INFO:tasks.workunit.client.0.smithi134.stdout:5/394: fsync dc/d1d/d2f/d3b/f77 0 2024-04-13T10:59:05.014 INFO:tasks.workunit.client.0.smithi134.stdout:5/395: mkdir dc/d1d/d2f/d3b/d7f 0 2024-04-13T10:59:05.015 INFO:tasks.workunit.client.0.smithi134.stdout:8/221: dwrite d8/dc/d37/f3b [0,4194304] 0 2024-04-13T10:59:05.017 INFO:tasks.workunit.client.0.smithi134.stdout:5/396: read - dc/d1d/d20/d23/f32 zero size 2024-04-13T10:59:05.018 INFO:tasks.workunit.client.0.smithi134.stdout:5/397: dread - dc/d15/d65/f6c zero size 2024-04-13T10:59:05.018 INFO:tasks.workunit.client.0.smithi134.stdout:8/222: symlink d8/dc/d37/l4b 0 2024-04-13T10:59:05.019 INFO:tasks.workunit.client.0.smithi134.stdout:5/398: chown dc/d1d/d2f/d3b/d3c/c7e 34 1 2024-04-13T10:59:05.019 INFO:tasks.workunit.client.0.smithi134.stdout:8/223: stat d8/dc/d13/c4a 0 2024-04-13T10:59:05.022 INFO:tasks.workunit.client.0.smithi134.stdout:7/222: truncate da/f1d 6066861 0 2024-04-13T10:59:05.026 INFO:tasks.workunit.client.0.smithi134.stdout:7/223: write da/d15/d26/d27/d3d/f45 [395369,130465] 0 2024-04-13T10:59:05.026 INFO:tasks.workunit.client.0.smithi134.stdout:8/224: mknod d8/d48/c4c 0 2024-04-13T10:59:05.027 INFO:tasks.workunit.client.0.smithi134.stdout:5/399: dwrite dc/d1d/d2f/d3b/f77 [0,4194304] 0 2024-04-13T10:59:05.031 INFO:tasks.workunit.client.0.smithi134.stdout:7/224: mkdir da/d15/d26/d27/d4e 0 2024-04-13T10:59:05.036 INFO:tasks.workunit.client.0.smithi134.stdout:5/400: dwrite dc/d1d/d2f/d3b/f77 [0,4194304] 0 2024-04-13T10:59:05.037 INFO:tasks.workunit.client.0.smithi134.stdout:7/225: dread da/d15/d26/d27/d3d/f45 [0,4194304] 0 2024-04-13T10:59:05.037 INFO:tasks.workunit.client.0.smithi134.stdout:5/401: stat dc/d1d/d20/d33 0 2024-04-13T10:59:05.038 INFO:tasks.workunit.client.0.smithi134.stdout:7/226: write da/f33 [775539,72517] 0 2024-04-13T10:59:05.038 INFO:tasks.workunit.client.0.smithi134.stdout:5/402: chown dc/f28 2 1 2024-04-13T10:59:05.048 INFO:tasks.workunit.client.0.smithi134.stdout:8/225: truncate d8/dc/d13/f1e 3291661 0 2024-04-13T10:59:05.052 INFO:tasks.workunit.client.0.smithi134.stdout:7/227: dread da/d15/f1a [0,4194304] 0 2024-04-13T10:59:05.055 INFO:tasks.workunit.client.0.smithi134.stdout:5/403: creat dc/d1d/d20/d23/d36/f80 x:0 0 0 2024-04-13T10:59:05.058 INFO:tasks.workunit.client.0.smithi134.stdout:8/226: rmdir d8/dc/d37 39 2024-04-13T10:59:05.059 INFO:tasks.workunit.client.0.smithi134.stdout:7/228: mkdir da/d15/d26/d27/d4f 0 2024-04-13T10:59:05.061 INFO:tasks.workunit.client.0.smithi134.stdout:8/227: write d8/dc/f1a [4641442,130423] 0 2024-04-13T10:59:05.063 INFO:tasks.workunit.client.0.smithi134.stdout:8/228: dread d8/dc/d13/f36 [0,4194304] 0 2024-04-13T10:59:05.064 INFO:tasks.workunit.client.0.smithi134.stdout:5/404: link dc/l4f dc/d1d/d2b/l81 0 2024-04-13T10:59:05.067 INFO:tasks.workunit.client.0.smithi134.stdout:5/405: rmdir dc/d1d/d2f 39 2024-04-13T10:59:05.068 INFO:tasks.workunit.client.0.smithi134.stdout:8/229: mknod d8/dc/d16/c4d 0 2024-04-13T10:59:05.076 INFO:tasks.workunit.client.0.smithi134.stdout:8/230: dread d8/f2b [0,4194304] 0 2024-04-13T10:59:05.076 INFO:tasks.workunit.client.0.smithi134.stdout:8/231: stat d8 0 2024-04-13T10:59:05.077 INFO:tasks.workunit.client.0.smithi134.stdout:8/232: write d8/dc/f45 [707718,108624] 0 2024-04-13T10:59:05.081 INFO:tasks.workunit.client.0.smithi134.stdout:5/406: creat dc/f82 x:0 0 0 2024-04-13T10:59:05.085 INFO:tasks.workunit.client.0.smithi134.stdout:4/199: sync 2024-04-13T10:59:05.088 INFO:tasks.workunit.client.0.smithi134.stdout:4/200: truncate d4/da/f16 88878 0 2024-04-13T10:59:05.089 INFO:tasks.workunit.client.0.smithi134.stdout:5/407: dwrite dc/d15/f43 [0,4194304] 0 2024-04-13T10:59:05.090 INFO:tasks.workunit.client.0.smithi134.stdout:8/233: dwrite d8/dc/d37/f3b [0,4194304] 0 2024-04-13T10:59:05.090 INFO:tasks.workunit.client.0.smithi134.stdout:4/201: read - d4/d1b/d32/f3b zero size 2024-04-13T10:59:05.100 INFO:tasks.workunit.client.0.smithi134.stdout:5/408: creat dc/d1d/d2f/d3b/d6a/f83 x:0 0 0 2024-04-13T10:59:05.102 INFO:tasks.workunit.client.0.smithi134.stdout:5/409: write dc/d15/d65/f6d [353705,100451] 0 2024-04-13T10:59:05.105 INFO:tasks.workunit.client.0.smithi134.stdout:8/234: getdents d8/d48 0 2024-04-13T10:59:05.105 INFO:tasks.workunit.client.0.smithi134.stdout:5/410: write dc/f82 [117960,45685] 0 2024-04-13T10:59:05.107 INFO:tasks.workunit.client.0.smithi134.stdout:4/202: dwrite d4/dd/f39 [0,4194304] 0 2024-04-13T10:59:05.109 INFO:tasks.workunit.client.0.smithi134.stdout:8/235: rmdir d8/dc/d37 39 2024-04-13T10:59:05.115 INFO:tasks.workunit.client.0.smithi134.stdout:5/411: truncate dc/d1d/d2f/d3b/d3c/f5d 2153086 0 2024-04-13T10:59:05.118 INFO:tasks.workunit.client.0.smithi134.stdout:4/203: dwrite d4/da/f36 [0,4194304] 0 2024-04-13T10:59:05.119 INFO:tasks.workunit.client.0.smithi134.stdout:8/236: unlink d8/dc/d37/f3c 0 2024-04-13T10:59:05.122 INFO:tasks.workunit.client.0.smithi134.stdout:8/237: dread - d8/f44 zero size 2024-04-13T10:59:05.123 INFO:tasks.workunit.client.0.smithi134.stdout:5/412: truncate dc/d1d/d20/d23/d36/f73 150277 0 2024-04-13T10:59:05.124 INFO:tasks.workunit.client.0.smithi134.stdout:5/413: chown dc/d1d/d2b/d30/d3e/f4d 0 1 2024-04-13T10:59:05.124 INFO:tasks.workunit.client.0.smithi134.stdout:8/238: dread d8/dc/d2c/f39 [0,4194304] 0 2024-04-13T10:59:05.126 INFO:tasks.workunit.client.0.smithi134.stdout:5/414: mkdir dc/d15/d84 0 2024-04-13T10:59:05.127 INFO:tasks.workunit.client.0.smithi134.stdout:5/415: dread - dc/d1d/d67/d69/f7b zero size 2024-04-13T10:59:05.132 INFO:tasks.workunit.client.0.smithi134.stdout:5/416: creat dc/d1d/d2b/d30/d3e/f85 x:0 0 0 2024-04-13T10:59:05.137 INFO:tasks.workunit.client.0.smithi134.stdout:8/239: rmdir d8/dc/d37 39 2024-04-13T10:59:05.269 INFO:tasks.workunit.client.0.smithi134.stdout:4/204: write d4/d1f/d27/d2f/f40 [1458714,52843] 0 2024-04-13T10:59:05.272 INFO:tasks.workunit.client.0.smithi134.stdout:5/417: creat dc/d1d/d20/d23/f86 x:0 0 0 2024-04-13T10:59:05.272 INFO:tasks.workunit.client.0.smithi134.stdout:5/418: chown dc/d15/l18 5719763 1 2024-04-13T10:59:05.277 INFO:tasks.workunit.client.0.smithi134.stdout:5/419: dread dc/d1d/d2f/d3b/f77 [0,4194304] 0 2024-04-13T10:59:05.282 INFO:tasks.workunit.client.0.smithi134.stdout:5/420: link dc/d1d/d20/d23/f42 dc/d1d/d20/f87 0 2024-04-13T10:59:05.283 INFO:tasks.workunit.client.0.smithi134.stdout:8/240: truncate d8/dc/f35 947406 0 2024-04-13T10:59:05.284 INFO:tasks.workunit.client.0.smithi134.stdout:4/205: write d4/da/f19 [1070832,19995] 0 2024-04-13T10:59:05.286 INFO:tasks.workunit.client.0.smithi134.stdout:8/241: unlink d8/d48/c4c 0 2024-04-13T10:59:05.288 INFO:tasks.workunit.client.0.smithi134.stdout:5/421: getdents dc/d15/d84 0 2024-04-13T10:59:05.291 INFO:tasks.workunit.client.0.smithi134.stdout:4/206: rename d4/d1f/d27/d2f/f40 to d4/d1f/d27/d2f/f44 0 2024-04-13T10:59:05.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/242: mkdir d8/dc/d16/d4e 0 2024-04-13T10:59:05.298 INFO:tasks.workunit.client.0.smithi134.stdout:5/422: mknod dc/d1d/d20/d23/d5a/c88 0 2024-04-13T10:59:05.302 INFO:tasks.workunit.client.0.smithi134.stdout:5/423: symlink dc/d1d/d20/d23/d38/d3a/l89 0 2024-04-13T10:59:05.306 INFO:tasks.workunit.client.0.smithi134.stdout:8/243: creat d8/dc/f4f x:0 0 0 2024-04-13T10:59:05.307 INFO:tasks.workunit.client.0.smithi134.stdout:4/207: link d4/c5 d4/d1b/c45 0 2024-04-13T10:59:05.308 INFO:tasks.workunit.client.0.smithi134.stdout:8/244: chown d8/ce 7 1 2024-04-13T10:59:05.309 INFO:tasks.workunit.client.0.smithi134.stdout:5/424: symlink dc/l8a 0 2024-04-13T10:59:05.309 INFO:tasks.workunit.client.0.smithi134.stdout:4/208: readlink d4/dd/l11 0 2024-04-13T10:59:05.310 INFO:tasks.workunit.client.0.smithi134.stdout:5/425: readlink dc/d1d/d20/l31 0 2024-04-13T10:59:05.310 INFO:tasks.workunit.client.0.smithi134.stdout:5/426: chown dc/d1d/d67/c7c 233215069 1 2024-04-13T10:59:05.316 INFO:tasks.workunit.client.0.smithi134.stdout:4/209: rename d4/d1b/f1d to d4/d1b/f46 0 2024-04-13T10:59:05.317 INFO:tasks.workunit.client.0.smithi134.stdout:5/427: creat dc/d1d/d2f/d3b/d6a/f8b x:0 0 0 2024-04-13T10:59:05.319 INFO:tasks.workunit.client.0.smithi134.stdout:8/245: dread d8/dc/f29 [0,4194304] 0 2024-04-13T10:59:05.320 INFO:tasks.workunit.client.0.smithi134.stdout:4/210: symlink d4/d1f/d27/l47 0 2024-04-13T10:59:05.321 INFO:tasks.workunit.client.0.smithi134.stdout:5/428: creat dc/d1d/d20/d23/d36/f8c x:0 0 0 2024-04-13T10:59:05.321 INFO:tasks.workunit.client.0.smithi134.stdout:4/211: write d4/da/ff [1412128,76048] 0 2024-04-13T10:59:05.322 INFO:tasks.workunit.client.0.smithi134.stdout:5/429: chown dc/d1d/d20/d23/d38 20 1 2024-04-13T10:59:05.322 INFO:tasks.workunit.client.0.smithi134.stdout:8/246: mknod d8/dc/d2c/c50 0 2024-04-13T10:59:05.323 INFO:tasks.workunit.client.0.smithi134.stdout:4/212: write d4/da/f16 [238136,73568] 0 2024-04-13T10:59:05.327 INFO:tasks.workunit.client.0.smithi134.stdout:5/430: rename dc/d1d/d20/d33 to dc/d1d/d2f/d3b/d7f/d8d 0 2024-04-13T10:59:05.328 INFO:tasks.workunit.client.0.smithi134.stdout:5/431: chown dc/d1d/d2b/d30/f7a 0 1 2024-04-13T10:59:05.328 INFO:tasks.workunit.client.0.smithi134.stdout:8/247: truncate d8/dc/f12 2011771 0 2024-04-13T10:59:05.329 INFO:tasks.workunit.client.0.smithi134.stdout:5/432: read - dc/d1d/d20/d23/d5a/f6e zero size 2024-04-13T10:59:05.329 INFO:tasks.workunit.client.0.smithi134.stdout:8/248: dread - d8/dc/d16/f2a zero size 2024-04-13T10:59:05.329 INFO:tasks.workunit.client.0.smithi134.stdout:4/213: mkdir d4/d48 0 2024-04-13T10:59:05.332 INFO:tasks.workunit.client.0.smithi134.stdout:5/433: mknod dc/d1d/d2b/d30/c8e 0 2024-04-13T10:59:05.333 INFO:tasks.workunit.client.0.smithi134.stdout:4/214: write d4/d1f/d27/d2f/f44 [3318011,98431] 0 2024-04-13T10:59:05.335 INFO:tasks.workunit.client.0.smithi134.stdout:5/434: rmdir dc/d1d/d67 39 2024-04-13T10:59:05.337 INFO:tasks.workunit.client.0.smithi134.stdout:5/435: truncate dc/d1d/d2f/d3b/d6a/f6b 439371 0 2024-04-13T10:59:05.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/215: rmdir d4/d1f/d27/d2f/d38/d42 0 2024-04-13T10:59:05.343 INFO:tasks.workunit.client.0.smithi134.stdout:5/436: symlink dc/d39/d63/l8f 0 2024-04-13T10:59:05.344 INFO:tasks.workunit.client.0.smithi134.stdout:8/249: getdents d8/dc/d13 0 2024-04-13T10:59:05.346 INFO:tasks.workunit.client.0.smithi134.stdout:8/250: truncate d8/dc/f4f 796345 0 2024-04-13T10:59:05.350 INFO:tasks.workunit.client.0.smithi134.stdout:5/437: dwrite dc/d1d/d46/f47 [0,4194304] 0 2024-04-13T10:59:05.353 INFO:tasks.workunit.client.0.smithi134.stdout:8/251: dread d8/dc/d16/f1c [0,4194304] 0 2024-04-13T10:59:05.354 INFO:tasks.workunit.client.0.smithi134.stdout:2/266: sync 2024-04-13T10:59:05.354 INFO:tasks.workunit.client.0.smithi134.stdout:6/320: sync 2024-04-13T10:59:05.355 INFO:tasks.workunit.client.0.smithi134.stdout:2/267: write d5/d6/d21/f4d [4682536,7384] 0 2024-04-13T10:59:05.356 INFO:tasks.workunit.client.0.smithi134.stdout:6/321: fdatasync d4/f1b 0 2024-04-13T10:59:05.358 INFO:tasks.workunit.client.0.smithi134.stdout:8/252: symlink d8/dc/d16/l51 0 2024-04-13T10:59:05.365 INFO:tasks.workunit.client.0.smithi134.stdout:2/268: symlink d5/d6/l5a 0 2024-04-13T10:59:05.365 INFO:tasks.workunit.client.0.smithi134.stdout:6/322: fsync d4/da/d15/d1f/f4b 0 2024-04-13T10:59:05.366 INFO:tasks.workunit.client.0.smithi134.stdout:2/269: read d5/de/f48 [2266946,29393] 0 2024-04-13T10:59:05.368 INFO:tasks.workunit.client.0.smithi134.stdout:8/253: symlink d8/dc/d16/l52 0 2024-04-13T10:59:05.368 INFO:tasks.workunit.client.0.smithi134.stdout:8/254: dread - d8/dc/d13/f40 zero size 2024-04-13T10:59:05.371 INFO:tasks.workunit.client.0.smithi134.stdout:6/323: fsync d4/da/d15/d1f/d24/f3a 0 2024-04-13T10:59:05.377 INFO:tasks.workunit.client.0.smithi134.stdout:8/255: dwrite d8/dc/f46 [0,4194304] 0 2024-04-13T10:59:05.379 INFO:tasks.workunit.client.0.smithi134.stdout:2/270: link d5/de/d2e/d4e/d30/l32 d5/de/d2e/l5b 0 2024-04-13T10:59:05.391 INFO:tasks.workunit.client.0.smithi134.stdout:8/256: dwrite d8/dc/d37/f3b [0,4194304] 0 2024-04-13T10:59:05.397 INFO:tasks.workunit.client.0.smithi134.stdout:6/324: getdents d4/da/d15 0 2024-04-13T10:59:05.398 INFO:tasks.workunit.client.0.smithi134.stdout:8/257: fdatasync d8/ff 0 2024-04-13T10:59:05.398 INFO:tasks.workunit.client.0.smithi134.stdout:2/271: link d5/de/c11 d5/de/c5c 0 2024-04-13T10:59:05.401 INFO:tasks.workunit.client.0.smithi134.stdout:6/325: symlink d4/da/d15/d5f/l66 0 2024-04-13T10:59:05.406 INFO:tasks.workunit.client.0.smithi134.stdout:2/272: dread d5/de/d2e/d4e/d30/f42 [0,4194304] 0 2024-04-13T10:59:05.409 INFO:tasks.workunit.client.0.smithi134.stdout:2/273: creat d5/de/d50/f5d x:0 0 0 2024-04-13T10:59:05.410 INFO:tasks.workunit.client.0.smithi134.stdout:8/258: write d8/dc/d16/f17 [2229217,111704] 0 2024-04-13T10:59:05.410 INFO:tasks.workunit.client.0.smithi134.stdout:6/326: dwrite d4/f4d [0,4194304] 0 2024-04-13T10:59:05.416 INFO:tasks.workunit.client.0.smithi134.stdout:6/327: creat d4/da/d15/d1f/d24/d2b/f67 x:0 0 0 2024-04-13T10:59:05.418 INFO:tasks.workunit.client.0.smithi134.stdout:8/259: mknod d8/dc/d16/c53 0 2024-04-13T10:59:05.420 INFO:tasks.workunit.client.0.smithi134.stdout:2/274: dwrite d5/de/d2e/d4e/d30/f4f [0,4194304] 0 2024-04-13T10:59:05.425 INFO:tasks.workunit.client.0.smithi134.stdout:6/328: fdatasync d4/da/d15/d1f/d24/d2b/f2e 0 2024-04-13T10:59:05.425 INFO:tasks.workunit.client.0.smithi134.stdout:8/260: mkdir d8/dc/d16/d54 0 2024-04-13T10:59:05.427 INFO:tasks.workunit.client.0.smithi134.stdout:2/275: dread d5/de/d2e/d4e/d30/f42 [0,4194304] 0 2024-04-13T10:59:05.432 INFO:tasks.workunit.client.0.smithi134.stdout:8/261: dwrite d8/dc/f46 [0,4194304] 0 2024-04-13T10:59:05.433 INFO:tasks.workunit.client.0.smithi134.stdout:8/262: fsync d8/dc/d16/f17 0 2024-04-13T10:59:05.435 INFO:tasks.workunit.client.0.smithi134.stdout:2/276: creat d5/de/d50/f5e x:0 0 0 2024-04-13T10:59:05.436 INFO:tasks.workunit.client.0.smithi134.stdout:2/277: write d5/de/d50/f5d [723551,54421] 0 2024-04-13T10:59:05.438 INFO:tasks.workunit.client.0.smithi134.stdout:6/329: unlink d4/l4a 0 2024-04-13T10:59:05.445 INFO:tasks.workunit.client.0.smithi134.stdout:2/278: unlink d5/d6/df/c3b 0 2024-04-13T10:59:05.445 INFO:tasks.workunit.client.0.smithi134.stdout:8/263: link d8/dc/l11 d8/d48/l55 0 2024-04-13T10:59:05.448 INFO:tasks.workunit.client.0.smithi134.stdout:2/279: fsync d5/de/d2e/d4e/d30/f42 0 2024-04-13T10:59:05.449 INFO:tasks.workunit.client.0.smithi134.stdout:2/280: truncate d5/de/d50/f5e 436282 0 2024-04-13T10:59:05.450 INFO:tasks.workunit.client.0.smithi134.stdout:8/264: mkdir d8/d56 0 2024-04-13T10:59:05.450 INFO:tasks.workunit.client.0.smithi134.stdout:2/281: readlink d5/d6/l5a 0 2024-04-13T10:59:05.452 INFO:tasks.workunit.client.0.smithi134.stdout:8/265: chown d8/dc/f46 162 1 2024-04-13T10:59:05.455 INFO:tasks.workunit.client.0.smithi134.stdout:8/266: symlink d8/l57 0 2024-04-13T10:59:05.459 INFO:tasks.workunit.client.0.smithi134.stdout:8/267: mknod d8/c58 0 2024-04-13T10:59:05.459 INFO:tasks.workunit.client.0.smithi134.stdout:2/282: dwrite d5/d6/d21/f49 [0,4194304] 0 2024-04-13T10:59:05.465 INFO:tasks.workunit.client.0.smithi134.stdout:2/283: rmdir d5/de/d2e/d4e/d30/d58 39 2024-04-13T10:59:05.466 INFO:tasks.workunit.client.0.smithi134.stdout:6/330: dread d4/da/d15/d1f/f2a [0,4194304] 0 2024-04-13T10:59:05.484 INFO:tasks.workunit.client.0.smithi134.stdout:2/284: dread f1 [0,4194304] 0 2024-04-13T10:59:05.487 INFO:tasks.workunit.client.0.smithi134.stdout:2/285: unlink d5/d6/df/l1b 0 2024-04-13T10:59:05.489 INFO:tasks.workunit.client.0.smithi134.stdout:2/286: symlink d5/d6/d34/l5f 0 2024-04-13T10:59:05.492 INFO:tasks.workunit.client.0.smithi134.stdout:2/287: dread d5/de/f16 [0,4194304] 0 2024-04-13T10:59:05.621 INFO:tasks.workunit.client.0.smithi134.stdout:1/312: sync 2024-04-13T10:59:05.621 INFO:tasks.workunit.client.0.smithi134.stdout:0/225: sync 2024-04-13T10:59:05.622 INFO:tasks.workunit.client.0.smithi134.stdout:1/313: read - d3/d6/d6a/f6c zero size 2024-04-13T10:59:05.622 INFO:tasks.workunit.client.0.smithi134.stdout:1/314: readlink d3/d39/l52 0 2024-04-13T10:59:05.623 INFO:tasks.workunit.client.0.smithi134.stdout:1/315: chown d3/d6/c2f 44389 1 2024-04-13T10:59:05.623 INFO:tasks.workunit.client.0.smithi134.stdout:1/316: fsync d3/d30/f4b 0 2024-04-13T10:59:05.624 INFO:tasks.workunit.client.0.smithi134.stdout:1/317: chown d3/d6/c2f 1303 1 2024-04-13T10:59:05.624 INFO:tasks.workunit.client.0.smithi134.stdout:1/318: fsync d3/d6/fc 0 2024-04-13T10:59:05.626 INFO:tasks.workunit.client.0.smithi134.stdout:0/226: mkdir d4/d17/d23/d51/d56 0 2024-04-13T10:59:05.626 INFO:tasks.workunit.client.0.smithi134.stdout:0/227: chown d4/d17/da/fe 70572 1 2024-04-13T10:59:05.627 INFO:tasks.workunit.client.0.smithi134.stdout:0/228: chown d4/c9 961713 1 2024-04-13T10:59:05.628 INFO:tasks.workunit.client.0.smithi134.stdout:1/319: mkdir d3/d6/d20/d6d 0 2024-04-13T10:59:05.633 INFO:tasks.workunit.client.0.smithi134.stdout:0/229: creat d4/d17/da/d22/d37/d47/f57 x:0 0 0 2024-04-13T10:59:05.635 INFO:tasks.workunit.client.0.smithi134.stdout:1/320: dwrite d3/d6/d16/d1d/f26 [0,4194304] 0 2024-04-13T10:59:05.637 INFO:tasks.workunit.client.0.smithi134.stdout:0/230: creat d4/d17/d23/d51/f58 x:0 0 0 2024-04-13T10:59:05.638 INFO:tasks.workunit.client.0.smithi134.stdout:1/321: chown d3/f41 110388 1 2024-04-13T10:59:05.639 INFO:tasks.workunit.client.0.smithi134.stdout:1/322: dread - d3/d6/f55 zero size 2024-04-13T10:59:05.641 INFO:tasks.workunit.client.0.smithi134.stdout:0/231: mknod d4/d17/d23/d51/d56/c59 0 2024-04-13T10:59:05.642 INFO:tasks.workunit.client.0.smithi134.stdout:1/323: creat d3/d6/d6a/f6e x:0 0 0 2024-04-13T10:59:05.645 INFO:tasks.workunit.client.0.smithi134.stdout:0/232: chown d4/d17/d20/d29/c53 763799 1 2024-04-13T10:59:05.651 INFO:tasks.workunit.client.0.smithi134.stdout:1/324: truncate d3/d6/f15 4135562 0 2024-04-13T10:59:05.654 INFO:tasks.workunit.client.0.smithi134.stdout:0/233: dwrite d4/d17/d23/d51/f58 [0,4194304] 0 2024-04-13T10:59:05.659 INFO:tasks.workunit.client.0.smithi134.stdout:0/234: rmdir d4/d17/da/d22/d41 39 2024-04-13T10:59:05.664 INFO:tasks.workunit.client.0.smithi134.stdout:0/235: unlink d4/d17/d20/f3a 0 2024-04-13T10:59:05.665 INFO:tasks.workunit.client.0.smithi134.stdout:0/236: dread - d4/d17/da/f54 zero size 2024-04-13T10:59:05.668 INFO:tasks.workunit.client.0.smithi134.stdout:0/237: unlink d4/c21 0 2024-04-13T10:59:05.669 INFO:tasks.workunit.client.0.smithi134.stdout:0/238: dread - d4/d17/da/d22/d37/d47/f57 zero size 2024-04-13T10:59:05.671 INFO:tasks.workunit.client.0.smithi134.stdout:0/239: write d4/d17/d20/f3f [4378662,21526] 0 2024-04-13T10:59:05.682 INFO:tasks.workunit.client.0.smithi134.stdout:1/325: dread d3/d6/f15 [0,4194304] 0 2024-04-13T10:59:05.686 INFO:tasks.workunit.client.0.smithi134.stdout:0/240: dread d4/d17/d20/d29/d30/d3e/f50 [0,4194304] 0 2024-04-13T10:59:05.688 INFO:tasks.workunit.client.0.smithi134.stdout:0/241: creat d4/d17/d23/d51/d56/f5a x:0 0 0 2024-04-13T10:59:05.696 INFO:tasks.workunit.client.0.smithi134.stdout:0/242: dwrite d4/d17/da/d22/d37/d47/f57 [0,4194304] 0 2024-04-13T10:59:05.700 INFO:tasks.workunit.client.0.smithi134.stdout:0/243: stat d4/cf 0 2024-04-13T10:59:05.707 INFO:tasks.workunit.client.0.smithi134.stdout:0/244: dwrite d4/d17/da/d22/d41/f4b [0,4194304] 0 2024-04-13T10:59:05.711 INFO:tasks.workunit.client.0.smithi134.stdout:0/245: read d4/d17/da/f10 [3710803,16491] 0 2024-04-13T10:59:05.718 INFO:tasks.workunit.client.0.smithi134.stdout:0/246: creat d4/d17/d20/d29/f5b x:0 0 0 2024-04-13T10:59:05.730 INFO:tasks.workunit.client.0.smithi134.stdout:0/247: dwrite d4/d17/d23/f3b [4194304,4194304] 0 2024-04-13T10:59:05.732 INFO:tasks.workunit.client.0.smithi134.stdout:0/248: mkdir d4/d17/da/d22/d38/d5c 0 2024-04-13T10:59:05.732 INFO:tasks.workunit.client.0.smithi134.stdout:0/249: write d4/d17/d20/d29/d30/d3e/f50 [2874386,72943] 0 2024-04-13T10:59:05.754 INFO:tasks.workunit.client.0.smithi134.stdout:0/250: dread d4/d17/d20/f3f [0,4194304] 0 2024-04-13T10:59:05.759 INFO:tasks.workunit.client.0.smithi134.stdout:0/251: rename d4/d17/d23/d51/d56 to d4/d5d 0 2024-04-13T10:59:05.760 INFO:tasks.workunit.client.0.smithi134.stdout:0/252: fsync d4/d17/da/d22/d41/f4b 0 2024-04-13T10:59:05.764 INFO:tasks.workunit.client.0.smithi134.stdout:0/253: rename d4/f11 to d4/d17/da/d22/d37/d47/f5e 0 2024-04-13T10:59:05.767 INFO:tasks.workunit.client.0.smithi134.stdout:0/254: creat d4/d17/da/d22/d37/f5f x:0 0 0 2024-04-13T10:59:05.768 INFO:tasks.workunit.client.0.smithi134.stdout:0/255: write d4/d17/da/d22/d41/f4b [1548268,110699] 0 2024-04-13T10:59:05.769 INFO:tasks.workunit.client.0.smithi134.stdout:0/256: chown d4/d17/da/d22/d38/f44 162 1 2024-04-13T10:59:05.771 INFO:tasks.workunit.client.0.smithi134.stdout:0/257: symlink d4/d5d/l60 0 2024-04-13T10:59:05.773 INFO:tasks.workunit.client.0.smithi134.stdout:0/258: dread d4/d17/f4a [0,4194304] 0 2024-04-13T10:59:05.777 INFO:tasks.workunit.client.0.smithi134.stdout:9/291: sync 2024-04-13T10:59:05.777 INFO:tasks.workunit.client.0.smithi134.stdout:3/239: sync 2024-04-13T10:59:05.777 INFO:tasks.workunit.client.0.smithi134.stdout:3/240: chown dc/d27/d19/d48 10738867 1 2024-04-13T10:59:05.779 INFO:tasks.workunit.client.0.smithi134.stdout:9/292: mkdir d13/d39/d58/d5f 0 2024-04-13T10:59:05.781 INFO:tasks.workunit.client.0.smithi134.stdout:0/259: rmdir d4 39 2024-04-13T10:59:05.783 INFO:tasks.workunit.client.0.smithi134.stdout:9/293: fsync d13/f21 0 2024-04-13T10:59:05.784 INFO:tasks.workunit.client.0.smithi134.stdout:9/294: fsync d13/f23 0 2024-04-13T10:59:05.786 INFO:tasks.workunit.client.0.smithi134.stdout:3/241: rename dc/d1d/c22 to dc/d27/d1f/c4c 0 2024-04-13T10:59:05.817 INFO:tasks.workunit.client.0.smithi134.stdout:9/295: mkdir d13/d2e/d35/d50/d60 0 2024-04-13T10:59:05.820 INFO:tasks.workunit.client.0.smithi134.stdout:3/242: dwrite dc/f42 [0,4194304] 0 2024-04-13T10:59:05.822 INFO:tasks.workunit.client.0.smithi134.stdout:0/260: mkdir d4/d17/d23/d61 0 2024-04-13T10:59:05.823 INFO:tasks.workunit.client.0.smithi134.stdout:0/261: readlink d4/d17/da/l3d 0 2024-04-13T10:59:05.826 INFO:tasks.workunit.client.0.smithi134.stdout:3/243: dread dc/d27/d1f/f20 [0,4194304] 0 2024-04-13T10:59:05.827 INFO:tasks.workunit.client.0.smithi134.stdout:9/296: write d13/d39/f3b [1123898,9522] 0 2024-04-13T10:59:05.830 INFO:tasks.workunit.client.0.smithi134.stdout:9/297: chown d13/d39/f3b 7144 1 2024-04-13T10:59:05.832 INFO:tasks.workunit.client.0.smithi134.stdout:0/262: dwrite d4/d17/da/f1b [0,4194304] 0 2024-04-13T10:59:05.834 INFO:tasks.workunit.client.0.smithi134.stdout:3/244: rename dc/d27/d19/d23 to dc/d27/d4d 0 2024-04-13T10:59:05.835 INFO:tasks.workunit.client.0.smithi134.stdout:0/263: write d4/d17/d20/d29/d30/d3e/f50 [163828,105379] 0 2024-04-13T10:59:05.839 INFO:tasks.workunit.client.0.smithi134.stdout:3/245: mknod dc/d2a/d38/c4e 0 2024-04-13T10:59:05.843 INFO:tasks.workunit.client.0.smithi134.stdout:9/298: dwrite d13/d39/f4e [0,4194304] 0 2024-04-13T10:59:05.843 INFO:tasks.workunit.client.0.smithi134.stdout:0/264: rmdir d4/d17/da/d22/d38/d5c 0 2024-04-13T10:59:05.844 INFO:tasks.workunit.client.0.smithi134.stdout:0/265: chown d4/d17/d20/c52 2354 1 2024-04-13T10:59:05.849 INFO:tasks.workunit.client.0.smithi134.stdout:9/299: symlink d13/d40/l61 0 2024-04-13T10:59:05.850 INFO:tasks.workunit.client.0.smithi134.stdout:0/266: mkdir d4/d17/d23/d61/d62 0 2024-04-13T10:59:05.853 INFO:tasks.workunit.client.0.smithi134.stdout:0/267: fsync d4/d17/da/d22/d38/f44 0 2024-04-13T10:59:05.857 INFO:tasks.workunit.client.0.smithi134.stdout:9/300: dwrite d13/d40/f48 [0,4194304] 0 2024-04-13T10:59:05.861 INFO:tasks.workunit.client.0.smithi134.stdout:9/301: creat d13/d39/f62 x:0 0 0 2024-04-13T10:59:05.863 INFO:tasks.workunit.client.0.smithi134.stdout:0/268: dread d4/d17/da/d22/d37/d47/f57 [0,4194304] 0 2024-04-13T10:59:05.864 INFO:tasks.workunit.client.0.smithi134.stdout:0/269: fsync d4/d17/d23/f2f 0 2024-04-13T10:59:05.865 INFO:tasks.workunit.client.0.smithi134.stdout:9/302: creat d13/d39/d52/f63 x:0 0 0 2024-04-13T10:59:05.866 INFO:tasks.workunit.client.0.smithi134.stdout:9/303: write fd [832710,123567] 0 2024-04-13T10:59:05.870 INFO:tasks.workunit.client.0.smithi134.stdout:0/270: creat d4/d17/da/d22/d38/f63 x:0 0 0 2024-04-13T10:59:05.874 INFO:tasks.workunit.client.0.smithi134.stdout:0/271: mkdir d4/d17/d20/d29/d30/d64 0 2024-04-13T10:59:05.876 INFO:tasks.workunit.client.0.smithi134.stdout:9/304: dwrite d13/d2e/d35/f46 [0,4194304] 0 2024-04-13T10:59:05.877 INFO:tasks.workunit.client.0.smithi134.stdout:3/246: dread dc/d27/d1f/d25/f3c [0,4194304] 0 2024-04-13T10:59:05.877 INFO:tasks.workunit.client.0.smithi134.stdout:0/272: write d4/d17/da/d22/d37/f5f [513900,33894] 0 2024-04-13T10:59:05.879 INFO:tasks.workunit.client.0.smithi134.stdout:9/305: mkdir d13/d39/d64 0 2024-04-13T10:59:05.881 INFO:tasks.workunit.client.0.smithi134.stdout:9/306: chown d13/d39/f4d 2767 1 2024-04-13T10:59:05.885 INFO:tasks.workunit.client.0.smithi134.stdout:9/307: symlink d13/d2e/d35/d50/d60/l65 0 2024-04-13T10:59:05.895 INFO:tasks.workunit.client.0.smithi134.stdout:0/273: dwrite d4/d17/f4a [0,4194304] 0 2024-04-13T10:59:05.901 INFO:tasks.workunit.client.0.smithi134.stdout:0/274: link d4/d17/da/f15 d4/d17/da/d22/d37/f65 0 2024-04-13T10:59:05.901 INFO:tasks.workunit.client.0.smithi134.stdout:3/247: truncate dc/f17 3959968 0 2024-04-13T10:59:05.907 INFO:tasks.workunit.client.0.smithi134.stdout:0/275: unlink d4/d17/d20/d29/d30/d3e/c4c 0 2024-04-13T10:59:05.913 INFO:tasks.workunit.client.0.smithi134.stdout:0/276: dwrite d4/d17/da/f1b [0,4194304] 0 2024-04-13T10:59:05.919 INFO:tasks.workunit.client.0.smithi134.stdout:9/308: dread fc [0,4194304] 0 2024-04-13T10:59:05.919 INFO:tasks.workunit.client.0.smithi134.stdout:0/277: symlink d4/d17/d20/d29/d30/d3e/l66 0 2024-04-13T10:59:05.921 INFO:tasks.workunit.client.0.smithi134.stdout:9/309: fsync d13/d39/f4e 0 2024-04-13T10:59:05.921 INFO:tasks.workunit.client.0.smithi134.stdout:3/248: dwrite dc/fe [4194304,4194304] 0 2024-04-13T10:59:05.923 INFO:tasks.workunit.client.0.smithi134.stdout:9/310: read - d13/f51 zero size 2024-04-13T10:59:05.923 INFO:tasks.workunit.client.0.smithi134.stdout:3/249: chown dc/d1d/f28 8 1 2024-04-13T10:59:05.929 INFO:tasks.workunit.client.0.smithi134.stdout:0/278: rmdir d4/d17/da/d22/d38 39 2024-04-13T10:59:05.930 INFO:tasks.workunit.client.0.smithi134.stdout:3/250: mkdir dc/d27/d4d/d4f 0 2024-04-13T10:59:05.930 INFO:tasks.workunit.client.0.smithi134.stdout:0/279: stat d4/d17/da/d22/f31 0 2024-04-13T10:59:05.931 INFO:tasks.workunit.client.0.smithi134.stdout:9/311: dwrite fd [0,4194304] 0 2024-04-13T10:59:05.938 INFO:tasks.workunit.client.0.smithi134.stdout:3/251: rename dc/d27/d1f to dc/d27/d4d/d4f/d50 0 2024-04-13T10:59:05.942 INFO:tasks.workunit.client.0.smithi134.stdout:0/280: dwrite d4/d17/f4a [0,4194304] 0 2024-04-13T10:59:05.943 INFO:tasks.workunit.client.0.smithi134.stdout:9/312: creat d13/d39/d58/f66 x:0 0 0 2024-04-13T10:59:05.950 INFO:tasks.workunit.client.0.smithi134.stdout:0/281: creat d4/d17/da/d48/f67 x:0 0 0 2024-04-13T10:59:05.951 INFO:tasks.workunit.client.0.smithi134.stdout:0/282: chown d4/cf 257672893 1 2024-04-13T10:59:05.951 INFO:tasks.workunit.client.0.smithi134.stdout:9/313: symlink d13/d2e/d47/l67 0 2024-04-13T10:59:05.952 INFO:tasks.workunit.client.0.smithi134.stdout:0/283: stat d4/d17/da/d22 0 2024-04-13T10:59:05.952 INFO:tasks.workunit.client.0.smithi134.stdout:9/314: dread - d13/f3f zero size 2024-04-13T10:59:05.956 INFO:tasks.workunit.client.0.smithi134.stdout:9/315: rename d13/d2e/d35/f49 to d13/d2e/d35/f68 0 2024-04-13T10:59:05.957 INFO:tasks.workunit.client.0.smithi134.stdout:9/316: fdatasync d13/d40/f42 0 2024-04-13T10:59:05.958 INFO:tasks.workunit.client.0.smithi134.stdout:9/317: rename d13/d40 to d13/d40/d69 22 2024-04-13T10:59:05.961 INFO:tasks.workunit.client.0.smithi134.stdout:0/284: dread d4/d17/da/d22/d37/d47/f5e [0,4194304] 0 2024-04-13T10:59:05.965 INFO:tasks.workunit.client.0.smithi134.stdout:9/318: dwrite d13/d2e/d35/f4b [0,4194304] 0 2024-04-13T10:59:05.967 INFO:tasks.workunit.client.0.smithi134.stdout:0/285: mknod d4/d17/da/d22/c68 0 2024-04-13T10:59:05.971 INFO:tasks.workunit.client.0.smithi134.stdout:9/319: rename d13/f23 to d13/d2e/d35/f6a 0 2024-04-13T10:59:05.974 INFO:tasks.workunit.client.0.smithi134.stdout:9/320: mkdir d13/d39/d52/d6b 0 2024-04-13T10:59:05.975 INFO:tasks.workunit.client.0.smithi134.stdout:0/286: creat d4/d17/da/d22/d38/f69 x:0 0 0 2024-04-13T10:59:05.977 INFO:tasks.workunit.client.0.smithi134.stdout:0/287: mkdir d4/d17/d23/d51/d6a 0 2024-04-13T10:59:05.979 INFO:tasks.workunit.client.0.smithi134.stdout:0/288: unlink d4/d17/d20/c55 0 2024-04-13T10:59:05.981 INFO:tasks.workunit.client.0.smithi134.stdout:0/289: mkdir d4/d17/d23/d51/d6b 0 2024-04-13T10:59:05.982 INFO:tasks.workunit.client.0.smithi134.stdout:0/290: fsync d4/d17/da/d48/f67 0 2024-04-13T10:59:05.984 INFO:tasks.workunit.client.0.smithi134.stdout:0/291: write d4/d17/d20/d29/f5b [106507,66689] 0 2024-04-13T10:59:05.988 INFO:tasks.workunit.client.0.smithi134.stdout:0/292: rename d4/d17/da/fe to d4/d17/da/d48/f6c 0 2024-04-13T10:59:05.988 INFO:tasks.workunit.client.0.smithi134.stdout:0/293: stat d4/d17/da/l2e 0 2024-04-13T10:59:05.989 INFO:tasks.workunit.client.0.smithi134.stdout:0/294: dread - d4/d17/da/d22/d38/f69 zero size 2024-04-13T10:59:05.989 INFO:tasks.workunit.client.0.smithi134.stdout:0/295: chown d4/d5d/l60 1943834 1 2024-04-13T10:59:05.991 INFO:tasks.workunit.client.0.smithi134.stdout:0/296: write d4/d17/da/f10 [313323,123168] 0 2024-04-13T10:59:05.992 INFO:tasks.workunit.client.0.smithi134.stdout:9/321: dread d13/f21 [0,4194304] 0 2024-04-13T10:59:05.996 INFO:tasks.workunit.client.0.smithi134.stdout:0/297: rename d4/d17/d1a/d49 to d4/d17/da/d22/d37/d6d 0 2024-04-13T10:59:05.999 INFO:tasks.workunit.client.0.smithi134.stdout:0/298: truncate d4/d17/da/d22/d37/f40 449052 0 2024-04-13T10:59:06.000 INFO:tasks.workunit.client.0.smithi134.stdout:9/322: dwrite fc [4194304,4194304] 0 2024-04-13T10:59:06.001 INFO:tasks.workunit.client.0.smithi134.stdout:9/323: write d13/d40/f48 [4801164,34492] 0 2024-04-13T10:59:06.002 INFO:tasks.workunit.client.0.smithi134.stdout:0/299: dread d4/d17/da/d22/d37/f40 [0,4194304] 0 2024-04-13T10:59:06.004 INFO:tasks.workunit.client.0.smithi134.stdout:0/300: write d4/d17/da/f1b [2443310,113392] 0 2024-04-13T10:59:06.012 INFO:tasks.workunit.client.0.smithi134.stdout:0/301: dread d4/d17/d23/f3b [0,4194304] 0 2024-04-13T10:59:06.015 INFO:tasks.workunit.client.0.smithi134.stdout:0/302: dread d4/d17/da/d22/d37/f5f [0,4194304] 0 2024-04-13T10:59:06.018 INFO:tasks.workunit.client.0.smithi134.stdout:0/303: dread d4/d17/f4a [0,4194304] 0 2024-04-13T10:59:06.020 INFO:tasks.workunit.client.0.smithi134.stdout:0/304: mkdir d4/d17/da/d22/d41/d6e 0 2024-04-13T10:59:06.023 INFO:tasks.workunit.client.0.smithi134.stdout:0/305: creat d4/f6f x:0 0 0 2024-04-13T10:59:06.026 INFO:tasks.workunit.client.0.smithi134.stdout:0/306: rename d4/d17/da/d22/d38/f69 to d4/d17/d23/d61/d62/f70 0 2024-04-13T10:59:06.027 INFO:tasks.workunit.client.0.smithi134.stdout:0/307: dread d4/d17/da/d22/d37/f5f [0,4194304] 0 2024-04-13T10:59:06.029 INFO:tasks.workunit.client.0.smithi134.stdout:0/308: creat d4/d17/da/d22/d37/d47/f71 x:0 0 0 2024-04-13T10:59:06.031 INFO:tasks.workunit.client.0.smithi134.stdout:0/309: creat d4/d17/da/d22/d41/d6e/f72 x:0 0 0 2024-04-13T10:59:06.033 INFO:tasks.workunit.client.0.smithi134.stdout:0/310: mkdir d4/d17/d23/d51/d6a/d73 0 2024-04-13T10:59:06.035 INFO:tasks.workunit.client.0.smithi134.stdout:0/311: mknod d4/d17/da/d22/d41/c74 0 2024-04-13T10:59:06.037 INFO:tasks.workunit.client.0.smithi134.stdout:0/312: symlink d4/d17/d23/d61/l75 0 2024-04-13T10:59:06.039 INFO:tasks.workunit.client.0.smithi134.stdout:0/313: mknod d4/d17/da/d22/d41/c76 0 2024-04-13T10:59:06.040 INFO:tasks.workunit.client.0.smithi134.stdout:0/314: truncate d4/d17/d20/d29/f5b 460698 0 2024-04-13T10:59:06.053 INFO:tasks.workunit.client.0.smithi134.stdout:0/315: truncate d4/d17/da/f10 225239 0 2024-04-13T10:59:06.054 INFO:tasks.workunit.client.0.smithi134.stdout:0/316: symlink d4/d17/da/d22/d37/d47/l77 0 2024-04-13T10:59:06.056 INFO:tasks.workunit.client.0.smithi134.stdout:0/317: unlink d4/d17/d20/f33 0 2024-04-13T10:59:06.060 INFO:tasks.workunit.client.0.smithi134.stdout:0/318: getdents d4 0 2024-04-13T10:59:06.060 INFO:tasks.workunit.client.0.smithi134.stdout:0/319: stat d4 0 2024-04-13T10:59:06.061 INFO:tasks.workunit.client.0.smithi134.stdout:0/320: fsync d4/d17/d23/f2f 0 2024-04-13T10:59:06.061 INFO:tasks.workunit.client.0.smithi134.stdout:0/321: read - d4/d17/da/d48/f67 zero size 2024-04-13T10:59:06.067 INFO:tasks.workunit.client.0.smithi134.stdout:0/322: chown d4/d17/d20/d29/d30/d3e/c4e 2870164 1 2024-04-13T10:59:06.069 INFO:tasks.workunit.client.0.smithi134.stdout:0/323: mkdir d4/d17/d36/d78 0 2024-04-13T10:59:06.069 INFO:tasks.workunit.client.0.smithi134.stdout:0/324: chown d4/d17/d20/f3f 956741038 1 2024-04-13T10:59:06.070 INFO:tasks.workunit.client.0.smithi134.stdout:0/325: write d4/f6f [278767,13319] 0 2024-04-13T10:59:06.072 INFO:tasks.workunit.client.0.smithi134.stdout:0/326: write d4/d17/d23/d61/d62/f70 [810603,78676] 0 2024-04-13T10:59:06.073 INFO:tasks.workunit.client.0.smithi134.stdout:0/327: dread - d4/d17/da/d22/d38/f63 zero size 2024-04-13T10:59:06.075 INFO:tasks.workunit.client.0.smithi134.stdout:0/328: symlink d4/d17/d23/d51/d6a/d73/l79 0 2024-04-13T10:59:06.076 INFO:tasks.workunit.client.0.smithi134.stdout:0/329: dread - d4/d17/da/f54 zero size 2024-04-13T10:59:06.077 INFO:tasks.workunit.client.0.smithi134.stdout:0/330: creat d4/d17/d23/d51/d6a/d73/f7a x:0 0 0 2024-04-13T10:59:06.080 INFO:tasks.workunit.client.0.smithi134.stdout:0/331: creat d4/d17/d23/d51/d6b/f7b x:0 0 0 2024-04-13T10:59:06.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/332: mkdir d4/d17/d23/d61/d62/d7c 0 2024-04-13T10:59:06.084 INFO:tasks.workunit.client.0.smithi134.stdout:0/333: creat d4/d17/da/d22/d38/f7d x:0 0 0 2024-04-13T10:59:06.101 INFO:tasks.workunit.client.0.smithi134.stdout:7/229: sync 2024-04-13T10:59:06.101 INFO:tasks.workunit.client.0.smithi134.stdout:4/216: sync 2024-04-13T10:59:06.103 INFO:tasks.workunit.client.0.smithi134.stdout:7/230: truncate da/f11 1469628 0 2024-04-13T10:59:06.103 INFO:tasks.workunit.client.0.smithi134.stdout:7/231: dread - da/d15/d26/d27/d47/f49 zero size 2024-04-13T10:59:06.104 INFO:tasks.workunit.client.0.smithi134.stdout:7/232: stat da/d15/d26/d27/d47/f49 0 2024-04-13T10:59:06.229 INFO:tasks.workunit.client.0.smithi134.stdout:0/334: fsync d4/d17/d20/d29/d30/d3e/f50 0 2024-04-13T10:59:06.240 INFO:tasks.workunit.client.0.smithi134.stdout:0/335: symlink d4/d17/d23/d51/d6a/l7e 0 2024-04-13T10:59:06.241 INFO:tasks.workunit.client.0.smithi134.stdout:7/233: dwrite da/d15/f2e [4194304,4194304] 0 2024-04-13T10:59:06.246 INFO:tasks.workunit.client.0.smithi134.stdout:7/234: rmdir da/d15/d26/d27/d3d/d46 39 2024-04-13T10:59:06.252 INFO:tasks.workunit.client.0.smithi134.stdout:7/235: dread da/f12 [0,4194304] 0 2024-04-13T10:59:06.252 INFO:tasks.workunit.client.0.smithi134.stdout:4/217: getdents d4/da 0 2024-04-13T10:59:06.254 INFO:tasks.workunit.client.0.smithi134.stdout:7/236: write da/fb [4882519,40588] 0 2024-04-13T10:59:06.258 INFO:tasks.workunit.client.0.smithi134.stdout:5/438: sync 2024-04-13T10:59:06.258 INFO:tasks.workunit.client.0.smithi134.stdout:8/268: sync 2024-04-13T10:59:06.261 INFO:tasks.workunit.client.0.smithi134.stdout:4/218: dread d4/d1b/f35 [0,4194304] 0 2024-04-13T10:59:06.269 INFO:tasks.workunit.client.0.smithi134.stdout:4/219: creat d4/d1f/f49 x:0 0 0 2024-04-13T10:59:06.271 INFO:tasks.workunit.client.0.smithi134.stdout:4/220: read d4/f2a [1059796,103823] 0 2024-04-13T10:59:06.273 INFO:tasks.workunit.client.0.smithi134.stdout:8/269: creat d8/dc/d16/d54/f59 x:0 0 0 2024-04-13T10:59:06.278 INFO:tasks.workunit.client.0.smithi134.stdout:4/221: chown d4/dd/c1e 191757151 1 2024-04-13T10:59:06.279 INFO:tasks.workunit.client.0.smithi134.stdout:8/270: readlink d8/dc/d16/l24 0 2024-04-13T10:59:06.280 INFO:tasks.workunit.client.0.smithi134.stdout:4/222: fsync d4/d1b/f35 0 2024-04-13T10:59:06.280 INFO:tasks.workunit.client.0.smithi134.stdout:8/271: truncate d8/dc/d16/f2a 314774 0 2024-04-13T10:59:06.283 INFO:tasks.workunit.client.0.smithi134.stdout:4/223: unlink d4/dd/c33 0 2024-04-13T10:59:06.287 INFO:tasks.workunit.client.0.smithi134.stdout:4/224: mkdir d4/d48/d4a 0 2024-04-13T10:59:06.288 INFO:tasks.workunit.client.0.smithi134.stdout:8/272: dwrite d8/dc/d16/f2a [0,4194304] 0 2024-04-13T10:59:06.290 INFO:tasks.workunit.client.0.smithi134.stdout:4/225: mknod d4/d1b/d32/c4b 0 2024-04-13T10:59:06.293 INFO:tasks.workunit.client.0.smithi134.stdout:4/226: creat d4/d48/f4c x:0 0 0 2024-04-13T10:59:06.295 INFO:tasks.workunit.client.0.smithi134.stdout:8/273: symlink d8/dc/d16/d4e/l5a 0 2024-04-13T10:59:06.298 INFO:tasks.workunit.client.0.smithi134.stdout:4/227: dread d4/d1b/f1c [0,4194304] 0 2024-04-13T10:59:06.305 INFO:tasks.workunit.client.0.smithi134.stdout:8/274: creat d8/dc/d16/f5b x:0 0 0 2024-04-13T10:59:06.305 INFO:tasks.workunit.client.0.smithi134.stdout:4/228: creat d4/d1f/d27/d2f/d38/f4d x:0 0 0 2024-04-13T10:59:06.306 INFO:tasks.workunit.client.0.smithi134.stdout:8/275: creat d8/dc/d2c/f5c x:0 0 0 2024-04-13T10:59:06.308 INFO:tasks.workunit.client.0.smithi134.stdout:8/276: write d8/dc/d16/d54/f59 [528150,120785] 0 2024-04-13T10:59:06.310 INFO:tasks.workunit.client.0.smithi134.stdout:8/277: mkdir d8/dc/d13/d5d 0 2024-04-13T10:59:06.313 INFO:tasks.workunit.client.0.smithi134.stdout:8/278: unlink d8/dc/d13/l27 0 2024-04-13T10:59:06.314 INFO:tasks.workunit.client.0.smithi134.stdout:8/279: readlink d8/dc/d2c/l31 0 2024-04-13T10:59:06.316 INFO:tasks.workunit.client.0.smithi134.stdout:8/280: fdatasync d8/dc/d16/f1b 0 2024-04-13T10:59:06.322 INFO:tasks.workunit.client.0.smithi134.stdout:0/336: truncate d4/d17/d23/d51/f58 2402766 0 2024-04-13T10:59:06.328 INFO:tasks.workunit.client.0.smithi134.stdout:8/281: getdents d8/dc/d13/d5d 0 2024-04-13T10:59:06.330 INFO:tasks.workunit.client.0.smithi134.stdout:0/337: mkdir d4/d17/d20/d29/d30/d7f 0 2024-04-13T10:59:06.341 INFO:tasks.workunit.client.0.smithi134.stdout:7/237: rename da/d15/f19 to da/d15/d26/d27/d47/d48/f50 0 2024-04-13T10:59:06.341 INFO:tasks.workunit.client.0.smithi134.stdout:0/338: mknod d4/d17/d23/d61/d62/d7c/c80 0 2024-04-13T10:59:06.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/439: rename dc/d1d/d2b/d30/d3e/f85 to dc/d15/d50/f90 0 2024-04-13T10:59:06.346 INFO:tasks.workunit.client.0.smithi134.stdout:5/440: write dc/d15/d65/f6d [383594,22729] 0 2024-04-13T10:59:06.349 INFO:tasks.workunit.client.0.smithi134.stdout:7/238: read da/d15/f3a [706098,62219] 0 2024-04-13T10:59:06.350 INFO:tasks.workunit.client.0.smithi134.stdout:5/441: chown dc/c35 73 1 2024-04-13T10:59:06.352 INFO:tasks.workunit.client.0.smithi134.stdout:5/442: truncate dc/d1d/d2f/d3b/d6a/f83 260442 0 2024-04-13T10:59:06.352 INFO:tasks.workunit.client.0.smithi134.stdout:4/229: rename d4/da/f19 to d4/d1f/d27/d2f/d38/f4e 0 2024-04-13T10:59:06.356 INFO:tasks.workunit.client.0.smithi134.stdout:0/339: rename d4/d17/da/d22/d37/l3c to d4/d17/d23/d61/l81 0 2024-04-13T10:59:06.357 INFO:tasks.workunit.client.0.smithi134.stdout:0/340: write d4/d17/da/f54 [596803,16154] 0 2024-04-13T10:59:06.359 INFO:tasks.workunit.client.0.smithi134.stdout:4/230: symlink d4/d48/l4f 0 2024-04-13T10:59:06.363 INFO:tasks.workunit.client.0.smithi134.stdout:0/341: rename d4/d17/da/l2e to d4/d17/da/d22/d37/d47/l82 0 2024-04-13T10:59:06.364 INFO:tasks.workunit.client.0.smithi134.stdout:4/231: mkdir d4/d48/d50 0 2024-04-13T10:59:06.366 INFO:tasks.workunit.client.0.smithi134.stdout:0/342: creat d4/d17/d23/f83 x:0 0 0 2024-04-13T10:59:06.367 INFO:tasks.workunit.client.0.smithi134.stdout:4/232: symlink d4/d1f/d27/l51 0 2024-04-13T10:59:06.367 INFO:tasks.workunit.client.0.smithi134.stdout:4/233: write d4/d1b/f35 [1995427,105036] 0 2024-04-13T10:59:06.368 INFO:tasks.workunit.client.0.smithi134.stdout:0/343: mkdir d4/d17/d20/d29/d30/d64/d84 0 2024-04-13T10:59:06.381 INFO:tasks.workunit.client.0.smithi134.stdout:0/344: rename d4/d17/d23/d51/f58 to d4/d17/d23/d61/d62/f85 0 2024-04-13T10:59:06.385 INFO:tasks.workunit.client.0.smithi134.stdout:0/345: creat d4/d17/d20/d29/d30/d64/d84/f86 x:0 0 0 2024-04-13T10:59:06.387 INFO:tasks.workunit.client.0.smithi134.stdout:0/346: write d4/d17/d23/d51/d6a/d73/f7a [524623,98128] 0 2024-04-13T10:59:06.395 INFO:tasks.workunit.client.0.smithi134.stdout:0/347: dwrite d4/d17/da/d22/d37/f40 [0,4194304] 0 2024-04-13T10:59:06.410 INFO:tasks.workunit.client.0.smithi134.stdout:5/443: dwrite dc/d1d/d20/d23/f32 [0,4194304] 0 2024-04-13T10:59:06.410 INFO:tasks.workunit.client.0.smithi134.stdout:7/239: dwrite f5 [0,4194304] 0 2024-04-13T10:59:06.411 INFO:tasks.workunit.client.0.smithi134.stdout:5/444: dread - dc/d1d/d20/f62 zero size 2024-04-13T10:59:06.412 INFO:tasks.workunit.client.0.smithi134.stdout:4/234: dwrite d4/d1f/d27/d2f/f31 [0,4194304] 0 2024-04-13T10:59:06.415 INFO:tasks.workunit.client.0.smithi134.stdout:7/240: chown da/l41 94851 1 2024-04-13T10:59:06.424 INFO:tasks.workunit.client.0.smithi134.stdout:5/445: dwrite dc/d1d/d2f/d3b/f77 [0,4194304] 0 2024-04-13T10:59:06.424 INFO:tasks.workunit.client.0.smithi134.stdout:4/235: dread d4/da/f16 [0,4194304] 0 2024-04-13T10:59:06.428 INFO:tasks.workunit.client.0.smithi134.stdout:7/241: dread da/f33 [0,4194304] 0 2024-04-13T10:59:06.428 INFO:tasks.workunit.client.0.smithi134.stdout:4/236: creat d4/d1f/d27/d2f/f52 x:0 0 0 2024-04-13T10:59:06.462 INFO:tasks.workunit.client.0.smithi134.stdout:6/331: sync 2024-04-13T10:59:06.464 INFO:tasks.workunit.client.0.smithi134.stdout:5/446: mkdir dc/d1d/d2f/d3b/d7f/d8d/d7d/d91 0 2024-04-13T10:59:06.471 INFO:tasks.workunit.client.0.smithi134.stdout:6/332: mkdir d4/da/d68 0 2024-04-13T10:59:06.474 INFO:tasks.workunit.client.0.smithi134.stdout:5/447: symlink dc/d15/d84/l92 0 2024-04-13T10:59:06.475 INFO:tasks.workunit.client.0.smithi134.stdout:7/242: rename da/d15/c3e to da/d15/d26/d38/c51 0 2024-04-13T10:59:06.480 INFO:tasks.workunit.client.0.smithi134.stdout:6/333: dread - d4/da/d15/d1f/d3c/f59 zero size 2024-04-13T10:59:06.480 INFO:tasks.workunit.client.0.smithi134.stdout:5/448: dwrite dc/d15/d65/f6d [0,4194304] 0 2024-04-13T10:59:06.484 INFO:tasks.workunit.client.0.smithi134.stdout:4/237: getdents d4/d1f 0 2024-04-13T10:59:06.485 INFO:tasks.workunit.client.0.smithi134.stdout:7/243: creat da/d15/d26/d27/d47/f52 x:0 0 0 2024-04-13T10:59:06.489 INFO:tasks.workunit.client.0.smithi134.stdout:7/244: mknod da/d15/d26/d27/c53 0 2024-04-13T10:59:06.491 INFO:tasks.workunit.client.0.smithi134.stdout:7/245: fsync f4 0 2024-04-13T10:59:06.492 INFO:tasks.workunit.client.0.smithi134.stdout:6/334: truncate d4/da/d15/d1f/d3c/f5e 5281252 0 2024-04-13T10:59:06.493 INFO:tasks.workunit.client.0.smithi134.stdout:6/335: chown d4/da/c5c 15765 1 2024-04-13T10:59:06.494 INFO:tasks.workunit.client.0.smithi134.stdout:7/246: creat da/f54 x:0 0 0 2024-04-13T10:59:06.495 INFO:tasks.workunit.client.0.smithi134.stdout:7/247: dread - da/f54 zero size 2024-04-13T10:59:06.498 INFO:tasks.workunit.client.0.smithi134.stdout:7/248: rmdir da/d15/d26/d27/d47/d48 39 2024-04-13T10:59:06.498 INFO:tasks.workunit.client.0.smithi134.stdout:6/336: read d4/da/f14 [981671,28199] 0 2024-04-13T10:59:06.499 INFO:tasks.workunit.client.0.smithi134.stdout:6/337: dread - d4/da/d15/d1f/d3c/f59 zero size 2024-04-13T10:59:06.510 INFO:tasks.workunit.client.0.smithi134.stdout:5/449: dread dc/d1d/f1f [0,4194304] 0 2024-04-13T10:59:06.511 INFO:tasks.workunit.client.0.smithi134.stdout:6/338: truncate d4/da/d1a/f44 54941 0 2024-04-13T10:59:06.511 INFO:tasks.workunit.client.0.smithi134.stdout:5/450: write f8 [4009121,26187] 0 2024-04-13T10:59:06.511 INFO:tasks.workunit.client.0.smithi134.stdout:6/339: chown d4/f1b 266382107 1 2024-04-13T10:59:06.513 INFO:tasks.workunit.client.0.smithi134.stdout:6/340: write d4/da/d15/d1f/d24/f62 [345318,79403] 0 2024-04-13T10:59:06.515 INFO:tasks.workunit.client.0.smithi134.stdout:5/451: creat dc/d1d/d20/f93 x:0 0 0 2024-04-13T10:59:06.515 INFO:tasks.workunit.client.0.smithi134.stdout:5/452: chown f8 505816 1 2024-04-13T10:59:06.520 INFO:tasks.workunit.client.0.smithi134.stdout:5/453: creat dc/d15/f94 x:0 0 0 2024-04-13T10:59:06.521 INFO:tasks.workunit.client.0.smithi134.stdout:6/341: mkdir d4/da/d69 0 2024-04-13T10:59:06.522 INFO:tasks.workunit.client.0.smithi134.stdout:6/342: write d4/da/d15/d1f/d24/d2b/f40 [1811375,89135] 0 2024-04-13T10:59:06.527 INFO:tasks.workunit.client.0.smithi134.stdout:6/343: dread d4/da/d15/d1f/d24/d2b/f2e [0,4194304] 0 2024-04-13T10:59:06.532 INFO:tasks.workunit.client.0.smithi134.stdout:5/454: dread f8 [0,4194304] 0 2024-04-13T10:59:06.533 INFO:tasks.workunit.client.0.smithi134.stdout:6/344: rename d4/l20 to d4/da/d15/d1f/d24/l6a 0 2024-04-13T10:59:06.533 INFO:tasks.workunit.client.0.smithi134.stdout:5/455: write dc/f17 [5004174,14049] 0 2024-04-13T10:59:06.538 INFO:tasks.workunit.client.0.smithi134.stdout:5/456: rename dc/d1d/f76 to dc/d1d/d2f/d3b/d7f/d8d/d7d/f95 0 2024-04-13T10:59:06.540 INFO:tasks.workunit.client.0.smithi134.stdout:5/457: write dc/d1d/d20/f62 [748913,107393] 0 2024-04-13T10:59:06.546 INFO:tasks.workunit.client.0.smithi134.stdout:5/458: creat dc/f96 x:0 0 0 2024-04-13T10:59:06.546 INFO:tasks.workunit.client.0.smithi134.stdout:5/459: creat dc/d1d/d46/f97 x:0 0 0 2024-04-13T10:59:06.547 INFO:tasks.workunit.client.0.smithi134.stdout:5/460: creat dc/d1d/d2b/d30/d3e/f98 x:0 0 0 2024-04-13T10:59:06.547 INFO:tasks.workunit.client.0.smithi134.stdout:6/345: write d4/da/f11 [961595,112877] 0 2024-04-13T10:59:06.548 INFO:tasks.workunit.client.0.smithi134.stdout:5/461: stat dc/c35 0 2024-04-13T10:59:06.550 INFO:tasks.workunit.client.0.smithi134.stdout:5/462: mkdir dc/d39/d63/d99 0 2024-04-13T10:59:06.553 INFO:tasks.workunit.client.0.smithi134.stdout:5/463: creat dc/d1d/d20/f9a x:0 0 0 2024-04-13T10:59:06.555 INFO:tasks.workunit.client.0.smithi134.stdout:5/464: truncate dc/d1d/d2b/d30/d3e/f71 497572 0 2024-04-13T10:59:06.558 INFO:tasks.workunit.client.0.smithi134.stdout:5/465: mknod dc/d1d/d67/d69/c9b 0 2024-04-13T10:59:06.559 INFO:tasks.workunit.client.0.smithi134.stdout:5/466: stat dc/d1d/d67/d69/c9b 0 2024-04-13T10:59:06.561 INFO:tasks.workunit.client.0.smithi134.stdout:5/467: creat dc/d15/d84/f9c x:0 0 0 2024-04-13T10:59:06.562 INFO:tasks.workunit.client.0.smithi134.stdout:5/468: stat dc/d15/d84/l92 0 2024-04-13T10:59:06.562 INFO:tasks.workunit.client.0.smithi134.stdout:5/469: stat dc/d1d/d20/d23/d5a 0 2024-04-13T10:59:06.563 INFO:tasks.workunit.client.0.smithi134.stdout:6/346: truncate d4/f4d 3991129 0 2024-04-13T10:59:06.563 INFO:tasks.workunit.client.0.smithi134.stdout:5/470: fdatasync dc/d1d/d20/d23/d5a/f6e 0 2024-04-13T10:59:06.563 INFO:tasks.workunit.client.0.smithi134.stdout:5/471: readlink l4 0 2024-04-13T10:59:06.564 INFO:tasks.workunit.client.0.smithi134.stdout:5/472: read - dc/d1d/d2f/d3b/d6a/f8b zero size 2024-04-13T10:59:06.566 INFO:tasks.workunit.client.0.smithi134.stdout:5/473: mknod dc/d1d/d46/c9d 0 2024-04-13T10:59:06.569 INFO:tasks.workunit.client.0.smithi134.stdout:5/474: mknod dc/d1d/d20/d23/d5a/c9e 0 2024-04-13T10:59:06.572 INFO:tasks.workunit.client.0.smithi134.stdout:5/475: creat dc/d1d/d20/d23/d38/d3a/f9f x:0 0 0 2024-04-13T10:59:06.574 INFO:tasks.workunit.client.0.smithi134.stdout:5/476: symlink dc/d1d/d20/d23/d36/la0 0 2024-04-13T10:59:06.627 INFO:tasks.workunit.client.0.smithi134.stdout:5/477: write dc/d1d/d20/f87 [1346744,89470] 0 2024-04-13T10:59:06.631 INFO:tasks.workunit.client.0.smithi134.stdout:5/478: link fb dc/d15/d65/fa1 0 2024-04-13T10:59:06.632 INFO:tasks.workunit.client.0.smithi134.stdout:5/479: dread - dc/d39/f41 zero size 2024-04-13T10:59:06.639 INFO:tasks.workunit.client.0.smithi134.stdout:5/480: dwrite dc/d1d/d20/d23/f86 [0,4194304] 0 2024-04-13T10:59:06.646 INFO:tasks.workunit.client.0.smithi134.stdout:5/481: link dc/l11 dc/d15/d84/la2 0 2024-04-13T10:59:06.648 INFO:tasks.workunit.client.0.smithi134.stdout:5/482: truncate dc/d1d/d2b/d30/f7a 13105 0 2024-04-13T10:59:06.648 INFO:tasks.workunit.client.0.smithi134.stdout:5/483: fdatasync dc/f28 0 2024-04-13T10:59:06.651 INFO:tasks.workunit.client.0.smithi134.stdout:5/484: mknod dc/d1d/d20/d23/d36/ca3 0 2024-04-13T10:59:06.656 INFO:tasks.workunit.client.0.smithi134.stdout:5/485: rename dc/d1d/d2b/d30/d3e/f71 to dc/d1d/d2f/d3b/d3c/fa4 0 2024-04-13T10:59:06.661 INFO:tasks.workunit.client.0.smithi134.stdout:5/486: dwrite dc/d1d/d20/d23/f68 [0,4194304] 0 2024-04-13T10:59:06.669 INFO:tasks.workunit.client.0.smithi134.stdout:5/487: write dc/d1d/d2f/d3b/d3c/f5d [250207,111914] 0 2024-04-13T10:59:06.672 INFO:tasks.workunit.client.0.smithi134.stdout:5/488: fdatasync dc/f14 0 2024-04-13T10:59:06.679 INFO:tasks.workunit.client.0.smithi134.stdout:5/489: dwrite dc/d1d/d2f/d3b/f51 [0,4194304] 0 2024-04-13T10:59:06.680 INFO:tasks.workunit.client.0.smithi134.stdout:5/490: write dc/f96 [307798,105846] 0 2024-04-13T10:59:06.681 INFO:tasks.workunit.client.0.smithi134.stdout:5/491: write dc/d15/f43 [2247248,39380] 0 2024-04-13T10:59:06.683 INFO:tasks.workunit.client.0.smithi134.stdout:5/492: write f9 [2412992,14676] 0 2024-04-13T10:59:06.685 INFO:tasks.workunit.client.0.smithi134.stdout:5/493: mkdir dc/d39/d63/da5 0 2024-04-13T10:59:06.689 INFO:tasks.workunit.client.0.smithi134.stdout:5/494: rename dc/d15/d65/fa1 to dc/d1d/d67/fa6 0 2024-04-13T10:59:06.691 INFO:tasks.workunit.client.0.smithi134.stdout:5/495: symlink dc/d1d/d20/d23/d38/d3a/la7 0 2024-04-13T10:59:06.693 INFO:tasks.workunit.client.0.smithi134.stdout:5/496: symlink dc/d1d/d2b/la8 0 2024-04-13T10:59:06.694 INFO:tasks.workunit.client.0.smithi134.stdout:5/497: chown dc/d1d/d20/f59 31638 1 2024-04-13T10:59:06.695 INFO:tasks.workunit.client.0.smithi134.stdout:5/498: write f1 [9951920,75808] 0 2024-04-13T10:59:06.697 INFO:tasks.workunit.client.0.smithi134.stdout:5/499: symlink dc/d1d/d20/la9 0 2024-04-13T10:59:06.698 INFO:tasks.workunit.client.0.smithi134.stdout:5/500: rmdir dc/d1d/d2f/d3b/d7f 39 2024-04-13T10:59:06.700 INFO:tasks.workunit.client.0.smithi134.stdout:5/501: fdatasync dc/d1d/f1f 0 2024-04-13T10:59:06.704 INFO:tasks.workunit.client.0.smithi134.stdout:2/288: sync 2024-04-13T10:59:06.704 INFO:tasks.workunit.client.0.smithi134.stdout:5/502: truncate dc/d15/d65/f6c 1060709 0 2024-04-13T10:59:06.707 INFO:tasks.workunit.client.0.smithi134.stdout:2/289: creat d5/de/d50/f60 x:0 0 0 2024-04-13T10:59:06.708 INFO:tasks.workunit.client.0.smithi134.stdout:2/290: fsync d5/d6/d21/d29/f46 0 2024-04-13T10:59:06.710 INFO:tasks.workunit.client.0.smithi134.stdout:5/503: chown dc/d1d/d2f/d3b/d7f/d8d/l3d 1605566 1 2024-04-13T10:59:06.714 INFO:tasks.workunit.client.0.smithi134.stdout:5/504: rmdir dc/d39 39 2024-04-13T10:59:06.717 INFO:tasks.workunit.client.0.smithi134.stdout:2/291: dwrite d5/de/d2e/d4e/f44 [0,4194304] 0 2024-04-13T10:59:06.719 INFO:tasks.workunit.client.0.smithi134.stdout:5/505: mknod dc/d1d/d20/caa 0 2024-04-13T10:59:06.723 INFO:tasks.workunit.client.0.smithi134.stdout:2/292: unlink d5/de/f48 0 2024-04-13T10:59:06.727 INFO:tasks.workunit.client.0.smithi134.stdout:5/506: mkdir dc/d15/dab 0 2024-04-13T10:59:06.731 INFO:tasks.workunit.client.0.smithi134.stdout:5/507: symlink dc/d1d/d2f/d3b/d7f/lac 0 2024-04-13T10:59:06.733 INFO:tasks.workunit.client.0.smithi134.stdout:5/508: write dc/f1b [8584464,76555] 0 2024-04-13T10:59:06.733 INFO:tasks.workunit.client.0.smithi134.stdout:5/509: read dc/d1d/d46/f74 [31723,13015] 0 2024-04-13T10:59:06.735 INFO:tasks.workunit.client.0.smithi134.stdout:5/510: dread - dc/d1d/d20/f93 zero size 2024-04-13T10:59:06.740 INFO:tasks.workunit.client.0.smithi134.stdout:5/511: creat dc/d1d/d67/d69/fad x:0 0 0 2024-04-13T10:59:06.743 INFO:tasks.workunit.client.0.smithi134.stdout:2/293: link d5/fd d5/de/d2e/d4e/d30/d58/d59/f61 0 2024-04-13T10:59:06.746 INFO:tasks.workunit.client.0.smithi134.stdout:5/512: dwrite dc/d1d/d46/f47 [0,4194304] 0 2024-04-13T10:59:06.749 INFO:tasks.workunit.client.0.smithi134.stdout:2/294: symlink d5/d6/df/l62 0 2024-04-13T10:59:06.756 INFO:tasks.workunit.client.0.smithi134.stdout:5/513: dwrite dc/d1d/d46/f70 [0,4194304] 0 2024-04-13T10:59:06.763 INFO:tasks.workunit.client.0.smithi134.stdout:5/514: creat dc/d1d/d20/fae x:0 0 0 2024-04-13T10:59:06.768 INFO:tasks.workunit.client.0.smithi134.stdout:5/515: unlink l4 0 2024-04-13T10:59:06.775 INFO:tasks.workunit.client.0.smithi134.stdout:5/516: dwrite dc/d1d/d20/d23/f26 [0,4194304] 0 2024-04-13T10:59:06.779 INFO:tasks.workunit.client.0.smithi134.stdout:5/517: stat dc/d1d/d20/la9 0 2024-04-13T10:59:06.780 INFO:tasks.workunit.client.0.smithi134.stdout:5/518: stat dc/d1d/d67/d69/f7b 0 2024-04-13T10:59:06.782 INFO:tasks.workunit.client.0.smithi134.stdout:5/519: fdatasync fb 0 2024-04-13T10:59:06.783 INFO:tasks.workunit.client.0.smithi134.stdout:2/295: dwrite d5/d6/f9 [4194304,4194304] 0 2024-04-13T10:59:06.784 INFO:tasks.workunit.client.0.smithi134.stdout:5/520: chown dc/d1d/d20/d23/d38/d3a 18348145 1 2024-04-13T10:59:06.785 INFO:tasks.workunit.client.0.smithi134.stdout:2/296: readlink d5/de/d2e/l5b 0 2024-04-13T10:59:06.790 INFO:tasks.workunit.client.0.smithi134.stdout:5/521: creat dc/d1d/d2f/d3b/faf x:0 0 0 2024-04-13T10:59:06.790 INFO:tasks.workunit.client.0.smithi134.stdout:2/297: creat d5/de/d2e/d4e/d30/f63 x:0 0 0 2024-04-13T10:59:06.791 INFO:tasks.workunit.client.0.smithi134.stdout:2/298: chown d5/d6/d34 1008765 1 2024-04-13T10:59:06.793 INFO:tasks.workunit.client.0.smithi134.stdout:2/299: rmdir d5/d6/d21/d29 39 2024-04-13T10:59:06.795 INFO:tasks.workunit.client.0.smithi134.stdout:5/522: rename dc/d1d/d46/c9d to dc/cb0 0 2024-04-13T10:59:06.800 INFO:tasks.workunit.client.0.smithi134.stdout:5/523: dwrite dc/f1b [4194304,4194304] 0 2024-04-13T10:59:06.802 INFO:tasks.workunit.client.0.smithi134.stdout:5/524: mkdir dc/d1d/d67/db1 0 2024-04-13T10:59:06.803 INFO:tasks.workunit.client.0.smithi134.stdout:5/525: fsync dc/d15/d84/f9c 0 2024-04-13T10:59:06.806 INFO:tasks.workunit.client.0.smithi134.stdout:5/526: write f8 [1042761,127513] 0 2024-04-13T10:59:06.808 INFO:tasks.workunit.client.0.smithi134.stdout:5/527: dread - dc/d1d/d20/d23/d36/f8c zero size 2024-04-13T10:59:06.815 INFO:tasks.workunit.client.0.smithi134.stdout:5/528: dwrite dc/f82 [0,4194304] 0 2024-04-13T10:59:06.816 INFO:tasks.workunit.client.0.smithi134.stdout:2/300: dread d5/de/f10 [0,4194304] 0 2024-04-13T10:59:06.817 INFO:tasks.workunit.client.0.smithi134.stdout:5/529: dread - dc/d1d/d20/d23/d38/d3a/f9f zero size 2024-04-13T10:59:06.821 INFO:tasks.workunit.client.0.smithi134.stdout:2/301: read d5/de/d2e/d4e/d30/f42 [557300,68879] 0 2024-04-13T10:59:06.826 INFO:tasks.workunit.client.0.smithi134.stdout:2/302: creat d5/de/d2e/f64 x:0 0 0 2024-04-13T10:59:06.827 INFO:tasks.workunit.client.0.smithi134.stdout:5/530: creat dc/d39/d63/d99/fb2 x:0 0 0 2024-04-13T10:59:06.833 INFO:tasks.workunit.client.0.smithi134.stdout:2/303: dwrite d5/fd [4194304,4194304] 0 2024-04-13T10:59:06.840 INFO:tasks.workunit.client.0.smithi134.stdout:2/304: fdatasync d5/d6/d21/d29/f46 0 2024-04-13T10:59:06.842 INFO:tasks.workunit.client.0.smithi134.stdout:5/531: link dc/d15/d84/l92 dc/d1d/d20/d23/d5a/lb3 0 2024-04-13T10:59:06.844 INFO:tasks.workunit.client.0.smithi134.stdout:5/532: creat dc/d15/d50/fb4 x:0 0 0 2024-04-13T10:59:06.844 INFO:tasks.workunit.client.0.smithi134.stdout:2/305: dread d5/de/d2e/d4e/d30/f42 [0,4194304] 0 2024-04-13T10:59:06.846 INFO:tasks.workunit.client.0.smithi134.stdout:2/306: dread d5/d6/d21/d29/f46 [0,4194304] 0 2024-04-13T10:59:06.847 INFO:tasks.workunit.client.0.smithi134.stdout:2/307: chown d5/de/d50/f5e 57443867 1 2024-04-13T10:59:06.848 INFO:tasks.workunit.client.0.smithi134.stdout:5/533: dread dc/d1d/d20/f62 [0,4194304] 0 2024-04-13T10:59:06.849 INFO:tasks.workunit.client.0.smithi134.stdout:2/308: creat d5/de/f65 x:0 0 0 2024-04-13T10:59:06.850 INFO:tasks.workunit.client.0.smithi134.stdout:5/534: dread dc/d1d/d2f/d3b/d6a/f83 [0,4194304] 0 2024-04-13T10:59:06.851 INFO:tasks.workunit.client.0.smithi134.stdout:5/535: write dc/d1d/d2f/d3b/f51 [538094,127919] 0 2024-04-13T10:59:06.858 INFO:tasks.workunit.client.0.smithi134.stdout:5/536: mknod dc/d15/dab/cb5 0 2024-04-13T10:59:06.862 INFO:tasks.workunit.client.0.smithi134.stdout:2/309: getdents d5/d6 0 2024-04-13T10:59:06.863 INFO:tasks.workunit.client.0.smithi134.stdout:2/310: fsync d5/de/d2e/d4e/f4a 0 2024-04-13T10:59:06.869 INFO:tasks.workunit.client.0.smithi134.stdout:2/311: dwrite d5/de/f16 [0,4194304] 0 2024-04-13T10:59:06.874 INFO:tasks.workunit.client.0.smithi134.stdout:1/326: sync 2024-04-13T10:59:06.874 INFO:tasks.workunit.client.0.smithi134.stdout:0/348: sync 2024-04-13T10:59:06.874 INFO:tasks.workunit.client.0.smithi134.stdout:8/282: sync 2024-04-13T10:59:06.874 INFO:tasks.workunit.client.0.smithi134.stdout:9/324: sync 2024-04-13T10:59:06.874 INFO:tasks.workunit.client.0.smithi134.stdout:3/252: sync 2024-04-13T10:59:06.877 INFO:tasks.workunit.client.0.smithi134.stdout:5/537: dread dc/d1d/d46/f4c [0,4194304] 0 2024-04-13T10:59:06.878 INFO:tasks.workunit.client.0.smithi134.stdout:3/253: readlink dc/d1d/l30 0 2024-04-13T10:59:06.879 INFO:tasks.workunit.client.0.smithi134.stdout:2/312: dwrite d5/de/d2e/d4e/d30/f4f [0,4194304] 0 2024-04-13T10:59:06.879 INFO:tasks.workunit.client.0.smithi134.stdout:8/283: symlink d8/dc/d13/l5e 0 2024-04-13T10:59:06.881 INFO:tasks.workunit.client.0.smithi134.stdout:3/254: write dc/d27/d4d/d4f/d50/d25/f46 [3489684,120762] 0 2024-04-13T10:59:06.881 INFO:tasks.workunit.client.0.smithi134.stdout:2/313: write d5/de/d2e/f64 [692945,13313] 0 2024-04-13T10:59:06.882 INFO:tasks.workunit.client.0.smithi134.stdout:9/325: truncate f4 3248569 0 2024-04-13T10:59:06.885 INFO:tasks.workunit.client.0.smithi134.stdout:3/255: write dc/f24 [4386961,54968] 0 2024-04-13T10:59:06.893 INFO:tasks.workunit.client.0.smithi134.stdout:8/284: rename d8/dc/d16/l1f to d8/dc/d16/d4e/l5f 0 2024-04-13T10:59:06.894 INFO:tasks.workunit.client.0.smithi134.stdout:0/349: write d4/d17/da/d22/d37/f65 [4466794,84511] 0 2024-04-13T10:59:06.895 INFO:tasks.workunit.client.0.smithi134.stdout:5/538: write dc/d39/f41 [354628,36086] 0 2024-04-13T10:59:06.897 INFO:tasks.workunit.client.0.smithi134.stdout:5/539: fdatasync dc/d1d/d20/f2d 0 2024-04-13T10:59:06.897 INFO:tasks.workunit.client.0.smithi134.stdout:2/314: dwrite d5/d6/d21/f4d [4194304,4194304] 0 2024-04-13T10:59:06.898 INFO:tasks.workunit.client.0.smithi134.stdout:3/256: creat dc/d27/d4d/d4f/d50/d25/f51 x:0 0 0 2024-04-13T10:59:06.900 INFO:tasks.workunit.client.0.smithi134.stdout:9/326: link d13/d2e/d35/f6a d13/d40/f6c 0 2024-04-13T10:59:06.903 INFO:tasks.workunit.client.0.smithi134.stdout:8/285: unlink d8/dc/c3d 0 2024-04-13T10:59:06.905 INFO:tasks.workunit.client.0.smithi134.stdout:8/286: write d8/dc/f30 [826170,10059] 0 2024-04-13T10:59:06.907 INFO:tasks.workunit.client.0.smithi134.stdout:0/350: dwrite d4/d17/da/d22/d38/f44 [0,4194304] 0 2024-04-13T10:59:06.911 INFO:tasks.workunit.client.0.smithi134.stdout:8/287: dread - d8/dc/d37/f3a zero size 2024-04-13T10:59:06.911 INFO:tasks.workunit.client.0.smithi134.stdout:2/315: rename d5/de/f22 to d5/d6/d21/d29/f66 0 2024-04-13T10:59:06.920 INFO:tasks.workunit.client.0.smithi134.stdout:0/351: creat d4/d17/d20/d29/f87 x:0 0 0 2024-04-13T10:59:06.922 INFO:tasks.workunit.client.0.smithi134.stdout:8/288: chown d8/l9 395576149 1 2024-04-13T10:59:06.922 INFO:tasks.workunit.client.0.smithi134.stdout:9/327: dwrite d13/f21 [0,4194304] 0 2024-04-13T10:59:06.923 INFO:tasks.workunit.client.0.smithi134.stdout:3/257: creat dc/d27/f52 x:0 0 0 2024-04-13T10:59:06.925 INFO:tasks.workunit.client.0.smithi134.stdout:8/289: mknod d8/dc/d37/c60 0 2024-04-13T10:59:06.927 INFO:tasks.workunit.client.0.smithi134.stdout:0/352: rename d4/d17/da/d22/l43 to d4/d17/da/l88 0 2024-04-13T10:59:06.928 INFO:tasks.workunit.client.0.smithi134.stdout:2/316: creat d5/d6/d21/f67 x:0 0 0 2024-04-13T10:59:06.928 INFO:tasks.workunit.client.0.smithi134.stdout:0/353: chown d4/d17/d20/d29/f5b 8 1 2024-04-13T10:59:06.932 INFO:tasks.workunit.client.0.smithi134.stdout:9/328: write d13/f2d [434432,968] 0 2024-04-13T10:59:06.932 INFO:tasks.workunit.client.0.smithi134.stdout:3/258: creat dc/d27/d4d/d4f/d50/f53 x:0 0 0 2024-04-13T10:59:06.933 INFO:tasks.workunit.client.0.smithi134.stdout:9/329: dread - d13/f3f zero size 2024-04-13T10:59:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:06 smithi134 ceph-mon[39696]: pgmap v37: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 7.3 MiB/s rd, 63 MiB/s wr, 174 op/s 2024-04-13T10:59:06.935 INFO:tasks.workunit.client.0.smithi134.stdout:0/354: mknod d4/d17/d23/d61/d62/c89 0 2024-04-13T10:59:06.937 INFO:tasks.workunit.client.0.smithi134.stdout:0/355: fdatasync d4/d17/d23/d61/d62/f70 0 2024-04-13T10:59:06.940 INFO:tasks.workunit.client.0.smithi134.stdout:9/330: dread d13/d39/f3b [0,4194304] 0 2024-04-13T10:59:06.941 INFO:tasks.workunit.client.0.smithi134.stdout:3/259: mkdir dc/d27/d19/d48/d49/d54 0 2024-04-13T10:59:06.943 INFO:tasks.workunit.client.0.smithi134.stdout:2/317: dwrite d5/de/d12/f1d [8388608,4194304] 0 2024-04-13T10:59:06.944 INFO:tasks.workunit.client.0.smithi134.stdout:3/260: fsync dc/d27/d4d/d4f/d50/f2d 0 2024-04-13T10:59:06.945 INFO:tasks.workunit.client.0.smithi134.stdout:0/356: mkdir d4/d17/da/d22/d41/d6e/d8a 0 2024-04-13T10:59:06.947 INFO:tasks.workunit.client.0.smithi134.stdout:0/357: fdatasync d4/d17/d20/d29/f5b 0 2024-04-13T10:59:06.949 INFO:tasks.workunit.client.0.smithi134.stdout:9/331: dwrite d13/f21 [0,4194304] 0 2024-04-13T10:59:06.951 INFO:tasks.workunit.client.0.smithi134.stdout:0/358: read d4/d17/da/d22/d38/f44 [3204200,129718] 0 2024-04-13T10:59:06.951 INFO:tasks.workunit.client.0.smithi134.stdout:8/290: write d8/f2b [153278,38201] 0 2024-04-13T10:59:06.953 INFO:tasks.workunit.client.0.smithi134.stdout:8/291: write d8/dc/d16/f17 [532010,48906] 0 2024-04-13T10:59:06.957 INFO:tasks.workunit.client.0.smithi134.stdout:8/292: creat d8/d48/f61 x:0 0 0 2024-04-13T10:59:06.957 INFO:tasks.workunit.client.0.smithi134.stdout:8/293: chown d8/dc/d13/d5d 202 1 2024-04-13T10:59:06.959 INFO:tasks.workunit.client.0.smithi134.stdout:0/359: dread d4/d17/f4a [0,4194304] 0 2024-04-13T10:59:06.961 INFO:tasks.workunit.client.0.smithi134.stdout:8/294: rmdir d8/dc/d37 39 2024-04-13T10:59:06.962 INFO:tasks.workunit.client.0.smithi134.stdout:2/318: getdents d5/d6/d57 0 2024-04-13T10:59:06.964 INFO:tasks.workunit.client.0.smithi134.stdout:3/261: getdents dc/d27 0 2024-04-13T10:59:06.965 INFO:tasks.workunit.client.0.smithi134.stdout:0/360: mkdir d4/d17/d23/d61/d8b 0 2024-04-13T10:59:06.967 INFO:tasks.workunit.client.0.smithi134.stdout:9/332: getdents d13/d39/d58 0 2024-04-13T10:59:06.970 INFO:tasks.workunit.client.0.smithi134.stdout:8/295: write d8/dc/f29 [89394,59225] 0 2024-04-13T10:59:06.971 INFO:tasks.workunit.client.0.smithi134.stdout:9/333: fdatasync d13/d39/f62 0 2024-04-13T10:59:06.974 INFO:tasks.workunit.client.0.smithi134.stdout:9/334: fdatasync d13/d39/f5e 0 2024-04-13T10:59:06.974 INFO:tasks.workunit.client.0.smithi134.stdout:2/319: dwrite d5/de/d2e/d4e/f4a [0,4194304] 0 2024-04-13T10:59:06.978 INFO:tasks.workunit.client.0.smithi134.stdout:0/361: mkdir d4/d17/d23/d61/d8b/d8c 0 2024-04-13T10:59:06.978 INFO:tasks.workunit.client.0.smithi134.stdout:3/262: dwrite dc/f10 [4194304,4194304] 0 2024-04-13T10:59:06.984 INFO:tasks.workunit.client.0.smithi134.stdout:8/296: dread d8/f2b [0,4194304] 0 2024-04-13T10:59:06.986 INFO:tasks.workunit.client.0.smithi134.stdout:8/297: stat d8/dc/f45 0 2024-04-13T10:59:06.988 INFO:tasks.workunit.client.0.smithi134.stdout:9/335: symlink d13/d2e/d35/d50/l6d 0 2024-04-13T10:59:06.990 INFO:tasks.workunit.client.0.smithi134.stdout:0/362: dwrite d4/d5d/f5a [0,4194304] 0 2024-04-13T10:59:06.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:06 smithi194 ceph-mon[46737]: pgmap v37: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 7.3 MiB/s rd, 63 MiB/s wr, 174 op/s 2024-04-13T10:59:07.002 INFO:tasks.workunit.client.0.smithi134.stdout:8/298: dwrite d8/d48/f61 [0,4194304] 0 2024-04-13T10:59:07.008 INFO:tasks.workunit.client.0.smithi134.stdout:0/363: dwrite d4/d17/d23/f3b [0,4194304] 0 2024-04-13T10:59:07.008 INFO:tasks.workunit.client.0.smithi134.stdout:2/320: dread d5/d6/d21/f49 [0,4194304] 0 2024-04-13T10:59:07.010 INFO:tasks.workunit.client.0.smithi134.stdout:8/299: creat d8/dc/d16/d4e/f62 x:0 0 0 2024-04-13T10:59:07.011 INFO:tasks.workunit.client.0.smithi134.stdout:3/263: dwrite dc/d27/d4d/d4f/d50/f20 [0,4194304] 0 2024-04-13T10:59:07.018 INFO:tasks.workunit.client.0.smithi134.stdout:0/364: read d4/d17/f4a [3391988,47830] 0 2024-04-13T10:59:07.018 INFO:tasks.workunit.client.0.smithi134.stdout:9/336: truncate fc 153020 0 2024-04-13T10:59:07.019 INFO:tasks.workunit.client.0.smithi134.stdout:3/264: read - dc/d27/d4d/d4f/d50/f2b zero size 2024-04-13T10:59:07.020 INFO:tasks.workunit.client.0.smithi134.stdout:2/321: fsync d5/d6/f1e 0 2024-04-13T10:59:07.020 INFO:tasks.workunit.client.0.smithi134.stdout:8/300: creat d8/dc/d13/f63 x:0 0 0 2024-04-13T10:59:07.021 INFO:tasks.workunit.client.0.smithi134.stdout:0/365: write d4/d5d/f5a [3915082,13283] 0 2024-04-13T10:59:07.103 INFO:tasks.workunit.client.0.smithi134.stdout:9/337: dread d13/f28 [0,4194304] 0 2024-04-13T10:59:07.104 INFO:tasks.workunit.client.0.smithi134.stdout:7/249: sync 2024-04-13T10:59:07.104 INFO:tasks.workunit.client.0.smithi134.stdout:6/347: sync 2024-04-13T10:59:07.104 INFO:tasks.workunit.client.0.smithi134.stdout:4/238: sync 2024-04-13T10:59:07.105 INFO:tasks.workunit.client.0.smithi134.stdout:9/338: readlink d13/l31 0 2024-04-13T10:59:07.106 INFO:tasks.workunit.client.0.smithi134.stdout:4/239: stat d4/d1b/f1c 0 2024-04-13T10:59:07.107 INFO:tasks.workunit.client.0.smithi134.stdout:0/366: creat d4/d17/d20/d29/d30/d64/d84/f8d x:0 0 0 2024-04-13T10:59:07.111 INFO:tasks.workunit.client.0.smithi134.stdout:4/240: readlink d4/l18 0 2024-04-13T10:59:07.112 INFO:tasks.workunit.client.0.smithi134.stdout:0/367: chown d4/d17/c12 3136287 1 2024-04-13T10:59:07.112 INFO:tasks.workunit.client.0.smithi134.stdout:3/265: dwrite dc/f24 [0,4194304] 0 2024-04-13T10:59:07.112 INFO:tasks.workunit.client.0.smithi134.stdout:8/301: dwrite d8/dc/d13/f40 [0,4194304] 0 2024-04-13T10:59:07.113 INFO:tasks.workunit.client.0.smithi134.stdout:4/241: chown d4/d1f/d27/d3a 24330299 1 2024-04-13T10:59:07.117 INFO:tasks.workunit.client.0.smithi134.stdout:7/250: unlink da/d15/d26/d38/f39 0 2024-04-13T10:59:07.119 INFO:tasks.workunit.client.0.smithi134.stdout:9/339: mkdir d13/d39/d58/d5f/d6e 0 2024-04-13T10:59:07.126 INFO:tasks.workunit.client.0.smithi134.stdout:0/368: creat d4/d17/d20/d29/d30/d64/d84/f8e x:0 0 0 2024-04-13T10:59:07.127 INFO:tasks.workunit.client.0.smithi134.stdout:4/242: mkdir d4/d1f/d27/d3a/d53 0 2024-04-13T10:59:07.127 INFO:tasks.workunit.client.0.smithi134.stdout:3/266: dread dc/f10 [4194304,4194304] 0 2024-04-13T10:59:07.127 INFO:tasks.workunit.client.0.smithi134.stdout:9/340: unlink d13/d39/d52/f63 0 2024-04-13T10:59:07.128 INFO:tasks.workunit.client.0.smithi134.stdout:0/369: chown d4/d17/da/d22/d37 1697 1 2024-04-13T10:59:07.129 INFO:tasks.workunit.client.0.smithi134.stdout:8/302: creat d8/dc/d37/f64 x:0 0 0 2024-04-13T10:59:07.130 INFO:tasks.workunit.client.0.smithi134.stdout:0/370: readlink d4/d17/da/d22/d37/d47/l77 0 2024-04-13T10:59:07.131 INFO:tasks.workunit.client.0.smithi134.stdout:6/348: rename d4/f1b to d4/da/d15/d1f/f6b 0 2024-04-13T10:59:07.133 INFO:tasks.workunit.client.0.smithi134.stdout:9/341: unlink d13/d2e/l38 0 2024-04-13T10:59:07.137 INFO:tasks.workunit.client.0.smithi134.stdout:7/251: creat da/d15/d26/d27/d47/f55 x:0 0 0 2024-04-13T10:59:07.138 INFO:tasks.workunit.client.0.smithi134.stdout:6/349: fdatasync d4/da/f14 0 2024-04-13T10:59:07.139 INFO:tasks.workunit.client.0.smithi134.stdout:8/303: dread d8/d48/f61 [0,4194304] 0 2024-04-13T10:59:07.139 INFO:tasks.workunit.client.0.smithi134.stdout:3/267: dwrite dc/d27/d4d/d4f/d50/d25/f46 [0,4194304] 0 2024-04-13T10:59:07.140 INFO:tasks.workunit.client.0.smithi134.stdout:9/342: write f6 [2056129,112086] 0 2024-04-13T10:59:07.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/268: chown dc/d27/d4d/d4f/d50/d25/f3c 58636334 1 2024-04-13T10:59:07.144 INFO:tasks.workunit.client.0.smithi134.stdout:0/371: rename d4/d17/d23/f3b to d4/d17/d23/d61/d62/d7c/f8f 0 2024-04-13T10:59:07.144 INFO:tasks.workunit.client.0.smithi134.stdout:3/269: write dc/d1d/f33 [2974967,75644] 0 2024-04-13T10:59:07.146 INFO:tasks.workunit.client.0.smithi134.stdout:0/372: write d4/d17/d20/d29/d30/d64/d84/f8d [999290,41425] 0 2024-04-13T10:59:07.149 INFO:tasks.workunit.client.0.smithi134.stdout:4/243: getdents d4/d1b 0 2024-04-13T10:59:07.150 INFO:tasks.workunit.client.0.smithi134.stdout:0/373: write d4/d17/da/f54 [1273311,16944] 0 2024-04-13T10:59:07.151 INFO:tasks.workunit.client.0.smithi134.stdout:8/304: creat d8/dc/d16/d54/f65 x:0 0 0 2024-04-13T10:59:07.155 INFO:tasks.workunit.client.0.smithi134.stdout:9/343: mknod d13/d2e/d35/d50/d60/c6f 0 2024-04-13T10:59:07.157 INFO:tasks.workunit.client.0.smithi134.stdout:9/344: read d13/d2e/d35/f46 [3236086,8589] 0 2024-04-13T10:59:07.162 INFO:tasks.workunit.client.0.smithi134.stdout:6/350: truncate d4/da/d15/d1f/d3c/f5e 4294034 0 2024-04-13T10:59:07.163 INFO:tasks.workunit.client.0.smithi134.stdout:4/244: fsync d4/d1b/f46 0 2024-04-13T10:59:07.166 INFO:tasks.workunit.client.0.smithi134.stdout:8/305: mkdir d8/d48/d66 0 2024-04-13T10:59:07.170 INFO:tasks.workunit.client.0.smithi134.stdout:3/270: unlink dc/f17 0 2024-04-13T10:59:07.172 INFO:tasks.workunit.client.0.smithi134.stdout:3/271: fdatasync dc/d27/d19/f3b 0 2024-04-13T10:59:07.174 INFO:tasks.workunit.client.0.smithi134.stdout:4/245: mknod d4/d1f/d27/d2f/d38/c54 0 2024-04-13T10:59:07.175 INFO:tasks.workunit.client.0.smithi134.stdout:3/272: write dc/f24 [652271,68767] 0 2024-04-13T10:59:07.177 INFO:tasks.workunit.client.0.smithi134.stdout:9/345: dwrite d13/d39/f3b [0,4194304] 0 2024-04-13T10:59:07.181 INFO:tasks.workunit.client.0.smithi134.stdout:6/351: write d4/da/d15/f1e [414235,9914] 0 2024-04-13T10:59:07.181 INFO:tasks.workunit.client.0.smithi134.stdout:8/306: dread d8/dc/d2c/f39 [0,4194304] 0 2024-04-13T10:59:07.183 INFO:tasks.workunit.client.0.smithi134.stdout:8/307: readlink d8/dc/l28 0 2024-04-13T10:59:07.183 INFO:tasks.workunit.client.0.smithi134.stdout:8/308: stat d8/dc/f46 0 2024-04-13T10:59:07.189 INFO:tasks.workunit.client.0.smithi134.stdout:7/252: link da/d15/d26/d27/c53 da/d15/d26/d27/d3d/d46/c56 0 2024-04-13T10:59:07.196 INFO:tasks.workunit.client.0.smithi134.stdout:4/246: creat d4/d48/d4a/f55 x:0 0 0 2024-04-13T10:59:07.198 INFO:tasks.workunit.client.0.smithi134.stdout:9/346: symlink d13/d39/d64/l70 0 2024-04-13T10:59:07.201 INFO:tasks.workunit.client.0.smithi134.stdout:8/309: fdatasync d8/dc/f35 0 2024-04-13T10:59:07.202 INFO:tasks.workunit.client.0.smithi134.stdout:4/247: mkdir d4/d1f/d56 0 2024-04-13T10:59:07.204 INFO:tasks.workunit.client.0.smithi134.stdout:3/273: rename dc/f24 to dc/f55 0 2024-04-13T10:59:07.205 INFO:tasks.workunit.client.0.smithi134.stdout:3/274: readlink dc/l11 0 2024-04-13T10:59:07.206 INFO:tasks.workunit.client.0.smithi134.stdout:3/275: fsync dc/d27/d19/f3b 0 2024-04-13T10:59:07.208 INFO:tasks.workunit.client.0.smithi134.stdout:9/347: mkdir d13/d39/d52/d71 0 2024-04-13T10:59:07.208 INFO:tasks.workunit.client.0.smithi134.stdout:9/348: chown d13/d39/f5e 7 1 2024-04-13T10:59:07.210 INFO:tasks.workunit.client.0.smithi134.stdout:6/352: write d4/da/d1a/f44 [184478,29960] 0 2024-04-13T10:59:07.211 INFO:tasks.workunit.client.0.smithi134.stdout:4/248: mknod d4/d48/c57 0 2024-04-13T10:59:07.215 INFO:tasks.workunit.client.0.smithi134.stdout:4/249: dread d4/d1b/f46 [0,4194304] 0 2024-04-13T10:59:07.215 INFO:tasks.workunit.client.0.smithi134.stdout:3/276: rename dc/d27/d4d/d4f/d50/d25/f46 to dc/d2a/f56 0 2024-04-13T10:59:07.217 INFO:tasks.workunit.client.0.smithi134.stdout:4/250: write d4/da/f36 [2097076,120302] 0 2024-04-13T10:59:07.217 INFO:tasks.workunit.client.0.smithi134.stdout:8/310: mknod d8/c67 0 2024-04-13T10:59:07.219 INFO:tasks.workunit.client.0.smithi134.stdout:6/353: symlink d4/da/d15/d5f/l6c 0 2024-04-13T10:59:07.222 INFO:tasks.workunit.client.0.smithi134.stdout:9/349: rename d13/d2e/d35/d50/d59/c5b to d13/d2e/c72 0 2024-04-13T10:59:07.224 INFO:tasks.workunit.client.0.smithi134.stdout:4/251: dwrite d4/da/ff [0,4194304] 0 2024-04-13T10:59:07.226 INFO:tasks.workunit.client.0.smithi134.stdout:3/277: mknod dc/d27/d19/d48/c57 0 2024-04-13T10:59:07.237 INFO:tasks.workunit.client.0.smithi134.stdout:7/253: getdents da/d15/d26/d27/d47/d48 0 2024-04-13T10:59:07.238 INFO:tasks.workunit.client.0.smithi134.stdout:7/254: fdatasync f5 0 2024-04-13T10:59:07.239 INFO:tasks.workunit.client.0.smithi134.stdout:7/255: chown da/d15/d26/d27/d4e 16 1 2024-04-13T10:59:07.239 INFO:tasks.workunit.client.0.smithi134.stdout:9/350: dread d13/d39/f4e [0,4194304] 0 2024-04-13T10:59:07.244 INFO:tasks.workunit.client.0.smithi134.stdout:3/278: mkdir dc/d1d/d58 0 2024-04-13T10:59:07.246 INFO:tasks.workunit.client.0.smithi134.stdout:6/354: mknod d4/da/d15/d5f/d63/c6d 0 2024-04-13T10:59:07.249 INFO:tasks.workunit.client.0.smithi134.stdout:9/351: creat d13/d2e/d35/d50/d60/f73 x:0 0 0 2024-04-13T10:59:07.250 INFO:tasks.workunit.client.0.smithi134.stdout:4/252: mkdir d4/d1f/d27/d3a/d53/d58 0 2024-04-13T10:59:07.251 INFO:tasks.workunit.client.0.smithi134.stdout:3/279: symlink dc/d27/d19/d48/l59 0 2024-04-13T10:59:07.252 INFO:tasks.workunit.client.0.smithi134.stdout:8/311: rmdir d8/d48/d66 0 2024-04-13T10:59:07.255 INFO:tasks.workunit.client.0.smithi134.stdout:7/256: rename da/d15/l1f to da/d15/d26/d4a/l57 0 2024-04-13T10:59:07.256 INFO:tasks.workunit.client.0.smithi134.stdout:7/257: dread - da/d15/d26/d27/d47/f55 zero size 2024-04-13T10:59:07.257 INFO:tasks.workunit.client.0.smithi134.stdout:9/352: mkdir d13/d2e/d35/d50/d59/d74 0 2024-04-13T10:59:07.258 INFO:tasks.workunit.client.0.smithi134.stdout:4/253: symlink d4/d48/l59 0 2024-04-13T10:59:07.259 INFO:tasks.workunit.client.0.smithi134.stdout:3/280: fsync dc/f55 0 2024-04-13T10:59:07.260 INFO:tasks.workunit.client.0.smithi134.stdout:3/281: stat dc/d27/f52 0 2024-04-13T10:59:07.262 INFO:tasks.workunit.client.0.smithi134.stdout:7/258: creat da/d15/d26/d27/f58 x:0 0 0 2024-04-13T10:59:07.266 INFO:tasks.workunit.client.0.smithi134.stdout:3/282: mknod dc/d2a/d38/c5a 0 2024-04-13T10:59:07.269 INFO:tasks.workunit.client.0.smithi134.stdout:6/355: dread d4/f18 [0,4194304] 0 2024-04-13T10:59:07.270 INFO:tasks.workunit.client.0.smithi134.stdout:3/283: read - dc/d27/d4d/d4f/d50/f53 zero size 2024-04-13T10:59:07.270 INFO:tasks.workunit.client.0.smithi134.stdout:8/312: dwrite d8/f2b [0,4194304] 0 2024-04-13T10:59:07.276 INFO:tasks.workunit.client.0.smithi134.stdout:7/259: rmdir da/d15/d26/d27/d4e 0 2024-04-13T10:59:07.277 INFO:tasks.workunit.client.0.smithi134.stdout:9/353: link d13/d2e/c72 d13/d2e/d47/c75 0 2024-04-13T10:59:07.281 INFO:tasks.workunit.client.0.smithi134.stdout:4/254: dread d4/da/f36 [0,4194304] 0 2024-04-13T10:59:07.284 INFO:tasks.workunit.client.0.smithi134.stdout:7/260: truncate da/d15/f3a 2520118 0 2024-04-13T10:59:07.288 INFO:tasks.workunit.client.0.smithi134.stdout:6/356: dread d4/da/f41 [0,4194304] 0 2024-04-13T10:59:07.290 INFO:tasks.workunit.client.0.smithi134.stdout:4/255: dwrite d4/d1f/f23 [4194304,4194304] 0 2024-04-13T10:59:07.290 INFO:tasks.workunit.client.0.smithi134.stdout:4/256: readlink d4/d48/l4f 0 2024-04-13T10:59:07.295 INFO:tasks.workunit.client.0.smithi134.stdout:8/313: rename d8/d48 to d8/dc/d2c/d68 0 2024-04-13T10:59:07.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/314: dread - d8/dc/d2c/f5c zero size 2024-04-13T10:59:07.296 INFO:tasks.workunit.client.0.smithi134.stdout:6/357: rmdir d4/da/d15/d1f/d24 39 2024-04-13T10:59:07.298 INFO:tasks.workunit.client.0.smithi134.stdout:4/257: write d4/da/f36 [1912736,74175] 0 2024-04-13T10:59:07.299 INFO:tasks.workunit.client.0.smithi134.stdout:4/258: chown d4/d1b/l2b 370 1 2024-04-13T10:59:07.301 INFO:tasks.workunit.client.0.smithi134.stdout:9/354: creat d13/f76 x:0 0 0 2024-04-13T10:59:07.302 INFO:tasks.workunit.client.0.smithi134.stdout:3/284: getdents dc/d27/d4d 0 2024-04-13T10:59:07.307 INFO:tasks.workunit.client.0.smithi134.stdout:9/355: fdatasync d13/d40/f42 0 2024-04-13T10:59:07.307 INFO:tasks.workunit.client.0.smithi134.stdout:7/261: dread f4 [0,4194304] 0 2024-04-13T10:59:07.308 INFO:tasks.workunit.client.0.smithi134.stdout:6/358: stat d4/da/d15/d1f/d24/d2b/f51 0 2024-04-13T10:59:07.309 INFO:tasks.workunit.client.0.smithi134.stdout:6/359: chown d4/da/c5c 933830 1 2024-04-13T10:59:07.310 INFO:tasks.workunit.client.0.smithi134.stdout:9/356: fdatasync d13/d2e/d35/f68 0 2024-04-13T10:59:07.349 INFO:tasks.workunit.client.0.smithi134.stdout:1/327: sync 2024-04-13T10:59:07.350 INFO:tasks.workunit.client.0.smithi134.stdout:3/285: rename dc/d27/d19/l2f to dc/d27/d4d/l5b 0 2024-04-13T10:59:07.350 INFO:tasks.workunit.client.0.smithi134.stdout:7/262: creat da/d15/d26/d4a/f59 x:0 0 0 2024-04-13T10:59:07.352 INFO:tasks.workunit.client.0.smithi134.stdout:8/315: mkdir d8/dc/d13/d5d/d69 0 2024-04-13T10:59:07.353 INFO:tasks.workunit.client.0.smithi134.stdout:6/360: creat d4/da/d15/f6e x:0 0 0 2024-04-13T10:59:07.355 INFO:tasks.workunit.client.0.smithi134.stdout:4/259: link d4/d1f/d27/d2f/f44 d4/d48/f5a 0 2024-04-13T10:59:07.356 INFO:tasks.workunit.client.0.smithi134.stdout:9/357: mknod d13/d2e/d35/d50/d59/c77 0 2024-04-13T10:59:07.356 INFO:tasks.workunit.client.0.smithi134.stdout:9/358: chown la 17567 1 2024-04-13T10:59:07.360 INFO:tasks.workunit.client.0.smithi134.stdout:8/316: creat d8/dc/d2c/d68/f6a x:0 0 0 2024-04-13T10:59:07.430 INFO:tasks.workunit.client.0.smithi134.stdout:3/286: unlink dc/f1b 0 2024-04-13T10:59:07.430 INFO:tasks.workunit.client.0.smithi134.stdout:7/263: mkdir da/d15/d26/d27/d47/d5a 0 2024-04-13T10:59:07.431 INFO:tasks.workunit.client.0.smithi134.stdout:6/361: mknod d4/da/d15/d1f/d24/c6f 0 2024-04-13T10:59:07.431 INFO:tasks.workunit.client.0.smithi134.stdout:8/317: dread d8/dc/d2c/f39 [0,4194304] 0 2024-04-13T10:59:07.432 INFO:tasks.workunit.client.0.smithi134.stdout:3/287: chown dc/d27/f52 11126 1 2024-04-13T10:59:07.433 INFO:tasks.workunit.client.0.smithi134.stdout:7/264: read - da/d15/d26/d27/d47/f52 zero size 2024-04-13T10:59:07.433 INFO:tasks.workunit.client.0.smithi134.stdout:8/318: chown d8/dc/f1a 138 1 2024-04-13T10:59:07.435 INFO:tasks.workunit.client.0.smithi134.stdout:4/260: link d4/f2a d4/d1f/f5b 0 2024-04-13T10:59:07.436 INFO:tasks.workunit.client.0.smithi134.stdout:8/319: dread - d8/dc/d16/d4e/f62 zero size 2024-04-13T10:59:07.441 INFO:tasks.workunit.client.0.smithi134.stdout:9/359: write fc [76938,55572] 0 2024-04-13T10:59:07.442 INFO:tasks.workunit.client.0.smithi134.stdout:7/265: dread da/f1d [0,4194304] 0 2024-04-13T10:59:07.444 INFO:tasks.workunit.client.0.smithi134.stdout:8/320: dread d8/dc/d16/d54/f59 [0,4194304] 0 2024-04-13T10:59:07.446 INFO:tasks.workunit.client.0.smithi134.stdout:6/362: dread d4/da/f25 [0,4194304] 0 2024-04-13T10:59:07.447 INFO:tasks.workunit.client.0.smithi134.stdout:3/288: dwrite dc/d27/d4d/d4f/d50/d25/f3c [0,4194304] 0 2024-04-13T10:59:07.450 INFO:tasks.workunit.client.0.smithi134.stdout:4/261: write d4/d48/f5a [7943755,9062] 0 2024-04-13T10:59:07.451 INFO:tasks.workunit.client.0.smithi134.stdout:8/321: read d8/f10 [330883,35432] 0 2024-04-13T10:59:07.453 INFO:tasks.workunit.client.0.smithi134.stdout:3/289: creat dc/d27/d19/f5c x:0 0 0 2024-04-13T10:59:07.453 INFO:tasks.workunit.client.0.smithi134.stdout:7/266: dread da/f2a [0,4194304] 0 2024-04-13T10:59:07.455 INFO:tasks.workunit.client.0.smithi134.stdout:6/363: symlink d4/da/d15/d1f/d24/d49/l70 0 2024-04-13T10:59:07.457 INFO:tasks.workunit.client.0.smithi134.stdout:4/262: creat d4/d1f/d27/d2e/f5c x:0 0 0 2024-04-13T10:59:07.459 INFO:tasks.workunit.client.0.smithi134.stdout:9/360: creat d13/d39/d52/d71/f78 x:0 0 0 2024-04-13T10:59:07.459 INFO:tasks.workunit.client.0.smithi134.stdout:7/267: truncate da/d15/d26/d27/f2d 1017524 0 2024-04-13T10:59:07.459 INFO:tasks.workunit.client.0.smithi134.stdout:6/364: dread - d4/da/d15/d1f/d24/d49/f50 zero size 2024-04-13T10:59:07.460 INFO:tasks.workunit.client.0.smithi134.stdout:4/263: fsync d4/da/f36 0 2024-04-13T10:59:07.463 INFO:tasks.workunit.client.0.smithi134.stdout:6/365: write d4/da/d15/f6e [4786,111920] 0 2024-04-13T10:59:07.465 INFO:tasks.workunit.client.0.smithi134.stdout:4/264: chown d4/c34 106371591 1 2024-04-13T10:59:07.467 INFO:tasks.workunit.client.0.smithi134.stdout:3/290: dwrite dc/d27/d4d/d4f/d50/d25/f47 [0,4194304] 0 2024-04-13T10:59:07.468 INFO:tasks.workunit.client.0.smithi134.stdout:7/268: symlink da/d15/d26/l5b 0 2024-04-13T10:59:07.468 INFO:tasks.workunit.client.0.smithi134.stdout:4/265: stat d4/d1f/c3c 0 2024-04-13T10:59:07.475 INFO:tasks.workunit.client.0.smithi134.stdout:8/322: rmdir d8/d56 0 2024-04-13T10:59:07.475 INFO:tasks.workunit.client.0.smithi134.stdout:9/361: mknod d13/d39/d58/d5f/d6e/c79 0 2024-04-13T10:59:07.475 INFO:tasks.workunit.client.0.smithi134.stdout:7/269: fsync da/f33 0 2024-04-13T10:59:07.476 INFO:tasks.workunit.client.0.smithi134.stdout:4/266: symlink d4/d48/d4a/l5d 0 2024-04-13T10:59:07.477 INFO:tasks.workunit.client.0.smithi134.stdout:3/291: creat dc/d1d/d58/f5d x:0 0 0 2024-04-13T10:59:07.478 INFO:tasks.workunit.client.0.smithi134.stdout:8/323: dread d8/dc/d2c/d68/f61 [0,4194304] 0 2024-04-13T10:59:07.479 INFO:tasks.workunit.client.0.smithi134.stdout:8/324: truncate d8/dc/d13/f63 206754 0 2024-04-13T10:59:07.481 INFO:tasks.workunit.client.0.smithi134.stdout:9/362: unlink l12 0 2024-04-13T10:59:07.482 INFO:tasks.workunit.client.0.smithi134.stdout:7/270: creat da/d15/d26/d27/f5c x:0 0 0 2024-04-13T10:59:07.484 INFO:tasks.workunit.client.0.smithi134.stdout:8/325: dread d8/dc/f30 [0,4194304] 0 2024-04-13T10:59:07.505 INFO:tasks.workunit.client.0.smithi134.stdout:3/292: dwrite dc/d27/d4d/f34 [0,4194304] 0 2024-04-13T10:59:07.527 INFO:tasks.workunit.client.0.smithi134.stdout:3/293: dread dc/fe [0,4194304] 0 2024-04-13T10:59:07.528 INFO:tasks.workunit.client.0.smithi134.stdout:3/294: stat dc/l11 0 2024-04-13T10:59:07.533 INFO:tasks.workunit.client.0.smithi134.stdout:3/295: dread dc/d27/d4d/d4f/d50/f2d [0,4194304] 0 2024-04-13T10:59:07.534 INFO:tasks.workunit.client.0.smithi134.stdout:3/296: fdatasync dc/fe 0 2024-04-13T10:59:07.539 INFO:tasks.workunit.client.0.smithi134.stdout:5/540: sync 2024-04-13T10:59:07.541 INFO:tasks.workunit.client.0.smithi134.stdout:8/326: symlink d8/dc/d16/d4e/l6b 0 2024-04-13T10:59:07.542 INFO:tasks.workunit.client.0.smithi134.stdout:5/541: dread - dc/d15/d84/f9c zero size 2024-04-13T10:59:07.542 INFO:tasks.workunit.client.0.smithi134.stdout:5/542: fsync dc/d1d/d2f/d3b/faf 0 2024-04-13T10:59:07.549 INFO:tasks.workunit.client.0.smithi134.stdout:9/363: truncate d13/d39/f4e 811363 0 2024-04-13T10:59:07.551 INFO:tasks.workunit.client.0.smithi134.stdout:8/327: chown d8/dc/d16/d4e/l5f 70178 1 2024-04-13T10:59:07.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/328: write d8/dc/d13/f40 [1269460,53040] 0 2024-04-13T10:59:07.557 INFO:tasks.workunit.client.0.smithi134.stdout:4/267: link d4/d1f/d27/d2f/d38/c43 d4/c5e 0 2024-04-13T10:59:07.560 INFO:tasks.workunit.client.0.smithi134.stdout:7/271: getdents da/d15/d26/d27/d3d 0 2024-04-13T10:59:07.564 INFO:tasks.workunit.client.0.smithi134.stdout:8/329: mkdir d8/dc/d16/d54/d6c 0 2024-04-13T10:59:07.565 INFO:tasks.workunit.client.0.smithi134.stdout:8/330: readlink d8/dc/l28 0 2024-04-13T10:59:07.565 INFO:tasks.workunit.client.0.smithi134.stdout:8/331: fsync d8/dc/d37/f3a 0 2024-04-13T10:59:07.566 INFO:tasks.workunit.client.0.smithi134.stdout:8/332: write d8/dc/d13/f63 [639124,60849] 0 2024-04-13T10:59:07.567 INFO:tasks.workunit.client.0.smithi134.stdout:4/268: mkdir d4/da/d5f 0 2024-04-13T10:59:07.571 INFO:tasks.workunit.client.0.smithi134.stdout:7/272: creat da/d15/d26/d27/d47/d48/f5d x:0 0 0 2024-04-13T10:59:07.573 INFO:tasks.workunit.client.0.smithi134.stdout:5/543: rename c5 to dc/d1d/d20/d23/cb6 0 2024-04-13T10:59:07.575 INFO:tasks.workunit.client.0.smithi134.stdout:9/364: truncate f6 160750 0 2024-04-13T10:59:07.582 INFO:tasks.workunit.client.0.smithi134.stdout:5/544: rename dc/f82 to dc/d1d/d67/fb7 0 2024-04-13T10:59:07.585 INFO:tasks.workunit.client.0.smithi134.stdout:7/273: dread da/d15/f3a [0,4194304] 0 2024-04-13T10:59:07.586 INFO:tasks.workunit.client.0.smithi134.stdout:7/274: fsync da/f33 0 2024-04-13T10:59:07.592 INFO:tasks.workunit.client.0.smithi134.stdout:9/365: dwrite d13/d39/f4d [0,4194304] 0 2024-04-13T10:59:07.593 INFO:tasks.workunit.client.0.smithi134.stdout:9/366: chown d13/d2e/d35/f4b 0 1 2024-04-13T10:59:07.605 INFO:tasks.workunit.client.0.smithi134.stdout:9/367: creat d13/d39/d52/f7a x:0 0 0 2024-04-13T10:59:07.607 INFO:tasks.workunit.client.0.smithi134.stdout:4/269: getdents d4 0 2024-04-13T10:59:07.608 INFO:tasks.workunit.client.0.smithi134.stdout:8/333: getdents d8/dc/d2c/d68 0 2024-04-13T10:59:07.611 INFO:tasks.workunit.client.0.smithi134.stdout:5/545: dwrite dc/d1d/d2f/d3b/f52 [4194304,4194304] 0 2024-04-13T10:59:07.616 INFO:tasks.workunit.client.0.smithi134.stdout:4/270: rename d4/da to d4/d48/d50/d60 0 2024-04-13T10:59:07.619 INFO:tasks.workunit.client.0.smithi134.stdout:9/368: dwrite fd [4194304,4194304] 0 2024-04-13T10:59:07.620 INFO:tasks.workunit.client.0.smithi134.stdout:9/369: readlink d13/d40/l61 0 2024-04-13T10:59:07.621 INFO:tasks.workunit.client.0.smithi134.stdout:7/275: dread da/f12 [0,4194304] 0 2024-04-13T10:59:07.621 INFO:tasks.workunit.client.0.smithi134.stdout:8/334: mknod d8/c6d 0 2024-04-13T10:59:07.622 INFO:tasks.workunit.client.0.smithi134.stdout:8/335: stat d8/dc/d13/f36 0 2024-04-13T10:59:07.623 INFO:tasks.workunit.client.0.smithi134.stdout:8/336: dread - d8/dc/d37/f3a zero size 2024-04-13T10:59:07.631 INFO:tasks.workunit.client.0.smithi134.stdout:5/546: link dc/d1d/d20/l40 dc/d1d/d46/lb8 0 2024-04-13T10:59:07.633 INFO:tasks.workunit.client.0.smithi134.stdout:7/276: dwrite da/d15/f22 [0,4194304] 0 2024-04-13T10:59:07.634 INFO:tasks.workunit.client.0.smithi134.stdout:5/547: write dc/d1d/d20/f93 [553739,119266] 0 2024-04-13T10:59:07.638 INFO:tasks.workunit.client.0.smithi134.stdout:7/277: creat da/d15/d26/d38/f5e x:0 0 0 2024-04-13T10:59:07.639 INFO:tasks.workunit.client.0.smithi134.stdout:5/548: mknod dc/d1d/d67/cb9 0 2024-04-13T10:59:07.639 INFO:tasks.workunit.client.0.smithi134.stdout:5/549: fdatasync dc/d1d/d2b/d30/d3e/f4d 0 2024-04-13T10:59:07.640 INFO:tasks.workunit.client.0.smithi134.stdout:5/550: write f1 [12160166,43507] 0 2024-04-13T10:59:07.644 INFO:tasks.workunit.client.0.smithi134.stdout:7/278: mkdir da/d15/d26/d27/d4f/d5f 0 2024-04-13T10:59:07.647 INFO:tasks.workunit.client.0.smithi134.stdout:5/551: symlink dc/d1d/d20/d23/d36/lba 0 2024-04-13T10:59:07.649 INFO:tasks.workunit.client.0.smithi134.stdout:5/552: fsync dc/d1d/d46/f74 0 2024-04-13T10:59:07.650 INFO:tasks.workunit.client.0.smithi134.stdout:7/279: dread da/d15/f1a [0,4194304] 0 2024-04-13T10:59:07.652 INFO:tasks.workunit.client.0.smithi134.stdout:7/280: chown da/d15/d26/d27/d47/f49 57670 1 2024-04-13T10:59:07.655 INFO:tasks.workunit.client.0.smithi134.stdout:5/553: dread dc/d15/d65/f6c [0,4194304] 0 2024-04-13T10:59:07.656 INFO:tasks.workunit.client.0.smithi134.stdout:5/554: write f1 [6824285,48402] 0 2024-04-13T10:59:07.660 INFO:tasks.workunit.client.0.smithi134.stdout:8/337: dread d8/dc/d37/f3b [0,4194304] 0 2024-04-13T10:59:07.664 INFO:tasks.workunit.client.0.smithi134.stdout:7/281: rename da/l21 to da/d15/l60 0 2024-04-13T10:59:07.667 INFO:tasks.workunit.client.0.smithi134.stdout:8/338: symlink d8/dc/d37/l6e 0 2024-04-13T10:59:07.668 INFO:tasks.workunit.client.0.smithi134.stdout:4/271: truncate d4/d1b/f28 3668936 0 2024-04-13T10:59:07.669 INFO:tasks.workunit.client.0.smithi134.stdout:5/555: mknod dc/d1d/d2f/d3b/cbb 0 2024-04-13T10:59:07.675 INFO:tasks.workunit.client.0.smithi134.stdout:4/272: dwrite d4/d1f/d27/d2f/f44 [8388608,4194304] 0 2024-04-13T10:59:07.678 INFO:tasks.workunit.client.0.smithi134.stdout:5/556: mkdir dc/d1d/d2f/d3b/d3c/dbc 0 2024-04-13T10:59:07.679 INFO:tasks.workunit.client.0.smithi134.stdout:5/557: chown dc/d1d/d2f/d3b/d3c/c7e 79 1 2024-04-13T10:59:07.679 INFO:tasks.workunit.client.0.smithi134.stdout:5/558: chown dc/d15/d50/f90 8 1 2024-04-13T10:59:07.685 INFO:tasks.workunit.client.0.smithi134.stdout:5/559: dwrite f9 [0,4194304] 0 2024-04-13T10:59:07.687 INFO:tasks.workunit.client.0.smithi134.stdout:4/273: write d4/dd/f3f [688692,311] 0 2024-04-13T10:59:07.687 INFO:tasks.workunit.client.0.smithi134.stdout:5/560: read - dc/d1d/d2b/d30/f54 zero size 2024-04-13T10:59:07.691 INFO:tasks.workunit.client.0.smithi134.stdout:8/339: write d8/dc/d13/f1e [4152513,70901] 0 2024-04-13T10:59:07.692 INFO:tasks.workunit.client.0.smithi134.stdout:7/282: creat da/d15/d26/d27/d47/f61 x:0 0 0 2024-04-13T10:59:07.695 INFO:tasks.workunit.client.0.smithi134.stdout:7/283: write da/d15/f1a [1065508,55658] 0 2024-04-13T10:59:07.695 INFO:tasks.workunit.client.0.smithi134.stdout:8/340: mkdir d8/dc/d16/d54/d6f 0 2024-04-13T10:59:07.697 INFO:tasks.workunit.client.0.smithi134.stdout:7/284: truncate f8 4240045 0 2024-04-13T10:59:07.699 INFO:tasks.workunit.client.0.smithi134.stdout:8/341: dread d8/dc/d13/f36 [0,4194304] 0 2024-04-13T10:59:07.699 INFO:tasks.workunit.client.0.smithi134.stdout:4/274: creat d4/f61 x:0 0 0 2024-04-13T10:59:07.701 INFO:tasks.workunit.client.0.smithi134.stdout:4/275: chown d4/d1b/d32/c4b 88502003 1 2024-04-13T10:59:07.706 INFO:tasks.workunit.client.0.smithi134.stdout:7/285: rename da/d15/d26/d27/d47/f52 to da/d15/d26/f62 0 2024-04-13T10:59:07.708 INFO:tasks.workunit.client.0.smithi134.stdout:4/276: dwrite d4/d1b/f46 [0,4194304] 0 2024-04-13T10:59:07.718 INFO:tasks.workunit.client.0.smithi134.stdout:5/561: dread dc/f28 [0,4194304] 0 2024-04-13T10:59:07.723 INFO:tasks.workunit.client.0.smithi134.stdout:5/562: truncate dc/d1d/d67/fa6 1729440 0 2024-04-13T10:59:07.725 INFO:tasks.workunit.client.0.smithi134.stdout:7/286: write da/f13 [1334066,13915] 0 2024-04-13T10:59:07.731 INFO:tasks.workunit.client.0.smithi134.stdout:5/563: getdents dc/d1d/d2f/d3b/d6a 0 2024-04-13T10:59:07.732 INFO:tasks.workunit.client.0.smithi134.stdout:8/342: dwrite d8/dc/f12 [0,4194304] 0 2024-04-13T10:59:07.734 INFO:tasks.workunit.client.0.smithi134.stdout:7/287: dread da/d15/f3a [0,4194304] 0 2024-04-13T10:59:07.736 INFO:tasks.workunit.client.0.smithi134.stdout:4/277: dwrite d4/f2a [0,4194304] 0 2024-04-13T10:59:07.737 INFO:tasks.workunit.client.0.smithi134.stdout:5/564: dread dc/d1d/d46/f74 [0,4194304] 0 2024-04-13T10:59:07.738 INFO:tasks.workunit.client.0.smithi134.stdout:7/288: chown da/d15/d26/f62 222969 1 2024-04-13T10:59:07.739 INFO:tasks.workunit.client.0.smithi134.stdout:7/289: fdatasync da/f54 0 2024-04-13T10:59:07.743 INFO:tasks.workunit.client.0.smithi134.stdout:5/565: unlink dc/d1d/d67/d69/c9b 0 2024-04-13T10:59:07.745 INFO:tasks.workunit.client.0.smithi134.stdout:8/343: dwrite d8/dc/f1a [0,4194304] 0 2024-04-13T10:59:07.745 INFO:tasks.workunit.client.0.smithi134.stdout:5/566: dread dc/d1d/d20/f62 [0,4194304] 0 2024-04-13T10:59:07.747 INFO:tasks.workunit.client.0.smithi134.stdout:7/290: dread - da/d15/d26/f30 zero size 2024-04-13T10:59:07.750 INFO:tasks.workunit.client.0.smithi134.stdout:8/344: write d8/ff [4741332,120155] 0 2024-04-13T10:59:07.754 INFO:tasks.workunit.client.0.smithi134.stdout:5/567: rename dc/d1d/d20/d23/d38/d3a to dc/d1d/d20/d23/d36/dbd 0 2024-04-13T10:59:07.754 INFO:tasks.workunit.client.0.smithi134.stdout:7/291: dread - da/d15/d26/f35 zero size 2024-04-13T10:59:07.756 INFO:tasks.workunit.client.0.smithi134.stdout:4/278: getdents d4/d1f 0 2024-04-13T10:59:07.756 INFO:tasks.workunit.client.0.smithi134.stdout:5/568: read dc/d1d/d46/f74 [18057,123160] 0 2024-04-13T10:59:07.758 INFO:tasks.workunit.client.0.smithi134.stdout:8/345: rename d8/dc/f46 to d8/dc/d16/d54/d6c/f70 0 2024-04-13T10:59:07.762 INFO:tasks.workunit.client.0.smithi134.stdout:7/292: symlink da/d15/d26/d27/l63 0 2024-04-13T10:59:07.764 INFO:tasks.workunit.client.0.smithi134.stdout:5/569: write dc/d15/f43 [227218,16238] 0 2024-04-13T10:59:07.764 INFO:tasks.workunit.client.0.smithi134.stdout:7/293: read da/d15/d26/d27/d47/d48/f50 [4587376,107245] 0 2024-04-13T10:59:07.766 INFO:tasks.workunit.client.0.smithi134.stdout:5/570: dread dc/f14 [0,4194304] 0 2024-04-13T10:59:07.767 INFO:tasks.workunit.client.0.smithi134.stdout:5/571: write dc/d1d/d20/f93 [1529295,66892] 0 2024-04-13T10:59:07.770 INFO:tasks.workunit.client.0.smithi134.stdout:4/279: link d4/d1f/d27/d2f/d38/f4e d4/d1f/f62 0 2024-04-13T10:59:07.774 INFO:tasks.workunit.client.0.smithi134.stdout:5/572: rmdir dc/d39/d63/d99 39 2024-04-13T10:59:07.780 INFO:tasks.workunit.client.0.smithi134.stdout:4/280: symlink d4/l63 0 2024-04-13T10:59:07.782 INFO:tasks.workunit.client.0.smithi134.stdout:7/294: dwrite da/d15/d26/f35 [0,4194304] 0 2024-04-13T10:59:07.782 INFO:tasks.workunit.client.0.smithi134.stdout:8/346: getdents d8/dc/d16/d54 0 2024-04-13T10:59:07.787 INFO:tasks.workunit.client.0.smithi134.stdout:8/347: truncate d8/dc/d16/d54/f59 1522118 0 2024-04-13T10:59:07.789 INFO:tasks.workunit.client.0.smithi134.stdout:8/348: chown d8/dc/f15 1738347216 1 2024-04-13T10:59:07.791 INFO:tasks.workunit.client.0.smithi134.stdout:7/295: dread da/d15/d26/d27/f2d [0,4194304] 0 2024-04-13T10:59:07.792 INFO:tasks.workunit.client.0.smithi134.stdout:5/573: dread dc/d1d/d67/fb7 [0,4194304] 0 2024-04-13T10:59:07.792 INFO:tasks.workunit.client.0.smithi134.stdout:7/296: fdatasync da/f36 0 2024-04-13T10:59:07.793 INFO:tasks.workunit.client.0.smithi134.stdout:4/281: rename d4/c5 to d4/d48/c64 0 2024-04-13T10:59:07.794 INFO:tasks.workunit.client.0.smithi134.stdout:4/282: stat d4/d48/d50/d60/d5f 0 2024-04-13T10:59:07.798 INFO:tasks.workunit.client.0.smithi134.stdout:4/283: write d4/dd/f3f [1686850,29367] 0 2024-04-13T10:59:07.800 INFO:tasks.workunit.client.0.smithi134.stdout:8/349: dwrite d8/dc/d16/d54/d6c/f70 [0,4194304] 0 2024-04-13T10:59:07.800 INFO:tasks.workunit.client.0.smithi134.stdout:5/574: symlink dc/lbe 0 2024-04-13T10:59:07.802 INFO:tasks.workunit.client.0.smithi134.stdout:7/297: rename da/d15/d26/d38/c51 to da/d15/d26/d27/d3d/d46/c64 0 2024-04-13T10:59:07.803 INFO:tasks.workunit.client.0.smithi134.stdout:8/350: chown d8/dc/f45 209554 1 2024-04-13T10:59:07.803 INFO:tasks.workunit.client.0.smithi134.stdout:8/351: fdatasync d8/dc/d13/f40 0 2024-04-13T10:59:07.806 INFO:tasks.workunit.client.0.smithi134.stdout:4/284: rmdir d4/d1f/d27/d3a/d53 39 2024-04-13T10:59:07.809 INFO:tasks.workunit.client.0.smithi134.stdout:7/298: mknod da/d15/d26/d4a/c65 0 2024-04-13T10:59:07.811 INFO:tasks.workunit.client.0.smithi134.stdout:8/352: creat d8/dc/d37/f71 x:0 0 0 2024-04-13T10:59:07.812 INFO:tasks.workunit.client.0.smithi134.stdout:5/575: getdents dc/d1d/d2f/d3b/d3c/dbc 0 2024-04-13T10:59:07.814 INFO:tasks.workunit.client.0.smithi134.stdout:4/285: dread d4/dd/f3f [0,4194304] 0 2024-04-13T10:59:07.815 INFO:tasks.workunit.client.0.smithi134.stdout:7/299: unlink da/l41 0 2024-04-13T10:59:07.816 INFO:tasks.workunit.client.0.smithi134.stdout:4/286: read d4/d48/d50/d60/f16 [1477,24361] 0 2024-04-13T10:59:07.819 INFO:tasks.workunit.client.0.smithi134.stdout:5/576: truncate dc/f14 601128 0 2024-04-13T10:59:07.823 INFO:tasks.workunit.client.0.smithi134.stdout:7/300: creat da/d15/d26/d38/f66 x:0 0 0 2024-04-13T10:59:07.825 INFO:tasks.workunit.client.0.smithi134.stdout:4/287: mkdir d4/d1f/d27/d3a/d65 0 2024-04-13T10:59:07.826 INFO:tasks.workunit.client.0.smithi134.stdout:5/577: creat dc/d1d/d2f/d3b/d3c/dbc/fbf x:0 0 0 2024-04-13T10:59:07.832 INFO:tasks.workunit.client.0.smithi134.stdout:4/288: dwrite d4/dd/f39 [0,4194304] 0 2024-04-13T10:59:07.833 INFO:tasks.workunit.client.0.smithi134.stdout:4/289: readlink d4/d1f/d27/d3a/l3e 0 2024-04-13T10:59:07.839 INFO:tasks.workunit.client.0.smithi134.stdout:7/301: mkdir da/d15/d26/d27/d4f/d5f/d67 0 2024-04-13T10:59:07.841 INFO:tasks.workunit.client.0.smithi134.stdout:5/578: dread dc/f14 [0,4194304] 0 2024-04-13T10:59:07.844 INFO:tasks.workunit.client.0.smithi134.stdout:5/579: chown dc/d1d/d20/f2d 2 1 2024-04-13T10:59:07.844 INFO:tasks.workunit.client.0.smithi134.stdout:7/302: unlink da/d15/f3a 0 2024-04-13T10:59:07.848 INFO:tasks.workunit.client.0.smithi134.stdout:8/353: dwrite d8/dc/d16/f1d [0,4194304] 0 2024-04-13T10:59:07.848 INFO:tasks.workunit.client.0.smithi134.stdout:4/290: creat d4/d1f/d27/d3a/d65/f66 x:0 0 0 2024-04-13T10:59:07.858 INFO:tasks.workunit.client.0.smithi134.stdout:4/291: mkdir d4/d1b/d32/d67 0 2024-04-13T10:59:07.858 INFO:tasks.workunit.client.0.smithi134.stdout:7/303: rename da/lf to da/d15/d26/d27/d3d/l68 0 2024-04-13T10:59:07.859 INFO:tasks.workunit.client.0.smithi134.stdout:4/292: truncate d4/f61 282846 0 2024-04-13T10:59:07.861 INFO:tasks.workunit.client.0.smithi134.stdout:7/304: chown da/d15/d26/d38/f66 14386720 1 2024-04-13T10:59:07.861 INFO:tasks.workunit.client.0.smithi134.stdout:4/293: write d4/d48/d50/d60/ff [4158392,67978] 0 2024-04-13T10:59:07.863 INFO:tasks.workunit.client.0.smithi134.stdout:8/354: creat d8/dc/d37/d3f/f72 x:0 0 0 2024-04-13T10:59:07.864 INFO:tasks.workunit.client.0.smithi134.stdout:8/355: chown d8/dc/d37/f3a 169 1 2024-04-13T10:59:07.866 INFO:tasks.workunit.client.0.smithi134.stdout:4/294: creat d4/d1f/d27/d2f/f68 x:0 0 0 2024-04-13T10:59:07.867 INFO:tasks.workunit.client.0.smithi134.stdout:8/356: creat d8/dc/d37/d3f/f73 x:0 0 0 2024-04-13T10:59:07.869 INFO:tasks.workunit.client.0.smithi134.stdout:8/357: write d8/dc/d37/d3f/f73 [201108,17911] 0 2024-04-13T10:59:07.871 INFO:tasks.workunit.client.0.smithi134.stdout:8/358: dread d8/dc/d2c/f39 [0,4194304] 0 2024-04-13T10:59:07.873 INFO:tasks.workunit.client.0.smithi134.stdout:4/295: write d4/d48/d50/d60/f16 [1016549,84868] 0 2024-04-13T10:59:07.875 INFO:tasks.workunit.client.0.smithi134.stdout:7/305: truncate f5 5661082 0 2024-04-13T10:59:07.877 INFO:tasks.workunit.client.0.smithi134.stdout:7/306: write f4 [1212726,74116] 0 2024-04-13T10:59:07.881 INFO:tasks.workunit.client.0.smithi134.stdout:7/307: read da/d15/d26/d27/f34 [672428,82073] 0 2024-04-13T10:59:07.884 INFO:tasks.workunit.client.0.smithi134.stdout:4/296: dread d4/d1b/f35 [0,4194304] 0 2024-04-13T10:59:07.885 INFO:tasks.workunit.client.0.smithi134.stdout:8/359: mkdir d8/dc/d16/d74 0 2024-04-13T10:59:07.887 INFO:tasks.workunit.client.0.smithi134.stdout:8/360: chown d8/dc/d16/c43 0 1 2024-04-13T10:59:07.888 INFO:tasks.workunit.client.0.smithi134.stdout:4/297: write d4/d1f/d27/d2f/f31 [4731267,86763] 0 2024-04-13T10:59:07.892 INFO:tasks.workunit.client.0.smithi134.stdout:4/298: dread d4/d48/d50/d60/ff [0,4194304] 0 2024-04-13T10:59:07.895 INFO:tasks.workunit.client.0.smithi134.stdout:8/361: rmdir d8/dc/d13 39 2024-04-13T10:59:07.897 INFO:tasks.workunit.client.0.smithi134.stdout:4/299: dread d4/d1b/f1c [0,4194304] 0 2024-04-13T10:59:07.904 INFO:tasks.workunit.client.0.smithi134.stdout:8/362: creat d8/dc/d13/f75 x:0 0 0 2024-04-13T10:59:07.904 INFO:tasks.workunit.client.0.smithi134.stdout:4/300: symlink d4/d1f/d56/l69 0 2024-04-13T10:59:07.905 INFO:tasks.workunit.client.0.smithi134.stdout:8/363: read - d8/dc/d2c/f5c zero size 2024-04-13T10:59:07.905 INFO:tasks.workunit.client.0.smithi134.stdout:4/301: fsync d4/d1f/f23 0 2024-04-13T10:59:07.906 INFO:tasks.workunit.client.0.smithi134.stdout:4/302: chown d4/d1f/d27/d2f/f31 102 1 2024-04-13T10:59:07.910 INFO:tasks.workunit.client.0.smithi134.stdout:8/364: mkdir d8/dc/d16/d4e/d76 0 2024-04-13T10:59:07.911 INFO:tasks.workunit.client.0.smithi134.stdout:7/308: link da/d15/d26/d27/d3d/d46/c64 da/d15/d26/d27/d47/d5a/c69 0 2024-04-13T10:59:07.912 INFO:tasks.workunit.client.0.smithi134.stdout:7/309: chown c9 3 1 2024-04-13T10:59:07.915 INFO:tasks.workunit.client.0.smithi134.stdout:7/310: mknod da/d15/d26/d27/d4f/d5f/c6a 0 2024-04-13T10:59:07.916 INFO:tasks.workunit.client.0.smithi134.stdout:7/311: read da/f2a [628738,92495] 0 2024-04-13T10:59:07.919 INFO:tasks.workunit.client.0.smithi134.stdout:4/303: creat d4/d1f/d27/d3a/f6a x:0 0 0 2024-04-13T10:59:07.923 INFO:tasks.workunit.client.0.smithi134.stdout:7/312: symlink da/d15/d26/d27/d47/d5a/l6b 0 2024-04-13T10:59:07.924 INFO:tasks.workunit.client.0.smithi134.stdout:7/313: readlink da/d15/d26/d27/l63 0 2024-04-13T10:59:07.925 INFO:tasks.workunit.client.0.smithi134.stdout:7/314: chown da/l25 1 1 2024-04-13T10:59:07.925 INFO:tasks.workunit.client.0.smithi134.stdout:8/365: truncate d8/dc/d2c/d68/f61 932522 0 2024-04-13T10:59:07.929 INFO:tasks.workunit.client.0.smithi134.stdout:7/315: mknod da/d15/d26/d27/d3d/c6c 0 2024-04-13T10:59:07.930 INFO:tasks.workunit.client.0.smithi134.stdout:0/374: sync 2024-04-13T10:59:07.930 INFO:tasks.workunit.client.0.smithi134.stdout:2/322: sync 2024-04-13T10:59:07.933 INFO:tasks.workunit.client.0.smithi134.stdout:8/366: write d8/dc/f35 [1905371,128619] 0 2024-04-13T10:59:07.934 INFO:tasks.workunit.client.0.smithi134.stdout:8/367: fsync d8/dc/d37/f3a 0 2024-04-13T10:59:07.935 INFO:tasks.workunit.client.0.smithi134.stdout:2/323: creat d5/d6/f68 x:0 0 0 2024-04-13T10:59:07.941 INFO:tasks.workunit.client.0.smithi134.stdout:8/368: truncate d8/dc/f15 5310197 0 2024-04-13T10:59:07.944 INFO:tasks.workunit.client.0.smithi134.stdout:0/375: truncate d4/d17/d23/f2f 4175736 0 2024-04-13T10:59:07.946 INFO:tasks.workunit.client.0.smithi134.stdout:2/324: write d5/d6/f1e [4915542,50788] 0 2024-04-13T10:59:07.946 INFO:tasks.workunit.client.0.smithi134.stdout:7/316: getdents da/d15/d26/d4a 0 2024-04-13T10:59:07.947 INFO:tasks.workunit.client.0.smithi134.stdout:7/317: write da/f2a [1297334,125975] 0 2024-04-13T10:59:07.948 INFO:tasks.workunit.client.0.smithi134.stdout:8/369: rename d8/dc/d16/f2a to d8/dc/d16/d54/f77 0 2024-04-13T10:59:07.951 INFO:tasks.workunit.client.0.smithi134.stdout:2/325: creat d5/d6/f69 x:0 0 0 2024-04-13T10:59:07.952 INFO:tasks.workunit.client.0.smithi134.stdout:2/326: fdatasync d5/de/d2e/d4e/d30/f4f 0 2024-04-13T10:59:07.953 INFO:tasks.workunit.client.0.smithi134.stdout:2/327: write d5/fd [2783,18309] 0 2024-04-13T10:59:07.954 INFO:tasks.workunit.client.0.smithi134.stdout:2/328: readlink d5/d6/l5a 0 2024-04-13T10:59:07.955 INFO:tasks.workunit.client.0.smithi134.stdout:7/318: write f8 [3525550,96481] 0 2024-04-13T10:59:07.955 INFO:tasks.workunit.client.0.smithi134.stdout:2/329: chown d5/d6/df/l62 231 1 2024-04-13T10:59:07.957 INFO:tasks.workunit.client.0.smithi134.stdout:0/376: rename d4/d17/d20/f3f to d4/d17/da/f90 0 2024-04-13T10:59:07.959 INFO:tasks.workunit.client.0.smithi134.stdout:8/370: mkdir d8/dc/d16/d4e/d78 0 2024-04-13T10:59:07.965 INFO:tasks.workunit.client.0.smithi134.stdout:7/319: mknod da/d15/d26/d27/c6d 0 2024-04-13T10:59:07.966 INFO:tasks.workunit.client.0.smithi134.stdout:0/377: mkdir d4/d17/d23/d51/d6b/d91 0 2024-04-13T10:59:07.966 INFO:tasks.workunit.client.0.smithi134.stdout:8/371: dwrite d8/dc/d13/f63 [0,4194304] 0 2024-04-13T10:59:07.969 INFO:tasks.workunit.client.0.smithi134.stdout:2/330: unlink d5/de/d12/c13 0 2024-04-13T10:59:07.972 INFO:tasks.workunit.client.0.smithi134.stdout:0/378: mkdir d4/d17/d23/d61/d92 0 2024-04-13T10:59:07.974 INFO:tasks.workunit.client.0.smithi134.stdout:7/320: dwrite da/f2a [0,4194304] 0 2024-04-13T10:59:07.974 INFO:tasks.workunit.client.0.smithi134.stdout:0/379: chown d4/d17/c12 342732 1 2024-04-13T10:59:07.976 INFO:tasks.workunit.client.0.smithi134.stdout:8/372: unlink d8/dc/d2c/f5c 0 2024-04-13T10:59:07.977 INFO:tasks.workunit.client.0.smithi134.stdout:8/373: read d8/dc/f12 [420893,49918] 0 2024-04-13T10:59:07.981 INFO:tasks.workunit.client.0.smithi134.stdout:0/380: creat d4/d17/d23/d61/d8b/f93 x:0 0 0 2024-04-13T10:59:07.983 INFO:tasks.workunit.client.0.smithi134.stdout:0/381: chown d4/d17/d23/d61/d8b/d8c 153302 1 2024-04-13T10:59:07.985 INFO:tasks.workunit.client.0.smithi134.stdout:2/331: link d5/de/d2e/d4e/d30/f4f d5/de/d12/f6a 0 2024-04-13T10:59:07.985 INFO:tasks.workunit.client.0.smithi134.stdout:7/321: dwrite da/d15/d26/d27/d47/f55 [0,4194304] 0 2024-04-13T10:59:07.988 INFO:tasks.workunit.client.0.smithi134.stdout:2/332: read - d5/de/d2e/d4e/d30/f63 zero size 2024-04-13T10:59:07.990 INFO:tasks.workunit.client.0.smithi134.stdout:8/374: dwrite d8/dc/d37/d3f/f73 [0,4194304] 0 2024-04-13T10:59:08.015 INFO:tasks.workunit.client.0.smithi134.stdout:2/333: dread d5/d6/d21/f4d [0,4194304] 0 2024-04-13T10:59:08.065 INFO:tasks.workunit.client.0.smithi134.stdout:0/382: rename d4/d17/da/d48 to d4/d17/d23/d51/d6a/d94 0 2024-04-13T10:59:08.071 INFO:tasks.workunit.client.0.smithi134.stdout:0/383: dwrite d4/d17/da/d22/d37/f4d [0,4194304] 0 2024-04-13T10:59:08.094 INFO:tasks.workunit.client.0.smithi134.stdout:8/375: rmdir d8/dc 39 2024-04-13T10:59:08.095 INFO:tasks.workunit.client.0.smithi134.stdout:0/384: fsync d4/d17/d23/d61/d8b/f93 0 2024-04-13T10:59:08.096 INFO:tasks.workunit.client.0.smithi134.stdout:0/385: readlink d4/d17/d20/d29/l35 0 2024-04-13T10:59:08.102 INFO:tasks.workunit.client.0.smithi134.stdout:8/376: write d8/dc/d13/f32 [241276,5319] 0 2024-04-13T10:59:08.103 INFO:tasks.workunit.client.0.smithi134.stdout:8/377: write d8/dc/d16/f2d [3540439,10443] 0 2024-04-13T10:59:08.104 INFO:tasks.workunit.client.0.smithi134.stdout:8/378: readlink d8/dc/d13/l41 0 2024-04-13T10:59:08.105 INFO:tasks.workunit.client.0.smithi134.stdout:2/334: link d5/d6/d21/f28 d5/de/d50/f6b 0 2024-04-13T10:59:08.110 INFO:tasks.workunit.client.0.smithi134.stdout:0/386: dread d4/d17/da/d22/d37/f65 [0,4194304] 0 2024-04-13T10:59:08.113 INFO:tasks.workunit.client.0.smithi134.stdout:7/322: link da/d15/d26/d27/d3d/f45 da/d15/f6e 0 2024-04-13T10:59:08.115 INFO:tasks.workunit.client.0.smithi134.stdout:0/387: write d4/d17/f4a [2563413,105700] 0 2024-04-13T10:59:08.116 INFO:tasks.workunit.client.0.smithi134.stdout:8/379: dwrite d8/dc/d16/d54/f77 [0,4194304] 0 2024-04-13T10:59:08.117 INFO:tasks.workunit.client.0.smithi134.stdout:8/380: fsync d8/ff 0 2024-04-13T10:59:08.118 INFO:tasks.workunit.client.0.smithi134.stdout:0/388: dread - d4/d17/d23/d61/d8b/f93 zero size 2024-04-13T10:59:08.118 INFO:tasks.workunit.client.0.smithi134.stdout:2/335: rename d5/d6/d21 to d5/d6/d57/d6c 0 2024-04-13T10:59:08.119 INFO:tasks.workunit.client.0.smithi134.stdout:2/336: chown d5/de/d2e 30 1 2024-04-13T10:59:08.124 INFO:tasks.workunit.client.0.smithi134.stdout:8/381: rename d8/dc/f1a to d8/dc/d16/d4e/d76/f79 0 2024-04-13T10:59:08.126 INFO:tasks.workunit.client.0.smithi134.stdout:2/337: write d5/d6/d57/d6c/d29/f66 [2297087,86027] 0 2024-04-13T10:59:08.130 INFO:tasks.workunit.client.0.smithi134.stdout:0/389: mkdir d4/d17/da/d22/d41/d6e/d8a/d95 0 2024-04-13T10:59:08.131 INFO:tasks.workunit.client.0.smithi134.stdout:0/390: stat d4/d17/d23/d51/d6a/d73/f7a 0 2024-04-13T10:59:08.132 INFO:tasks.workunit.client.0.smithi134.stdout:2/338: symlink d5/d6/l6d 0 2024-04-13T10:59:08.133 INFO:tasks.workunit.client.0.smithi134.stdout:2/339: write d5/fd [5189396,28114] 0 2024-04-13T10:59:08.139 INFO:tasks.workunit.client.0.smithi134.stdout:2/340: rename d5/fd to d5/de/d55/f6e 0 2024-04-13T10:59:08.141 INFO:tasks.workunit.client.0.smithi134.stdout:0/391: dread d4/d17/da/f10 [0,4194304] 0 2024-04-13T10:59:08.144 INFO:tasks.workunit.client.0.smithi134.stdout:2/341: rename d5/de/d2e/d4e to d5/d6/d57/d6f 0 2024-04-13T10:59:08.145 INFO:tasks.workunit.client.0.smithi134.stdout:0/392: mkdir d4/d17/da/d22/d37/d47/d96 0 2024-04-13T10:59:08.146 INFO:tasks.workunit.client.0.smithi134.stdout:0/393: chown d4/d17/d20/d29/d30/d3e/f50 8985 1 2024-04-13T10:59:08.148 INFO:tasks.workunit.client.0.smithi134.stdout:8/382: getdents d8/dc 0 2024-04-13T10:59:08.150 INFO:tasks.workunit.client.0.smithi134.stdout:8/383: mknod d8/dc/d16/d4e/d76/c7a 0 2024-04-13T10:59:08.151 INFO:tasks.workunit.client.0.smithi134.stdout:8/384: fsync d8/dc/d16/d54/f77 0 2024-04-13T10:59:08.159 INFO:tasks.workunit.client.0.smithi134.stdout:2/342: truncate d5/d6/d57/d6c/d29/f66 1540974 0 2024-04-13T10:59:08.160 INFO:tasks.workunit.client.0.smithi134.stdout:8/385: dread d8/dc/f35 [0,4194304] 0 2024-04-13T10:59:08.161 INFO:tasks.workunit.client.0.smithi134.stdout:2/343: write d5/d6/f69 [158511,48720] 0 2024-04-13T10:59:08.163 INFO:tasks.workunit.client.0.smithi134.stdout:0/394: dread d4/d17/da/d22/d37/d47/f57 [0,4194304] 0 2024-04-13T10:59:08.163 INFO:tasks.workunit.client.0.smithi134.stdout:8/386: creat d8/dc/f7b x:0 0 0 2024-04-13T10:59:08.165 INFO:tasks.workunit.client.0.smithi134.stdout:8/387: fdatasync d8/dc/f4f 0 2024-04-13T10:59:08.171 INFO:tasks.workunit.client.0.smithi134.stdout:8/388: creat d8/dc/d13/f7c x:0 0 0 2024-04-13T10:59:08.174 INFO:tasks.workunit.client.0.smithi134.stdout:2/344: dread d5/d6/d57/d6f/f44 [0,4194304] 0 2024-04-13T10:59:08.175 INFO:tasks.workunit.client.0.smithi134.stdout:2/345: write d5/de/f65 [604248,47278] 0 2024-04-13T10:59:08.176 INFO:tasks.workunit.client.0.smithi134.stdout:8/389: unlink d8/dc/d16/f5b 0 2024-04-13T10:59:08.178 INFO:tasks.workunit.client.0.smithi134.stdout:2/346: mkdir d5/d6/d70 0 2024-04-13T10:59:08.179 INFO:tasks.workunit.client.0.smithi134.stdout:2/347: write d5/d6/d57/d6f/d30/f63 [512332,12469] 0 2024-04-13T10:59:08.181 INFO:tasks.workunit.client.0.smithi134.stdout:8/390: truncate d8/dc/d37/f3a 812877 0 2024-04-13T10:59:08.184 INFO:tasks.workunit.client.0.smithi134.stdout:8/391: unlink d8/dc/d16/d4e/l5f 0 2024-04-13T10:59:08.185 INFO:tasks.workunit.client.0.smithi134.stdout:8/392: fsync d8/dc/d13/f40 0 2024-04-13T10:59:08.185 INFO:tasks.workunit.client.0.smithi134.stdout:2/348: creat d5/d6/d57/d6f/d30/f71 x:0 0 0 2024-04-13T10:59:08.189 INFO:tasks.workunit.client.0.smithi134.stdout:2/349: link d5/d6/f1e d5/d6/d57/d6c/d29/f72 0 2024-04-13T10:59:08.190 INFO:tasks.workunit.client.0.smithi134.stdout:2/350: chown d5/d6/f9 12774940 1 2024-04-13T10:59:08.192 INFO:tasks.workunit.client.0.smithi134.stdout:2/351: write d5/d6/d57/d6f/f44 [424005,120373] 0 2024-04-13T10:59:08.199 INFO:tasks.workunit.client.0.smithi134.stdout:2/352: dwrite d5/d6/d57/d6f/f4a [0,4194304] 0 2024-04-13T10:59:08.200 INFO:tasks.workunit.client.0.smithi134.stdout:2/353: readlink d5/l27 0 2024-04-13T10:59:08.202 INFO:tasks.workunit.client.0.smithi134.stdout:8/393: dread d8/ff [0,4194304] 0 2024-04-13T10:59:08.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/354: read d5/de/d50/f6b [241528,107618] 0 2024-04-13T10:59:08.207 INFO:tasks.workunit.client.0.smithi134.stdout:8/394: mkdir d8/dc/d16/d54/d6c/d7d 0 2024-04-13T10:59:08.208 INFO:tasks.workunit.client.0.smithi134.stdout:2/355: truncate d5/d6/d57/d6c/f28 4679247 0 2024-04-13T10:59:08.208 INFO:tasks.workunit.client.0.smithi134.stdout:2/356: chown d5/d6/d57/d6c/l3d 6 1 2024-04-13T10:59:08.212 INFO:tasks.workunit.client.0.smithi134.stdout:2/357: mkdir d5/d6/d57/d6f/d30/d58/d73 0 2024-04-13T10:59:08.218 INFO:tasks.workunit.client.0.smithi134.stdout:2/358: dread d5/d6/d57/d6f/f4a [0,4194304] 0 2024-04-13T10:59:08.218 INFO:tasks.workunit.client.0.smithi134.stdout:2/359: readlink d5/d6/l2a 0 2024-04-13T10:59:08.225 INFO:tasks.workunit.client.0.smithi134.stdout:8/395: getdents d8/dc 0 2024-04-13T10:59:08.225 INFO:tasks.workunit.client.0.smithi134.stdout:8/396: readlink d8/l57 0 2024-04-13T10:59:08.231 INFO:tasks.workunit.client.0.smithi134.stdout:8/397: link d8/dc/f29 d8/dc/d2c/d68/f7e 0 2024-04-13T10:59:08.234 INFO:tasks.workunit.client.0.smithi134.stdout:8/398: creat d8/dc/d13/f7f x:0 0 0 2024-04-13T10:59:08.239 INFO:tasks.workunit.client.0.smithi134.stdout:2/360: dread d5/de/d50/f6b [0,4194304] 0 2024-04-13T10:59:08.248 INFO:tasks.workunit.client.0.smithi134.stdout:8/399: rename d8/dc/d16/f17 to d8/f80 0 2024-04-13T10:59:08.251 INFO:tasks.workunit.client.0.smithi134.stdout:2/361: write d5/d6/d57/d6c/d29/f66 [1924345,85462] 0 2024-04-13T10:59:08.252 INFO:tasks.workunit.client.0.smithi134.stdout:8/400: mknod d8/dc/d16/d74/c81 0 2024-04-13T10:59:08.252 INFO:tasks.workunit.client.0.smithi134.stdout:8/401: chown d8/c58 106838822 1 2024-04-13T10:59:08.257 INFO:tasks.workunit.client.0.smithi134.stdout:8/402: creat d8/dc/d16/d54/f82 x:0 0 0 2024-04-13T10:59:08.258 INFO:tasks.workunit.client.0.smithi134.stdout:2/362: dwrite d5/d6/f68 [0,4194304] 0 2024-04-13T10:59:08.259 INFO:tasks.workunit.client.0.smithi134.stdout:8/403: write d8/dc/d13/f63 [172432,91539] 0 2024-04-13T10:59:08.264 INFO:tasks.workunit.client.0.smithi134.stdout:2/363: rename d5/l27 to d5/d6/d57/d6f/d30/d58/d73/l74 0 2024-04-13T10:59:08.266 INFO:tasks.workunit.client.0.smithi134.stdout:8/404: mknod d8/dc/d16/d54/d6f/c83 0 2024-04-13T10:59:08.270 INFO:tasks.workunit.client.0.smithi134.stdout:8/405: dread d8/dc/d16/d54/f59 [0,4194304] 0 2024-04-13T10:59:08.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/364: fsync d5/d6/d57/d6c/f28 0 2024-04-13T10:59:08.278 INFO:tasks.workunit.client.0.smithi134.stdout:8/406: link d8/c67 d8/dc/d13/d5d/c84 0 2024-04-13T10:59:08.281 INFO:tasks.workunit.client.0.smithi134.stdout:8/407: rename f0 to d8/dc/d16/d54/d6c/d7d/f85 0 2024-04-13T10:59:08.283 INFO:tasks.workunit.client.0.smithi134.stdout:8/408: symlink d8/dc/d13/l86 0 2024-04-13T10:59:08.284 INFO:tasks.workunit.client.0.smithi134.stdout:8/409: chown d8/dc/d16/l52 385891387 1 2024-04-13T10:59:08.284 INFO:tasks.workunit.client.0.smithi134.stdout:8/410: stat d8/dc/d16/d54/f59 0 2024-04-13T10:59:08.286 INFO:tasks.workunit.client.0.smithi134.stdout:8/411: fsync d8/dc/f35 0 2024-04-13T10:59:08.291 INFO:tasks.workunit.client.0.smithi134.stdout:8/412: creat d8/dc/d16/d54/d6c/d7d/f87 x:0 0 0 2024-04-13T10:59:08.303 INFO:tasks.workunit.client.0.smithi134.stdout:3/297: sync 2024-04-13T10:59:08.303 INFO:tasks.workunit.client.0.smithi134.stdout:1/328: sync 2024-04-13T10:59:08.303 INFO:tasks.workunit.client.0.smithi134.stdout:6/366: sync 2024-04-13T10:59:08.305 INFO:tasks.workunit.client.0.smithi134.stdout:1/329: truncate d3/d30/f4b 19862 0 2024-04-13T10:59:08.308 INFO:tasks.workunit.client.0.smithi134.stdout:1/330: truncate d3/d6/f4f 84364 0 2024-04-13T10:59:08.310 INFO:tasks.workunit.client.0.smithi134.stdout:1/331: chown d3/d6/dd/l1c 192 1 2024-04-13T10:59:08.315 INFO:tasks.workunit.client.0.smithi134.stdout:6/367: mknod d4/da/d15/d5f/c71 0 2024-04-13T10:59:08.316 INFO:tasks.workunit.client.0.smithi134.stdout:3/298: dwrite dc/d27/d4d/d4f/d50/d25/f51 [0,4194304] 0 2024-04-13T10:59:08.317 INFO:tasks.workunit.client.0.smithi134.stdout:1/332: mknod d3/d6/dd/c6f 0 2024-04-13T10:59:08.322 INFO:tasks.workunit.client.0.smithi134.stdout:1/333: fdatasync d3/d6/d20/f38 0 2024-04-13T10:59:08.324 INFO:tasks.workunit.client.0.smithi134.stdout:6/368: mknod d4/da/d15/d1f/d24/d49/c72 0 2024-04-13T10:59:08.328 INFO:tasks.workunit.client.0.smithi134.stdout:1/334: creat d3/d6/d16/d1d/d3c/f70 x:0 0 0 2024-04-13T10:59:08.330 INFO:tasks.workunit.client.0.smithi134.stdout:3/299: link dc/d1d/f33 dc/d27/d4d/f5e 0 2024-04-13T10:59:08.330 INFO:tasks.workunit.client.0.smithi134.stdout:6/369: fdatasync d4/da/d15/d1f/f6b 0 2024-04-13T10:59:08.330 INFO:tasks.workunit.client.0.smithi134.stdout:1/335: chown d3/d30/c63 32 1 2024-04-13T10:59:08.332 INFO:tasks.workunit.client.0.smithi134.stdout:2/365: truncate d5/de/d50/f6b 2380197 0 2024-04-13T10:59:08.334 INFO:tasks.workunit.client.0.smithi134.stdout:2/366: readlink d5/d6/d57/d6f/d30/l32 0 2024-04-13T10:59:08.336 INFO:tasks.workunit.client.0.smithi134.stdout:3/300: dread dc/d27/d4d/d4f/d50/f2d [0,4194304] 0 2024-04-13T10:59:08.339 INFO:tasks.workunit.client.0.smithi134.stdout:3/301: fdatasync dc/d27/f52 0 2024-04-13T10:59:08.339 INFO:tasks.workunit.client.0.smithi134.stdout:2/367: rename d5/d6/f1e to d5/de/f75 0 2024-04-13T10:59:08.347 INFO:tasks.workunit.client.0.smithi134.stdout:3/302: rename dc/d2a/d38 to dc/d27/d4d/d4f/d50/d25/d5f 0 2024-04-13T10:59:08.350 INFO:tasks.workunit.client.0.smithi134.stdout:2/368: dwrite d5/de/d50/f56 [0,4194304] 0 2024-04-13T10:59:08.358 INFO:tasks.workunit.client.0.smithi134.stdout:3/303: dwrite dc/d27/d4d/d4f/d50/d25/f3e [0,4194304] 0 2024-04-13T10:59:08.360 INFO:tasks.workunit.client.0.smithi134.stdout:3/304: read dc/d27/d4d/d4f/d50/d25/f47 [1676521,7942] 0 2024-04-13T10:59:08.374 INFO:tasks.workunit.client.0.smithi134.stdout:6/370: write d4/da/d15/d1f/d24/d2b/f51 [912273,83466] 0 2024-04-13T10:59:08.376 INFO:tasks.workunit.client.0.smithi134.stdout:2/369: write d5/de/d12/f6a [251363,58024] 0 2024-04-13T10:59:08.378 INFO:tasks.workunit.client.0.smithi134.stdout:3/305: link dc/f42 dc/d1d/d58/f60 0 2024-04-13T10:59:08.378 INFO:tasks.workunit.client.0.smithi134.stdout:2/370: write d5/d6/d57/d6c/d29/f46 [841929,8455] 0 2024-04-13T10:59:08.381 INFO:tasks.workunit.client.0.smithi134.stdout:6/371: symlink d4/da/d15/d1f/d24/d2b/l73 0 2024-04-13T10:59:08.382 INFO:tasks.workunit.client.0.smithi134.stdout:6/372: chown d4/da/d15/l3b 7169 1 2024-04-13T10:59:08.382 INFO:tasks.workunit.client.0.smithi134.stdout:2/371: symlink d5/d6/d57/d6f/d30/d58/d73/l76 0 2024-04-13T10:59:08.386 INFO:tasks.workunit.client.0.smithi134.stdout:2/372: symlink d5/d6/d57/d6f/d30/d58/l77 0 2024-04-13T10:59:08.388 INFO:tasks.workunit.client.0.smithi134.stdout:6/373: dwrite d4/da/d15/d1f/f6b [0,4194304] 0 2024-04-13T10:59:08.389 INFO:tasks.workunit.client.0.smithi134.stdout:6/374: chown d4/da/d15/l3b 18798639 1 2024-04-13T10:59:08.394 INFO:tasks.workunit.client.0.smithi134.stdout:2/373: dread d5/de/d50/f5d [0,4194304] 0 2024-04-13T10:59:08.394 INFO:tasks.workunit.client.0.smithi134.stdout:3/306: truncate dc/d2a/f56 2932294 0 2024-04-13T10:59:08.396 INFO:tasks.workunit.client.0.smithi134.stdout:3/307: chown dc/d27/d19/d48/c57 38 1 2024-04-13T10:59:08.396 INFO:tasks.workunit.client.0.smithi134.stdout:2/374: symlink d5/l78 0 2024-04-13T10:59:08.398 INFO:tasks.workunit.client.0.smithi134.stdout:6/375: dwrite d4/da/d15/d1f/d3c/f59 [0,4194304] 0 2024-04-13T10:59:08.400 INFO:tasks.workunit.client.0.smithi134.stdout:2/375: mknod d5/c79 0 2024-04-13T10:59:08.428 INFO:tasks.workunit.client.0.smithi134.stdout:3/308: dwrite dc/fe [0,4194304] 0 2024-04-13T10:59:08.428 INFO:tasks.workunit.client.0.smithi134.stdout:6/376: dread d4/da/d15/d1f/d24/d2b/f3f [0,4194304] 0 2024-04-13T10:59:08.430 INFO:tasks.workunit.client.0.smithi134.stdout:2/376: dwrite d5/d6/d57/d6c/f28 [0,4194304] 0 2024-04-13T10:59:08.437 INFO:tasks.workunit.client.0.smithi134.stdout:3/309: mknod dc/d27/d4d/d4f/d50/d25/d5f/c61 0 2024-04-13T10:59:08.437 INFO:tasks.workunit.client.0.smithi134.stdout:6/377: fsync d4/f18 0 2024-04-13T10:59:08.439 INFO:tasks.workunit.client.0.smithi134.stdout:3/310: mkdir dc/d27/d4d/d4f/d62 0 2024-04-13T10:59:08.441 INFO:tasks.workunit.client.0.smithi134.stdout:2/377: dwrite d5/d6/d57/d6c/d29/f46 [0,4194304] 0 2024-04-13T10:59:08.442 INFO:tasks.workunit.client.0.smithi134.stdout:3/311: chown dc/d27/d4d/d4f/d50/d25/d5f/c4e 3203906 1 2024-04-13T10:59:08.444 INFO:tasks.workunit.client.0.smithi134.stdout:3/312: stat dc/d27/d4d/d4f/d50/d25/d5f/c4e 0 2024-04-13T10:59:08.446 INFO:tasks.workunit.client.0.smithi134.stdout:2/378: write d5/d6/d57/d6c/f49 [1133608,52226] 0 2024-04-13T10:59:08.447 INFO:tasks.workunit.client.0.smithi134.stdout:2/379: readlink d5/d6/df/l62 0 2024-04-13T10:59:08.448 INFO:tasks.workunit.client.0.smithi134.stdout:6/378: dread d4/da/d15/d1f/d24/d2b/f3f [0,4194304] 0 2024-04-13T10:59:08.449 INFO:tasks.workunit.client.0.smithi134.stdout:6/379: stat d4/fd 0 2024-04-13T10:59:08.451 INFO:tasks.workunit.client.0.smithi134.stdout:2/380: mkdir d5/d6/d57/d6c/d29/d7a 0 2024-04-13T10:59:08.453 INFO:tasks.workunit.client.0.smithi134.stdout:2/381: rmdir d5/d6/d57/d6f/d30/d58 39 2024-04-13T10:59:08.459 INFO:tasks.workunit.client.0.smithi134.stdout:2/382: dwrite d5/de/f65 [0,4194304] 0 2024-04-13T10:59:08.461 INFO:tasks.workunit.client.0.smithi134.stdout:6/380: link d4/da/d15/d1f/d3c/l4e d4/da/d15/d1f/d3c/l74 0 2024-04-13T10:59:08.464 INFO:tasks.workunit.client.0.smithi134.stdout:2/383: rmdir d5/de 39 2024-04-13T10:59:08.466 INFO:tasks.workunit.client.0.smithi134.stdout:2/384: chown d5/de/d12 7 1 2024-04-13T10:59:08.472 INFO:tasks.workunit.client.0.smithi134.stdout:2/385: dwrite d5/d6/d57/d6c/d29/f46 [0,4194304] 0 2024-04-13T10:59:08.480 INFO:tasks.workunit.client.0.smithi134.stdout:2/386: dwrite d5/d6/d57/d6c/d29/f46 [0,4194304] 0 2024-04-13T10:59:08.483 INFO:tasks.workunit.client.0.smithi134.stdout:2/387: read d5/de/d12/f6a [3383200,75178] 0 2024-04-13T10:59:08.485 INFO:tasks.workunit.client.0.smithi134.stdout:3/313: dread dc/d27/d4d/d4f/d50/f20 [0,4194304] 0 2024-04-13T10:59:08.556 INFO:tasks.workunit.client.0.smithi134.stdout:2/388: creat d5/de/d50/f7b x:0 0 0 2024-04-13T10:59:08.557 INFO:tasks.workunit.client.0.smithi134.stdout:3/314: write dc/f10 [3151119,96120] 0 2024-04-13T10:59:08.566 INFO:tasks.workunit.client.0.smithi134.stdout:2/389: rmdir d5/d6/d57/d6c 39 2024-04-13T10:59:08.568 INFO:tasks.workunit.client.0.smithi134.stdout:3/315: symlink dc/d27/d19/d4b/l63 0 2024-04-13T10:59:08.569 INFO:tasks.workunit.client.0.smithi134.stdout:2/390: dread d5/d6/d57/d6f/f3a [0,4194304] 0 2024-04-13T10:59:08.570 INFO:tasks.workunit.client.0.smithi134.stdout:2/391: write d5/de/d12/f1d [3878602,91320] 0 2024-04-13T10:59:08.571 INFO:tasks.workunit.client.0.smithi134.stdout:9/370: sync 2024-04-13T10:59:08.571 INFO:tasks.workunit.client.0.smithi134.stdout:5/580: sync 2024-04-13T10:59:08.571 INFO:tasks.workunit.client.0.smithi134.stdout:4/304: sync 2024-04-13T10:59:08.575 INFO:tasks.workunit.client.0.smithi134.stdout:9/371: creat d13/d2e/d35/d50/f7b x:0 0 0 2024-04-13T10:59:08.577 INFO:tasks.workunit.client.0.smithi134.stdout:5/581: mkdir dc/d1d/d2f/d3b/d7f/d8d/d7d/dc0 0 2024-04-13T10:59:08.579 INFO:tasks.workunit.client.0.smithi134.stdout:5/582: write dc/d1d/d2f/d3b/f52 [6040192,107816] 0 2024-04-13T10:59:08.580 INFO:tasks.workunit.client.0.smithi134.stdout:9/372: fdatasync d13/d40/f6c 0 2024-04-13T10:59:08.583 INFO:tasks.workunit.client.0.smithi134.stdout:4/305: getdents d4 0 2024-04-13T10:59:08.589 INFO:tasks.workunit.client.0.smithi134.stdout:4/306: dwrite d4/d1f/d27/d2f/f31 [4194304,4194304] 0 2024-04-13T10:59:08.590 INFO:tasks.workunit.client.0.smithi134.stdout:4/307: dread - d4/d1f/d27/d2f/f52 zero size 2024-04-13T10:59:08.591 INFO:tasks.workunit.client.0.smithi134.stdout:5/583: mkdir dc/dc1 0 2024-04-13T10:59:08.592 INFO:tasks.workunit.client.0.smithi134.stdout:5/584: stat dc/d1d/d20/d23/d36/lba 0 2024-04-13T10:59:08.593 INFO:tasks.workunit.client.0.smithi134.stdout:9/373: getdents d13/d2e/d35/d50/d59/d74 0 2024-04-13T10:59:08.598 INFO:tasks.workunit.client.0.smithi134.stdout:9/374: rename d13/d39/d52/f7a to d13/d2e/d35/d50/d59/d74/f7c 0 2024-04-13T10:59:08.601 INFO:tasks.workunit.client.0.smithi134.stdout:5/585: creat dc/d39/d63/d99/fc2 x:0 0 0 2024-04-13T10:59:08.604 INFO:tasks.workunit.client.0.smithi134.stdout:9/375: mkdir d13/d40/d7d 0 2024-04-13T10:59:08.606 INFO:tasks.workunit.client.0.smithi134.stdout:9/376: symlink d13/d39/d64/l7e 0 2024-04-13T10:59:08.606 INFO:tasks.workunit.client.0.smithi134.stdout:9/377: fsync d13/f76 0 2024-04-13T10:59:08.607 INFO:tasks.workunit.client.0.smithi134.stdout:5/586: link l7 dc/d1d/d20/d23/d38/lc3 0 2024-04-13T10:59:08.610 INFO:tasks.workunit.client.0.smithi134.stdout:5/587: unlink f8 0 2024-04-13T10:59:08.613 INFO:tasks.workunit.client.0.smithi134.stdout:9/378: dwrite d13/f1e [0,4194304] 0 2024-04-13T10:59:08.614 INFO:tasks.workunit.client.0.smithi134.stdout:5/588: write dc/d1d/d67/fb7 [4237292,84667] 0 2024-04-13T10:59:08.616 INFO:tasks.workunit.client.0.smithi134.stdout:5/589: truncate dc/d1d/d67/d69/fad 661782 0 2024-04-13T10:59:08.621 INFO:tasks.workunit.client.0.smithi134.stdout:9/379: creat d13/d40/d7d/f7f x:0 0 0 2024-04-13T10:59:08.622 INFO:tasks.workunit.client.0.smithi134.stdout:5/590: dread dc/d1d/d20/f93 [0,4194304] 0 2024-04-13T10:59:08.625 INFO:tasks.workunit.client.0.smithi134.stdout:9/380: rename d13/l3d to d13/d40/l80 0 2024-04-13T10:59:08.626 INFO:tasks.workunit.client.0.smithi134.stdout:9/381: fsync d13/f2d 0 2024-04-13T10:59:08.630 INFO:tasks.workunit.client.0.smithi134.stdout:9/382: mknod d13/d39/c81 0 2024-04-13T10:59:08.631 INFO:tasks.workunit.client.0.smithi134.stdout:9/383: write d13/d39/d58/f66 [896466,60083] 0 2024-04-13T10:59:08.632 INFO:tasks.workunit.client.0.smithi134.stdout:5/591: link dc/d1d/d20/d23/f2a dc/d1d/d2f/d3b/d7f/d8d/d7d/dc0/fc4 0 2024-04-13T10:59:08.635 INFO:tasks.workunit.client.0.smithi134.stdout:9/384: mkdir d13/d39/d58/d5f/d82 0 2024-04-13T10:59:08.637 INFO:tasks.workunit.client.0.smithi134.stdout:5/592: creat dc/dc1/fc5 x:0 0 0 2024-04-13T10:59:08.640 INFO:tasks.workunit.client.0.smithi134.stdout:5/593: rmdir dc/d1d/d67/d69 39 2024-04-13T10:59:08.642 INFO:tasks.workunit.client.0.smithi134.stdout:9/385: dwrite d13/d39/f3b [0,4194304] 0 2024-04-13T10:59:08.648 INFO:tasks.workunit.client.0.smithi134.stdout:9/386: symlink d13/d40/d7d/l83 0 2024-04-13T10:59:08.655 INFO:tasks.workunit.client.0.smithi134.stdout:5/594: getdents dc/d39/d63/d99 0 2024-04-13T10:59:08.656 INFO:tasks.workunit.client.0.smithi134.stdout:5/595: fdatasync dc/d1d/d20/d23/d5a/f6e 0 2024-04-13T10:59:08.663 INFO:tasks.workunit.client.0.smithi134.stdout:9/387: write d13/d2e/f3e [228559,44516] 0 2024-04-13T10:59:08.667 INFO:tasks.workunit.client.0.smithi134.stdout:9/388: write d13/d2e/d35/d50/d59/d74/f7c [1004393,40926] 0 2024-04-13T10:59:08.669 INFO:tasks.workunit.client.0.smithi134.stdout:9/389: fsync d13/d40/f42 0 2024-04-13T10:59:08.670 INFO:tasks.workunit.client.0.smithi134.stdout:5/596: dwrite dc/d1d/d2f/d3b/d3c/fa4 [0,4194304] 0 2024-04-13T10:59:08.675 INFO:tasks.workunit.client.0.smithi134.stdout:5/597: unlink dc/d1d/d2b/la8 0 2024-04-13T10:59:08.683 INFO:tasks.workunit.client.0.smithi134.stdout:5/598: dwrite dc/d1d/d2f/d3b/d3c/dbc/fbf [0,4194304] 0 2024-04-13T10:59:08.686 INFO:tasks.workunit.client.0.smithi134.stdout:9/390: dread fc [0,4194304] 0 2024-04-13T10:59:08.692 INFO:tasks.workunit.client.0.smithi134.stdout:9/391: creat d13/d39/d58/d5f/d82/f84 x:0 0 0 2024-04-13T10:59:08.694 INFO:tasks.workunit.client.0.smithi134.stdout:9/392: symlink d13/d40/d7d/l85 0 2024-04-13T10:59:08.695 INFO:tasks.workunit.client.0.smithi134.stdout:9/393: readlink d13/d39/d64/l70 0 2024-04-13T10:59:08.695 INFO:tasks.workunit.client.0.smithi134.stdout:9/394: fdatasync d13/f2d 0 2024-04-13T10:59:08.698 INFO:tasks.workunit.client.0.smithi134.stdout:9/395: mkdir d13/d39/d52/d86 0 2024-04-13T10:59:08.700 INFO:tasks.workunit.client.0.smithi134.stdout:9/396: fsync d13/f28 0 2024-04-13T10:59:08.702 INFO:tasks.workunit.client.0.smithi134.stdout:9/397: fsync d13/d2e/d35/d50/d59/d74/f7c 0 2024-04-13T10:59:08.712 INFO:tasks.workunit.client.0.smithi134.stdout:9/398: write f6 [80838,13433] 0 2024-04-13T10:59:08.715 INFO:tasks.workunit.client.0.smithi134.stdout:9/399: symlink d13/d39/d52/d71/l87 0 2024-04-13T10:59:08.718 INFO:tasks.workunit.client.0.smithi134.stdout:9/400: mknod d13/d39/d52/d6b/c88 0 2024-04-13T10:59:08.721 INFO:tasks.workunit.client.0.smithi134.stdout:9/401: rename d13/d2e/c72 to d13/d39/d58/d5f/d6e/c89 0 2024-04-13T10:59:08.723 INFO:tasks.workunit.client.0.smithi134.stdout:9/402: creat d13/d39/d64/f8a x:0 0 0 2024-04-13T10:59:08.724 INFO:tasks.workunit.client.0.smithi134.stdout:9/403: symlink d13/d39/d58/d5f/d82/l8b 0 2024-04-13T10:59:08.725 INFO:tasks.workunit.client.0.smithi134.stdout:9/404: dread - d13/f76 zero size 2024-04-13T10:59:08.725 INFO:tasks.workunit.client.0.smithi134.stdout:9/405: write d13/d2e/f3e [247393,9122] 0 2024-04-13T10:59:08.732 INFO:tasks.workunit.client.0.smithi134.stdout:9/406: dwrite d13/f51 [0,4194304] 0 2024-04-13T10:59:08.738 INFO:tasks.workunit.client.0.smithi134.stdout:9/407: rename d13/f51 to d13/d2e/d35/d50/d59/d74/f8c 0 2024-04-13T10:59:08.738 INFO:tasks.workunit.client.0.smithi134.stdout:9/408: chown d13/d39/d58/d5f/d6e/c79 3729016 1 2024-04-13T10:59:08.740 INFO:tasks.workunit.client.0.smithi134.stdout:9/409: dread - d13/d39/f62 zero size 2024-04-13T10:59:08.740 INFO:tasks.workunit.client.0.smithi134.stdout:9/410: chown d13/d2e/d35/d50/l6d 2430100 1 2024-04-13T10:59:08.743 INFO:tasks.workunit.client.0.smithi134.stdout:9/411: mkdir d13/d2e/d35/d50/d59/d74/d8d 0 2024-04-13T10:59:08.746 INFO:tasks.workunit.client.0.smithi134.stdout:9/412: creat d13/d39/d58/d5f/f8e x:0 0 0 2024-04-13T10:59:08.752 INFO:tasks.workunit.client.0.smithi134.stdout:9/413: getdents d13/d39/d52 0 2024-04-13T10:59:08.767 INFO:tasks.workunit.client.0.smithi134.stdout:9/414: dread d13/f21 [0,4194304] 0 2024-04-13T10:59:08.771 INFO:tasks.workunit.client.0.smithi134.stdout:9/415: dwrite d13/d39/d58/f5c [0,4194304] 0 2024-04-13T10:59:08.825 INFO:tasks.workunit.client.0.smithi134.stdout:7/323: sync 2024-04-13T10:59:08.829 INFO:tasks.workunit.client.0.smithi134.stdout:9/416: symlink d13/l8f 0 2024-04-13T10:59:08.835 INFO:tasks.workunit.client.0.smithi134.stdout:9/417: dwrite f6 [0,4194304] 0 2024-04-13T10:59:08.853 INFO:tasks.workunit.client.0.smithi134.stdout:9/418: fsync d13/d2e/d35/f6a 0 2024-04-13T10:59:08.854 INFO:tasks.workunit.client.0.smithi134.stdout:7/324: write da/d15/d26/d27/d47/d48/f50 [5438740,74812] 0 2024-04-13T10:59:08.856 INFO:tasks.workunit.client.0.smithi134.stdout:7/325: dread - da/d15/d26/d27/d47/f61 zero size 2024-04-13T10:59:08.857 INFO:tasks.workunit.client.0.smithi134.stdout:9/419: read d13/d40/f48 [3466332,113531] 0 2024-04-13T10:59:08.858 INFO:tasks.workunit.client.0.smithi134.stdout:7/326: dread - da/d15/d26/d27/d47/f49 zero size 2024-04-13T10:59:08.860 INFO:tasks.workunit.client.0.smithi134.stdout:9/420: creat d13/d2e/f90 x:0 0 0 2024-04-13T10:59:08.862 INFO:tasks.workunit.client.0.smithi134.stdout:7/327: creat da/d15/d26/d27/d47/d48/f6f x:0 0 0 2024-04-13T10:59:08.862 INFO:tasks.workunit.client.0.smithi134.stdout:9/421: dread - d13/d2e/d35/f43 zero size 2024-04-13T10:59:08.868 INFO:tasks.workunit.client.0.smithi134.stdout:7/328: symlink da/d15/l70 0 2024-04-13T10:59:08.870 INFO:tasks.workunit.client.0.smithi134.stdout:9/422: rmdir d13/d39/d58/d5f 39 2024-04-13T10:59:08.871 INFO:tasks.workunit.client.0.smithi134.stdout:7/329: chown da/d15/c16 523387 1 2024-04-13T10:59:08.873 INFO:tasks.workunit.client.0.smithi134.stdout:9/423: dread d13/f28 [0,4194304] 0 2024-04-13T10:59:08.873 INFO:tasks.workunit.client.0.smithi134.stdout:7/330: symlink da/d15/d26/d27/d3d/d46/l71 0 2024-04-13T10:59:08.874 INFO:tasks.workunit.client.0.smithi134.stdout:9/424: fsync d13/d39/d52/d71/f78 0 2024-04-13T10:59:08.876 INFO:tasks.workunit.client.0.smithi134.stdout:9/425: truncate d13/d40/f42 804407 0 2024-04-13T10:59:08.877 INFO:tasks.workunit.client.0.smithi134.stdout:7/331: creat da/d15/d26/d27/d47/d5a/f72 x:0 0 0 2024-04-13T10:59:08.879 INFO:tasks.workunit.client.0.smithi134.stdout:7/332: read da/f13 [252098,73404] 0 2024-04-13T10:59:08.884 INFO:tasks.workunit.client.0.smithi134.stdout:9/426: link d13/c26 d13/d39/d58/d5f/d82/c91 0 2024-04-13T10:59:08.885 INFO:tasks.workunit.client.0.smithi134.stdout:9/427: dread - d13/d39/d64/f8a zero size 2024-04-13T10:59:08.885 INFO:tasks.workunit.client.0.smithi134.stdout:7/333: mkdir da/d15/d26/d27/d4f/d5f/d67/d73 0 2024-04-13T10:59:08.887 INFO:tasks.workunit.client.0.smithi134.stdout:9/428: creat d13/d39/d64/f92 x:0 0 0 2024-04-13T10:59:08.889 INFO:tasks.workunit.client.0.smithi134.stdout:7/334: mknod da/d15/d26/d4a/c74 0 2024-04-13T10:59:08.890 INFO:tasks.workunit.client.0.smithi134.stdout:9/429: creat d13/d39/d64/f93 x:0 0 0 2024-04-13T10:59:08.891 INFO:tasks.workunit.client.0.smithi134.stdout:9/430: chown f4 32 1 2024-04-13T10:59:08.894 INFO:tasks.workunit.client.0.smithi134.stdout:9/431: creat d13/d2e/d47/f94 x:0 0 0 2024-04-13T10:59:08.895 INFO:tasks.workunit.client.0.smithi134.stdout:7/335: creat da/d15/d26/d27/d4f/d5f/d67/d73/f75 x:0 0 0 2024-04-13T10:59:08.895 INFO:tasks.workunit.client.0.smithi134.stdout:7/336: chown da/ce 13717110 1 2024-04-13T10:59:08.896 INFO:tasks.workunit.client.0.smithi134.stdout:9/432: truncate d13/d2e/d35/f46 4689495 0 2024-04-13T10:59:08.897 INFO:tasks.workunit.client.0.smithi134.stdout:9/433: truncate d13/d2e/f90 1007368 0 2024-04-13T10:59:08.904 INFO:tasks.workunit.client.0.smithi134.stdout:7/337: dwrite da/d15/d26/d27/d4f/d5f/d67/d73/f75 [0,4194304] 0 2024-04-13T10:59:08.905 INFO:tasks.workunit.client.0.smithi134.stdout:7/338: dread - da/d15/d26/d27/d47/d48/f5d zero size 2024-04-13T10:59:08.930 INFO:tasks.workunit.client.0.smithi134.stdout:7/339: dread da/d15/f22 [0,4194304] 0 2024-04-13T10:59:08.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:08 smithi134 ceph-mon[39696]: pgmap v38: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 7.3 MiB/s rd, 63 MiB/s wr, 174 op/s 2024-04-13T10:59:08.934 INFO:tasks.workunit.client.0.smithi134.stdout:7/340: mkdir da/d15/d26/d27/d4f/d5f/d67/d76 0 2024-04-13T10:59:08.940 INFO:tasks.workunit.client.0.smithi134.stdout:7/341: rename da/f36 to da/d15/f77 0 2024-04-13T10:59:08.945 INFO:tasks.workunit.client.0.smithi134.stdout:7/342: symlink da/d15/d26/d27/d47/l78 0 2024-04-13T10:59:08.953 INFO:tasks.workunit.client.0.smithi134.stdout:7/343: dwrite da/d15/d26/d27/d47/d5a/f72 [0,4194304] 0 2024-04-13T10:59:08.955 INFO:tasks.workunit.client.0.smithi134.stdout:7/344: write da/d15/d26/d27/d47/f61 [792223,40451] 0 2024-04-13T10:59:08.961 INFO:tasks.workunit.client.0.smithi134.stdout:7/345: rename da/l1e to da/d15/d26/d4a/l79 0 2024-04-13T10:59:08.969 INFO:tasks.workunit.client.0.smithi134.stdout:7/346: dwrite da/d15/d26/d27/d47/d48/f5d [0,4194304] 0 2024-04-13T10:59:08.977 INFO:tasks.workunit.client.0.smithi134.stdout:7/347: creat da/d15/d26/d27/d3d/f7a x:0 0 0 2024-04-13T10:59:08.978 INFO:tasks.workunit.client.0.smithi134.stdout:7/348: write da/f33 [1107666,122392] 0 2024-04-13T10:59:08.979 INFO:tasks.workunit.client.0.smithi134.stdout:7/349: dread - da/d15/d26/d4a/f59 zero size 2024-04-13T10:59:08.982 INFO:tasks.workunit.client.0.smithi134.stdout:7/350: creat da/d15/d26/d27/d4f/d5f/d67/d73/f7b x:0 0 0 2024-04-13T10:59:08.984 INFO:tasks.workunit.client.0.smithi134.stdout:7/351: symlink da/d15/d26/d27/d4f/d5f/l7c 0 2024-04-13T10:59:08.986 INFO:tasks.workunit.client.0.smithi134.stdout:7/352: creat da/d15/d26/d27/d4f/f7d x:0 0 0 2024-04-13T10:59:08.988 INFO:tasks.workunit.client.0.smithi134.stdout:7/353: mknod da/d15/d26/d27/d4f/d5f/c7e 0 2024-04-13T10:59:08.990 INFO:tasks.workunit.client.0.smithi134.stdout:7/354: rmdir da/d15/d26/d27/d47/d48 39 2024-04-13T10:59:08.991 INFO:tasks.workunit.client.0.smithi134.stdout:7/355: write da/f2a [3638046,96077] 0 2024-04-13T10:59:08.992 INFO:tasks.workunit.client.0.smithi134.stdout:7/356: chown da/d15/d26/d27/d4f/d5f/d67/d73/f75 262097014 1 2024-04-13T10:59:08.995 INFO:tasks.workunit.client.0.smithi134.stdout:7/357: write da/d15/d26/f28 [964154,12144] 0 2024-04-13T10:59:08.996 INFO:tasks.workunit.client.0.smithi134.stdout:7/358: chown da/d15/f2e 1737 1 2024-04-13T10:59:08.997 INFO:tasks.workunit.client.0.smithi134.stdout:7/359: fsync da/d15/d26/d27/d3d/f7a 0 2024-04-13T10:59:08.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:08 smithi194 ceph-mon[46737]: pgmap v38: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 7.3 MiB/s rd, 63 MiB/s wr, 174 op/s 2024-04-13T10:59:09.000 INFO:tasks.workunit.client.0.smithi134.stdout:7/360: symlink da/d15/l7f 0 2024-04-13T10:59:09.002 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-13T10:59:09.002 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-13T10:59:09.056 INFO:tasks.workunit.client.0.smithi134.stdout:0/395: sync 2024-04-13T10:59:09.057 INFO:tasks.workunit.client.0.smithi134.stdout:0/396: getdents d4/d17/da/d22/d37/d6d 0 2024-04-13T10:59:09.058 INFO:tasks.workunit.client.0.smithi134.stdout:0/397: write d4/d5d/f5a [2200258,117839] 0 2024-04-13T10:59:09.059 INFO:tasks.workunit.client.0.smithi134.stdout:0/398: write d4/d17/da/d22/d38/f7d [190994,31991] 0 2024-04-13T10:59:09.060 INFO:tasks.workunit.client.0.smithi134.stdout:0/399: fsync d4/d17/da/d22/d41/d6e/f72 0 2024-04-13T10:59:09.066 INFO:tasks.workunit.client.0.smithi134.stdout:0/400: dwrite d4/d17/da/f15 [0,4194304] 0 2024-04-13T10:59:09.111 INFO:tasks.workunit.client.0.smithi134.stdout:0/401: unlink d4/d17/d23/d61/d62/d7c/f8f 0 2024-04-13T10:59:09.113 INFO:tasks.workunit.client.0.smithi134.stdout:0/402: mkdir d4/d17/da/d22/d37/d6d/d97 0 2024-04-13T10:59:09.114 INFO:tasks.workunit.client.0.smithi134.stdout:0/403: dread - d4/d17/d23/d51/d6a/d94/f67 zero size 2024-04-13T10:59:09.120 INFO:tasks.workunit.client.0.smithi134.stdout:0/404: rename d4/d17/d23/d61 to d4/d17/d23/d51/d6b/d91/d98 0 2024-04-13T10:59:09.122 INFO:tasks.workunit.client.0.smithi134.stdout:0/405: creat d4/d17/d23/d51/d6b/d91/f99 x:0 0 0 2024-04-13T10:59:09.124 INFO:tasks.workunit.client.0.smithi134.stdout:0/406: truncate d4/d17/da/d22/d41/d6e/f72 406781 0 2024-04-13T10:59:09.216 INFO:tasks.workunit.client.0.smithi134.stdout:8/413: sync 2024-04-13T10:59:09.216 INFO:tasks.workunit.client.0.smithi134.stdout:1/336: sync 2024-04-13T10:59:09.216 INFO:tasks.workunit.client.0.smithi134.stdout:8/414: dread - d8/dc/d37/f64 zero size 2024-04-13T10:59:09.224 INFO:tasks.workunit.client.0.smithi134.stdout:8/415: getdents d8/dc/d2c 0 2024-04-13T10:59:09.227 INFO:tasks.workunit.client.0.smithi134.stdout:8/416: creat d8/dc/d13/d5d/f88 x:0 0 0 2024-04-13T10:59:09.229 INFO:tasks.workunit.client.0.smithi134.stdout:1/337: dwrite d3/f45 [0,4194304] 0 2024-04-13T10:59:09.233 INFO:tasks.workunit.client.0.smithi134.stdout:1/338: mkdir d3/d6/d20/d71 0 2024-04-13T10:59:09.233 INFO:tasks.workunit.client.0.smithi134.stdout:1/339: fdatasync d3/d30/f4b 0 2024-04-13T10:59:09.235 INFO:tasks.workunit.client.0.smithi134.stdout:8/417: dread d8/dc/d16/f1c [0,4194304] 0 2024-04-13T10:59:09.236 INFO:tasks.workunit.client.0.smithi134.stdout:1/340: write d3/d6/d16/d1d/d68/f5d [610728,63915] 0 2024-04-13T10:59:09.238 INFO:tasks.workunit.client.0.smithi134.stdout:8/418: truncate d8/dc/f30 1567615 0 2024-04-13T10:59:09.240 INFO:tasks.workunit.client.0.smithi134.stdout:8/419: read d8/dc/f45 [555090,7482] 0 2024-04-13T10:59:09.251 INFO:tasks.workunit.client.0.smithi134.stdout:1/341: getdents d3/d6/dd 0 2024-04-13T10:59:09.254 INFO:tasks.workunit.client.0.smithi134.stdout:8/420: link d8/dc/d37/f71 d8/dc/d37/d3f/f89 0 2024-04-13T10:59:09.258 INFO:tasks.workunit.client.0.smithi134.stdout:8/421: dread d8/dc/f45 [0,4194304] 0 2024-04-13T10:59:09.262 INFO:tasks.workunit.client.0.smithi134.stdout:1/342: write d3/d6/d16/f36 [1640857,10608] 0 2024-04-13T10:59:09.266 INFO:tasks.workunit.client.0.smithi134.stdout:8/422: dwrite d8/dc/d16/d54/d6c/f70 [0,4194304] 0 2024-04-13T10:59:09.266 INFO:tasks.workunit.client.0.smithi134.stdout:1/343: stat d3/d6/d16/d1d/d3c/l50 0 2024-04-13T10:59:09.267 INFO:tasks.workunit.client.0.smithi134.stdout:8/423: readlink d8/dc/d13/l5e 0 2024-04-13T10:59:09.269 INFO:tasks.workunit.client.0.smithi134.stdout:8/424: truncate d8/f10 2491433 0 2024-04-13T10:59:09.270 INFO:tasks.workunit.client.0.smithi134.stdout:8/425: read d8/dc/f35 [446433,130852] 0 2024-04-13T10:59:09.270 INFO:tasks.workunit.client.0.smithi134.stdout:1/344: rename d3/d6/d20/d28/c3f to d3/d6/d20/d6d/c72 0 2024-04-13T10:59:09.300 INFO:tasks.workunit.client.0.smithi134.stdout:8/426: dwrite d8/dc/f30 [0,4194304] 0 2024-04-13T10:59:09.329 INFO:tasks.workunit.client.0.smithi134.stdout:8/427: write d8/dc/d13/f36 [198635,44961] 0 2024-04-13T10:59:09.569 INFO:tasks.workunit.client.0.smithi134.stdout:2/392: sync 2024-04-13T10:59:09.569 INFO:tasks.workunit.client.0.smithi134.stdout:3/316: sync 2024-04-13T10:59:09.569 INFO:tasks.workunit.client.0.smithi134.stdout:6/381: sync 2024-04-13T10:59:09.570 INFO:tasks.workunit.client.0.smithi134.stdout:3/317: chown dc/d27/d19/f3b 6524972 1 2024-04-13T10:59:09.570 INFO:tasks.workunit.client.0.smithi134.stdout:2/393: fdatasync d5/d6/d57/d6f/d30/f42 0 2024-04-13T10:59:09.571 INFO:tasks.workunit.client.0.smithi134.stdout:2/394: chown d5/d6/d57/d6f/f3a 6929 1 2024-04-13T10:59:09.574 INFO:tasks.workunit.client.0.smithi134.stdout:6/382: creat d4/f75 x:0 0 0 2024-04-13T10:59:09.574 INFO:tasks.workunit.client.0.smithi134.stdout:2/395: write d5/de/d50/f5d [1445394,55126] 0 2024-04-13T10:59:09.576 INFO:tasks.workunit.client.0.smithi134.stdout:3/318: creat dc/f64 x:0 0 0 2024-04-13T10:59:09.577 INFO:tasks.workunit.client.0.smithi134.stdout:3/319: stat dc/fe 0 2024-04-13T10:59:09.579 INFO:tasks.workunit.client.0.smithi134.stdout:2/396: rename d5/de/d12/f25 to d5/de/d50/f7c 0 2024-04-13T10:59:09.581 INFO:tasks.workunit.client.0.smithi134.stdout:3/320: symlink dc/d27/d19/d48/d49/l65 0 2024-04-13T10:59:09.582 INFO:tasks.workunit.client.0.smithi134.stdout:3/321: write dc/d27/d4d/f34 [3248890,73748] 0 2024-04-13T10:59:09.584 INFO:tasks.workunit.client.0.smithi134.stdout:3/322: chown dc/d27/d19/d48/d49/d54 9580840 1 2024-04-13T10:59:09.585 INFO:tasks.workunit.client.0.smithi134.stdout:3/323: write dc/f64 [821784,79069] 0 2024-04-13T10:59:09.587 INFO:tasks.workunit.client.0.smithi134.stdout:2/397: rename d5/d6/d57/d6c/d29/l2b to d5/de/l7d 0 2024-04-13T10:59:09.588 INFO:tasks.workunit.client.0.smithi134.stdout:2/398: fdatasync d5/de/f10 0 2024-04-13T10:59:09.592 INFO:tasks.workunit.client.0.smithi134.stdout:2/399: dread d5/de/f75 [4194304,4194304] 0 2024-04-13T10:59:09.596 INFO:tasks.workunit.client.0.smithi134.stdout:6/383: truncate d4/da/d15/d1f/d24/d2b/f51 234593 0 2024-04-13T10:59:09.598 INFO:tasks.workunit.client.0.smithi134.stdout:6/384: truncate d4/da/d15/d1f/d24/d49/f50 1022868 0 2024-04-13T10:59:09.601 INFO:tasks.workunit.client.0.smithi134.stdout:3/324: write dc/d27/d4d/d4f/d50/d25/f47 [4018244,87279] 0 2024-04-13T10:59:09.601 INFO:tasks.workunit.client.0.smithi134.stdout:3/325: stat dc/d1d/c29 0 2024-04-13T10:59:09.602 INFO:tasks.workunit.client.0.smithi134.stdout:3/326: write dc/d27/d4d/d4f/d50/f2d [2102467,17675] 0 2024-04-13T10:59:09.605 INFO:tasks.workunit.client.0.smithi134.stdout:3/327: creat dc/f66 x:0 0 0 2024-04-13T10:59:09.610 INFO:tasks.workunit.client.0.smithi134.stdout:3/328: dwrite dc/d27/d4d/d4f/d50/d25/f47 [0,4194304] 0 2024-04-13T10:59:09.647 INFO:tasks.workunit.client.0.smithi134.stdout:4/308: sync 2024-04-13T10:59:09.647 INFO:tasks.workunit.client.0.smithi134.stdout:1/345: sync 2024-04-13T10:59:09.647 INFO:tasks.workunit.client.0.smithi134.stdout:0/407: sync 2024-04-13T10:59:09.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/361: sync 2024-04-13T10:59:09.647 INFO:tasks.workunit.client.0.smithi134.stdout:5/599: sync 2024-04-13T10:59:09.647 INFO:tasks.workunit.client.0.smithi134.stdout:9/434: sync 2024-04-13T10:59:09.647 INFO:tasks.workunit.client.0.smithi134.stdout:8/428: sync 2024-04-13T10:59:09.648 INFO:tasks.workunit.client.0.smithi134.stdout:0/408: chown d4/cb 0 1 2024-04-13T10:59:09.649 INFO:tasks.workunit.client.0.smithi134.stdout:1/346: dread d3/d6/f4f [0,4194304] 0 2024-04-13T10:59:09.649 INFO:tasks.workunit.client.0.smithi134.stdout:8/429: chown d8/dc/d13/d5d/f88 567 1 2024-04-13T10:59:09.650 INFO:tasks.workunit.client.0.smithi134.stdout:1/347: chown d3/d1e 1 1 2024-04-13T10:59:09.651 INFO:tasks.workunit.client.0.smithi134.stdout:5/600: chown l7 851737 1 2024-04-13T10:59:09.654 INFO:tasks.workunit.client.0.smithi134.stdout:9/435: creat d13/d2e/d35/d50/d59/d74/f95 x:0 0 0 2024-04-13T10:59:09.655 INFO:tasks.workunit.client.0.smithi134.stdout:7/362: creat da/d15/d26/d27/d4f/d5f/d67/f80 x:0 0 0 2024-04-13T10:59:09.656 INFO:tasks.workunit.client.0.smithi134.stdout:7/363: chown da/d15/d26/d4a/c65 98647 1 2024-04-13T10:59:09.657 INFO:tasks.workunit.client.0.smithi134.stdout:1/348: symlink d3/l73 0 2024-04-13T10:59:09.660 INFO:tasks.workunit.client.0.smithi134.stdout:8/430: mknod d8/dc/d16/d4e/d76/c8a 0 2024-04-13T10:59:09.663 INFO:tasks.workunit.client.0.smithi134.stdout:4/309: rename d4/c5e to d4/d1f/d27/d2f/d38/c6b 0 2024-04-13T10:59:09.665 INFO:tasks.workunit.client.0.smithi134.stdout:9/436: mknod d13/d39/d64/c96 0 2024-04-13T10:59:09.667 INFO:tasks.workunit.client.0.smithi134.stdout:3/329: getdents dc/d2a 0 2024-04-13T10:59:09.668 INFO:tasks.workunit.client.0.smithi134.stdout:8/431: mknod d8/dc/d13/d5d/c8b 0 2024-04-13T10:59:09.671 INFO:tasks.workunit.client.0.smithi134.stdout:5/601: creat dc/d1d/d2f/d3b/d7f/d8d/d7d/dc0/fc6 x:0 0 0 2024-04-13T10:59:09.671 INFO:tasks.workunit.client.0.smithi134.stdout:5/602: read - dc/d1d/d20/d23/d36/f80 zero size 2024-04-13T10:59:09.673 INFO:tasks.workunit.client.0.smithi134.stdout:0/409: rename d4/f6f to d4/d17/da/d22/d37/d47/d96/f9a 0 2024-04-13T10:59:09.675 INFO:tasks.workunit.client.0.smithi134.stdout:4/310: mknod d4/d48/d50/d60/c6c 0 2024-04-13T10:59:09.678 INFO:tasks.workunit.client.0.smithi134.stdout:9/437: mknod d13/d2e/d35/d50/d59/c97 0 2024-04-13T10:59:09.682 INFO:tasks.workunit.client.0.smithi134.stdout:3/330: creat dc/d27/d19/d48/d49/f67 x:0 0 0 2024-04-13T10:59:09.686 INFO:tasks.workunit.client.0.smithi134.stdout:1/349: dwrite d3/d6/d20/f24 [0,4194304] 0 2024-04-13T10:59:09.690 INFO:tasks.workunit.client.0.smithi134.stdout:8/432: write d8/f10 [1771865,69221] 0 2024-04-13T10:59:09.692 INFO:tasks.workunit.client.0.smithi134.stdout:5/603: creat dc/d1d/d2b/d30/d3e/fc7 x:0 0 0 2024-04-13T10:59:09.694 INFO:tasks.workunit.client.0.smithi134.stdout:5/604: stat dc/d1d/d2f/d3b/d7f 0 2024-04-13T10:59:09.696 INFO:tasks.workunit.client.0.smithi134.stdout:7/364: creat da/d15/f81 x:0 0 0 2024-04-13T10:59:09.697 INFO:tasks.workunit.client.0.smithi134.stdout:9/438: mkdir d13/d39/d58/d5f/d82/d98 0 2024-04-13T10:59:09.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/365: chown da/d15/d26/d38 0 1 2024-04-13T10:59:09.699 INFO:tasks.workunit.client.0.smithi134.stdout:8/433: dwrite d8/dc/d13/f75 [0,4194304] 0 2024-04-13T10:59:09.702 INFO:tasks.workunit.client.0.smithi134.stdout:3/331: creat dc/d27/d4d/d4f/f68 x:0 0 0 2024-04-13T10:59:09.705 INFO:tasks.workunit.client.0.smithi134.stdout:1/350: unlink d3/c2d 0 2024-04-13T10:59:09.706 INFO:tasks.workunit.client.0.smithi134.stdout:4/311: mkdir d4/dd/d6d 0 2024-04-13T10:59:09.706 INFO:tasks.workunit.client.0.smithi134.stdout:8/434: dread d8/dc/d16/f1b [0,4194304] 0 2024-04-13T10:59:09.712 INFO:tasks.workunit.client.0.smithi134.stdout:5/605: creat dc/d1d/d20/fc8 x:0 0 0 2024-04-13T10:59:09.716 INFO:tasks.workunit.client.0.smithi134.stdout:8/435: dwrite d8/dc/d16/f1d [0,4194304] 0 2024-04-13T10:59:09.716 INFO:tasks.workunit.client.0.smithi134.stdout:9/439: unlink d13/d2e/d35/d50/d60/f73 0 2024-04-13T10:59:09.719 INFO:tasks.workunit.client.0.smithi134.stdout:9/440: chown d13/d39/d64/l7e 16256465 1 2024-04-13T10:59:09.719 INFO:tasks.workunit.client.0.smithi134.stdout:1/351: dread - d3/d6/d20/f42 zero size 2024-04-13T10:59:09.723 INFO:tasks.workunit.client.0.smithi134.stdout:4/312: dread d4/d1f/d27/d2f/d38/f4e [0,4194304] 0 2024-04-13T10:59:09.723 INFO:tasks.workunit.client.0.smithi134.stdout:9/441: write d13/d39/d58/f5c [3638932,115852] 0 2024-04-13T10:59:09.723 INFO:tasks.workunit.client.0.smithi134.stdout:5/606: symlink dc/d39/d63/d99/lc9 0 2024-04-13T10:59:09.724 INFO:tasks.workunit.client.0.smithi134.stdout:8/436: mkdir d8/dc/d2c/d68/d8c 0 2024-04-13T10:59:09.727 INFO:tasks.workunit.client.0.smithi134.stdout:1/352: creat d3/d6/d20/d6d/f74 x:0 0 0 2024-04-13T10:59:09.730 INFO:tasks.workunit.client.0.smithi134.stdout:4/313: unlink d4/d48/d4a/f55 0 2024-04-13T10:59:09.733 INFO:tasks.workunit.client.0.smithi134.stdout:9/442: rename d13/c2b to d13/d39/d64/c99 0 2024-04-13T10:59:09.733 INFO:tasks.workunit.client.0.smithi134.stdout:4/314: chown d4/d1f/d27/d2f/f31 58 1 2024-04-13T10:59:09.733 INFO:tasks.workunit.client.0.smithi134.stdout:9/443: stat f4 0 2024-04-13T10:59:09.734 INFO:tasks.workunit.client.0.smithi134.stdout:8/437: mkdir d8/dc/d13/d5d/d69/d8d 0 2024-04-13T10:59:09.736 INFO:tasks.workunit.client.0.smithi134.stdout:1/353: dwrite d3/d6/d20/d6d/f74 [0,4194304] 0 2024-04-13T10:59:09.738 INFO:tasks.workunit.client.0.smithi134.stdout:9/444: creat d13/d2e/f9a x:0 0 0 2024-04-13T10:59:09.740 INFO:tasks.workunit.client.0.smithi134.stdout:4/315: rmdir d4/d48/d50/d60 39 2024-04-13T10:59:09.747 INFO:tasks.workunit.client.0.smithi134.stdout:9/445: rename d13/d39/c30 to d13/d39/c9b 0 2024-04-13T10:59:09.748 INFO:tasks.workunit.client.0.smithi134.stdout:3/332: dwrite dc/fd [0,4194304] 0 2024-04-13T10:59:09.750 INFO:tasks.workunit.client.0.smithi134.stdout:4/316: mknod d4/d48/d4a/c6e 0 2024-04-13T10:59:09.756 INFO:tasks.workunit.client.0.smithi134.stdout:3/333: creat dc/d27/d4d/f69 x:0 0 0 2024-04-13T10:59:09.758 INFO:tasks.workunit.client.0.smithi134.stdout:8/438: rmdir d8/dc/d16/d4e/d78 0 2024-04-13T10:59:09.764 INFO:tasks.workunit.client.0.smithi134.stdout:8/439: rename d8/f80 to d8/dc/d16/d54/d6c/f8e 0 2024-04-13T10:59:09.766 INFO:tasks.workunit.client.0.smithi134.stdout:8/440: write d8/dc/d13/f32 [756841,43184] 0 2024-04-13T10:59:09.766 INFO:tasks.workunit.client.0.smithi134.stdout:1/354: dwrite d3/f13 [0,4194304] 0 2024-04-13T10:59:09.767 INFO:tasks.workunit.client.0.smithi134.stdout:1/355: chown d3/d6 24198536 1 2024-04-13T10:59:09.769 INFO:tasks.workunit.client.0.smithi134.stdout:8/441: write d8/f10 [2398454,29551] 0 2024-04-13T10:59:09.772 INFO:tasks.workunit.client.0.smithi134.stdout:9/446: getdents d13 0 2024-04-13T10:59:09.775 INFO:tasks.workunit.client.0.smithi134.stdout:8/442: mkdir d8/dc/d2c/d68/d8c/d8f 0 2024-04-13T10:59:09.776 INFO:tasks.workunit.client.0.smithi134.stdout:9/447: symlink d13/d39/d64/l9c 0 2024-04-13T10:59:09.778 INFO:tasks.workunit.client.0.smithi134.stdout:9/448: symlink d13/d39/l9d 0 2024-04-13T10:59:09.779 INFO:tasks.workunit.client.0.smithi134.stdout:9/449: chown d13/d39/d64/c96 1955 1 2024-04-13T10:59:09.782 INFO:tasks.workunit.client.0.smithi134.stdout:8/443: dwrite d8/dc/d13/f7c [0,4194304] 0 2024-04-13T10:59:09.783 INFO:tasks.workunit.client.0.smithi134.stdout:8/444: write d8/dc/d13/d5d/f88 [1041044,99715] 0 2024-04-13T10:59:09.784 INFO:tasks.workunit.client.0.smithi134.stdout:8/445: chown d8/dc/d16/c2f 13371 1 2024-04-13T10:59:09.786 INFO:tasks.workunit.client.0.smithi134.stdout:8/446: fdatasync d8/dc/d16/d54/d6c/f8e 0 2024-04-13T10:59:09.790 INFO:tasks.workunit.client.0.smithi134.stdout:8/447: rmdir d8/dc/d13/d5d/d69/d8d 0 2024-04-13T10:59:09.792 INFO:tasks.workunit.client.0.smithi134.stdout:8/448: creat d8/dc/d16/d54/d6f/f90 x:0 0 0 2024-04-13T10:59:09.793 INFO:tasks.workunit.client.0.smithi134.stdout:8/449: chown d8/dc/d16/d4e/d76/c7a 79 1 2024-04-13T10:59:09.794 INFO:tasks.workunit.client.0.smithi134.stdout:8/450: creat d8/dc/d37/d3f/f91 x:0 0 0 2024-04-13T10:59:09.795 INFO:tasks.workunit.client.0.smithi134.stdout:8/451: write d8/dc/d13/f40 [2612865,21147] 0 2024-04-13T10:59:09.805 INFO:tasks.workunit.client.0.smithi134.stdout:3/334: write dc/d27/d4d/f32 [565036,89837] 0 2024-04-13T10:59:09.805 INFO:tasks.workunit.client.0.smithi134.stdout:8/452: dwrite d8/dc/d16/d4e/f62 [0,4194304] 0 2024-04-13T10:59:09.810 INFO:tasks.workunit.client.0.smithi134.stdout:3/335: creat dc/d27/d19/f6a x:0 0 0 2024-04-13T10:59:09.814 INFO:tasks.workunit.client.0.smithi134.stdout:9/450: write d13/f28 [1032180,17058] 0 2024-04-13T10:59:09.817 INFO:tasks.workunit.client.0.smithi134.stdout:1/356: dwrite d3/d6/d20/d28/f37 [0,4194304] 0 2024-04-13T10:59:09.819 INFO:tasks.workunit.client.0.smithi134.stdout:9/451: symlink d13/d2e/d35/d50/d59/d74/l9e 0 2024-04-13T10:59:09.823 INFO:tasks.workunit.client.0.smithi134.stdout:3/336: link dc/d27/d4d/f34 dc/d27/d19/d4b/f6b 0 2024-04-13T10:59:09.830 INFO:tasks.workunit.client.0.smithi134.stdout:9/452: mkdir d13/d39/d52/d86/d9f 0 2024-04-13T10:59:09.830 INFO:tasks.workunit.client.0.smithi134.stdout:1/357: write d3/ff [192678,126237] 0 2024-04-13T10:59:09.832 INFO:tasks.workunit.client.0.smithi134.stdout:9/453: mknod d13/d40/d7d/ca0 0 2024-04-13T10:59:09.834 INFO:tasks.workunit.client.0.smithi134.stdout:1/358: creat d3/d6/d20/f75 x:0 0 0 2024-04-13T10:59:09.835 INFO:tasks.workunit.client.0.smithi134.stdout:3/337: dwrite dc/d27/d4d/d4f/d50/f20 [0,4194304] 0 2024-04-13T10:59:09.839 INFO:tasks.workunit.client.0.smithi134.stdout:9/454: mknod d13/d2e/d47/ca1 0 2024-04-13T10:59:09.840 INFO:tasks.workunit.client.0.smithi134.stdout:1/359: mknod d3/d1e/c76 0 2024-04-13T10:59:09.843 INFO:tasks.workunit.client.0.smithi134.stdout:1/360: creat d3/d30/f77 x:0 0 0 2024-04-13T10:59:09.845 INFO:tasks.workunit.client.0.smithi134.stdout:3/338: dwrite dc/d27/d19/f5c [0,4194304] 0 2024-04-13T10:59:09.846 INFO:tasks.workunit.client.0.smithi134.stdout:3/339: stat dc/d27/f18 0 2024-04-13T10:59:09.853 INFO:tasks.workunit.client.0.smithi134.stdout:3/340: dwrite dc/f55 [0,4194304] 0 2024-04-13T10:59:09.855 INFO:tasks.workunit.client.0.smithi134.stdout:1/361: rmdir d3/d30/d5e 0 2024-04-13T10:59:09.859 INFO:tasks.workunit.client.0.smithi134.stdout:3/341: fsync dc/d27/d19/d4b/f6b 0 2024-04-13T10:59:09.862 INFO:tasks.workunit.client.0.smithi134.stdout:1/362: creat d3/d6/d6a/f78 x:0 0 0 2024-04-13T10:59:09.863 INFO:tasks.workunit.client.0.smithi134.stdout:9/455: truncate d13/f1e 259230 0 2024-04-13T10:59:09.864 INFO:tasks.workunit.client.0.smithi134.stdout:1/363: truncate d3/d30/f77 24563 0 2024-04-13T10:59:09.866 INFO:tasks.workunit.client.0.smithi134.stdout:9/456: mkdir d13/d39/d52/da2 0 2024-04-13T10:59:09.872 INFO:tasks.workunit.client.0.smithi134.stdout:9/457: rename d13/d39/d58/d5f/d82 to d13/da3 0 2024-04-13T10:59:09.875 INFO:tasks.workunit.client.0.smithi134.stdout:1/364: getdents d3/d6/d20/d6d 0 2024-04-13T10:59:09.876 INFO:tasks.workunit.client.0.smithi134.stdout:1/365: readlink d3/d6/l47 0 2024-04-13T10:59:09.879 INFO:tasks.workunit.client.0.smithi134.stdout:1/366: symlink d3/d6/d16/d4d/l79 0 2024-04-13T10:59:09.884 INFO:tasks.workunit.client.0.smithi134.stdout:1/367: creat d3/d30/f7a x:0 0 0 2024-04-13T10:59:09.884 INFO:tasks.workunit.client.0.smithi134.stdout:3/342: dwrite dc/f42 [0,4194304] 0 2024-04-13T10:59:09.889 INFO:tasks.workunit.client.0.smithi134.stdout:1/368: creat d3/d6/d20/f7b x:0 0 0 2024-04-13T10:59:09.891 INFO:tasks.workunit.client.0.smithi134.stdout:3/343: rename dc/d1d/f33 to dc/d27/d19/d48/d49/f6c 0 2024-04-13T10:59:09.892 INFO:tasks.workunit.client.0.smithi134.stdout:9/458: rmdir d13/da3 39 2024-04-13T10:59:09.893 INFO:tasks.workunit.client.0.smithi134.stdout:3/344: chown dc/d27/d4d/d4f/d50/f2d 31380 1 2024-04-13T10:59:09.895 INFO:tasks.workunit.client.0.smithi134.stdout:1/369: creat d3/d6/d16/d4d/f7c x:0 0 0 2024-04-13T10:59:09.896 INFO:tasks.workunit.client.0.smithi134.stdout:1/370: fdatasync d3/d6/d20/d28/f37 0 2024-04-13T10:59:09.897 INFO:tasks.workunit.client.0.smithi134.stdout:3/345: mknod dc/d27/d4d/d4f/d50/d25/c6d 0 2024-04-13T10:59:09.902 INFO:tasks.workunit.client.0.smithi134.stdout:3/346: link dc/f42 dc/d27/d4d/f6e 0 2024-04-13T10:59:09.903 INFO:tasks.workunit.client.0.smithi134.stdout:1/371: dread d3/d6/d20/d28/f37 [0,4194304] 0 2024-04-13T10:59:09.906 INFO:tasks.workunit.client.0.smithi134.stdout:9/459: dwrite d13/d2e/f9a [0,4194304] 0 2024-04-13T10:59:09.907 INFO:tasks.workunit.client.0.smithi134.stdout:1/372: creat d3/d6/d16/f7d x:0 0 0 2024-04-13T10:59:09.911 INFO:tasks.workunit.client.0.smithi134.stdout:9/460: dread - d13/d40/d7d/f7f zero size 2024-04-13T10:59:09.918 INFO:tasks.workunit.client.0.smithi134.stdout:1/373: link d3/d6/d16/f7d d3/d6/f7e 0 2024-04-13T10:59:09.920 INFO:tasks.workunit.client.0.smithi134.stdout:9/461: rename d13/d2e/f90 to d13/d39/d52/fa4 0 2024-04-13T10:59:09.921 INFO:tasks.workunit.client.0.smithi134.stdout:9/462: truncate d13/d2e/f3e 961855 0 2024-04-13T10:59:09.925 INFO:tasks.workunit.client.0.smithi134.stdout:9/463: mknod d13/d39/d52/d71/ca5 0 2024-04-13T10:59:09.928 INFO:tasks.workunit.client.0.smithi134.stdout:9/464: symlink d13/d39/d52/da2/la6 0 2024-04-13T10:59:09.935 INFO:tasks.workunit.client.0.smithi134.stdout:9/465: dwrite d13/d39/d58/d5f/f8e [0,4194304] 0 2024-04-13T10:59:09.940 INFO:tasks.workunit.client.0.smithi134.stdout:9/466: chown d13/d40/d7d/f7f 28 1 2024-04-13T10:59:09.940 INFO:tasks.workunit.client.0.smithi134.stdout:1/374: dwrite d3/d6/d20/d28/f3e [0,4194304] 0 2024-04-13T10:59:09.943 INFO:tasks.workunit.client.0.smithi134.stdout:1/375: write d3/d6/d20/f24 [4107242,34505] 0 2024-04-13T10:59:09.950 INFO:tasks.workunit.client.0.smithi134.stdout:1/376: rename d3/d6/d20/l54 to d3/d6/d16/d1d/d68/l7f 0 2024-04-13T10:59:09.956 INFO:tasks.workunit.client.0.smithi134.stdout:9/467: write d13/d39/f4e [926862,4590] 0 2024-04-13T10:59:09.959 INFO:tasks.workunit.client.0.smithi134.stdout:9/468: truncate d13/f28 1519729 0 2024-04-13T10:59:09.960 INFO:tasks.workunit.client.0.smithi134.stdout:9/469: write d13/d2e/d35/f46 [3279562,29382] 0 2024-04-13T10:59:09.961 INFO:tasks.workunit.client.0.smithi134.stdout:1/377: link d3/d6/d16/d1d/d68/l7f d3/d6/d16/d1d/d68/l80 0 2024-04-13T10:59:09.963 INFO:tasks.workunit.client.0.smithi134.stdout:1/378: fdatasync d3/d6/f7e 0 2024-04-13T10:59:09.967 INFO:tasks.workunit.client.0.smithi134.stdout:1/379: mknod d3/d6/d6a/c81 0 2024-04-13T10:59:09.969 INFO:tasks.workunit.client.0.smithi134.stdout:1/380: readlink d3/d6/dd/le 0 2024-04-13T10:59:09.969 INFO:tasks.workunit.client.0.smithi134.stdout:9/470: dwrite d13/d2e/d47/f94 [0,4194304] 0 2024-04-13T10:59:09.975 INFO:tasks.workunit.client.0.smithi134.stdout:1/381: creat d3/d6/d16/d4d/d65/f82 x:0 0 0 2024-04-13T10:59:09.977 INFO:tasks.workunit.client.0.smithi134.stdout:1/382: symlink d3/d6/d16/d1d/l83 0 2024-04-13T10:59:09.980 INFO:tasks.workunit.client.0.smithi134.stdout:1/383: truncate d3/d6/dd/f56 857820 0 2024-04-13T10:59:09.988 INFO:tasks.workunit.client.0.smithi134.stdout:2/400: sync 2024-04-13T10:59:09.988 INFO:tasks.workunit.client.0.smithi134.stdout:6/385: sync 2024-04-13T10:59:09.991 INFO:tasks.workunit.client.0.smithi134.stdout:6/386: read d4/f18 [3821127,36833] 0 2024-04-13T10:59:09.994 INFO:tasks.workunit.client.0.smithi134.stdout:2/401: creat d5/d6/d57/d6f/d30/d58/d59/f7e x:0 0 0 2024-04-13T10:59:09.998 INFO:tasks.workunit.client.0.smithi134.stdout:9/471: truncate d13/d39/d58/d5f/f8e 1489448 0 2024-04-13T10:59:10.000 INFO:tasks.workunit.client.0.smithi134.stdout:2/402: dread d5/d6/f68 [0,4194304] 0 2024-04-13T10:59:10.000 INFO:tasks.workunit.client.0.smithi134.stdout:9/472: chown d13/d39/d58/d5f/d6e/c79 281437 1 2024-04-13T10:59:10.003 INFO:tasks.workunit.client.0.smithi134.stdout:1/384: dread d3/d1e/f25 [0,4194304] 0 2024-04-13T10:59:10.003 INFO:tasks.workunit.client.0.smithi134.stdout:2/403: dread d5/d6/f69 [0,4194304] 0 2024-04-13T10:59:10.005 INFO:tasks.workunit.client.0.smithi134.stdout:2/404: write d5/d6/d57/d6f/d30/f71 [357525,45298] 0 2024-04-13T10:59:10.006 INFO:tasks.workunit.client.0.smithi134.stdout:1/385: chown d3/d6/d16/d1d/d68/f5d 807 1 2024-04-13T10:59:10.015 INFO:tasks.workunit.client.0.smithi134.stdout:6/387: dwrite d4/f5 [0,4194304] 0 2024-04-13T10:59:10.015 INFO:tasks.workunit.client.0.smithi134.stdout:1/386: fsync d3/d6/f3a 0 2024-04-13T10:59:10.022 INFO:tasks.workunit.client.0.smithi134.stdout:6/388: fdatasync d4/da/d15/d1f/d24/d2b/f67 0 2024-04-13T10:59:10.022 INFO:tasks.workunit.client.0.smithi134.stdout:9/473: dwrite d13/d2e/d35/f43 [0,4194304] 0 2024-04-13T10:59:10.026 INFO:tasks.workunit.client.0.smithi134.stdout:1/387: creat d3/d6/d16/d1d/f84 x:0 0 0 2024-04-13T10:59:10.028 INFO:tasks.workunit.client.0.smithi134.stdout:6/389: mkdir d4/da/d15/d76 0 2024-04-13T10:59:10.034 INFO:tasks.workunit.client.0.smithi134.stdout:1/388: creat d3/d30/f85 x:0 0 0 2024-04-13T10:59:10.034 INFO:tasks.workunit.client.0.smithi134.stdout:1/389: write d3/d6/d16/f36 [363250,32461] 0 2024-04-13T10:59:10.035 INFO:tasks.workunit.client.0.smithi134.stdout:6/390: dread d4/da/d15/d1f/d24/f62 [0,4194304] 0 2024-04-13T10:59:10.040 INFO:tasks.workunit.client.0.smithi134.stdout:6/391: fdatasync d4/da/d1a/f29 0 2024-04-13T10:59:10.043 INFO:tasks.workunit.client.0.smithi134.stdout:1/390: dwrite d3/d6/f7 [8388608,4194304] 0 2024-04-13T10:59:10.045 INFO:tasks.workunit.client.0.smithi134.stdout:6/392: rename d4/da/d15/d5f to d4/da/d15/d77 0 2024-04-13T10:59:10.047 INFO:tasks.workunit.client.0.smithi134.stdout:6/393: write d4/da/d15/d1f/f6b [3979471,48537] 0 2024-04-13T10:59:10.050 INFO:tasks.workunit.client.0.smithi134.stdout:1/391: dread d3/d6/f31 [0,4194304] 0 2024-04-13T10:59:10.051 INFO:tasks.workunit.client.0.smithi134.stdout:9/474: dread d13/d39/f4d [0,4194304] 0 2024-04-13T10:59:10.052 INFO:tasks.workunit.client.0.smithi134.stdout:1/392: write d3/d6/d20/d28/f3e [2191186,99410] 0 2024-04-13T10:59:10.058 INFO:tasks.workunit.client.0.smithi134.stdout:1/393: mkdir d3/d6/d16/d1d/d86 0 2024-04-13T10:59:10.058 INFO:tasks.workunit.client.0.smithi134.stdout:9/475: link d13/d2e/d35/l53 d13/d2e/la7 0 2024-04-13T10:59:10.062 INFO:tasks.workunit.client.0.smithi134.stdout:9/476: creat d13/d2e/d35/fa8 x:0 0 0 2024-04-13T10:59:10.064 INFO:tasks.workunit.client.0.smithi134.stdout:9/477: creat d13/d39/d52/d71/fa9 x:0 0 0 2024-04-13T10:59:10.066 INFO:tasks.workunit.client.0.smithi134.stdout:9/478: dread - d13/da3/f84 zero size 2024-04-13T10:59:10.069 INFO:tasks.workunit.client.0.smithi134.stdout:9/479: mknod d13/da3/caa 0 2024-04-13T10:59:10.073 INFO:tasks.workunit.client.0.smithi134.stdout:9/480: rmdir d13/d39/d58/d5f 39 2024-04-13T10:59:10.073 INFO:tasks.workunit.client.0.smithi134.stdout:6/394: dwrite d4/da/d15/d1f/d3c/f45 [0,4194304] 0 2024-04-13T10:59:10.075 INFO:tasks.workunit.client.0.smithi134.stdout:1/394: dread d3/d6/f27 [0,4194304] 0 2024-04-13T10:59:10.076 INFO:tasks.workunit.client.0.smithi134.stdout:9/481: creat d13/da3/fab x:0 0 0 2024-04-13T10:59:10.080 INFO:tasks.workunit.client.0.smithi134.stdout:1/395: fsync d3/d6/d20/f42 0 2024-04-13T10:59:10.089 INFO:tasks.workunit.client.0.smithi134.stdout:9/482: dwrite d13/f76 [0,4194304] 0 2024-04-13T10:59:10.089 INFO:tasks.workunit.client.0.smithi134.stdout:6/395: getdents d4/da/d15/d1f/d24/d2b 0 2024-04-13T10:59:10.092 INFO:tasks.workunit.client.0.smithi134.stdout:1/396: write d3/d6/d16/f19 [2573440,34946] 0 2024-04-13T10:59:10.095 INFO:tasks.workunit.client.0.smithi134.stdout:9/483: unlink d13/d2e/d35/f68 0 2024-04-13T10:59:10.096 INFO:tasks.workunit.client.0.smithi134.stdout:9/484: fdatasync d13/da3/f84 0 2024-04-13T10:59:10.097 INFO:tasks.workunit.client.0.smithi134.stdout:9/485: dread - d13/d39/f62 zero size 2024-04-13T10:59:10.105 INFO:tasks.workunit.client.0.smithi134.stdout:9/486: mkdir d13/d39/d58/d5f/dac 0 2024-04-13T10:59:10.111 INFO:tasks.workunit.client.0.smithi134.stdout:6/396: dwrite d4/da/d15/d1f/d24/d2b/f2e [0,4194304] 0 2024-04-13T10:59:10.112 INFO:tasks.workunit.client.0.smithi134.stdout:6/397: stat d4/da/d15/d1f/f6b 0 2024-04-13T10:59:10.113 INFO:tasks.workunit.client.0.smithi134.stdout:9/487: symlink d13/d39/d58/d5f/dac/lad 0 2024-04-13T10:59:10.116 INFO:tasks.workunit.client.0.smithi134.stdout:1/397: dwrite d3/d6/f31 [0,4194304] 0 2024-04-13T10:59:10.118 INFO:tasks.workunit.client.0.smithi134.stdout:6/398: dread d4/da/d15/d1f/d24/f3e [0,4194304] 0 2024-04-13T10:59:10.119 INFO:tasks.workunit.client.0.smithi134.stdout:9/488: dread d13/d40/f42 [0,4194304] 0 2024-04-13T10:59:10.121 INFO:tasks.workunit.client.0.smithi134.stdout:1/398: mknod d3/d6/d16/d1d/d68/c87 0 2024-04-13T10:59:10.123 INFO:tasks.workunit.client.0.smithi134.stdout:6/399: truncate d4/da/f2f 1880486 0 2024-04-13T10:59:10.124 INFO:tasks.workunit.client.0.smithi134.stdout:9/489: dread d13/f57 [0,4194304] 0 2024-04-13T10:59:10.127 INFO:tasks.workunit.client.0.smithi134.stdout:1/399: unlink d3/d6/f3a 0 2024-04-13T10:59:10.127 INFO:tasks.workunit.client.0.smithi134.stdout:1/400: chown d3/d30/f85 33 1 2024-04-13T10:59:10.128 INFO:tasks.workunit.client.0.smithi134.stdout:1/401: chown d3/d6/d20/d6d/c72 0 1 2024-04-13T10:59:10.129 INFO:tasks.workunit.client.0.smithi134.stdout:1/402: chown d3/d1e/l2a 98 1 2024-04-13T10:59:10.130 INFO:tasks.workunit.client.0.smithi134.stdout:6/400: rmdir d4/da/d15/d1f/d24 39 2024-04-13T10:59:10.131 INFO:tasks.workunit.client.0.smithi134.stdout:9/490: symlink d13/d2e/d35/d50/d59/lae 0 2024-04-13T10:59:10.131 INFO:tasks.workunit.client.0.smithi134.stdout:9/491: readlink d13/d40/d7d/l85 0 2024-04-13T10:59:10.135 INFO:tasks.workunit.client.0.smithi134.stdout:9/492: dread d13/d2e/d47/f94 [0,4194304] 0 2024-04-13T10:59:10.136 INFO:tasks.workunit.client.0.smithi134.stdout:6/401: creat d4/da/d69/f78 x:0 0 0 2024-04-13T10:59:10.141 INFO:tasks.workunit.client.0.smithi134.stdout:9/493: mknod d13/d2e/d35/caf 0 2024-04-13T10:59:10.143 INFO:tasks.workunit.client.0.smithi134.stdout:1/403: getdents d3/d6/d20/d28 0 2024-04-13T10:59:10.144 INFO:tasks.workunit.client.0.smithi134.stdout:1/404: write d3/d30/f85 [318872,77723] 0 2024-04-13T10:59:10.145 INFO:tasks.workunit.client.0.smithi134.stdout:1/405: dread - d3/d6/d6a/f6e zero size 2024-04-13T10:59:10.147 INFO:tasks.workunit.client.0.smithi134.stdout:9/494: mkdir d13/d39/d52/d86/d9f/db0 0 2024-04-13T10:59:10.147 INFO:tasks.workunit.client.0.smithi134.stdout:1/406: write d3/d6/fc [4741420,9985] 0 2024-04-13T10:59:10.150 INFO:tasks.workunit.client.0.smithi134.stdout:9/495: readlink d13/d2e/d35/d50/d59/lae 0 2024-04-13T10:59:10.152 INFO:tasks.workunit.client.0.smithi134.stdout:1/407: dread d3/d6/dd/f56 [0,4194304] 0 2024-04-13T10:59:10.154 INFO:tasks.workunit.client.0.smithi134.stdout:6/402: dwrite d4/da/d15/d1f/d24/f62 [0,4194304] 0 2024-04-13T10:59:10.158 INFO:tasks.workunit.client.0.smithi134.stdout:1/408: read d3/d30/f85 [388358,71173] 0 2024-04-13T10:59:10.160 INFO:tasks.workunit.client.0.smithi134.stdout:9/496: dwrite fc [0,4194304] 0 2024-04-13T10:59:10.162 INFO:tasks.workunit.client.0.smithi134.stdout:9/497: dread - d13/d2e/d35/d50/d59/d74/f95 zero size 2024-04-13T10:59:10.162 INFO:tasks.workunit.client.0.smithi134.stdout:1/409: creat d3/d6/d20/d71/f88 x:0 0 0 2024-04-13T10:59:10.165 INFO:tasks.workunit.client.0.smithi134.stdout:1/410: mkdir d3/d6/d20/d89 0 2024-04-13T10:59:10.170 INFO:tasks.workunit.client.0.smithi134.stdout:1/411: creat d3/d6/d16/d1d/d68/f8a x:0 0 0 2024-04-13T10:59:10.170 INFO:tasks.workunit.client.0.smithi134.stdout:6/403: dwrite d4/da/d15/d1f/d24/d2b/f3f [0,4194304] 0 2024-04-13T10:59:10.175 INFO:tasks.workunit.client.0.smithi134.stdout:1/412: rename d3/d39 to d3/d6/d20/d6d/d8b 0 2024-04-13T10:59:10.177 INFO:tasks.workunit.client.0.smithi134.stdout:6/404: mknod d4/da/d15/c79 0 2024-04-13T10:59:10.184 INFO:tasks.workunit.client.0.smithi134.stdout:1/413: dwrite d3/d6/d20/d6d/f74 [0,4194304] 0 2024-04-13T10:59:10.186 INFO:tasks.workunit.client.0.smithi134.stdout:6/405: dwrite d4/da/f11 [0,4194304] 0 2024-04-13T10:59:10.214 INFO:tasks.workunit.client.0.smithi134.stdout:1/414: dread d3/d6/d16/d1d/f26 [0,4194304] 0 2024-04-13T10:59:10.218 INFO:tasks.workunit.client.0.smithi134.stdout:1/415: fsync d3/d30/f85 0 2024-04-13T10:59:10.218 INFO:tasks.workunit.client.0.smithi134.stdout:7/366: sync 2024-04-13T10:59:10.218 INFO:tasks.workunit.client.0.smithi134.stdout:0/410: sync 2024-04-13T10:59:10.221 INFO:tasks.workunit.client.0.smithi134.stdout:6/406: dread d4/da/d15/f1e [0,4194304] 0 2024-04-13T10:59:10.223 INFO:tasks.workunit.client.0.smithi134.stdout:1/416: unlink d3/d6/d16/d1d/d3c/l50 0 2024-04-13T10:59:10.226 INFO:tasks.workunit.client.0.smithi134.stdout:1/417: write d3/ff [1365529,3171] 0 2024-04-13T10:59:10.231 INFO:tasks.workunit.client.0.smithi134.stdout:6/407: dwrite d4/da/d15/d1f/d24/f62 [4194304,4194304] 0 2024-04-13T10:59:10.233 INFO:tasks.workunit.client.0.smithi134.stdout:6/408: write d4/da/d15/d1f/d24/f3a [4483036,31019] 0 2024-04-13T10:59:10.238 INFO:tasks.workunit.client.0.smithi134.stdout:6/409: chown d4/da/d15/c55 1290 1 2024-04-13T10:59:10.241 INFO:tasks.workunit.client.0.smithi134.stdout:0/411: dread d4/d17/da/f90 [0,4194304] 0 2024-04-13T10:59:10.241 INFO:tasks.workunit.client.0.smithi134.stdout:7/367: write da/d15/f6e [1362539,58875] 0 2024-04-13T10:59:10.243 INFO:tasks.workunit.client.0.smithi134.stdout:7/368: fdatasync da/d15/d26/d4a/f59 0 2024-04-13T10:59:10.243 INFO:tasks.workunit.client.0.smithi134.stdout:0/412: write d4/d17/da/d22/d37/f40 [997067,65187] 0 2024-04-13T10:59:10.244 INFO:tasks.workunit.client.0.smithi134.stdout:7/369: fdatasync da/d15/d26/d27/d47/f61 0 2024-04-13T10:59:10.244 INFO:tasks.workunit.client.0.smithi134.stdout:0/413: chown d4/d17/d20/c52 7151230 1 2024-04-13T10:59:10.246 INFO:tasks.workunit.client.0.smithi134.stdout:1/418: truncate d3/d6/f31 1116018 0 2024-04-13T10:59:10.253 INFO:tasks.workunit.client.0.smithi134.stdout:7/370: chown da/d15/d26/d27/d3d/d46/c56 12237 1 2024-04-13T10:59:10.253 INFO:tasks.workunit.client.0.smithi134.stdout:6/410: dwrite d4/f18 [4194304,4194304] 0 2024-04-13T10:59:10.256 INFO:tasks.workunit.client.0.smithi134.stdout:0/414: mknod d4/d17/d20/d29/c9b 0 2024-04-13T10:59:10.258 INFO:tasks.workunit.client.0.smithi134.stdout:1/419: rename d3/d6/dd/l1c to d3/d6/d16/d4d/d65/l8c 0 2024-04-13T10:59:10.259 INFO:tasks.workunit.client.0.smithi134.stdout:7/371: chown da/l2f 1 1 2024-04-13T10:59:10.261 INFO:tasks.workunit.client.0.smithi134.stdout:7/372: dread - da/d15/d26/d27/d4f/d5f/d67/f80 zero size 2024-04-13T10:59:10.262 INFO:tasks.workunit.client.0.smithi134.stdout:7/373: read - da/d15/d26/d38/f66 zero size 2024-04-13T10:59:10.263 INFO:tasks.workunit.client.0.smithi134.stdout:1/420: mknod d3/d6/d16/d4d/c8d 0 2024-04-13T10:59:10.264 INFO:tasks.workunit.client.0.smithi134.stdout:6/411: mknod d4/da/d15/d1f/c7a 0 2024-04-13T10:59:10.265 INFO:tasks.workunit.client.0.smithi134.stdout:6/412: chown d4/da/d1a/f44 124796704 1 2024-04-13T10:59:10.266 INFO:tasks.workunit.client.0.smithi134.stdout:6/413: truncate d4/da/d15/d1f/f4b 632190 0 2024-04-13T10:59:10.271 INFO:tasks.workunit.client.0.smithi134.stdout:7/374: creat da/d15/d26/d27/d4f/d5f/d67/d76/f82 x:0 0 0 2024-04-13T10:59:10.381 INFO:tasks.workunit.client.0.smithi134.stdout:0/415: getdents d4/d17/d23/d51/d6b/d91 0 2024-04-13T10:59:10.384 INFO:tasks.workunit.client.0.smithi134.stdout:7/375: mknod da/d15/d26/d27/d3d/d46/c83 0 2024-04-13T10:59:10.390 INFO:tasks.workunit.client.0.smithi134.stdout:1/421: getdents d3/d6/d20/d6d 0 2024-04-13T10:59:10.391 INFO:tasks.workunit.client.0.smithi134.stdout:0/416: mkdir d4/d17/da/d22/d37/d6d/d97/d9c 0 2024-04-13T10:59:10.397 INFO:tasks.workunit.client.0.smithi134.stdout:6/414: truncate d4/f18 1070135 0 2024-04-13T10:59:10.401 INFO:tasks.workunit.client.0.smithi134.stdout:0/417: dwrite d4/d17/d23/d51/d6a/d94/f67 [0,4194304] 0 2024-04-13T10:59:10.402 INFO:tasks.workunit.client.0.smithi134.stdout:1/422: dread d3/d6/f15 [0,4194304] 0 2024-04-13T10:59:10.404 INFO:tasks.workunit.client.0.smithi134.stdout:6/415: mknod d4/c7b 0 2024-04-13T10:59:10.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/376: write da/d15/d26/d27/f2d [1265931,121004] 0 2024-04-13T10:59:10.414 INFO:tasks.workunit.client.0.smithi134.stdout:6/416: truncate d4/da/d15/d1f/d24/d2b/f51 543224 0 2024-04-13T10:59:10.415 INFO:tasks.workunit.client.0.smithi134.stdout:0/418: dwrite d4/d17/d20/d29/d30/d64/d84/f8d [0,4194304] 0 2024-04-13T10:59:10.416 INFO:tasks.workunit.client.0.smithi134.stdout:1/423: dwrite d3/d6/f7 [0,4194304] 0 2024-04-13T10:59:10.417 INFO:tasks.workunit.client.0.smithi134.stdout:7/377: dread da/d15/d26/f28 [0,4194304] 0 2024-04-13T10:59:10.419 INFO:tasks.workunit.client.0.smithi134.stdout:1/424: fsync d3/d6/fc 0 2024-04-13T10:59:10.422 INFO:tasks.workunit.client.0.smithi134.stdout:6/417: truncate d4/da/f25 1783697 0 2024-04-13T10:59:10.426 INFO:tasks.workunit.client.0.smithi134.stdout:7/378: write da/d15/f24 [340583,2436] 0 2024-04-13T10:59:10.428 INFO:tasks.workunit.client.0.smithi134.stdout:0/419: creat d4/d17/d23/d51/f9d x:0 0 0 2024-04-13T10:59:10.434 INFO:tasks.workunit.client.0.smithi134.stdout:5/607: sync 2024-04-13T10:59:10.436 INFO:tasks.workunit.client.0.smithi134.stdout:0/420: rename d4/d17/d36 to d4/d17/da/d22/d37/d47/d9e 0 2024-04-13T10:59:10.438 INFO:tasks.workunit.client.0.smithi134.stdout:1/425: creat d3/d6/d16/d1d/d86/f8e x:0 0 0 2024-04-13T10:59:10.439 INFO:tasks.workunit.client.0.smithi134.stdout:0/421: chown d4/d17/d23/d51/d6b/d91/d98/d62/d7c/c80 6 1 2024-04-13T10:59:10.440 INFO:tasks.workunit.client.0.smithi134.stdout:6/418: truncate d4/f4d 251383 0 2024-04-13T10:59:10.440 INFO:tasks.workunit.client.0.smithi134.stdout:0/422: chown d4/d17/da/f90 34 1 2024-04-13T10:59:10.446 INFO:tasks.workunit.client.0.smithi134.stdout:0/423: unlink d4/d17/da/f90 0 2024-04-13T10:59:10.450 INFO:tasks.workunit.client.0.smithi134.stdout:7/379: dwrite da/d15/d26/d27/d47/d48/f6f [0,4194304] 0 2024-04-13T10:59:10.451 INFO:tasks.workunit.client.0.smithi134.stdout:7/380: chown da/d15/f22 557895 1 2024-04-13T10:59:10.458 INFO:tasks.workunit.client.0.smithi134.stdout:7/381: stat da/d15/d26/d27/d47/f55 0 2024-04-13T10:59:10.461 INFO:tasks.workunit.client.0.smithi134.stdout:6/419: dwrite d4/da/d15/d1f/d3c/f59 [4194304,4194304] 0 2024-04-13T10:59:10.462 INFO:tasks.workunit.client.0.smithi134.stdout:5/608: truncate dc/f17 4446537 0 2024-04-13T10:59:10.471 INFO:tasks.workunit.client.0.smithi134.stdout:0/424: symlink d4/d17/d23/d51/d6b/d91/d98/d62/d7c/l9f 0 2024-04-13T10:59:10.478 INFO:tasks.workunit.client.0.smithi134.stdout:5/609: symlink dc/d1d/d2f/d3b/d6a/lca 0 2024-04-13T10:59:10.486 INFO:tasks.workunit.client.0.smithi134.stdout:0/425: dwrite d4/d17/d20/d29/f87 [0,4194304] 0 2024-04-13T10:59:10.489 INFO:tasks.workunit.client.0.smithi134.stdout:6/420: creat d4/da/d15/d76/f7c x:0 0 0 2024-04-13T10:59:10.490 INFO:tasks.workunit.client.0.smithi134.stdout:5/610: chown dc/d15/d84/la2 1759080 1 2024-04-13T10:59:10.494 INFO:tasks.workunit.client.0.smithi134.stdout:7/382: getdents da/d15/d26/d27/d4f/d5f/d67/d73 0 2024-04-13T10:59:10.503 INFO:tasks.workunit.client.0.smithi134.stdout:6/421: mkdir d4/da/d15/d1f/d3c/d7d 0 2024-04-13T10:59:10.522 INFO:tasks.workunit.client.0.smithi134.stdout:7/383: creat da/d15/d26/d38/f84 x:0 0 0 2024-04-13T10:59:10.526 INFO:tasks.workunit.client.0.smithi134.stdout:5/611: truncate dc/f14 1689058 0 2024-04-13T10:59:10.526 INFO:tasks.workunit.client.0.smithi134.stdout:0/426: getdents d4/d17/da/d22/d37/d47/d96 0 2024-04-13T10:59:10.529 INFO:tasks.workunit.client.0.smithi134.stdout:6/422: mknod d4/da/d15/d1f/c7e 0 2024-04-13T10:59:10.530 INFO:tasks.workunit.client.0.smithi134.stdout:5/612: fdatasync dc/d1d/d2f/d3b/d3c/f57 0 2024-04-13T10:59:10.533 INFO:tasks.workunit.client.0.smithi134.stdout:6/423: write d4/da/d15/d1f/f2a [877593,72269] 0 2024-04-13T10:59:10.534 INFO:tasks.workunit.client.0.smithi134.stdout:6/424: chown d4/c7b 1 1 2024-04-13T10:59:10.535 INFO:tasks.workunit.client.0.smithi134.stdout:0/427: creat d4/d17/d20/d29/d30/d7f/fa0 x:0 0 0 2024-04-13T10:59:10.539 INFO:tasks.workunit.client.0.smithi134.stdout:6/425: dread d4/da/d1a/f44 [0,4194304] 0 2024-04-13T10:59:10.540 INFO:tasks.workunit.client.0.smithi134.stdout:5/613: creat dc/d1d/d2f/d3b/fcb x:0 0 0 2024-04-13T10:59:10.541 INFO:tasks.workunit.client.0.smithi134.stdout:0/428: truncate d4/d17/da/d22/d37/d47/f5e 1452473 0 2024-04-13T10:59:10.542 INFO:tasks.workunit.client.0.smithi134.stdout:7/384: dread da/d15/d26/d27/f34 [0,4194304] 0 2024-04-13T10:59:10.542 INFO:tasks.workunit.client.0.smithi134.stdout:0/429: stat d4/d17/da/f27 0 2024-04-13T10:59:10.543 INFO:tasks.workunit.client.0.smithi134.stdout:5/614: symlink dc/dc1/lcc 0 2024-04-13T10:59:10.544 INFO:tasks.workunit.client.0.smithi134.stdout:6/426: symlink d4/da/d15/d1f/d3c/d7d/l7f 0 2024-04-13T10:59:10.550 INFO:tasks.workunit.client.0.smithi134.stdout:7/385: dwrite da/d15/d26/d27/f2d [0,4194304] 0 2024-04-13T10:59:10.551 INFO:tasks.workunit.client.0.smithi134.stdout:7/386: readlink da/d15/d26/d27/d47/l78 0 2024-04-13T10:59:10.563 INFO:tasks.workunit.client.0.smithi134.stdout:4/317: sync 2024-04-13T10:59:10.570 INFO:tasks.workunit.client.0.smithi134.stdout:6/427: symlink d4/da/l80 0 2024-04-13T10:59:10.572 INFO:tasks.workunit.client.0.smithi134.stdout:7/387: write da/d15/d26/f28 [1778213,120076] 0 2024-04-13T10:59:10.574 INFO:tasks.workunit.client.0.smithi134.stdout:5/615: dread dc/f1b [0,4194304] 0 2024-04-13T10:59:10.575 INFO:tasks.workunit.client.0.smithi134.stdout:7/388: write da/d15/d26/d27/d47/d48/f5d [1602345,58052] 0 2024-04-13T10:59:10.576 INFO:tasks.workunit.client.0.smithi134.stdout:0/430: write d4/d17/da/f27 [2442860,109986] 0 2024-04-13T10:59:10.577 INFO:tasks.workunit.client.0.smithi134.stdout:5/616: write dc/d1d/d46/f70 [1896188,4357] 0 2024-04-13T10:59:10.581 INFO:tasks.workunit.client.0.smithi134.stdout:4/318: getdents d4 0 2024-04-13T10:59:10.582 INFO:tasks.workunit.client.0.smithi134.stdout:0/431: mknod d4/d17/d23/d51/d6b/d91/d98/ca1 0 2024-04-13T10:59:10.584 INFO:tasks.workunit.client.0.smithi134.stdout:7/389: mkdir da/d15/d85 0 2024-04-13T10:59:10.586 INFO:tasks.workunit.client.0.smithi134.stdout:5/617: creat dc/d1d/d2b/d30/d3e/fcd x:0 0 0 2024-04-13T10:59:10.586 INFO:tasks.workunit.client.0.smithi134.stdout:7/390: fdatasync da/d15/d26/d38/f5e 0 2024-04-13T10:59:10.590 INFO:tasks.workunit.client.0.smithi134.stdout:7/391: fsync da/d15/d26/d27/d47/d5a/f72 0 2024-04-13T10:59:10.591 INFO:tasks.workunit.client.0.smithi134.stdout:5/618: truncate dc/d1d/d2f/d3b/d3c/f5d 2246958 0 2024-04-13T10:59:10.592 INFO:tasks.workunit.client.0.smithi134.stdout:4/319: mknod d4/d1f/d27/d3a/c6f 0 2024-04-13T10:59:10.593 INFO:tasks.workunit.client.0.smithi134.stdout:0/432: dwrite d4/d17/da/d22/d37/f65 [0,4194304] 0 2024-04-13T10:59:10.595 INFO:tasks.workunit.client.0.smithi134.stdout:0/433: write d4/d17/da/d22/d38/f7d [1120416,113239] 0 2024-04-13T10:59:10.601 INFO:tasks.workunit.client.0.smithi134.stdout:7/392: mknod da/d15/d26/d27/d47/d5a/c86 0 2024-04-13T10:59:10.604 INFO:tasks.workunit.client.0.smithi134.stdout:0/434: getdents d4/d17/d23/d51/d6b/d91/d98/d8b/d8c 0 2024-04-13T10:59:10.607 INFO:tasks.workunit.client.0.smithi134.stdout:0/435: mkdir d4/d17/d20/d29/d30/d7f/da2 0 2024-04-13T10:59:10.610 INFO:tasks.workunit.client.0.smithi134.stdout:7/393: dwrite da/d15/d26/d27/f5c [0,4194304] 0 2024-04-13T10:59:10.612 INFO:tasks.workunit.client.0.smithi134.stdout:0/436: write d4/d17/d20/d29/d30/d64/d84/f8d [2532432,24581] 0 2024-04-13T10:59:10.614 INFO:tasks.workunit.client.0.smithi134.stdout:0/437: fdatasync d4/d17/d23/d51/d6b/d91/d98/d8b/f93 0 2024-04-13T10:59:10.616 INFO:tasks.workunit.client.0.smithi134.stdout:5/619: write dc/d1d/d2f/d3b/d3c/fa4 [507134,10816] 0 2024-04-13T10:59:10.616 INFO:tasks.workunit.client.0.smithi134.stdout:7/394: unlink da/d15/d26/d27/c53 0 2024-04-13T10:59:10.620 INFO:tasks.workunit.client.0.smithi134.stdout:5/620: chown dc/d1d/d20/d23/d36 33 1 2024-04-13T10:59:10.620 INFO:tasks.workunit.client.0.smithi134.stdout:5/621: chown dc/d1d/d20/d23/d36 0 1 2024-04-13T10:59:10.620 INFO:tasks.workunit.client.0.smithi134.stdout:0/438: mknod d4/d17/d23/d51/ca3 0 2024-04-13T10:59:10.623 INFO:tasks.workunit.client.0.smithi134.stdout:7/395: mknod da/d15/d26/d27/d3d/c87 0 2024-04-13T10:59:10.625 INFO:tasks.workunit.client.0.smithi134.stdout:7/396: write da/d15/d26/d27/f5c [2825261,36249] 0 2024-04-13T10:59:10.628 INFO:tasks.workunit.client.0.smithi134.stdout:0/439: creat d4/fa4 x:0 0 0 2024-04-13T10:59:10.628 INFO:tasks.workunit.client.0.smithi134.stdout:5/622: symlink dc/d1d/lce 0 2024-04-13T10:59:10.629 INFO:tasks.workunit.client.0.smithi134.stdout:5/623: readlink dc/d39/d63/d99/lc9 0 2024-04-13T10:59:10.633 INFO:tasks.workunit.client.0.smithi134.stdout:0/440: mkdir d4/d17/da/d22/d37/d6d/da5 0 2024-04-13T10:59:10.635 INFO:tasks.workunit.client.0.smithi134.stdout:5/624: unlink dc/d1d/d2f/d3b/c4e 0 2024-04-13T10:59:10.637 INFO:tasks.workunit.client.0.smithi134.stdout:5/625: write dc/d15/d84/f9c [1026279,84261] 0 2024-04-13T10:59:10.637 INFO:tasks.workunit.client.0.smithi134.stdout:0/441: dread d4/d17/da/d22/d37/d47/d96/f9a [0,4194304] 0 2024-04-13T10:59:10.642 INFO:tasks.workunit.client.0.smithi134.stdout:5/626: creat dc/d15/d65/fcf x:0 0 0 2024-04-13T10:59:10.646 INFO:tasks.workunit.client.0.smithi134.stdout:0/442: symlink d4/d17/da/d22/d41/d6e/la6 0 2024-04-13T10:59:10.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/397: truncate da/d15/f77 279313 0 2024-04-13T10:59:10.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/398: chown da/d15/d26/f35 1980865 1 2024-04-13T10:59:10.650 INFO:tasks.workunit.client.0.smithi134.stdout:5/627: mkdir dc/d15/dab/dd0 0 2024-04-13T10:59:10.654 INFO:tasks.workunit.client.0.smithi134.stdout:0/443: unlink d4/d17/d20/d29/c53 0 2024-04-13T10:59:10.658 INFO:tasks.workunit.client.0.smithi134.stdout:5/628: dread dc/d1d/f1f [0,4194304] 0 2024-04-13T10:59:10.660 INFO:tasks.workunit.client.0.smithi134.stdout:7/399: dread - da/d15/d26/d27/d3d/d46/f4b zero size 2024-04-13T10:59:10.662 INFO:tasks.workunit.client.0.smithi134.stdout:7/400: dread - da/d15/d26/f62 zero size 2024-04-13T10:59:10.663 INFO:tasks.workunit.client.0.smithi134.stdout:7/401: stat da/f33 0 2024-04-13T10:59:10.666 INFO:tasks.workunit.client.0.smithi134.stdout:5/629: dwrite dc/d1d/d2f/d3b/d3c/fa4 [0,4194304] 0 2024-04-13T10:59:10.668 INFO:tasks.workunit.client.0.smithi134.stdout:5/630: truncate dc/d15/f94 630091 0 2024-04-13T10:59:10.668 INFO:tasks.workunit.client.0.smithi134.stdout:7/402: unlink da/c23 0 2024-04-13T10:59:10.671 INFO:tasks.workunit.client.0.smithi134.stdout:7/403: unlink da/d15/d26/d27/d3d/c87 0 2024-04-13T10:59:10.674 INFO:tasks.workunit.client.0.smithi134.stdout:5/631: rename dc/d1d/d46/f47 to dc/d1d/d2f/d3b/d7f/d8d/d7d/fd1 0 2024-04-13T10:59:10.676 INFO:tasks.workunit.client.0.smithi134.stdout:7/404: mkdir da/d15/d26/d27/d4f/d5f/d88 0 2024-04-13T10:59:10.679 INFO:tasks.workunit.client.0.smithi134.stdout:5/632: creat dc/d1d/d2f/d3b/d7f/d8d/d7d/d91/fd2 x:0 0 0 2024-04-13T10:59:10.685 INFO:tasks.workunit.client.0.smithi134.stdout:7/405: dwrite da/d15/d26/f28 [0,4194304] 0 2024-04-13T10:59:10.694 INFO:tasks.workunit.client.0.smithi134.stdout:5/633: dread dc/d1d/d2f/d3b/d3c/f5d [0,4194304] 0 2024-04-13T10:59:10.700 INFO:tasks.workunit.client.0.smithi134.stdout:7/406: dread da/d15/d26/f35 [0,4194304] 0 2024-04-13T10:59:10.712 INFO:tasks.workunit.client.0.smithi134.stdout:5/634: dread dc/d1d/d2f/d3b/d7f/d8d/d7d/dc0/fc4 [0,4194304] 0 2024-04-13T10:59:10.713 INFO:tasks.workunit.client.0.smithi134.stdout:5/635: truncate dc/d1d/d20/fae 892919 0 2024-04-13T10:59:10.714 INFO:tasks.workunit.client.0.smithi134.stdout:5/636: write dc/f28 [8218439,58978] 0 2024-04-13T10:59:10.793 INFO:tasks.workunit.client.0.smithi134.stdout:3/347: sync 2024-04-13T10:59:10.793 INFO:tasks.workunit.client.0.smithi134.stdout:8/453: sync 2024-04-13T10:59:10.794 INFO:tasks.workunit.client.0.smithi134.stdout:3/348: write dc/d27/d4d/d4f/d50/f53 [932796,17879] 0 2024-04-13T10:59:10.796 INFO:tasks.workunit.client.0.smithi134.stdout:7/407: rmdir da/d15/d26/d27/d4f 39 2024-04-13T10:59:10.802 INFO:tasks.workunit.client.0.smithi134.stdout:3/349: mknod dc/c6f 0 2024-04-13T10:59:10.804 INFO:tasks.workunit.client.0.smithi134.stdout:8/454: dwrite d8/dc/d37/f3b [0,4194304] 0 2024-04-13T10:59:10.807 INFO:tasks.workunit.client.0.smithi134.stdout:7/408: rename da/d15/l37 to da/d15/d26/l89 0 2024-04-13T10:59:10.811 INFO:tasks.workunit.client.0.smithi134.stdout:7/409: fdatasync f5 0 2024-04-13T10:59:10.814 INFO:tasks.workunit.client.0.smithi134.stdout:3/350: write dc/d1d/f39 [87912,19886] 0 2024-04-13T10:59:10.816 INFO:tasks.workunit.client.0.smithi134.stdout:8/455: dwrite d8/dc/f45 [0,4194304] 0 2024-04-13T10:59:10.816 INFO:tasks.workunit.client.0.smithi134.stdout:3/351: dread - dc/d27/d19/f6a zero size 2024-04-13T10:59:10.825 INFO:tasks.workunit.client.0.smithi134.stdout:7/410: creat da/d15/f8a x:0 0 0 2024-04-13T10:59:10.826 INFO:tasks.workunit.client.0.smithi134.stdout:7/411: write da/f54 [789156,14495] 0 2024-04-13T10:59:10.829 INFO:tasks.workunit.client.0.smithi134.stdout:7/412: symlink da/d15/d26/l8b 0 2024-04-13T10:59:10.830 INFO:tasks.workunit.client.0.smithi134.stdout:7/413: readlink da/d15/l7f 0 2024-04-13T10:59:10.830 INFO:tasks.workunit.client.0.smithi134.stdout:7/414: readlink da/d15/d26/l3b 0 2024-04-13T10:59:10.832 INFO:tasks.workunit.client.0.smithi134.stdout:7/415: fsync f5 0 2024-04-13T10:59:10.835 INFO:tasks.workunit.client.0.smithi134.stdout:7/416: creat da/d15/d26/d38/f8c x:0 0 0 2024-04-13T10:59:10.841 INFO:tasks.workunit.client.0.smithi134.stdout:8/456: dread d8/dc/d16/f2d [0,4194304] 0 2024-04-13T10:59:10.841 INFO:tasks.workunit.client.0.smithi134.stdout:7/417: rename da/d15/d26/d4a/f59 to da/d15/d26/d27/d4f/d5f/d88/f8d 0 2024-04-13T10:59:10.844 INFO:tasks.workunit.client.0.smithi134.stdout:3/352: dread dc/d27/d4d/d4f/d50/d25/f47 [0,4194304] 0 2024-04-13T10:59:10.844 INFO:tasks.workunit.client.0.smithi134.stdout:7/418: mknod da/d15/d26/d27/d4f/d5f/d88/c8e 0 2024-04-13T10:59:10.846 INFO:tasks.workunit.client.0.smithi134.stdout:3/353: write dc/d27/f52 [301001,102714] 0 2024-04-13T10:59:10.847 INFO:tasks.workunit.client.0.smithi134.stdout:7/419: readlink da/d15/d26/d27/d47/l78 0 2024-04-13T10:59:10.850 INFO:tasks.workunit.client.0.smithi134.stdout:8/457: dwrite d8/dc/d16/d54/d6f/f90 [0,4194304] 0 2024-04-13T10:59:10.861 INFO:tasks.workunit.client.0.smithi134.stdout:8/458: dwrite d8/dc/d16/d54/f59 [0,4194304] 0 2024-04-13T10:59:10.865 INFO:tasks.workunit.client.0.smithi134.stdout:3/354: dread dc/d27/d4d/d4f/d50/d25/f3e [0,4194304] 0 2024-04-13T10:59:10.866 INFO:tasks.workunit.client.0.smithi134.stdout:8/459: mkdir d8/dc/d16/d54/d92 0 2024-04-13T10:59:10.871 INFO:tasks.workunit.client.0.smithi134.stdout:3/355: creat dc/d27/d19/f70 x:0 0 0 2024-04-13T10:59:10.872 INFO:tasks.workunit.client.0.smithi134.stdout:8/460: write d8/dc/d16/f2d [548025,102584] 0 2024-04-13T10:59:10.874 INFO:tasks.workunit.client.0.smithi134.stdout:8/461: chown d8/l18 2 1 2024-04-13T10:59:10.879 INFO:tasks.workunit.client.0.smithi134.stdout:3/356: getdents dc/d27/d4d/d4f/d50/d25 0 2024-04-13T10:59:10.879 INFO:tasks.workunit.client.0.smithi134.stdout:3/357: chown dc/d2a 1079 1 2024-04-13T10:59:10.886 INFO:tasks.workunit.client.0.smithi134.stdout:3/358: creat dc/f71 x:0 0 0 2024-04-13T10:59:10.888 INFO:tasks.workunit.client.0.smithi134.stdout:3/359: rename dc/d27/d19/d48/d49/d54 to dc/d1d/d58/d72 0 2024-04-13T10:59:10.896 INFO:tasks.workunit.client.0.smithi134.stdout:3/360: write dc/d27/d19/d4b/f6b [2598451,38273] 0 2024-04-13T10:59:10.899 INFO:tasks.workunit.client.0.smithi134.stdout:3/361: write dc/d27/d4d/f6e [3497913,127247] 0 2024-04-13T10:59:10.900 INFO:tasks.workunit.client.0.smithi134.stdout:3/362: readlink dc/d27/d4d/l35 0 2024-04-13T10:59:10.900 INFO:tasks.workunit.client.0.smithi134.stdout:3/363: chown dc/d27/f18 12 1 2024-04-13T10:59:10.906 INFO:tasks.workunit.client.0.smithi134.stdout:3/364: truncate dc/d27/d4d/f5e 1248767 0 2024-04-13T10:59:10.909 INFO:tasks.workunit.client.0.smithi134.stdout:3/365: rename dc/d27/d19/c2e to dc/d1d/d58/d72/c73 0 2024-04-13T10:59:10.920 INFO:tasks.workunit.client.0.smithi134.stdout:3/366: dread dc/f55 [0,4194304] 0 2024-04-13T10:59:10.929 INFO:tasks.workunit.client.0.smithi134.stdout:3/367: truncate dc/d27/d4d/f32 2587154 0 2024-04-13T10:59:10.929 INFO:tasks.workunit.client.0.smithi134.stdout:3/368: read - dc/d27/d19/f70 zero size 2024-04-13T10:59:10.932 INFO:tasks.workunit.client.0.smithi134.stdout:3/369: link dc/d27/f52 dc/d27/d4d/d4f/d50/d25/f74 0 2024-04-13T10:59:10.933 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:10 smithi134 ceph-mon[39696]: pgmap v39: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 25 MiB/s rd, 117 MiB/s wr, 297 op/s 2024-04-13T10:59:10.937 INFO:tasks.workunit.client.0.smithi134.stdout:3/370: dwrite dc/d27/d4d/d4f/d50/f53 [0,4194304] 0 2024-04-13T10:59:10.940 INFO:tasks.workunit.client.0.smithi134.stdout:3/371: mkdir dc/d27/d4d/d4f/d50/d25/d5f/d75 0 2024-04-13T10:59:10.956 INFO:tasks.workunit.client.0.smithi134.stdout:3/372: dread dc/d27/d4d/d4f/d50/f20 [0,4194304] 0 2024-04-13T10:59:10.967 INFO:tasks.workunit.client.0.smithi134.stdout:1/426: sync 2024-04-13T10:59:10.967 INFO:tasks.workunit.client.0.smithi134.stdout:2/405: sync 2024-04-13T10:59:10.967 INFO:tasks.workunit.client.0.smithi134.stdout:9/498: sync 2024-04-13T10:59:10.967 INFO:tasks.workunit.client.0.smithi134.stdout:6/428: sync 2024-04-13T10:59:10.969 INFO:tasks.workunit.client.0.smithi134.stdout:2/406: write d5/de/d50/f56 [4090516,51960] 0 2024-04-13T10:59:10.969 INFO:tasks.workunit.client.0.smithi134.stdout:6/429: read d4/da/d15/d1f/d3c/f45 [894430,33728] 0 2024-04-13T10:59:10.969 INFO:tasks.workunit.client.0.smithi134.stdout:3/373: rename dc/d27/d19/d4b/l63 to dc/d27/l76 0 2024-04-13T10:59:10.973 INFO:tasks.workunit.client.0.smithi134.stdout:1/427: rmdir d3/d6 39 2024-04-13T10:59:10.974 INFO:tasks.workunit.client.0.smithi134.stdout:6/430: dread d4/da/f11 [0,4194304] 0 2024-04-13T10:59:10.975 INFO:tasks.workunit.client.0.smithi134.stdout:6/431: dread - d4/f75 zero size 2024-04-13T10:59:10.979 INFO:tasks.workunit.client.0.smithi134.stdout:9/499: fdatasync d13/d40/f48 0 2024-04-13T10:59:10.984 INFO:tasks.workunit.client.0.smithi134.stdout:2/407: unlink d5/d6/f9 0 2024-04-13T10:59:10.985 INFO:tasks.workunit.client.0.smithi134.stdout:3/374: chown dc/d27/d4d/l5b 93860 1 2024-04-13T10:59:10.989 INFO:tasks.workunit.client.0.smithi134.stdout:9/500: creat d13/d39/d52/fb1 x:0 0 0 2024-04-13T10:59:10.992 INFO:tasks.workunit.client.0.smithi134.stdout:2/408: mknod d5/de/c7f 0 2024-04-13T10:59:10.993 INFO:tasks.workunit.client.0.smithi134.stdout:3/375: chown dc/d27/d19/c37 1187483 1 2024-04-13T10:59:10.995 INFO:tasks.workunit.client.0.smithi134.stdout:1/428: creat d3/d6/d20/f8f x:0 0 0 2024-04-13T10:59:10.996 INFO:tasks.workunit.client.0.smithi134.stdout:6/432: fsync d4/fd 0 2024-04-13T10:59:10.997 INFO:tasks.workunit.client.0.smithi134.stdout:9/501: dwrite d13/d39/d64/f93 [0,4194304] 0 2024-04-13T10:59:10.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:10 smithi194 ceph-mon[46737]: pgmap v39: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 25 MiB/s rd, 117 MiB/s wr, 297 op/s 2024-04-13T10:59:10.999 INFO:tasks.workunit.client.0.smithi134.stdout:9/502: write d13/d39/d64/f92 [615207,128908] 0 2024-04-13T10:59:11.000 INFO:tasks.workunit.client.0.smithi134.stdout:2/409: write d5/d6/f68 [1717756,128546] 0 2024-04-13T10:59:11.007 INFO:tasks.workunit.client.0.smithi134.stdout:3/376: mkdir dc/d27/d19/d48/d77 0 2024-04-13T10:59:11.008 INFO:tasks.workunit.client.0.smithi134.stdout:9/503: dwrite d13/d2e/d35/d50/d59/d74/f95 [0,4194304] 0 2024-04-13T10:59:11.008 INFO:tasks.workunit.client.0.smithi134.stdout:3/377: fsync dc/d27/d4d/f69 0 2024-04-13T10:59:11.013 INFO:tasks.workunit.client.0.smithi134.stdout:1/429: truncate d3/d30/f43 508851 0 2024-04-13T10:59:11.014 INFO:tasks.workunit.client.0.smithi134.stdout:2/410: chown d5/d6/d57/d6f/d30/d58/d73/l74 2 1 2024-04-13T10:59:11.018 INFO:tasks.workunit.client.0.smithi134.stdout:9/504: readlink d13/l25 0 2024-04-13T10:59:11.018 INFO:tasks.workunit.client.0.smithi134.stdout:3/378: rmdir dc/d27/d4d/d4f/d50/d25 39 2024-04-13T10:59:11.020 INFO:tasks.workunit.client.0.smithi134.stdout:3/379: write dc/fe [810808,69990] 0 2024-04-13T10:59:11.020 INFO:tasks.workunit.client.0.smithi134.stdout:6/433: symlink d4/da/l81 0 2024-04-13T10:59:11.023 INFO:tasks.workunit.client.0.smithi134.stdout:2/411: rename d5/c79 to d5/d6/d57/d6f/d30/d58/d73/c80 0 2024-04-13T10:59:11.024 INFO:tasks.workunit.client.0.smithi134.stdout:9/505: mkdir d13/d39/d64/db2 0 2024-04-13T10:59:11.030 INFO:tasks.workunit.client.0.smithi134.stdout:9/506: dwrite d13/d39/d64/f93 [0,4194304] 0 2024-04-13T10:59:11.038 INFO:tasks.workunit.client.0.smithi134.stdout:1/430: truncate d3/d6/f7 5365577 0 2024-04-13T10:59:11.039 INFO:tasks.workunit.client.0.smithi134.stdout:2/412: write d5/d6/d57/d6f/f3a [167334,18131] 0 2024-04-13T10:59:11.039 INFO:tasks.workunit.client.0.smithi134.stdout:3/380: write dc/d27/d4d/d4f/d50/d25/f47 [3200908,96217] 0 2024-04-13T10:59:11.041 INFO:tasks.workunit.client.0.smithi134.stdout:9/507: mkdir d13/da3/d98/db3 0 2024-04-13T10:59:11.041 INFO:tasks.workunit.client.0.smithi134.stdout:1/431: mknod d3/d6/d16/d4d/c90 0 2024-04-13T10:59:11.042 INFO:tasks.workunit.client.0.smithi134.stdout:2/413: fdatasync d5/d6/d57/d6f/d30/f4f 0 2024-04-13T10:59:11.042 INFO:tasks.workunit.client.0.smithi134.stdout:3/381: truncate dc/d1d/f39 191304 0 2024-04-13T10:59:11.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/508: chown d13/d39/d58/d5f/d6e 342962 1 2024-04-13T10:59:11.045 INFO:tasks.workunit.client.0.smithi134.stdout:2/414: truncate d5/de/d50/f60 125210 0 2024-04-13T10:59:11.051 INFO:tasks.workunit.client.0.smithi134.stdout:3/382: symlink dc/d1d/l78 0 2024-04-13T10:59:11.057 INFO:tasks.workunit.client.0.smithi134.stdout:6/434: dwrite d4/f18 [0,4194304] 0 2024-04-13T10:59:11.058 INFO:tasks.workunit.client.0.smithi134.stdout:3/383: mknod dc/d1d/d58/c79 0 2024-04-13T10:59:11.059 INFO:tasks.workunit.client.0.smithi134.stdout:1/432: write d3/d6/d16/f7d [324433,87316] 0 2024-04-13T10:59:11.062 INFO:tasks.workunit.client.0.smithi134.stdout:3/384: write dc/d27/d19/d48/d49/f67 [202000,19579] 0 2024-04-13T10:59:11.063 INFO:tasks.workunit.client.0.smithi134.stdout:2/415: symlink d5/d6/d57/l81 0 2024-04-13T10:59:11.064 INFO:tasks.workunit.client.0.smithi134.stdout:6/435: rmdir d4/da/d15/d57 39 2024-04-13T10:59:11.066 INFO:tasks.workunit.client.0.smithi134.stdout:1/433: chown d3/d6/d16/d1d/d68/l7f 12 1 2024-04-13T10:59:11.069 INFO:tasks.workunit.client.0.smithi134.stdout:3/385: symlink dc/d27/d19/d48/d49/l7a 0 2024-04-13T10:59:11.070 INFO:tasks.workunit.client.0.smithi134.stdout:3/386: dread - dc/d27/d19/f6a zero size 2024-04-13T10:59:11.073 INFO:tasks.workunit.client.0.smithi134.stdout:1/434: mkdir d3/d6/d20/d6d/d8b/d91 0 2024-04-13T10:59:11.075 INFO:tasks.workunit.client.0.smithi134.stdout:9/509: getdents d13/d2e/d35 0 2024-04-13T10:59:11.076 INFO:tasks.workunit.client.0.smithi134.stdout:3/387: mknod dc/d27/d19/d48/d49/c7b 0 2024-04-13T10:59:11.077 INFO:tasks.workunit.client.0.smithi134.stdout:3/388: truncate dc/d27/d19/f36 5216862 0 2024-04-13T10:59:11.078 INFO:tasks.workunit.client.0.smithi134.stdout:1/435: rename d3/d6/d20/d6d/f74 to d3/d6/d20/d6d/d8b/f92 0 2024-04-13T10:59:11.084 INFO:tasks.workunit.client.0.smithi134.stdout:6/436: write d4/da/d1a/f29 [163315,55662] 0 2024-04-13T10:59:11.088 INFO:tasks.workunit.client.0.smithi134.stdout:2/416: dread d5/de/f37 [0,4194304] 0 2024-04-13T10:59:11.109 INFO:tasks.workunit.client.0.smithi134.stdout:2/417: dread d5/de/d50/f56 [0,4194304] 0 2024-04-13T10:59:11.111 INFO:tasks.workunit.client.0.smithi134.stdout:3/389: link dc/d1d/c41 dc/d27/c7c 0 2024-04-13T10:59:11.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/437: creat d4/da/d15/d77/f82 x:0 0 0 2024-04-13T10:59:11.117 INFO:tasks.workunit.client.0.smithi134.stdout:2/418: unlink d5/d6/d57/d6f/c52 0 2024-04-13T10:59:11.117 INFO:tasks.workunit.client.0.smithi134.stdout:9/510: dwrite f4 [0,4194304] 0 2024-04-13T10:59:11.124 INFO:tasks.workunit.client.0.smithi134.stdout:1/436: rename d3/d6/d16/d1d/l5b to d3/d6/d16/d1d/l93 0 2024-04-13T10:59:11.125 INFO:tasks.workunit.client.0.smithi134.stdout:6/438: write d4/da/d15/f1e [1370351,18043] 0 2024-04-13T10:59:11.126 INFO:tasks.workunit.client.0.smithi134.stdout:9/511: dwrite f4 [4194304,4194304] 0 2024-04-13T10:59:11.128 INFO:tasks.workunit.client.0.smithi134.stdout:2/419: dread - d5/de/d12/f43 zero size 2024-04-13T10:59:11.130 INFO:tasks.workunit.client.0.smithi134.stdout:3/390: symlink dc/l7d 0 2024-04-13T10:59:11.132 INFO:tasks.workunit.client.0.smithi134.stdout:1/437: creat d3/d6/d16/d1d/f94 x:0 0 0 2024-04-13T10:59:11.133 INFO:tasks.workunit.client.0.smithi134.stdout:9/512: readlink d13/l15 0 2024-04-13T10:59:11.136 INFO:tasks.workunit.client.0.smithi134.stdout:6/439: creat d4/da/d15/d1f/d24/d49/f83 x:0 0 0 2024-04-13T10:59:11.139 INFO:tasks.workunit.client.0.smithi134.stdout:2/420: dwrite d5/d6/d57/d6f/f44 [0,4194304] 0 2024-04-13T10:59:11.141 INFO:tasks.workunit.client.0.smithi134.stdout:6/440: write d4/f5 [4868383,12886] 0 2024-04-13T10:59:11.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/391: dwrite dc/d27/d19/f3b [0,4194304] 0 2024-04-13T10:59:11.148 INFO:tasks.workunit.client.0.smithi134.stdout:1/438: dwrite d3/d6/d16/d1d/d3c/f70 [0,4194304] 0 2024-04-13T10:59:11.152 INFO:tasks.workunit.client.0.smithi134.stdout:6/441: rename d4/da/d15/l3b to d4/da/d15/d1f/d3c/l84 0 2024-04-13T10:59:11.155 INFO:tasks.workunit.client.0.smithi134.stdout:3/392: creat dc/d1d/d58/f7e x:0 0 0 2024-04-13T10:59:11.157 INFO:tasks.workunit.client.0.smithi134.stdout:1/439: creat d3/d6/d20/d28/f95 x:0 0 0 2024-04-13T10:59:11.158 INFO:tasks.workunit.client.0.smithi134.stdout:6/442: mknod d4/da/d15/d76/c85 0 2024-04-13T10:59:11.160 INFO:tasks.workunit.client.0.smithi134.stdout:3/393: symlink dc/d27/d19/l7f 0 2024-04-13T10:59:11.162 INFO:tasks.workunit.client.0.smithi134.stdout:1/440: creat d3/d6/d16/d1d/d86/f96 x:0 0 0 2024-04-13T10:59:11.170 INFO:tasks.workunit.client.0.smithi134.stdout:1/441: getdents d3/d6/d20/d6d/d8b 0 2024-04-13T10:59:11.171 INFO:tasks.workunit.client.0.smithi134.stdout:1/442: creat d3/d6/d20/d6d/d8b/f97 x:0 0 0 2024-04-13T10:59:11.184 INFO:tasks.workunit.client.0.smithi134.stdout:1/443: write d3/d1e/f25 [4893810,129367] 0 2024-04-13T10:59:11.185 INFO:tasks.workunit.client.0.smithi134.stdout:1/444: chown d3/d6/d20/d6d/d8b/d91 28 1 2024-04-13T10:59:11.187 INFO:tasks.workunit.client.0.smithi134.stdout:1/445: creat d3/d6/d20/d28/f98 x:0 0 0 2024-04-13T10:59:11.192 INFO:tasks.workunit.client.0.smithi134.stdout:3/394: dread dc/d27/f18 [0,4194304] 0 2024-04-13T10:59:11.194 INFO:tasks.workunit.client.0.smithi134.stdout:1/446: dwrite d3/d6/d20/d71/f88 [0,4194304] 0 2024-04-13T10:59:11.196 INFO:tasks.workunit.client.0.smithi134.stdout:3/395: symlink dc/d1d/d58/d72/l80 0 2024-04-13T10:59:11.198 INFO:tasks.workunit.client.0.smithi134.stdout:3/396: readlink dc/d27/d19/d48/d49/l65 0 2024-04-13T10:59:11.200 INFO:tasks.workunit.client.0.smithi134.stdout:3/397: read dc/f10 [8010756,21479] 0 2024-04-13T10:59:11.202 INFO:tasks.workunit.client.0.smithi134.stdout:1/447: link d3/d6/d20/d6d/d8b/f92 d3/d6/d16/d1d/d57/f99 0 2024-04-13T10:59:11.203 INFO:tasks.workunit.client.0.smithi134.stdout:3/398: mkdir dc/d27/d81 0 2024-04-13T10:59:11.203 INFO:tasks.workunit.client.0.smithi134.stdout:1/448: dread - d3/d6/d16/d1d/f84 zero size 2024-04-13T10:59:11.204 INFO:tasks.workunit.client.0.smithi134.stdout:1/449: truncate d3/d30/f77 669682 0 2024-04-13T10:59:11.204 INFO:tasks.workunit.client.0.smithi134.stdout:1/450: chown d3/d6/d16/d1d/d57 168014 1 2024-04-13T10:59:11.205 INFO:tasks.workunit.client.0.smithi134.stdout:1/451: chown d3/d6/d16/d1d/d68/l80 1270271346 1 2024-04-13T10:59:11.205 INFO:tasks.workunit.client.0.smithi134.stdout:3/399: creat dc/d27/d4d/d4f/d50/d25/f82 x:0 0 0 2024-04-13T10:59:11.208 INFO:tasks.workunit.client.0.smithi134.stdout:1/452: creat d3/d1e/f9a x:0 0 0 2024-04-13T10:59:11.208 INFO:tasks.workunit.client.0.smithi134.stdout:3/400: rmdir dc/d27/d4d/d4f/d50/d25/d5f 39 2024-04-13T10:59:11.214 INFO:tasks.workunit.client.0.smithi134.stdout:1/453: rename d3/d6/d20/d6d/d8b/l49 to d3/d30/l9b 0 2024-04-13T10:59:11.214 INFO:tasks.workunit.client.0.smithi134.stdout:3/401: dwrite dc/d27/d4d/d4f/d50/d25/f47 [0,4194304] 0 2024-04-13T10:59:11.216 INFO:tasks.workunit.client.0.smithi134.stdout:1/454: write d3/d6/d20/f7b [847257,52581] 0 2024-04-13T10:59:11.220 INFO:tasks.workunit.client.0.smithi134.stdout:1/455: unlink d3/d6/d16/d4d/c8d 0 2024-04-13T10:59:11.223 INFO:tasks.workunit.client.0.smithi134.stdout:1/456: chown d3/d6/d16/d1d/l93 219578176 1 2024-04-13T10:59:11.224 INFO:tasks.workunit.client.0.smithi134.stdout:1/457: mkdir d3/d6/d20/d71/d9c 0 2024-04-13T10:59:11.224 INFO:tasks.workunit.client.0.smithi134.stdout:1/458: stat d3/d6/d20 0 2024-04-13T10:59:11.227 INFO:tasks.workunit.client.0.smithi134.stdout:1/459: mknod d3/d6/d20/d6d/d8b/c9d 0 2024-04-13T10:59:11.233 INFO:tasks.workunit.client.0.smithi134.stdout:1/460: dwrite d3/d6/d16/d1d/f22 [0,4194304] 0 2024-04-13T10:59:11.235 INFO:tasks.workunit.client.0.smithi134.stdout:3/402: write dc/d27/d19/d48/d49/f6c [1045559,88754] 0 2024-04-13T10:59:11.236 INFO:tasks.workunit.client.0.smithi134.stdout:3/403: stat dc/d27/l3d 0 2024-04-13T10:59:11.241 INFO:tasks.workunit.client.0.smithi134.stdout:3/404: rmdir dc/d27/d4d/d4f 39 2024-04-13T10:59:11.242 INFO:tasks.workunit.client.0.smithi134.stdout:1/461: dread d3/ff [0,4194304] 0 2024-04-13T10:59:11.243 INFO:tasks.workunit.client.0.smithi134.stdout:1/462: chown d3/d6/c2f 281985 1 2024-04-13T10:59:11.244 INFO:tasks.workunit.client.0.smithi134.stdout:3/405: mknod dc/d27/c83 0 2024-04-13T10:59:11.245 INFO:tasks.workunit.client.0.smithi134.stdout:3/406: write dc/d1d/f39 [217762,45180] 0 2024-04-13T10:59:11.248 INFO:tasks.workunit.client.0.smithi134.stdout:1/463: rename d3/d6/d16/d1d/l83 to d3/d6/d20/d6d/d8b/l9e 0 2024-04-13T10:59:11.251 INFO:tasks.workunit.client.0.smithi134.stdout:3/407: rename dc/d27/d19/d48/c57 to dc/d27/d81/c84 0 2024-04-13T10:59:11.267 INFO:tasks.workunit.client.0.smithi134.stdout:3/408: write dc/d1d/f28 [4466935,3062] 0 2024-04-13T10:59:11.272 INFO:tasks.workunit.client.0.smithi134.stdout:1/464: dwrite d3/d6/f4f [0,4194304] 0 2024-04-13T10:59:11.274 INFO:tasks.workunit.client.0.smithi134.stdout:1/465: read d3/d6/d20/f38 [2688768,8912] 0 2024-04-13T10:59:11.277 INFO:tasks.workunit.client.0.smithi134.stdout:3/409: mknod dc/d27/d4d/d4f/d50/d25/c85 0 2024-04-13T10:59:11.368 INFO:tasks.workunit.client.0.smithi134.stdout:1/466: dread d3/d6/d16/d1d/d68/f5d [0,4194304] 0 2024-04-13T10:59:11.368 INFO:tasks.workunit.client.0.smithi134.stdout:1/467: chown d3/d6/d16/d4d/f5f 249511597 1 2024-04-13T10:59:11.370 INFO:tasks.workunit.client.0.smithi134.stdout:3/410: mknod dc/d27/d4d/d4f/d50/d25/d5f/c86 0 2024-04-13T10:59:11.371 INFO:tasks.workunit.client.0.smithi134.stdout:3/411: dread - dc/d27/d4d/d4f/d50/f2b zero size 2024-04-13T10:59:11.372 INFO:tasks.workunit.client.0.smithi134.stdout:3/412: fdatasync dc/d27/d19/d48/d49/f67 0 2024-04-13T10:59:11.372 INFO:tasks.workunit.client.0.smithi134.stdout:3/413: chown dc/l2c 6211830 1 2024-04-13T10:59:11.376 INFO:tasks.workunit.client.0.smithi134.stdout:1/468: rmdir d3/d6/d20/d6d/d8b/d91 0 2024-04-13T10:59:11.378 INFO:tasks.workunit.client.0.smithi134.stdout:1/469: write d3/f45 [3826907,113714] 0 2024-04-13T10:59:11.379 INFO:tasks.workunit.client.0.smithi134.stdout:3/414: dwrite dc/f66 [0,4194304] 0 2024-04-13T10:59:11.381 INFO:tasks.workunit.client.0.smithi134.stdout:1/470: chown d3/d6/d16/d4d/c90 161812656 1 2024-04-13T10:59:11.388 INFO:tasks.workunit.client.0.smithi134.stdout:1/471: rename d3/d6/d16/d1d/d57 to d3/d6/d20/d9f 0 2024-04-13T10:59:11.389 INFO:tasks.workunit.client.0.smithi134.stdout:3/415: dwrite dc/d27/d4d/f6e [0,4194304] 0 2024-04-13T10:59:11.391 INFO:tasks.workunit.client.0.smithi134.stdout:3/416: fsync dc/d27/d4d/d4f/d50/d25/f3c 0 2024-04-13T10:59:11.391 INFO:tasks.workunit.client.0.smithi134.stdout:1/472: creat d3/d6/d16/d4d/d65/fa0 x:0 0 0 2024-04-13T10:59:11.396 INFO:tasks.workunit.client.0.smithi134.stdout:1/473: link d3/d6/d6a/c81 d3/d6/d16/d4d/d65/ca1 0 2024-04-13T10:59:11.418 INFO:tasks.workunit.client.0.smithi134.stdout:1/474: dread d3/d6/f31 [0,4194304] 0 2024-04-13T10:59:11.423 INFO:tasks.workunit.client.0.smithi134.stdout:3/417: dread dc/f10 [4194304,4194304] 0 2024-04-13T10:59:11.424 INFO:tasks.workunit.client.0.smithi134.stdout:1/475: dwrite d3/d6/f55 [0,4194304] 0 2024-04-13T10:59:11.430 INFO:tasks.workunit.client.0.smithi134.stdout:3/418: dread dc/d27/d19/d48/d49/f6c [0,4194304] 0 2024-04-13T10:59:11.433 INFO:tasks.workunit.client.0.smithi134.stdout:3/419: unlink dc/d27/d19/f70 0 2024-04-13T10:59:11.436 INFO:tasks.workunit.client.0.smithi134.stdout:4/320: sync 2024-04-13T10:59:11.437 INFO:tasks.workunit.client.0.smithi134.stdout:3/420: creat dc/d1d/d58/d72/f87 x:0 0 0 2024-04-13T10:59:11.438 INFO:tasks.workunit.client.0.smithi134.stdout:4/321: write d4/dd/f39 [2369113,95793] 0 2024-04-13T10:59:11.441 INFO:tasks.workunit.client.0.smithi134.stdout:1/476: write d3/d6/d20/d6d/d8b/f92 [1202054,104948] 0 2024-04-13T10:59:11.443 INFO:tasks.workunit.client.0.smithi134.stdout:4/322: creat d4/d1b/d32/d67/f70 x:0 0 0 2024-04-13T10:59:11.444 INFO:tasks.workunit.client.0.smithi134.stdout:4/323: write d4/d1f/d27/d2f/f68 [616807,102207] 0 2024-04-13T10:59:11.446 INFO:tasks.workunit.client.0.smithi134.stdout:4/324: mknod d4/d1f/d27/d2f/c71 0 2024-04-13T10:59:11.448 INFO:tasks.workunit.client.0.smithi134.stdout:1/477: getdents d3/d6/d20/d9f 0 2024-04-13T10:59:11.454 INFO:tasks.workunit.client.0.smithi134.stdout:1/478: getdents d3/d6/d20/d6d/d8b 0 2024-04-13T10:59:11.455 INFO:tasks.workunit.client.0.smithi134.stdout:1/479: dread - d3/d6/d16/d4d/d65/f82 zero size 2024-04-13T10:59:11.458 INFO:tasks.workunit.client.0.smithi134.stdout:1/480: rmdir d3/d6/d20 39 2024-04-13T10:59:11.460 INFO:tasks.workunit.client.0.smithi134.stdout:4/325: dread d4/d1f/d27/d2f/f31 [4194304,4194304] 0 2024-04-13T10:59:11.461 INFO:tasks.workunit.client.0.smithi134.stdout:4/326: dread - d4/d1f/d27/d2f/f52 zero size 2024-04-13T10:59:11.462 INFO:tasks.workunit.client.0.smithi134.stdout:4/327: chown d4/d1b/d32/d67/f70 6 1 2024-04-13T10:59:11.466 INFO:tasks.workunit.client.0.smithi134.stdout:1/481: dwrite d3/d6/d20/f38 [4194304,4194304] 0 2024-04-13T10:59:11.468 INFO:tasks.workunit.client.0.smithi134.stdout:4/328: rename d4/d1f/d27/d2f/d38/f4d to d4/d48/f72 0 2024-04-13T10:59:11.469 INFO:tasks.workunit.client.0.smithi134.stdout:4/329: chown d4/d1f/d27/d2f/d38/c54 32493 1 2024-04-13T10:59:11.469 INFO:tasks.workunit.client.0.smithi134.stdout:4/330: readlink d4/dd/l30 0 2024-04-13T10:59:11.473 INFO:tasks.workunit.client.0.smithi134.stdout:4/331: mkdir d4/d1b/d73 0 2024-04-13T10:59:11.475 INFO:tasks.workunit.client.0.smithi134.stdout:4/332: creat d4/d1b/d32/f74 x:0 0 0 2024-04-13T10:59:11.476 INFO:tasks.workunit.client.0.smithi134.stdout:1/482: write d3/d6/d20/f42 [534902,114275] 0 2024-04-13T10:59:11.477 INFO:tasks.workunit.client.0.smithi134.stdout:1/483: fdatasync d3/d6/f7e 0 2024-04-13T10:59:11.485 INFO:tasks.workunit.client.0.smithi134.stdout:1/484: link d3/d6/d16/d4d/l79 d3/d6/d20/la2 0 2024-04-13T10:59:11.489 INFO:tasks.workunit.client.0.smithi134.stdout:1/485: creat d3/d6/d20/d28/fa3 x:0 0 0 2024-04-13T10:59:11.490 INFO:tasks.workunit.client.0.smithi134.stdout:4/333: dwrite d4/d1b/f28 [0,4194304] 0 2024-04-13T10:59:11.497 INFO:tasks.workunit.client.0.smithi134.stdout:1/486: dwrite d3/d6/d20/d9f/f99 [0,4194304] 0 2024-04-13T10:59:11.498 INFO:tasks.workunit.client.0.smithi134.stdout:4/334: dread d4/d1f/d27/d2f/f31 [4194304,4194304] 0 2024-04-13T10:59:11.521 INFO:tasks.workunit.client.0.smithi134.stdout:4/335: rename d4/d1f/d27/d2f to d4/d1f/d27/d75 0 2024-04-13T10:59:11.522 INFO:tasks.workunit.client.0.smithi134.stdout:4/336: write d4/d1f/f5b [463089,35589] 0 2024-04-13T10:59:11.532 INFO:tasks.workunit.client.0.smithi134.stdout:1/487: write d3/d6/d16/d1d/d3c/f53 [3097144,24769] 0 2024-04-13T10:59:11.539 INFO:tasks.workunit.client.0.smithi134.stdout:1/488: dwrite d3/d6/d16/d4d/d65/fa0 [0,4194304] 0 2024-04-13T10:59:11.540 INFO:tasks.workunit.client.0.smithi134.stdout:1/489: fdatasync d3/d6/f7e 0 2024-04-13T10:59:11.541 INFO:tasks.workunit.client.0.smithi134.stdout:1/490: dread - d3/d6/d16/d1d/d86/f96 zero size 2024-04-13T10:59:11.543 INFO:tasks.workunit.client.0.smithi134.stdout:1/491: creat d3/d6/d20/d71/fa4 x:0 0 0 2024-04-13T10:59:11.544 INFO:tasks.workunit.client.0.smithi134.stdout:1/492: fsync d3/d1e/f25 0 2024-04-13T10:59:11.545 INFO:tasks.workunit.client.0.smithi134.stdout:1/493: fdatasync d3/d6/d16/d1d/d86/f96 0 2024-04-13T10:59:11.548 INFO:tasks.workunit.client.0.smithi134.stdout:1/494: symlink d3/d6/d20/d89/la5 0 2024-04-13T10:59:11.552 INFO:tasks.workunit.client.0.smithi134.stdout:1/495: creat d3/fa6 x:0 0 0 2024-04-13T10:59:11.554 INFO:tasks.workunit.client.0.smithi134.stdout:1/496: unlink d3/f45 0 2024-04-13T10:59:11.556 INFO:tasks.workunit.client.0.smithi134.stdout:1/497: creat d3/d6/d16/d1d/d86/fa7 x:0 0 0 2024-04-13T10:59:11.557 INFO:tasks.workunit.client.0.smithi134.stdout:1/498: dread - d3/d6/d16/d1d/d68/f8a zero size 2024-04-13T10:59:11.558 INFO:tasks.workunit.client.0.smithi134.stdout:1/499: dread - d3/d6/d16/d1d/f84 zero size 2024-04-13T10:59:11.564 INFO:tasks.workunit.client.0.smithi134.stdout:1/500: dwrite d3/d6/d20/f7b [0,4194304] 0 2024-04-13T10:59:11.577 INFO:tasks.workunit.client.0.smithi134.stdout:1/501: dwrite d3/d1e/f46 [0,4194304] 0 2024-04-13T10:59:11.583 INFO:tasks.workunit.client.0.smithi134.stdout:1/502: link d3/d6/d20/d28/f3e d3/d6/d16/fa8 0 2024-04-13T10:59:11.586 INFO:tasks.workunit.client.0.smithi134.stdout:1/503: creat d3/d6/d20/d9f/fa9 x:0 0 0 2024-04-13T10:59:11.588 INFO:tasks.workunit.client.0.smithi134.stdout:1/504: creat d3/d6/d16/d1d/d68/faa x:0 0 0 2024-04-13T10:59:11.589 INFO:tasks.workunit.client.0.smithi134.stdout:1/505: stat d3/d6/d16/d1d/d68 0 2024-04-13T10:59:11.590 INFO:tasks.workunit.client.0.smithi134.stdout:1/506: fsync d3/d6/f15 0 2024-04-13T10:59:11.590 INFO:tasks.workunit.client.0.smithi134.stdout:1/507: stat d3/d30/f85 0 2024-04-13T10:59:11.591 INFO:tasks.workunit.client.0.smithi134.stdout:1/508: readlink d3/d6/d20/d6d/d8b/l3b 0 2024-04-13T10:59:11.593 INFO:tasks.workunit.client.0.smithi134.stdout:1/509: mkdir d3/d6/d16/d1d/dab 0 2024-04-13T10:59:11.594 INFO:tasks.workunit.client.0.smithi134.stdout:1/510: truncate d3/d6/d20/f75 916409 0 2024-04-13T10:59:11.595 INFO:tasks.workunit.client.0.smithi134.stdout:1/511: read d3/d30/f77 [669459,11376] 0 2024-04-13T10:59:11.599 INFO:tasks.workunit.client.0.smithi134.stdout:1/512: unlink d3/c29 0 2024-04-13T10:59:11.605 INFO:tasks.workunit.client.0.smithi134.stdout:1/513: rename d3/d30/f43 to d3/d6/d16/d1d/d68/fac 0 2024-04-13T10:59:11.609 INFO:tasks.workunit.client.0.smithi134.stdout:1/514: truncate d3/d6/fc 4478346 0 2024-04-13T10:59:11.625 INFO:tasks.workunit.client.0.smithi134.stdout:1/515: dwrite d3/d30/f48 [0,4194304] 0 2024-04-13T10:59:11.627 INFO:tasks.workunit.client.0.smithi134.stdout:1/516: write d3/d6/d16/d1d/d86/fa7 [300391,66921] 0 2024-04-13T10:59:11.630 INFO:tasks.workunit.client.0.smithi134.stdout:1/517: symlink d3/d6/d20/d89/lad 0 2024-04-13T10:59:11.638 INFO:tasks.workunit.client.0.smithi134.stdout:0/444: sync 2024-04-13T10:59:11.638 INFO:tasks.workunit.client.0.smithi134.stdout:5/637: sync 2024-04-13T10:59:11.638 INFO:tasks.workunit.client.0.smithi134.stdout:7/420: sync 2024-04-13T10:59:11.641 INFO:tasks.workunit.client.0.smithi134.stdout:7/421: unlink da/f1d 0 2024-04-13T10:59:11.641 INFO:tasks.workunit.client.0.smithi134.stdout:1/518: dwrite d3/fb [0,4194304] 0 2024-04-13T10:59:11.643 INFO:tasks.workunit.client.0.smithi134.stdout:7/422: fsync da/d15/d26/d27/f58 0 2024-04-13T10:59:11.643 INFO:tasks.workunit.client.0.smithi134.stdout:1/519: dread - d3/d6/d20/d6d/d8b/f4e zero size 2024-04-13T10:59:11.650 INFO:tasks.workunit.client.0.smithi134.stdout:7/423: dwrite da/d15/d26/d38/f66 [0,4194304] 0 2024-04-13T10:59:11.650 INFO:tasks.workunit.client.0.smithi134.stdout:1/520: creat d3/d6/d20/d9f/fae x:0 0 0 2024-04-13T10:59:11.652 INFO:tasks.workunit.client.0.smithi134.stdout:7/424: write da/d15/d26/d27/f5c [81071,108766] 0 2024-04-13T10:59:11.657 INFO:tasks.workunit.client.0.smithi134.stdout:5/638: write dc/d1d/d2f/f6f [652519,49497] 0 2024-04-13T10:59:11.657 INFO:tasks.workunit.client.0.smithi134.stdout:0/445: write d4/d17/da/f10 [737104,90951] 0 2024-04-13T10:59:11.660 INFO:tasks.workunit.client.0.smithi134.stdout:1/521: mknod d3/d6/d20/d28/caf 0 2024-04-13T10:59:11.660 INFO:tasks.workunit.client.0.smithi134.stdout:1/522: chown d3/fa6 0 1 2024-04-13T10:59:11.666 INFO:tasks.workunit.client.0.smithi134.stdout:5/639: dwrite dc/d1d/d20/d23/f68 [0,4194304] 0 2024-04-13T10:59:11.669 INFO:tasks.workunit.client.0.smithi134.stdout:5/640: write dc/d1d/d46/f97 [829950,34357] 0 2024-04-13T10:59:11.669 INFO:tasks.workunit.client.0.smithi134.stdout:1/523: rename d3/d6/d16/d1d/d68/l7f to d3/d6/d20/d89/lb0 0 2024-04-13T10:59:11.671 INFO:tasks.workunit.client.0.smithi134.stdout:0/446: mknod d4/d17/da/d22/d37/d6d/d97/d9c/ca7 0 2024-04-13T10:59:11.673 INFO:tasks.workunit.client.0.smithi134.stdout:5/641: mkdir dc/d1d/d2f/d3b/d3c/dd3 0 2024-04-13T10:59:11.675 INFO:tasks.workunit.client.0.smithi134.stdout:7/425: getdents da/d15/d26/d27/d47/d5a 0 2024-04-13T10:59:11.677 INFO:tasks.workunit.client.0.smithi134.stdout:1/524: rename d3/d1e to d3/d6/d20/d6d/db1 0 2024-04-13T10:59:11.678 INFO:tasks.workunit.client.0.smithi134.stdout:1/525: fdatasync d3/d30/f4b 0 2024-04-13T10:59:11.681 INFO:tasks.workunit.client.0.smithi134.stdout:0/447: mknod d4/d17/d20/d29/d30/ca8 0 2024-04-13T10:59:11.682 INFO:tasks.workunit.client.0.smithi134.stdout:0/448: readlink d4/d17/d23/d51/d6b/d91/d98/d62/d7c/l9f 0 2024-04-13T10:59:11.689 INFO:tasks.workunit.client.0.smithi134.stdout:5/642: write dc/d15/d65/f6c [95015,93444] 0 2024-04-13T10:59:11.692 INFO:tasks.workunit.client.0.smithi134.stdout:1/526: write d3/d6/f31 [676642,76258] 0 2024-04-13T10:59:11.693 INFO:tasks.workunit.client.0.smithi134.stdout:1/527: dread - d3/d6/d20/d28/f95 zero size 2024-04-13T10:59:11.693 INFO:tasks.workunit.client.0.smithi134.stdout:7/426: creat da/d15/d85/f8f x:0 0 0 2024-04-13T10:59:11.694 INFO:tasks.workunit.client.0.smithi134.stdout:1/528: fsync d3/d6/d16/f36 0 2024-04-13T10:59:11.695 INFO:tasks.workunit.client.0.smithi134.stdout:0/449: mkdir d4/d17/d20/da9 0 2024-04-13T10:59:11.695 INFO:tasks.workunit.client.0.smithi134.stdout:1/529: stat d3/fa6 0 2024-04-13T10:59:11.697 INFO:tasks.workunit.client.0.smithi134.stdout:7/427: creat da/d15/d26/d27/d4f/d5f/d67/f90 x:0 0 0 2024-04-13T10:59:11.699 INFO:tasks.workunit.client.0.smithi134.stdout:5/643: rename dc/lbe to dc/d1d/ld4 0 2024-04-13T10:59:11.705 INFO:tasks.workunit.client.0.smithi134.stdout:1/530: rename d3/d6/d16/d4d/d65/ca1 to d3/d6/d6a/cb2 0 2024-04-13T10:59:11.709 INFO:tasks.workunit.client.0.smithi134.stdout:7/428: rename da/d15/d26/d38/f5e to da/d15/d26/d27/d4f/d5f/d67/d73/f91 0 2024-04-13T10:59:11.712 INFO:tasks.workunit.client.0.smithi134.stdout:1/531: dwrite d3/d6/d20/d28/fa3 [0,4194304] 0 2024-04-13T10:59:11.713 INFO:tasks.workunit.client.0.smithi134.stdout:0/450: truncate d4/d17/da/d22/f25 4465002 0 2024-04-13T10:59:11.715 INFO:tasks.workunit.client.0.smithi134.stdout:5/644: getdents dc/d15/d65 0 2024-04-13T10:59:11.720 INFO:tasks.workunit.client.0.smithi134.stdout:7/429: rmdir da/d15/d26/d27/d47 39 2024-04-13T10:59:11.723 INFO:tasks.workunit.client.0.smithi134.stdout:7/430: truncate da/d15/d85/f8f 1039457 0 2024-04-13T10:59:11.723 INFO:tasks.workunit.client.0.smithi134.stdout:1/532: dwrite d3/d6/d20/d28/f95 [0,4194304] 0 2024-04-13T10:59:11.725 INFO:tasks.workunit.client.0.smithi134.stdout:0/451: unlink d4/d17/d20/d29/c9b 0 2024-04-13T10:59:11.725 INFO:tasks.workunit.client.0.smithi134.stdout:1/533: write d3/d6/d20/f42 [1594227,64935] 0 2024-04-13T10:59:11.729 INFO:tasks.workunit.client.0.smithi134.stdout:0/452: chown d4/d17/d20/c39 1 1 2024-04-13T10:59:11.729 INFO:tasks.workunit.client.0.smithi134.stdout:5/645: creat dc/d1d/d2f/d3b/d7f/d8d/d7d/dc0/fd5 x:0 0 0 2024-04-13T10:59:11.734 INFO:tasks.workunit.client.0.smithi134.stdout:1/534: mknod d3/d6/d20/d71/d9c/cb3 0 2024-04-13T10:59:11.735 INFO:tasks.workunit.client.0.smithi134.stdout:0/453: creat d4/d17/d23/d51/d6b/d91/d98/d8b/d8c/faa x:0 0 0 2024-04-13T10:59:11.736 INFO:tasks.workunit.client.0.smithi134.stdout:5/646: mknod dc/d1d/d2f/d3b/d6a/cd6 0 2024-04-13T10:59:11.736 INFO:tasks.workunit.client.0.smithi134.stdout:1/535: creat d3/d6/d16/d1d/d86/fb4 x:0 0 0 2024-04-13T10:59:11.738 INFO:tasks.workunit.client.0.smithi134.stdout:1/536: chown d3/d6/d16/f36 1116938 1 2024-04-13T10:59:11.739 INFO:tasks.workunit.client.0.smithi134.stdout:5/647: symlink dc/d1d/d2f/d3b/d7f/d8d/d7d/dc0/ld7 0 2024-04-13T10:59:11.743 INFO:tasks.workunit.client.0.smithi134.stdout:5/648: truncate dc/d1d/d46/f74 1134957 0 2024-04-13T10:59:11.746 INFO:tasks.workunit.client.0.smithi134.stdout:5/649: creat dc/d1d/d2f/d3b/d7f/fd8 x:0 0 0 2024-04-13T10:59:11.752 INFO:tasks.workunit.client.0.smithi134.stdout:7/431: dwrite da/d15/f29 [0,4194304] 0 2024-04-13T10:59:11.753 INFO:tasks.workunit.client.0.smithi134.stdout:0/454: truncate d4/d17/d20/d29/f87 16586 0 2024-04-13T10:59:11.755 INFO:tasks.workunit.client.0.smithi134.stdout:1/537: write d3/d6/fc [593794,128386] 0 2024-04-13T10:59:11.757 INFO:tasks.workunit.client.0.smithi134.stdout:1/538: dread - d3/d6/d16/d1d/f84 zero size 2024-04-13T10:59:11.758 INFO:tasks.workunit.client.0.smithi134.stdout:1/539: chown d3/d6/d20/d71 97 1 2024-04-13T10:59:11.761 INFO:tasks.workunit.client.0.smithi134.stdout:5/650: write dc/f75 [183499,101744] 0 2024-04-13T10:59:11.762 INFO:tasks.workunit.client.0.smithi134.stdout:7/432: dwrite f4 [0,4194304] 0 2024-04-13T10:59:11.763 INFO:tasks.workunit.client.0.smithi134.stdout:7/433: fdatasync da/d15/f6e 0 2024-04-13T10:59:11.764 INFO:tasks.workunit.client.0.smithi134.stdout:1/540: creat d3/d6/d16/d4d/fb5 x:0 0 0 2024-04-13T10:59:11.767 INFO:tasks.workunit.client.0.smithi134.stdout:0/455: getdents d4/d17/d23/d51/d6b/d91/d98/d8b 0 2024-04-13T10:59:11.770 INFO:tasks.workunit.client.0.smithi134.stdout:5/651: rename dc/d1d/d2f/d3b/d7f/d8d/d7d/d91 to dc/d1d/d20/d23/d5a/dd9 0 2024-04-13T10:59:11.770 INFO:tasks.workunit.client.0.smithi134.stdout:0/456: stat d4/d17/d23/d51/d6a/d94/f67 0 2024-04-13T10:59:11.772 INFO:tasks.workunit.client.0.smithi134.stdout:0/457: chown d4/d17/d20/c52 34415783 1 2024-04-13T10:59:11.774 INFO:tasks.workunit.client.0.smithi134.stdout:1/541: dwrite d3/d6/d20/f8f [0,4194304] 0 2024-04-13T10:59:11.778 INFO:tasks.workunit.client.0.smithi134.stdout:5/652: dwrite f9 [0,4194304] 0 2024-04-13T10:59:11.779 INFO:tasks.workunit.client.0.smithi134.stdout:5/653: stat dc/d15/f94 0 2024-04-13T10:59:11.869 INFO:tasks.workunit.client.0.smithi134.stdout:1/542: symlink d3/d6/d20/d71/lb6 0 2024-04-13T10:59:11.871 INFO:tasks.workunit.client.0.smithi134.stdout:9/513: sync 2024-04-13T10:59:11.871 INFO:tasks.workunit.client.0.smithi134.stdout:8/462: sync 2024-04-13T10:59:11.872 INFO:tasks.workunit.client.0.smithi134.stdout:5/654: mknod dc/d1d/d2f/d3b/d7f/d8d/d7d/cda 0 2024-04-13T10:59:11.873 INFO:tasks.workunit.client.0.smithi134.stdout:5/655: chown dc/d1d/d20/d23/d36 562 1 2024-04-13T10:59:11.878 INFO:tasks.workunit.client.0.smithi134.stdout:0/458: creat d4/d17/da/d22/d37/d6d/da5/fab x:0 0 0 2024-04-13T10:59:11.932 INFO:tasks.workunit.client.0.smithi134.stdout:1/543: creat d3/d30/fb7 x:0 0 0 2024-04-13T10:59:11.935 INFO:tasks.workunit.client.0.smithi134.stdout:9/514: rename fc to d13/d40/d7d/fb4 0 2024-04-13T10:59:11.939 INFO:tasks.workunit.client.0.smithi134.stdout:1/544: dread d3/d6/d16/d1d/d68/fac [0,4194304] 0 2024-04-13T10:59:11.942 INFO:tasks.workunit.client.0.smithi134.stdout:9/515: dwrite d13/d2e/f9a [0,4194304] 0 2024-04-13T10:59:11.942 INFO:tasks.workunit.client.0.smithi134.stdout:8/463: rename c7 to d8/dc/d16/d54/d6c/c93 0 2024-04-13T10:59:11.945 INFO:tasks.workunit.client.0.smithi134.stdout:8/464: read d8/f10 [833140,22288] 0 2024-04-13T10:59:11.948 INFO:tasks.workunit.client.0.smithi134.stdout:1/545: dwrite d3/f13 [0,4194304] 0 2024-04-13T10:59:11.956 INFO:tasks.workunit.client.0.smithi134.stdout:5/656: getdents dc/d1d/d46 0 2024-04-13T10:59:11.956 INFO:tasks.workunit.client.0.smithi134.stdout:8/465: mkdir d8/dc/d16/d54/d6c/d94 0 2024-04-13T10:59:11.957 INFO:tasks.workunit.client.0.smithi134.stdout:1/546: rmdir d3/d6/d20 39 2024-04-13T10:59:11.958 INFO:tasks.workunit.client.0.smithi134.stdout:1/547: readlink d3/d6/dd/le 0 2024-04-13T10:59:11.959 INFO:tasks.workunit.client.0.smithi134.stdout:0/459: getdents d4/d17/d23/d51/d6b/d91/d98/d62/d7c 0 2024-04-13T10:59:11.960 INFO:tasks.workunit.client.0.smithi134.stdout:5/657: dread dc/d15/d65/f6c [0,4194304] 0 2024-04-13T10:59:11.962 INFO:tasks.workunit.client.0.smithi134.stdout:5/658: fdatasync dc/dc1/fc5 0 2024-04-13T10:59:11.962 INFO:tasks.workunit.client.0.smithi134.stdout:0/460: write d4/d17/da/d22/d37/d6d/da5/fab [605057,72515] 0 2024-04-13T10:59:11.962 INFO:tasks.workunit.client.0.smithi134.stdout:5/659: write f1 [9070851,3048] 0 2024-04-13T10:59:11.966 INFO:tasks.workunit.client.0.smithi134.stdout:5/660: fsync dc/d1d/d2f/d3b/d7f/d8d/d7d/dc0/fd5 0 2024-04-13T10:59:11.969 INFO:tasks.workunit.client.0.smithi134.stdout:0/461: creat d4/d17/da/d22/d37/fac x:0 0 0 2024-04-13T10:59:11.972 INFO:tasks.workunit.client.0.smithi134.stdout:5/661: mknod dc/d15/d50/cdb 0 2024-04-13T10:59:11.972 INFO:tasks.workunit.client.0.smithi134.stdout:8/466: dwrite d8/dc/f35 [0,4194304] 0 2024-04-13T10:59:11.972 INFO:tasks.workunit.client.0.smithi134.stdout:1/548: dread d3/d6/d20/d9f/f99 [0,4194304] 0 2024-04-13T10:59:11.974 INFO:tasks.workunit.client.0.smithi134.stdout:0/462: readlink d4/d17/l34 0 2024-04-13T10:59:11.974 INFO:tasks.workunit.client.0.smithi134.stdout:9/516: dread f6 [0,4194304] 0 2024-04-13T10:59:11.984 INFO:tasks.workunit.client.0.smithi134.stdout:8/467: symlink d8/dc/d16/d74/l95 0 2024-04-13T10:59:11.985 INFO:tasks.workunit.client.0.smithi134.stdout:0/463: creat d4/d17/d20/d29/d30/d7f/fad x:0 0 0 2024-04-13T10:59:11.985 INFO:tasks.workunit.client.0.smithi134.stdout:8/468: write d8/dc/d16/d54/f65 [394191,75167] 0 2024-04-13T10:59:11.990 INFO:tasks.workunit.client.0.smithi134.stdout:1/549: write d3/f41 [224637,12790] 0 2024-04-13T10:59:11.993 INFO:tasks.workunit.client.0.smithi134.stdout:0/464: mkdir d4/d17/da/d22/d37/d6d/d97/dae 0 2024-04-13T10:59:11.995 INFO:tasks.workunit.client.0.smithi134.stdout:9/517: link d13/d2e/d35/f46 d13/d2e/d35/d50/d59/fb5 0 2024-04-13T10:59:11.996 INFO:tasks.workunit.client.0.smithi134.stdout:5/662: dread dc/d1d/d20/d23/f26 [0,4194304] 0 2024-04-13T10:59:11.998 INFO:tasks.workunit.client.0.smithi134.stdout:6/443: sync 2024-04-13T10:59:11.998 INFO:tasks.workunit.client.0.smithi134.stdout:2/421: sync 2024-04-13T10:59:11.998 INFO:tasks.workunit.client.0.smithi134.stdout:0/465: mkdir d4/d17/d23/d51/d6b/d91/d98/d62/daf 0 2024-04-13T10:59:12.000 INFO:tasks.workunit.client.0.smithi134.stdout:9/518: creat d13/d39/d52/fb6 x:0 0 0 2024-04-13T10:59:12.001 INFO:tasks.workunit.client.0.smithi134.stdout:8/469: rmdir d8/dc/d16/d54/d92 0 2024-04-13T10:59:12.002 INFO:tasks.workunit.client.0.smithi134.stdout:0/466: truncate d4/d17/da/d22/d37/f4d 5067529 0 2024-04-13T10:59:12.002 INFO:tasks.workunit.client.0.smithi134.stdout:1/550: creat d3/d6/d16/d1d/dab/fb8 x:0 0 0 2024-04-13T10:59:12.004 INFO:tasks.workunit.client.0.smithi134.stdout:1/551: dread - d3/d6/d16/d1d/d86/f96 zero size 2024-04-13T10:59:12.004 INFO:tasks.workunit.client.0.smithi134.stdout:6/444: creat d4/da/d15/d77/d63/f86 x:0 0 0 2024-04-13T10:59:12.006 INFO:tasks.workunit.client.0.smithi134.stdout:2/422: truncate d5/de/d12/f43 565649 0 2024-04-13T10:59:12.007 INFO:tasks.workunit.client.0.smithi134.stdout:9/519: symlink d13/d39/d58/d5f/d6e/lb7 0 2024-04-13T10:59:12.013 INFO:tasks.workunit.client.0.smithi134.stdout:1/552: dwrite d3/d6/d20/d6d/db1/f46 [4194304,4194304] 0 2024-04-13T10:59:12.014 INFO:tasks.workunit.client.0.smithi134.stdout:5/663: dread dc/d1d/d20/d23/f55 [0,4194304] 0 2024-04-13T10:59:12.018 INFO:tasks.workunit.client.0.smithi134.stdout:5/664: read dc/d1d/d20/f62 [509506,41658] 0 2024-04-13T10:59:12.019 INFO:tasks.workunit.client.0.smithi134.stdout:1/553: mknod d3/d30/cb9 0 2024-04-13T10:59:12.023 INFO:tasks.workunit.client.0.smithi134.stdout:1/554: dread d3/d6/f7e [0,4194304] 0 2024-04-13T10:59:12.024 INFO:tasks.workunit.client.0.smithi134.stdout:6/445: creat d4/da/d15/d1f/d24/f87 x:0 0 0 2024-04-13T10:59:12.025 INFO:tasks.workunit.client.0.smithi134.stdout:6/446: fsync d4/da/d15/f6e 0 2024-04-13T10:59:12.025 INFO:tasks.workunit.client.0.smithi134.stdout:1/555: write d3/d30/f48 [2088128,80072] 0 2024-04-13T10:59:12.028 INFO:tasks.workunit.client.0.smithi134.stdout:5/665: write dc/d1d/d2f/d3b/d7f/d8d/d7d/fd1 [3065816,117868] 0 2024-04-13T10:59:12.032 INFO:tasks.workunit.client.0.smithi134.stdout:5/666: chown dc/d1d/d20/caa 28612333 1 2024-04-13T10:59:12.033 INFO:tasks.workunit.client.0.smithi134.stdout:1/556: creat d3/d6/d16/fba x:0 0 0 2024-04-13T10:59:12.041 INFO:tasks.workunit.client.0.smithi134.stdout:6/447: dwrite d4/da/d15/d1f/d24/f3a [4194304,4194304] 0 2024-04-13T10:59:12.041 INFO:tasks.workunit.client.0.smithi134.stdout:1/557: chown d3/d6/d20/d71/d9c/cb3 96916 1 2024-04-13T10:59:12.042 INFO:tasks.workunit.client.0.smithi134.stdout:8/470: dwrite d8/dc/f29 [0,4194304] 0 2024-04-13T10:59:12.046 INFO:tasks.workunit.client.0.smithi134.stdout:0/467: dwrite d4/d17/da/d22/d37/f65 [0,4194304] 0 2024-04-13T10:59:12.048 INFO:tasks.workunit.client.0.smithi134.stdout:9/520: dread d13/f21 [0,4194304] 0 2024-04-13T10:59:12.048 INFO:tasks.workunit.client.0.smithi134.stdout:1/558: write d3/d6/f31 [1042453,42] 0 2024-04-13T10:59:12.052 INFO:tasks.workunit.client.0.smithi134.stdout:6/448: creat d4/da/d1a/f88 x:0 0 0 2024-04-13T10:59:12.059 INFO:tasks.workunit.client.0.smithi134.stdout:0/468: write d4/d17/da/d22/d38/f7d [1204632,1811] 0 2024-04-13T10:59:12.059 INFO:tasks.workunit.client.0.smithi134.stdout:8/471: mknod d8/dc/d16/c96 0 2024-04-13T10:59:12.059 INFO:tasks.workunit.client.0.smithi134.stdout:5/667: dwrite dc/d1d/d20/d23/f86 [0,4194304] 0 2024-04-13T10:59:12.059 INFO:tasks.workunit.client.0.smithi134.stdout:1/559: readlink d3/d6/d16/d1d/d68/l80 0 2024-04-13T10:59:12.059 INFO:tasks.workunit.client.0.smithi134.stdout:1/560: chown d3/d6/d20/d6d/d8b/l52 128 1 2024-04-13T10:59:12.060 INFO:tasks.workunit.client.0.smithi134.stdout:6/449: symlink d4/da/d1a/l89 0 2024-04-13T10:59:12.062 INFO:tasks.workunit.client.0.smithi134.stdout:0/469: readlink d4/d17/da/l88 0 2024-04-13T10:59:12.063 INFO:tasks.workunit.client.0.smithi134.stdout:6/450: chown d4/da/d15/d1f/f2a 105 1 2024-04-13T10:59:12.065 INFO:tasks.workunit.client.0.smithi134.stdout:8/472: rmdir d8/dc/d16/d4e/d76 39 2024-04-13T10:59:12.066 INFO:tasks.workunit.client.0.smithi134.stdout:6/451: chown d4/da/f41 25095 1 2024-04-13T10:59:12.066 INFO:tasks.workunit.client.0.smithi134.stdout:5/668: dwrite dc/d1d/d2f/d3b/fcb [0,4194304] 0 2024-04-13T10:59:12.068 INFO:tasks.workunit.client.0.smithi134.stdout:9/521: truncate d13/d2e/d35/f46 2885547 0 2024-04-13T10:59:12.069 INFO:tasks.workunit.client.0.smithi134.stdout:9/522: fdatasync d13/d2e/f9a 0 2024-04-13T10:59:12.071 INFO:tasks.workunit.client.0.smithi134.stdout:8/473: mknod d8/c97 0 2024-04-13T10:59:12.073 INFO:tasks.workunit.client.0.smithi134.stdout:9/523: write d13/d39/d64/f92 [1320671,73555] 0 2024-04-13T10:59:12.075 INFO:tasks.workunit.client.0.smithi134.stdout:9/524: truncate d13/da3/fab 923492 0 2024-04-13T10:59:12.075 INFO:tasks.workunit.client.0.smithi134.stdout:6/452: rename d4/f18 to d4/da/d15/f8a 0 2024-04-13T10:59:12.078 INFO:tasks.workunit.client.0.smithi134.stdout:0/470: rename d4/d17/d23/d51/d6b/d91/d98/d62/d7c/c80 to d4/d17/d20/d29/d30/d64/d84/cb0 0 2024-04-13T10:59:12.080 INFO:tasks.workunit.client.0.smithi134.stdout:6/453: write d4/da/d15/d1f/f4b [262269,120237] 0 2024-04-13T10:59:12.082 INFO:tasks.workunit.client.0.smithi134.stdout:5/669: rename dc/d39/d63/d99 to dc/d1d/d20/ddc 0 2024-04-13T10:59:12.084 INFO:tasks.workunit.client.0.smithi134.stdout:8/474: dwrite d8/dc/d13/d5d/f88 [0,4194304] 0 2024-04-13T10:59:12.086 INFO:tasks.workunit.client.0.smithi134.stdout:6/454: creat d4/da/d68/f8b x:0 0 0 2024-04-13T10:59:12.087 INFO:tasks.workunit.client.0.smithi134.stdout:8/475: mkdir d8/dc/d16/d54/d98 0 2024-04-13T10:59:12.089 INFO:tasks.workunit.client.0.smithi134.stdout:6/455: dread d4/da/d1a/f44 [0,4194304] 0 2024-04-13T10:59:12.089 INFO:tasks.workunit.client.0.smithi134.stdout:5/670: creat dc/d1d/d20/d23/d36/dbd/fdd x:0 0 0 2024-04-13T10:59:12.090 INFO:tasks.workunit.client.0.smithi134.stdout:0/471: dread d4/d17/da/d22/d38/f7d [0,4194304] 0 2024-04-13T10:59:12.093 INFO:tasks.workunit.client.0.smithi134.stdout:0/472: fsync d4/d17/d20/d29/d30/d64/d84/f8d 0 2024-04-13T10:59:12.094 INFO:tasks.workunit.client.0.smithi134.stdout:0/473: chown d4/d17/da/d22/f25 19681278 1 2024-04-13T10:59:12.095 INFO:tasks.workunit.client.0.smithi134.stdout:6/456: rename d4/da/d15/d1f/d24/f62 to d4/da/d15/d77/d63/f8c 0 2024-04-13T10:59:12.097 INFO:tasks.workunit.client.0.smithi134.stdout:1/561: dread d3/d6/d20/d28/f37 [0,4194304] 0 2024-04-13T10:59:12.100 INFO:tasks.workunit.client.0.smithi134.stdout:1/562: write d3/d6/d16/d1d/dab/fb8 [7780,33207] 0 2024-04-13T10:59:12.103 INFO:tasks.workunit.client.0.smithi134.stdout:6/457: symlink d4/da/d15/d57/l8d 0 2024-04-13T10:59:12.106 INFO:tasks.workunit.client.0.smithi134.stdout:0/474: dwrite d4/d17/d23/d51/d6b/d91/d98/d8b/f93 [0,4194304] 0 2024-04-13T10:59:12.106 INFO:tasks.workunit.client.0.smithi134.stdout:9/525: dread d13/d39/d58/d5f/f8e [0,4194304] 0 2024-04-13T10:59:12.107 INFO:tasks.workunit.client.0.smithi134.stdout:3/421: sync 2024-04-13T10:59:12.107 INFO:tasks.workunit.client.0.smithi134.stdout:4/337: sync 2024-04-13T10:59:12.111 INFO:tasks.workunit.client.0.smithi134.stdout:9/526: write d13/d2e/d35/d50/d59/d74/f7c [1268719,44929] 0 2024-04-13T10:59:12.112 INFO:tasks.workunit.client.0.smithi134.stdout:4/338: write d4/d1f/d27/d75/f68 [125596,13376] 0 2024-04-13T10:59:12.112 INFO:tasks.workunit.client.0.smithi134.stdout:4/339: chown d4/d48/f4c 40 1 2024-04-13T10:59:12.116 INFO:tasks.workunit.client.0.smithi134.stdout:6/458: rename d4/da/d15/d1f/d24/d5b to d4/da/d15/d76/d8e 0 2024-04-13T10:59:12.116 INFO:tasks.workunit.client.0.smithi134.stdout:6/459: fsync d4/da/d1a/f29 0 2024-04-13T10:59:12.121 INFO:tasks.workunit.client.0.smithi134.stdout:8/476: dread d8/dc/d37/f3b [0,4194304] 0 2024-04-13T10:59:12.121 INFO:tasks.workunit.client.0.smithi134.stdout:3/422: unlink dc/d27/d4d/d4f/d50/f2b 0 2024-04-13T10:59:12.122 INFO:tasks.workunit.client.0.smithi134.stdout:8/477: chown d8/dc/f45 57 1 2024-04-13T10:59:12.129 INFO:tasks.workunit.client.0.smithi134.stdout:8/478: dwrite d8/dc/d13/f7c [0,4194304] 0 2024-04-13T10:59:12.138 INFO:tasks.workunit.client.0.smithi134.stdout:8/479: dwrite d8/dc/f4f [0,4194304] 0 2024-04-13T10:59:12.140 INFO:tasks.workunit.client.0.smithi134.stdout:1/563: write d3/d6/d20/d28/f3e [5931857,108449] 0 2024-04-13T10:59:12.142 INFO:tasks.workunit.client.0.smithi134.stdout:1/564: dread - d3/d6/d6a/f6e zero size 2024-04-13T10:59:12.143 INFO:tasks.workunit.client.0.smithi134.stdout:5/671: dwrite dc/f17 [4194304,4194304] 0 2024-04-13T10:59:12.147 INFO:tasks.workunit.client.0.smithi134.stdout:8/480: dread d8/dc/f4f [0,4194304] 0 2024-04-13T10:59:12.147 INFO:tasks.workunit.client.0.smithi134.stdout:1/565: write d3/d6/d20/d28/f37 [3964310,95101] 0 2024-04-13T10:59:12.153 INFO:tasks.workunit.client.0.smithi134.stdout:6/460: rename d4/da/f11 to d4/da/f8f 0 2024-04-13T10:59:12.158 INFO:tasks.workunit.client.0.smithi134.stdout:4/340: link d4/d48/l59 d4/d1f/d27/d3a/d53/d58/l76 0 2024-04-13T10:59:12.160 INFO:tasks.workunit.client.0.smithi134.stdout:1/566: dwrite d3/d30/fb7 [0,4194304] 0 2024-04-13T10:59:12.164 INFO:tasks.workunit.client.0.smithi134.stdout:3/423: truncate dc/d27/d4d/f34 3058740 0 2024-04-13T10:59:12.164 INFO:tasks.workunit.client.0.smithi134.stdout:6/461: rmdir d4/da/d1a 39 2024-04-13T10:59:12.164 INFO:tasks.workunit.client.0.smithi134.stdout:0/475: dwrite d4/d17/d23/f2f [0,4194304] 0 2024-04-13T10:59:12.166 INFO:tasks.workunit.client.0.smithi134.stdout:6/462: write d4/da/d15/d1f/d24/d49/f50 [1445665,45767] 0 2024-04-13T10:59:12.177 INFO:tasks.workunit.client.0.smithi134.stdout:0/476: dread d4/d17/da/d22/d37/f65 [0,4194304] 0 2024-04-13T10:59:12.179 INFO:tasks.workunit.client.0.smithi134.stdout:5/672: link dc/d1d/d2f/d3b/d7f/d8d/d7d/dc0/fc6 dc/d1d/d2f/d3b/d7f/d8d/d7d/fde 0 2024-04-13T10:59:12.181 INFO:tasks.workunit.client.0.smithi134.stdout:1/567: creat d3/d6/d16/d4d/fbb x:0 0 0 2024-04-13T10:59:12.183 INFO:tasks.workunit.client.0.smithi134.stdout:0/477: dread d4/d17/da/d22/d41/f4b [0,4194304] 0 2024-04-13T10:59:12.196 INFO:tasks.workunit.client.0.smithi134.stdout:1/568: creat d3/d6/d20/d71/d9c/fbc x:0 0 0 2024-04-13T10:59:12.197 INFO:tasks.workunit.client.0.smithi134.stdout:1/569: read - d3/d6/d20/d28/f98 zero size 2024-04-13T10:59:12.199 INFO:tasks.workunit.client.0.smithi134.stdout:8/481: link d8/dc/c47 d8/dc/d2c/d68/d8c/d8f/c99 0 2024-04-13T10:59:12.199 INFO:tasks.workunit.client.0.smithi134.stdout:1/570: write d3/d6/d6a/f6e [416523,86942] 0 2024-04-13T10:59:12.200 INFO:tasks.workunit.client.0.smithi134.stdout:8/482: chown d8/dc/l2e 21704664 1 2024-04-13T10:59:12.200 INFO:tasks.workunit.client.0.smithi134.stdout:1/571: chown d3/d6/d16/d1d/d86/f96 3 1 2024-04-13T10:59:12.204 INFO:tasks.workunit.client.0.smithi134.stdout:6/463: rename d4/da/d15/d1f/d24/l6a to d4/da/d15/d76/d8e/l90 0 2024-04-13T10:59:12.212 INFO:tasks.workunit.client.0.smithi134.stdout:6/464: mkdir d4/da/d15/d1f/d24/d49/d91 0 2024-04-13T10:59:12.213 INFO:tasks.workunit.client.0.smithi134.stdout:4/341: truncate d4/d48/d50/d60/f36 1569270 0 2024-04-13T10:59:12.213 INFO:tasks.workunit.client.0.smithi134.stdout:8/483: dwrite d8/dc/d37/f3b [0,4194304] 0 2024-04-13T10:59:12.219 INFO:tasks.workunit.client.0.smithi134.stdout:0/478: link d4/d17/d23/d51/d6b/f7b d4/d17/da/d22/d37/d6d/da5/fb1 0 2024-04-13T10:59:12.220 INFO:tasks.workunit.client.0.smithi134.stdout:6/465: mkdir d4/da/d15/d76/d92 0 2024-04-13T10:59:12.222 INFO:tasks.workunit.client.0.smithi134.stdout:8/484: symlink d8/dc/d13/d5d/d69/l9a 0 2024-04-13T10:59:12.224 INFO:tasks.workunit.client.0.smithi134.stdout:4/342: creat d4/d48/d50/d60/d5f/f77 x:0 0 0 2024-04-13T10:59:12.227 INFO:tasks.workunit.client.0.smithi134.stdout:4/343: stat d4/d1f/f23 0 2024-04-13T10:59:12.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/479: rmdir d4/d17/d23/d51/d6b/d91/d98 39 2024-04-13T10:59:12.228 INFO:tasks.workunit.client.0.smithi134.stdout:6/466: rmdir d4/da/d15/d1f/d3c/d7d 39 2024-04-13T10:59:12.230 INFO:tasks.workunit.client.0.smithi134.stdout:8/485: mkdir d8/dc/d16/d54/d98/d9b 0 2024-04-13T10:59:12.231 INFO:tasks.workunit.client.0.smithi134.stdout:5/673: dwrite dc/d1d/d67/d69/f7b [0,4194304] 0 2024-04-13T10:59:12.231 INFO:tasks.workunit.client.0.smithi134.stdout:1/572: dwrite d3/d30/f77 [0,4194304] 0 2024-04-13T10:59:12.234 INFO:tasks.workunit.client.0.smithi134.stdout:4/344: write d4/dd/f3f [1985069,70614] 0 2024-04-13T10:59:12.241 INFO:tasks.workunit.client.0.smithi134.stdout:4/345: write d4/d1f/f5b [5033581,122422] 0 2024-04-13T10:59:12.241 INFO:tasks.workunit.client.0.smithi134.stdout:0/480: rmdir d4/d17/d23/d51/d6a/d73 39 2024-04-13T10:59:12.241 INFO:tasks.workunit.client.0.smithi134.stdout:0/481: write d4/d17/d20/d29/d30/d7f/fad [232904,76413] 0 2024-04-13T10:59:12.244 INFO:tasks.workunit.client.0.smithi134.stdout:0/482: write d4/d17/da/f27 [1064536,81310] 0 2024-04-13T10:59:12.249 INFO:tasks.workunit.client.0.smithi134.stdout:5/674: dread dc/d15/d84/f9c [0,4194304] 0 2024-04-13T10:59:12.251 INFO:tasks.workunit.client.0.smithi134.stdout:1/573: creat d3/d6/d16/fbd x:0 0 0 2024-04-13T10:59:12.255 INFO:tasks.workunit.client.0.smithi134.stdout:1/574: dread d3/d6/d16/d4d/d65/fa0 [0,4194304] 0 2024-04-13T10:59:12.257 INFO:tasks.workunit.client.0.smithi134.stdout:8/486: mkdir d8/dc/d16/d4e/d9c 0 2024-04-13T10:59:12.258 INFO:tasks.workunit.client.0.smithi134.stdout:4/346: rename d4/d1f/d27/d2e/c3d to d4/d1f/c78 0 2024-04-13T10:59:12.365 INFO:tasks.workunit.client.0.smithi134.stdout:7/434: sync 2024-04-13T10:59:12.366 INFO:tasks.workunit.client.0.smithi134.stdout:5/675: rmdir dc/d15/d65 39 2024-04-13T10:59:12.371 INFO:tasks.workunit.client.0.smithi134.stdout:1/575: mkdir d3/d6/d20/d9f/dbe 0 2024-04-13T10:59:12.372 INFO:tasks.workunit.client.0.smithi134.stdout:1/576: fsync d3/d6/d16/fba 0 2024-04-13T10:59:12.373 INFO:tasks.workunit.client.0.smithi134.stdout:8/487: unlink d8/dc/d16/d54/d6c/d7d/f87 0 2024-04-13T10:59:12.374 INFO:tasks.workunit.client.0.smithi134.stdout:8/488: write d8/dc/d16/f2d [3607929,112353] 0 2024-04-13T10:59:12.376 INFO:tasks.workunit.client.0.smithi134.stdout:0/483: rename d4/d17/da/d22/d38 to d4/d17/d23/d51/d6a/d94/db2 0 2024-04-13T10:59:12.378 INFO:tasks.workunit.client.0.smithi134.stdout:5/676: stat dc/d1d/d67/fa6 0 2024-04-13T10:59:12.384 INFO:tasks.workunit.client.0.smithi134.stdout:8/489: rename d8/dc/d13/d5d to d8/dc/d9d 0 2024-04-13T10:59:12.385 INFO:tasks.workunit.client.0.smithi134.stdout:8/490: fsync d8/dc/d16/d4e/f62 0 2024-04-13T10:59:12.386 INFO:tasks.workunit.client.0.smithi134.stdout:6/467: truncate d4/da/d15/d1f/d3c/f5e 1273821 0 2024-04-13T10:59:12.389 INFO:tasks.workunit.client.0.smithi134.stdout:8/491: dread d8/dc/d9d/f88 [0,4194304] 0 2024-04-13T10:59:12.395 INFO:tasks.workunit.client.0.smithi134.stdout:5/677: mknod dc/d15/d65/cdf 0 2024-04-13T10:59:12.395 INFO:tasks.workunit.client.0.smithi134.stdout:8/492: dwrite d8/dc/d13/f75 [0,4194304] 0 2024-04-13T10:59:12.400 INFO:tasks.workunit.client.0.smithi134.stdout:7/435: getdents da/d15/d26/d27/d3d 0 2024-04-13T10:59:12.401 INFO:tasks.workunit.client.0.smithi134.stdout:5/678: dread dc/d1d/d46/f97 [0,4194304] 0 2024-04-13T10:59:12.409 INFO:tasks.workunit.client.0.smithi134.stdout:0/484: symlink d4/d17/d20/d29/d30/d3e/lb3 0 2024-04-13T10:59:12.409 INFO:tasks.workunit.client.0.smithi134.stdout:7/436: dwrite da/d15/d26/d38/f84 [0,4194304] 0 2024-04-13T10:59:12.410 INFO:tasks.workunit.client.0.smithi134.stdout:5/679: dwrite dc/f28 [4194304,4194304] 0 2024-04-13T10:59:12.413 INFO:tasks.workunit.client.0.smithi134.stdout:1/577: getdents d3/d6/d20/d6d 0 2024-04-13T10:59:12.419 INFO:tasks.workunit.client.0.smithi134.stdout:7/437: chown da/d15/d26/d27/d47/d5a/c86 242 1 2024-04-13T10:59:12.424 INFO:tasks.workunit.client.0.smithi134.stdout:8/493: truncate d8/f44 881384 0 2024-04-13T10:59:12.426 INFO:tasks.workunit.client.0.smithi134.stdout:1/578: chown d3/d6/d6a/cb2 44215 1 2024-04-13T10:59:12.427 INFO:tasks.workunit.client.0.smithi134.stdout:0/485: creat d4/d5d/fb4 x:0 0 0 2024-04-13T10:59:12.428 INFO:tasks.workunit.client.0.smithi134.stdout:1/579: chown d3/l14 1894 1 2024-04-13T10:59:12.431 INFO:tasks.workunit.client.0.smithi134.stdout:7/438: dwrite da/d15/d26/d27/d4f/d5f/d67/d73/f7b [0,4194304] 0 2024-04-13T10:59:12.432 INFO:tasks.workunit.client.0.smithi134.stdout:7/439: chown da/l25 15609031 1 2024-04-13T10:59:12.432 INFO:tasks.workunit.client.0.smithi134.stdout:0/486: readlink d4/d17/l18 0 2024-04-13T10:59:12.433 INFO:tasks.workunit.client.0.smithi134.stdout:5/680: link dc/d15/d65/cdf dc/d1d/d67/ce0 0 2024-04-13T10:59:12.436 INFO:tasks.workunit.client.0.smithi134.stdout:8/494: creat d8/dc/d16/d4e/d9c/f9e x:0 0 0 2024-04-13T10:59:12.442 INFO:tasks.workunit.client.0.smithi134.stdout:8/495: creat d8/dc/d16/d54/d6c/f9f x:0 0 0 2024-04-13T10:59:12.443 INFO:tasks.workunit.client.0.smithi134.stdout:7/440: dwrite da/d15/d85/f8f [0,4194304] 0 2024-04-13T10:59:12.446 INFO:tasks.workunit.client.0.smithi134.stdout:8/496: truncate d8/dc/d16/f1b 1432940 0 2024-04-13T10:59:12.454 INFO:tasks.workunit.client.0.smithi134.stdout:8/497: creat d8/dc/d37/d3f/fa0 x:0 0 0 2024-04-13T10:59:12.454 INFO:tasks.workunit.client.0.smithi134.stdout:1/580: dread d3/d6/d20/d6d/db1/f25 [0,4194304] 0 2024-04-13T10:59:12.456 INFO:tasks.workunit.client.0.smithi134.stdout:7/441: getdents da/d15/d26/d27/d4f/d5f/d67/d73 0 2024-04-13T10:59:12.457 INFO:tasks.workunit.client.0.smithi134.stdout:7/442: fdatasync da/d15/d26/d27/f5c 0 2024-04-13T10:59:12.458 INFO:tasks.workunit.client.0.smithi134.stdout:1/581: symlink d3/d6/d20/d71/lbf 0 2024-04-13T10:59:12.459 INFO:tasks.workunit.client.0.smithi134.stdout:1/582: chown d3/d30/l64 131015 1 2024-04-13T10:59:12.460 INFO:tasks.workunit.client.0.smithi134.stdout:1/583: write d3/d6/d20/d71/fa4 [627203,94300] 0 2024-04-13T10:59:12.463 INFO:tasks.workunit.client.0.smithi134.stdout:7/443: fdatasync da/d15/d26/f62 0 2024-04-13T10:59:12.468 INFO:tasks.workunit.client.0.smithi134.stdout:8/498: dread d8/dc/d16/d54/d6c/f8e [4194304,4194304] 0 2024-04-13T10:59:12.469 INFO:tasks.workunit.client.0.smithi134.stdout:5/681: dread dc/d1d/d2f/d3b/f51 [0,4194304] 0 2024-04-13T10:59:12.472 INFO:tasks.workunit.client.0.smithi134.stdout:5/682: write dc/d1d/d20/f87 [227255,37750] 0 2024-04-13T10:59:12.474 INFO:tasks.workunit.client.0.smithi134.stdout:6/468: truncate d4/da/d15/f8a 1288000 0 2024-04-13T10:59:12.475 INFO:tasks.workunit.client.0.smithi134.stdout:5/683: write dc/d1d/d20/ddc/fc2 [94384,16887] 0 2024-04-13T10:59:12.479 INFO:tasks.workunit.client.0.smithi134.stdout:5/684: fsync dc/d1d/d2b/d30/d3e/fc7 0 2024-04-13T10:59:12.481 INFO:tasks.workunit.client.0.smithi134.stdout:1/584: dread d3/d6/d20/d71/f88 [0,4194304] 0 2024-04-13T10:59:12.483 INFO:tasks.workunit.client.0.smithi134.stdout:1/585: write d3/d6/d20/d71/d9c/fbc [581930,12859] 0 2024-04-13T10:59:12.496 INFO:tasks.workunit.client.0.smithi134.stdout:2/423: sync 2024-04-13T10:59:12.497 INFO:tasks.workunit.client.0.smithi134.stdout:9/527: sync 2024-04-13T10:59:12.498 INFO:tasks.workunit.client.0.smithi134.stdout:8/499: link d8/dc/d2c/c50 d8/dc/d16/ca1 0 2024-04-13T10:59:12.498 INFO:tasks.workunit.client.0.smithi134.stdout:1/586: read d3/f18 [1527486,55441] 0 2024-04-13T10:59:12.501 INFO:tasks.workunit.client.0.smithi134.stdout:8/500: write d8/dc/d37/f64 [150761,10354] 0 2024-04-13T10:59:12.501 INFO:tasks.workunit.client.0.smithi134.stdout:0/487: truncate d4/d17/da/f27 1929303 0 2024-04-13T10:59:12.505 INFO:tasks.workunit.client.0.smithi134.stdout:9/528: write d13/d39/d52/fa4 [12206,130598] 0 2024-04-13T10:59:12.510 INFO:tasks.workunit.client.0.smithi134.stdout:1/587: link d3/d6/d16/d1d/d3c/f53 d3/d6/d20/d9f/dbe/fc0 0 2024-04-13T10:59:12.511 INFO:tasks.workunit.client.0.smithi134.stdout:8/501: write d8/dc/d16/d54/f59 [4201962,78781] 0 2024-04-13T10:59:12.517 INFO:tasks.workunit.client.0.smithi134.stdout:1/588: dread d3/d6/f31 [0,4194304] 0 2024-04-13T10:59:12.518 INFO:tasks.workunit.client.0.smithi134.stdout:0/488: dwrite d4/d17/da/d22/d37/fac [0,4194304] 0 2024-04-13T10:59:12.523 INFO:tasks.workunit.client.0.smithi134.stdout:7/444: write da/f13 [1798608,25535] 0 2024-04-13T10:59:12.524 INFO:tasks.workunit.client.0.smithi134.stdout:7/445: read - da/d15/d26/d27/d3d/d46/f4b zero size 2024-04-13T10:59:12.534 INFO:tasks.workunit.client.0.smithi134.stdout:2/424: truncate d5/d6/d57/d6f/d30/f4f 1760857 0 2024-04-13T10:59:12.539 INFO:tasks.workunit.client.0.smithi134.stdout:5/685: dwrite dc/d1d/d2f/d3b/d6a/f6b [0,4194304] 0 2024-04-13T10:59:12.541 INFO:tasks.workunit.client.0.smithi134.stdout:6/469: write d4/da/d15/d1f/d24/d2b/f51 [323437,94267] 0 2024-04-13T10:59:12.542 INFO:tasks.workunit.client.0.smithi134.stdout:0/489: creat d4/d17/d20/d29/d30/d64/fb5 x:0 0 0 2024-04-13T10:59:12.545 INFO:tasks.workunit.client.0.smithi134.stdout:1/589: rename d3/d6/d6a/c81 to d3/d6/d20/d6d/d8b/cc1 0 2024-04-13T10:59:12.555 INFO:tasks.workunit.client.0.smithi134.stdout:1/590: dwrite d3/d6/d16/f19 [4194304,4194304] 0 2024-04-13T10:59:12.555 INFO:tasks.workunit.client.0.smithi134.stdout:9/529: mknod d13/cb8 0 2024-04-13T10:59:12.557 INFO:tasks.workunit.client.0.smithi134.stdout:7/446: dwrite da/d15/d26/f35 [0,4194304] 0 2024-04-13T10:59:12.560 INFO:tasks.workunit.client.0.smithi134.stdout:9/530: dread - d13/d40/d7d/f7f zero size 2024-04-13T10:59:12.560 INFO:tasks.workunit.client.0.smithi134.stdout:1/591: fdatasync d3/d6/d20/f7b 0 2024-04-13T10:59:12.562 INFO:tasks.workunit.client.0.smithi134.stdout:7/447: chown da/d15/d26/d27/d4f/d5f/d67/d73/f91 16209 1 2024-04-13T10:59:12.565 INFO:tasks.workunit.client.0.smithi134.stdout:6/470: dread d4/f4d [0,4194304] 0 2024-04-13T10:59:12.570 INFO:tasks.workunit.client.0.smithi134.stdout:8/502: creat d8/dc/d16/d4e/fa2 x:0 0 0 2024-04-13T10:59:12.573 INFO:tasks.workunit.client.0.smithi134.stdout:8/503: stat d8/dc/d13/f32 0 2024-04-13T10:59:12.573 INFO:tasks.workunit.client.0.smithi134.stdout:7/448: dread da/d15/f1a [0,4194304] 0 2024-04-13T10:59:12.578 INFO:tasks.workunit.client.0.smithi134.stdout:9/531: read d13/d2e/d35/d50/d59/fb5 [2769340,27587] 0 2024-04-13T10:59:12.578 INFO:tasks.workunit.client.0.smithi134.stdout:1/592: unlink d3/d6/d20/f38 0 2024-04-13T10:59:12.579 INFO:tasks.workunit.client.0.smithi134.stdout:9/532: stat d13/d2e/d35/d50/d59 0 2024-04-13T10:59:12.582 INFO:tasks.workunit.client.0.smithi134.stdout:3/424: sync 2024-04-13T10:59:12.582 INFO:tasks.workunit.client.0.smithi134.stdout:4/347: sync 2024-04-13T10:59:12.583 INFO:tasks.workunit.client.0.smithi134.stdout:0/490: truncate d4/d17/da/d22/d37/d47/f5e 1631208 0 2024-04-13T10:59:12.583 INFO:tasks.workunit.client.0.smithi134.stdout:4/348: chown d4/d48/f72 1717 1 2024-04-13T10:59:12.584 INFO:tasks.workunit.client.0.smithi134.stdout:3/425: write dc/d27/d19/f3b [2977996,126147] 0 2024-04-13T10:59:12.586 INFO:tasks.workunit.client.0.smithi134.stdout:7/449: mkdir da/d15/d26/d27/d4f/d5f/d67/d73/d92 0 2024-04-13T10:59:12.591 INFO:tasks.workunit.client.0.smithi134.stdout:1/593: creat d3/d6/d20/d6d/db1/fc2 x:0 0 0 2024-04-13T10:59:12.592 INFO:tasks.workunit.client.0.smithi134.stdout:7/450: dread da/d15/d26/f35 [0,4194304] 0 2024-04-13T10:59:12.593 INFO:tasks.workunit.client.0.smithi134.stdout:3/426: dwrite dc/d27/d19/d48/d49/f67 [0,4194304] 0 2024-04-13T10:59:12.595 INFO:tasks.workunit.client.0.smithi134.stdout:5/686: rename dc/d1d/d2f/d3b/d7f/d8d/d7d/dc0/fc6 to dc/d39/d63/fe1 0 2024-04-13T10:59:12.596 INFO:tasks.workunit.client.0.smithi134.stdout:1/594: dread d3/d6/d16/f7d [0,4194304] 0 2024-04-13T10:59:12.596 INFO:tasks.workunit.client.0.smithi134.stdout:8/504: mkdir d8/dc/d16/d54/d98/d9b/da3 0 2024-04-13T10:59:12.599 INFO:tasks.workunit.client.0.smithi134.stdout:2/425: truncate d5/d6/d57/d6c/d29/f46 110715 0 2024-04-13T10:59:12.599 INFO:tasks.workunit.client.0.smithi134.stdout:1/595: fdatasync d3/d6/d20/d71/fa4 0 2024-04-13T10:59:12.602 INFO:tasks.workunit.client.0.smithi134.stdout:6/471: creat d4/da/d15/d1f/d24/f93 x:0 0 0 2024-04-13T10:59:12.602 INFO:tasks.workunit.client.0.smithi134.stdout:0/491: read d4/d17/d20/d29/f5b [149280,125183] 0 2024-04-13T10:59:12.602 INFO:tasks.workunit.client.0.smithi134.stdout:6/472: stat d4/f4d 0 2024-04-13T10:59:12.602 INFO:tasks.workunit.client.0.smithi134.stdout:9/533: dwrite d13/d39/f4d [0,4194304] 0 2024-04-13T10:59:12.603 INFO:tasks.workunit.client.0.smithi134.stdout:6/473: fsync d4/da/d69/f78 0 2024-04-13T10:59:12.606 INFO:tasks.workunit.client.0.smithi134.stdout:4/349: rename d4/d1b to d4/d1f/d27/d75/d38/d79 0 2024-04-13T10:59:12.608 INFO:tasks.workunit.client.0.smithi134.stdout:7/451: creat da/d15/d26/d27/d47/d48/f93 x:0 0 0 2024-04-13T10:59:12.610 INFO:tasks.workunit.client.0.smithi134.stdout:7/452: write da/d15/f6e [737685,117902] 0 2024-04-13T10:59:12.610 INFO:tasks.workunit.client.0.smithi134.stdout:3/427: dwrite dc/d27/d4d/f5e [0,4194304] 0 2024-04-13T10:59:12.613 INFO:tasks.workunit.client.0.smithi134.stdout:8/505: rmdir d8/dc/d13 39 2024-04-13T10:59:12.613 INFO:tasks.workunit.client.0.smithi134.stdout:3/428: read dc/d27/d4d/d4f/d50/d25/f3e [2559450,64009] 0 2024-04-13T10:59:12.621 INFO:tasks.workunit.client.0.smithi134.stdout:1/596: unlink d3/d30/f7a 0 2024-04-13T10:59:12.623 INFO:tasks.workunit.client.0.smithi134.stdout:9/534: rmdir d13/d2e/d35 39 2024-04-13T10:59:12.624 INFO:tasks.workunit.client.0.smithi134.stdout:1/597: read d3/d6/d20/d6d/db1/f46 [884371,142] 0 2024-04-13T10:59:12.626 INFO:tasks.workunit.client.0.smithi134.stdout:6/474: mknod d4/da/d15/d1f/d24/d2b/c94 0 2024-04-13T10:59:12.627 INFO:tasks.workunit.client.0.smithi134.stdout:4/350: creat d4/f7a x:0 0 0 2024-04-13T10:59:12.630 INFO:tasks.workunit.client.0.smithi134.stdout:4/351: write d4/dd/f39 [4482049,114355] 0 2024-04-13T10:59:12.630 INFO:tasks.workunit.client.0.smithi134.stdout:5/687: mkdir dc/d39/d63/de2 0 2024-04-13T10:59:12.635 INFO:tasks.workunit.client.0.smithi134.stdout:7/453: mknod da/d15/d26/d4a/c94 0 2024-04-13T10:59:12.635 INFO:tasks.workunit.client.0.smithi134.stdout:6/475: dwrite d4/da/d15/d76/f7c [0,4194304] 0 2024-04-13T10:59:12.638 INFO:tasks.workunit.client.0.smithi134.stdout:7/454: truncate da/d15/f24 4577005 0 2024-04-13T10:59:12.638 INFO:tasks.workunit.client.0.smithi134.stdout:8/506: mknod d8/dc/d2c/ca4 0 2024-04-13T10:59:12.640 INFO:tasks.workunit.client.0.smithi134.stdout:2/426: write d5/de/d2e/f64 [793836,99443] 0 2024-04-13T10:59:12.642 INFO:tasks.workunit.client.0.smithi134.stdout:6/476: write d4/da/d15/d1f/d24/d49/f83 [117275,112986] 0 2024-04-13T10:59:12.644 INFO:tasks.workunit.client.0.smithi134.stdout:4/352: dwrite d4/d1f/d27/d75/d38/d79/f28 [0,4194304] 0 2024-04-13T10:59:12.648 INFO:tasks.workunit.client.0.smithi134.stdout:3/429: dread dc/d27/d19/f3b [0,4194304] 0 2024-04-13T10:59:12.656 INFO:tasks.workunit.client.0.smithi134.stdout:6/477: dwrite d4/da/d15/d1f/f2a [4194304,4194304] 0 2024-04-13T10:59:12.658 INFO:tasks.workunit.client.0.smithi134.stdout:6/478: chown d4/da/d15/c22 81253 1 2024-04-13T10:59:12.659 INFO:tasks.workunit.client.0.smithi134.stdout:5/688: symlink dc/d1d/d46/le3 0 2024-04-13T10:59:12.664 INFO:tasks.workunit.client.0.smithi134.stdout:6/479: chown d4/da/d15/d1f/d24/d2b/f40 38601364 1 2024-04-13T10:59:12.665 INFO:tasks.workunit.client.0.smithi134.stdout:2/427: mknod d5/d6/d34/c82 0 2024-04-13T10:59:12.665 INFO:tasks.workunit.client.0.smithi134.stdout:3/430: dwrite dc/d27/d4d/f6e [0,4194304] 0 2024-04-13T10:59:12.667 INFO:tasks.workunit.client.0.smithi134.stdout:5/689: dread dc/f75 [0,4194304] 0 2024-04-13T10:59:12.668 INFO:tasks.workunit.client.0.smithi134.stdout:6/480: chown d4/da/d15/f1e 2003997 1 2024-04-13T10:59:12.668 INFO:tasks.workunit.client.0.smithi134.stdout:3/431: truncate dc/d27/d19/f6a 929505 0 2024-04-13T10:59:12.671 INFO:tasks.workunit.client.0.smithi134.stdout:9/535: rename d13/d39/f5e to d13/d2e/d35/d50/d59/d74/d8d/fb9 0 2024-04-13T10:59:12.672 INFO:tasks.workunit.client.0.smithi134.stdout:4/353: rmdir d4/d1f/d27/d75/d38 39 2024-04-13T10:59:12.675 INFO:tasks.workunit.client.0.smithi134.stdout:1/598: unlink d3/d6/d20/la2 0 2024-04-13T10:59:12.679 INFO:tasks.workunit.client.0.smithi134.stdout:7/455: mkdir da/d15/d26/d27/d3d/d46/d95 0 2024-04-13T10:59:12.682 INFO:tasks.workunit.client.0.smithi134.stdout:5/690: creat dc/d1d/d2f/d3b/d7f/d8d/fe4 x:0 0 0 2024-04-13T10:59:12.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:12 smithi134 ceph-mon[39696]: pgmap v40: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 24 MiB/s rd, 110 MiB/s wr, 229 op/s 2024-04-13T10:59:12.685 INFO:tasks.workunit.client.0.smithi134.stdout:3/432: rename dc/d27/d4d/c3f to dc/d27/d19/c88 0 2024-04-13T10:59:12.685 INFO:tasks.workunit.client.0.smithi134.stdout:8/507: write d8/dc/d37/f71 [823197,38689] 0 2024-04-13T10:59:12.689 INFO:tasks.workunit.client.0.smithi134.stdout:1/599: rmdir d3/d6/d16 39 2024-04-13T10:59:12.694 INFO:tasks.workunit.client.0.smithi134.stdout:7/456: write da/d15/d26/d27/d4f/d5f/d88/f8d [558296,80093] 0 2024-04-13T10:59:12.696 INFO:tasks.workunit.client.0.smithi134.stdout:5/691: symlink dc/d1d/d20/d23/d36/dbd/le5 0 2024-04-13T10:59:12.698 INFO:tasks.workunit.client.0.smithi134.stdout:5/692: chown dc/d1d/d2f/d3b/fcb 91268 1 2024-04-13T10:59:12.698 INFO:tasks.workunit.client.0.smithi134.stdout:4/354: dread - d4/d1f/d27/d75/d38/d79/d32/f3b zero size 2024-04-13T10:59:12.700 INFO:tasks.workunit.client.0.smithi134.stdout:8/508: creat d8/dc/d9d/d69/fa5 x:0 0 0 2024-04-13T10:59:12.700 INFO:tasks.workunit.client.0.smithi134.stdout:8/509: dread - d8/dc/d37/d3f/fa0 zero size 2024-04-13T10:59:12.704 INFO:tasks.workunit.client.0.smithi134.stdout:3/433: rename dc/d27/d4d/f6e to dc/d27/d19/d48/d77/f89 0 2024-04-13T10:59:12.705 INFO:tasks.workunit.client.0.smithi134.stdout:1/600: rmdir d3/d6/d20/d6d/db1 39 2024-04-13T10:59:12.706 INFO:tasks.workunit.client.0.smithi134.stdout:1/601: truncate d3/d30/f48 4560165 0 2024-04-13T10:59:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:12 smithi194 ceph-mon[46737]: pgmap v40: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 24 MiB/s rd, 110 MiB/s wr, 229 op/s 2024-04-13T10:59:12.792 INFO:tasks.workunit.client.0.smithi134.stdout:6/481: creat d4/da/f95 x:0 0 0 2024-04-13T10:59:12.792 INFO:tasks.workunit.client.0.smithi134.stdout:7/457: symlink da/d15/d26/d27/d3d/l96 0 2024-04-13T10:59:12.793 INFO:tasks.workunit.client.0.smithi134.stdout:2/428: truncate d5/de/d12/f1d 3068211 0 2024-04-13T10:59:12.794 INFO:tasks.workunit.client.0.smithi134.stdout:6/482: readlink d4/da/d15/l4f 0 2024-04-13T10:59:12.795 INFO:tasks.workunit.client.0.smithi134.stdout:9/536: getdents d13/d39/d52/d86/d9f 0 2024-04-13T10:59:12.796 INFO:tasks.workunit.client.0.smithi134.stdout:1/602: write d3/d6/d16/d1d/f84 [356594,34841] 0 2024-04-13T10:59:12.800 INFO:tasks.workunit.client.0.smithi134.stdout:7/458: symlink da/d15/d26/d27/d4f/d5f/d67/d76/l97 0 2024-04-13T10:59:12.803 INFO:tasks.workunit.client.0.smithi134.stdout:4/355: truncate d4/f2a 1634034 0 2024-04-13T10:59:12.804 INFO:tasks.workunit.client.0.smithi134.stdout:8/510: write d8/dc/d16/d54/d6c/d7d/f85 [55352,121582] 0 2024-04-13T10:59:12.805 INFO:tasks.workunit.client.0.smithi134.stdout:3/434: link dc/d27/l3d dc/d1d/l8a 0 2024-04-13T10:59:12.807 INFO:tasks.workunit.client.0.smithi134.stdout:9/537: chown d13/d2e/d35/d50/d59/d74/d8d/fb9 187208 1 2024-04-13T10:59:12.809 INFO:tasks.workunit.client.0.smithi134.stdout:9/538: dread - d13/d40/d7d/f7f zero size 2024-04-13T10:59:12.812 INFO:tasks.workunit.client.0.smithi134.stdout:1/603: dwrite d3/d6/d20/d6d/d8b/f92 [0,4194304] 0 2024-04-13T10:59:12.813 INFO:tasks.workunit.client.0.smithi134.stdout:4/356: unlink d4/dd/f39 0 2024-04-13T10:59:12.816 INFO:tasks.workunit.client.0.smithi134.stdout:9/539: dread d13/d39/f4d [0,4194304] 0 2024-04-13T10:59:12.817 INFO:tasks.workunit.client.0.smithi134.stdout:3/435: mkdir dc/d27/d19/d8b 0 2024-04-13T10:59:12.821 INFO:tasks.workunit.client.0.smithi134.stdout:6/483: creat d4/da/d15/d1f/f96 x:0 0 0 2024-04-13T10:59:12.824 INFO:tasks.workunit.client.0.smithi134.stdout:8/511: creat d8/dc/d16/d54/d98/d9b/da3/fa6 x:0 0 0 2024-04-13T10:59:12.826 INFO:tasks.workunit.client.0.smithi134.stdout:4/357: symlink d4/d1f/d27/d3a/d53/l7b 0 2024-04-13T10:59:12.826 INFO:tasks.workunit.client.0.smithi134.stdout:8/512: chown d8/dc/d16/d54/d6f/f90 34370418 1 2024-04-13T10:59:12.827 INFO:tasks.workunit.client.0.smithi134.stdout:2/429: getdents d5/de/d2e 0 2024-04-13T10:59:12.830 INFO:tasks.workunit.client.0.smithi134.stdout:7/459: rename da/d15/d26/d27/d47/d48/f6f to da/d15/d26/d27/d3d/d46/d95/f98 0 2024-04-13T10:59:12.831 INFO:tasks.workunit.client.0.smithi134.stdout:6/484: symlink d4/da/d15/d77/l97 0 2024-04-13T10:59:12.834 INFO:tasks.workunit.client.0.smithi134.stdout:8/513: mkdir d8/dc/d16/d4e/d9c/da7 0 2024-04-13T10:59:12.835 INFO:tasks.workunit.client.0.smithi134.stdout:3/436: getdents dc/d2a 0 2024-04-13T10:59:12.836 INFO:tasks.workunit.client.0.smithi134.stdout:2/430: creat d5/d6/d57/d6f/d30/d58/d73/f83 x:0 0 0 2024-04-13T10:59:12.841 INFO:tasks.workunit.client.0.smithi134.stdout:6/485: stat d4/lc 0 2024-04-13T10:59:12.841 INFO:tasks.workunit.client.0.smithi134.stdout:2/431: dread d5/d6/d57/d6c/d29/f72 [4194304,4194304] 0 2024-04-13T10:59:12.843 INFO:tasks.workunit.client.0.smithi134.stdout:1/604: creat d3/d6/fc3 x:0 0 0 2024-04-13T10:59:12.844 INFO:tasks.workunit.client.0.smithi134.stdout:9/540: link d13/d39/d52/da2/la6 d13/d40/lba 0 2024-04-13T10:59:12.849 INFO:tasks.workunit.client.0.smithi134.stdout:4/358: write d4/d1f/d27/d2e/f5c [650401,76017] 0 2024-04-13T10:59:12.853 INFO:tasks.workunit.client.0.smithi134.stdout:6/486: fsync d4/da/d15/d1f/d3c/f45 0 2024-04-13T10:59:12.854 INFO:tasks.workunit.client.0.smithi134.stdout:8/514: dwrite d8/dc/d13/f1e [0,4194304] 0 2024-04-13T10:59:12.855 INFO:tasks.workunit.client.0.smithi134.stdout:1/605: write d3/d6/d20/d6d/db1/f25 [1593003,42216] 0 2024-04-13T10:59:12.856 INFO:tasks.workunit.client.0.smithi134.stdout:9/541: rename d13/d2e/d35/d50/d59/d74/d8d to d13/d39/d58/d5f/dbb 0 2024-04-13T10:59:12.857 INFO:tasks.workunit.client.0.smithi134.stdout:1/606: dread - d3/d6/d16/d4d/fb5 zero size 2024-04-13T10:59:12.859 INFO:tasks.workunit.client.0.smithi134.stdout:3/437: mknod dc/d27/d4d/d4f/d50/c8c 0 2024-04-13T10:59:12.866 INFO:tasks.workunit.client.0.smithi134.stdout:4/359: rename d4/d1f/f62 to d4/d1f/d27/d75/d38/d79/d32/f7c 0 2024-04-13T10:59:12.868 INFO:tasks.workunit.client.0.smithi134.stdout:9/542: fdatasync d13/d40/f48 0 2024-04-13T10:59:12.870 INFO:tasks.workunit.client.0.smithi134.stdout:6/487: dread d4/da/f2f [0,4194304] 0 2024-04-13T10:59:12.871 INFO:tasks.workunit.client.0.smithi134.stdout:7/460: getdents da/d15/d26/d27/d4f 0 2024-04-13T10:59:12.871 INFO:tasks.workunit.client.0.smithi134.stdout:7/461: chown da/d15/l7f 0 1 2024-04-13T10:59:12.873 INFO:tasks.workunit.client.0.smithi134.stdout:7/462: chown da/d15/d26/d27/d4f/d5f/d67 1262 1 2024-04-13T10:59:12.874 INFO:tasks.workunit.client.0.smithi134.stdout:3/438: rmdir dc 39 2024-04-13T10:59:12.875 INFO:tasks.workunit.client.0.smithi134.stdout:2/432: write d5/de/d12/f6a [2554720,117546] 0 2024-04-13T10:59:12.880 INFO:tasks.workunit.client.0.smithi134.stdout:4/360: mknod d4/d1f/d27/d2e/c7d 0 2024-04-13T10:59:12.881 INFO:tasks.workunit.client.0.smithi134.stdout:7/463: dwrite da/d15/d26/d27/d47/d48/f93 [0,4194304] 0 2024-04-13T10:59:12.883 INFO:tasks.workunit.client.0.smithi134.stdout:7/464: fsync da/d15/d26/d38/f66 0 2024-04-13T10:59:12.884 INFO:tasks.workunit.client.0.smithi134.stdout:9/543: creat d13/d2e/d35/d50/d59/fbc x:0 0 0 2024-04-13T10:59:12.886 INFO:tasks.workunit.client.0.smithi134.stdout:2/433: dwrite d5/d6/d57/d6f/f44 [0,4194304] 0 2024-04-13T10:59:12.889 INFO:tasks.workunit.client.0.smithi134.stdout:7/465: write da/d15/d26/d27/d4f/d5f/d67/d73/f7b [2540768,68710] 0 2024-04-13T10:59:12.890 INFO:tasks.workunit.client.0.smithi134.stdout:3/439: read dc/f66 [806768,95891] 0 2024-04-13T10:59:12.898 INFO:tasks.workunit.client.0.smithi134.stdout:6/488: write d4/da/d1a/f44 [939190,21496] 0 2024-04-13T10:59:12.898 INFO:tasks.workunit.client.0.smithi134.stdout:8/515: getdents d8/dc/d2c/d68/d8c/d8f 0 2024-04-13T10:59:12.899 INFO:tasks.workunit.client.0.smithi134.stdout:7/466: dread - da/d15/d26/f4d zero size 2024-04-13T10:59:12.899 INFO:tasks.workunit.client.0.smithi134.stdout:3/440: creat dc/d1d/f8d x:0 0 0 2024-04-13T10:59:12.899 INFO:tasks.workunit.client.0.smithi134.stdout:8/516: chown d8/dc/d16/d54/d6c/d7d 0 1 2024-04-13T10:59:12.900 INFO:tasks.workunit.client.0.smithi134.stdout:1/607: rename d3/d6/d16/d4d/f7c to d3/d6/d20/d6d/fc4 0 2024-04-13T10:59:12.901 INFO:tasks.workunit.client.0.smithi134.stdout:7/467: write da/d15/d26/d27/d47/f55 [204007,79258] 0 2024-04-13T10:59:12.903 INFO:tasks.workunit.client.0.smithi134.stdout:8/517: truncate d8/dc/d16/d54/d6c/f8e 5714540 0 2024-04-13T10:59:12.904 INFO:tasks.workunit.client.0.smithi134.stdout:1/608: read d3/d6/d16/d1d/d68/f5d [569547,100737] 0 2024-04-13T10:59:12.906 INFO:tasks.workunit.client.0.smithi134.stdout:1/609: truncate d3/d6/d16/d1d/d86/fb4 342418 0 2024-04-13T10:59:12.907 INFO:tasks.workunit.client.0.smithi134.stdout:1/610: stat d3/d6/f4f 0 2024-04-13T10:59:12.907 INFO:tasks.workunit.client.0.smithi134.stdout:3/441: mkdir dc/d27/d19/d48/d8e 0 2024-04-13T10:59:12.909 INFO:tasks.workunit.client.0.smithi134.stdout:1/611: write d3/d6/d16/fbd [667403,100519] 0 2024-04-13T10:59:12.911 INFO:tasks.workunit.client.0.smithi134.stdout:8/518: creat d8/dc/d9d/fa8 x:0 0 0 2024-04-13T10:59:12.913 INFO:tasks.workunit.client.0.smithi134.stdout:6/489: creat d4/da/d15/d1f/f98 x:0 0 0 2024-04-13T10:59:12.913 INFO:tasks.workunit.client.0.smithi134.stdout:2/434: write d5/d6/d57/d6c/f4d [7197181,22897] 0 2024-04-13T10:59:12.916 INFO:tasks.workunit.client.0.smithi134.stdout:8/519: write d8/dc/d13/f7c [440179,56418] 0 2024-04-13T10:59:12.918 INFO:tasks.workunit.client.0.smithi134.stdout:7/468: dread da/d15/d26/d27/f34 [4194304,4194304] 0 2024-04-13T10:59:12.919 INFO:tasks.workunit.client.0.smithi134.stdout:6/490: write d4/da/d15/d1f/f2a [2537843,90080] 0 2024-04-13T10:59:12.919 INFO:tasks.workunit.client.0.smithi134.stdout:3/442: getdents dc/d27/d19/d8b 0 2024-04-13T10:59:12.920 INFO:tasks.workunit.client.0.smithi134.stdout:4/361: dwrite d4/d48/f4c [0,4194304] 0 2024-04-13T10:59:12.922 INFO:tasks.workunit.client.0.smithi134.stdout:3/443: chown dc/d27/d4d 269677 1 2024-04-13T10:59:12.923 INFO:tasks.workunit.client.0.smithi134.stdout:2/435: rmdir d5/d6 39 2024-04-13T10:59:12.927 INFO:tasks.workunit.client.0.smithi134.stdout:1/612: mkdir d3/d6/dc5 0 2024-04-13T10:59:12.928 INFO:tasks.workunit.client.0.smithi134.stdout:9/544: dread d13/f17 [0,4194304] 0 2024-04-13T10:59:12.930 INFO:tasks.workunit.client.0.smithi134.stdout:4/362: dwrite d4/d48/f5a [0,4194304] 0 2024-04-13T10:59:12.934 INFO:tasks.workunit.client.0.smithi134.stdout:8/520: creat d8/dc/d2c/d68/d8c/d8f/fa9 x:0 0 0 2024-04-13T10:59:12.939 INFO:tasks.workunit.client.0.smithi134.stdout:7/469: mknod da/d15/d26/d27/d4f/d5f/d67/d73/c99 0 2024-04-13T10:59:12.941 INFO:tasks.workunit.client.0.smithi134.stdout:1/613: creat d3/d6/d16/d1d/d3c/fc6 x:0 0 0 2024-04-13T10:59:12.942 INFO:tasks.workunit.client.0.smithi134.stdout:6/491: mknod d4/da/d15/d1f/d24/d49/d91/c99 0 2024-04-13T10:59:12.944 INFO:tasks.workunit.client.0.smithi134.stdout:3/444: mkdir dc/d27/d4d/d4f/d50/d25/d5f/d75/d8f 0 2024-04-13T10:59:12.945 INFO:tasks.workunit.client.0.smithi134.stdout:9/545: dwrite d13/d39/d52/fb6 [0,4194304] 0 2024-04-13T10:59:12.945 INFO:tasks.workunit.client.0.smithi134.stdout:8/521: creat d8/dc/d16/d54/d6c/faa x:0 0 0 2024-04-13T10:59:12.947 INFO:tasks.workunit.client.0.smithi134.stdout:3/445: chown dc/d27/f18 129399702 1 2024-04-13T10:59:12.949 INFO:tasks.workunit.client.0.smithi134.stdout:3/446: fdatasync dc/d1d/f39 0 2024-04-13T10:59:12.950 INFO:tasks.workunit.client.0.smithi134.stdout:4/363: dwrite d4/dd/f3f [0,4194304] 0 2024-04-13T10:59:12.950 INFO:tasks.workunit.client.0.smithi134.stdout:9/546: chown d13/c19 51 1 2024-04-13T10:59:12.950 INFO:tasks.workunit.client.0.smithi134.stdout:6/492: chown d4/da/d15/d1f/d24/d49/d91/c99 23 1 2024-04-13T10:59:12.951 INFO:tasks.workunit.client.0.smithi134.stdout:4/364: readlink d4/l24 0 2024-04-13T10:59:12.952 INFO:tasks.workunit.client.0.smithi134.stdout:6/493: chown d4/da/d15/d77/l6c 103 1 2024-04-13T10:59:12.954 INFO:tasks.workunit.client.0.smithi134.stdout:2/436: mkdir d5/d6/d70/d84 0 2024-04-13T10:59:12.955 INFO:tasks.workunit.client.0.smithi134.stdout:1/614: readlink d3/d6/d16/d4d/d65/l8c 0 2024-04-13T10:59:12.957 INFO:tasks.workunit.client.0.smithi134.stdout:8/522: symlink d8/dc/d16/d54/d98/d9b/lab 0 2024-04-13T10:59:12.961 INFO:tasks.workunit.client.0.smithi134.stdout:9/547: rmdir d13/d39/d52/d86/d9f 39 2024-04-13T10:59:12.962 INFO:tasks.workunit.client.0.smithi134.stdout:8/523: dread d8/dc/d37/f3b [0,4194304] 0 2024-04-13T10:59:12.965 INFO:tasks.workunit.client.0.smithi134.stdout:2/437: symlink d5/de/l85 0 2024-04-13T10:59:12.966 INFO:tasks.workunit.client.0.smithi134.stdout:2/438: write d5/de/d12/f6a [933541,42239] 0 2024-04-13T10:59:12.967 INFO:tasks.workunit.client.0.smithi134.stdout:1/615: mknod d3/d6/dd/cc7 0 2024-04-13T10:59:12.971 INFO:tasks.workunit.client.0.smithi134.stdout:3/447: getdents dc/d27/d4d/d4f/d62 0 2024-04-13T10:59:12.973 INFO:tasks.workunit.client.0.smithi134.stdout:9/548: chown d13/c1c 5902336 1 2024-04-13T10:59:12.986 INFO:tasks.workunit.client.0.smithi134.stdout:2/439: dwrite d5/de/d2e/f64 [0,4194304] 0 2024-04-13T10:59:12.986 INFO:tasks.workunit.client.0.smithi134.stdout:9/549: chown d13/d39/f45 35 1 2024-04-13T10:59:12.987 INFO:tasks.workunit.client.0.smithi134.stdout:4/365: dread d4/d1f/d27/d75/d38/f4e [0,4194304] 0 2024-04-13T10:59:12.987 INFO:tasks.workunit.client.0.smithi134.stdout:1/616: dwrite d3/d6/d16/d1d/d86/f96 [0,4194304] 0 2024-04-13T10:59:12.987 INFO:tasks.workunit.client.0.smithi134.stdout:3/448: dread dc/d27/d4d/d4f/d50/d25/f74 [0,4194304] 0 2024-04-13T10:59:12.987 INFO:tasks.workunit.client.0.smithi134.stdout:7/470: getdents da/d15 0 2024-04-13T10:59:12.987 INFO:tasks.workunit.client.0.smithi134.stdout:9/550: read f6 [2729699,67610] 0 2024-04-13T10:59:12.988 INFO:tasks.workunit.client.0.smithi134.stdout:1/617: truncate d3/d6/d16/d1d/dab/fb8 130701 0 2024-04-13T10:59:12.989 INFO:tasks.workunit.client.0.smithi134.stdout:8/524: symlink d8/dc/lac 0 2024-04-13T10:59:12.991 INFO:tasks.workunit.client.0.smithi134.stdout:1/618: chown d3/d6/d16/d4d/d65/l8c 11723419 1 2024-04-13T10:59:12.994 INFO:tasks.workunit.client.0.smithi134.stdout:4/366: mkdir d4/d48/d4a/d7e 0 2024-04-13T10:59:12.999 INFO:tasks.workunit.client.0.smithi134.stdout:2/440: dwrite d5/de/d50/f60 [0,4194304] 0 2024-04-13T10:59:13.001 INFO:tasks.workunit.client.0.smithi134.stdout:0/492: sync 2024-04-13T10:59:13.001 INFO:tasks.workunit.client.0.smithi134.stdout:5/693: sync 2024-04-13T10:59:13.002 INFO:tasks.workunit.client.0.smithi134.stdout:3/449: readlink dc/d1d/l8a 0 2024-04-13T10:59:13.005 INFO:tasks.workunit.client.0.smithi134.stdout:9/551: symlink d13/d40/lbd 0 2024-04-13T10:59:13.009 INFO:tasks.workunit.client.0.smithi134.stdout:8/525: dwrite d8/dc/d2c/d68/f7e [0,4194304] 0 2024-04-13T10:59:13.011 INFO:tasks.workunit.client.0.smithi134.stdout:6/494: dwrite d4/da/d15/d57/f5a [0,4194304] 0 2024-04-13T10:59:13.011 INFO:tasks.workunit.client.0.smithi134.stdout:4/367: rmdir d4/d48/d50/d60 39 2024-04-13T10:59:13.011 INFO:tasks.workunit.client.0.smithi134.stdout:8/526: chown d8/dc/f35 23 1 2024-04-13T10:59:13.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/495: fdatasync d4/da/d1a/f88 0 2024-04-13T10:59:13.016 INFO:tasks.workunit.client.0.smithi134.stdout:4/368: write d4/d1f/d27/d75/d38/d79/d32/d67/f70 [1044812,73175] 0 2024-04-13T10:59:13.021 INFO:tasks.workunit.client.0.smithi134.stdout:6/496: read d4/fd [651905,19373] 0 2024-04-13T10:59:13.022 INFO:tasks.workunit.client.0.smithi134.stdout:7/471: dread da/d15/d26/d27/f2d [0,4194304] 0 2024-04-13T10:59:13.023 INFO:tasks.workunit.client.0.smithi134.stdout:6/497: write d4/da/d68/f8b [220201,107687] 0 2024-04-13T10:59:13.027 INFO:tasks.workunit.client.0.smithi134.stdout:4/369: dread d4/dd/f3f [0,4194304] 0 2024-04-13T10:59:13.029 INFO:tasks.workunit.client.0.smithi134.stdout:4/370: fdatasync d4/d1f/d27/d75/d38/d79/d32/d67/f70 0 2024-04-13T10:59:13.037 INFO:tasks.workunit.client.0.smithi134.stdout:2/441: dread d5/de/d12/f1d [0,4194304] 0 2024-04-13T10:59:13.066 INFO:tasks.workunit.client.0.smithi134.stdout:0/493: mkdir d4/d17/da/d22/d37/d6d/d97/db6 0 2024-04-13T10:59:13.067 INFO:tasks.workunit.client.0.smithi134.stdout:0/494: stat d4/d17/d23/d51/d6a/d94/db2/f7d 0 2024-04-13T10:59:13.074 INFO:tasks.workunit.client.0.smithi134.stdout:1/619: truncate d3/d6/fc 3974411 0 2024-04-13T10:59:13.075 INFO:tasks.workunit.client.0.smithi134.stdout:5/694: dwrite dc/d1d/d67/fa6 [0,4194304] 0 2024-04-13T10:59:13.077 INFO:tasks.workunit.client.0.smithi134.stdout:2/442: fdatasync d5/de/f37 0 2024-04-13T10:59:13.086 INFO:tasks.workunit.client.0.smithi134.stdout:7/472: creat da/d15/d26/d27/d4f/d5f/d67/d73/d92/f9a x:0 0 0 2024-04-13T10:59:13.087 INFO:tasks.workunit.client.0.smithi134.stdout:4/371: mkdir d4/d1f/d27/d3a/d53/d58/d7f 0 2024-04-13T10:59:13.089 INFO:tasks.workunit.client.0.smithi134.stdout:1/620: creat d3/d6/d16/d1d/d68/fc8 x:0 0 0 2024-04-13T10:59:13.091 INFO:tasks.workunit.client.0.smithi134.stdout:0/495: dwrite d4/d17/d23/d51/d6b/d91/d98/d8b/d8c/faa [0,4194304] 0 2024-04-13T10:59:13.092 INFO:tasks.workunit.client.0.smithi134.stdout:9/552: creat d13/d39/d58/fbe x:0 0 0 2024-04-13T10:59:13.095 INFO:tasks.workunit.client.0.smithi134.stdout:8/527: creat d8/dc/fad x:0 0 0 2024-04-13T10:59:13.096 INFO:tasks.workunit.client.0.smithi134.stdout:6/498: rename d4/da/d69/f78 to d4/da/d15/d1f/d24/f9a 0 2024-04-13T10:59:13.098 INFO:tasks.workunit.client.0.smithi134.stdout:1/621: truncate d3/d6/d20/d6d/db1/fc2 469979 0 2024-04-13T10:59:13.102 INFO:tasks.workunit.client.0.smithi134.stdout:0/496: dread - d4/d17/da/d22/d37/d6d/da5/fb1 zero size 2024-04-13T10:59:13.104 INFO:tasks.workunit.client.0.smithi134.stdout:5/695: link dc/d1d/d46/f97 dc/d15/d65/fe6 0 2024-04-13T10:59:13.110 INFO:tasks.workunit.client.0.smithi134.stdout:8/528: rename d8/dc/d16/d4e/d9c/da7 to d8/dc/d2c/d68/dae 0 2024-04-13T10:59:13.112 INFO:tasks.workunit.client.0.smithi134.stdout:4/372: link d4/d1f/d27/d75/d38/d79/f46 d4/dd/d6d/f80 0 2024-04-13T10:59:13.122 INFO:tasks.workunit.client.0.smithi134.stdout:7/473: dread da/f12 [0,4194304] 0 2024-04-13T10:59:13.123 INFO:tasks.workunit.client.0.smithi134.stdout:8/529: rename d8/dc/d2c/d68/f7e to d8/dc/d16/d54/d98/d9b/faf 0 2024-04-13T10:59:13.128 INFO:tasks.workunit.client.0.smithi134.stdout:4/373: truncate d4/d1f/f5b 1251973 0 2024-04-13T10:59:13.135 INFO:tasks.workunit.client.0.smithi134.stdout:2/443: dwrite d5/de/d50/f7c [4194304,4194304] 0 2024-04-13T10:59:13.135 INFO:tasks.workunit.client.0.smithi134.stdout:8/530: symlink d8/dc/d16/d54/d98/lb0 0 2024-04-13T10:59:13.135 INFO:tasks.workunit.client.0.smithi134.stdout:0/497: dread d4/d17/da/d22/d37/f40 [0,4194304] 0 2024-04-13T10:59:13.139 INFO:tasks.workunit.client.0.smithi134.stdout:6/499: dwrite d4/f4d [0,4194304] 0 2024-04-13T10:59:13.143 INFO:tasks.workunit.client.0.smithi134.stdout:9/553: dwrite d13/d40/f6c [0,4194304] 0 2024-04-13T10:59:13.144 INFO:tasks.workunit.client.0.smithi134.stdout:2/444: read - d5/d6/d57/d6c/f67 zero size 2024-04-13T10:59:13.146 INFO:tasks.workunit.client.0.smithi134.stdout:0/498: fsync d4/d17/d20/d29/d30/d64/fb5 0 2024-04-13T10:59:13.146 INFO:tasks.workunit.client.0.smithi134.stdout:1/622: dwrite d3/d6/d16/d1d/d3c/f53 [4194304,4194304] 0 2024-04-13T10:59:13.151 INFO:tasks.workunit.client.0.smithi134.stdout:4/374: dread d4/d1f/d27/d75/d38/d79/f1c [0,4194304] 0 2024-04-13T10:59:13.152 INFO:tasks.workunit.client.0.smithi134.stdout:2/445: write d5/d6/d57/d6f/f44 [1201373,101862] 0 2024-04-13T10:59:13.152 INFO:tasks.workunit.client.0.smithi134.stdout:8/531: mkdir d8/dc/d2c/d68/d8c/d8f/db1 0 2024-04-13T10:59:13.155 INFO:tasks.workunit.client.0.smithi134.stdout:9/554: mknod d13/d2e/d35/cbf 0 2024-04-13T10:59:13.156 INFO:tasks.workunit.client.0.smithi134.stdout:4/375: chown d4/d1f/d27/d75/d38/d79/d32/d67/f70 171 1 2024-04-13T10:59:13.159 INFO:tasks.workunit.client.0.smithi134.stdout:0/499: mknod d4/d17/d23/d51/cb7 0 2024-04-13T10:59:13.161 INFO:tasks.workunit.client.0.smithi134.stdout:6/500: dwrite d4/f75 [0,4194304] 0 2024-04-13T10:59:13.163 INFO:tasks.workunit.client.0.smithi134.stdout:9/555: creat d13/d40/fc0 x:0 0 0 2024-04-13T10:59:13.169 INFO:tasks.workunit.client.0.smithi134.stdout:7/474: truncate da/d15/f24 2105925 0 2024-04-13T10:59:13.169 INFO:tasks.workunit.client.0.smithi134.stdout:9/556: read d13/f76 [3740724,14298] 0 2024-04-13T10:59:13.170 INFO:tasks.workunit.client.0.smithi134.stdout:7/475: stat da/d15/l7f 0 2024-04-13T10:59:13.172 INFO:tasks.workunit.client.0.smithi134.stdout:8/532: creat d8/dc/d16/d54/d6c/d94/fb2 x:0 0 0 2024-04-13T10:59:13.173 INFO:tasks.workunit.client.0.smithi134.stdout:6/501: creat d4/da/d15/d76/f9b x:0 0 0 2024-04-13T10:59:13.179 INFO:tasks.workunit.client.0.smithi134.stdout:4/376: read d4/d48/d50/d60/f36 [583207,8951] 0 2024-04-13T10:59:13.181 INFO:tasks.workunit.client.0.smithi134.stdout:7/476: rmdir da/d15/d26/d27/d47 39 2024-04-13T10:59:13.184 INFO:tasks.workunit.client.0.smithi134.stdout:0/500: creat d4/d17/da/d22/d37/d6d/d97/db6/fb8 x:0 0 0 2024-04-13T10:59:13.185 INFO:tasks.workunit.client.0.smithi134.stdout:0/501: stat d4/d17/da/d22/d41/d6e/d8a/d95 0 2024-04-13T10:59:13.185 INFO:tasks.workunit.client.0.smithi134.stdout:8/533: rmdir d8/dc/d16/d54/d6f 39 2024-04-13T10:59:13.188 INFO:tasks.workunit.client.0.smithi134.stdout:6/502: mknod d4/da/d15/d57/c9c 0 2024-04-13T10:59:13.191 INFO:tasks.workunit.client.0.smithi134.stdout:9/557: dread d13/f4c [0,4194304] 0 2024-04-13T10:59:13.192 INFO:tasks.workunit.client.0.smithi134.stdout:1/623: getdents d3/d6/d20/d71/d9c 0 2024-04-13T10:59:13.195 INFO:tasks.workunit.client.0.smithi134.stdout:7/477: symlink da/d15/d26/d27/d4f/d5f/l9b 0 2024-04-13T10:59:13.196 INFO:tasks.workunit.client.0.smithi134.stdout:0/502: dwrite d4/d17/d23/d51/d6b/d91/f99 [0,4194304] 0 2024-04-13T10:59:13.197 INFO:tasks.workunit.client.0.smithi134.stdout:1/624: dread - d3/d6/d16/d4d/fbb zero size 2024-04-13T10:59:13.199 INFO:tasks.workunit.client.0.smithi134.stdout:6/503: dread d4/f4d [0,4194304] 0 2024-04-13T10:59:13.199 INFO:tasks.workunit.client.0.smithi134.stdout:8/534: fdatasync d8/f2b 0 2024-04-13T10:59:13.200 INFO:tasks.workunit.client.0.smithi134.stdout:0/503: dread - d4/d17/d20/d29/d30/d64/fb5 zero size 2024-04-13T10:59:13.201 INFO:tasks.workunit.client.0.smithi134.stdout:6/504: chown d4/da/d15/d1f/f6b 504348057 1 2024-04-13T10:59:13.201 INFO:tasks.workunit.client.0.smithi134.stdout:2/446: getdents d5/d6/d57/d6f 0 2024-04-13T10:59:13.202 INFO:tasks.workunit.client.0.smithi134.stdout:6/505: fsync d4/da/d15/d1f/d24/d2b/f67 0 2024-04-13T10:59:13.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/447: chown d5/de/d50/f5d 3456 1 2024-04-13T10:59:13.204 INFO:tasks.workunit.client.0.smithi134.stdout:6/506: write d4/da/d15/f6e [509232,8527] 0 2024-04-13T10:59:13.205 INFO:tasks.workunit.client.0.smithi134.stdout:2/448: write d5/d6/d57/d6c/f49 [764011,124470] 0 2024-04-13T10:59:13.205 INFO:tasks.workunit.client.0.smithi134.stdout:4/377: link d4/d48/f72 d4/d1f/d27/d3a/d53/d58/f81 0 2024-04-13T10:59:13.207 INFO:tasks.workunit.client.0.smithi134.stdout:6/507: fdatasync d4/da/d15/d1f/d24/d49/f50 0 2024-04-13T10:59:13.208 INFO:tasks.workunit.client.0.smithi134.stdout:6/508: fdatasync d4/da/d15/d1f/f2a 0 2024-04-13T10:59:13.209 INFO:tasks.workunit.client.0.smithi134.stdout:9/558: chown d13/d39/d58/d5f/d6e/c89 3402 1 2024-04-13T10:59:13.213 INFO:tasks.workunit.client.0.smithi134.stdout:1/625: creat d3/d6/d20/d28/fc9 x:0 0 0 2024-04-13T10:59:13.219 INFO:tasks.workunit.client.0.smithi134.stdout:0/504: unlink d4/d17/da/d22/d37/d6d/da5/fb1 0 2024-04-13T10:59:13.220 INFO:tasks.workunit.client.0.smithi134.stdout:0/505: chown d4/d17/da/d22/d37/d47/d96 2013334119 1 2024-04-13T10:59:13.221 INFO:tasks.workunit.client.0.smithi134.stdout:4/378: mkdir d4/d82 0 2024-04-13T10:59:13.222 INFO:tasks.workunit.client.0.smithi134.stdout:2/449: dread d5/de/d50/f5e [0,4194304] 0 2024-04-13T10:59:13.223 INFO:tasks.workunit.client.0.smithi134.stdout:2/450: chown d5/d6/d57/d6c/c3f 1 1 2024-04-13T10:59:13.223 INFO:tasks.workunit.client.0.smithi134.stdout:2/451: readlink d5/d6/d57/l81 0 2024-04-13T10:59:13.225 INFO:tasks.workunit.client.0.smithi134.stdout:9/559: mkdir d13/d2e/d47/dc1 0 2024-04-13T10:59:13.229 INFO:tasks.workunit.client.0.smithi134.stdout:1/626: mknod d3/d6/d16/d1d/d86/cca 0 2024-04-13T10:59:13.230 INFO:tasks.workunit.client.0.smithi134.stdout:1/627: fsync d3/d6/d6a/f78 0 2024-04-13T10:59:13.233 INFO:tasks.workunit.client.0.smithi134.stdout:1/628: read d3/d6/d20/d71/fa4 [645294,107194] 0 2024-04-13T10:59:13.234 INFO:tasks.workunit.client.0.smithi134.stdout:6/509: link d4/da/d15/d1f/d3c/f59 d4/da/d15/d76/d92/f9d 0 2024-04-13T10:59:13.238 INFO:tasks.workunit.client.0.smithi134.stdout:9/560: dread d13/d2e/d35/d50/d59/d74/f8c [0,4194304] 0 2024-04-13T10:59:13.239 INFO:tasks.workunit.client.0.smithi134.stdout:0/506: unlink d4/cb 0 2024-04-13T10:59:13.244 INFO:tasks.workunit.client.0.smithi134.stdout:9/561: dread d13/d39/d58/d5f/f8e [0,4194304] 0 2024-04-13T10:59:13.245 INFO:tasks.workunit.client.0.smithi134.stdout:7/478: rename da/d15/d26/d27/d47 to da/d15/d26/d27/d3d/d9c 0 2024-04-13T10:59:13.251 INFO:tasks.workunit.client.0.smithi134.stdout:6/510: rename d4/da/d68/f8b to d4/da/d15/d1f/d24/d49/f9e 0 2024-04-13T10:59:13.253 INFO:tasks.workunit.client.0.smithi134.stdout:7/479: dwrite da/d15/d26/d27/d4f/d5f/d67/d76/f82 [0,4194304] 0 2024-04-13T10:59:13.254 INFO:tasks.workunit.client.0.smithi134.stdout:7/480: stat da/d15/d26/d27/d3d/d46 0 2024-04-13T10:59:13.255 INFO:tasks.workunit.client.0.smithi134.stdout:0/507: mkdir d4/d17/da/d22/d41/d6e/d8a/d95/db9 0 2024-04-13T10:59:13.256 INFO:tasks.workunit.client.0.smithi134.stdout:0/508: fdatasync d4/d5d/fb4 0 2024-04-13T10:59:13.265 INFO:tasks.workunit.client.0.smithi134.stdout:1/629: dwrite d3/f18 [0,4194304] 0 2024-04-13T10:59:13.271 INFO:tasks.workunit.client.0.smithi134.stdout:1/630: dwrite d3/d6/d20/f24 [0,4194304] 0 2024-04-13T10:59:13.276 INFO:tasks.workunit.client.0.smithi134.stdout:0/509: rmdir d4/d17/d23/d51/d6a/d73 39 2024-04-13T10:59:13.279 INFO:tasks.workunit.client.0.smithi134.stdout:3/450: sync 2024-04-13T10:59:13.280 INFO:tasks.workunit.client.0.smithi134.stdout:1/631: mkdir d3/d6/d20/d71/d9c/dcb 0 2024-04-13T10:59:13.280 INFO:tasks.workunit.client.0.smithi134.stdout:7/481: link da/d15/d26/d27/d4f/d5f/c6a da/d15/d26/d38/c9d 0 2024-04-13T10:59:13.284 INFO:tasks.workunit.client.0.smithi134.stdout:0/510: creat d4/d17/da/d22/d37/d6d/d97/d9c/fba x:0 0 0 2024-04-13T10:59:13.286 INFO:tasks.workunit.client.0.smithi134.stdout:6/511: rename d4/da/ce to d4/c9f 0 2024-04-13T10:59:13.289 INFO:tasks.workunit.client.0.smithi134.stdout:6/512: write d4/da/d15/f6e [772758,28203] 0 2024-04-13T10:59:13.298 INFO:tasks.workunit.client.0.smithi134.stdout:6/513: mknod d4/da/d15/ca0 0 2024-04-13T10:59:13.301 INFO:tasks.workunit.client.0.smithi134.stdout:0/511: link d4/d17/da/d22/d41/c76 d4/d17/d20/d29/d30/cbb 0 2024-04-13T10:59:13.301 INFO:tasks.workunit.client.0.smithi134.stdout:3/451: dwrite dc/f55 [4194304,4194304] 0 2024-04-13T10:59:13.306 INFO:tasks.workunit.client.0.smithi134.stdout:1/632: dwrite d3/d6/d16/d1d/f26 [4194304,4194304] 0 2024-04-13T10:59:13.306 INFO:tasks.workunit.client.0.smithi134.stdout:7/482: dwrite da/d15/d26/d27/d4f/d5f/d67/d73/f91 [0,4194304] 0 2024-04-13T10:59:13.313 INFO:tasks.workunit.client.0.smithi134.stdout:3/452: dread dc/d1d/d58/f60 [0,4194304] 0 2024-04-13T10:59:13.313 INFO:tasks.workunit.client.0.smithi134.stdout:6/514: unlink d4/da/d15/d1f/d24/f93 0 2024-04-13T10:59:13.315 INFO:tasks.workunit.client.0.smithi134.stdout:3/453: truncate dc/f71 337346 0 2024-04-13T10:59:13.317 INFO:tasks.workunit.client.0.smithi134.stdout:1/633: rmdir d3/d6/d20/d9f/dbe 39 2024-04-13T10:59:13.319 INFO:tasks.workunit.client.0.smithi134.stdout:7/483: mkdir da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e 0 2024-04-13T10:59:13.321 INFO:tasks.workunit.client.0.smithi134.stdout:6/515: mkdir d4/da/d15/d76/d8e/da1 0 2024-04-13T10:59:13.322 INFO:tasks.workunit.client.0.smithi134.stdout:6/516: fsync d4/da/d15/d1f/d24/f3a 0 2024-04-13T10:59:13.325 INFO:tasks.workunit.client.0.smithi134.stdout:0/512: fdatasync d4/d17/da/d22/d37/d47/f5e 0 2024-04-13T10:59:13.325 INFO:tasks.workunit.client.0.smithi134.stdout:1/634: mkdir d3/d6/d16/d4d/d65/dcc 0 2024-04-13T10:59:13.326 INFO:tasks.workunit.client.0.smithi134.stdout:7/484: unlink da/d15/d26/d27/f34 0 2024-04-13T10:59:13.328 INFO:tasks.workunit.client.0.smithi134.stdout:3/454: creat dc/d27/d19/d8b/f90 x:0 0 0 2024-04-13T10:59:13.328 INFO:tasks.workunit.client.0.smithi134.stdout:7/485: read - da/d15/d26/d27/d4f/d5f/d67/f90 zero size 2024-04-13T10:59:13.330 INFO:tasks.workunit.client.0.smithi134.stdout:7/486: dread - da/d15/f8a zero size 2024-04-13T10:59:13.331 INFO:tasks.workunit.client.0.smithi134.stdout:0/513: mknod d4/d17/da/d22/d41/d6e/d8a/d95/cbc 0 2024-04-13T10:59:13.339 INFO:tasks.workunit.client.0.smithi134.stdout:7/487: dwrite da/f54 [0,4194304] 0 2024-04-13T10:59:13.339 INFO:tasks.workunit.client.0.smithi134.stdout:1/635: creat d3/d6/d20/d6d/fcd x:0 0 0 2024-04-13T10:59:13.342 INFO:tasks.workunit.client.0.smithi134.stdout:6/517: link d4/da/d15/d1f/d24/d49/c72 d4/da/d15/d76/ca2 0 2024-04-13T10:59:13.344 INFO:tasks.workunit.client.0.smithi134.stdout:7/488: write da/d15/d26/d27/d4f/d5f/d88/f8d [82675,30774] 0 2024-04-13T10:59:13.345 INFO:tasks.workunit.client.0.smithi134.stdout:7/489: readlink da/d15/d26/l3b 0 2024-04-13T10:59:13.346 INFO:tasks.workunit.client.0.smithi134.stdout:7/490: chown da/d15/c1b 23 1 2024-04-13T10:59:13.347 INFO:tasks.workunit.client.0.smithi134.stdout:1/636: symlink d3/d6/d16/d1d/d3c/lce 0 2024-04-13T10:59:13.348 INFO:tasks.workunit.client.0.smithi134.stdout:1/637: chown d3/d6/d20/c66 1612 1 2024-04-13T10:59:13.349 INFO:tasks.workunit.client.0.smithi134.stdout:3/455: dread dc/d27/d4d/d4f/d50/f53 [0,4194304] 0 2024-04-13T10:59:13.350 INFO:tasks.workunit.client.0.smithi134.stdout:6/518: mknod d4/da/d1a/ca3 0 2024-04-13T10:59:13.353 INFO:tasks.workunit.client.0.smithi134.stdout:7/491: chown da/d15/d26/d38/c9d 2255 1 2024-04-13T10:59:13.355 INFO:tasks.workunit.client.0.smithi134.stdout:1/638: fsync d3/d6/d6a/f6c 0 2024-04-13T10:59:13.355 INFO:tasks.workunit.client.0.smithi134.stdout:7/492: write f4 [3132226,36288] 0 2024-04-13T10:59:13.356 INFO:tasks.workunit.client.0.smithi134.stdout:7/493: readlink da/l25 0 2024-04-13T10:59:13.357 INFO:tasks.workunit.client.0.smithi134.stdout:0/514: dread d4/d17/f4a [0,4194304] 0 2024-04-13T10:59:13.359 INFO:tasks.workunit.client.0.smithi134.stdout:7/494: fdatasync da/d15/d26/d27/d4f/d5f/d67/d73/d92/f9a 0 2024-04-13T10:59:13.360 INFO:tasks.workunit.client.0.smithi134.stdout:7/495: chown da/d15/d26/d27/d4f 4266585 1 2024-04-13T10:59:13.361 INFO:tasks.workunit.client.0.smithi134.stdout:6/519: unlink d4/da/f8f 0 2024-04-13T10:59:13.365 INFO:tasks.workunit.client.0.smithi134.stdout:1/639: rename d3/d6/d20/d89/lad to d3/d6/lcf 0 2024-04-13T10:59:13.367 INFO:tasks.workunit.client.0.smithi134.stdout:6/520: truncate d4/da/d15/d1f/d3c/f5e 1842686 0 2024-04-13T10:59:13.368 INFO:tasks.workunit.client.0.smithi134.stdout:0/515: rename d4/d17/d23/d51/cb7 to d4/d17/da/d22/d37/d47/d9e/d78/cbd 0 2024-04-13T10:59:13.372 INFO:tasks.workunit.client.0.smithi134.stdout:0/516: mkdir d4/d17/da/d22/d37/d6d/d97/dbe 0 2024-04-13T10:59:13.374 INFO:tasks.workunit.client.0.smithi134.stdout:6/521: mkdir d4/da/d15/d1f/d24/da4 0 2024-04-13T10:59:13.378 INFO:tasks.workunit.client.0.smithi134.stdout:6/522: mknod d4/ca5 0 2024-04-13T10:59:13.380 INFO:tasks.workunit.client.0.smithi134.stdout:1/640: dread d3/d30/fb7 [0,4194304] 0 2024-04-13T10:59:13.381 INFO:tasks.workunit.client.0.smithi134.stdout:6/523: mkdir d4/da/d15/d57/da6 0 2024-04-13T10:59:13.381 INFO:tasks.workunit.client.0.smithi134.stdout:1/641: dread - d3/d6/d20/d9f/fae zero size 2024-04-13T10:59:13.385 INFO:tasks.workunit.client.0.smithi134.stdout:6/524: dread d4/da/d15/f6e [0,4194304] 0 2024-04-13T10:59:13.390 INFO:tasks.workunit.client.0.smithi134.stdout:6/525: rename d4/da/d15/d57/c61 to d4/da/d68/ca7 0 2024-04-13T10:59:13.395 INFO:tasks.workunit.client.0.smithi134.stdout:6/526: mknod d4/da/d15/d1f/d3c/d7d/ca8 0 2024-04-13T10:59:13.396 INFO:tasks.workunit.client.0.smithi134.stdout:1/642: truncate d3/d6/d6a/f6c 809120 0 2024-04-13T10:59:13.398 INFO:tasks.workunit.client.0.smithi134.stdout:1/643: truncate d3/d30/f85 534181 0 2024-04-13T10:59:13.403 INFO:tasks.workunit.client.0.smithi134.stdout:6/527: dwrite d4/da/d15/d77/f82 [0,4194304] 0 2024-04-13T10:59:13.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/496: truncate da/d15/d85/f8f 973638 0 2024-04-13T10:59:13.407 INFO:tasks.workunit.client.0.smithi134.stdout:7/497: dread - da/d15/d26/f62 zero size 2024-04-13T10:59:13.407 INFO:tasks.workunit.client.0.smithi134.stdout:1/644: dwrite d3/d6/d16/f7d [0,4194304] 0 2024-04-13T10:59:13.414 INFO:tasks.workunit.client.0.smithi134.stdout:7/498: symlink da/d15/d85/l9f 0 2024-04-13T10:59:13.437 INFO:tasks.workunit.client.0.smithi134.stdout:1/645: dread d3/d6/d16/f35 [0,4194304] 0 2024-04-13T10:59:13.445 INFO:tasks.workunit.client.0.smithi134.stdout:6/528: dread d4/da/d15/d1f/d24/f3a [0,4194304] 0 2024-04-13T10:59:13.447 INFO:tasks.workunit.client.0.smithi134.stdout:0/517: dwrite d4/d17/d23/d51/d6b/f7b [0,4194304] 0 2024-04-13T10:59:13.448 INFO:tasks.workunit.client.0.smithi134.stdout:1/646: rename d3/d6/d16/d1d/d86/fa7 to d3/fd0 0 2024-04-13T10:59:13.454 INFO:tasks.workunit.client.0.smithi134.stdout:6/529: symlink d4/da/d15/d1f/d24/da4/la9 0 2024-04-13T10:59:13.463 INFO:tasks.workunit.client.0.smithi134.stdout:1/647: dwrite d3/d6/d20/d6d/d8b/f97 [0,4194304] 0 2024-04-13T10:59:13.463 INFO:tasks.workunit.client.0.smithi134.stdout:7/499: dread da/d15/d26/d27/d3d/d9c/f55 [0,4194304] 0 2024-04-13T10:59:13.464 INFO:tasks.workunit.client.0.smithi134.stdout:0/518: dwrite d4/d17/f4a [4194304,4194304] 0 2024-04-13T10:59:13.465 INFO:tasks.workunit.client.0.smithi134.stdout:1/648: dread - d3/d6/d20/d9f/fa9 zero size 2024-04-13T10:59:13.470 INFO:tasks.workunit.client.0.smithi134.stdout:1/649: dread d3/d6/d16/d1d/dab/fb8 [0,4194304] 0 2024-04-13T10:59:13.486 INFO:tasks.workunit.client.0.smithi134.stdout:7/500: dread da/d15/d26/f28 [0,4194304] 0 2024-04-13T10:59:13.486 INFO:tasks.workunit.client.0.smithi134.stdout:7/501: readlink da/l2f 0 2024-04-13T10:59:13.553 INFO:tasks.workunit.client.0.smithi134.stdout:6/530: creat d4/da/d15/d1f/d24/da4/faa x:0 0 0 2024-04-13T10:59:13.555 INFO:tasks.workunit.client.0.smithi134.stdout:6/531: chown d4/da/d15/c43 48111 1 2024-04-13T10:59:13.556 INFO:tasks.workunit.client.0.smithi134.stdout:0/519: creat d4/d17/da/d22/d37/d6d/d97/db6/fbf x:0 0 0 2024-04-13T10:59:13.556 INFO:tasks.workunit.client.0.smithi134.stdout:6/532: dread - d4/da/d1a/f88 zero size 2024-04-13T10:59:13.558 INFO:tasks.workunit.client.0.smithi134.stdout:1/650: creat d3/d6/d20/d89/fd1 x:0 0 0 2024-04-13T10:59:13.568 INFO:tasks.workunit.client.0.smithi134.stdout:1/651: dread d3/d6/d20/d28/f37 [0,4194304] 0 2024-04-13T10:59:13.570 INFO:tasks.workunit.client.0.smithi134.stdout:1/652: truncate d3/d6/d16/d1d/d68/faa 119747 0 2024-04-13T10:59:13.595 INFO:tasks.workunit.client.0.smithi134.stdout:1/653: dread d3/d6/d20/d6d/db1/f46 [4194304,4194304] 0 2024-04-13T10:59:13.597 INFO:tasks.workunit.client.0.smithi134.stdout:7/502: link da/f2a da/d15/d26/d38/fa0 0 2024-04-13T10:59:13.598 INFO:tasks.workunit.client.0.smithi134.stdout:7/503: dread - da/d15/d26/d27/d4f/f7d zero size 2024-04-13T10:59:13.604 INFO:tasks.workunit.client.0.smithi134.stdout:6/533: link d4/da/d15/d57/f5a d4/da/d15/d57/fab 0 2024-04-13T10:59:13.612 INFO:tasks.workunit.client.0.smithi134.stdout:1/654: rename d3/d6/d20/f8f to d3/d6/d20/d6d/fd2 0 2024-04-13T10:59:13.613 INFO:tasks.workunit.client.0.smithi134.stdout:7/504: link da/d15/c3c da/d15/d26/d27/d4f/d5f/d67/d73/d92/ca1 0 2024-04-13T10:59:13.616 INFO:tasks.workunit.client.0.smithi134.stdout:6/534: rename d4/da/d15/d1f/d24/d2b/l33 to d4/da/d15/d76/d92/lac 0 2024-04-13T10:59:13.617 INFO:tasks.workunit.client.0.smithi134.stdout:1/655: symlink d3/d6/d16/d1d/d68/ld3 0 2024-04-13T10:59:13.618 INFO:tasks.workunit.client.0.smithi134.stdout:1/656: chown d3/d30/f4b 219 1 2024-04-13T10:59:13.619 INFO:tasks.workunit.client.0.smithi134.stdout:1/657: truncate d3/d30/f85 1341061 0 2024-04-13T10:59:13.621 INFO:tasks.workunit.client.0.smithi134.stdout:6/535: fsync d4/f4d 0 2024-04-13T10:59:13.623 INFO:tasks.workunit.client.0.smithi134.stdout:1/658: creat d3/d6/d16/d4d/fd4 x:0 0 0 2024-04-13T10:59:13.635 INFO:tasks.workunit.client.0.smithi134.stdout:6/536: dread d4/da/f41 [0,4194304] 0 2024-04-13T10:59:13.638 INFO:tasks.workunit.client.0.smithi134.stdout:6/537: mkdir d4/da/d15/d1f/d3c/d7d/dad 0 2024-04-13T10:59:13.639 INFO:tasks.workunit.client.0.smithi134.stdout:6/538: readlink d4/lc 0 2024-04-13T10:59:13.641 INFO:tasks.workunit.client.0.smithi134.stdout:0/520: dwrite d4/d17/d23/d51/d6a/d73/f7a [0,4194304] 0 2024-04-13T10:59:13.642 INFO:tasks.workunit.client.0.smithi134.stdout:0/521: chown d4/d5d/fb4 65891176 1 2024-04-13T10:59:13.644 INFO:tasks.workunit.client.0.smithi134.stdout:6/539: rename d4/fd to d4/da/d15/d57/fae 0 2024-04-13T10:59:13.647 INFO:tasks.workunit.client.0.smithi134.stdout:7/505: write da/d15/d26/f30 [413209,22533] 0 2024-04-13T10:59:13.648 INFO:tasks.workunit.client.0.smithi134.stdout:6/540: fdatasync d4/da/d15/d1f/d24/f3e 0 2024-04-13T10:59:13.649 INFO:tasks.workunit.client.0.smithi134.stdout:7/506: write da/d15/d26/d27/d4f/d5f/d67/f80 [432673,101948] 0 2024-04-13T10:59:13.657 INFO:tasks.workunit.client.0.smithi134.stdout:7/507: dwrite da/d15/d26/d27/d3d/d9c/d48/f93 [4194304,4194304] 0 2024-04-13T10:59:13.659 INFO:tasks.workunit.client.0.smithi134.stdout:7/508: write da/d15/d26/d27/d3d/d9c/d5a/f72 [2684176,38988] 0 2024-04-13T10:59:13.663 INFO:tasks.workunit.client.0.smithi134.stdout:6/541: truncate d4/da/d15/d1f/d24/f3e 823522 0 2024-04-13T10:59:13.668 INFO:tasks.workunit.client.0.smithi134.stdout:6/542: write d4/da/d15/d77/d63/f86 [192657,115727] 0 2024-04-13T10:59:13.668 INFO:tasks.workunit.client.0.smithi134.stdout:7/509: dwrite da/f13 [0,4194304] 0 2024-04-13T10:59:13.669 INFO:tasks.workunit.client.0.smithi134.stdout:0/522: dwrite d4/d17/da/d22/d41/f4b [0,4194304] 0 2024-04-13T10:59:13.670 INFO:tasks.workunit.client.0.smithi134.stdout:6/543: chown d4/da/d15/d57/fab 183384 1 2024-04-13T10:59:13.675 INFO:tasks.workunit.client.0.smithi134.stdout:0/523: mkdir d4/d17/d20/d29/d30/d7f/dc0 0 2024-04-13T10:59:13.682 INFO:tasks.workunit.client.0.smithi134.stdout:0/524: mknod d4/d17/d20/cc1 0 2024-04-13T10:59:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:13 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:59:13.684 INFO:tasks.workunit.client.0.smithi134.stdout:6/544: dwrite d4/da/d15/d77/f82 [4194304,4194304] 0 2024-04-13T10:59:13.686 INFO:tasks.workunit.client.0.smithi134.stdout:6/545: write d4/da/d15/d76/f9b [778129,42334] 0 2024-04-13T10:59:13.687 INFO:tasks.workunit.client.0.smithi134.stdout:0/525: unlink d4/d5d/f5a 0 2024-04-13T10:59:13.691 INFO:tasks.workunit.client.0.smithi134.stdout:7/510: dread da/f11 [0,4194304] 0 2024-04-13T10:59:13.691 INFO:tasks.workunit.client.0.smithi134.stdout:0/526: mkdir d4/d17/da/d22/d41/dc2 0 2024-04-13T10:59:13.693 INFO:tasks.workunit.client.0.smithi134.stdout:6/546: mknod d4/da/d15/d77/caf 0 2024-04-13T10:59:13.695 INFO:tasks.workunit.client.0.smithi134.stdout:0/527: creat d4/d17/d20/d29/d30/fc3 x:0 0 0 2024-04-13T10:59:13.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/511: rename da/d15/d26/d27/d3d/d9c/f49 to da/d15/d26/d27/d3d/d46/d95/fa2 0 2024-04-13T10:59:13.699 INFO:tasks.workunit.client.0.smithi134.stdout:6/547: creat d4/da/d15/d1f/d24/d49/d91/fb0 x:0 0 0 2024-04-13T10:59:13.701 INFO:tasks.workunit.client.0.smithi134.stdout:0/528: rename d4/d17/d23/d51/d6a/d94/db2/f7d to d4/d17/d23/d51/d6a/d94/db2/fc4 0 2024-04-13T10:59:13.703 INFO:tasks.workunit.client.0.smithi134.stdout:6/548: rename d4/da/d15/d77/caf to d4/da/d15/d57/da6/cb1 0 2024-04-13T10:59:13.705 INFO:tasks.workunit.client.0.smithi134.stdout:6/549: creat d4/da/d15/d1f/d24/da4/fb2 x:0 0 0 2024-04-13T10:59:13.706 INFO:tasks.workunit.client.0.smithi134.stdout:0/529: creat d4/d17/fc5 x:0 0 0 2024-04-13T10:59:13.708 INFO:tasks.workunit.client.0.smithi134.stdout:6/550: dread d4/da/d15/d1f/d24/d49/f9e [0,4194304] 0 2024-04-13T10:59:13.710 INFO:tasks.workunit.client.0.smithi134.stdout:0/530: creat d4/d17/d20/d29/d30/d7f/dc0/fc6 x:0 0 0 2024-04-13T10:59:13.711 INFO:tasks.workunit.client.0.smithi134.stdout:6/551: unlink d4/da/d15/d76/d92/f9d 0 2024-04-13T10:59:13.718 INFO:tasks.workunit.client.0.smithi134.stdout:0/531: mkdir d4/d17/d23/d51/d6b/d91/d98/d62/daf/dc7 0 2024-04-13T10:59:13.723 INFO:tasks.workunit.client.0.smithi134.stdout:6/552: creat d4/da/d15/d1f/d24/fb3 x:0 0 0 2024-04-13T10:59:13.723 INFO:tasks.workunit.client.0.smithi134.stdout:0/532: dread d4/d17/d23/d51/d6b/d91/d98/d8b/d8c/faa [0,4194304] 0 2024-04-13T10:59:13.727 INFO:tasks.workunit.client.0.smithi134.stdout:6/553: symlink d4/da/d15/d77/lb4 0 2024-04-13T10:59:13.733 INFO:tasks.workunit.client.0.smithi134.stdout:6/554: unlink d4/da/d15/d1f/d24/f87 0 2024-04-13T10:59:13.737 INFO:tasks.workunit.client.0.smithi134.stdout:6/555: symlink d4/da/d15/d1f/d24/d49/d91/lb5 0 2024-04-13T10:59:13.738 INFO:tasks.workunit.client.0.smithi134.stdout:6/556: stat d4/da/d15/d1f/l65 0 2024-04-13T10:59:13.744 INFO:tasks.workunit.client.0.smithi134.stdout:0/533: dwrite d4/d17/d20/d29/f5b [0,4194304] 0 2024-04-13T10:59:13.744 INFO:tasks.workunit.client.0.smithi134.stdout:6/557: dread d4/f5 [4194304,4194304] 0 2024-04-13T10:59:13.745 INFO:tasks.workunit.client.0.smithi134.stdout:0/534: write d4/d17/d23/d51/f9d [733392,68045] 0 2024-04-13T10:59:13.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:13 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:59:13.749 INFO:tasks.workunit.client.0.smithi134.stdout:6/558: creat d4/da/d15/d1f/fb6 x:0 0 0 2024-04-13T10:59:13.750 INFO:tasks.workunit.client.0.smithi134.stdout:0/535: mknod d4/d17/da/d22/d37/d6d/d97/db6/cc8 0 2024-04-13T10:59:13.754 INFO:tasks.workunit.client.0.smithi134.stdout:0/536: symlink d4/d17/da/d22/d37/d6d/d97/db6/lc9 0 2024-04-13T10:59:13.755 INFO:tasks.workunit.client.0.smithi134.stdout:6/559: truncate d4/da/d15/d1f/d3c/f5e 1259890 0 2024-04-13T10:59:13.758 INFO:tasks.workunit.client.0.smithi134.stdout:6/560: truncate d4/da/f2f 2502337 0 2024-04-13T10:59:13.758 INFO:tasks.workunit.client.0.smithi134.stdout:6/561: chown d4/da/d68 17436 1 2024-04-13T10:59:13.762 INFO:tasks.workunit.client.0.smithi134.stdout:6/562: symlink d4/da/lb7 0 2024-04-13T10:59:13.765 INFO:tasks.workunit.client.0.smithi134.stdout:6/563: symlink d4/da/d1a/lb8 0 2024-04-13T10:59:13.766 INFO:tasks.workunit.client.0.smithi134.stdout:6/564: write d4/da/d15/d1f/d24/f3a [5386807,13702] 0 2024-04-13T10:59:13.767 INFO:tasks.workunit.client.0.smithi134.stdout:0/537: write d4/d17/da/d22/d37/f65 [22327,5362] 0 2024-04-13T10:59:13.776 INFO:tasks.workunit.client.0.smithi134.stdout:6/565: dwrite d4/da/d15/d1f/fb6 [0,4194304] 0 2024-04-13T10:59:13.777 INFO:tasks.workunit.client.0.smithi134.stdout:0/538: dwrite d4/d17/d20/d29/d30/d7f/dc0/fc6 [0,4194304] 0 2024-04-13T10:59:13.779 INFO:tasks.workunit.client.0.smithi134.stdout:0/539: read d4/d17/d23/d51/d6a/d73/f7a [1382798,37073] 0 2024-04-13T10:59:13.787 INFO:tasks.workunit.client.0.smithi134.stdout:0/540: mkdir d4/d17/d23/d51/d6b/d91/d98/d92/dca 0 2024-04-13T10:59:13.791 INFO:tasks.workunit.client.0.smithi134.stdout:0/541: creat d4/d17/d23/d51/d6a/fcb x:0 0 0 2024-04-13T10:59:13.795 INFO:tasks.workunit.client.0.smithi134.stdout:0/542: rename d4/d17/d20/d29/d30/d7f/fad to d4/d17/d23/d51/d6b/fcc 0 2024-04-13T10:59:13.804 INFO:tasks.workunit.client.0.smithi134.stdout:6/566: dread d4/da/d15/d1f/d24/d2b/f2e [0,4194304] 0 2024-04-13T10:59:13.812 INFO:tasks.workunit.client.0.smithi134.stdout:0/543: dwrite d4/d17/da/d22/d37/f5f [0,4194304] 0 2024-04-13T10:59:13.812 INFO:tasks.workunit.client.0.smithi134.stdout:0/544: readlink d4/d17/da/d22/l2a 0 2024-04-13T10:59:13.819 INFO:tasks.workunit.client.0.smithi134.stdout:5/696: sync 2024-04-13T10:59:13.819 INFO:tasks.workunit.client.0.smithi134.stdout:8/535: sync 2024-04-13T10:59:13.820 INFO:tasks.workunit.client.0.smithi134.stdout:0/545: dwrite d4/d17/f4a [0,4194304] 0 2024-04-13T10:59:13.823 INFO:tasks.workunit.client.0.smithi134.stdout:6/567: write d4/da/f2f [819076,35157] 0 2024-04-13T10:59:13.824 INFO:tasks.workunit.client.0.smithi134.stdout:6/568: read d4/f4d [2642907,69227] 0 2024-04-13T10:59:13.825 INFO:tasks.workunit.client.0.smithi134.stdout:5/697: fdatasync dc/d1d/d46/f4c 0 2024-04-13T10:59:13.827 INFO:tasks.workunit.client.0.smithi134.stdout:0/546: dread d4/d17/d23/f2f [0,4194304] 0 2024-04-13T10:59:13.833 INFO:tasks.workunit.client.0.smithi134.stdout:8/536: mknod d8/dc/d16/d4e/cb3 0 2024-04-13T10:59:13.838 INFO:tasks.workunit.client.0.smithi134.stdout:8/537: write d8/dc/f29 [4264264,88853] 0 2024-04-13T10:59:13.847 INFO:tasks.workunit.client.0.smithi134.stdout:5/698: write dc/d1d/f1f [4093990,48233] 0 2024-04-13T10:59:13.852 INFO:tasks.workunit.client.0.smithi134.stdout:5/699: creat dc/d1d/d2f/d3b/d7f/d8d/d7d/fe7 x:0 0 0 2024-04-13T10:59:13.854 INFO:tasks.workunit.client.0.smithi134.stdout:0/547: write d4/d17/d23/d51/d6b/d91/d98/d8b/d8c/faa [587084,73042] 0 2024-04-13T10:59:13.855 INFO:tasks.workunit.client.0.smithi134.stdout:0/548: fdatasync d4/d5d/fb4 0 2024-04-13T10:59:13.855 INFO:tasks.workunit.client.0.smithi134.stdout:8/538: dread d8/dc/d13/f40 [0,4194304] 0 2024-04-13T10:59:13.857 INFO:tasks.workunit.client.0.smithi134.stdout:0/549: write d4/d17/fc5 [588074,44391] 0 2024-04-13T10:59:13.857 INFO:tasks.workunit.client.0.smithi134.stdout:6/569: write d4/da/d15/d1f/d3c/f5e [1561720,88248] 0 2024-04-13T10:59:13.860 INFO:tasks.workunit.client.0.smithi134.stdout:8/539: symlink d8/dc/d16/d54/d6c/d7d/lb4 0 2024-04-13T10:59:13.861 INFO:tasks.workunit.client.0.smithi134.stdout:0/550: unlink d4/d17/l34 0 2024-04-13T10:59:13.863 INFO:tasks.workunit.client.0.smithi134.stdout:6/570: fdatasync d4/da/f14 0 2024-04-13T10:59:13.864 INFO:tasks.workunit.client.0.smithi134.stdout:6/571: dread - d4/da/d15/d1f/f96 zero size 2024-04-13T10:59:13.864 INFO:tasks.workunit.client.0.smithi134.stdout:8/540: creat d8/dc/d2c/d68/fb5 x:0 0 0 2024-04-13T10:59:13.865 INFO:tasks.workunit.client.0.smithi134.stdout:0/551: fsync d4/d17/da/f54 0 2024-04-13T10:59:13.875 INFO:tasks.workunit.client.0.smithi134.stdout:6/572: mkdir d4/da/d15/d1f/d24/db9 0 2024-04-13T10:59:13.875 INFO:tasks.workunit.client.0.smithi134.stdout:6/573: readlink d4/da/d15/d77/l6c 0 2024-04-13T10:59:13.878 INFO:tasks.workunit.client.0.smithi134.stdout:6/574: mknod d4/da/d15/d76/d8e/cba 0 2024-04-13T10:59:13.885 INFO:tasks.workunit.client.0.smithi134.stdout:6/575: rename d4/da/d15/d1f/d3c/d7d to d4/da/dbb 0 2024-04-13T10:59:13.888 INFO:tasks.workunit.client.0.smithi134.stdout:6/576: creat d4/da/dbb/fbc x:0 0 0 2024-04-13T10:59:13.890 INFO:tasks.workunit.client.0.smithi134.stdout:8/541: write d8/dc/d37/d3f/f72 [19162,86628] 0 2024-04-13T10:59:13.891 INFO:tasks.workunit.client.0.smithi134.stdout:6/577: symlink d4/da/d15/d76/d8e/da1/lbd 0 2024-04-13T10:59:13.893 INFO:tasks.workunit.client.0.smithi134.stdout:8/542: creat d8/dc/d16/d74/fb6 x:0 0 0 2024-04-13T10:59:13.896 INFO:tasks.workunit.client.0.smithi134.stdout:8/543: rename d8/dc/d16/c43 to d8/dc/d2c/cb7 0 2024-04-13T10:59:13.896 INFO:tasks.workunit.client.0.smithi134.stdout:8/544: chown d8/f2b 668859423 1 2024-04-13T10:59:13.898 INFO:tasks.workunit.client.0.smithi134.stdout:6/578: getdents d4/da/d15/d1f/d24/da4 0 2024-04-13T10:59:13.899 INFO:tasks.workunit.client.0.smithi134.stdout:8/545: mknod d8/dc/d9d/cb8 0 2024-04-13T10:59:13.906 INFO:tasks.workunit.client.0.smithi134.stdout:6/579: mknod d4/da/d15/d1f/d24/db9/cbe 0 2024-04-13T10:59:13.907 INFO:tasks.workunit.client.0.smithi134.stdout:6/580: truncate d4/da/dbb/fbc 576729 0 2024-04-13T10:59:13.908 INFO:tasks.workunit.client.0.smithi134.stdout:6/581: chown d4/da/d15/d57/c9c 61322677 1 2024-04-13T10:59:13.910 INFO:tasks.workunit.client.0.smithi134.stdout:8/546: creat d8/dc/d16/d54/fb9 x:0 0 0 2024-04-13T10:59:13.911 INFO:tasks.workunit.client.0.smithi134.stdout:6/582: mkdir d4/da/d68/dbf 0 2024-04-13T10:59:13.918 INFO:tasks.workunit.client.0.smithi134.stdout:6/583: symlink d4/da/d15/d1f/d24/d2b/lc0 0 2024-04-13T10:59:13.921 INFO:tasks.workunit.client.0.smithi134.stdout:6/584: dwrite d4/da/d1a/f29 [0,4194304] 0 2024-04-13T10:59:13.923 INFO:tasks.workunit.client.0.smithi134.stdout:6/585: write d4/da/d15/d1f/d3c/f5e [1859855,39705] 0 2024-04-13T10:59:13.929 INFO:tasks.workunit.client.0.smithi134.stdout:6/586: unlink d4/da/d15/d1f/d24/da4/la9 0 2024-04-13T10:59:13.934 INFO:tasks.workunit.client.0.smithi134.stdout:8/547: getdents d8/dc/d16/d54 0 2024-04-13T10:59:13.938 INFO:tasks.workunit.client.0.smithi134.stdout:8/548: rename d8/dc/d16/d54/d98/d9b/da3/fa6 to d8/dc/d2c/d68/d8c/fba 0 2024-04-13T10:59:13.942 INFO:tasks.workunit.client.0.smithi134.stdout:8/549: symlink d8/dc/d2c/d68/d8c/lbb 0 2024-04-13T10:59:13.952 INFO:tasks.workunit.client.0.smithi134.stdout:6/587: dread d4/da/d15/d76/f7c [0,4194304] 0 2024-04-13T10:59:13.955 INFO:tasks.workunit.client.0.smithi134.stdout:6/588: dread d4/da/d15/d1f/d24/f3e [0,4194304] 0 2024-04-13T10:59:13.958 INFO:tasks.workunit.client.0.smithi134.stdout:8/550: dread d8/dc/d16/d54/d6c/f70 [0,4194304] 0 2024-04-13T10:59:13.959 INFO:tasks.workunit.client.0.smithi134.stdout:8/551: fsync d8/dc/d16/d54/d6c/d94/fb2 0 2024-04-13T10:59:13.962 INFO:tasks.workunit.client.0.smithi134.stdout:6/589: rename d4/da/d15/d1f/c39 to d4/da/d15/d1f/cc1 0 2024-04-13T10:59:13.963 INFO:tasks.workunit.client.0.smithi134.stdout:8/552: creat d8/dc/fbc x:0 0 0 2024-04-13T10:59:13.965 INFO:tasks.workunit.client.0.smithi134.stdout:8/553: creat d8/dc/d16/d54/d98/d9b/da3/fbd x:0 0 0 2024-04-13T10:59:13.967 INFO:tasks.workunit.client.0.smithi134.stdout:8/554: creat d8/dc/d16/d54/d6c/d7d/fbe x:0 0 0 2024-04-13T10:59:13.968 INFO:tasks.workunit.client.0.smithi134.stdout:6/590: creat d4/da/fc2 x:0 0 0 2024-04-13T10:59:13.970 INFO:tasks.workunit.client.0.smithi134.stdout:8/555: creat d8/dc/d16/d54/d98/fbf x:0 0 0 2024-04-13T10:59:13.972 INFO:tasks.workunit.client.0.smithi134.stdout:8/556: mkdir d8/dc/d16/d54/d6c/d94/dc0 0 2024-04-13T10:59:13.974 INFO:tasks.workunit.client.0.smithi134.stdout:8/557: mkdir d8/dc/d16/d54/d6c/d94/dc1 0 2024-04-13T10:59:13.977 INFO:tasks.workunit.client.0.smithi134.stdout:8/558: creat d8/dc/d16/fc2 x:0 0 0 2024-04-13T10:59:13.979 INFO:tasks.workunit.client.0.smithi134.stdout:8/559: unlink d8/dc/d16/c53 0 2024-04-13T10:59:13.980 INFO:tasks.workunit.client.0.smithi134.stdout:8/560: dread - d8/dc/d16/d74/fb6 zero size 2024-04-13T10:59:13.981 INFO:tasks.workunit.client.0.smithi134.stdout:8/561: stat d8/dc/d16/d54/d98/d9b/faf 0 2024-04-13T10:59:13.983 INFO:tasks.workunit.client.0.smithi134.stdout:8/562: mknod d8/dc/d2c/cc3 0 2024-04-13T10:59:13.983 INFO:tasks.workunit.client.0.smithi134.stdout:8/563: chown d8/dc/d2c/d68 902972 1 2024-04-13T10:59:13.985 INFO:tasks.workunit.client.0.smithi134.stdout:8/564: stat d8/dc/d9d/c84 0 2024-04-13T10:59:13.997 INFO:tasks.workunit.client.0.smithi134.stdout:8/565: dread d8/dc/d37/d3f/f73 [0,4194304] 0 2024-04-13T10:59:14.042 INFO:tasks.workunit.client.0.smithi134.stdout:8/566: truncate d8/dc/d16/d54/d6f/f90 3346286 0 2024-04-13T10:59:14.056 INFO:tasks.workunit.client.0.smithi134.stdout:8/567: dread d8/dc/d16/d4e/f62 [0,4194304] 0 2024-04-13T10:59:14.058 INFO:tasks.workunit.client.0.smithi134.stdout:8/568: read d8/dc/d2c/d68/f61 [126016,72517] 0 2024-04-13T10:59:14.059 INFO:tasks.workunit.client.0.smithi134.stdout:8/569: chown d8/dc/d2c/d68/d8c/fba 30899815 1 2024-04-13T10:59:14.063 INFO:tasks.workunit.client.0.smithi134.stdout:8/570: mknod d8/dc/d16/d4e/d76/cc4 0 2024-04-13T10:59:14.070 INFO:tasks.workunit.client.0.smithi134.stdout:2/452: sync 2024-04-13T10:59:14.070 INFO:tasks.workunit.client.0.smithi134.stdout:4/379: sync 2024-04-13T10:59:14.071 INFO:tasks.workunit.client.0.smithi134.stdout:8/571: rename d8/dc/d37/c60 to d8/dc/d16/d54/d98/d9b/da3/cc5 0 2024-04-13T10:59:14.072 INFO:tasks.workunit.client.0.smithi134.stdout:8/572: chown d8/dc/d16/d54/d98/fbf 141 1 2024-04-13T10:59:14.073 INFO:tasks.workunit.client.0.smithi134.stdout:4/380: mknod d4/d1f/d27/d75/d38/d79/d73/c83 0 2024-04-13T10:59:14.073 INFO:tasks.workunit.client.0.smithi134.stdout:4/381: chown d4/d48/d4a/d7e 24646979 1 2024-04-13T10:59:14.199 INFO:tasks.workunit.client.0.smithi134.stdout:4/382: unlink d4/d1f/d56/l69 0 2024-04-13T10:59:14.199 INFO:tasks.workunit.client.0.smithi134.stdout:8/573: creat d8/dc/d16/d54/d6c/d94/dc1/fc6 x:0 0 0 2024-04-13T10:59:14.201 INFO:tasks.workunit.client.0.smithi134.stdout:4/383: dread d4/f61 [0,4194304] 0 2024-04-13T10:59:14.238 INFO:tasks.workunit.client.0.smithi134.stdout:3/456: sync 2024-04-13T10:59:14.238 INFO:tasks.workunit.client.0.smithi134.stdout:9/562: sync 2024-04-13T10:59:14.238 INFO:tasks.workunit.client.0.smithi134.stdout:9/563: chown d13/d39/d64/c96 3 1 2024-04-13T10:59:14.239 INFO:tasks.workunit.client.0.smithi134.stdout:8/574: fdatasync d8/ff 0 2024-04-13T10:59:14.240 INFO:tasks.workunit.client.0.smithi134.stdout:8/575: fdatasync d8/dc/d16/d54/fb9 0 2024-04-13T10:59:14.241 INFO:tasks.workunit.client.0.smithi134.stdout:8/576: fsync d8/dc/d37/d3f/f72 0 2024-04-13T10:59:14.241 INFO:tasks.workunit.client.0.smithi134.stdout:4/384: mkdir d4/d1f/d27/d2e/d84 0 2024-04-13T10:59:14.249 INFO:tasks.workunit.client.0.smithi134.stdout:8/577: rmdir d8/dc/d16/d54/d6f 39 2024-04-13T10:59:14.251 INFO:tasks.workunit.client.0.smithi134.stdout:4/385: symlink d4/d48/l85 0 2024-04-13T10:59:14.254 INFO:tasks.workunit.client.0.smithi134.stdout:9/564: symlink d13/da3/d98/db3/lc2 0 2024-04-13T10:59:14.326 INFO:tasks.workunit.client.0.smithi134.stdout:4/386: mkdir d4/d48/d86 0 2024-04-13T10:59:14.327 INFO:tasks.workunit.client.0.smithi134.stdout:8/578: mknod d8/cc7 0 2024-04-13T10:59:14.327 INFO:tasks.workunit.client.0.smithi134.stdout:9/565: dwrite d13/d40/f6c [4194304,4194304] 0 2024-04-13T10:59:14.332 INFO:tasks.workunit.client.0.smithi134.stdout:4/387: unlink d4/d1f/d27/d75/d38/d79/c2c 0 2024-04-13T10:59:14.339 INFO:tasks.workunit.client.0.smithi134.stdout:9/566: dread d13/d2e/d35/d50/d59/d74/f8c [0,4194304] 0 2024-04-13T10:59:14.340 INFO:tasks.workunit.client.0.smithi134.stdout:8/579: creat d8/dc/d16/d54/d98/d9b/da3/fc8 x:0 0 0 2024-04-13T10:59:14.342 INFO:tasks.workunit.client.0.smithi134.stdout:9/567: creat d13/d2e/d35/d50/d59/fc3 x:0 0 0 2024-04-13T10:59:14.344 INFO:tasks.workunit.client.0.smithi134.stdout:8/580: chown d8/dc/d16/ca1 429245355 1 2024-04-13T10:59:14.348 INFO:tasks.workunit.client.0.smithi134.stdout:4/388: link d4/d48/d4a/c6e d4/d1f/d27/d3a/d65/c87 0 2024-04-13T10:59:14.349 INFO:tasks.workunit.client.0.smithi134.stdout:4/389: readlink d4/d48/l4f 0 2024-04-13T10:59:14.352 INFO:tasks.workunit.client.0.smithi134.stdout:9/568: link d13/f28 d13/d2e/d47/fc4 0 2024-04-13T10:59:14.353 INFO:tasks.workunit.client.0.smithi134.stdout:8/581: getdents d8/dc/d2c/d68/dae 0 2024-04-13T10:59:14.354 INFO:tasks.workunit.client.0.smithi134.stdout:1/659: sync 2024-04-13T10:59:14.356 INFO:tasks.workunit.client.0.smithi134.stdout:9/569: creat d13/d39/d52/d6b/fc5 x:0 0 0 2024-04-13T10:59:14.357 INFO:tasks.workunit.client.0.smithi134.stdout:4/390: mknod d4/d48/d4a/d7e/c88 0 2024-04-13T10:59:14.360 INFO:tasks.workunit.client.0.smithi134.stdout:1/660: mknod d3/d6/d20/d71/d9c/dcb/cd5 0 2024-04-13T10:59:14.363 INFO:tasks.workunit.client.0.smithi134.stdout:8/582: link d8/dc/d16/c4d d8/dc/d2c/d68/d8c/d8f/cc9 0 2024-04-13T10:59:14.365 INFO:tasks.workunit.client.0.smithi134.stdout:1/661: creat d3/d6/d20/d6d/d8b/fd6 x:0 0 0 2024-04-13T10:59:14.367 INFO:tasks.workunit.client.0.smithi134.stdout:9/570: link d13/d40/d7d/f7f d13/d2e/d35/d50/d60/fc6 0 2024-04-13T10:59:14.369 INFO:tasks.workunit.client.0.smithi134.stdout:8/583: stat d8/dc/d16/l23 0 2024-04-13T10:59:14.372 INFO:tasks.workunit.client.0.smithi134.stdout:9/571: symlink d13/d2e/d35/d50/d60/lc7 0 2024-04-13T10:59:14.375 INFO:tasks.workunit.client.0.smithi134.stdout:8/584: symlink d8/dc/d2c/d68/d8c/lca 0 2024-04-13T10:59:14.377 INFO:tasks.workunit.client.0.smithi134.stdout:1/662: mknod d3/d6/d20/d9f/cd7 0 2024-04-13T10:59:14.377 INFO:tasks.workunit.client.0.smithi134.stdout:8/585: chown d8/dc/d13/f40 305158458 1 2024-04-13T10:59:14.378 INFO:tasks.workunit.client.0.smithi134.stdout:9/572: fdatasync d13/d2e/d47/fc4 0 2024-04-13T10:59:14.380 INFO:tasks.workunit.client.0.smithi134.stdout:1/663: write d3/d6/d16/d1d/f22 [1626227,86764] 0 2024-04-13T10:59:14.382 INFO:tasks.workunit.client.0.smithi134.stdout:4/391: dwrite d4/d1f/d27/d75/d38/f4e [0,4194304] 0 2024-04-13T10:59:14.384 INFO:tasks.workunit.client.0.smithi134.stdout:4/392: truncate d4/f7a 846166 0 2024-04-13T10:59:14.386 INFO:tasks.workunit.client.0.smithi134.stdout:8/586: chown d8/dc/d16/d54/d6f/f90 0 1 2024-04-13T10:59:14.387 INFO:tasks.workunit.client.0.smithi134.stdout:8/587: stat d8/dc/f30 0 2024-04-13T10:59:14.387 INFO:tasks.workunit.client.0.smithi134.stdout:1/664: unlink d3/d6/d20/d28/f3e 0 2024-04-13T10:59:14.389 INFO:tasks.workunit.client.0.smithi134.stdout:9/573: creat d13/d39/d64/db2/fc8 x:0 0 0 2024-04-13T10:59:14.389 INFO:tasks.workunit.client.0.smithi134.stdout:9/574: chown d13/d40/f6c 29 1 2024-04-13T10:59:14.389 INFO:tasks.workunit.client.0.smithi134.stdout:4/393: fsync d4/d1f/d27/d3a/d65/f66 0 2024-04-13T10:59:14.390 INFO:tasks.workunit.client.0.smithi134.stdout:9/575: chown d13/d39/d52/d71/ca5 7 1 2024-04-13T10:59:14.393 INFO:tasks.workunit.client.0.smithi134.stdout:8/588: creat d8/dc/d13/fcb x:0 0 0 2024-04-13T10:59:14.393 INFO:tasks.workunit.client.0.smithi134.stdout:1/665: rmdir d3/d6/d16/d1d 39 2024-04-13T10:59:14.396 INFO:tasks.workunit.client.0.smithi134.stdout:4/394: write d4/dd/f3f [1466218,32149] 0 2024-04-13T10:59:14.397 INFO:tasks.workunit.client.0.smithi134.stdout:9/576: creat d13/da3/fc9 x:0 0 0 2024-04-13T10:59:14.399 INFO:tasks.workunit.client.0.smithi134.stdout:1/666: unlink d3/d6/d20/d6d/db1/f46 0 2024-04-13T10:59:14.400 INFO:tasks.workunit.client.0.smithi134.stdout:4/395: chown d4/dd/c20 0 1 2024-04-13T10:59:14.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/589: mkdir d8/dcc 0 2024-04-13T10:59:14.404 INFO:tasks.workunit.client.0.smithi134.stdout:8/590: read d8/dc/d2c/d68/f61 [612658,15629] 0 2024-04-13T10:59:14.405 INFO:tasks.workunit.client.0.smithi134.stdout:1/667: mkdir d3/d6/d6a/dd8 0 2024-04-13T10:59:14.405 INFO:tasks.workunit.client.0.smithi134.stdout:8/591: write d8/dc/d13/f32 [1334367,128414] 0 2024-04-13T10:59:14.405 INFO:tasks.workunit.client.0.smithi134.stdout:4/396: rmdir d4/d48/d50 39 2024-04-13T10:59:14.410 INFO:tasks.workunit.client.0.smithi134.stdout:8/592: write d8/dc/d16/f1c [1334345,64081] 0 2024-04-13T10:59:14.412 INFO:tasks.workunit.client.0.smithi134.stdout:8/593: write d8/dc/d37/d3f/f91 [356394,110897] 0 2024-04-13T10:59:14.412 INFO:tasks.workunit.client.0.smithi134.stdout:1/668: creat d3/d6/d16/d1d/fd9 x:0 0 0 2024-04-13T10:59:14.414 INFO:tasks.workunit.client.0.smithi134.stdout:4/397: truncate d4/dd/d6d/f80 644635 0 2024-04-13T10:59:14.414 INFO:tasks.workunit.client.0.smithi134.stdout:9/577: dread d13/d40/f6c [0,4194304] 0 2024-04-13T10:59:14.414 INFO:tasks.workunit.client.0.smithi134.stdout:8/594: rmdir d8/dc/d37 39 2024-04-13T10:59:14.415 INFO:tasks.workunit.client.0.smithi134.stdout:1/669: dread - d3/d6/d16/d4d/f5f zero size 2024-04-13T10:59:14.417 INFO:tasks.workunit.client.0.smithi134.stdout:9/578: write d13/d40/d7d/fb4 [1248178,83305] 0 2024-04-13T10:59:14.417 INFO:tasks.workunit.client.0.smithi134.stdout:9/579: dread - d13/d40/fc0 zero size 2024-04-13T10:59:14.418 INFO:tasks.workunit.client.0.smithi134.stdout:4/398: mknod d4/d1f/d27/d75/d38/c89 0 2024-04-13T10:59:14.419 INFO:tasks.workunit.client.0.smithi134.stdout:8/595: mknod d8/dc/d2c/d68/d8c/d8f/ccd 0 2024-04-13T10:59:14.422 INFO:tasks.workunit.client.0.smithi134.stdout:4/399: symlink d4/d1f/d27/d75/d38/d79/l8a 0 2024-04-13T10:59:14.424 INFO:tasks.workunit.client.0.smithi134.stdout:8/596: creat d8/dc/d2c/d68/d8c/fce x:0 0 0 2024-04-13T10:59:14.425 INFO:tasks.workunit.client.0.smithi134.stdout:8/597: readlink d8/l9 0 2024-04-13T10:59:14.425 INFO:tasks.workunit.client.0.smithi134.stdout:1/670: symlink d3/d6/d20/d9f/lda 0 2024-04-13T10:59:14.428 INFO:tasks.workunit.client.0.smithi134.stdout:4/400: creat d4/d1f/d27/d75/d38/d79/f8b x:0 0 0 2024-04-13T10:59:14.431 INFO:tasks.workunit.client.0.smithi134.stdout:1/671: dwrite d3/d30/f77 [0,4194304] 0 2024-04-13T10:59:14.431 INFO:tasks.workunit.client.0.smithi134.stdout:9/580: creat d13/d2e/fca x:0 0 0 2024-04-13T10:59:14.434 INFO:tasks.workunit.client.0.smithi134.stdout:1/672: truncate d3/d6/d20/d6d/fc4 634675 0 2024-04-13T10:59:14.436 INFO:tasks.workunit.client.0.smithi134.stdout:8/598: fsync d8/dc/d37/d3f/f73 0 2024-04-13T10:59:14.444 INFO:tasks.workunit.client.0.smithi134.stdout:4/401: rename d4/d48/d50/d60 to d4/dd/d6d/d8c 0 2024-04-13T10:59:14.452 INFO:tasks.workunit.client.0.smithi134.stdout:4/402: dread d4/d1f/d27/d75/f68 [0,4194304] 0 2024-04-13T10:59:14.460 INFO:tasks.workunit.client.0.smithi134.stdout:9/581: dread f4 [0,4194304] 0 2024-04-13T10:59:14.465 INFO:tasks.workunit.client.0.smithi134.stdout:8/599: getdents d8/dc/d2c/d68/d8c/d8f 0 2024-04-13T10:59:14.467 INFO:tasks.workunit.client.0.smithi134.stdout:9/582: rename d13/d39/d52/fb1 to d13/d2e/d35/d50/d59/fcb 0 2024-04-13T10:59:14.477 INFO:tasks.workunit.client.0.smithi134.stdout:9/583: dwrite d13/f21 [0,4194304] 0 2024-04-13T10:59:14.481 INFO:tasks.workunit.client.0.smithi134.stdout:9/584: creat d13/d2e/d35/d50/fcc x:0 0 0 2024-04-13T10:59:14.484 INFO:tasks.workunit.client.0.smithi134.stdout:9/585: creat d13/d39/d58/d5f/dbb/fcd x:0 0 0 2024-04-13T10:59:14.485 INFO:tasks.workunit.client.0.smithi134.stdout:9/586: truncate d13/d39/f62 940047 0 2024-04-13T10:59:14.487 INFO:tasks.workunit.client.0.smithi134.stdout:8/600: dread d8/dc/d16/d54/d6c/d7d/f85 [0,4194304] 0 2024-04-13T10:59:14.489 INFO:tasks.workunit.client.0.smithi134.stdout:9/587: unlink d13/da3/f84 0 2024-04-13T10:59:14.490 INFO:tasks.workunit.client.0.smithi134.stdout:9/588: dread - d13/d2e/fca zero size 2024-04-13T10:59:14.495 INFO:tasks.workunit.client.0.smithi134.stdout:8/601: dwrite d8/dc/d2c/d68/d8c/d8f/fa9 [0,4194304] 0 2024-04-13T10:59:14.498 INFO:tasks.workunit.client.0.smithi134.stdout:9/589: rename d13/d39/d58/d5f/d6e/c79 to d13/d2e/d47/cce 0 2024-04-13T10:59:14.503 INFO:tasks.workunit.client.0.smithi134.stdout:8/602: dwrite d8/dc/f45 [0,4194304] 0 2024-04-13T10:59:14.505 INFO:tasks.workunit.client.0.smithi134.stdout:8/603: truncate d8/dc/d2c/d68/fb5 893289 0 2024-04-13T10:59:14.508 INFO:tasks.workunit.client.0.smithi134.stdout:9/590: creat d13/d39/d58/fcf x:0 0 0 2024-04-13T10:59:14.510 INFO:tasks.workunit.client.0.smithi134.stdout:9/591: mknod d13/da3/d98/cd0 0 2024-04-13T10:59:14.514 INFO:tasks.workunit.client.0.smithi134.stdout:9/592: symlink d13/d2e/d35/d50/d60/ld1 0 2024-04-13T10:59:14.522 INFO:tasks.workunit.client.0.smithi134.stdout:4/403: dwrite d4/d1f/d27/d75/d38/d79/f46 [0,4194304] 0 2024-04-13T10:59:14.533 INFO:tasks.workunit.client.0.smithi134.stdout:9/593: mknod d13/d2e/d35/d50/cd2 0 2024-04-13T10:59:14.534 INFO:tasks.workunit.client.0.smithi134.stdout:9/594: chown fd 2 1 2024-04-13T10:59:14.542 INFO:tasks.workunit.client.0.smithi134.stdout:9/595: rename d13/d2e/d35/f46 to d13/d39/d52/d86/fd3 0 2024-04-13T10:59:14.548 INFO:tasks.workunit.client.0.smithi134.stdout:9/596: getdents d13/d39/d58 0 2024-04-13T10:59:14.550 INFO:tasks.workunit.client.0.smithi134.stdout:9/597: creat d13/d39/d52/d6b/fd4 x:0 0 0 2024-04-13T10:59:14.565 INFO:tasks.workunit.client.0.smithi134.stdout:4/404: write d4/d1f/d27/d75/d38/d79/d32/f3b [690817,110570] 0 2024-04-13T10:59:14.568 INFO:tasks.workunit.client.0.smithi134.stdout:4/405: read - d4/d1f/f49 zero size 2024-04-13T10:59:14.569 INFO:tasks.workunit.client.0.smithi134.stdout:4/406: dread - d4/d1f/d27/d75/d38/d79/d32/f74 zero size 2024-04-13T10:59:14.574 INFO:tasks.workunit.client.0.smithi134.stdout:4/407: dwrite d4/d1f/d27/d75/f44 [8388608,4194304] 0 2024-04-13T10:59:14.575 INFO:tasks.workunit.client.0.smithi134.stdout:4/408: chown d4/d1f/f49 0 1 2024-04-13T10:59:14.580 INFO:tasks.workunit.client.0.smithi134.stdout:4/409: creat d4/d1f/d27/d3a/d65/f8d x:0 0 0 2024-04-13T10:59:14.588 INFO:tasks.workunit.client.0.smithi134.stdout:7/512: sync 2024-04-13T10:59:14.588 INFO:tasks.workunit.client.0.smithi134.stdout:0/552: sync 2024-04-13T10:59:14.588 INFO:tasks.workunit.client.0.smithi134.stdout:5/700: sync 2024-04-13T10:59:14.588 INFO:tasks.workunit.client.0.smithi134.stdout:6/591: sync 2024-04-13T10:59:14.593 INFO:tasks.workunit.client.0.smithi134.stdout:4/410: mknod d4/d1f/d27/c8e 0 2024-04-13T10:59:14.593 INFO:tasks.workunit.client.0.smithi134.stdout:5/701: chown dc/d1d/d2f/d3b/d6a/l79 19 1 2024-04-13T10:59:14.594 INFO:tasks.workunit.client.0.smithi134.stdout:0/553: mkdir d4/d17/d20/d29/dcd 0 2024-04-13T10:59:14.596 INFO:tasks.workunit.client.0.smithi134.stdout:9/598: dwrite d13/d40/d7d/f7f [0,4194304] 0 2024-04-13T10:59:14.599 INFO:tasks.workunit.client.0.smithi134.stdout:6/592: rename d4/da/d15/d57 to d4/da/dbb/dc3 0 2024-04-13T10:59:14.603 INFO:tasks.workunit.client.0.smithi134.stdout:5/702: mknod dc/d1d/d2f/d3b/d7f/d8d/ce8 0 2024-04-13T10:59:14.604 INFO:tasks.workunit.client.0.smithi134.stdout:4/411: dwrite d4/d1f/d27/d75/d38/d79/d32/d67/f70 [0,4194304] 0 2024-04-13T10:59:14.611 INFO:tasks.workunit.client.0.smithi134.stdout:6/593: readlink d4/da/d15/d1f/d3c/l74 0 2024-04-13T10:59:14.615 INFO:tasks.workunit.client.0.smithi134.stdout:0/554: getdents d4/d17/da/d22/d41/dc2 0 2024-04-13T10:59:14.617 INFO:tasks.workunit.client.0.smithi134.stdout:0/555: read d4/d17/da/f10 [40830,123871] 0 2024-04-13T10:59:14.619 INFO:tasks.workunit.client.0.smithi134.stdout:5/703: creat dc/d1d/d2b/d30/fe9 x:0 0 0 2024-04-13T10:59:14.619 INFO:tasks.workunit.client.0.smithi134.stdout:5/704: fdatasync fb 0 2024-04-13T10:59:14.624 INFO:tasks.workunit.client.0.smithi134.stdout:9/599: dread d13/d40/f48 [0,4194304] 0 2024-04-13T10:59:14.624 INFO:tasks.workunit.client.0.smithi134.stdout:6/594: mkdir d4/da/d15/d76/d8e/da1/dc4 0 2024-04-13T10:59:14.632 INFO:tasks.workunit.client.0.smithi134.stdout:4/412: getdents d4/d48/d86 0 2024-04-13T10:59:14.635 INFO:tasks.workunit.client.0.smithi134.stdout:7/513: write f8 [1156809,100603] 0 2024-04-13T10:59:14.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:14 smithi134 ceph-mon[39696]: pgmap v41: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 41 MiB/s rd, 155 MiB/s wr, 341 op/s 2024-04-13T10:59:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:14 smithi194 ceph-mon[46737]: pgmap v41: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 41 MiB/s rd, 155 MiB/s wr, 341 op/s 2024-04-13T10:59:14.757 INFO:tasks.workunit.client.0.smithi134.stdout:7/514: symlink da/d15/d26/d27/d4f/d5f/la3 0 2024-04-13T10:59:14.759 INFO:tasks.workunit.client.0.smithi134.stdout:6/595: rename d4/da/d15/d1f/d3c/f59 to d4/da/d15/d1f/d24/da4/fc5 0 2024-04-13T10:59:14.763 INFO:tasks.workunit.client.0.smithi134.stdout:7/515: stat da/d15/d26/d27/d3d/d46/c64 0 2024-04-13T10:59:14.765 INFO:tasks.workunit.client.0.smithi134.stdout:0/556: dwrite d4/d17/da/f1b [0,4194304] 0 2024-04-13T10:59:14.768 INFO:tasks.workunit.client.0.smithi134.stdout:9/600: getdents d13/d40/d7d 0 2024-04-13T10:59:14.771 INFO:tasks.workunit.client.0.smithi134.stdout:9/601: write d13/d40/fc0 [81420,88458] 0 2024-04-13T10:59:14.773 INFO:tasks.workunit.client.0.smithi134.stdout:6/596: rename d4/da/d1a/l56 to d4/da/d1a/lc6 0 2024-04-13T10:59:14.773 INFO:tasks.workunit.client.0.smithi134.stdout:5/705: dwrite dc/d39/d63/fe1 [0,4194304] 0 2024-04-13T10:59:14.776 INFO:tasks.workunit.client.0.smithi134.stdout:5/706: write dc/d1d/d20/f87 [361907,15001] 0 2024-04-13T10:59:14.777 INFO:tasks.workunit.client.0.smithi134.stdout:6/597: symlink d4/da/dbb/dc3/lc7 0 2024-04-13T10:59:14.779 INFO:tasks.workunit.client.0.smithi134.stdout:6/598: write d4/da/d15/d1f/f2a [2375514,14161] 0 2024-04-13T10:59:14.780 INFO:tasks.workunit.client.0.smithi134.stdout:6/599: fdatasync d4/da/d15/d1f/d24/f3a 0 2024-04-13T10:59:14.783 INFO:tasks.workunit.client.0.smithi134.stdout:9/602: getdents d13/d40/d7d 0 2024-04-13T10:59:14.784 INFO:tasks.workunit.client.0.smithi134.stdout:9/603: chown d13/d39/d52/d6b 61 1 2024-04-13T10:59:14.785 INFO:tasks.workunit.client.0.smithi134.stdout:5/707: read dc/d1d/d20/d23/f32 [2930131,11121] 0 2024-04-13T10:59:14.786 INFO:tasks.workunit.client.0.smithi134.stdout:0/557: truncate d4/d17/da/d22/d37/fac 659039 0 2024-04-13T10:59:14.788 INFO:tasks.workunit.client.0.smithi134.stdout:9/604: read d13/d2e/f9a [347548,82747] 0 2024-04-13T10:59:14.793 INFO:tasks.workunit.client.0.smithi134.stdout:9/605: mkdir d13/d39/d58/dd5 0 2024-04-13T10:59:14.793 INFO:tasks.workunit.client.0.smithi134.stdout:9/606: chown d13/d39/d52/d86 0 1 2024-04-13T10:59:14.795 INFO:tasks.workunit.client.0.smithi134.stdout:0/558: rename d4/d17/da/d22/d37/d6d/d97/db6/fbf to d4/d17/d23/d51/d6b/d91/d98/d92/dca/fce 0 2024-04-13T10:59:14.797 INFO:tasks.workunit.client.0.smithi134.stdout:0/559: fdatasync d4/d17/fc5 0 2024-04-13T10:59:14.797 INFO:tasks.workunit.client.0.smithi134.stdout:9/607: unlink d13/f21 0 2024-04-13T10:59:14.798 INFO:tasks.workunit.client.0.smithi134.stdout:9/608: stat d13/d2e/d47 0 2024-04-13T10:59:14.802 INFO:tasks.workunit.client.0.smithi134.stdout:0/560: fsync d4/d17/da/d22/d37/d47/f71 0 2024-04-13T10:59:14.803 INFO:tasks.workunit.client.0.smithi134.stdout:6/600: dread d4/da/d15/d1f/d24/d2b/f3f [0,4194304] 0 2024-04-13T10:59:14.803 INFO:tasks.workunit.client.0.smithi134.stdout:9/609: mkdir d13/d39/d64/db2/dd6 0 2024-04-13T10:59:14.805 INFO:tasks.workunit.client.0.smithi134.stdout:2/453: sync 2024-04-13T10:59:14.805 INFO:tasks.workunit.client.0.smithi134.stdout:3/457: sync 2024-04-13T10:59:14.811 INFO:tasks.workunit.client.0.smithi134.stdout:5/708: dread dc/d1d/d20/d23/f68 [0,4194304] 0 2024-04-13T10:59:14.814 INFO:tasks.workunit.client.0.smithi134.stdout:9/610: dwrite d13/da3/fc9 [0,4194304] 0 2024-04-13T10:59:14.814 INFO:tasks.workunit.client.0.smithi134.stdout:0/561: rename d4/d17/da/d22/d37/d47 to d4/d17/da/d22/d37/d6d/d97/d9c/dcf 0 2024-04-13T10:59:14.821 INFO:tasks.workunit.client.0.smithi134.stdout:6/601: dwrite d4/da/d15/d1f/d24/d2b/f3f [0,4194304] 0 2024-04-13T10:59:14.828 INFO:tasks.workunit.client.0.smithi134.stdout:2/454: dread d5/d6/d57/d6f/f44 [0,4194304] 0 2024-04-13T10:59:14.830 INFO:tasks.workunit.client.0.smithi134.stdout:0/562: dwrite d4/d17/da/d22/d37/f4d [4194304,4194304] 0 2024-04-13T10:59:14.832 INFO:tasks.workunit.client.0.smithi134.stdout:9/611: rename d13/d2e/l41 to d13/d39/d64/db2/ld7 0 2024-04-13T10:59:14.833 INFO:tasks.workunit.client.0.smithi134.stdout:3/458: dread dc/d27/d19/d48/d49/f67 [0,4194304] 0 2024-04-13T10:59:14.839 INFO:tasks.workunit.client.0.smithi134.stdout:6/602: dread d4/da/d15/f6e [0,4194304] 0 2024-04-13T10:59:14.839 INFO:tasks.workunit.client.0.smithi134.stdout:9/612: creat d13/d39/d52/d6b/fd8 x:0 0 0 2024-04-13T10:59:14.840 INFO:tasks.workunit.client.0.smithi134.stdout:9/613: stat d13/c19 0 2024-04-13T10:59:14.840 INFO:tasks.workunit.client.0.smithi134.stdout:6/603: dread - d4/da/d15/d1f/f98 zero size 2024-04-13T10:59:14.841 INFO:tasks.workunit.client.0.smithi134.stdout:6/604: fsync d4/f75 0 2024-04-13T10:59:14.842 INFO:tasks.workunit.client.0.smithi134.stdout:0/563: symlink d4/d17/da/d22/d41/d6e/d8a/ld0 0 2024-04-13T10:59:14.847 INFO:tasks.workunit.client.0.smithi134.stdout:2/455: write d5/de/f16 [623136,34729] 0 2024-04-13T10:59:14.848 INFO:tasks.workunit.client.0.smithi134.stdout:9/614: creat d13/d39/d64/db2/fd9 x:0 0 0 2024-04-13T10:59:14.850 INFO:tasks.workunit.client.0.smithi134.stdout:5/709: truncate dc/f14 21962 0 2024-04-13T10:59:14.852 INFO:tasks.workunit.client.0.smithi134.stdout:3/459: dwrite dc/d27/d19/d48/d49/f67 [0,4194304] 0 2024-04-13T10:59:14.866 INFO:tasks.workunit.client.0.smithi134.stdout:9/615: write d13/d40/f42 [143631,112134] 0 2024-04-13T10:59:14.866 INFO:tasks.workunit.client.0.smithi134.stdout:5/710: write dc/d15/d65/f6d [232009,28932] 0 2024-04-13T10:59:14.869 INFO:tasks.workunit.client.0.smithi134.stdout:3/460: mkdir dc/d27/d4d/d4f/d50/d25/d91 0 2024-04-13T10:59:14.870 INFO:tasks.workunit.client.0.smithi134.stdout:6/605: dwrite d4/da/f14 [0,4194304] 0 2024-04-13T10:59:14.873 INFO:tasks.workunit.client.0.smithi134.stdout:0/564: dwrite d4/d17/da/d22/f31 [0,4194304] 0 2024-04-13T10:59:14.880 INFO:tasks.workunit.client.0.smithi134.stdout:2/456: dread d5/de/d50/f56 [0,4194304] 0 2024-04-13T10:59:14.882 INFO:tasks.workunit.client.0.smithi134.stdout:5/711: write dc/d15/d84/f9c [306478,34073] 0 2024-04-13T10:59:14.885 INFO:tasks.workunit.client.0.smithi134.stdout:6/606: dwrite d4/da/d15/d77/d63/f86 [0,4194304] 0 2024-04-13T10:59:14.886 INFO:tasks.workunit.client.0.smithi134.stdout:0/565: fsync d4/d17/d23/f83 0 2024-04-13T10:59:14.891 INFO:tasks.workunit.client.0.smithi134.stdout:3/461: truncate dc/d27/d4d/f34 2652560 0 2024-04-13T10:59:14.892 INFO:tasks.workunit.client.0.smithi134.stdout:2/457: creat d5/de/d12/f86 x:0 0 0 2024-04-13T10:59:14.892 INFO:tasks.workunit.client.0.smithi134.stdout:2/458: chown d5/d6/d57/d6c 6708161 1 2024-04-13T10:59:14.896 INFO:tasks.workunit.client.0.smithi134.stdout:0/566: mknod d4/d17/d20/d29/d30/cd1 0 2024-04-13T10:59:14.898 INFO:tasks.workunit.client.0.smithi134.stdout:2/459: truncate d5/de/f37 2425170 0 2024-04-13T10:59:14.901 INFO:tasks.workunit.client.0.smithi134.stdout:3/462: creat dc/d27/d19/d48/d8e/f92 x:0 0 0 2024-04-13T10:59:14.907 INFO:tasks.workunit.client.0.smithi134.stdout:3/463: read - dc/d1d/d58/f5d zero size 2024-04-13T10:59:14.908 INFO:tasks.workunit.client.0.smithi134.stdout:3/464: readlink dc/d27/d19/d48/d49/l65 0 2024-04-13T10:59:14.909 INFO:tasks.workunit.client.0.smithi134.stdout:9/616: truncate d13/da3/fc9 327406 0 2024-04-13T10:59:14.910 INFO:tasks.workunit.client.0.smithi134.stdout:9/617: fsync d13/d2e/d35/d50/d60/fc6 0 2024-04-13T10:59:14.912 INFO:tasks.workunit.client.0.smithi134.stdout:6/607: getdents d4/da/d15/d1f/d24/da4 0 2024-04-13T10:59:14.913 INFO:tasks.workunit.client.0.smithi134.stdout:6/608: truncate d4/da/fc2 1009689 0 2024-04-13T10:59:14.914 INFO:tasks.workunit.client.0.smithi134.stdout:2/460: dread f1 [4194304,4194304] 0 2024-04-13T10:59:14.915 INFO:tasks.workunit.client.0.smithi134.stdout:6/609: chown d4/da/d15/d77/d63/f86 152714089 1 2024-04-13T10:59:14.916 INFO:tasks.workunit.client.0.smithi134.stdout:5/712: write dc/d1d/d2f/d3b/f52 [4380953,73119] 0 2024-04-13T10:59:14.921 INFO:tasks.workunit.client.0.smithi134.stdout:3/465: mkdir dc/d27/d4d/d4f/d50/d25/d91/d93 0 2024-04-13T10:59:14.921 INFO:tasks.workunit.client.0.smithi134.stdout:5/713: dread dc/d15/d84/f9c [0,4194304] 0 2024-04-13T10:59:14.926 INFO:tasks.workunit.client.0.smithi134.stdout:2/461: symlink d5/d6/d57/d6f/d30/d58/d59/l87 0 2024-04-13T10:59:14.927 INFO:tasks.workunit.client.0.smithi134.stdout:2/462: dread - d5/d6/d57/d6f/d30/d58/d73/f83 zero size 2024-04-13T10:59:14.930 INFO:tasks.workunit.client.0.smithi134.stdout:3/466: mknod dc/d27/c94 0 2024-04-13T10:59:14.932 INFO:tasks.workunit.client.0.smithi134.stdout:0/567: truncate d4/d17/da/d22/d37/d6d/d97/d9c/dcf/d96/f9a 254147 0 2024-04-13T10:59:14.934 INFO:tasks.workunit.client.0.smithi134.stdout:2/463: dwrite d5/de/d50/f60 [0,4194304] 0 2024-04-13T10:59:14.936 INFO:tasks.workunit.client.0.smithi134.stdout:2/464: write d5/d6/d57/d6f/d30/f4f [1824368,97944] 0 2024-04-13T10:59:14.942 INFO:tasks.workunit.client.0.smithi134.stdout:2/465: dread d5/d6/d57/d6f/d30/f71 [0,4194304] 0 2024-04-13T10:59:14.942 INFO:tasks.workunit.client.0.smithi134.stdout:6/610: creat d4/da/fc8 x:0 0 0 2024-04-13T10:59:14.947 INFO:tasks.workunit.client.0.smithi134.stdout:0/568: dread d4/d17/d20/d29/f87 [0,4194304] 0 2024-04-13T10:59:14.948 INFO:tasks.workunit.client.0.smithi134.stdout:8/604: sync 2024-04-13T10:59:14.948 INFO:tasks.workunit.client.0.smithi134.stdout:1/673: sync 2024-04-13T10:59:14.951 INFO:tasks.workunit.client.0.smithi134.stdout:0/569: write d4/d17/da/d22/f31 [2286428,74432] 0 2024-04-13T10:59:14.951 INFO:tasks.workunit.client.0.smithi134.stdout:9/618: dwrite d13/f28 [0,4194304] 0 2024-04-13T10:59:14.953 INFO:tasks.workunit.client.0.smithi134.stdout:1/674: write d3/d6/d20/d28/f98 [847025,29774] 0 2024-04-13T10:59:14.956 INFO:tasks.workunit.client.0.smithi134.stdout:9/619: write d13/d40/f42 [1527783,94813] 0 2024-04-13T10:59:14.957 INFO:tasks.workunit.client.0.smithi134.stdout:8/605: write d8/dc/d16/d54/d6c/d94/dc1/fc6 [294515,68463] 0 2024-04-13T10:59:14.958 INFO:tasks.workunit.client.0.smithi134.stdout:6/611: dwrite d4/da/d15/d1f/f2a [4194304,4194304] 0 2024-04-13T10:59:14.961 INFO:tasks.workunit.client.0.smithi134.stdout:3/467: dread dc/f42 [0,4194304] 0 2024-04-13T10:59:14.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/620: read d13/d2e/f9a [2225711,19895] 0 2024-04-13T10:59:14.965 INFO:tasks.workunit.client.0.smithi134.stdout:2/466: mkdir d5/d6/d57/d6f/d30/d88 0 2024-04-13T10:59:14.971 INFO:tasks.workunit.client.0.smithi134.stdout:1/675: dread d3/d6/d16/f35 [0,4194304] 0 2024-04-13T10:59:14.971 INFO:tasks.workunit.client.0.smithi134.stdout:5/714: rename dc/d1d/d2f/d3b/d6a/c78 to dc/d1d/d67/cea 0 2024-04-13T10:59:14.972 INFO:tasks.workunit.client.0.smithi134.stdout:5/715: stat dc/d15/f43 0 2024-04-13T10:59:14.976 INFO:tasks.workunit.client.0.smithi134.stdout:6/612: mkdir d4/da/d15/d1f/d24/d49/d91/dc9 0 2024-04-13T10:59:14.979 INFO:tasks.workunit.client.0.smithi134.stdout:2/467: fsync d5/d6/d57/d6c/d29/f66 0 2024-04-13T10:59:14.981 INFO:tasks.workunit.client.0.smithi134.stdout:3/468: mkdir dc/d27/d95 0 2024-04-13T10:59:14.982 INFO:tasks.workunit.client.0.smithi134.stdout:3/469: write dc/f71 [1062283,56219] 0 2024-04-13T10:59:14.982 INFO:tasks.workunit.client.0.smithi134.stdout:8/606: symlink d8/lcf 0 2024-04-13T10:59:14.985 INFO:tasks.workunit.client.0.smithi134.stdout:1/676: rename d3/d6/dd/l4a to d3/d6/d16/d1d/d3c/ldb 0 2024-04-13T10:59:14.987 INFO:tasks.workunit.client.0.smithi134.stdout:5/716: symlink dc/d1d/d20/d23/d5a/leb 0 2024-04-13T10:59:14.994 INFO:tasks.workunit.client.0.smithi134.stdout:2/468: write f1 [7467868,130638] 0 2024-04-13T10:59:14.996 INFO:tasks.workunit.client.0.smithi134.stdout:0/570: dwrite d4/d17/da/f27 [0,4194304] 0 2024-04-13T10:59:14.998 INFO:tasks.workunit.client.0.smithi134.stdout:6/613: write d4/da/d15/d1f/d24/da4/fc5 [1634385,70563] 0 2024-04-13T10:59:15.003 INFO:tasks.workunit.client.0.smithi134.stdout:4/413: sync 2024-04-13T10:59:15.003 INFO:tasks.workunit.client.0.smithi134.stdout:7/516: sync 2024-04-13T10:59:15.006 INFO:tasks.workunit.client.0.smithi134.stdout:7/517: read da/d15/d26/d27/d3d/d9c/d48/f93 [6960501,3352] 0 2024-04-13T10:59:15.011 INFO:tasks.workunit.client.0.smithi134.stdout:0/571: unlink d4/d17/d20/d29/d30/ca8 0 2024-04-13T10:59:15.013 INFO:tasks.workunit.client.0.smithi134.stdout:6/614: mkdir d4/da/dbb/dca 0 2024-04-13T10:59:15.015 INFO:tasks.workunit.client.0.smithi134.stdout:0/572: write d4/d17/d23/d51/f9d [421068,61922] 0 2024-04-13T10:59:15.016 INFO:tasks.workunit.client.0.smithi134.stdout:8/607: dread d8/dc/f30 [0,4194304] 0 2024-04-13T10:59:15.016 INFO:tasks.workunit.client.0.smithi134.stdout:1/677: mknod d3/d6/cdc 0 2024-04-13T10:59:15.017 INFO:tasks.workunit.client.0.smithi134.stdout:3/470: mknod dc/d27/d4d/d4f/d50/d25/c96 0 2024-04-13T10:59:15.019 INFO:tasks.workunit.client.0.smithi134.stdout:5/717: dwrite dc/d1d/d67/d69/fad [0,4194304] 0 2024-04-13T10:59:15.020 INFO:tasks.workunit.client.0.smithi134.stdout:4/414: symlink d4/dd/d6d/l8f 0 2024-04-13T10:59:15.021 INFO:tasks.workunit.client.0.smithi134.stdout:0/573: write d4/d17/d20/d29/d30/d7f/dc0/fc6 [2208317,72654] 0 2024-04-13T10:59:15.022 INFO:tasks.workunit.client.0.smithi134.stdout:5/718: stat dc/d1d/d2b/d30/f54 0 2024-04-13T10:59:15.026 INFO:tasks.workunit.client.0.smithi134.stdout:8/608: creat d8/dc/d37/d3f/fd0 x:0 0 0 2024-04-13T10:59:15.029 INFO:tasks.workunit.client.0.smithi134.stdout:9/621: link d13/d2e/d35/d50/f7b d13/d39/d58/d5f/d6e/fda 0 2024-04-13T10:59:15.029 INFO:tasks.workunit.client.0.smithi134.stdout:1/678: dwrite d3/d6/d16/d1d/d86/f8e [0,4194304] 0 2024-04-13T10:59:15.031 INFO:tasks.workunit.client.0.smithi134.stdout:0/574: symlink d4/d17/d1a/ld2 0 2024-04-13T10:59:15.036 INFO:tasks.workunit.client.0.smithi134.stdout:6/615: mknod d4/da/d15/d1f/ccb 0 2024-04-13T10:59:15.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/622: readlink d13/d40/l80 0 2024-04-13T10:59:15.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/623: readlink la 0 2024-04-13T10:59:15.045 INFO:tasks.workunit.client.0.smithi134.stdout:1/679: truncate d3/d6/d16/d1d/dab/fb8 1031004 0 2024-04-13T10:59:15.046 INFO:tasks.workunit.client.0.smithi134.stdout:2/469: getdents d5/d6/d57 0 2024-04-13T10:59:15.050 INFO:tasks.workunit.client.0.smithi134.stdout:6/616: creat d4/da/d15/d1f/d24/da4/fcc x:0 0 0 2024-04-13T10:59:15.052 INFO:tasks.workunit.client.0.smithi134.stdout:7/518: dread da/d15/d26/d27/d4f/d5f/d67/d73/f75 [0,4194304] 0 2024-04-13T10:59:15.052 INFO:tasks.workunit.client.0.smithi134.stdout:9/624: dwrite d13/d2e/f3e [0,4194304] 0 2024-04-13T10:59:15.053 INFO:tasks.workunit.client.0.smithi134.stdout:6/617: fsync d4/da/d15/d1f/d24/d49/f83 0 2024-04-13T10:59:15.054 INFO:tasks.workunit.client.0.smithi134.stdout:7/519: write f8 [4588502,86771] 0 2024-04-13T10:59:15.058 INFO:tasks.workunit.client.0.smithi134.stdout:3/471: truncate dc/d27/d4d/d4f/d50/d25/f47 542955 0 2024-04-13T10:59:15.060 INFO:tasks.workunit.client.0.smithi134.stdout:5/719: truncate dc/f1b 879291 0 2024-04-13T10:59:15.061 INFO:tasks.workunit.client.0.smithi134.stdout:2/470: rmdir d5/de 39 2024-04-13T10:59:15.062 INFO:tasks.workunit.client.0.smithi134.stdout:4/415: getdents d4 0 2024-04-13T10:59:15.064 INFO:tasks.workunit.client.0.smithi134.stdout:0/575: dwrite d4/d17/da/d22/d41/f4b [0,4194304] 0 2024-04-13T10:59:15.065 INFO:tasks.workunit.client.0.smithi134.stdout:9/625: stat d13/c27 0 2024-04-13T10:59:15.069 INFO:tasks.workunit.client.0.smithi134.stdout:7/520: stat da/d15/d26/d27/d3d/f45 0 2024-04-13T10:59:15.076 INFO:tasks.workunit.client.0.smithi134.stdout:1/680: mknod d3/d6/d16/cdd 0 2024-04-13T10:59:15.078 INFO:tasks.workunit.client.0.smithi134.stdout:1/681: write d3/d6/d20/d28/f95 [3905455,81930] 0 2024-04-13T10:59:15.081 INFO:tasks.workunit.client.0.smithi134.stdout:5/720: mkdir dc/d39/dec 0 2024-04-13T10:59:15.084 INFO:tasks.workunit.client.0.smithi134.stdout:2/471: fdatasync d5/de/d50/f7c 0 2024-04-13T10:59:15.085 INFO:tasks.workunit.client.0.smithi134.stdout:3/472: dwrite dc/d27/d19/d48/d77/f89 [0,4194304] 0 2024-04-13T10:59:15.088 INFO:tasks.workunit.client.0.smithi134.stdout:8/609: getdents d8/dc/d16/d54/d98/d9b/da3 0 2024-04-13T10:59:15.091 INFO:tasks.workunit.client.0.smithi134.stdout:9/626: chown d13/d2e/d47/cce 75 1 2024-04-13T10:59:15.093 INFO:tasks.workunit.client.0.smithi134.stdout:0/576: rename d4/d17/d23/d51/d6b/d91/d98/d8b to d4/d17/d20/d29/d30/d64/d84/dd3 0 2024-04-13T10:59:15.099 INFO:tasks.workunit.client.0.smithi134.stdout:3/473: dwrite dc/d27/d19/f5c [4194304,4194304] 0 2024-04-13T10:59:15.100 INFO:tasks.workunit.client.0.smithi134.stdout:7/521: read da/f33 [7808,119958] 0 2024-04-13T10:59:15.102 INFO:tasks.workunit.client.0.smithi134.stdout:2/472: dread d5/d6/d57/d6f/d30/f4f [0,4194304] 0 2024-04-13T10:59:15.104 INFO:tasks.workunit.client.0.smithi134.stdout:8/610: dwrite d8/dc/d16/d54/d6c/f9f [0,4194304] 0 2024-04-13T10:59:15.111 INFO:tasks.workunit.client.0.smithi134.stdout:4/416: dwrite d4/d1f/f49 [0,4194304] 0 2024-04-13T10:59:15.113 INFO:tasks.workunit.client.0.smithi134.stdout:5/721: mknod dc/d1d/d2f/d3b/d7f/d8d/ced 0 2024-04-13T10:59:15.114 INFO:tasks.workunit.client.0.smithi134.stdout:4/417: write d4/d1f/d27/d75/f52 [664149,16317] 0 2024-04-13T10:59:15.127 INFO:tasks.workunit.client.0.smithi134.stdout:9/627: mknod d13/da3/cdb 0 2024-04-13T10:59:15.127 INFO:tasks.workunit.client.0.smithi134.stdout:4/418: dwrite d4/d1f/d27/d75/d38/d79/f8b [0,4194304] 0 2024-04-13T10:59:15.129 INFO:tasks.workunit.client.0.smithi134.stdout:1/682: rename d3/d6/d20/d6d/d8b/c9d to d3/d6/d20/d71/cde 0 2024-04-13T10:59:15.130 INFO:tasks.workunit.client.0.smithi134.stdout:1/683: chown d3/f41 35652246 1 2024-04-13T10:59:15.136 INFO:tasks.workunit.client.0.smithi134.stdout:0/577: rmdir d4/d17/d23/d51/d6b/d91/d98/d92 39 2024-04-13T10:59:15.137 INFO:tasks.workunit.client.0.smithi134.stdout:2/473: symlink d5/de/l89 0 2024-04-13T10:59:15.139 INFO:tasks.workunit.client.0.smithi134.stdout:3/474: fsync dc/d27/d4d/d4f/d50/d25/f3e 0 2024-04-13T10:59:15.142 INFO:tasks.workunit.client.0.smithi134.stdout:7/522: rename da/d15/d26/d27/d4f/d5f/d67/d73/c99 to da/d15/d26/d27/d4f/d5f/d67/d73/ca4 0 2024-04-13T10:59:15.146 INFO:tasks.workunit.client.0.smithi134.stdout:9/628: mknod d13/d40/cdc 0 2024-04-13T10:59:15.148 INFO:tasks.workunit.client.0.smithi134.stdout:5/722: dwrite dc/d1d/d20/d23/f68 [0,4194304] 0 2024-04-13T10:59:15.150 INFO:tasks.workunit.client.0.smithi134.stdout:5/723: chown dc/d39/d63/l8f 0 1 2024-04-13T10:59:15.152 INFO:tasks.workunit.client.0.smithi134.stdout:8/611: rename d8/dc/d16/ca1 to d8/dcc/cd1 0 2024-04-13T10:59:15.153 INFO:tasks.workunit.client.0.smithi134.stdout:0/578: mknod d4/d17/d20/d29/d30/d64/d84/cd4 0 2024-04-13T10:59:15.155 INFO:tasks.workunit.client.0.smithi134.stdout:2/474: symlink d5/d6/d57/d6c/d29/l8a 0 2024-04-13T10:59:15.156 INFO:tasks.workunit.client.0.smithi134.stdout:1/684: dwrite d3/d30/fb7 [0,4194304] 0 2024-04-13T10:59:15.157 INFO:tasks.workunit.client.0.smithi134.stdout:0/579: chown d4/d17/da/d22/d37/d6d/d97/d9c/dcf/d9e 10 1 2024-04-13T10:59:15.159 INFO:tasks.workunit.client.0.smithi134.stdout:0/580: truncate d4/d17/d23/d51/d6b/fcc 455533 0 2024-04-13T10:59:15.167 INFO:tasks.workunit.client.0.smithi134.stdout:7/523: mknod da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/ca5 0 2024-04-13T10:59:15.168 INFO:tasks.workunit.client.0.smithi134.stdout:1/685: creat d3/d6/d20/d71/d9c/fdf x:0 0 0 2024-04-13T10:59:15.173 INFO:tasks.workunit.client.0.smithi134.stdout:0/581: mkdir d4/d17/da/d22/d37/d6d/d97/d9c/dcf/d96/dd5 0 2024-04-13T10:59:15.176 INFO:tasks.workunit.client.0.smithi134.stdout:7/524: unlink da/f2a 0 2024-04-13T10:59:15.178 INFO:tasks.workunit.client.0.smithi134.stdout:9/629: link d13/d39/d58/d5f/dbb/fb9 d13/d40/d7d/fdd 0 2024-04-13T10:59:15.179 INFO:tasks.workunit.client.0.smithi134.stdout:9/630: chown d13/d39/l34 1414568688 1 2024-04-13T10:59:15.179 INFO:tasks.workunit.client.0.smithi134.stdout:9/631: readlink d13/l15 0 2024-04-13T10:59:15.180 INFO:tasks.workunit.client.0.smithi134.stdout:4/419: getdents d4/d1f/d27/d75/d38/d79/d73 0 2024-04-13T10:59:15.181 INFO:tasks.workunit.client.0.smithi134.stdout:5/724: rmdir dc/d1d/d67/db1 0 2024-04-13T10:59:15.186 INFO:tasks.workunit.client.0.smithi134.stdout:3/475: getdents dc/d1d/d58 0 2024-04-13T10:59:15.187 INFO:tasks.workunit.client.0.smithi134.stdout:2/475: rmdir d5/d6/d57/d6c/d29/d7a 0 2024-04-13T10:59:15.190 INFO:tasks.workunit.client.0.smithi134.stdout:1/686: truncate d3/d6/d16/d1d/dab/fb8 336514 0 2024-04-13T10:59:15.191 INFO:tasks.workunit.client.0.smithi134.stdout:3/476: dread dc/d27/d19/d48/d77/f89 [0,4194304] 0 2024-04-13T10:59:15.191 INFO:tasks.workunit.client.0.smithi134.stdout:4/420: fsync d4/f61 0 2024-04-13T10:59:15.192 INFO:tasks.workunit.client.0.smithi134.stdout:3/477: fsync dc/d1d/f39 0 2024-04-13T10:59:15.193 INFO:tasks.workunit.client.0.smithi134.stdout:3/478: chown dc/d27/d19/d48/d49/l65 0 1 2024-04-13T10:59:15.194 INFO:tasks.workunit.client.0.smithi134.stdout:9/632: rename d13/d2e/d35/d50/d60/fc6 to d13/d40/d7d/fde 0 2024-04-13T10:59:15.194 INFO:tasks.workunit.client.0.smithi134.stdout:4/421: truncate d4/d1f/d27/d75/d38/d79/d32/f74 464017 0 2024-04-13T10:59:15.195 INFO:tasks.workunit.client.0.smithi134.stdout:8/612: link d8/dc/f15 d8/dc/fd2 0 2024-04-13T10:59:15.196 INFO:tasks.workunit.client.0.smithi134.stdout:4/422: chown d4/dd/d6d/d8c/f16 531 1 2024-04-13T10:59:15.197 INFO:tasks.workunit.client.0.smithi134.stdout:2/476: rmdir d5/d6/df 39 2024-04-13T10:59:15.198 INFO:tasks.workunit.client.0.smithi134.stdout:8/613: read d8/dc/d13/f7c [3177048,17326] 0 2024-04-13T10:59:15.199 INFO:tasks.workunit.client.0.smithi134.stdout:4/423: chown d4/dd/l11 192692 1 2024-04-13T10:59:15.200 INFO:tasks.workunit.client.0.smithi134.stdout:8/614: chown d8/c6d 3 1 2024-04-13T10:59:15.201 INFO:tasks.workunit.client.0.smithi134.stdout:1/687: mkdir d3/d6/d20/d6d/db1/de0 0 2024-04-13T10:59:15.203 INFO:tasks.workunit.client.0.smithi134.stdout:8/615: write d8/dc/d13/fcb [157727,99159] 0 2024-04-13T10:59:15.204 INFO:tasks.workunit.client.0.smithi134.stdout:9/633: dwrite d13/d39/d64/db2/fc8 [0,4194304] 0 2024-04-13T10:59:15.207 INFO:tasks.workunit.client.0.smithi134.stdout:0/582: write d4/d17/da/f10 [1150233,57015] 0 2024-04-13T10:59:15.210 INFO:tasks.workunit.client.0.smithi134.stdout:3/479: rename dc/d27/d19/d4b to dc/d27/d4d/d4f/d50/d25/d5f/d75/d97 0 2024-04-13T10:59:15.220 INFO:tasks.workunit.client.0.smithi134.stdout:4/424: write d4/d1f/d27/d75/f68 [1670389,83007] 0 2024-04-13T10:59:15.221 INFO:tasks.workunit.client.0.smithi134.stdout:4/425: readlink d4/d1f/d27/l47 0 2024-04-13T10:59:15.222 INFO:tasks.workunit.client.0.smithi134.stdout:4/426: dread - d4/d1f/d27/d3a/d53/d58/f81 zero size 2024-04-13T10:59:15.223 INFO:tasks.workunit.client.0.smithi134.stdout:4/427: write d4/d1f/d27/d75/f44 [11820580,120663] 0 2024-04-13T10:59:15.225 INFO:tasks.workunit.client.0.smithi134.stdout:1/688: creat d3/d6/d20/fe1 x:0 0 0 2024-04-13T10:59:15.229 INFO:tasks.workunit.client.0.smithi134.stdout:5/725: creat dc/d39/d63/fee x:0 0 0 2024-04-13T10:59:15.230 INFO:tasks.workunit.client.0.smithi134.stdout:9/634: dwrite d13/d39/d58/f5c [0,4194304] 0 2024-04-13T10:59:15.236 INFO:tasks.workunit.client.0.smithi134.stdout:5/726: dwrite dc/d15/d65/fcf [0,4194304] 0 2024-04-13T10:59:15.299 INFO:tasks.workunit.client.0.smithi134.stdout:0/583: write d4/d17/da/d22/d37/d6d/d97/d9c/dcf/f71 [347634,110019] 0 2024-04-13T10:59:15.300 INFO:tasks.workunit.client.0.smithi134.stdout:2/477: write d5/de/f37 [1797164,15654] 0 2024-04-13T10:59:15.300 INFO:tasks.workunit.client.0.smithi134.stdout:7/525: link da/d15/d26/d27/d3d/d9c/d48/f50 da/d15/d26/d27/d3d/d9c/fa6 0 2024-04-13T10:59:15.307 INFO:tasks.workunit.client.0.smithi134.stdout:9/635: creat d13/d39/d52/da2/fdf x:0 0 0 2024-04-13T10:59:15.308 INFO:tasks.workunit.client.0.smithi134.stdout:9/636: chown d13/d39/c36 10123 1 2024-04-13T10:59:15.310 INFO:tasks.workunit.client.0.smithi134.stdout:5/727: chown dc/d1d/d2b/l81 340 1 2024-04-13T10:59:15.310 INFO:tasks.workunit.client.0.smithi134.stdout:4/428: dread d4/dd/d6d/d8c/f16 [0,4194304] 0 2024-04-13T10:59:15.311 INFO:tasks.workunit.client.0.smithi134.stdout:5/728: write dc/d39/d63/fee [614439,48689] 0 2024-04-13T10:59:15.312 INFO:tasks.workunit.client.0.smithi134.stdout:4/429: read d4/d48/f5a [11658064,102516] 0 2024-04-13T10:59:15.313 INFO:tasks.workunit.client.0.smithi134.stdout:5/729: stat dc/d1d/d20/d23/d5a/leb 0 2024-04-13T10:59:15.313 INFO:tasks.workunit.client.0.smithi134.stdout:5/730: readlink dc/d1d/l58 0 2024-04-13T10:59:15.316 INFO:tasks.workunit.client.0.smithi134.stdout:2/478: rmdir d5/d6/d57/d6f/d30/d58/d59 39 2024-04-13T10:59:15.317 INFO:tasks.workunit.client.0.smithi134.stdout:2/479: write d5/de/d55/f6e [392095,50792] 0 2024-04-13T10:59:15.320 INFO:tasks.workunit.client.0.smithi134.stdout:8/616: link d8/dc/d13/f63 d8/dc/d16/d54/d98/d9b/da3/fd3 0 2024-04-13T10:59:15.324 INFO:tasks.workunit.client.0.smithi134.stdout:4/430: mkdir d4/d1f/d90 0 2024-04-13T10:59:15.325 INFO:tasks.workunit.client.0.smithi134.stdout:5/731: write dc/d15/d50/f90 [38560,83200] 0 2024-04-13T10:59:15.325 INFO:tasks.workunit.client.0.smithi134.stdout:4/431: fsync d4/d1f/d27/d75/d38/d79/d32/d67/f70 0 2024-04-13T10:59:15.327 INFO:tasks.workunit.client.0.smithi134.stdout:3/480: link dc/d27/d4d/d4f/d50/d25/d5f/c4e dc/d1d/c98 0 2024-04-13T10:59:15.328 INFO:tasks.workunit.client.0.smithi134.stdout:9/637: creat d13/d39/d64/db2/dd6/fe0 x:0 0 0 2024-04-13T10:59:15.337 INFO:tasks.workunit.client.0.smithi134.stdout:5/732: unlink dc/d1d/d20/l31 0 2024-04-13T10:59:15.341 INFO:tasks.workunit.client.0.smithi134.stdout:3/481: mkdir dc/d27/d4d/d4f/d50/d25/d5f/d99 0 2024-04-13T10:59:15.341 INFO:tasks.workunit.client.0.smithi134.stdout:9/638: mkdir d13/d2e/d35/d50/d59/d74/de1 0 2024-04-13T10:59:15.344 INFO:tasks.workunit.client.0.smithi134.stdout:2/480: truncate d5/d6/d57/d6c/d29/f46 74875 0 2024-04-13T10:59:15.350 INFO:tasks.workunit.client.0.smithi134.stdout:4/432: symlink d4/d82/l91 0 2024-04-13T10:59:15.352 INFO:tasks.workunit.client.0.smithi134.stdout:9/639: rename d13/d2e/d35/d50/d59/d74/de1 to d13/d39/d58/dd5/de2 0 2024-04-13T10:59:15.353 INFO:tasks.workunit.client.0.smithi134.stdout:9/640: write d13/d39/d52/d6b/fd8 [443968,39923] 0 2024-04-13T10:59:15.356 INFO:tasks.workunit.client.0.smithi134.stdout:3/482: creat dc/d27/d4d/d4f/d50/d25/d91/d93/f9a x:0 0 0 2024-04-13T10:59:15.357 INFO:tasks.workunit.client.0.smithi134.stdout:3/483: dread - dc/d27/d4d/f69 zero size 2024-04-13T10:59:15.357 INFO:tasks.workunit.client.0.smithi134.stdout:9/641: dread d13/d39/d52/d6b/fd8 [0,4194304] 0 2024-04-13T10:59:15.358 INFO:tasks.workunit.client.0.smithi134.stdout:3/484: chown dc/d1d/l30 63485 1 2024-04-13T10:59:15.358 INFO:tasks.workunit.client.0.smithi134.stdout:3/485: chown dc/d1d/l30 478993389 1 2024-04-13T10:59:15.363 INFO:tasks.workunit.client.0.smithi134.stdout:4/433: symlink d4/d1f/d27/d3a/d53/d58/d7f/l92 0 2024-04-13T10:59:15.368 INFO:tasks.workunit.client.0.smithi134.stdout:2/481: creat d5/d6/f8b x:0 0 0 2024-04-13T10:59:15.368 INFO:tasks.workunit.client.0.smithi134.stdout:2/482: fsync d5/de/f16 0 2024-04-13T10:59:15.372 INFO:tasks.workunit.client.0.smithi134.stdout:4/434: fsync d4/dd/d6d/d8c/f16 0 2024-04-13T10:59:15.373 INFO:tasks.workunit.client.0.smithi134.stdout:3/486: dread dc/fd [0,4194304] 0 2024-04-13T10:59:15.374 INFO:tasks.workunit.client.0.smithi134.stdout:3/487: chown dc/d27/d4d/d4f/d50/d25/d5f/d75/d97 31 1 2024-04-13T10:59:15.375 INFO:tasks.workunit.client.0.smithi134.stdout:9/642: mknod d13/d39/d58/ce3 0 2024-04-13T10:59:15.379 INFO:tasks.workunit.client.0.smithi134.stdout:8/617: write d8/dc/d16/d54/d6f/f90 [4372129,86761] 0 2024-04-13T10:59:15.380 INFO:tasks.workunit.client.0.smithi134.stdout:2/483: unlink d5/d6/d57/d6c/d29/c3e 0 2024-04-13T10:59:15.385 INFO:tasks.workunit.client.0.smithi134.stdout:3/488: rename dc/d27/d4d/d4f/d50/d25/d5f/d75/d97 to dc/d27/d19/d8b/d9b 0 2024-04-13T10:59:15.395 INFO:tasks.workunit.client.0.smithi134.stdout:8/618: dwrite d8/dc/d16/d54/f65 [0,4194304] 0 2024-04-13T10:59:15.396 INFO:tasks.workunit.client.0.smithi134.stdout:8/619: chown d8/dc/d16/d54/d6c/d94/dc1 518335 1 2024-04-13T10:59:15.398 INFO:tasks.workunit.client.0.smithi134.stdout:2/484: mknod d5/d6/d70/d84/c8c 0 2024-04-13T10:59:15.401 INFO:tasks.workunit.client.0.smithi134.stdout:4/435: creat d4/d48/d50/f93 x:0 0 0 2024-04-13T10:59:15.410 INFO:tasks.workunit.client.0.smithi134.stdout:8/620: mkdir d8/dc/d16/d54/d98/d9b/dd4 0 2024-04-13T10:59:15.413 INFO:tasks.workunit.client.0.smithi134.stdout:5/733: write dc/d1d/d2f/d3b/d7f/d8d/d7d/dc0/fc4 [2250962,94578] 0 2024-04-13T10:59:15.419 INFO:tasks.workunit.client.0.smithi134.stdout:4/436: mknod d4/d1f/d27/d75/d38/d79/d32/c94 0 2024-04-13T10:59:15.422 INFO:tasks.workunit.client.0.smithi134.stdout:4/437: fsync d4/d1f/f49 0 2024-04-13T10:59:15.422 INFO:tasks.workunit.client.0.smithi134.stdout:9/643: getdents d13/d40 0 2024-04-13T10:59:15.424 INFO:tasks.workunit.client.0.smithi134.stdout:5/734: write dc/d1d/d20/d23/d36/f80 [876158,80594] 0 2024-04-13T10:59:15.431 INFO:tasks.workunit.client.0.smithi134.stdout:4/438: dread - d4/dd/d6d/d8c/d5f/f77 zero size 2024-04-13T10:59:15.431 INFO:tasks.workunit.client.0.smithi134.stdout:5/735: chown dc/d15/l18 19680632 1 2024-04-13T10:59:15.432 INFO:tasks.workunit.client.0.smithi134.stdout:2/485: rename d5/d6/d57/d6f/d30/d58/d59/f61 to d5/d6/d57/d6f/d30/d58/d73/f8d 0 2024-04-13T10:59:15.435 INFO:tasks.workunit.client.0.smithi134.stdout:9/644: dread - d13/d39/d58/fbe zero size 2024-04-13T10:59:15.439 INFO:tasks.workunit.client.0.smithi134.stdout:5/736: rmdir dc/d1d/d67 39 2024-04-13T10:59:15.441 INFO:tasks.workunit.client.0.smithi134.stdout:8/621: dread d8/dc/d16/f1b [0,4194304] 0 2024-04-13T10:59:15.449 INFO:tasks.workunit.client.0.smithi134.stdout:8/622: creat d8/dc/d2c/fd5 x:0 0 0 2024-04-13T10:59:15.454 INFO:tasks.workunit.client.0.smithi134.stdout:9/645: symlink d13/d2e/le4 0 2024-04-13T10:59:15.457 INFO:tasks.workunit.client.0.smithi134.stdout:5/737: mknod dc/d1d/d67/d69/cef 0 2024-04-13T10:59:15.458 INFO:tasks.workunit.client.0.smithi134.stdout:5/738: write dc/d1d/d20/f87 [1904548,21686] 0 2024-04-13T10:59:15.465 INFO:tasks.workunit.client.0.smithi134.stdout:8/623: rename d8/ca to d8/dc/d16/d4e/d76/cd6 0 2024-04-13T10:59:15.466 INFO:tasks.workunit.client.0.smithi134.stdout:9/646: dwrite d13/f57 [0,4194304] 0 2024-04-13T10:59:15.469 INFO:tasks.workunit.client.0.smithi134.stdout:4/439: getdents d4/d1f/d27/d3a/d65 0 2024-04-13T10:59:15.470 INFO:tasks.workunit.client.0.smithi134.stdout:9/647: truncate d13/d39/d64/db2/dd6/fe0 870709 0 2024-04-13T10:59:15.477 INFO:tasks.workunit.client.0.smithi134.stdout:9/648: mkdir d13/d39/d58/dd5/de5 0 2024-04-13T10:59:15.478 INFO:tasks.workunit.client.0.smithi134.stdout:9/649: dread d13/d39/f62 [0,4194304] 0 2024-04-13T10:59:15.481 INFO:tasks.workunit.client.0.smithi134.stdout:5/739: getdents dc/d1d 0 2024-04-13T10:59:15.482 INFO:tasks.workunit.client.0.smithi134.stdout:5/740: write dc/d1d/d20/d23/f42 [431927,11546] 0 2024-04-13T10:59:15.485 INFO:tasks.workunit.client.0.smithi134.stdout:9/650: creat d13/da3/d98/db3/fe6 x:0 0 0 2024-04-13T10:59:15.486 INFO:tasks.workunit.client.0.smithi134.stdout:9/651: chown d13/d39/d58/dd5 1218 1 2024-04-13T10:59:15.495 INFO:tasks.workunit.client.0.smithi134.stdout:8/624: getdents d8/dc/d2c/d68/d8c 0 2024-04-13T10:59:15.498 INFO:tasks.workunit.client.0.smithi134.stdout:8/625: unlink d8/dc/d16/f1c 0 2024-04-13T10:59:15.500 INFO:tasks.workunit.client.0.smithi134.stdout:8/626: chown d8/dc/d16/f2d 564121 1 2024-04-13T10:59:15.500 INFO:tasks.workunit.client.0.smithi134.stdout:9/652: dwrite d13/d39/f62 [0,4194304] 0 2024-04-13T10:59:15.501 INFO:tasks.workunit.client.0.smithi134.stdout:8/627: readlink d8/dc/d37/l6e 0 2024-04-13T10:59:15.502 INFO:tasks.workunit.client.0.smithi134.stdout:9/653: dread - d13/d39/d52/d6b/fc5 zero size 2024-04-13T10:59:15.506 INFO:tasks.workunit.client.0.smithi134.stdout:9/654: mkdir d13/d2e/d47/de7 0 2024-04-13T10:59:15.506 INFO:tasks.workunit.client.0.smithi134.stdout:9/655: stat d13/l25 0 2024-04-13T10:59:15.507 INFO:tasks.workunit.client.0.smithi134.stdout:6/618: sync 2024-04-13T10:59:15.510 INFO:tasks.workunit.client.0.smithi134.stdout:3/489: write dc/d27/d4d/d4f/d50/d25/f47 [121219,12768] 0 2024-04-13T10:59:15.514 INFO:tasks.workunit.client.0.smithi134.stdout:6/619: getdents d4/da/d15/d1f/d24/d49 0 2024-04-13T10:59:15.516 INFO:tasks.workunit.client.0.smithi134.stdout:3/490: creat dc/d27/d19/d48/d8e/f9c x:0 0 0 2024-04-13T10:59:15.517 INFO:tasks.workunit.client.0.smithi134.stdout:6/620: readlink d4/da/d1a/l31 0 2024-04-13T10:59:15.526 INFO:tasks.workunit.client.0.smithi134.stdout:9/656: dread f6 [0,4194304] 0 2024-04-13T10:59:15.530 INFO:tasks.workunit.client.0.smithi134.stdout:3/491: dwrite dc/f55 [0,4194304] 0 2024-04-13T10:59:15.540 INFO:tasks.workunit.client.0.smithi134.stdout:2/486: dwrite d5/d6/d57/d6c/f28 [0,4194304] 0 2024-04-13T10:59:15.555 INFO:tasks.workunit.client.0.smithi134.stdout:2/487: creat d5/d6/d57/d6f/d30/d58/d59/f8e x:0 0 0 2024-04-13T10:59:15.556 INFO:tasks.workunit.client.0.smithi134.stdout:2/488: chown d5/c7 305499811 1 2024-04-13T10:59:15.557 INFO:tasks.workunit.client.0.smithi134.stdout:9/657: mknod d13/d39/d52/d86/d9f/ce8 0 2024-04-13T10:59:15.558 INFO:tasks.workunit.client.0.smithi134.stdout:4/440: truncate d4/d1f/d27/d75/d38/d79/d32/f74 160366 0 2024-04-13T10:59:15.560 INFO:tasks.workunit.client.0.smithi134.stdout:9/658: read - d13/d39/d58/fbe zero size 2024-04-13T10:59:15.560 INFO:tasks.workunit.client.0.smithi134.stdout:6/621: rename d4/da/d15/d76/f7c to d4/da/d15/d1f/d3c/fcd 0 2024-04-13T10:59:15.561 INFO:tasks.workunit.client.0.smithi134.stdout:3/492: dwrite dc/d27/d4d/d4f/d50/f2d [0,4194304] 0 2024-04-13T10:59:15.562 INFO:tasks.workunit.client.0.smithi134.stdout:3/493: readlink dc/d27/l3d 0 2024-04-13T10:59:15.563 INFO:tasks.workunit.client.0.smithi134.stdout:4/441: truncate d4/dd/d6d/d8c/d5f/f77 1042329 0 2024-04-13T10:59:15.565 INFO:tasks.workunit.client.0.smithi134.stdout:2/489: rename d5/de/d55 to d5/de/d2e/d8f 0 2024-04-13T10:59:15.566 INFO:tasks.workunit.client.0.smithi134.stdout:9/659: write d13/d2e/d35/d50/d59/fbc [440940,57698] 0 2024-04-13T10:59:15.569 INFO:tasks.workunit.client.0.smithi134.stdout:3/494: truncate dc/d27/d4d/d4f/d50/d25/f3e 4509128 0 2024-04-13T10:59:15.570 INFO:tasks.workunit.client.0.smithi134.stdout:9/660: chown d13/d39/d58/dd5/de5 424559035 1 2024-04-13T10:59:15.572 INFO:tasks.workunit.client.0.smithi134.stdout:9/661: dread - d13/d39/d52/d6b/fc5 zero size 2024-04-13T10:59:15.574 INFO:tasks.workunit.client.0.smithi134.stdout:3/495: write dc/f64 [643412,13142] 0 2024-04-13T10:59:15.575 INFO:tasks.workunit.client.0.smithi134.stdout:5/741: dwrite dc/d1d/d20/f2d [0,4194304] 0 2024-04-13T10:59:15.577 INFO:tasks.workunit.client.0.smithi134.stdout:8/628: write d8/dc/f3e [450390,101123] 0 2024-04-13T10:59:15.586 INFO:tasks.workunit.client.0.smithi134.stdout:8/629: creat d8/dc/d2c/d68/d8c/d8f/fd7 x:0 0 0 2024-04-13T10:59:15.588 INFO:tasks.workunit.client.0.smithi134.stdout:9/662: dwrite d13/d39/d52/fa4 [0,4194304] 0 2024-04-13T10:59:15.588 INFO:tasks.workunit.client.0.smithi134.stdout:5/742: rename dc/d1d/d20/d23/f55 to dc/d1d/d2f/d3b/d6a/ff0 0 2024-04-13T10:59:15.590 INFO:tasks.workunit.client.0.smithi134.stdout:9/663: chown d13/d2e/d35/d50/d59/c97 111 1 2024-04-13T10:59:15.590 INFO:tasks.workunit.client.0.smithi134.stdout:3/496: link dc/d27/d4d/f69 dc/d27/f9d 0 2024-04-13T10:59:15.593 INFO:tasks.workunit.client.0.smithi134.stdout:8/630: write d8/dc/d16/d4e/d76/f79 [2059685,50845] 0 2024-04-13T10:59:15.594 INFO:tasks.workunit.client.0.smithi134.stdout:8/631: stat d8/dc/d9d/fa8 0 2024-04-13T10:59:15.594 INFO:tasks.workunit.client.0.smithi134.stdout:9/664: creat d13/d2e/d35/d50/fe9 x:0 0 0 2024-04-13T10:59:15.596 INFO:tasks.workunit.client.0.smithi134.stdout:3/497: creat dc/d27/d81/f9e x:0 0 0 2024-04-13T10:59:15.599 INFO:tasks.workunit.client.0.smithi134.stdout:5/743: truncate dc/d1d/d2f/d3b/f53 912774 0 2024-04-13T10:59:15.599 INFO:tasks.workunit.client.0.smithi134.stdout:5/744: chown dc/l4f 0 1 2024-04-13T10:59:15.600 INFO:tasks.workunit.client.0.smithi134.stdout:8/632: creat d8/dc/d9d/d69/fd8 x:0 0 0 2024-04-13T10:59:15.601 INFO:tasks.workunit.client.0.smithi134.stdout:8/633: fdatasync d8/dc/f29 0 2024-04-13T10:59:15.603 INFO:tasks.workunit.client.0.smithi134.stdout:3/498: truncate dc/d1d/d58/f5d 849874 0 2024-04-13T10:59:15.606 INFO:tasks.workunit.client.0.smithi134.stdout:4/442: dread d4/d1f/d27/d75/d38/d79/d32/f74 [0,4194304] 0 2024-04-13T10:59:15.610 INFO:tasks.workunit.client.0.smithi134.stdout:9/665: link d13/d2e/d35/d50/d59/c97 d13/d39/d64/db2/cea 0 2024-04-13T10:59:15.611 INFO:tasks.workunit.client.0.smithi134.stdout:6/622: truncate d4/da/d15/d1f/d3c/f5e 1424455 0 2024-04-13T10:59:15.612 INFO:tasks.workunit.client.0.smithi134.stdout:9/666: dread - d13/d39/d52/d6b/fd4 zero size 2024-04-13T10:59:15.614 INFO:tasks.workunit.client.0.smithi134.stdout:3/499: dwrite dc/d27/d19/f3b [0,4194304] 0 2024-04-13T10:59:15.616 INFO:tasks.workunit.client.0.smithi134.stdout:6/623: mknod d4/da/d15/d77/cce 0 2024-04-13T10:59:15.617 INFO:tasks.workunit.client.0.smithi134.stdout:9/667: chown d13/d39/c9b 4988 1 2024-04-13T10:59:15.619 INFO:tasks.workunit.client.0.smithi134.stdout:3/500: rename dc/d27/d4d/d4f/d50/f53 to dc/d27/d19/d8b/d9b/f9f 0 2024-04-13T10:59:15.620 INFO:tasks.workunit.client.0.smithi134.stdout:6/624: creat d4/da/d1a/fcf x:0 0 0 2024-04-13T10:59:15.622 INFO:tasks.workunit.client.0.smithi134.stdout:9/668: mknod d13/da3/d98/ceb 0 2024-04-13T10:59:15.626 INFO:tasks.workunit.client.0.smithi134.stdout:3/501: creat dc/d27/d4d/d4f/d50/d25/d5f/d75/d8f/fa0 x:0 0 0 2024-04-13T10:59:15.628 INFO:tasks.workunit.client.0.smithi134.stdout:6/625: mkdir d4/da/d15/d1f/d3c/dd0 0 2024-04-13T10:59:15.633 INFO:tasks.workunit.client.0.smithi134.stdout:3/502: dread dc/d1d/d58/f60 [0,4194304] 0 2024-04-13T10:59:15.638 INFO:tasks.workunit.client.0.smithi134.stdout:9/669: getdents d13/d40/d7d 0 2024-04-13T10:59:15.640 INFO:tasks.workunit.client.0.smithi134.stdout:4/443: dwrite d4/d1f/d27/d3a/d53/d58/f81 [0,4194304] 0 2024-04-13T10:59:15.642 INFO:tasks.workunit.client.0.smithi134.stdout:6/626: write d4/da/d15/f8a [2156610,9341] 0 2024-04-13T10:59:15.647 INFO:tasks.workunit.client.0.smithi134.stdout:4/444: rename d4/d1f/d27/d75/c71 to d4/dd/d6d/d8c/d5f/c95 0 2024-04-13T10:59:15.649 INFO:tasks.workunit.client.0.smithi134.stdout:6/627: readlink d4/da/d1a/lc6 0 2024-04-13T10:59:15.649 INFO:tasks.workunit.client.0.smithi134.stdout:3/503: write dc/d27/f52 [696385,53614] 0 2024-04-13T10:59:15.650 INFO:tasks.workunit.client.0.smithi134.stdout:9/670: mknod d13/d2e/cec 0 2024-04-13T10:59:15.654 INFO:tasks.workunit.client.0.smithi134.stdout:4/445: symlink d4/d1f/d27/d75/l96 0 2024-04-13T10:59:15.657 INFO:tasks.workunit.client.0.smithi134.stdout:4/446: mknod d4/d1f/d27/d75/d38/d79/d73/c97 0 2024-04-13T10:59:15.659 INFO:tasks.workunit.client.0.smithi134.stdout:4/447: truncate d4/dd/d6d/d8c/d5f/f77 1243791 0 2024-04-13T10:59:15.659 INFO:tasks.workunit.client.0.smithi134.stdout:6/628: rename d4/da/d15/d1f/l46 to d4/da/d15/d76/d8e/da1/dc4/ld1 0 2024-04-13T10:59:15.660 INFO:tasks.workunit.client.0.smithi134.stdout:6/629: chown d4/da/dbb/fbc 13590 1 2024-04-13T10:59:15.661 INFO:tasks.workunit.client.0.smithi134.stdout:9/671: link d13/d39/f3b d13/d39/d52/da2/fed 0 2024-04-13T10:59:15.666 INFO:tasks.workunit.client.0.smithi134.stdout:4/448: truncate d4/d1f/d27/d75/d38/f41 182458 0 2024-04-13T10:59:15.667 INFO:tasks.workunit.client.0.smithi134.stdout:9/672: rmdir d13/d39/d58/d5f/dac 39 2024-04-13T10:59:15.668 INFO:tasks.workunit.client.0.smithi134.stdout:6/630: truncate d4/da/d15/d1f/f6b 4578874 0 2024-04-13T10:59:15.668 INFO:tasks.workunit.client.0.smithi134.stdout:6/631: chown d4/da/d15/d1f/f4b 1982173 1 2024-04-13T10:59:15.669 INFO:tasks.workunit.client.0.smithi134.stdout:3/504: getdents dc/d27/d4d/d4f/d50/d25/d5f/d75/d8f 0 2024-04-13T10:59:15.669 INFO:tasks.workunit.client.0.smithi134.stdout:4/449: read - d4/d1f/d27/d3a/f6a zero size 2024-04-13T10:59:15.672 INFO:tasks.workunit.client.0.smithi134.stdout:3/505: mknod dc/d27/d4d/d4f/d50/d25/d5f/d75/d8f/ca1 0 2024-04-13T10:59:15.680 INFO:tasks.workunit.client.0.smithi134.stdout:4/450: rename d4/d48/f4c to d4/d48/d50/f98 0 2024-04-13T10:59:15.681 INFO:tasks.workunit.client.0.smithi134.stdout:4/451: rename d4 to d4/d1f/d27/d2e/d99 22 2024-04-13T10:59:15.681 INFO:tasks.workunit.client.0.smithi134.stdout:3/506: creat dc/fa2 x:0 0 0 2024-04-13T10:59:15.682 INFO:tasks.workunit.client.0.smithi134.stdout:3/507: fsync dc/f71 0 2024-04-13T10:59:15.683 INFO:tasks.workunit.client.0.smithi134.stdout:9/673: dwrite d13/d39/f4d [0,4194304] 0 2024-04-13T10:59:15.683 INFO:tasks.workunit.client.0.smithi134.stdout:4/452: chown d4/d1f/d27/d2e/f5c 5365 1 2024-04-13T10:59:15.693 INFO:tasks.workunit.client.0.smithi134.stdout:3/508: getdents dc/d27/d19/d48/d77 0 2024-04-13T10:59:15.694 INFO:tasks.workunit.client.0.smithi134.stdout:4/453: write d4/d48/f5a [3416505,38448] 0 2024-04-13T10:59:15.703 INFO:tasks.workunit.client.0.smithi134.stdout:3/509: dwrite dc/d27/d4d/d4f/d50/d25/f3e [4194304,4194304] 0 2024-04-13T10:59:15.707 INFO:tasks.workunit.client.0.smithi134.stdout:9/674: dwrite d13/d39/d58/d5f/f8e [0,4194304] 0 2024-04-13T10:59:15.710 INFO:tasks.workunit.client.0.smithi134.stdout:4/454: dwrite d4/f61 [0,4194304] 0 2024-04-13T10:59:15.712 INFO:tasks.workunit.client.0.smithi134.stdout:4/455: readlink d4/d1f/d27/d75/l96 0 2024-04-13T10:59:15.712 INFO:tasks.workunit.client.0.smithi134.stdout:9/675: mknod d13/da3/cee 0 2024-04-13T10:59:15.717 INFO:tasks.workunit.client.0.smithi134.stdout:4/456: creat d4/d48/d4a/d7e/f9a x:0 0 0 2024-04-13T10:59:15.718 INFO:tasks.workunit.client.0.smithi134.stdout:9/676: chown d13/f2d 3 1 2024-04-13T10:59:15.724 INFO:tasks.workunit.client.0.smithi134.stdout:9/677: link d13/d39/d58/ce3 d13/d2e/d35/d50/cef 0 2024-04-13T10:59:15.725 INFO:tasks.workunit.client.0.smithi134.stdout:9/678: stat d13/d39/d64/l70 0 2024-04-13T10:59:15.726 INFO:tasks.workunit.client.0.smithi134.stdout:3/510: dread dc/d27/d19/f36 [0,4194304] 0 2024-04-13T10:59:15.729 INFO:tasks.workunit.client.0.smithi134.stdout:9/679: rename d13/f4c to d13/d2e/d35/ff0 0 2024-04-13T10:59:15.729 INFO:tasks.workunit.client.0.smithi134.stdout:3/511: read dc/d27/d4d/d4f/d50/d25/f3e [3363402,94831] 0 2024-04-13T10:59:15.730 INFO:tasks.workunit.client.0.smithi134.stdout:9/680: write d13/d39/d64/f93 [239084,30014] 0 2024-04-13T10:59:15.732 INFO:tasks.workunit.client.0.smithi134.stdout:3/512: write dc/d1d/d58/d72/f87 [521742,76803] 0 2024-04-13T10:59:15.732 INFO:tasks.workunit.client.0.smithi134.stdout:9/681: fsync d13/d39/d58/d5f/dbb/fcd 0 2024-04-13T10:59:15.734 INFO:tasks.workunit.client.0.smithi134.stdout:9/682: fsync d13/d2e/d47/fc4 0 2024-04-13T10:59:15.740 INFO:tasks.workunit.client.0.smithi134.stdout:9/683: rename d13/d39/d52/d71/l87 to d13/d2e/d35/lf1 0 2024-04-13T10:59:15.745 INFO:tasks.workunit.client.0.smithi134.stdout:9/684: rename d13/d39/d58/fbe to d13/d2e/d47/dc1/ff2 0 2024-04-13T10:59:15.746 INFO:tasks.workunit.client.0.smithi134.stdout:3/513: dread dc/d27/d19/d8b/d9b/f6b [0,4194304] 0 2024-04-13T10:59:15.747 INFO:tasks.workunit.client.0.smithi134.stdout:4/457: dread d4/d1f/d27/d75/d38/d79/d32/f7c [0,4194304] 0 2024-04-13T10:59:15.748 INFO:tasks.workunit.client.0.smithi134.stdout:3/514: chown dc/d27/d4d/d4f/d50/d25/c96 3 1 2024-04-13T10:59:15.748 INFO:tasks.workunit.client.0.smithi134.stdout:3/515: chown dc/d27/f52 39 1 2024-04-13T10:59:15.752 INFO:tasks.workunit.client.0.smithi134.stdout:3/516: symlink dc/la3 0 2024-04-13T10:59:15.759 INFO:tasks.workunit.client.0.smithi134.stdout:9/685: dread d13/d2e/d35/d50/d59/fb5 [0,4194304] 0 2024-04-13T10:59:15.760 INFO:tasks.workunit.client.0.smithi134.stdout:3/517: write dc/d1d/d58/f5d [972469,114218] 0 2024-04-13T10:59:15.762 INFO:tasks.workunit.client.0.smithi134.stdout:4/458: dwrite d4/d1f/d27/d75/d38/f41 [0,4194304] 0 2024-04-13T10:59:15.764 INFO:tasks.workunit.client.0.smithi134.stdout:9/686: symlink d13/d2e/d35/d50/d59/lf3 0 2024-04-13T10:59:15.767 INFO:tasks.workunit.client.0.smithi134.stdout:9/687: write d13/d39/d64/db2/fd9 [609915,44106] 0 2024-04-13T10:59:15.771 INFO:tasks.workunit.client.0.smithi134.stdout:3/518: dwrite dc/d27/d19/d8b/f90 [0,4194304] 0 2024-04-13T10:59:15.774 INFO:tasks.workunit.client.0.smithi134.stdout:9/688: getdents d13/d39/d52/d86/d9f/db0 0 2024-04-13T10:59:15.778 INFO:tasks.workunit.client.0.smithi134.stdout:4/459: dwrite d4/d1f/d27/d75/d38/d79/f1c [0,4194304] 0 2024-04-13T10:59:15.780 INFO:tasks.workunit.client.0.smithi134.stdout:9/689: rmdir d13/d39/d58/d5f 39 2024-04-13T10:59:15.782 INFO:tasks.workunit.client.0.smithi134.stdout:4/460: dread d4/dd/d6d/d8c/d5f/f77 [0,4194304] 0 2024-04-13T10:59:15.783 INFO:tasks.workunit.client.0.smithi134.stdout:3/519: rename dc/d1d/d58/d72/l80 to dc/d27/d4d/la4 0 2024-04-13T10:59:15.785 INFO:tasks.workunit.client.0.smithi134.stdout:3/520: write dc/d27/d4d/d4f/d50/d25/d91/d93/f9a [217820,487] 0 2024-04-13T10:59:15.786 INFO:tasks.workunit.client.0.smithi134.stdout:9/690: creat d13/d39/d58/dd5/de5/ff4 x:0 0 0 2024-04-13T10:59:15.787 INFO:tasks.workunit.client.0.smithi134.stdout:3/521: chown dc/d1d/f39 74774 1 2024-04-13T10:59:15.787 INFO:tasks.workunit.client.0.smithi134.stdout:4/461: mkdir d4/d1f/d27/d75/d38/d79/d32/d67/d9b 0 2024-04-13T10:59:15.788 INFO:tasks.workunit.client.0.smithi134.stdout:9/691: fsync fd 0 2024-04-13T10:59:15.789 INFO:tasks.workunit.client.0.smithi134.stdout:4/462: symlink d4/d48/d4a/d7e/l9c 0 2024-04-13T10:59:15.790 INFO:tasks.workunit.client.0.smithi134.stdout:9/692: truncate d13/d2e/d35/d50/fcc 945841 0 2024-04-13T10:59:15.793 INFO:tasks.workunit.client.0.smithi134.stdout:9/693: write d13/d39/d58/d5f/dbb/fcd [229630,127714] 0 2024-04-13T10:59:15.794 INFO:tasks.workunit.client.0.smithi134.stdout:4/463: creat d4/d1f/d27/d75/d38/d79/d32/d67/d9b/f9d x:0 0 0 2024-04-13T10:59:15.795 INFO:tasks.workunit.client.0.smithi134.stdout:9/694: mknod d13/d39/d52/d71/cf5 0 2024-04-13T10:59:15.796 INFO:tasks.workunit.client.0.smithi134.stdout:9/695: dread - d13/d2e/fca zero size 2024-04-13T10:59:15.797 INFO:tasks.workunit.client.0.smithi134.stdout:9/696: chown d13/d2e/d47/de7 711 1 2024-04-13T10:59:15.798 INFO:tasks.workunit.client.0.smithi134.stdout:3/522: read dc/d27/d4d/d4f/d50/d25/d91/d93/f9a [76283,115457] 0 2024-04-13T10:59:15.801 INFO:tasks.workunit.client.0.smithi134.stdout:4/464: dwrite d4/d48/f72 [0,4194304] 0 2024-04-13T10:59:15.803 INFO:tasks.workunit.client.0.smithi134.stdout:3/523: creat dc/d27/d19/d8b/d9b/fa5 x:0 0 0 2024-04-13T10:59:15.804 INFO:tasks.workunit.client.0.smithi134.stdout:3/524: write dc/d27/d19/d48/d8e/f92 [936933,66562] 0 2024-04-13T10:59:15.808 INFO:tasks.workunit.client.0.smithi134.stdout:3/525: symlink dc/d27/d4d/d4f/d50/la6 0 2024-04-13T10:59:15.810 INFO:tasks.workunit.client.0.smithi134.stdout:9/697: write d13/d39/f4e [1099783,14167] 0 2024-04-13T10:59:15.817 INFO:tasks.workunit.client.0.smithi134.stdout:9/698: symlink d13/d39/lf6 0 2024-04-13T10:59:15.819 INFO:tasks.workunit.client.0.smithi134.stdout:4/465: dwrite d4/dd/d6d/d8c/d5f/f77 [0,4194304] 0 2024-04-13T10:59:15.820 INFO:tasks.workunit.client.0.smithi134.stdout:3/526: dwrite dc/d27/d19/d8b/d9b/f9f [0,4194304] 0 2024-04-13T10:59:15.821 INFO:tasks.workunit.client.0.smithi134.stdout:3/527: readlink dc/d1d/l30 0 2024-04-13T10:59:15.823 INFO:tasks.workunit.client.0.smithi134.stdout:3/528: read dc/d1d/f28 [229232,30593] 0 2024-04-13T10:59:15.824 INFO:tasks.workunit.client.0.smithi134.stdout:3/529: chown dc/f10 891798 1 2024-04-13T10:59:15.825 INFO:tasks.workunit.client.0.smithi134.stdout:9/699: link d13/d2e/d35/d50/cd2 d13/cf7 0 2024-04-13T10:59:15.829 INFO:tasks.workunit.client.0.smithi134.stdout:4/466: truncate d4/d1f/d27/d75/d38/d79/f35 926086 0 2024-04-13T10:59:15.829 INFO:tasks.workunit.client.0.smithi134.stdout:3/530: creat dc/d2a/fa7 x:0 0 0 2024-04-13T10:59:15.830 INFO:tasks.workunit.client.0.smithi134.stdout:9/700: read - d13/d39/d58/d5f/d6e/fda zero size 2024-04-13T10:59:15.835 INFO:tasks.workunit.client.0.smithi134.stdout:3/531: read dc/d2a/f56 [2076046,107278] 0 2024-04-13T10:59:15.837 INFO:tasks.workunit.client.0.smithi134.stdout:3/532: rmdir dc/d27/d19/d48/d49 39 2024-04-13T10:59:15.838 INFO:tasks.workunit.client.0.smithi134.stdout:4/467: getdents d4/d1f/d27/d75/d38/d79/d73 0 2024-04-13T10:59:15.838 INFO:tasks.workunit.client.0.smithi134.stdout:3/533: chown dc/d27/d81 8137615 1 2024-04-13T10:59:15.840 INFO:tasks.workunit.client.0.smithi134.stdout:9/701: dwrite d13/d40/d7d/f7f [0,4194304] 0 2024-04-13T10:59:15.842 INFO:tasks.workunit.client.0.smithi134.stdout:1/689: sync 2024-04-13T10:59:15.849 INFO:tasks.workunit.client.0.smithi134.stdout:4/468: rename d4/d1f/d27/d75/d38/d79/d32/d67/f70 to d4/d1f/d27/d75/d38/f9e 0 2024-04-13T10:59:15.851 INFO:tasks.workunit.client.0.smithi134.stdout:9/702: mknod d13/d39/d58/d5f/dbb/cf8 0 2024-04-13T10:59:15.855 INFO:tasks.workunit.client.0.smithi134.stdout:3/534: write dc/d27/d4d/d4f/f68 [431328,28313] 0 2024-04-13T10:59:15.856 INFO:tasks.workunit.client.0.smithi134.stdout:4/469: unlink d4/d1f/d27/d75/l96 0 2024-04-13T10:59:15.860 INFO:tasks.workunit.client.0.smithi134.stdout:4/470: symlink d4/d1f/d56/l9f 0 2024-04-13T10:59:15.860 INFO:tasks.workunit.client.0.smithi134.stdout:3/535: write dc/fd [1071823,101846] 0 2024-04-13T10:59:15.862 INFO:tasks.workunit.client.0.smithi134.stdout:1/690: dwrite d3/d6/f27 [0,4194304] 0 2024-04-13T10:59:15.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/536: truncate dc/d27/d81/f9e 205796 0 2024-04-13T10:59:15.864 INFO:tasks.workunit.client.0.smithi134.stdout:4/471: chown d4/d1f/d27/d75/d38/d79/d73/c97 208 1 2024-04-13T10:59:15.865 INFO:tasks.workunit.client.0.smithi134.stdout:1/691: fsync d3/d6/d20/d6d/db1/f9a 0 2024-04-13T10:59:15.865 INFO:tasks.workunit.client.0.smithi134.stdout:4/472: readlink d4/d48/d4a/l5d 0 2024-04-13T10:59:15.865 INFO:tasks.workunit.client.0.smithi134.stdout:3/537: dread - dc/d27/d4d/d4f/d50/d25/f82 zero size 2024-04-13T10:59:15.866 INFO:tasks.workunit.client.0.smithi134.stdout:1/692: dread - d3/d6/d16/d1d/fd9 zero size 2024-04-13T10:59:15.866 INFO:tasks.workunit.client.0.smithi134.stdout:3/538: dread - dc/d27/f9d zero size 2024-04-13T10:59:15.869 INFO:tasks.workunit.client.0.smithi134.stdout:4/473: dread d4/d1f/d27/d75/f52 [0,4194304] 0 2024-04-13T10:59:15.872 INFO:tasks.workunit.client.0.smithi134.stdout:4/474: stat d4/d1f/d27/d3a/d53/d58/d7f 0 2024-04-13T10:59:15.872 INFO:tasks.workunit.client.0.smithi134.stdout:1/693: mkdir d3/d6/d16/d1d/d68/de2 0 2024-04-13T10:59:15.875 INFO:tasks.workunit.client.0.smithi134.stdout:4/475: readlink d4/d1f/d27/d3a/d53/d58/d7f/l92 0 2024-04-13T10:59:15.877 INFO:tasks.workunit.client.0.smithi134.stdout:3/539: dwrite dc/d1d/d58/d72/f87 [0,4194304] 0 2024-04-13T10:59:15.878 INFO:tasks.workunit.client.0.smithi134.stdout:1/694: mkdir d3/d6/de3 0 2024-04-13T10:59:15.883 INFO:tasks.workunit.client.0.smithi134.stdout:3/540: read dc/d27/d4d/d4f/d50/f20 [3874754,32222] 0 2024-04-13T10:59:15.884 INFO:tasks.workunit.client.0.smithi134.stdout:4/476: dwrite d4/d48/f72 [4194304,4194304] 0 2024-04-13T10:59:15.892 INFO:tasks.workunit.client.0.smithi134.stdout:3/541: dread dc/d1d/d58/f5d [0,4194304] 0 2024-04-13T10:59:15.895 INFO:tasks.workunit.client.0.smithi134.stdout:4/477: dread d4/d1f/d27/d75/d38/d79/d32/f3b [0,4194304] 0 2024-04-13T10:59:15.896 INFO:tasks.workunit.client.0.smithi134.stdout:3/542: rename dc/d27/d4d/d4f to dc/d27/d19/d8b/da8 0 2024-04-13T10:59:15.898 INFO:tasks.workunit.client.0.smithi134.stdout:4/478: mkdir d4/d48/d50/da0 0 2024-04-13T10:59:15.907 INFO:tasks.workunit.client.0.smithi134.stdout:1/695: dread d3/d6/f55 [0,4194304] 0 2024-04-13T10:59:15.908 INFO:tasks.workunit.client.0.smithi134.stdout:1/696: chown d3/d6/d16/d1d/f22 7767 1 2024-04-13T10:59:15.912 INFO:tasks.workunit.client.0.smithi134.stdout:4/479: dread d4/d48/f5a [0,4194304] 0 2024-04-13T10:59:16.028 INFO:tasks.workunit.client.0.smithi134.stdout:3/543: dwrite dc/d27/d4d/f69 [0,4194304] 0 2024-04-13T10:59:16.028 INFO:tasks.workunit.client.0.smithi134.stdout:4/480: getdents d4/d1f/d27/d3a/d53/d58/d7f 0 2024-04-13T10:59:16.039 INFO:tasks.workunit.client.0.smithi134.stdout:3/544: link dc/d27/d4d/la4 dc/d27/d19/d8b/da8/la9 0 2024-04-13T10:59:16.040 INFO:tasks.workunit.client.0.smithi134.stdout:3/545: readlink dc/d27/d19/l7f 0 2024-04-13T10:59:16.042 INFO:tasks.workunit.client.0.smithi134.stdout:4/481: dread d4/f2a [0,4194304] 0 2024-04-13T10:59:16.045 INFO:tasks.workunit.client.0.smithi134.stdout:4/482: unlink d4/d48/d50/f93 0 2024-04-13T10:59:16.048 INFO:tasks.workunit.client.0.smithi134.stdout:4/483: creat d4/d1f/d27/d75/d38/fa1 x:0 0 0 2024-04-13T10:59:16.049 INFO:tasks.workunit.client.0.smithi134.stdout:4/484: fsync d4/d1f/d27/d75/d38/d79/f1c 0 2024-04-13T10:59:16.050 INFO:tasks.workunit.client.0.smithi134.stdout:4/485: fsync d4/d1f/d27/d75/f68 0 2024-04-13T10:59:16.057 INFO:tasks.workunit.client.0.smithi134.stdout:4/486: dwrite d4/d48/d50/f98 [0,4194304] 0 2024-04-13T10:59:16.061 INFO:tasks.workunit.client.0.smithi134.stdout:4/487: creat d4/d1f/d90/fa2 x:0 0 0 2024-04-13T10:59:16.062 INFO:tasks.workunit.client.0.smithi134.stdout:4/488: read - d4/d1f/d27/d3a/d65/f66 zero size 2024-04-13T10:59:16.066 INFO:tasks.workunit.client.0.smithi134.stdout:4/489: unlink d4/dd/d6d/d8c/d5f/f77 0 2024-04-13T10:59:16.067 INFO:tasks.workunit.client.0.smithi134.stdout:4/490: readlink d4/d1f/d27/d3a/d53/d58/d7f/l92 0 2024-04-13T10:59:16.073 INFO:tasks.workunit.client.0.smithi134.stdout:4/491: dwrite d4/d1f/d90/fa2 [0,4194304] 0 2024-04-13T10:59:16.097 INFO:tasks.workunit.client.0.smithi134.stdout:0/584: sync 2024-04-13T10:59:16.099 INFO:tasks.workunit.client.0.smithi134.stdout:4/492: dwrite d4/d1f/d27/d75/d38/d79/f8b [4194304,4194304] 0 2024-04-13T10:59:16.239 INFO:tasks.workunit.client.0.smithi134.stdout:4/493: symlink d4/d1f/d56/la3 0 2024-04-13T10:59:16.243 INFO:tasks.workunit.client.0.smithi134.stdout:4/494: creat d4/dd/d6d/d8c/d5f/fa4 x:0 0 0 2024-04-13T10:59:16.250 INFO:tasks.workunit.client.0.smithi134.stdout:0/585: getdents d4/d17/d23/d51/d6a 0 2024-04-13T10:59:16.251 INFO:tasks.workunit.client.0.smithi134.stdout:0/586: fsync d4/d17/f4a 0 2024-04-13T10:59:16.256 INFO:tasks.workunit.client.0.smithi134.stdout:0/587: creat d4/d17/d20/d29/d30/fd6 x:0 0 0 2024-04-13T10:59:16.261 INFO:tasks.workunit.client.0.smithi134.stdout:0/588: unlink d4/d17/da/d22/d41/d6e/d8a/d95/cbc 0 2024-04-13T10:59:16.264 INFO:tasks.workunit.client.0.smithi134.stdout:0/589: mknod d4/d17/da/d22/d37/d6d/d97/d9c/cd7 0 2024-04-13T10:59:16.268 INFO:tasks.workunit.client.0.smithi134.stdout:0/590: rename d4/d17/d23/d51/f9d to d4/d17/d20/d29/d30/d7f/dc0/fd8 0 2024-04-13T10:59:16.273 INFO:tasks.workunit.client.0.smithi134.stdout:0/591: dread d4/d17/da/d22/d37/d6d/d97/d9c/dcf/d96/f9a [0,4194304] 0 2024-04-13T10:59:16.280 INFO:tasks.workunit.client.0.smithi134.stdout:0/592: dwrite d4/d17/d23/d51/d6b/fcc [0,4194304] 0 2024-04-13T10:59:16.282 INFO:tasks.workunit.client.0.smithi134.stdout:0/593: fsync d4/d17/d23/d51/d6a/d94/db2/fc4 0 2024-04-13T10:59:16.287 INFO:tasks.workunit.client.0.smithi134.stdout:0/594: mkdir d4/d17/da/d22/d37/d6d/da5/dd9 0 2024-04-13T10:59:16.292 INFO:tasks.workunit.client.0.smithi134.stdout:0/595: creat d4/d17/da/d22/d37/d6d/d97/d9c/dcf/d96/dd5/fda x:0 0 0 2024-04-13T10:59:16.295 INFO:tasks.workunit.client.0.smithi134.stdout:0/596: creat d4/d17/d23/d51/d6b/d91/d98/d62/d7c/fdb x:0 0 0 2024-04-13T10:59:16.297 INFO:tasks.workunit.client.0.smithi134.stdout:0/597: chown d4/d17/da/d22/d37/d6d/da5/fab 6581 1 2024-04-13T10:59:16.298 INFO:tasks.workunit.client.0.smithi134.stdout:0/598: stat d4/d17/da/d22/d37/d6d/d97/d9c/dcf 0 2024-04-13T10:59:16.307 INFO:tasks.workunit.client.0.smithi134.stdout:0/599: creat d4/d17/da/d22/d37/d6d/d97/d9c/dcf/d9e/d78/fdc x:0 0 0 2024-04-13T10:59:16.310 INFO:tasks.workunit.client.0.smithi134.stdout:0/600: symlink d4/d17/d20/d29/dcd/ldd 0 2024-04-13T10:59:16.310 INFO:tasks.workunit.client.0.smithi134.stdout:0/601: fsync d4/d17/da/f27 0 2024-04-13T10:59:16.314 INFO:tasks.workunit.client.0.smithi134.stdout:0/602: symlink d4/d17/da/d22/d37/d6d/d97/d9c/dcf/d96/lde 0 2024-04-13T10:59:16.324 INFO:tasks.workunit.client.0.smithi134.stdout:4/495: write d4/d1f/d27/d75/d38/d79/f35 [1834707,78277] 0 2024-04-13T10:59:16.332 INFO:tasks.workunit.client.0.smithi134.stdout:4/496: dwrite d4/d1f/d27/d75/d38/d79/d32/f74 [0,4194304] 0 2024-04-13T10:59:16.333 INFO:tasks.workunit.client.0.smithi134.stdout:4/497: chown d4/dd/d6d/d8c/ff 13040 1 2024-04-13T10:59:16.336 INFO:tasks.workunit.client.0.smithi134.stdout:4/498: unlink d4/d1f/f49 0 2024-04-13T10:59:16.339 INFO:tasks.workunit.client.0.smithi134.stdout:4/499: unlink d4/l63 0 2024-04-13T10:59:16.341 INFO:tasks.workunit.client.0.smithi134.stdout:7/526: sync 2024-04-13T10:59:16.351 INFO:tasks.workunit.client.0.smithi134.stdout:7/527: rename da/d15/d26/d27/d3d/l96 to da/d15/d26/d27/d4f/la7 0 2024-04-13T10:59:16.364 INFO:tasks.workunit.client.0.smithi134.stdout:7/528: dread da/d15/d26/d27/f2d [0,4194304] 0 2024-04-13T10:59:16.370 INFO:tasks.workunit.client.0.smithi134.stdout:7/529: rename f5 to da/fa8 0 2024-04-13T10:59:16.374 INFO:tasks.workunit.client.0.smithi134.stdout:0/603: getdents d4/d17/da/d22/d37/d6d/d97/d9c/dcf/d9e/d78 0 2024-04-13T10:59:16.376 INFO:tasks.workunit.client.0.smithi134.stdout:0/604: mknod d4/d17/da/d22/d37/d6d/d97/d9c/cdf 0 2024-04-13T10:59:16.377 INFO:tasks.workunit.client.0.smithi134.stdout:7/530: getdents da/d15/d26/d38 0 2024-04-13T10:59:16.379 INFO:tasks.workunit.client.0.smithi134.stdout:0/605: mknod d4/d17/d20/d29/d30/d64/d84/ce0 0 2024-04-13T10:59:16.392 INFO:tasks.workunit.client.0.smithi134.stdout:4/500: write d4/dd/d6d/d8c/f16 [307587,101174] 0 2024-04-13T10:59:16.394 INFO:tasks.workunit.client.0.smithi134.stdout:4/501: write d4/d1f/d27/d75/d38/d79/f35 [2327963,90445] 0 2024-04-13T10:59:16.397 INFO:tasks.workunit.client.0.smithi134.stdout:4/502: truncate d4/dd/d6d/d8c/f36 1304561 0 2024-04-13T10:59:16.398 INFO:tasks.workunit.client.0.smithi134.stdout:5/745: sync 2024-04-13T10:59:16.398 INFO:tasks.workunit.client.0.smithi134.stdout:8/634: sync 2024-04-13T10:59:16.400 INFO:tasks.workunit.client.0.smithi134.stdout:6/632: sync 2024-04-13T10:59:16.400 INFO:tasks.workunit.client.0.smithi134.stdout:2/490: sync 2024-04-13T10:59:16.400 INFO:tasks.workunit.client.0.smithi134.stdout:9/703: sync 2024-04-13T10:59:16.400 INFO:tasks.workunit.client.0.smithi134.stdout:3/546: sync 2024-04-13T10:59:16.400 INFO:tasks.workunit.client.0.smithi134.stdout:1/697: sync 2024-04-13T10:59:16.401 INFO:tasks.workunit.client.0.smithi134.stdout:4/503: symlink d4/d1f/d90/la5 0 2024-04-13T10:59:16.401 INFO:tasks.workunit.client.0.smithi134.stdout:3/547: chown dc/d2a/fa7 263918894 1 2024-04-13T10:59:16.402 INFO:tasks.workunit.client.0.smithi134.stdout:6/633: write d4/da/f14 [4414681,47334] 0 2024-04-13T10:59:16.403 INFO:tasks.workunit.client.0.smithi134.stdout:9/704: fsync f6 0 2024-04-13T10:59:16.409 INFO:tasks.workunit.client.0.smithi134.stdout:3/548: creat dc/d27/d19/faa x:0 0 0 2024-04-13T10:59:16.412 INFO:tasks.workunit.client.0.smithi134.stdout:6/634: fsync d4/f5 0 2024-04-13T10:59:16.414 INFO:tasks.workunit.client.0.smithi134.stdout:6/635: chown d4/da/f95 1640 1 2024-04-13T10:59:16.418 INFO:tasks.workunit.client.0.smithi134.stdout:3/549: mkdir dc/d27/d19/d8b/d9b/dab 0 2024-04-13T10:59:16.425 INFO:tasks.workunit.client.0.smithi134.stdout:9/705: dwrite d13/d40/fc0 [0,4194304] 0 2024-04-13T10:59:16.429 INFO:tasks.workunit.client.0.smithi134.stdout:0/606: rename d4/d17/da/d22/d37/d6d/d97/d9c to d4/d17/d20/da9/de1 0 2024-04-13T10:59:16.429 INFO:tasks.workunit.client.0.smithi134.stdout:3/550: rename dc/d27/f18 to dc/d27/fac 0 2024-04-13T10:59:16.431 INFO:tasks.workunit.client.0.smithi134.stdout:0/607: write d4/d17/fc5 [1643995,22224] 0 2024-04-13T10:59:16.432 INFO:tasks.workunit.client.0.smithi134.stdout:6/636: mknod d4/da/d15/d1f/d24/d49/cd2 0 2024-04-13T10:59:16.438 INFO:tasks.workunit.client.0.smithi134.stdout:0/608: write d4/d17/da/f10 [256555,25842] 0 2024-04-13T10:59:16.444 INFO:tasks.workunit.client.0.smithi134.stdout:3/551: truncate dc/d27/d19/d8b/da8/d50/d25/f82 297199 0 2024-04-13T10:59:16.446 INFO:tasks.workunit.client.0.smithi134.stdout:0/609: symlink d4/d5d/le2 0 2024-04-13T10:59:16.446 INFO:tasks.workunit.client.0.smithi134.stdout:2/491: dread d5/de/d50/f7c [0,4194304] 0 2024-04-13T10:59:16.449 INFO:tasks.workunit.client.0.smithi134.stdout:8/635: dread d8/dc/d16/d54/d98/d9b/faf [0,4194304] 0 2024-04-13T10:59:16.450 INFO:tasks.workunit.client.0.smithi134.stdout:0/610: write d4/d17/d20/d29/f5b [3575991,21766] 0 2024-04-13T10:59:16.451 INFO:tasks.workunit.client.0.smithi134.stdout:5/746: rename dc/d1d/d2f to dc/d15/df1 0 2024-04-13T10:59:16.452 INFO:tasks.workunit.client.0.smithi134.stdout:7/531: dwrite da/f11 [0,4194304] 0 2024-04-13T10:59:16.454 INFO:tasks.workunit.client.0.smithi134.stdout:6/637: creat d4/da/d15/fd3 x:0 0 0 2024-04-13T10:59:16.460 INFO:tasks.workunit.client.0.smithi134.stdout:6/638: write d4/da/d15/fd3 [543085,25386] 0 2024-04-13T10:59:16.468 INFO:tasks.workunit.client.0.smithi134.stdout:2/492: unlink d5/d6/d57/d6f/f4a 0 2024-04-13T10:59:16.470 INFO:tasks.workunit.client.0.smithi134.stdout:2/493: readlink d5/d6/d57/l47 0 2024-04-13T10:59:16.473 INFO:tasks.workunit.client.0.smithi134.stdout:9/706: rename d13/d2e/d35/f43 to d13/d39/d64/db2/ff9 0 2024-04-13T10:59:16.474 INFO:tasks.workunit.client.0.smithi134.stdout:0/611: truncate d4/d17/d20/da9/de1/dcf/f57 2329708 0 2024-04-13T10:59:16.478 INFO:tasks.workunit.client.0.smithi134.stdout:7/532: dwrite da/d15/d26/d38/f84 [0,4194304] 0 2024-04-13T10:59:16.481 INFO:tasks.workunit.client.0.smithi134.stdout:0/612: chown d4/d17/da/d22/c68 15 1 2024-04-13T10:59:16.484 INFO:tasks.workunit.client.0.smithi134.stdout:6/639: symlink d4/da/d15/d1f/d24/d49/d91/ld4 0 2024-04-13T10:59:16.487 INFO:tasks.workunit.client.0.smithi134.stdout:3/552: rename dc/d27/d19/d48/d49/l7a to dc/d27/d19/d8b/da8/d50/d25/d5f/d75/lad 0 2024-04-13T10:59:16.492 INFO:tasks.workunit.client.0.smithi134.stdout:2/494: dwrite d5/d6/d57/d6f/d30/d58/d59/f8e [0,4194304] 0 2024-04-13T10:59:16.492 INFO:tasks.workunit.client.0.smithi134.stdout:7/533: read da/d15/d26/d27/d3d/d9c/f55 [3103409,36369] 0 2024-04-13T10:59:16.493 INFO:tasks.workunit.client.0.smithi134.stdout:0/613: read d4/d17/f4a [7526506,124375] 0 2024-04-13T10:59:16.497 INFO:tasks.workunit.client.0.smithi134.stdout:8/636: link d8/dc/d16/d54/d6c/d94/dc1/fc6 d8/dc/d16/d4e/d9c/fd9 0 2024-04-13T10:59:16.498 INFO:tasks.workunit.client.0.smithi134.stdout:7/534: chown da/d15/c16 5989 1 2024-04-13T10:59:16.498 INFO:tasks.workunit.client.0.smithi134.stdout:3/553: mknod dc/d27/d81/cae 0 2024-04-13T10:59:16.498 INFO:tasks.workunit.client.0.smithi134.stdout:7/535: chown da/d15/d85/l9f 29 1 2024-04-13T10:59:16.501 INFO:tasks.workunit.client.0.smithi134.stdout:6/640: creat d4/da/d15/d76/d92/fd5 x:0 0 0 2024-04-13T10:59:16.506 INFO:tasks.workunit.client.0.smithi134.stdout:7/536: fsync da/d15/d26/d38/f8c 0 2024-04-13T10:59:16.506 INFO:tasks.workunit.client.0.smithi134.stdout:0/614: creat d4/d17/d20/d29/d30/fe3 x:0 0 0 2024-04-13T10:59:16.506 INFO:tasks.workunit.client.0.smithi134.stdout:9/707: dwrite d13/d39/d58/fcf [0,4194304] 0 2024-04-13T10:59:16.511 INFO:tasks.workunit.client.0.smithi134.stdout:7/537: write da/d15/d26/d27/d4f/f7d [13809,72709] 0 2024-04-13T10:59:16.514 INFO:tasks.workunit.client.0.smithi134.stdout:0/615: dread - d4/d17/d20/d29/d30/d64/d84/f8e zero size 2024-04-13T10:59:16.514 INFO:tasks.workunit.client.0.smithi134.stdout:8/637: dwrite d8/dc/fbc [0,4194304] 0 2024-04-13T10:59:16.517 INFO:tasks.workunit.client.0.smithi134.stdout:3/554: rename dc/d1d/c98 to dc/d27/d19/d8b/da8/d50/caf 0 2024-04-13T10:59:16.519 INFO:tasks.workunit.client.0.smithi134.stdout:6/641: truncate d4/da/d15/d1f/d3c/f45 2268034 0 2024-04-13T10:59:16.519 INFO:tasks.workunit.client.0.smithi134.stdout:8/638: fsync d8/dc/d16/d54/fb9 0 2024-04-13T10:59:16.522 INFO:tasks.workunit.client.0.smithi134.stdout:7/538: rename da/d15/f1a to da/d15/d26/d27/d4f/d5f/d67/d73/d92/fa9 0 2024-04-13T10:59:16.523 INFO:tasks.workunit.client.0.smithi134.stdout:6/642: creat d4/da/d1a/fd6 x:0 0 0 2024-04-13T10:59:16.524 INFO:tasks.workunit.client.0.smithi134.stdout:8/639: creat d8/dc/d16/d4e/d76/fda x:0 0 0 2024-04-13T10:59:16.529 INFO:tasks.workunit.client.0.smithi134.stdout:6/643: fdatasync d4/da/d15/d1f/d24/da4/fc5 0 2024-04-13T10:59:16.535 INFO:tasks.workunit.client.0.smithi134.stdout:6/644: dwrite d4/f5 [0,4194304] 0 2024-04-13T10:59:16.536 INFO:tasks.workunit.client.0.smithi134.stdout:6/645: fsync d4/da/d1a/f29 0 2024-04-13T10:59:16.537 INFO:tasks.workunit.client.0.smithi134.stdout:6/646: chown d4/da/d15/d1f/d24/d49/d91/dc9 29 1 2024-04-13T10:59:16.539 INFO:tasks.workunit.client.0.smithi134.stdout:6/647: write d4/da/d15/d76/d92/fd5 [556835,82609] 0 2024-04-13T10:59:16.540 INFO:tasks.workunit.client.0.smithi134.stdout:6/648: truncate d4/da/fc8 236985 0 2024-04-13T10:59:16.541 INFO:tasks.workunit.client.0.smithi134.stdout:6/649: dread - d4/da/d15/d1f/d24/f9a zero size 2024-04-13T10:59:16.543 INFO:tasks.workunit.client.0.smithi134.stdout:1/698: write d3/d6/d20/d28/f37 [4456572,129974] 0 2024-04-13T10:59:16.545 INFO:tasks.workunit.client.0.smithi134.stdout:1/699: write d3/d6/d20/d71/d9c/fdf [380205,57756] 0 2024-04-13T10:59:16.546 INFO:tasks.workunit.client.0.smithi134.stdout:6/650: dread d4/da/d15/f6e [0,4194304] 0 2024-04-13T10:59:16.551 INFO:tasks.workunit.client.0.smithi134.stdout:0/616: link d4/d17/d20/c52 d4/d17/da/d22/d41/d6e/d8a/d95/db9/ce4 0 2024-04-13T10:59:16.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/640: symlink d8/dc/d37/ldb 0 2024-04-13T10:59:16.555 INFO:tasks.workunit.client.0.smithi134.stdout:1/700: creat d3/d6/d20/d89/fe4 x:0 0 0 2024-04-13T10:59:16.556 INFO:tasks.workunit.client.0.smithi134.stdout:6/651: write d4/da/d15/d77/d63/f8c [4525448,42370] 0 2024-04-13T10:59:16.559 INFO:tasks.workunit.client.0.smithi134.stdout:0/617: mkdir d4/d17/da/d22/d37/d6d/d97/de5 0 2024-04-13T10:59:16.561 INFO:tasks.workunit.client.0.smithi134.stdout:1/701: mkdir d3/d6/dd/de5 0 2024-04-13T10:59:16.564 INFO:tasks.workunit.client.0.smithi134.stdout:3/555: rename dc/d27/d19/d8b/da8/d50/c4c to dc/d27/d19/d48/cb0 0 2024-04-13T10:59:16.571 INFO:tasks.workunit.client.0.smithi134.stdout:1/702: unlink d3/d6/d20/d9f/fa9 0 2024-04-13T10:59:16.573 INFO:tasks.workunit.client.0.smithi134.stdout:3/556: dwrite dc/d27/d19/f6a [0,4194304] 0 2024-04-13T10:59:16.573 INFO:tasks.workunit.client.0.smithi134.stdout:5/747: chown dc/d1d/d67/cea 500775637 1 2024-04-13T10:59:16.583 INFO:tasks.workunit.client.0.smithi134.stdout:1/703: write d3/d6/f4f [4937655,11897] 0 2024-04-13T10:59:16.583 INFO:tasks.workunit.client.0.smithi134.stdout:2/495: write d5/d6/f69 [1038015,117848] 0 2024-04-13T10:59:16.585 INFO:tasks.workunit.client.0.smithi134.stdout:2/496: chown d5/d6/d57/d6f/d30/d58/d73 19764 1 2024-04-13T10:59:16.585 INFO:tasks.workunit.client.0.smithi134.stdout:1/704: dread d3/d30/f4b [0,4194304] 0 2024-04-13T10:59:16.587 INFO:tasks.workunit.client.0.smithi134.stdout:2/497: write d5/d6/f69 [1761716,27550] 0 2024-04-13T10:59:16.588 INFO:tasks.workunit.client.0.smithi134.stdout:5/748: dread dc/f96 [0,4194304] 0 2024-04-13T10:59:16.590 INFO:tasks.workunit.client.0.smithi134.stdout:3/557: rename dc/d27/d19/d8b/da8/d62 to dc/d27/d19/db1 0 2024-04-13T10:59:16.593 INFO:tasks.workunit.client.0.smithi134.stdout:9/708: write d13/d39/d58/d5f/d6e/fda [47050,7229] 0 2024-04-13T10:59:16.601 INFO:tasks.workunit.client.0.smithi134.stdout:2/498: creat d5/d6/d70/f90 x:0 0 0 2024-04-13T10:59:16.603 INFO:tasks.workunit.client.0.smithi134.stdout:5/749: fdatasync dc/d15/df1/d3b/d3c/f5d 0 2024-04-13T10:59:16.605 INFO:tasks.workunit.client.0.smithi134.stdout:8/641: link d8/dc/d16/d4e/d76/cd6 d8/cdc 0 2024-04-13T10:59:16.606 INFO:tasks.workunit.client.0.smithi134.stdout:6/652: truncate d4/da/d15/d1f/d24/da4/fc5 7928817 0 2024-04-13T10:59:16.608 INFO:tasks.workunit.client.0.smithi134.stdout:6/653: dread d4/da/d15/f6e [0,4194304] 0 2024-04-13T10:59:16.608 INFO:tasks.workunit.client.0.smithi134.stdout:3/558: mknod dc/d27/d19/d8b/da8/cb2 0 2024-04-13T10:59:16.615 INFO:tasks.workunit.client.0.smithi134.stdout:1/705: link d3/d6/d6a/f6e d3/d6/d20/d71/d9c/dcb/fe6 0 2024-04-13T10:59:16.618 INFO:tasks.workunit.client.0.smithi134.stdout:3/559: dwrite dc/d27/d19/d48/d8e/f9c [0,4194304] 0 2024-04-13T10:59:16.621 INFO:tasks.workunit.client.0.smithi134.stdout:2/499: unlink d5/d6/c33 0 2024-04-13T10:59:16.622 INFO:tasks.workunit.client.0.smithi134.stdout:8/642: dread d8/dc/f12 [0,4194304] 0 2024-04-13T10:59:16.622 INFO:tasks.workunit.client.0.smithi134.stdout:1/706: write d3/d6/d20/d9f/f99 [1493282,10956] 0 2024-04-13T10:59:16.628 INFO:tasks.workunit.client.0.smithi134.stdout:9/709: symlink d13/lfa 0 2024-04-13T10:59:16.629 INFO:tasks.workunit.client.0.smithi134.stdout:3/560: dwrite dc/d27/f9d [0,4194304] 0 2024-04-13T10:59:16.631 INFO:tasks.workunit.client.0.smithi134.stdout:1/707: dread - d3/d6/d20/d89/fd1 zero size 2024-04-13T10:59:16.633 INFO:tasks.workunit.client.0.smithi134.stdout:3/561: truncate dc/d27/d19/faa 162526 0 2024-04-13T10:59:16.633 INFO:tasks.workunit.client.0.smithi134.stdout:6/654: rename d4/da/d15/d76/d8e/da1/lbd to d4/da/dbb/dc3/da6/ld7 0 2024-04-13T10:59:16.638 INFO:tasks.workunit.client.0.smithi134.stdout:1/708: dwrite d3/d6/d20/f42 [0,4194304] 0 2024-04-13T10:59:16.641 INFO:tasks.workunit.client.0.smithi134.stdout:4/504: sync 2024-04-13T10:59:16.641 INFO:tasks.workunit.client.0.smithi134.stdout:1/709: dread d3/d6/d16/d1d/d86/fb4 [0,4194304] 0 2024-04-13T10:59:16.642 INFO:tasks.workunit.client.0.smithi134.stdout:4/505: write d4/d48/f72 [1977519,82147] 0 2024-04-13T10:59:16.644 INFO:tasks.workunit.client.0.smithi134.stdout:4/506: write d4/d1f/d27/d75/d38/d79/d32/d67/d9b/f9d [26964,10329] 0 2024-04-13T10:59:16.647 INFO:tasks.workunit.client.0.smithi134.stdout:2/500: mkdir d5/de/d91 0 2024-04-13T10:59:16.649 INFO:tasks.workunit.client.0.smithi134.stdout:8/643: rmdir d8/dc 39 2024-04-13T10:59:16.656 INFO:tasks.workunit.client.0.smithi134.stdout:6/655: unlink d4/da/l80 0 2024-04-13T10:59:16.658 INFO:tasks.workunit.client.0.smithi134.stdout:6/656: dread d4/da/d15/d1f/d24/f3e [0,4194304] 0 2024-04-13T10:59:16.659 INFO:tasks.workunit.client.0.smithi134.stdout:3/562: symlink dc/d27/d19/d48/d8e/lb3 0 2024-04-13T10:59:16.665 INFO:tasks.workunit.client.0.smithi134.stdout:0/618: dwrite d4/d17/d20/d29/d30/d64/d84/f8e [0,4194304] 0 2024-04-13T10:59:16.668 INFO:tasks.workunit.client.0.smithi134.stdout:4/507: mkdir d4/dd/d6d/d8c/da6 0 2024-04-13T10:59:16.672 INFO:tasks.workunit.client.0.smithi134.stdout:9/710: dread d13/d39/f45 [0,4194304] 0 2024-04-13T10:59:16.672 INFO:tasks.workunit.client.0.smithi134.stdout:5/750: creat dc/d15/df1/ff2 x:0 0 0 2024-04-13T10:59:16.679 INFO:tasks.workunit.client.0.smithi134.stdout:8/644: dread d8/dc/d16/d4e/d9c/fd9 [0,4194304] 0 2024-04-13T10:59:16.679 INFO:tasks.workunit.client.0.smithi134.stdout:5/751: dwrite dc/f28 [0,4194304] 0 2024-04-13T10:59:16.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/645: chown d8/dc/d37/d3f/fa0 117965 1 2024-04-13T10:59:16.690 INFO:tasks.workunit.client.0.smithi134.stdout:0/619: unlink d4/d17/d20/da9/de1/dcf/d96/dd5/fda 0 2024-04-13T10:59:16.692 INFO:tasks.workunit.client.0.smithi134.stdout:4/508: creat d4/dd/d6d/d8c/fa7 x:0 0 0 2024-04-13T10:59:16.696 INFO:tasks.workunit.client.0.smithi134.stdout:9/711: rename d13/d2e/d35/d50/d59/d74 to d13/d40/d7d/dfb 0 2024-04-13T10:59:16.704 INFO:tasks.workunit.client.0.smithi134.stdout:7/539: dwrite da/d15/d26/d27/d3d/d9c/d48/f5d [0,4194304] 0 2024-04-13T10:59:16.704 INFO:tasks.workunit.client.0.smithi134.stdout:2/501: rmdir d5/de/d91 0 2024-04-13T10:59:16.812 INFO:tasks.workunit.client.0.smithi134.stdout:4/509: unlink d4/d1f/d90/la5 0 2024-04-13T10:59:16.812 INFO:tasks.workunit.client.0.smithi134.stdout:5/752: mkdir dc/df3 0 2024-04-13T10:59:16.812 INFO:tasks.workunit.client.0.smithi134.stdout:8/646: mkdir d8/dc/d16/ddd 0 2024-04-13T10:59:16.813 INFO:tasks.workunit.client.0.smithi134.stdout:4/510: stat d4/d1f/d27/d75/f31 0 2024-04-13T10:59:16.814 INFO:tasks.workunit.client.0.smithi134.stdout:6/657: write d4/da/d15/d1f/d24/f3e [1565324,100868] 0 2024-04-13T10:59:16.816 INFO:tasks.workunit.client.0.smithi134.stdout:8/647: write d8/dc/d16/d54/d98/d9b/faf [1049503,114644] 0 2024-04-13T10:59:16.818 INFO:tasks.workunit.client.0.smithi134.stdout:7/540: creat da/d15/d26/d27/d4f/d5f/d67/d76/faa x:0 0 0 2024-04-13T10:59:16.821 INFO:tasks.workunit.client.0.smithi134.stdout:6/658: write d4/da/d15/d1f/d24/da4/fb2 [563262,48733] 0 2024-04-13T10:59:16.821 INFO:tasks.workunit.client.0.smithi134.stdout:8/648: chown d8/dc/d16/d54/d98/d9b/faf 46611125 1 2024-04-13T10:59:16.822 INFO:tasks.workunit.client.0.smithi134.stdout:6/659: stat d4/da/d15/l4f 0 2024-04-13T10:59:16.823 INFO:tasks.workunit.client.0.smithi134.stdout:8/649: stat d8/dc/d16/d4e/d76/c7a 0 2024-04-13T10:59:16.823 INFO:tasks.workunit.client.0.smithi134.stdout:3/563: dwrite dc/d27/d4d/f43 [0,4194304] 0 2024-04-13T10:59:16.825 INFO:tasks.workunit.client.0.smithi134.stdout:8/650: chown d8/dc/d13/c34 721 1 2024-04-13T10:59:16.827 INFO:tasks.workunit.client.0.smithi134.stdout:8/651: read - d8/dc/d9d/d69/fd8 zero size 2024-04-13T10:59:16.834 INFO:tasks.workunit.client.0.smithi134.stdout:8/652: dwrite d8/dc/d37/d3f/fa0 [0,4194304] 0 2024-04-13T10:59:16.836 INFO:tasks.workunit.client.0.smithi134.stdout:4/511: dread d4/d1f/d27/d75/d38/d79/f28 [0,4194304] 0 2024-04-13T10:59:16.838 INFO:tasks.workunit.client.0.smithi134.stdout:8/653: truncate d8/dc/d2c/d68/d8c/fba 806977 0 2024-04-13T10:59:16.838 INFO:tasks.workunit.client.0.smithi134.stdout:8/654: stat d8/dc/d2c/ca4 0 2024-04-13T10:59:16.892 INFO:tasks.workunit.client.0.smithi134.stdout:5/753: mkdir dc/d1d/d2b/d30/d3e/df4 0 2024-04-13T10:59:16.900 INFO:tasks.workunit.client.0.smithi134.stdout:3/564: rename dc/d27/d19/d48/d77 to dc/d1d/d58/db4 0 2024-04-13T10:59:16.904 INFO:tasks.workunit.client.0.smithi134.stdout:8/655: creat d8/dc/d2c/d68/d8c/d8f/fde x:0 0 0 2024-04-13T10:59:16.907 INFO:tasks.workunit.client.0.smithi134.stdout:5/754: chown dc/d1d/d20 47512363 1 2024-04-13T10:59:16.909 INFO:tasks.workunit.client.0.smithi134.stdout:6/660: creat d4/da/dbb/dad/fd8 x:0 0 0 2024-04-13T10:59:16.913 INFO:tasks.workunit.client.0.smithi134.stdout:8/656: fdatasync d8/dc/d16/d54/f59 0 2024-04-13T10:59:16.915 INFO:tasks.workunit.client.0.smithi134.stdout:5/755: unlink dc/c12 0 2024-04-13T10:59:16.916 INFO:tasks.workunit.client.0.smithi134.stdout:6/661: stat d4/da/f25 0 2024-04-13T10:59:16.918 INFO:tasks.workunit.client.0.smithi134.stdout:8/657: rmdir d8/dc/d16/d4e 39 2024-04-13T10:59:16.920 INFO:tasks.workunit.client.0.smithi134.stdout:5/756: unlink dc/dc1/fc5 0 2024-04-13T10:59:16.922 INFO:tasks.workunit.client.0.smithi134.stdout:5/757: truncate dc/d15/df1/d3b/d7f/d8d/d7d/dc0/fd5 1027080 0 2024-04-13T10:59:16.923 INFO:tasks.workunit.client.0.smithi134.stdout:8/658: mkdir d8/dc/d13/ddf 0 2024-04-13T10:59:16.924 INFO:tasks.workunit.client.0.smithi134.stdout:8/659: chown d8/dcc/cd1 965 1 2024-04-13T10:59:16.925 INFO:tasks.workunit.client.0.smithi134.stdout:2/502: truncate d5/d6/d57/d6c/f28 3911507 0 2024-04-13T10:59:16.927 INFO:tasks.workunit.client.0.smithi134.stdout:8/660: dread - d8/dc/d2c/d68/f6a zero size 2024-04-13T10:59:16.929 INFO:tasks.workunit.client.0.smithi134.stdout:5/758: creat dc/d15/dab/dd0/ff5 x:0 0 0 2024-04-13T10:59:16.930 INFO:tasks.workunit.client.0.smithi134.stdout:2/503: symlink d5/d6/d57/d6c/d29/l92 0 2024-04-13T10:59:16.930 INFO:tasks.workunit.client.0.smithi134.stdout:6/662: dread d4/da/d15/d1f/d3c/f45 [0,4194304] 0 2024-04-13T10:59:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:16 smithi134 ceph-mon[39696]: pgmap v42: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 40 MiB/s rd, 126 MiB/s wr, 307 op/s 2024-04-13T10:59:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:16 smithi194 ceph-mon[46737]: pgmap v42: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 40 MiB/s rd, 126 MiB/s wr, 307 op/s 2024-04-13T10:59:17.027 INFO:tasks.workunit.client.0.smithi134.stdout:3/565: rmdir dc/d27/d19 39 2024-04-13T10:59:17.029 INFO:tasks.workunit.client.0.smithi134.stdout:7/541: truncate f8 2306527 0 2024-04-13T10:59:17.029 INFO:tasks.workunit.client.0.smithi134.stdout:4/512: truncate d4/d1f/d27/d75/d38/d79/d32/f74 1330375 0 2024-04-13T10:59:17.031 INFO:tasks.workunit.client.0.smithi134.stdout:8/661: mkdir d8/dc/d16/d4e/d9c/de0 0 2024-04-13T10:59:17.032 INFO:tasks.workunit.client.0.smithi134.stdout:3/566: read dc/d27/d19/d8b/da8/d50/d25/f82 [9578,42875] 0 2024-04-13T10:59:17.032 INFO:tasks.workunit.client.0.smithi134.stdout:8/662: write d8/dc/d37/f64 [725471,30276] 0 2024-04-13T10:59:17.034 INFO:tasks.workunit.client.0.smithi134.stdout:6/663: rename d4/da/d15/f6e to d4/da/d15/d1f/d3c/dd0/fd9 0 2024-04-13T10:59:17.034 INFO:tasks.workunit.client.0.smithi134.stdout:3/567: read dc/d27/d19/d8b/d9b/f9f [793846,39866] 0 2024-04-13T10:59:17.040 INFO:tasks.workunit.client.0.smithi134.stdout:7/542: mknod da/d15/d26/d38/cab 0 2024-04-13T10:59:17.049 INFO:tasks.workunit.client.0.smithi134.stdout:8/663: write d8/dc/f4f [591546,85156] 0 2024-04-13T10:59:17.050 INFO:tasks.workunit.client.0.smithi134.stdout:8/664: dread - d8/dc/d2c/d68/d8c/d8f/fde zero size 2024-04-13T10:59:17.052 INFO:tasks.workunit.client.0.smithi134.stdout:4/513: write d4/f2a [1844608,43947] 0 2024-04-13T10:59:17.053 INFO:tasks.workunit.client.0.smithi134.stdout:6/664: mkdir d4/da/d15/d76/dda 0 2024-04-13T10:59:17.053 INFO:tasks.workunit.client.0.smithi134.stdout:4/514: fsync d4/d1f/d27/d75/f68 0 2024-04-13T10:59:17.054 INFO:tasks.workunit.client.0.smithi134.stdout:6/665: write d4/da/d15/fd3 [77403,67062] 0 2024-04-13T10:59:17.055 INFO:tasks.workunit.client.0.smithi134.stdout:3/568: symlink dc/d27/d19/d8b/da8/d50/d25/d91/lb5 0 2024-04-13T10:59:17.056 INFO:tasks.workunit.client.0.smithi134.stdout:6/666: fsync d4/da/d15/d1f/d24/d49/d91/fb0 0 2024-04-13T10:59:17.058 INFO:tasks.workunit.client.0.smithi134.stdout:2/504: link d5/d6/c45 d5/d6/d57/d6c/d29/c93 0 2024-04-13T10:59:17.059 INFO:tasks.workunit.client.0.smithi134.stdout:4/515: dread d4/d1f/d27/d75/d38/f4e [0,4194304] 0 2024-04-13T10:59:17.062 INFO:tasks.workunit.client.0.smithi134.stdout:6/667: dread d4/da/d15/d76/f9b [0,4194304] 0 2024-04-13T10:59:17.063 INFO:tasks.workunit.client.0.smithi134.stdout:6/668: dread - d4/da/dbb/dad/fd8 zero size 2024-04-13T10:59:17.065 INFO:tasks.workunit.client.0.smithi134.stdout:7/543: dread da/d15/f6e [0,4194304] 0 2024-04-13T10:59:17.066 INFO:tasks.workunit.client.0.smithi134.stdout:4/516: dread d4/d1f/d27/d75/f68 [0,4194304] 0 2024-04-13T10:59:17.068 INFO:tasks.workunit.client.0.smithi134.stdout:5/759: link dc/d1d/d20/d23/d5a/lb3 dc/d1d/lf6 0 2024-04-13T10:59:17.069 INFO:tasks.workunit.client.0.smithi134.stdout:8/665: symlink d8/dc/d16/d54/d6c/d94/dc0/le1 0 2024-04-13T10:59:17.070 INFO:tasks.workunit.client.0.smithi134.stdout:6/669: mkdir d4/da/d68/ddb 0 2024-04-13T10:59:17.073 INFO:tasks.workunit.client.0.smithi134.stdout:3/569: symlink dc/d27/d4d/lb6 0 2024-04-13T10:59:17.073 INFO:tasks.workunit.client.0.smithi134.stdout:3/570: read - dc/d2a/fa7 zero size 2024-04-13T10:59:17.076 INFO:tasks.workunit.client.0.smithi134.stdout:7/544: creat da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/fac x:0 0 0 2024-04-13T10:59:17.077 INFO:tasks.workunit.client.0.smithi134.stdout:7/545: fdatasync da/d15/d26/d27/d4f/d5f/d67/f80 0 2024-04-13T10:59:17.081 INFO:tasks.workunit.client.0.smithi134.stdout:4/517: dread d4/d1f/d27/d75/d38/d79/f46 [0,4194304] 0 2024-04-13T10:59:17.083 INFO:tasks.workunit.client.0.smithi134.stdout:4/518: read d4/d1f/d27/d75/d38/d79/d32/f7c [3941681,92076] 0 2024-04-13T10:59:17.083 INFO:tasks.workunit.client.0.smithi134.stdout:4/519: chown d4/c34 190443 1 2024-04-13T10:59:17.084 INFO:tasks.workunit.client.0.smithi134.stdout:8/666: rename d8/l9 to d8/dc/d16/d54/d6c/d94/dc1/le2 0 2024-04-13T10:59:17.084 INFO:tasks.workunit.client.0.smithi134.stdout:4/520: chown d4/dd/d6d/d8c/f16 567 1 2024-04-13T10:59:17.085 INFO:tasks.workunit.client.0.smithi134.stdout:2/505: write d5/d6/d57/d6c/d29/f66 [973962,10024] 0 2024-04-13T10:59:17.085 INFO:tasks.workunit.client.0.smithi134.stdout:8/667: fsync d8/dc/d16/d54/d6c/f9f 0 2024-04-13T10:59:17.086 INFO:tasks.workunit.client.0.smithi134.stdout:6/670: dread d4/da/d15/d76/f9b [0,4194304] 0 2024-04-13T10:59:17.087 INFO:tasks.workunit.client.0.smithi134.stdout:4/521: dread - d4/d1f/d27/d3a/d65/f66 zero size 2024-04-13T10:59:17.088 INFO:tasks.workunit.client.0.smithi134.stdout:3/571: truncate dc/f42 2739304 0 2024-04-13T10:59:17.088 INFO:tasks.workunit.client.0.smithi134.stdout:2/506: read d5/d6/d57/d6f/f44 [905996,87311] 0 2024-04-13T10:59:17.089 INFO:tasks.workunit.client.0.smithi134.stdout:4/522: chown d4/dd/f3f 11 1 2024-04-13T10:59:17.090 INFO:tasks.workunit.client.0.smithi134.stdout:3/572: chown dc/l7d 829 1 2024-04-13T10:59:17.091 INFO:tasks.workunit.client.0.smithi134.stdout:7/546: mkdir da/dad 0 2024-04-13T10:59:17.097 INFO:tasks.workunit.client.0.smithi134.stdout:8/668: rename d8/c58 to d8/dc/d16/d74/ce3 0 2024-04-13T10:59:17.099 INFO:tasks.workunit.client.0.smithi134.stdout:2/507: dwrite d5/d6/d57/d6f/d30/d58/d73/f83 [0,4194304] 0 2024-04-13T10:59:17.106 INFO:tasks.workunit.client.0.smithi134.stdout:7/547: dwrite da/d15/d26/d27/d4f/d5f/d67/f90 [0,4194304] 0 2024-04-13T10:59:17.112 INFO:tasks.workunit.client.0.smithi134.stdout:4/523: symlink d4/d1f/d27/d3a/la8 0 2024-04-13T10:59:17.121 INFO:tasks.workunit.client.0.smithi134.stdout:8/669: rename d8/dc/d16/d54/d98/d9b/da3/fbd to d8/dc/d2c/d68/fe4 0 2024-04-13T10:59:17.123 INFO:tasks.workunit.client.0.smithi134.stdout:5/760: write dc/d1d/d46/f97 [1814364,16347] 0 2024-04-13T10:59:17.126 INFO:tasks.workunit.client.0.smithi134.stdout:2/508: mkdir d5/d6/d57/d6f/d30/d88/d94 0 2024-04-13T10:59:17.128 INFO:tasks.workunit.client.0.smithi134.stdout:3/573: dwrite dc/d27/d19/d8b/d9b/f9f [0,4194304] 0 2024-04-13T10:59:17.131 INFO:tasks.workunit.client.0.smithi134.stdout:8/670: unlink d8/dc/d37/l6e 0 2024-04-13T10:59:17.132 INFO:tasks.workunit.client.0.smithi134.stdout:5/761: mkdir dc/d15/d84/df7 0 2024-04-13T10:59:17.135 INFO:tasks.workunit.client.0.smithi134.stdout:8/671: dread d8/dc/d16/d54/d6c/d94/dc1/fc6 [0,4194304] 0 2024-04-13T10:59:17.138 INFO:tasks.workunit.client.0.smithi134.stdout:3/574: rename dc/d27/l3d to dc/d27/d19/d8b/da8/d50/d25/d5f/d99/lb7 0 2024-04-13T10:59:17.140 INFO:tasks.workunit.client.0.smithi134.stdout:4/524: dread d4/dd/d6d/d8c/f36 [0,4194304] 0 2024-04-13T10:59:17.141 INFO:tasks.workunit.client.0.smithi134.stdout:7/548: getdents da/d15/d26/d27/d4f/d5f 0 2024-04-13T10:59:17.142 INFO:tasks.workunit.client.0.smithi134.stdout:3/575: chown dc/d1d/f8d 1 1 2024-04-13T10:59:17.142 INFO:tasks.workunit.client.0.smithi134.stdout:6/671: dread d4/da/d15/d1f/d24/da4/fc5 [4194304,4194304] 0 2024-04-13T10:59:17.146 INFO:tasks.workunit.client.0.smithi134.stdout:2/509: write d5/de/d50/f56 [2107148,55248] 0 2024-04-13T10:59:17.148 INFO:tasks.workunit.client.0.smithi134.stdout:7/549: unlink da/f12 0 2024-04-13T10:59:17.150 INFO:tasks.workunit.client.0.smithi134.stdout:7/550: write da/d15/d26/d27/d4f/d5f/d88/f8d [1360939,21522] 0 2024-04-13T10:59:17.153 INFO:tasks.workunit.client.0.smithi134.stdout:6/672: symlink d4/da/dbb/dc3/ldc 0 2024-04-13T10:59:17.153 INFO:tasks.workunit.client.0.smithi134.stdout:6/673: chown d4/da/d68 72048091 1 2024-04-13T10:59:17.154 INFO:tasks.workunit.client.0.smithi134.stdout:3/576: readlink dc/d27/d19/d8b/da8/d50/d25/d5f/d99/lb7 0 2024-04-13T10:59:17.161 INFO:tasks.workunit.client.0.smithi134.stdout:1/710: sync 2024-04-13T10:59:17.163 INFO:tasks.workunit.client.0.smithi134.stdout:4/525: mknod d4/d1f/d27/d3a/ca9 0 2024-04-13T10:59:17.163 INFO:tasks.workunit.client.0.smithi134.stdout:8/672: dwrite d8/dc/d2c/f39 [0,4194304] 0 2024-04-13T10:59:17.164 INFO:tasks.workunit.client.0.smithi134.stdout:6/674: mkdir d4/da/d15/d76/ddd 0 2024-04-13T10:59:17.166 INFO:tasks.workunit.client.0.smithi134.stdout:3/577: symlink dc/d27/d19/d48/d49/lb8 0 2024-04-13T10:59:17.166 INFO:tasks.workunit.client.0.smithi134.stdout:1/711: write d3/d6/d20/d9f/fae [220423,118977] 0 2024-04-13T10:59:17.170 INFO:tasks.workunit.client.0.smithi134.stdout:5/762: dwrite dc/d1d/d2b/d30/d3e/f98 [0,4194304] 0 2024-04-13T10:59:17.175 INFO:tasks.workunit.client.0.smithi134.stdout:5/763: write dc/d15/d65/f6d [2676050,7511] 0 2024-04-13T10:59:17.180 INFO:tasks.workunit.client.0.smithi134.stdout:7/551: rename da/d15/d26/d27/d3d/f45 to da/d15/d26/fae 0 2024-04-13T10:59:17.183 INFO:tasks.workunit.client.0.smithi134.stdout:3/578: symlink dc/d27/d19/d8b/lb9 0 2024-04-13T10:59:17.184 INFO:tasks.workunit.client.0.smithi134.stdout:1/712: mknod d3/d6/d20/d71/d9c/ce7 0 2024-04-13T10:59:17.187 INFO:tasks.workunit.client.0.smithi134.stdout:4/526: dwrite d4/d1f/d27/d75/f52 [0,4194304] 0 2024-04-13T10:59:17.189 INFO:tasks.workunit.client.0.smithi134.stdout:2/510: dwrite d5/de/d50/f6b [4194304,4194304] 0 2024-04-13T10:59:17.191 INFO:tasks.workunit.client.0.smithi134.stdout:6/675: link d4/da/d15/d1f/d24/d2b/f2e d4/da/d15/d76/d92/fde 0 2024-04-13T10:59:17.196 INFO:tasks.workunit.client.0.smithi134.stdout:8/673: getdents d8/dc 0 2024-04-13T10:59:17.197 INFO:tasks.workunit.client.0.smithi134.stdout:4/527: chown d4/d1f/d27/d3a/d65/c87 6336916 1 2024-04-13T10:59:17.198 INFO:tasks.workunit.client.0.smithi134.stdout:2/511: write d5/d6/d57/d6c/f4d [9326817,106032] 0 2024-04-13T10:59:17.200 INFO:tasks.workunit.client.0.smithi134.stdout:1/713: read d3/d6/f7 [5092959,67515] 0 2024-04-13T10:59:17.200 INFO:tasks.workunit.client.0.smithi134.stdout:8/674: chown d8/dc/d13/f7f 1538720 1 2024-04-13T10:59:17.202 INFO:tasks.workunit.client.0.smithi134.stdout:6/676: fsync d4/da/d15/d1f/d24/da4/fc5 0 2024-04-13T10:59:17.206 INFO:tasks.workunit.client.0.smithi134.stdout:3/579: creat dc/d27/d19/d8b/da8/d50/d25/d91/fba x:0 0 0 2024-04-13T10:59:17.209 INFO:tasks.workunit.client.0.smithi134.stdout:1/714: dread d3/d30/f85 [0,4194304] 0 2024-04-13T10:59:17.210 INFO:tasks.workunit.client.0.smithi134.stdout:6/677: dread d4/da/d15/d1f/d24/f3e [0,4194304] 0 2024-04-13T10:59:17.211 INFO:tasks.workunit.client.0.smithi134.stdout:2/512: rename d5/c7 to d5/de/c95 0 2024-04-13T10:59:17.212 INFO:tasks.workunit.client.0.smithi134.stdout:6/678: write d4/f5 [2521358,31320] 0 2024-04-13T10:59:17.217 INFO:tasks.workunit.client.0.smithi134.stdout:7/552: truncate da/d15/d26/d27/d4f/d5f/d67/d76/f82 2791489 0 2024-04-13T10:59:17.221 INFO:tasks.workunit.client.0.smithi134.stdout:3/580: dwrite dc/d27/d19/d48/d8e/f92 [0,4194304] 0 2024-04-13T10:59:17.223 INFO:tasks.workunit.client.0.smithi134.stdout:5/764: dread f9 [0,4194304] 0 2024-04-13T10:59:17.224 INFO:tasks.workunit.client.0.smithi134.stdout:4/528: dread d4/f61 [0,4194304] 0 2024-04-13T10:59:17.224 INFO:tasks.workunit.client.0.smithi134.stdout:3/581: stat dc/d27/d19/d8b/da8/d50/c8c 0 2024-04-13T10:59:17.228 INFO:tasks.workunit.client.0.smithi134.stdout:2/513: mkdir d5/d6/d57/d6f/d30/d88/d96 0 2024-04-13T10:59:17.234 INFO:tasks.workunit.client.0.smithi134.stdout:1/715: dread d3/d30/f48 [0,4194304] 0 2024-04-13T10:59:17.234 INFO:tasks.workunit.client.0.smithi134.stdout:7/553: rename da/d15/d26/d27/d4f/d5f/la3 to da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/laf 0 2024-04-13T10:59:17.236 INFO:tasks.workunit.client.0.smithi134.stdout:4/529: creat d4/d1f/d90/faa x:0 0 0 2024-04-13T10:59:17.238 INFO:tasks.workunit.client.0.smithi134.stdout:8/675: creat d8/dc/d16/d4e/fe5 x:0 0 0 2024-04-13T10:59:17.240 INFO:tasks.workunit.client.0.smithi134.stdout:6/679: mkdir d4/da/d15/d1f/d24/ddf 0 2024-04-13T10:59:17.242 INFO:tasks.workunit.client.0.smithi134.stdout:7/554: dwrite da/d15/d26/d27/d4f/d5f/d67/d73/f91 [0,4194304] 0 2024-04-13T10:59:17.246 INFO:tasks.workunit.client.0.smithi134.stdout:1/716: creat d3/d6/d20/d6d/db1/fe8 x:0 0 0 2024-04-13T10:59:17.251 INFO:tasks.workunit.client.0.smithi134.stdout:6/680: dwrite d4/da/fc8 [0,4194304] 0 2024-04-13T10:59:17.253 INFO:tasks.workunit.client.0.smithi134.stdout:5/765: write dc/d15/d50/fb4 [640422,54541] 0 2024-04-13T10:59:17.254 INFO:tasks.workunit.client.0.smithi134.stdout:2/514: dread d5/de/d12/f6a [0,4194304] 0 2024-04-13T10:59:17.254 INFO:tasks.workunit.client.0.smithi134.stdout:8/676: creat d8/dc/d2c/d68/d8c/fe6 x:0 0 0 2024-04-13T10:59:17.261 INFO:tasks.workunit.client.0.smithi134.stdout:8/677: dread d8/dc/f29 [0,4194304] 0 2024-04-13T10:59:17.265 INFO:tasks.workunit.client.0.smithi134.stdout:5/766: rmdir dc/d1d/d2b/d30 39 2024-04-13T10:59:17.267 INFO:tasks.workunit.client.0.smithi134.stdout:3/582: getdents dc 0 2024-04-13T10:59:17.269 INFO:tasks.workunit.client.0.smithi134.stdout:3/583: read - dc/d27/d19/d8b/da8/d50/d25/d91/fba zero size 2024-04-13T10:59:17.269 INFO:tasks.workunit.client.0.smithi134.stdout:8/678: mkdir d8/dc/d16/d54/d6c/d94/de7 0 2024-04-13T10:59:17.271 INFO:tasks.workunit.client.0.smithi134.stdout:3/584: chown dc/d27/c94 0 1 2024-04-13T10:59:17.271 INFO:tasks.workunit.client.0.smithi134.stdout:8/679: chown d8/dc/d37/d3f/f73 0 1 2024-04-13T10:59:17.271 INFO:tasks.workunit.client.0.smithi134.stdout:2/515: mknod d5/d6/d57/d6c/c97 0 2024-04-13T10:59:17.274 INFO:tasks.workunit.client.0.smithi134.stdout:5/767: mkdir dc/d15/df8 0 2024-04-13T10:59:17.275 INFO:tasks.workunit.client.0.smithi134.stdout:8/680: mknod d8/dc/d16/d4e/d9c/ce8 0 2024-04-13T10:59:17.276 INFO:tasks.workunit.client.0.smithi134.stdout:8/681: dread - d8/dc/d16/fc2 zero size 2024-04-13T10:59:17.276 INFO:tasks.workunit.client.0.smithi134.stdout:2/516: creat d5/d6/d57/d6f/d30/d58/d73/f98 x:0 0 0 2024-04-13T10:59:17.277 INFO:tasks.workunit.client.0.smithi134.stdout:2/517: readlink d5/d6/d57/l47 0 2024-04-13T10:59:17.279 INFO:tasks.workunit.client.0.smithi134.stdout:1/717: write d3/d6/d16/d1d/f94 [797044,38002] 0 2024-04-13T10:59:17.281 INFO:tasks.workunit.client.0.smithi134.stdout:8/682: creat d8/dc/d9d/d69/fe9 x:0 0 0 2024-04-13T10:59:17.281 INFO:tasks.workunit.client.0.smithi134.stdout:4/530: dread d4/dd/d6d/d8c/ff [0,4194304] 0 2024-04-13T10:59:17.283 INFO:tasks.workunit.client.0.smithi134.stdout:7/555: write da/fa8 [6527181,32247] 0 2024-04-13T10:59:17.283 INFO:tasks.workunit.client.0.smithi134.stdout:2/518: write d5/de/d2e/d8f/f6e [5395944,94280] 0 2024-04-13T10:59:17.285 INFO:tasks.workunit.client.0.smithi134.stdout:5/768: mkdir dc/df3/df9 0 2024-04-13T10:59:17.286 INFO:tasks.workunit.client.0.smithi134.stdout:2/519: rename d5/d6/d70 to d5/d6/d70/d84/d99 22 2024-04-13T10:59:17.286 INFO:tasks.workunit.client.0.smithi134.stdout:1/718: fdatasync d3/d6/d16/d4d/f5f 0 2024-04-13T10:59:17.292 INFO:tasks.workunit.client.0.smithi134.stdout:4/531: dwrite d4/d1f/d27/d75/d38/d79/f35 [0,4194304] 0 2024-04-13T10:59:17.299 INFO:tasks.workunit.client.0.smithi134.stdout:5/769: creat dc/d15/df1/d3b/d7f/ffa x:0 0 0 2024-04-13T10:59:17.299 INFO:tasks.workunit.client.0.smithi134.stdout:7/556: mkdir da/d15/d85/db0 0 2024-04-13T10:59:17.301 INFO:tasks.workunit.client.0.smithi134.stdout:0/620: sync 2024-04-13T10:59:17.301 INFO:tasks.workunit.client.0.smithi134.stdout:9/712: sync 2024-04-13T10:59:17.302 INFO:tasks.workunit.client.0.smithi134.stdout:4/532: creat d4/d1f/d27/d75/d38/fab x:0 0 0 2024-04-13T10:59:17.303 INFO:tasks.workunit.client.0.smithi134.stdout:5/770: readlink dc/d1d/l5f 0 2024-04-13T10:59:17.303 INFO:tasks.workunit.client.0.smithi134.stdout:4/533: dread - d4/dd/d6d/d8c/d5f/fa4 zero size 2024-04-13T10:59:17.305 INFO:tasks.workunit.client.0.smithi134.stdout:7/557: mknod da/d15/d26/d27/d4f/d5f/d88/cb1 0 2024-04-13T10:59:17.306 INFO:tasks.workunit.client.0.smithi134.stdout:7/558: chown da/d15/d26/d27/d3d 2089985 1 2024-04-13T10:59:17.365 INFO:tasks.workunit.client.0.smithi134.stdout:8/683: dread d8/dc/d16/f1d [0,4194304] 0 2024-04-13T10:59:17.368 INFO:tasks.workunit.client.0.smithi134.stdout:2/520: dread d5/d6/f68 [0,4194304] 0 2024-04-13T10:59:17.369 INFO:tasks.workunit.client.0.smithi134.stdout:9/713: mkdir d13/d39/d58/dd5/dfc 0 2024-04-13T10:59:17.372 INFO:tasks.workunit.client.0.smithi134.stdout:1/719: link d3/d6/d20/d28/l59 d3/d6/de3/le9 0 2024-04-13T10:59:17.373 INFO:tasks.workunit.client.0.smithi134.stdout:1/720: write d3/d6/d16/f7d [2201974,7835] 0 2024-04-13T10:59:17.374 INFO:tasks.workunit.client.0.smithi134.stdout:4/534: symlink d4/d1f/d27/d75/d38/d79/d32/d67/d9b/lac 0 2024-04-13T10:59:17.375 INFO:tasks.workunit.client.0.smithi134.stdout:4/535: dread - d4/d48/d4a/d7e/f9a zero size 2024-04-13T10:59:17.376 INFO:tasks.workunit.client.0.smithi134.stdout:7/559: fdatasync da/d15/d26/d27/d4f/d5f/d67/d73/f75 0 2024-04-13T10:59:17.378 INFO:tasks.workunit.client.0.smithi134.stdout:7/560: truncate da/d15/d26/d27/d4f/d5f/d67/f80 1277407 0 2024-04-13T10:59:17.381 INFO:tasks.workunit.client.0.smithi134.stdout:2/521: fdatasync d5/de/d50/f5e 0 2024-04-13T10:59:17.388 INFO:tasks.workunit.client.0.smithi134.stdout:2/522: dwrite d5/de/f37 [0,4194304] 0 2024-04-13T10:59:17.397 INFO:tasks.workunit.client.0.smithi134.stdout:7/561: write da/d15/d26/d27/d4f/d5f/d67/d73/f75 [2726202,106274] 0 2024-04-13T10:59:17.399 INFO:tasks.workunit.client.0.smithi134.stdout:7/562: write da/d15/d26/d27/d4f/d5f/d67/d73/d92/f9a [589479,55645] 0 2024-04-13T10:59:17.406 INFO:tasks.workunit.client.0.smithi134.stdout:8/684: dwrite d8/dc/f7b [0,4194304] 0 2024-04-13T10:59:17.408 INFO:tasks.workunit.client.0.smithi134.stdout:8/685: write d8/dc/d16/d54/f65 [1013004,87852] 0 2024-04-13T10:59:17.408 INFO:tasks.workunit.client.0.smithi134.stdout:0/621: truncate d4/d17/da/f15 2643831 0 2024-04-13T10:59:17.410 INFO:tasks.workunit.client.0.smithi134.stdout:4/536: creat d4/d48/d50/da0/fad x:0 0 0 2024-04-13T10:59:17.414 INFO:tasks.workunit.client.0.smithi134.stdout:9/714: creat d13/d2e/ffd x:0 0 0 2024-04-13T10:59:17.416 INFO:tasks.workunit.client.0.smithi134.stdout:5/771: truncate dc/d15/df1/d3b/d7f/d8d/d7d/fd1 2514234 0 2024-04-13T10:59:17.422 INFO:tasks.workunit.client.0.smithi134.stdout:7/563: dread da/f54 [0,4194304] 0 2024-04-13T10:59:17.429 INFO:tasks.workunit.client.0.smithi134.stdout:1/721: getdents d3/d6/d20/d9f 0 2024-04-13T10:59:17.430 INFO:tasks.workunit.client.0.smithi134.stdout:2/523: rename d5/d6/d57/l81 to d5/d6/d57/d6c/l9a 0 2024-04-13T10:59:17.432 INFO:tasks.workunit.client.0.smithi134.stdout:7/564: readlink da/d15/d26/d4a/l79 0 2024-04-13T10:59:17.433 INFO:tasks.workunit.client.0.smithi134.stdout:8/686: truncate d8/dc/d16/d54/f77 531329 0 2024-04-13T10:59:17.434 INFO:tasks.workunit.client.0.smithi134.stdout:8/687: write d8/dc/fbc [1942337,46149] 0 2024-04-13T10:59:17.437 INFO:tasks.workunit.client.0.smithi134.stdout:0/622: symlink d4/d17/da/d22/d37/d6d/d97/dbe/le6 0 2024-04-13T10:59:17.438 INFO:tasks.workunit.client.0.smithi134.stdout:7/565: dread da/d15/d26/d27/d3d/d9c/d48/f5d [0,4194304] 0 2024-04-13T10:59:17.439 INFO:tasks.workunit.client.0.smithi134.stdout:5/772: mknod dc/d39/d63/da5/cfb 0 2024-04-13T10:59:17.441 INFO:tasks.workunit.client.0.smithi134.stdout:1/722: mknod d3/d6/d16/d1d/cea 0 2024-04-13T10:59:17.460 INFO:tasks.workunit.client.0.smithi134.stdout:1/723: creat d3/d30/feb x:0 0 0 2024-04-13T10:59:17.463 INFO:tasks.workunit.client.0.smithi134.stdout:4/537: getdents d4/d48/d4a/d7e 0 2024-04-13T10:59:17.469 INFO:tasks.workunit.client.0.smithi134.stdout:5/773: truncate dc/f14 742118 0 2024-04-13T10:59:17.470 INFO:tasks.workunit.client.0.smithi134.stdout:5/774: stat dc/d15/d65 0 2024-04-13T10:59:17.470 INFO:tasks.workunit.client.0.smithi134.stdout:5/775: fsync dc/d15/d50/f90 0 2024-04-13T10:59:17.471 INFO:tasks.workunit.client.0.smithi134.stdout:8/688: rmdir d8/dc/d2c/d68/d8c/d8f/db1 0 2024-04-13T10:59:17.472 INFO:tasks.workunit.client.0.smithi134.stdout:8/689: dread - d8/dc/d2c/d68/d8c/d8f/fd7 zero size 2024-04-13T10:59:17.473 INFO:tasks.workunit.client.0.smithi134.stdout:4/538: rename d4/d1f/f23 to d4/dd/d6d/d8c/d5f/fae 0 2024-04-13T10:59:17.478 INFO:tasks.workunit.client.0.smithi134.stdout:8/690: dwrite d8/dc/f45 [0,4194304] 0 2024-04-13T10:59:17.479 INFO:tasks.workunit.client.0.smithi134.stdout:5/776: readlink dc/d1d/d20/ddc/lc9 0 2024-04-13T10:59:17.480 INFO:tasks.workunit.client.0.smithi134.stdout:8/691: readlink d8/dc/d16/d54/d98/d9b/lab 0 2024-04-13T10:59:17.481 INFO:tasks.workunit.client.0.smithi134.stdout:1/724: rmdir d3/d6/d20/d6d/db1/de0 0 2024-04-13T10:59:17.482 INFO:tasks.workunit.client.0.smithi134.stdout:4/539: symlink d4/d1f/d27/d75/d38/d79/d32/laf 0 2024-04-13T10:59:17.490 INFO:tasks.workunit.client.0.smithi134.stdout:4/540: mknod d4/d1f/cb0 0 2024-04-13T10:59:17.491 INFO:tasks.workunit.client.0.smithi134.stdout:5/777: fdatasync dc/f1b 0 2024-04-13T10:59:17.493 INFO:tasks.workunit.client.0.smithi134.stdout:8/692: fsync d8/dc/d16/d54/d98/d9b/da3/fd3 0 2024-04-13T10:59:17.495 INFO:tasks.workunit.client.0.smithi134.stdout:1/725: mknod d3/cec 0 2024-04-13T10:59:17.495 INFO:tasks.workunit.client.0.smithi134.stdout:8/693: dread - d8/dc/d2c/d68/f6a zero size 2024-04-13T10:59:17.499 INFO:tasks.workunit.client.0.smithi134.stdout:1/726: dread d3/d6/d16/d1d/f94 [0,4194304] 0 2024-04-13T10:59:17.504 INFO:tasks.workunit.client.0.smithi134.stdout:5/778: link dc/d39/d63/da5/cfb dc/d1d/d20/d23/d5a/cfc 0 2024-04-13T10:59:17.506 INFO:tasks.workunit.client.0.smithi134.stdout:5/779: creat dc/dc1/ffd x:0 0 0 2024-04-13T10:59:17.509 INFO:tasks.workunit.client.0.smithi134.stdout:5/780: mkdir dc/df3/dfe 0 2024-04-13T10:59:17.514 INFO:tasks.workunit.client.0.smithi134.stdout:5/781: rmdir dc/d1d/d20/d23/d5a 39 2024-04-13T10:59:17.520 INFO:tasks.workunit.client.0.smithi134.stdout:5/782: chown dc/d1d/d2b/d30/fe9 483777075 1 2024-04-13T10:59:17.545 INFO:tasks.workunit.client.0.smithi134.stdout:2/524: write d5/d6/d57/d6c/f67 [83675,39480] 0 2024-04-13T10:59:17.548 INFO:tasks.workunit.client.0.smithi134.stdout:7/566: dwrite da/d15/f24 [0,4194304] 0 2024-04-13T10:59:17.551 INFO:tasks.workunit.client.0.smithi134.stdout:0/623: dwrite d4/d17/da/d22/d37/fac [0,4194304] 0 2024-04-13T10:59:17.554 INFO:tasks.workunit.client.0.smithi134.stdout:0/624: readlink d4/d17/d23/d51/d6a/l7e 0 2024-04-13T10:59:17.558 INFO:tasks.workunit.client.0.smithi134.stdout:5/783: dread dc/d1d/d20/d23/f32 [0,4194304] 0 2024-04-13T10:59:17.567 INFO:tasks.workunit.client.0.smithi134.stdout:8/694: dwrite d8/dc/d37/f3b [4194304,4194304] 0 2024-04-13T10:59:17.574 INFO:tasks.workunit.client.0.smithi134.stdout:1/727: write d3/d6/d16/d1d/d86/fb4 [62555,58317] 0 2024-04-13T10:59:17.594 INFO:tasks.workunit.client.0.smithi134.stdout:7/567: dread - da/d15/d26/d27/d3d/f7a zero size 2024-04-13T10:59:17.598 INFO:tasks.workunit.client.0.smithi134.stdout:0/625: mknod d4/d17/da/d22/d37/d6d/d97/ce7 0 2024-04-13T10:59:17.620 INFO:tasks.workunit.client.0.smithi134.stdout:0/626: fdatasync d4/d17/d23/d51/d6b/d91/d98/d62/f85 0 2024-04-13T10:59:17.626 INFO:tasks.workunit.client.0.smithi134.stdout:2/525: creat d5/d6/d57/d6f/d30/d58/f9b x:0 0 0 2024-04-13T10:59:17.631 INFO:tasks.workunit.client.0.smithi134.stdout:0/627: symlink d4/d17/da/d22/d37/d6d/le8 0 2024-04-13T10:59:17.632 INFO:tasks.workunit.client.0.smithi134.stdout:0/628: chown d4/d17/da/d22/d37/d6d 4748885 1 2024-04-13T10:59:17.634 INFO:tasks.workunit.client.0.smithi134.stdout:1/728: getdents d3/d6/d16/d1d/d3c 0 2024-04-13T10:59:17.635 INFO:tasks.workunit.client.0.smithi134.stdout:1/729: fsync d3/d6/d16/d1d/d86/f96 0 2024-04-13T10:59:17.638 INFO:tasks.workunit.client.0.smithi134.stdout:2/526: truncate d5/d6/f68 1569627 0 2024-04-13T10:59:17.645 INFO:tasks.workunit.client.0.smithi134.stdout:2/527: fsync d5/de/d50/f5d 0 2024-04-13T10:59:17.649 INFO:tasks.workunit.client.0.smithi134.stdout:2/528: mkdir d5/d6/d70/d9c 0 2024-04-13T10:59:17.650 INFO:tasks.workunit.client.0.smithi134.stdout:2/529: stat d5/de/d2e/f64 0 2024-04-13T10:59:17.658 INFO:tasks.workunit.client.0.smithi134.stdout:1/730: dread d3/d6/f15 [0,4194304] 0 2024-04-13T10:59:17.669 INFO:tasks.workunit.client.0.smithi134.stdout:1/731: dwrite d3/d6/d20/d71/fa4 [0,4194304] 0 2024-04-13T10:59:17.669 INFO:tasks.workunit.client.0.smithi134.stdout:7/568: truncate da/d15/d26/d27/d4f/d5f/d67/d73/d92/f9a 435917 0 2024-04-13T10:59:17.672 INFO:tasks.workunit.client.0.smithi134.stdout:2/530: truncate d5/d6/f68 1826761 0 2024-04-13T10:59:17.676 INFO:tasks.workunit.client.0.smithi134.stdout:0/629: write d4/d17/d23/d51/d6b/d91/d98/d62/f85 [2881125,86713] 0 2024-04-13T10:59:17.678 INFO:tasks.workunit.client.0.smithi134.stdout:8/695: dwrite d8/dc/d13/f7f [0,4194304] 0 2024-04-13T10:59:17.679 INFO:tasks.workunit.client.0.smithi134.stdout:5/784: dwrite dc/f14 [0,4194304] 0 2024-04-13T10:59:17.682 INFO:tasks.workunit.client.0.smithi134.stdout:5/785: chown dc/f1b 848 1 2024-04-13T10:59:17.685 INFO:tasks.workunit.client.0.smithi134.stdout:0/630: creat d4/d17/da/d22/d37/fe9 x:0 0 0 2024-04-13T10:59:17.687 INFO:tasks.workunit.client.0.smithi134.stdout:0/631: read - d4/d17/d23/f83 zero size 2024-04-13T10:59:17.691 INFO:tasks.workunit.client.0.smithi134.stdout:8/696: creat d8/dc/d13/ddf/fea x:0 0 0 2024-04-13T10:59:17.693 INFO:tasks.workunit.client.0.smithi134.stdout:2/531: link d5/d6/d57/d6c/f67 d5/d6/d57/d6f/d30/d58/f9d 0 2024-04-13T10:59:17.698 INFO:tasks.workunit.client.0.smithi134.stdout:0/632: creat d4/d17/da/d22/d37/d6d/d97/fea x:0 0 0 2024-04-13T10:59:17.699 INFO:tasks.workunit.client.0.smithi134.stdout:8/697: symlink d8/dc/d16/d54/d98/d9b/dd4/leb 0 2024-04-13T10:59:17.701 INFO:tasks.workunit.client.0.smithi134.stdout:7/569: write da/d15/d26/d27/d3d/d9c/d48/f93 [2115065,36343] 0 2024-04-13T10:59:17.702 INFO:tasks.workunit.client.0.smithi134.stdout:0/633: write d4/d17/d20/d29/d30/fd6 [1017260,81137] 0 2024-04-13T10:59:17.717 INFO:tasks.workunit.client.0.smithi134.stdout:0/634: rename d4/d17/d20/da9/de1/dcf/d9e/d78 to d4/d17/da/d22/deb 0 2024-04-13T10:59:17.719 INFO:tasks.workunit.client.0.smithi134.stdout:2/532: dread d5/de/f75 [0,4194304] 0 2024-04-13T10:59:17.721 INFO:tasks.workunit.client.0.smithi134.stdout:0/635: fdatasync d4/d17/d23/d51/d6a/d94/db2/f44 0 2024-04-13T10:59:17.724 INFO:tasks.workunit.client.0.smithi134.stdout:5/786: truncate dc/d15/df1/d3b/d7f/d8d/d7d/dc0/fc4 2225104 0 2024-04-13T10:59:17.725 INFO:tasks.workunit.client.0.smithi134.stdout:2/533: unlink d5/d6/d57/d6f/d30/d58/l77 0 2024-04-13T10:59:17.726 INFO:tasks.workunit.client.0.smithi134.stdout:5/787: write dc/d15/df1/d3b/d7f/d8d/d7d/fe7 [385282,88104] 0 2024-04-13T10:59:17.726 INFO:tasks.workunit.client.0.smithi134.stdout:7/570: write da/d15/d26/d38/fa0 [293580,16766] 0 2024-04-13T10:59:17.730 INFO:tasks.workunit.client.0.smithi134.stdout:0/636: mknod d4/d17/d20/d29/d30/d7f/cec 0 2024-04-13T10:59:17.732 INFO:tasks.workunit.client.0.smithi134.stdout:2/534: creat d5/d6/d34/f9e x:0 0 0 2024-04-13T10:59:17.734 INFO:tasks.workunit.client.0.smithi134.stdout:2/535: chown d5/de/d50/f5d 77578 1 2024-04-13T10:59:17.736 INFO:tasks.workunit.client.0.smithi134.stdout:7/571: dwrite da/d15/d26/d27/d3d/d9c/d48/f93 [4194304,4194304] 0 2024-04-13T10:59:17.737 INFO:tasks.workunit.client.0.smithi134.stdout:0/637: dread d4/d17/d20/da9/de1/dcf/d96/f9a [0,4194304] 0 2024-04-13T10:59:17.739 INFO:tasks.workunit.client.0.smithi134.stdout:5/788: getdents dc/d39/d63/de2 0 2024-04-13T10:59:17.740 INFO:tasks.workunit.client.0.smithi134.stdout:2/536: mknod d5/d6/d34/c9f 0 2024-04-13T10:59:17.742 INFO:tasks.workunit.client.0.smithi134.stdout:5/789: readlink dc/d1d/lce 0 2024-04-13T10:59:17.744 INFO:tasks.workunit.client.0.smithi134.stdout:0/638: creat d4/d17/d23/d51/d6a/d73/fed x:0 0 0 2024-04-13T10:59:17.745 INFO:tasks.workunit.client.0.smithi134.stdout:2/537: stat d5/de/c5c 0 2024-04-13T10:59:17.747 INFO:tasks.workunit.client.0.smithi134.stdout:7/572: dwrite da/d15/d26/f30 [0,4194304] 0 2024-04-13T10:59:17.750 INFO:tasks.workunit.client.0.smithi134.stdout:5/790: mkdir dc/d15/df1/d3b/d3c/dff 0 2024-04-13T10:59:17.761 INFO:tasks.workunit.client.0.smithi134.stdout:5/791: dwrite dc/d1d/d46/f97 [0,4194304] 0 2024-04-13T10:59:17.765 INFO:tasks.workunit.client.0.smithi134.stdout:0/639: rename d4/d17/d20/d29/d30/d3e/lb3 to d4/d17/d23/d51/d6b/lee 0 2024-04-13T10:59:17.768 INFO:tasks.workunit.client.0.smithi134.stdout:5/792: dread - dc/dc1/ffd zero size 2024-04-13T10:59:17.771 INFO:tasks.workunit.client.0.smithi134.stdout:5/793: dread dc/f96 [0,4194304] 0 2024-04-13T10:59:17.775 INFO:tasks.workunit.client.0.smithi134.stdout:0/640: fsync d4/d17/d20/d29/d30/d64/d84/dd3/f93 0 2024-04-13T10:59:17.778 INFO:tasks.workunit.client.0.smithi134.stdout:5/794: dread - dc/d15/df1/d3b/d6a/f8b zero size 2024-04-13T10:59:17.784 INFO:tasks.workunit.client.0.smithi134.stdout:5/795: dread dc/d1d/d20/ddc/fc2 [0,4194304] 0 2024-04-13T10:59:17.785 INFO:tasks.workunit.client.0.smithi134.stdout:5/796: fdatasync dc/d15/d65/fcf 0 2024-04-13T10:59:17.786 INFO:tasks.workunit.client.0.smithi134.stdout:7/573: write da/d15/d26/d27/f5c [4545953,112443] 0 2024-04-13T10:59:17.787 INFO:tasks.workunit.client.0.smithi134.stdout:7/574: chown da/d15/d26/f62 211832688 1 2024-04-13T10:59:17.793 INFO:tasks.workunit.client.0.smithi134.stdout:7/575: read da/d15/f22 [2498947,21109] 0 2024-04-13T10:59:17.797 INFO:tasks.workunit.client.0.smithi134.stdout:7/576: chown da/d15/d26/d27/d4f/d5f/d67/d73/ca4 408806998 1 2024-04-13T10:59:17.798 INFO:tasks.workunit.client.0.smithi134.stdout:7/577: write da/d15/d26/d27/d4f/d5f/d67/d73/f75 [3894272,129256] 0 2024-04-13T10:59:17.800 INFO:tasks.workunit.client.0.smithi134.stdout:7/578: getdents da/d15/d85/db0 0 2024-04-13T10:59:17.802 INFO:tasks.workunit.client.0.smithi134.stdout:7/579: readlink da/d15/d26/d4a/l79 0 2024-04-13T10:59:17.802 INFO:tasks.workunit.client.0.smithi134.stdout:0/641: write d4/d17/d20/d29/d30/d64/d84/f8d [1625155,38795] 0 2024-04-13T10:59:17.803 INFO:tasks.workunit.client.0.smithi134.stdout:0/642: truncate d4/d17/fc5 2298617 0 2024-04-13T10:59:17.805 INFO:tasks.workunit.client.0.smithi134.stdout:5/797: truncate dc/d15/d65/fcf 39578 0 2024-04-13T10:59:17.806 INFO:tasks.workunit.client.0.smithi134.stdout:7/580: dread da/d15/d26/fae [0,4194304] 0 2024-04-13T10:59:17.807 INFO:tasks.workunit.client.0.smithi134.stdout:5/798: mkdir dc/d1d/d2b/d30/d100 0 2024-04-13T10:59:17.812 INFO:tasks.workunit.client.0.smithi134.stdout:7/581: dwrite da/f13 [0,4194304] 0 2024-04-13T10:59:17.821 INFO:tasks.workunit.client.0.smithi134.stdout:5/799: dwrite dc/d1d/d67/fa6 [0,4194304] 0 2024-04-13T10:59:17.827 INFO:tasks.workunit.client.0.smithi134.stdout:5/800: rename c3 to dc/d15/df1/d3b/d3c/dd3/c101 0 2024-04-13T10:59:17.831 INFO:tasks.workunit.client.0.smithi134.stdout:5/801: mknod dc/d1d/d2b/d30/d3e/df4/c102 0 2024-04-13T10:59:17.854 INFO:tasks.workunit.client.0.smithi134.stdout:5/802: dread dc/d1d/d46/f70 [0,4194304] 0 2024-04-13T10:59:17.856 INFO:tasks.workunit.client.0.smithi134.stdout:5/803: creat dc/df3/df9/f103 x:0 0 0 2024-04-13T10:59:17.857 INFO:tasks.workunit.client.0.smithi134.stdout:5/804: chown fb 13360 1 2024-04-13T10:59:17.861 INFO:tasks.workunit.client.0.smithi134.stdout:5/805: link dc/d1d/d67/fa6 dc/d1d/d2b/d30/d3e/f104 0 2024-04-13T10:59:17.863 INFO:tasks.workunit.client.0.smithi134.stdout:5/806: mkdir dc/d15/df1/d3b/d7f/d8d/d7d/dc0/d105 0 2024-04-13T10:59:17.873 INFO:tasks.workunit.client.0.smithi134.stdout:5/807: write dc/d1d/d20/fae [1376967,114464] 0 2024-04-13T10:59:17.877 INFO:tasks.workunit.client.0.smithi134.stdout:5/808: write dc/d1d/f1f [1639765,97822] 0 2024-04-13T10:59:17.884 INFO:tasks.workunit.client.0.smithi134.stdout:5/809: dwrite dc/d1d/d20/d23/f86 [0,4194304] 0 2024-04-13T10:59:17.890 INFO:tasks.workunit.client.0.smithi134.stdout:5/810: rename dc/d1d/d20/d23/d36/dbd/fdd to dc/d15/df1/d3b/f106 0 2024-04-13T10:59:17.892 INFO:tasks.workunit.client.0.smithi134.stdout:5/811: chown dc/d1d/d20/d23/cb6 124032 1 2024-04-13T10:59:17.893 INFO:tasks.workunit.client.0.smithi134.stdout:5/812: mknod dc/d15/df1/d3b/d3c/c107 0 2024-04-13T10:59:17.894 INFO:tasks.workunit.client.0.smithi134.stdout:5/813: chown dc/d15/dab/cb5 201958 1 2024-04-13T10:59:17.897 INFO:tasks.workunit.client.0.smithi134.stdout:5/814: mknod dc/d15/df1/d3b/d3c/dff/c108 0 2024-04-13T10:59:17.897 INFO:tasks.workunit.client.0.smithi134.stdout:5/815: stat dc/d1d/f1f 0 2024-04-13T10:59:17.898 INFO:tasks.workunit.client.0.smithi134.stdout:5/816: mknod dc/d15/d65/c109 0 2024-04-13T10:59:17.900 INFO:tasks.workunit.client.0.smithi134.stdout:5/817: mknod dc/d15/dab/c10a 0 2024-04-13T10:59:17.903 INFO:tasks.workunit.client.0.smithi134.stdout:5/818: symlink dc/d15/df1/d3b/l10b 0 2024-04-13T10:59:17.955 INFO:tasks.workunit.client.0.smithi134.stdout:6/681: sync 2024-04-13T10:59:17.956 INFO:tasks.workunit.client.0.smithi134.stdout:6/682: write d4/da/d15/d1f/d24/d2b/f3f [2253863,120085] 0 2024-04-13T10:59:17.957 INFO:tasks.workunit.client.0.smithi134.stdout:6/683: write d4/da/dbb/dad/fd8 [511915,107487] 0 2024-04-13T10:59:17.958 INFO:tasks.workunit.client.0.smithi134.stdout:6/684: fdatasync d4/da/d15/d77/d63/f86 0 2024-04-13T10:59:17.959 INFO:tasks.workunit.client.0.smithi134.stdout:6/685: chown d4/da/d1a/f29 304 1 2024-04-13T10:59:17.965 INFO:tasks.workunit.client.0.smithi134.stdout:6/686: creat d4/da/d15/d1f/d3c/dd0/fe0 x:0 0 0 2024-04-13T10:59:17.966 INFO:tasks.workunit.client.0.smithi134.stdout:6/687: fdatasync d4/da/d15/d77/f82 0 2024-04-13T10:59:17.967 INFO:tasks.workunit.client.0.smithi134.stdout:6/688: truncate d4/da/d15/d1f/d24/da4/faa 844939 0 2024-04-13T10:59:17.968 INFO:tasks.workunit.client.0.smithi134.stdout:6/689: readlink d4/da/d15/d1f/d24/d49/d91/ld4 0 2024-04-13T10:59:17.969 INFO:tasks.workunit.client.0.smithi134.stdout:5/819: write dc/d15/f94 [693001,64212] 0 2024-04-13T10:59:17.976 INFO:tasks.workunit.client.0.smithi134.stdout:6/690: dwrite d4/da/d15/d77/d63/f8c [8388608,4194304] 0 2024-04-13T10:59:17.977 INFO:tasks.workunit.client.0.smithi134.stdout:5/820: creat dc/d15/df1/d3b/d3c/dff/f10c x:0 0 0 2024-04-13T10:59:17.981 INFO:tasks.workunit.client.0.smithi134.stdout:6/691: creat d4/da/d15/d1f/d24/d49/d91/dc9/fe1 x:0 0 0 2024-04-13T10:59:17.982 INFO:tasks.workunit.client.0.smithi134.stdout:5/821: symlink dc/d15/l10d 0 2024-04-13T10:59:17.982 INFO:tasks.workunit.client.0.smithi134.stdout:6/692: chown d4/da/d15/fd3 2 1 2024-04-13T10:59:17.985 INFO:tasks.workunit.client.0.smithi134.stdout:6/693: rmdir d4/da/d15/d1f/d3c 39 2024-04-13T10:59:17.986 INFO:tasks.workunit.client.0.smithi134.stdout:5/822: mkdir dc/d1d/d2b/d30/d100/d10e 0 2024-04-13T10:59:17.988 INFO:tasks.workunit.client.0.smithi134.stdout:5/823: read - dc/d1d/d20/d23/d36/dbd/f9f zero size 2024-04-13T10:59:17.992 INFO:tasks.workunit.client.0.smithi134.stdout:6/694: dwrite d4/da/d15/d1f/d24/f3a [0,4194304] 0 2024-04-13T10:59:17.993 INFO:tasks.workunit.client.0.smithi134.stdout:6/695: readlink d4/lc 0 2024-04-13T10:59:17.999 INFO:tasks.workunit.client.0.smithi134.stdout:6/696: rename d4/da/d15/d1f/f6b to d4/da/d68/fe2 0 2024-04-13T10:59:18.000 INFO:tasks.workunit.client.0.smithi134.stdout:6/697: chown d4/da/d15/d76/d92 0 1 2024-04-13T10:59:18.005 INFO:tasks.workunit.client.0.smithi134.stdout:6/698: dwrite d4/da/d15/d1f/d24/da4/fb2 [0,4194304] 0 2024-04-13T10:59:18.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/699: dwrite d4/da/d15/fd3 [0,4194304] 0 2024-04-13T10:59:18.015 INFO:tasks.workunit.client.0.smithi134.stdout:6/700: mknod d4/da/d69/ce3 0 2024-04-13T10:59:18.020 INFO:tasks.workunit.client.0.smithi134.stdout:5/824: dwrite dc/d15/df1/d3b/d7f/d8d/d7d/dc0/fc4 [0,4194304] 0 2024-04-13T10:59:18.028 INFO:tasks.workunit.client.0.smithi134.stdout:6/701: getdents d4/da/d15/d1f/d24/d2b 0 2024-04-13T10:59:18.030 INFO:tasks.workunit.client.0.smithi134.stdout:5/825: mkdir dc/d15/df1/d3b/d7f/d8d/d7d/dc0/d105/d10f 0 2024-04-13T10:59:18.031 INFO:tasks.workunit.client.0.smithi134.stdout:5/826: write dc/d1d/d20/f87 [110065,84469] 0 2024-04-13T10:59:18.034 INFO:tasks.workunit.client.0.smithi134.stdout:5/827: truncate dc/d1d/d20/f62 275700 0 2024-04-13T10:59:18.035 INFO:tasks.workunit.client.0.smithi134.stdout:6/702: link d4/da/dbb/dc3/f5a d4/da/d68/fe4 0 2024-04-13T10:59:18.037 INFO:tasks.workunit.client.0.smithi134.stdout:6/703: mkdir d4/da/dbb/de5 0 2024-04-13T10:59:18.038 INFO:tasks.workunit.client.0.smithi134.stdout:5/828: mkdir dc/d15/df1/d3b/d3c/d110 0 2024-04-13T10:59:18.039 INFO:tasks.workunit.client.0.smithi134.stdout:5/829: dread - dc/d15/df1/d3b/d7f/d8d/fe4 zero size 2024-04-13T10:59:18.043 INFO:tasks.workunit.client.0.smithi134.stdout:5/830: mknod dc/d15/df1/d3b/d7f/c111 0 2024-04-13T10:59:18.044 INFO:tasks.workunit.client.0.smithi134.stdout:6/704: dwrite d4/da/fc8 [0,4194304] 0 2024-04-13T10:59:18.044 INFO:tasks.workunit.client.0.smithi134.stdout:6/705: chown d4/da/d15/d1f/f4b 14845963 1 2024-04-13T10:59:18.047 INFO:tasks.workunit.client.0.smithi134.stdout:5/831: mknod dc/df3/c112 0 2024-04-13T10:59:18.048 INFO:tasks.workunit.client.0.smithi134.stdout:6/706: unlink d4/da/c47 0 2024-04-13T10:59:18.057 INFO:tasks.workunit.client.0.smithi134.stdout:6/707: truncate d4/f4d 1001929 0 2024-04-13T10:59:18.061 INFO:tasks.workunit.client.0.smithi134.stdout:6/708: rmdir d4/da/d15 39 2024-04-13T10:59:18.070 INFO:tasks.workunit.client.0.smithi134.stdout:5/832: dwrite dc/d1d/d2b/d30/d3e/fc7 [0,4194304] 0 2024-04-13T10:59:18.077 INFO:tasks.workunit.client.0.smithi134.stdout:5/833: creat dc/f113 x:0 0 0 2024-04-13T10:59:18.079 INFO:tasks.workunit.client.0.smithi134.stdout:5/834: truncate fb 2765276 0 2024-04-13T10:59:18.093 INFO:tasks.workunit.client.0.smithi134.stdout:5/835: write dc/d1d/d2b/d30/d3e/f104 [1449920,95889] 0 2024-04-13T10:59:18.098 INFO:tasks.workunit.client.0.smithi134.stdout:5/836: dread dc/d15/d65/fcf [0,4194304] 0 2024-04-13T10:59:18.102 INFO:tasks.workunit.client.0.smithi134.stdout:5/837: write dc/d1d/d67/fb7 [2824251,77625] 0 2024-04-13T10:59:18.107 INFO:tasks.workunit.client.0.smithi134.stdout:5/838: unlink dc/d1d/d20/d23/d38/lc3 0 2024-04-13T10:59:18.110 INFO:tasks.workunit.client.0.smithi134.stdout:5/839: creat dc/d15/df8/f114 x:0 0 0 2024-04-13T10:59:18.121 INFO:tasks.workunit.client.0.smithi134.stdout:5/840: dwrite dc/d15/df1/d3b/f106 [0,4194304] 0 2024-04-13T10:59:18.125 INFO:tasks.workunit.client.0.smithi134.stdout:5/841: mkdir dc/d15/df8/d115 0 2024-04-13T10:59:18.129 INFO:tasks.workunit.client.0.smithi134.stdout:5/842: dread dc/d1d/d20/d23/f86 [0,4194304] 0 2024-04-13T10:59:18.194 INFO:tasks.workunit.client.0.smithi134.stdout:1/732: sync 2024-04-13T10:59:18.194 INFO:tasks.workunit.client.0.smithi134.stdout:9/715: sync 2024-04-13T10:59:18.194 INFO:tasks.workunit.client.0.smithi134.stdout:4/541: sync 2024-04-13T10:59:18.194 INFO:tasks.workunit.client.0.smithi134.stdout:3/585: sync 2024-04-13T10:59:18.200 INFO:tasks.workunit.client.0.smithi134.stdout:5/843: write dc/d15/df1/d3b/d6a/f83 [383312,110371] 0 2024-04-13T10:59:18.200 INFO:tasks.workunit.client.0.smithi134.stdout:3/586: dwrite dc/fd [0,4194304] 0 2024-04-13T10:59:18.204 INFO:tasks.workunit.client.0.smithi134.stdout:1/733: rename d3/d30/c63 to d3/d6/d20/ced 0 2024-04-13T10:59:18.205 INFO:tasks.workunit.client.0.smithi134.stdout:4/542: symlink d4/d1f/d27/d2e/d84/lb1 0 2024-04-13T10:59:18.209 INFO:tasks.workunit.client.0.smithi134.stdout:5/844: truncate dc/d15/df1/d3b/fcb 292914 0 2024-04-13T10:59:18.212 INFO:tasks.workunit.client.0.smithi134.stdout:4/543: creat d4/d1f/d27/d75/d38/d79/fb2 x:0 0 0 2024-04-13T10:59:18.213 INFO:tasks.workunit.client.0.smithi134.stdout:9/716: link d13/f2d d13/d2e/d35/d50/ffe 0 2024-04-13T10:59:18.215 INFO:tasks.workunit.client.0.smithi134.stdout:5/845: mkdir dc/d1d/d20/d23/d5a/d116 0 2024-04-13T10:59:18.223 INFO:tasks.workunit.client.0.smithi134.stdout:5/846: creat dc/d15/df1/d3b/d7f/d8d/f117 x:0 0 0 2024-04-13T10:59:18.223 INFO:tasks.workunit.client.0.smithi134.stdout:5/847: mkdir dc/d118 0 2024-04-13T10:59:18.228 INFO:tasks.workunit.client.0.smithi134.stdout:1/734: write d3/d6/dd/f56 [513386,9220] 0 2024-04-13T10:59:18.230 INFO:tasks.workunit.client.0.smithi134.stdout:3/587: dread dc/d27/d19/d48/d49/f6c [0,4194304] 0 2024-04-13T10:59:18.230 INFO:tasks.workunit.client.0.smithi134.stdout:1/735: readlink d3/d6/d16/d4d/l79 0 2024-04-13T10:59:18.233 INFO:tasks.workunit.client.0.smithi134.stdout:3/588: symlink dc/d27/d19/lbb 0 2024-04-13T10:59:18.233 INFO:tasks.workunit.client.0.smithi134.stdout:9/717: write d13/da3/fc9 [678067,50106] 0 2024-04-13T10:59:18.237 INFO:tasks.workunit.client.0.smithi134.stdout:9/718: write d13/d2e/d35/f6a [2538774,21744] 0 2024-04-13T10:59:18.239 INFO:tasks.workunit.client.0.smithi134.stdout:9/719: read d13/d40/f42 [301354,17290] 0 2024-04-13T10:59:18.241 INFO:tasks.workunit.client.0.smithi134.stdout:3/589: rename dc/d27/d19/d8b/da8/d50/d25/f3c to dc/fbc 0 2024-04-13T10:59:18.243 INFO:tasks.workunit.client.0.smithi134.stdout:5/848: dwrite dc/d1d/d20/d23/f32 [0,4194304] 0 2024-04-13T10:59:18.244 INFO:tasks.workunit.client.0.smithi134.stdout:4/544: dread d4/d1f/d27/d75/d38/f41 [0,4194304] 0 2024-04-13T10:59:18.252 INFO:tasks.workunit.client.0.smithi134.stdout:1/736: dwrite d3/d6/d16/d1d/d68/f5d [0,4194304] 0 2024-04-13T10:59:18.257 INFO:tasks.workunit.client.0.smithi134.stdout:5/849: symlink dc/d39/dec/l119 0 2024-04-13T10:59:18.262 INFO:tasks.workunit.client.0.smithi134.stdout:1/737: fsync d3/d6/d16/fa8 0 2024-04-13T10:59:18.264 INFO:tasks.workunit.client.0.smithi134.stdout:4/545: dwrite d4/d1f/d27/d75/d38/d79/f28 [0,4194304] 0 2024-04-13T10:59:18.268 INFO:tasks.workunit.client.0.smithi134.stdout:9/720: getdents d13/d39/d52/d86/d9f 0 2024-04-13T10:59:18.269 INFO:tasks.workunit.client.0.smithi134.stdout:5/850: mknod dc/d1d/d20/d23/c11a 0 2024-04-13T10:59:18.273 INFO:tasks.workunit.client.0.smithi134.stdout:1/738: unlink d3/d6/lcf 0 2024-04-13T10:59:18.274 INFO:tasks.workunit.client.0.smithi134.stdout:9/721: mknod d13/da3/d98/db3/cff 0 2024-04-13T10:59:18.279 INFO:tasks.workunit.client.0.smithi134.stdout:3/590: rename dc/d27/d19/d8b/da8/d50/d25/f47 to dc/d2a/fbd 0 2024-04-13T10:59:18.283 INFO:tasks.workunit.client.0.smithi134.stdout:1/739: creat d3/d6/d20/d9f/dbe/fee x:0 0 0 2024-04-13T10:59:18.284 INFO:tasks.workunit.client.0.smithi134.stdout:5/851: symlink dc/d15/l11b 0 2024-04-13T10:59:18.284 INFO:tasks.workunit.client.0.smithi134.stdout:5/852: stat f9 0 2024-04-13T10:59:18.287 INFO:tasks.workunit.client.0.smithi134.stdout:9/722: mkdir d13/d39/d64/db2/d100 0 2024-04-13T10:59:18.293 INFO:tasks.workunit.client.0.smithi134.stdout:9/723: creat d13/d39/d58/d5f/d6e/f101 x:0 0 0 2024-04-13T10:59:18.294 INFO:tasks.workunit.client.0.smithi134.stdout:3/591: creat dc/d27/d95/fbe x:0 0 0 2024-04-13T10:59:18.300 INFO:tasks.workunit.client.0.smithi134.stdout:9/724: mkdir d13/d39/d58/d5f/dac/d102 0 2024-04-13T10:59:18.300 INFO:tasks.workunit.client.0.smithi134.stdout:5/853: getdents dc/df3 0 2024-04-13T10:59:18.304 INFO:tasks.workunit.client.0.smithi134.stdout:5/854: truncate dc/d39/f41 1293361 0 2024-04-13T10:59:18.306 INFO:tasks.workunit.client.0.smithi134.stdout:4/546: dread d4/d1f/d27/d75/f31 [0,4194304] 0 2024-04-13T10:59:18.309 INFO:tasks.workunit.client.0.smithi134.stdout:3/592: link dc/d27/d4d/lb6 dc/d1d/lbf 0 2024-04-13T10:59:18.311 INFO:tasks.workunit.client.0.smithi134.stdout:4/547: mkdir d4/d1f/d27/d3a/d53/d58/d7f/db3 0 2024-04-13T10:59:18.314 INFO:tasks.workunit.client.0.smithi134.stdout:5/855: dwrite dc/d1d/d20/d23/f42 [0,4194304] 0 2024-04-13T10:59:18.316 INFO:tasks.workunit.client.0.smithi134.stdout:3/593: creat dc/d27/d19/d8b/da8/d50/d25/d5f/d99/fc0 x:0 0 0 2024-04-13T10:59:18.318 INFO:tasks.workunit.client.0.smithi134.stdout:5/856: chown dc/d15/df1/d3b/d7f/d8d/fe4 0 1 2024-04-13T10:59:18.321 INFO:tasks.workunit.client.0.smithi134.stdout:3/594: fdatasync dc/d1d/d58/f7e 0 2024-04-13T10:59:18.322 INFO:tasks.workunit.client.0.smithi134.stdout:1/740: dwrite d3/d6/d20/f75 [0,4194304] 0 2024-04-13T10:59:18.331 INFO:tasks.workunit.client.0.smithi134.stdout:9/725: dwrite d13/d39/d58/f66 [0,4194304] 0 2024-04-13T10:59:18.337 INFO:tasks.workunit.client.0.smithi134.stdout:9/726: write d13/d39/d58/d5f/d6e/f101 [513301,88479] 0 2024-04-13T10:59:18.339 INFO:tasks.workunit.client.0.smithi134.stdout:5/857: link dc/d1d/d20/d23/f86 dc/d1d/d2b/f11c 0 2024-04-13T10:59:18.340 INFO:tasks.workunit.client.0.smithi134.stdout:4/548: truncate d4/d1f/d90/fa2 2783120 0 2024-04-13T10:59:18.340 INFO:tasks.workunit.client.0.smithi134.stdout:5/858: stat dc/d15/df1/d3b/d6a/l79 0 2024-04-13T10:59:18.341 INFO:tasks.workunit.client.0.smithi134.stdout:1/741: link d3/d6/d6a/f78 d3/d6/d20/d6d/db1/fef 0 2024-04-13T10:59:18.342 INFO:tasks.workunit.client.0.smithi134.stdout:9/727: unlink d13/d39/f4d 0 2024-04-13T10:59:18.343 INFO:tasks.workunit.client.0.smithi134.stdout:4/549: fsync d4/dd/d6d/f80 0 2024-04-13T10:59:18.347 INFO:tasks.workunit.client.0.smithi134.stdout:5/859: dwrite dc/d39/d63/fee [0,4194304] 0 2024-04-13T10:59:18.354 INFO:tasks.workunit.client.0.smithi134.stdout:5/860: creat dc/dc1/f11d x:0 0 0 2024-04-13T10:59:18.356 INFO:tasks.workunit.client.0.smithi134.stdout:5/861: write dc/d1d/d46/f97 [45736,7691] 0 2024-04-13T10:59:18.357 INFO:tasks.workunit.client.0.smithi134.stdout:3/595: dread dc/fe [0,4194304] 0 2024-04-13T10:59:18.371 INFO:tasks.workunit.client.0.smithi134.stdout:1/742: dwrite d3/d30/f48 [0,4194304] 0 2024-04-13T10:59:18.373 INFO:tasks.workunit.client.0.smithi134.stdout:1/743: write d3/d6/d16/d1d/f26 [2264299,16269] 0 2024-04-13T10:59:18.375 INFO:tasks.workunit.client.0.smithi134.stdout:9/728: dread d13/d39/d64/db2/ff9 [0,4194304] 0 2024-04-13T10:59:18.376 INFO:tasks.workunit.client.0.smithi134.stdout:9/729: fdatasync d13/f17 0 2024-04-13T10:59:18.377 INFO:tasks.workunit.client.0.smithi134.stdout:1/744: symlink d3/d30/lf0 0 2024-04-13T10:59:18.379 INFO:tasks.workunit.client.0.smithi134.stdout:3/596: write dc/d27/d4d/f5e [1157326,52675] 0 2024-04-13T10:59:18.381 INFO:tasks.workunit.client.0.smithi134.stdout:9/730: mkdir d13/da3/d98/d103 0 2024-04-13T10:59:18.384 INFO:tasks.workunit.client.0.smithi134.stdout:9/731: unlink lf 0 2024-04-13T10:59:18.386 INFO:tasks.workunit.client.0.smithi134.stdout:9/732: dread - d13/d39/d58/dd5/de5/ff4 zero size 2024-04-13T10:59:18.387 INFO:tasks.workunit.client.0.smithi134.stdout:5/862: dwrite dc/d1d/d20/d23/d36/f8c [0,4194304] 0 2024-04-13T10:59:18.390 INFO:tasks.workunit.client.0.smithi134.stdout:1/745: rename d3/d6/d16/d1d/f22 to d3/d6/d20/d6d/ff1 0 2024-04-13T10:59:18.390 INFO:tasks.workunit.client.0.smithi134.stdout:9/733: chown d13/d39/lf6 26662944 1 2024-04-13T10:59:18.395 INFO:tasks.workunit.client.0.smithi134.stdout:5/863: dread dc/d15/df1/d3b/d3c/fa4 [0,4194304] 0 2024-04-13T10:59:18.396 INFO:tasks.workunit.client.0.smithi134.stdout:1/746: creat d3/d6/d20/ff2 x:0 0 0 2024-04-13T10:59:18.397 INFO:tasks.workunit.client.0.smithi134.stdout:3/597: link dc/d27/l13 dc/d27/d81/lc1 0 2024-04-13T10:59:18.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/864: dread fb [0,4194304] 0 2024-04-13T10:59:18.401 INFO:tasks.workunit.client.0.smithi134.stdout:5/865: dread dc/f96 [0,4194304] 0 2024-04-13T10:59:18.402 INFO:tasks.workunit.client.0.smithi134.stdout:1/747: fsync d3/f41 0 2024-04-13T10:59:18.405 INFO:tasks.workunit.client.0.smithi134.stdout:9/734: mknod d13/d39/d58/d5f/c104 0 2024-04-13T10:59:18.413 INFO:tasks.workunit.client.0.smithi134.stdout:1/748: rmdir d3/d6/dd 39 2024-04-13T10:59:18.417 INFO:tasks.workunit.client.0.smithi134.stdout:9/735: creat d13/d39/d52/d86/d9f/f105 x:0 0 0 2024-04-13T10:59:18.421 INFO:tasks.workunit.client.0.smithi134.stdout:9/736: mknod d13/d39/d58/dd5/de5/c106 0 2024-04-13T10:59:18.422 INFO:tasks.workunit.client.0.smithi134.stdout:1/749: creat d3/d6/de3/ff3 x:0 0 0 2024-04-13T10:59:18.431 INFO:tasks.workunit.client.0.smithi134.stdout:3/598: write dc/fe [6142702,6962] 0 2024-04-13T10:59:18.434 INFO:tasks.workunit.client.0.smithi134.stdout:3/599: fsync dc/d27/d4d/f69 0 2024-04-13T10:59:18.438 INFO:tasks.workunit.client.0.smithi134.stdout:1/750: dwrite d3/d6/d20/f7b [0,4194304] 0 2024-04-13T10:59:18.442 INFO:tasks.workunit.client.0.smithi134.stdout:3/600: symlink dc/d1d/d58/lc2 0 2024-04-13T10:59:18.443 INFO:tasks.workunit.client.0.smithi134.stdout:5/866: dwrite dc/d15/d65/fcf [0,4194304] 0 2024-04-13T10:59:18.446 INFO:tasks.workunit.client.0.smithi134.stdout:1/751: mknod d3/d6/d20/d6d/db1/cf4 0 2024-04-13T10:59:18.448 INFO:tasks.workunit.client.0.smithi134.stdout:9/737: write d13/d2e/d35/d50/ffe [35673,5654] 0 2024-04-13T10:59:18.451 INFO:tasks.workunit.client.0.smithi134.stdout:5/867: dread dc/d15/d50/fb4 [0,4194304] 0 2024-04-13T10:59:18.451 INFO:tasks.workunit.client.0.smithi134.stdout:5/868: readlink dc/lf 0 2024-04-13T10:59:18.454 INFO:tasks.workunit.client.0.smithi134.stdout:1/752: rmdir d3/d6/d20/d6d/d8b 39 2024-04-13T10:59:18.455 INFO:tasks.workunit.client.0.smithi134.stdout:1/753: write d3/d6/fc3 [855443,16130] 0 2024-04-13T10:59:18.460 INFO:tasks.workunit.client.0.smithi134.stdout:9/738: unlink d13/d39/d52/d86/d9f/f105 0 2024-04-13T10:59:18.463 INFO:tasks.workunit.client.0.smithi134.stdout:3/601: link dc/d27/d81/cae dc/d27/d19/d8b/da8/d50/d25/d5f/d99/cc3 0 2024-04-13T10:59:18.468 INFO:tasks.workunit.client.0.smithi134.stdout:9/739: mkdir d13/d39/d58/d5f/d107 0 2024-04-13T10:59:18.472 INFO:tasks.workunit.client.0.smithi134.stdout:3/602: link dc/d1d/d58/lc2 dc/d27/d19/d48/d49/lc4 0 2024-04-13T10:59:18.476 INFO:tasks.workunit.client.0.smithi134.stdout:3/603: mknod dc/d27/d19/d48/d49/cc5 0 2024-04-13T10:59:18.477 INFO:tasks.workunit.client.0.smithi134.stdout:1/754: write d3/d6/d16/f35 [341776,67958] 0 2024-04-13T10:59:18.479 INFO:tasks.workunit.client.0.smithi134.stdout:5/869: dwrite dc/f17 [0,4194304] 0 2024-04-13T10:59:18.479 INFO:tasks.workunit.client.0.smithi134.stdout:1/755: dread - d3/d6/d16/d4d/fb5 zero size 2024-04-13T10:59:18.479 INFO:tasks.workunit.client.0.smithi134.stdout:9/740: getdents d13/d39/d52/d71 0 2024-04-13T10:59:18.482 INFO:tasks.workunit.client.0.smithi134.stdout:5/870: fsync dc/d15/df1/d3b/d7f/d8d/d7d/dc0/fc4 0 2024-04-13T10:59:18.484 INFO:tasks.workunit.client.0.smithi134.stdout:1/756: creat d3/d30/ff5 x:0 0 0 2024-04-13T10:59:18.485 INFO:tasks.workunit.client.0.smithi134.stdout:1/757: write d3/d6/d16/d4d/fbb [334055,60573] 0 2024-04-13T10:59:18.489 INFO:tasks.workunit.client.0.smithi134.stdout:9/741: symlink d13/d39/d58/d5f/dac/l108 0 2024-04-13T10:59:18.496 INFO:tasks.workunit.client.0.smithi134.stdout:3/604: link l9 dc/d27/d81/lc6 0 2024-04-13T10:59:18.497 INFO:tasks.workunit.client.0.smithi134.stdout:1/758: creat d3/d6/d20/d6d/d8b/ff6 x:0 0 0 2024-04-13T10:59:18.504 INFO:tasks.workunit.client.0.smithi134.stdout:1/759: mkdir d3/d6/d16/d4d/d65/df7 0 2024-04-13T10:59:18.504 INFO:tasks.workunit.client.0.smithi134.stdout:1/760: chown d3/d6/d16 3 1 2024-04-13T10:59:18.505 INFO:tasks.workunit.client.0.smithi134.stdout:1/761: write d3/d6/f7e [148639,30523] 0 2024-04-13T10:59:18.506 INFO:tasks.workunit.client.0.smithi134.stdout:3/605: symlink dc/lc7 0 2024-04-13T10:59:18.508 INFO:tasks.workunit.client.0.smithi134.stdout:9/742: dread d13/d2e/d47/fc4 [0,4194304] 0 2024-04-13T10:59:18.509 INFO:tasks.workunit.client.0.smithi134.stdout:3/606: fdatasync dc/fe 0 2024-04-13T10:59:18.511 INFO:tasks.workunit.client.0.smithi134.stdout:5/871: dwrite dc/f10 [0,4194304] 0 2024-04-13T10:59:18.512 INFO:tasks.workunit.client.0.smithi134.stdout:1/762: symlink d3/d6/d16/d4d/lf8 0 2024-04-13T10:59:18.515 INFO:tasks.workunit.client.0.smithi134.stdout:5/872: readlink dc/d1d/l58 0 2024-04-13T10:59:18.518 INFO:tasks.workunit.client.0.smithi134.stdout:1/763: chown d3/d6/dd/f56 8012 1 2024-04-13T10:59:18.519 INFO:tasks.workunit.client.0.smithi134.stdout:3/607: mknod dc/d27/d19/cc8 0 2024-04-13T10:59:18.520 INFO:tasks.workunit.client.0.smithi134.stdout:9/743: link d13/d2e/d47/fc4 d13/d39/d58/dd5/f109 0 2024-04-13T10:59:18.523 INFO:tasks.workunit.client.0.smithi134.stdout:5/873: mknod dc/d15/dab/dd0/c11e 0 2024-04-13T10:59:18.523 INFO:tasks.workunit.client.0.smithi134.stdout:1/764: rmdir d3/d6/d16 39 2024-04-13T10:59:18.525 INFO:tasks.workunit.client.0.smithi134.stdout:1/765: dread - d3/d6/d20/d6d/d8b/f4e zero size 2024-04-13T10:59:18.526 INFO:tasks.workunit.client.0.smithi134.stdout:9/744: mkdir d13/d39/d58/dd5/de5/d10a 0 2024-04-13T10:59:18.528 INFO:tasks.workunit.client.0.smithi134.stdout:5/874: read dc/d1d/d2b/d30/f7a [6258,7779] 0 2024-04-13T10:59:18.528 INFO:tasks.workunit.client.0.smithi134.stdout:3/608: dwrite dc/d27/d19/d8b/d9b/fa5 [0,4194304] 0 2024-04-13T10:59:18.528 INFO:tasks.workunit.client.0.smithi134.stdout:1/766: readlink d3/d6/d16/d4d/l79 0 2024-04-13T10:59:18.530 INFO:tasks.workunit.client.0.smithi134.stdout:9/745: mkdir d13/d39/d64/db2/dd6/d10b 0 2024-04-13T10:59:18.531 INFO:tasks.workunit.client.0.smithi134.stdout:5/875: write dc/d15/d50/fb4 [1273260,83355] 0 2024-04-13T10:59:18.536 INFO:tasks.workunit.client.0.smithi134.stdout:5/876: write dc/d1d/d20/d23/f68 [2108935,44483] 0 2024-04-13T10:59:18.544 INFO:tasks.workunit.client.0.smithi134.stdout:5/877: symlink dc/d39/l11f 0 2024-04-13T10:59:18.546 INFO:tasks.workunit.client.0.smithi134.stdout:9/746: dwrite d13/d2e/d35/d50/f7b [0,4194304] 0 2024-04-13T10:59:18.549 INFO:tasks.workunit.client.0.smithi134.stdout:5/878: read dc/d15/df1/d3b/d3c/fa4 [4061266,646] 0 2024-04-13T10:59:18.553 INFO:tasks.workunit.client.0.smithi134.stdout:1/767: write d3/d6/d20/d71/d9c/fbc [806602,44138] 0 2024-04-13T10:59:18.554 INFO:tasks.workunit.client.0.smithi134.stdout:1/768: chown d3/d6/d16/d4d/d65/l8c 323135761 1 2024-04-13T10:59:18.599 INFO:tasks.workunit.client.0.smithi134.stdout:1/769: creat d3/d6/d20/d71/d9c/dcb/ff9 x:0 0 0 2024-04-13T10:59:18.602 INFO:tasks.workunit.client.0.smithi134.stdout:9/747: dwrite f4 [0,4194304] 0 2024-04-13T10:59:18.602 INFO:tasks.workunit.client.0.smithi134.stdout:5/879: link dc/d1d/d2b/d30/d3e/f104 dc/d15/df1/d3b/f120 0 2024-04-13T10:59:18.604 INFO:tasks.workunit.client.0.smithi134.stdout:9/748: write d13/d40/d7d/f7f [4145475,112829] 0 2024-04-13T10:59:18.608 INFO:tasks.workunit.client.0.smithi134.stdout:5/880: symlink dc/d15/df1/d3b/d6a/l121 0 2024-04-13T10:59:18.610 INFO:tasks.workunit.client.0.smithi134.stdout:1/770: link d3/d6/d20/ff2 d3/d6/d16/d1d/d68/de2/ffa 0 2024-04-13T10:59:18.612 INFO:tasks.workunit.client.0.smithi134.stdout:5/881: chown dc/d15/df1/d3b/fcb 3541367 1 2024-04-13T10:59:18.613 INFO:tasks.workunit.client.0.smithi134.stdout:9/749: creat d13/d39/d58/dd5/de5/d10a/f10c x:0 0 0 2024-04-13T10:59:18.615 INFO:tasks.workunit.client.0.smithi134.stdout:1/771: rename d3/fa6 to d3/d6/d20/d9f/ffb 0 2024-04-13T10:59:18.616 INFO:tasks.workunit.client.0.smithi134.stdout:1/772: chown d3/d6/d20/d71/f88 9768953 1 2024-04-13T10:59:18.617 INFO:tasks.workunit.client.0.smithi134.stdout:9/750: creat d13/d39/d58/dd5/de5/f10d x:0 0 0 2024-04-13T10:59:18.617 INFO:tasks.workunit.client.0.smithi134.stdout:1/773: read d3/d6/d20/d6d/fc4 [228073,71824] 0 2024-04-13T10:59:18.618 INFO:tasks.workunit.client.0.smithi134.stdout:5/882: mknod dc/d15/df1/c122 0 2024-04-13T10:59:18.620 INFO:tasks.workunit.client.0.smithi134.stdout:1/774: creat d3/d6/d16/d1d/ffc x:0 0 0 2024-04-13T10:59:18.627 INFO:tasks.workunit.client.0.smithi134.stdout:9/751: link d13/d39/d58/dd5/de5/c106 d13/d39/d64/db2/c10e 0 2024-04-13T10:59:18.636 INFO:tasks.workunit.client.0.smithi134.stdout:1/775: dread d3/d6/d20/d6d/d8b/f92 [0,4194304] 0 2024-04-13T10:59:18.646 INFO:tasks.workunit.client.0.smithi134.stdout:9/752: write d13/d39/f3b [3199561,101939] 0 2024-04-13T10:59:18.649 INFO:tasks.workunit.client.0.smithi134.stdout:5/883: dwrite dc/d1d/d67/d69/f7b [4194304,4194304] 0 2024-04-13T10:59:18.649 INFO:tasks.workunit.client.0.smithi134.stdout:9/753: write d13/d40/f6c [2619652,45556] 0 2024-04-13T10:59:18.651 INFO:tasks.workunit.client.0.smithi134.stdout:1/776: dread d3/d6/fc [0,4194304] 0 2024-04-13T10:59:18.653 INFO:tasks.workunit.client.0.smithi134.stdout:1/777: dread - d3/d6/d16/d1d/ffc zero size 2024-04-13T10:59:18.657 INFO:tasks.workunit.client.0.smithi134.stdout:5/884: symlink dc/d15/df1/d3b/l123 0 2024-04-13T10:59:18.658 INFO:tasks.workunit.client.0.smithi134.stdout:9/754: dwrite d13/f2d [0,4194304] 0 2024-04-13T10:59:18.659 INFO:tasks.workunit.client.0.smithi134.stdout:1/778: symlink d3/d6/d20/d6d/db1/lfd 0 2024-04-13T10:59:18.660 INFO:tasks.workunit.client.0.smithi134.stdout:1/779: chown d3/d6/d6a 3302 1 2024-04-13T10:59:18.669 INFO:tasks.workunit.client.0.smithi134.stdout:1/780: unlink d3/d6/d20/d9f/fae 0 2024-04-13T10:59:18.679 INFO:tasks.workunit.client.0.smithi134.stdout:9/755: dread d13/d39/d52/d86/fd3 [0,4194304] 0 2024-04-13T10:59:18.680 INFO:tasks.workunit.client.0.smithi134.stdout:5/885: dread dc/d15/df1/d3b/d3c/f5d [0,4194304] 0 2024-04-13T10:59:18.684 INFO:tasks.workunit.client.0.smithi134.stdout:9/756: symlink d13/d39/d58/dd5/de5/l10f 0 2024-04-13T10:59:18.688 INFO:tasks.workunit.client.0.smithi134.stdout:1/781: dread d3/d6/d16/d1d/d86/f8e [0,4194304] 0 2024-04-13T10:59:18.694 INFO:tasks.workunit.client.0.smithi134.stdout:5/886: dread dc/d1d/d2b/d30/d3e/f4d [0,4194304] 0 2024-04-13T10:59:18.694 INFO:tasks.workunit.client.0.smithi134.stdout:5/887: chown dc/d15/d50/fb4 650 1 2024-04-13T10:59:18.695 INFO:tasks.workunit.client.0.smithi134.stdout:5/888: chown dc/d15/d65 72 1 2024-04-13T10:59:18.791 INFO:tasks.workunit.client.0.smithi134.stdout:8/698: sync 2024-04-13T10:59:18.793 INFO:tasks.workunit.client.0.smithi134.stdout:8/699: truncate d8/dc/f3e 670363 0 2024-04-13T10:59:18.794 INFO:tasks.workunit.client.0.smithi134.stdout:5/889: mknod dc/d15/df8/d115/c124 0 2024-04-13T10:59:18.799 INFO:tasks.workunit.client.0.smithi134.stdout:8/700: truncate d8/dc/d16/d54/f77 1036163 0 2024-04-13T10:59:18.799 INFO:tasks.workunit.client.0.smithi134.stdout:1/782: write d3/f18 [3733591,46149] 0 2024-04-13T10:59:18.803 INFO:tasks.workunit.client.0.smithi134.stdout:5/890: rename dc/d15/df1/d3b/f106 to dc/d15/df1/d3b/f125 0 2024-04-13T10:59:18.804 INFO:tasks.workunit.client.0.smithi134.stdout:9/757: dwrite d13/d39/d64/f92 [0,4194304] 0 2024-04-13T10:59:18.805 INFO:tasks.workunit.client.0.smithi134.stdout:8/701: fdatasync d8/dc/d2c/d68/f61 0 2024-04-13T10:59:18.808 INFO:tasks.workunit.client.0.smithi134.stdout:9/758: stat d13/d2e/d47/fc4 0 2024-04-13T10:59:18.813 INFO:tasks.workunit.client.0.smithi134.stdout:8/702: readlink d8/lcf 0 2024-04-13T10:59:18.818 INFO:tasks.workunit.client.0.smithi134.stdout:9/759: dwrite d13/d2e/d35/d50/ffe [0,4194304] 0 2024-04-13T10:59:18.819 INFO:tasks.workunit.client.0.smithi134.stdout:8/703: mknod d8/dc/d16/d54/cec 0 2024-04-13T10:59:18.821 INFO:tasks.workunit.client.0.smithi134.stdout:8/704: fdatasync d8/dc/d16/d4e/d76/fda 0 2024-04-13T10:59:18.827 INFO:tasks.workunit.client.0.smithi134.stdout:1/783: truncate d3/d6/d20/d6d/ff1 551936 0 2024-04-13T10:59:18.828 INFO:tasks.workunit.client.0.smithi134.stdout:5/891: write dc/d1d/d20/d23/d36/f73 [821596,103370] 0 2024-04-13T10:59:18.829 INFO:tasks.workunit.client.0.smithi134.stdout:9/760: symlink d13/l110 0 2024-04-13T10:59:18.831 INFO:tasks.workunit.client.0.smithi134.stdout:9/761: truncate d13/d40/fc0 4521657 0 2024-04-13T10:59:18.832 INFO:tasks.workunit.client.0.smithi134.stdout:9/762: write d13/f57 [4086297,114924] 0 2024-04-13T10:59:18.832 INFO:tasks.workunit.client.0.smithi134.stdout:1/784: mknod d3/d6/d20/d6d/d8b/cfe 0 2024-04-13T10:59:18.837 INFO:tasks.workunit.client.0.smithi134.stdout:5/892: truncate dc/f75 529223 0 2024-04-13T10:59:18.843 INFO:tasks.workunit.client.0.smithi134.stdout:8/705: dwrite d8/dc/d16/d54/d98/d9b/da3/fd3 [0,4194304] 0 2024-04-13T10:59:18.847 INFO:tasks.workunit.client.0.smithi134.stdout:1/785: mkdir d3/d6/d16/dff 0 2024-04-13T10:59:18.848 INFO:tasks.workunit.client.0.smithi134.stdout:9/763: creat d13/d39/d58/d5f/d107/f111 x:0 0 0 2024-04-13T10:59:18.848 INFO:tasks.workunit.client.0.smithi134.stdout:1/786: write d3/d6/d20/d71/fa4 [2463940,12197] 0 2024-04-13T10:59:18.849 INFO:tasks.workunit.client.0.smithi134.stdout:8/706: creat d8/dc/d9d/fed x:0 0 0 2024-04-13T10:59:18.852 INFO:tasks.workunit.client.0.smithi134.stdout:8/707: write d8/dc/d2c/d68/d8c/d8f/fd7 [603460,14750] 0 2024-04-13T10:59:18.853 INFO:tasks.workunit.client.0.smithi134.stdout:8/708: fdatasync d8/dc/d2c/f39 0 2024-04-13T10:59:18.857 INFO:tasks.workunit.client.0.smithi134.stdout:8/709: read d8/f2b [3462002,101174] 0 2024-04-13T10:59:18.861 INFO:tasks.workunit.client.0.smithi134.stdout:5/893: getdents dc/d15/d84 0 2024-04-13T10:59:18.861 INFO:tasks.workunit.client.0.smithi134.stdout:1/787: rename d3/d6/d16/d1d/dab/fb8 to d3/d6/d20/f100 0 2024-04-13T10:59:18.863 INFO:tasks.workunit.client.0.smithi134.stdout:8/710: mknod d8/dc/d16/d54/d6c/d7d/cee 0 2024-04-13T10:59:18.863 INFO:tasks.workunit.client.0.smithi134.stdout:5/894: rmdir dc/d39/d63/da5 39 2024-04-13T10:59:18.864 INFO:tasks.workunit.client.0.smithi134.stdout:8/711: chown d8/dc/d16/d54/d6c/f70 3 1 2024-04-13T10:59:18.867 INFO:tasks.workunit.client.0.smithi134.stdout:1/788: creat d3/d6/d16/dff/f101 x:0 0 0 2024-04-13T10:59:18.870 INFO:tasks.workunit.client.0.smithi134.stdout:8/712: creat d8/dc/d16/d54/d6c/d94/de7/fef x:0 0 0 2024-04-13T10:59:18.871 INFO:tasks.workunit.client.0.smithi134.stdout:5/895: dread dc/d1d/d20/d23/f86 [0,4194304] 0 2024-04-13T10:59:18.876 INFO:tasks.workunit.client.0.smithi134.stdout:9/764: dread d13/d39/d52/fb6 [0,4194304] 0 2024-04-13T10:59:18.876 INFO:tasks.workunit.client.0.smithi134.stdout:1/789: dwrite d3/d6/d16/f7d [0,4194304] 0 2024-04-13T10:59:18.878 INFO:tasks.workunit.client.0.smithi134.stdout:5/896: dread dc/d1d/d46/f70 [0,4194304] 0 2024-04-13T10:59:18.883 INFO:tasks.workunit.client.0.smithi134.stdout:9/765: dread d13/d2e/d35/d50/f7b [0,4194304] 0 2024-04-13T10:59:18.884 INFO:tasks.workunit.client.0.smithi134.stdout:5/897: mkdir dc/dc1/d126 0 2024-04-13T10:59:18.885 INFO:tasks.workunit.client.0.smithi134.stdout:9/766: truncate d13/d39/d52/d6b/fd4 912837 0 2024-04-13T10:59:18.891 INFO:tasks.workunit.client.0.smithi134.stdout:1/790: mkdir d3/d6/d20/d6d/d102 0 2024-04-13T10:59:18.891 INFO:tasks.workunit.client.0.smithi134.stdout:8/713: truncate d8/dc/f4f 2160202 0 2024-04-13T10:59:18.892 INFO:tasks.workunit.client.0.smithi134.stdout:1/791: dread - d3/d6/d16/dff/f101 zero size 2024-04-13T10:59:18.893 INFO:tasks.workunit.client.0.smithi134.stdout:8/714: chown d8/dc/d2c/d68/d8c/d8f/fd7 6 1 2024-04-13T10:59:18.894 INFO:tasks.workunit.client.0.smithi134.stdout:5/898: readlink dc/d1d/d46/lb8 0 2024-04-13T10:59:18.894 INFO:tasks.workunit.client.0.smithi134.stdout:1/792: chown d3/d6/d20/d71/d9c/cb3 17222050 1 2024-04-13T10:59:18.895 INFO:tasks.workunit.client.0.smithi134.stdout:9/767: unlink d13/d39/d52/d71/f78 0 2024-04-13T10:59:18.898 INFO:tasks.workunit.client.0.smithi134.stdout:5/899: truncate dc/d15/df1/f6f 200533 0 2024-04-13T10:59:18.899 INFO:tasks.workunit.client.0.smithi134.stdout:5/900: chown dc/d15/df1/d3b/d6a/f8b 15285 1 2024-04-13T10:59:18.900 INFO:tasks.workunit.client.0.smithi134.stdout:9/768: mknod d13/d2e/d35/d50/c112 0 2024-04-13T10:59:18.901 INFO:tasks.workunit.client.0.smithi134.stdout:1/793: creat d3/d6/d6a/dd8/f103 x:0 0 0 2024-04-13T10:59:18.902 INFO:tasks.workunit.client.0.smithi134.stdout:1/794: fsync d3/d6/d16/d1d/fd9 0 2024-04-13T10:59:18.910 INFO:tasks.workunit.client.0.smithi134.stdout:1/795: dwrite d3/d6/dd/f56 [0,4194304] 0 2024-04-13T10:59:18.911 INFO:tasks.workunit.client.0.smithi134.stdout:5/901: rename dc/d15/df1/d3b/d7f/d8d/d7d/dc0/d105 to dc/d1d/d2b/d127 0 2024-04-13T10:59:18.912 INFO:tasks.workunit.client.0.smithi134.stdout:8/715: dread d8/ff [0,4194304] 0 2024-04-13T10:59:18.919 INFO:tasks.workunit.client.0.smithi134.stdout:9/769: getdents d13/d39/d64/db2/dd6 0 2024-04-13T10:59:18.919 INFO:tasks.workunit.client.0.smithi134.stdout:1/796: mknod d3/d6/d16/dff/c104 0 2024-04-13T10:59:18.920 INFO:tasks.workunit.client.0.smithi134.stdout:5/902: dread dc/d1d/d20/d23/f42 [0,4194304] 0 2024-04-13T10:59:18.922 INFO:tasks.workunit.client.0.smithi134.stdout:9/770: mkdir d13/d2e/d47/d113 0 2024-04-13T10:59:18.923 INFO:tasks.workunit.client.0.smithi134.stdout:9/771: read d13/d2e/d35/d50/f7b [2422530,95616] 0 2024-04-13T10:59:18.924 INFO:tasks.workunit.client.0.smithi134.stdout:1/797: mkdir d3/d6/d16/d1d/d86/d105 0 2024-04-13T10:59:18.925 INFO:tasks.workunit.client.0.smithi134.stdout:1/798: read - d3/d6/d6a/f78 zero size 2024-04-13T10:59:18.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:18 smithi134 ceph-mon[39696]: pgmap v43: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 38 MiB/s rd, 110 MiB/s wr, 252 op/s 2024-04-13T10:59:18.935 INFO:tasks.workunit.client.0.smithi134.stdout:8/716: dread d8/dc/d16/d4e/f62 [0,4194304] 0 2024-04-13T10:59:18.936 INFO:tasks.workunit.client.0.smithi134.stdout:9/772: symlink d13/d2e/d47/de7/l114 0 2024-04-13T10:59:18.937 INFO:tasks.workunit.client.0.smithi134.stdout:9/773: dread - d13/d39/d52/d6b/fc5 zero size 2024-04-13T10:59:18.937 INFO:tasks.workunit.client.0.smithi134.stdout:1/799: truncate d3/d6/d20/f100 1345699 0 2024-04-13T10:59:18.938 INFO:tasks.workunit.client.0.smithi134.stdout:1/800: fdatasync d3/d6/d16/dff/f101 0 2024-04-13T10:59:18.939 INFO:tasks.workunit.client.0.smithi134.stdout:5/903: rmdir dc/dc1/d126 0 2024-04-13T10:59:18.939 INFO:tasks.workunit.client.0.smithi134.stdout:1/801: chown d3/d6/d20/d6d/db1/lfd 139173 1 2024-04-13T10:59:18.940 INFO:tasks.workunit.client.0.smithi134.stdout:1/802: write d3/d6/d16/d1d/d68/faa [405845,47764] 0 2024-04-13T10:59:18.941 INFO:tasks.workunit.client.0.smithi134.stdout:8/717: rename d8/l57 to d8/dc/lf0 0 2024-04-13T10:59:18.943 INFO:tasks.workunit.client.0.smithi134.stdout:9/774: creat d13/d40/d7d/dfb/f115 x:0 0 0 2024-04-13T10:59:18.946 INFO:tasks.workunit.client.0.smithi134.stdout:1/803: creat d3/d6/d16/d4d/d65/f106 x:0 0 0 2024-04-13T10:59:18.947 INFO:tasks.workunit.client.0.smithi134.stdout:9/775: creat d13/da3/d98/f116 x:0 0 0 2024-04-13T10:59:18.948 INFO:tasks.workunit.client.0.smithi134.stdout:5/904: mkdir dc/d1d/d20/d23/d128 0 2024-04-13T10:59:18.950 INFO:tasks.workunit.client.0.smithi134.stdout:1/804: mkdir d3/d6/d20/d71/d107 0 2024-04-13T10:59:18.953 INFO:tasks.workunit.client.0.smithi134.stdout:9/776: creat d13/d39/d58/dd5/dfc/f117 x:0 0 0 2024-04-13T10:59:18.955 INFO:tasks.workunit.client.0.smithi134.stdout:1/805: dread d3/d6/d16/d1d/f94 [0,4194304] 0 2024-04-13T10:59:18.956 INFO:tasks.workunit.client.0.smithi134.stdout:1/806: read d3/d6/d20/d28/f37 [4502518,106636] 0 2024-04-13T10:59:18.958 INFO:tasks.workunit.client.0.smithi134.stdout:9/777: chown d13/d39/d58/c5a 3 1 2024-04-13T10:59:18.958 INFO:tasks.workunit.client.0.smithi134.stdout:5/905: link dc/d15/df1/d3b/l123 dc/d1d/d20/d23/d5a/l129 0 2024-04-13T10:59:18.959 INFO:tasks.workunit.client.0.smithi134.stdout:2/538: sync 2024-04-13T10:59:18.959 INFO:tasks.workunit.client.0.smithi134.stdout:0/643: sync 2024-04-13T10:59:18.959 INFO:tasks.workunit.client.0.smithi134.stdout:7/582: sync 2024-04-13T10:59:18.960 INFO:tasks.workunit.client.0.smithi134.stdout:0/644: chown d4/d17/da/d22 249 1 2024-04-13T10:59:18.965 INFO:tasks.workunit.client.0.smithi134.stdout:9/778: unlink d13/d39/d58/d5f/f8e 0 2024-04-13T10:59:18.965 INFO:tasks.workunit.client.0.smithi134.stdout:5/906: dwrite dc/f28 [4194304,4194304] 0 2024-04-13T10:59:18.965 INFO:tasks.workunit.client.0.smithi134.stdout:5/907: chown dc/d118 24085935 1 2024-04-13T10:59:18.969 INFO:tasks.workunit.client.0.smithi134.stdout:2/539: creat d5/d6/d70/fa0 x:0 0 0 2024-04-13T10:59:18.977 INFO:tasks.workunit.client.0.smithi134.stdout:2/540: dwrite d5/d6/d57/d6f/d30/d58/d59/f8e [0,4194304] 0 2024-04-13T10:59:18.977 INFO:tasks.workunit.client.0.smithi134.stdout:9/779: mkdir d13/d40/d7d/d118 0 2024-04-13T10:59:18.986 INFO:tasks.workunit.client.0.smithi134.stdout:0/645: mknod d4/d17/d23/d51/d6b/d91/cef 0 2024-04-13T10:59:18.991 INFO:tasks.workunit.client.0.smithi134.stdout:0/646: mknod d4/d17/d23/d51/d6a/d94/cf0 0 2024-04-13T10:59:18.993 INFO:tasks.workunit.client.0.smithi134.stdout:1/807: truncate d3/d6/d16/d1d/d68/faa 93197 0 2024-04-13T10:59:18.995 INFO:tasks.workunit.client.0.smithi134.stdout:0/647: creat d4/d17/da/d22/d37/ff1 x:0 0 0 2024-04-13T10:59:18.995 INFO:tasks.workunit.client.0.smithi134.stdout:7/583: write da/d15/d26/d27/d3d/f7a [949768,45791] 0 2024-04-13T10:59:18.997 INFO:tasks.workunit.client.0.smithi134.stdout:7/584: write da/d15/d26/d38/fa0 [2031165,71012] 0 2024-04-13T10:59:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:18 smithi194 ceph-mon[46737]: pgmap v43: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 38 MiB/s rd, 110 MiB/s wr, 252 op/s 2024-04-13T10:59:19.006 INFO:tasks.workunit.client.0.smithi134.stdout:7/585: dread - da/d15/f81 zero size 2024-04-13T10:59:19.007 INFO:tasks.workunit.client.0.smithi134.stdout:9/780: write d13/d2e/d35/f4b [3319122,119019] 0 2024-04-13T10:59:19.011 INFO:tasks.workunit.client.0.smithi134.stdout:1/808: creat d3/f108 x:0 0 0 2024-04-13T10:59:19.011 INFO:tasks.workunit.client.0.smithi134.stdout:0/648: dread d4/d17/d20/d29/d30/d64/d84/f8e [0,4194304] 0 2024-04-13T10:59:19.013 INFO:tasks.workunit.client.0.smithi134.stdout:9/781: readlink d13/l29 0 2024-04-13T10:59:19.016 INFO:tasks.workunit.client.0.smithi134.stdout:7/586: creat da/d15/d85/db0/fb2 x:0 0 0 2024-04-13T10:59:19.019 INFO:tasks.workunit.client.0.smithi134.stdout:7/587: write da/fa8 [2940539,33874] 0 2024-04-13T10:59:19.023 INFO:tasks.workunit.client.0.smithi134.stdout:1/809: dwrite d3/d6/d20/d89/fe4 [0,4194304] 0 2024-04-13T10:59:19.025 INFO:tasks.workunit.client.0.smithi134.stdout:9/782: dwrite d13/d2e/d35/f6a [0,4194304] 0 2024-04-13T10:59:19.025 INFO:tasks.workunit.client.0.smithi134.stdout:0/649: fdatasync d4/d17/d20/d29/d30/d3e/f50 0 2024-04-13T10:59:19.029 INFO:tasks.workunit.client.0.smithi134.stdout:1/810: write d3/d6/d16/d4d/fb5 [34371,9852] 0 2024-04-13T10:59:19.030 INFO:tasks.workunit.client.0.smithi134.stdout:7/588: fdatasync da/d15/d26/d27/d3d/d9c/f61 0 2024-04-13T10:59:19.032 INFO:tasks.workunit.client.0.smithi134.stdout:9/783: creat d13/d2e/d47/f119 x:0 0 0 2024-04-13T10:59:19.034 INFO:tasks.workunit.client.0.smithi134.stdout:1/811: write d3/d6/f4f [857557,75382] 0 2024-04-13T10:59:19.036 INFO:tasks.workunit.client.0.smithi134.stdout:0/650: mkdir d4/d17/da/d22/d41/d6e/d8a/d95/df2 0 2024-04-13T10:59:19.038 INFO:tasks.workunit.client.0.smithi134.stdout:9/784: mkdir d13/d39/d58/d5f/dac/d11a 0 2024-04-13T10:59:19.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/785: rmdir d13/d39/d52/d86/d9f 39 2024-04-13T10:59:19.046 INFO:tasks.workunit.client.0.smithi134.stdout:1/812: symlink d3/d6/l109 0 2024-04-13T10:59:19.047 INFO:tasks.workunit.client.0.smithi134.stdout:9/786: write d13/d40/fc0 [232244,49093] 0 2024-04-13T10:59:19.049 INFO:tasks.workunit.client.0.smithi134.stdout:7/589: dwrite da/d15/f81 [0,4194304] 0 2024-04-13T10:59:19.055 INFO:tasks.workunit.client.0.smithi134.stdout:0/651: creat d4/d17/d20/d29/d30/d3e/ff3 x:0 0 0 2024-04-13T10:59:19.056 INFO:tasks.workunit.client.0.smithi134.stdout:1/813: creat d3/d6/d16/d4d/f10a x:0 0 0 2024-04-13T10:59:19.057 INFO:tasks.workunit.client.0.smithi134.stdout:7/590: mknod da/d15/d26/d27/d4f/d5f/cb3 0 2024-04-13T10:59:19.063 INFO:tasks.workunit.client.0.smithi134.stdout:1/814: dread d3/d6/d16/d1d/f84 [0,4194304] 0 2024-04-13T10:59:19.064 INFO:tasks.workunit.client.0.smithi134.stdout:0/652: mkdir d4/d17/d23/d51/d6b/d91/d98/df4 0 2024-04-13T10:59:19.066 INFO:tasks.workunit.client.0.smithi134.stdout:1/815: creat d3/d6/d16/dff/f10b x:0 0 0 2024-04-13T10:59:19.067 INFO:tasks.workunit.client.0.smithi134.stdout:7/591: creat da/d15/d26/fb4 x:0 0 0 2024-04-13T10:59:19.070 INFO:tasks.workunit.client.0.smithi134.stdout:1/816: chown d3/d6/de3/le9 2287 1 2024-04-13T10:59:19.070 INFO:tasks.workunit.client.0.smithi134.stdout:9/787: dwrite d13/f28 [4194304,4194304] 0 2024-04-13T10:59:19.071 INFO:tasks.workunit.client.0.smithi134.stdout:9/788: readlink d13/d39/d64/l70 0 2024-04-13T10:59:19.078 INFO:tasks.workunit.client.0.smithi134.stdout:1/817: creat d3/d6/d16/d4d/d65/f10c x:0 0 0 2024-04-13T10:59:19.079 INFO:tasks.workunit.client.0.smithi134.stdout:1/818: write d3/d30/ff5 [198991,3679] 0 2024-04-13T10:59:19.080 INFO:tasks.workunit.client.0.smithi134.stdout:9/789: dwrite d13/d2e/d35/f4b [0,4194304] 0 2024-04-13T10:59:19.082 INFO:tasks.workunit.client.0.smithi134.stdout:9/790: write d13/d2e/d35/d50/d59/fbc [486639,104405] 0 2024-04-13T10:59:19.082 INFO:tasks.workunit.client.0.smithi134.stdout:7/592: write da/d15/d26/f28 [3755880,106211] 0 2024-04-13T10:59:19.086 INFO:tasks.workunit.client.0.smithi134.stdout:1/819: fsync d3/d6/d20/d9f/dbe/fee 0 2024-04-13T10:59:19.088 INFO:tasks.workunit.client.0.smithi134.stdout:9/791: rename d13/d39/d52/d86/fd3 to d13/d39/d58/dd5/dfc/f11b 0 2024-04-13T10:59:19.090 INFO:tasks.workunit.client.0.smithi134.stdout:1/820: truncate d3/d6/f15 4715781 0 2024-04-13T10:59:19.092 INFO:tasks.workunit.client.0.smithi134.stdout:7/593: creat da/d15/d26/d27/d3d/d9c/fb5 x:0 0 0 2024-04-13T10:59:19.092 INFO:tasks.workunit.client.0.smithi134.stdout:1/821: truncate d3/d6/d20/d6d/d8b/fd6 967237 0 2024-04-13T10:59:19.092 INFO:tasks.workunit.client.0.smithi134.stdout:9/792: mkdir d13/d40/d11c 0 2024-04-13T10:59:19.095 INFO:tasks.workunit.client.0.smithi134.stdout:9/793: write d13/d2e/d35/f4b [1840816,27949] 0 2024-04-13T10:59:19.098 INFO:tasks.workunit.client.0.smithi134.stdout:9/794: creat d13/d2e/d35/d50/f11d x:0 0 0 2024-04-13T10:59:19.102 INFO:tasks.workunit.client.0.smithi134.stdout:9/795: rename d13/d2e/d35/d50/d59/fbc to d13/d2e/d47/d113/f11e 0 2024-04-13T10:59:19.105 INFO:tasks.workunit.client.0.smithi134.stdout:1/822: getdents d3/d6/d20/d6d/db1 0 2024-04-13T10:59:19.112 INFO:tasks.workunit.client.0.smithi134.stdout:1/823: unlink d3/d6/d20/d6d/fc4 0 2024-04-13T10:59:19.115 INFO:tasks.workunit.client.0.smithi134.stdout:1/824: creat d3/d6/de3/f10d x:0 0 0 2024-04-13T10:59:19.116 INFO:tasks.workunit.client.0.smithi134.stdout:9/796: dwrite d13/d2e/d35/d50/d59/fcb [0,4194304] 0 2024-04-13T10:59:19.126 INFO:tasks.workunit.client.0.smithi134.stdout:1/825: dwrite d3/d6/d20/d9f/dbe/fee [0,4194304] 0 2024-04-13T10:59:19.128 INFO:tasks.workunit.client.0.smithi134.stdout:1/826: stat d3/d6/dd/l12 0 2024-04-13T10:59:19.129 INFO:tasks.workunit.client.0.smithi134.stdout:1/827: write d3/d6/d16/d1d/f26 [3642328,97022] 0 2024-04-13T10:59:19.132 INFO:tasks.workunit.client.0.smithi134.stdout:1/828: write d3/d6/d16/d1d/d86/f8e [1702835,11451] 0 2024-04-13T10:59:19.140 INFO:tasks.workunit.client.0.smithi134.stdout:9/797: dread d13/d40/f48 [0,4194304] 0 2024-04-13T10:59:19.142 INFO:tasks.workunit.client.0.smithi134.stdout:9/798: unlink d13/d40/d7d/l85 0 2024-04-13T10:59:19.145 INFO:tasks.workunit.client.0.smithi134.stdout:9/799: unlink d13/d40/lba 0 2024-04-13T10:59:19.147 INFO:tasks.workunit.client.0.smithi134.stdout:9/800: creat d13/d39/d64/f11f x:0 0 0 2024-04-13T10:59:19.149 INFO:tasks.workunit.client.0.smithi134.stdout:9/801: mknod d13/d39/d52/c120 0 2024-04-13T10:59:19.153 INFO:tasks.workunit.client.0.smithi134.stdout:1/829: dwrite d3/d6/d16/d1d/d68/fac [0,4194304] 0 2024-04-13T10:59:19.156 INFO:tasks.workunit.client.0.smithi134.stdout:1/830: symlink d3/d6/de3/l10e 0 2024-04-13T10:59:19.158 INFO:tasks.workunit.client.0.smithi134.stdout:1/831: dread d3/d6/d16/d1d/f84 [0,4194304] 0 2024-04-13T10:59:19.162 INFO:tasks.workunit.client.0.smithi134.stdout:1/832: fdatasync d3/d6/d20/d6d/d8b/f92 0 2024-04-13T10:59:19.168 INFO:tasks.workunit.client.0.smithi134.stdout:1/833: dwrite d3/d30/f77 [4194304,4194304] 0 2024-04-13T10:59:19.171 INFO:tasks.workunit.client.0.smithi134.stdout:1/834: chown d3/d6/f15 431 1 2024-04-13T10:59:19.173 INFO:tasks.workunit.client.0.smithi134.stdout:1/835: rename d3/d30/f85 to d3/d6/d20/d6d/d8b/f10f 0 2024-04-13T10:59:19.175 INFO:tasks.workunit.client.0.smithi134.stdout:1/836: mkdir d3/d6/d16/d1d/d110 0 2024-04-13T10:59:19.188 INFO:tasks.workunit.client.0.smithi134.stdout:1/837: rename d3/d6/d20/d6d/d8b to d3/d6/d16/d4d/d111 0 2024-04-13T10:59:19.190 INFO:tasks.workunit.client.0.smithi134.stdout:1/838: unlink d3/d6/dd/l12 0 2024-04-13T10:59:19.191 INFO:tasks.workunit.client.0.smithi134.stdout:1/839: chown d3/d6/d20/f24 1466114 1 2024-04-13T10:59:19.203 INFO:tasks.workunit.client.0.smithi134.stdout:1/840: dwrite d3/d6/d20/f100 [0,4194304] 0 2024-04-13T10:59:19.208 INFO:tasks.workunit.client.0.smithi134.stdout:1/841: symlink d3/d6/d20/d6d/l112 0 2024-04-13T10:59:19.305 INFO:tasks.workunit.client.0.smithi134.stdout:6/709: sync 2024-04-13T10:59:19.312 INFO:tasks.workunit.client.0.smithi134.stdout:1/842: symlink d3/d6/d20/d6d/db1/l113 0 2024-04-13T10:59:19.312 INFO:tasks.workunit.client.0.smithi134.stdout:6/710: mkdir d4/da/d1a/de6 0 2024-04-13T10:59:19.313 INFO:tasks.workunit.client.0.smithi134.stdout:1/843: write d3/d6/d20/f75 [529057,24902] 0 2024-04-13T10:59:19.317 INFO:tasks.workunit.client.0.smithi134.stdout:6/711: creat d4/da/d15/d1f/d24/d49/d91/dc9/fe7 x:0 0 0 2024-04-13T10:59:19.318 INFO:tasks.workunit.client.0.smithi134.stdout:6/712: write d4/da/d1a/f29 [1244935,74038] 0 2024-04-13T10:59:19.322 INFO:tasks.workunit.client.0.smithi134.stdout:6/713: read d4/da/d15/d1f/d24/f3e [989781,37722] 0 2024-04-13T10:59:19.325 INFO:tasks.workunit.client.0.smithi134.stdout:6/714: unlink d4/da/d15/d1f/d24/d49/d91/dc9/fe1 0 2024-04-13T10:59:19.329 INFO:tasks.workunit.client.0.smithi134.stdout:6/715: creat d4/da/d15/d1f/fe8 x:0 0 0 2024-04-13T10:59:19.330 INFO:tasks.workunit.client.0.smithi134.stdout:6/716: write d4/da/d15/d77/f82 [7850382,83971] 0 2024-04-13T10:59:19.337 INFO:tasks.workunit.client.0.smithi134.stdout:6/717: dwrite d4/da/d15/f8a [0,4194304] 0 2024-04-13T10:59:19.427 INFO:tasks.workunit.client.0.smithi134.stdout:6/718: dread d4/da/dbb/fbc [0,4194304] 0 2024-04-13T10:59:19.430 INFO:tasks.workunit.client.0.smithi134.stdout:6/719: symlink d4/da/d1a/le9 0 2024-04-13T10:59:19.433 INFO:tasks.workunit.client.0.smithi134.stdout:6/720: creat d4/da/dbb/fea x:0 0 0 2024-04-13T10:59:19.450 INFO:tasks.workunit.client.0.smithi134.stdout:6/721: write d4/da/d15/f1e [1472624,123909] 0 2024-04-13T10:59:19.452 INFO:tasks.workunit.client.0.smithi134.stdout:6/722: symlink d4/da/leb 0 2024-04-13T10:59:19.461 INFO:tasks.workunit.client.0.smithi134.stdout:6/723: dwrite d4/da/d68/fe2 [0,4194304] 0 2024-04-13T10:59:19.464 INFO:tasks.workunit.client.0.smithi134.stdout:6/724: symlink d4/da/dbb/lec 0 2024-04-13T10:59:19.468 INFO:tasks.workunit.client.0.smithi134.stdout:6/725: creat d4/da/d15/fed x:0 0 0 2024-04-13T10:59:19.472 INFO:tasks.workunit.client.0.smithi134.stdout:6/726: getdents d4/da/d15/d1f/d24/da4 0 2024-04-13T10:59:19.476 INFO:tasks.workunit.client.0.smithi134.stdout:3/609: sync 2024-04-13T10:59:19.477 INFO:tasks.workunit.client.0.smithi134.stdout:4/550: sync 2024-04-13T10:59:19.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/551: readlink d4/d48/l85 0 2024-04-13T10:59:19.481 INFO:tasks.workunit.client.0.smithi134.stdout:6/727: dread d4/da/d15/d1f/d3c/dd0/fd9 [0,4194304] 0 2024-04-13T10:59:19.482 INFO:tasks.workunit.client.0.smithi134.stdout:4/552: read d4/dd/d6d/d8c/d5f/fae [6015373,36823] 0 2024-04-13T10:59:19.482 INFO:tasks.workunit.client.0.smithi134.stdout:3/610: creat dc/fc9 x:0 0 0 2024-04-13T10:59:19.483 INFO:tasks.workunit.client.0.smithi134.stdout:3/611: fsync dc/d27/d19/f6a 0 2024-04-13T10:59:19.483 INFO:tasks.workunit.client.0.smithi134.stdout:6/728: write d4/da/d15/d1f/d24/fb3 [149378,36494] 0 2024-04-13T10:59:19.485 INFO:tasks.workunit.client.0.smithi134.stdout:4/553: write d4/d1f/d27/d75/d38/d79/f1c [4235965,127022] 0 2024-04-13T10:59:19.488 INFO:tasks.workunit.client.0.smithi134.stdout:6/729: mknod d4/da/d15/d1f/d24/da4/cee 0 2024-04-13T10:59:19.489 INFO:tasks.workunit.client.0.smithi134.stdout:6/730: readlink d4/da/lb7 0 2024-04-13T10:59:19.491 INFO:tasks.workunit.client.0.smithi134.stdout:4/554: creat d4/d82/fb4 x:0 0 0 2024-04-13T10:59:19.493 INFO:tasks.workunit.client.0.smithi134.stdout:4/555: dread - d4/dd/d6d/d8c/fa7 zero size 2024-04-13T10:59:19.493 INFO:tasks.workunit.client.0.smithi134.stdout:3/612: dwrite dc/d1d/d58/db4/f89 [0,4194304] 0 2024-04-13T10:59:19.496 INFO:tasks.workunit.client.0.smithi134.stdout:3/613: mkdir dc/d1d/dca 0 2024-04-13T10:59:19.498 INFO:tasks.workunit.client.0.smithi134.stdout:4/556: mkdir d4/d1f/d27/d3a/d65/db5 0 2024-04-13T10:59:19.500 INFO:tasks.workunit.client.0.smithi134.stdout:6/731: dwrite d4/da/d15/d1f/d24/d49/f9e [0,4194304] 0 2024-04-13T10:59:19.504 INFO:tasks.workunit.client.0.smithi134.stdout:6/732: creat d4/da/d69/fef x:0 0 0 2024-04-13T10:59:19.507 INFO:tasks.workunit.client.0.smithi134.stdout:3/614: dwrite dc/d27/d19/d48/d49/f6c [0,4194304] 0 2024-04-13T10:59:19.514 INFO:tasks.workunit.client.0.smithi134.stdout:3/615: unlink dc/d27/d19/d48/cb0 0 2024-04-13T10:59:19.518 INFO:tasks.workunit.client.0.smithi134.stdout:3/616: truncate dc/d27/d19/d8b/da8/d50/d25/f82 155724 0 2024-04-13T10:59:19.521 INFO:tasks.workunit.client.0.smithi134.stdout:3/617: readlink dc/d27/d19/d8b/da8/d50/d25/d5f/d75/lad 0 2024-04-13T10:59:19.523 INFO:tasks.workunit.client.0.smithi134.stdout:6/733: write d4/da/dbb/dc3/f5a [2422160,43435] 0 2024-04-13T10:59:19.525 INFO:tasks.workunit.client.0.smithi134.stdout:3/618: write dc/f42 [3145070,43796] 0 2024-04-13T10:59:19.528 INFO:tasks.workunit.client.0.smithi134.stdout:3/619: read - dc/d27/d19/d8b/da8/d50/d25/d91/fba zero size 2024-04-13T10:59:19.530 INFO:tasks.workunit.client.0.smithi134.stdout:6/734: dwrite d4/f75 [0,4194304] 0 2024-04-13T10:59:19.530 INFO:tasks.workunit.client.0.smithi134.stdout:3/620: write dc/d27/f9d [1296365,51817] 0 2024-04-13T10:59:19.532 INFO:tasks.workunit.client.0.smithi134.stdout:6/735: readlink d4/da/d15/l28 0 2024-04-13T10:59:19.533 INFO:tasks.workunit.client.0.smithi134.stdout:3/621: stat dc/d27/d4d/c4a 0 2024-04-13T10:59:19.535 INFO:tasks.workunit.client.0.smithi134.stdout:6/736: symlink d4/da/d15/d1f/d24/d49/lf0 0 2024-04-13T10:59:19.537 INFO:tasks.workunit.client.0.smithi134.stdout:3/622: mknod dc/d27/d95/ccb 0 2024-04-13T10:59:19.538 INFO:tasks.workunit.client.0.smithi134.stdout:3/623: fdatasync dc/d27/d95/fbe 0 2024-04-13T10:59:19.540 INFO:tasks.workunit.client.0.smithi134.stdout:6/737: rmdir d4/da/d15/d76/d8e/da1 39 2024-04-13T10:59:19.550 INFO:tasks.workunit.client.0.smithi134.stdout:6/738: fdatasync d4/da/dbb/fbc 0 2024-04-13T10:59:19.551 INFO:tasks.workunit.client.0.smithi134.stdout:4/557: dread d4/d1f/d27/d75/d38/d79/d32/f7c [0,4194304] 0 2024-04-13T10:59:19.577 INFO:tasks.workunit.client.0.smithi134.stdout:3/624: chown dc/d27/d4d/f5e 0 1 2024-04-13T10:59:19.577 INFO:tasks.workunit.client.0.smithi134.stdout:4/558: mknod d4/dd/d6d/d8c/cb6 0 2024-04-13T10:59:19.581 INFO:tasks.workunit.client.0.smithi134.stdout:6/739: symlink d4/da/d1a/de6/lf1 0 2024-04-13T10:59:19.581 INFO:tasks.workunit.client.0.smithi134.stdout:3/625: mkdir dc/d1d/dcc 0 2024-04-13T10:59:19.585 INFO:tasks.workunit.client.0.smithi134.stdout:3/626: mkdir dc/d1d/d58/dcd 0 2024-04-13T10:59:19.586 INFO:tasks.workunit.client.0.smithi134.stdout:6/740: creat d4/da/d15/d1f/d24/ff2 x:0 0 0 2024-04-13T10:59:19.587 INFO:tasks.workunit.client.0.smithi134.stdout:6/741: fdatasync d4/da/d15/d1f/f98 0 2024-04-13T10:59:19.589 INFO:tasks.workunit.client.0.smithi134.stdout:3/627: fdatasync dc/fbc 0 2024-04-13T10:59:19.591 INFO:tasks.workunit.client.0.smithi134.stdout:3/628: rename dc/d27 to dc/d27/dce 22 2024-04-13T10:59:19.608 INFO:tasks.workunit.client.0.smithi134.stdout:4/559: dwrite d4/dd/d6d/d8c/d5f/fae [8388608,4194304] 0 2024-04-13T10:59:19.611 INFO:tasks.workunit.client.0.smithi134.stdout:6/742: truncate d4/da/d15/d1f/d24/fb3 22903 0 2024-04-13T10:59:19.616 INFO:tasks.workunit.client.0.smithi134.stdout:3/629: dwrite dc/d27/d19/d8b/d9b/f6b [0,4194304] 0 2024-04-13T10:59:19.617 INFO:tasks.workunit.client.0.smithi134.stdout:4/560: rename d4/d1f/d27/d75/d38/d79/d32/f7c to d4/d1f/d27/d2e/d84/fb7 0 2024-04-13T10:59:19.629 INFO:tasks.workunit.client.0.smithi134.stdout:3/630: rmdir dc/d1d/dcc 0 2024-04-13T10:59:19.630 INFO:tasks.workunit.client.0.smithi134.stdout:6/743: getdents d4/da/d15/d1f/d24/d49 0 2024-04-13T10:59:19.633 INFO:tasks.workunit.client.0.smithi134.stdout:3/631: mknod dc/d27/d19/d48/ccf 0 2024-04-13T10:59:19.634 INFO:tasks.workunit.client.0.smithi134.stdout:6/744: mknod d4/da/d15/cf3 0 2024-04-13T10:59:19.636 INFO:tasks.workunit.client.0.smithi134.stdout:3/632: creat dc/d1d/d58/db4/fd0 x:0 0 0 2024-04-13T10:59:19.639 INFO:tasks.workunit.client.0.smithi134.stdout:6/745: fsync d4/da/d15/d1f/d24/d2b/f2e 0 2024-04-13T10:59:19.646 INFO:tasks.workunit.client.0.smithi134.stdout:6/746: dwrite d4/da/d15/d76/d92/fd5 [0,4194304] 0 2024-04-13T10:59:19.647 INFO:tasks.workunit.client.0.smithi134.stdout:4/561: dread d4/d48/d50/f98 [0,4194304] 0 2024-04-13T10:59:19.652 INFO:tasks.workunit.client.0.smithi134.stdout:4/562: dread d4/d48/d50/f98 [0,4194304] 0 2024-04-13T10:59:19.653 INFO:tasks.workunit.client.0.smithi134.stdout:4/563: fdatasync d4/dd/d6d/d8c/f16 0 2024-04-13T10:59:19.661 INFO:tasks.workunit.client.0.smithi134.stdout:6/747: dread d4/da/f14 [0,4194304] 0 2024-04-13T10:59:19.663 INFO:tasks.workunit.client.0.smithi134.stdout:4/564: rmdir d4/d1f/d27/d3a/d65/db5 0 2024-04-13T10:59:19.666 INFO:tasks.workunit.client.0.smithi134.stdout:4/565: write d4/d1f/d27/d2e/d84/fb7 [547420,20968] 0 2024-04-13T10:59:19.667 INFO:tasks.workunit.client.0.smithi134.stdout:6/748: rmdir d4/da/d68/dbf 0 2024-04-13T10:59:19.667 INFO:tasks.workunit.client.0.smithi134.stdout:4/566: write d4/f2a [205565,58737] 0 2024-04-13T10:59:19.670 INFO:tasks.workunit.client.0.smithi134.stdout:6/749: dread d4/da/d15/d1f/d3c/dd0/fd9 [0,4194304] 0 2024-04-13T10:59:19.670 INFO:tasks.workunit.client.0.smithi134.stdout:4/567: symlink d4/d48/d4a/d7e/lb8 0 2024-04-13T10:59:19.672 INFO:tasks.workunit.client.0.smithi134.stdout:6/750: fsync d4/da/f2f 0 2024-04-13T10:59:19.673 INFO:tasks.workunit.client.0.smithi134.stdout:6/751: chown d4/da/d1a/le9 782540556 1 2024-04-13T10:59:19.673 INFO:tasks.workunit.client.0.smithi134.stdout:4/568: mkdir d4/d1f/d27/d75/d38/d79/db9 0 2024-04-13T10:59:19.674 INFO:tasks.workunit.client.0.smithi134.stdout:4/569: dread - d4/d1f/d27/d75/d38/fab zero size 2024-04-13T10:59:19.675 INFO:tasks.workunit.client.0.smithi134.stdout:4/570: readlink d4/dd/d6d/l8f 0 2024-04-13T10:59:19.677 INFO:tasks.workunit.client.0.smithi134.stdout:8/718: sync 2024-04-13T10:59:19.677 INFO:tasks.workunit.client.0.smithi134.stdout:5/908: sync 2024-04-13T10:59:19.678 INFO:tasks.workunit.client.0.smithi134.stdout:6/752: creat d4/da/d15/d76/dda/ff4 x:0 0 0 2024-04-13T10:59:19.678 INFO:tasks.workunit.client.0.smithi134.stdout:5/909: fsync dc/dc1/ffd 0 2024-04-13T10:59:19.678 INFO:tasks.workunit.client.0.smithi134.stdout:4/571: creat d4/d1f/d27/d75/d38/fba x:0 0 0 2024-04-13T10:59:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:5/910: dread dc/d15/d50/f90 [0,4194304] 0 2024-04-13T10:59:19.681 INFO:tasks.workunit.client.0.smithi134.stdout:4/572: fdatasync d4/d1f/d27/d75/d38/d79/d32/f3b 0 2024-04-13T10:59:19.684 INFO:tasks.workunit.client.0.smithi134.stdout:8/719: chown d8/dc/d2c/d68/d8c/d8f/fd7 7849 1 2024-04-13T10:59:19.686 INFO:tasks.workunit.client.0.smithi134.stdout:4/573: unlink d4/d1f/d27/d75/d38/d79/l2b 0 2024-04-13T10:59:19.690 INFO:tasks.workunit.client.0.smithi134.stdout:5/911: symlink dc/d39/d63/da5/l12a 0 2024-04-13T10:59:19.692 INFO:tasks.workunit.client.0.smithi134.stdout:4/574: mknod d4/d1f/d90/cbb 0 2024-04-13T10:59:19.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/753: write d4/da/d15/d1f/d24/d2b/f67 [546587,58693] 0 2024-04-13T10:59:19.694 INFO:tasks.workunit.client.0.smithi134.stdout:6/754: readlink d4/da/d1a/le9 0 2024-04-13T10:59:19.696 INFO:tasks.workunit.client.0.smithi134.stdout:8/720: getdents d8/dc/d16/d4e/d9c/de0 0 2024-04-13T10:59:19.697 INFO:tasks.workunit.client.0.smithi134.stdout:5/912: dwrite dc/d1d/d20/fae [0,4194304] 0 2024-04-13T10:59:19.698 INFO:tasks.workunit.client.0.smithi134.stdout:5/913: fdatasync dc/f28 0 2024-04-13T10:59:19.698 INFO:tasks.workunit.client.0.smithi134.stdout:4/575: mkdir d4/d82/dbc 0 2024-04-13T10:59:19.700 INFO:tasks.workunit.client.0.smithi134.stdout:5/914: fsync dc/d1d/d20/d23/d36/f73 0 2024-04-13T10:59:19.700 INFO:tasks.workunit.client.0.smithi134.stdout:8/721: readlink d8/dc/lf0 0 2024-04-13T10:59:19.704 INFO:tasks.workunit.client.0.smithi134.stdout:4/576: symlink d4/d82/lbd 0 2024-04-13T10:59:19.710 INFO:tasks.workunit.client.0.smithi134.stdout:4/577: creat d4/d1f/d27/d75/d38/d79/d32/d67/d9b/fbe x:0 0 0 2024-04-13T10:59:19.711 INFO:tasks.workunit.client.0.smithi134.stdout:4/578: chown d4/dd 4246644 1 2024-04-13T10:59:19.712 INFO:tasks.workunit.client.0.smithi134.stdout:4/579: write d4/d1f/d27/d75/f52 [3686554,125472] 0 2024-04-13T10:59:19.714 INFO:tasks.workunit.client.0.smithi134.stdout:4/580: write d4/d1f/d27/d75/d38/d79/f8b [9321411,79488] 0 2024-04-13T10:59:19.714 INFO:tasks.workunit.client.0.smithi134.stdout:8/722: read d8/dc/d13/f36 [484472,75517] 0 2024-04-13T10:59:19.716 INFO:tasks.workunit.client.0.smithi134.stdout:6/755: write d4/f4d [35376,88216] 0 2024-04-13T10:59:19.727 INFO:tasks.workunit.client.0.smithi134.stdout:6/756: write d4/da/d15/d76/d92/fde [4360133,83359] 0 2024-04-13T10:59:19.731 INFO:tasks.workunit.client.0.smithi134.stdout:6/757: creat d4/da/d1a/de6/ff5 x:0 0 0 2024-04-13T10:59:19.731 INFO:tasks.workunit.client.0.smithi134.stdout:4/581: link d4/dd/l11 d4/d1f/d27/d75/lbf 0 2024-04-13T10:59:19.732 INFO:tasks.workunit.client.0.smithi134.stdout:8/723: link d8/dc/d2c/d68/l55 d8/dc/d16/d54/d6c/d7d/lf1 0 2024-04-13T10:59:19.733 INFO:tasks.workunit.client.0.smithi134.stdout:5/915: dread dc/d15/df1/d3b/d3c/dbc/fbf [0,4194304] 0 2024-04-13T10:59:19.734 INFO:tasks.workunit.client.0.smithi134.stdout:8/724: stat d8/dc/d37/ldb 0 2024-04-13T10:59:19.735 INFO:tasks.workunit.client.0.smithi134.stdout:4/582: symlink d4/d1f/d27/d75/d38/d79/lc0 0 2024-04-13T10:59:19.738 INFO:tasks.workunit.client.0.smithi134.stdout:8/725: dread - d8/dc/d16/d54/d6c/d7d/fbe zero size 2024-04-13T10:59:19.740 INFO:tasks.workunit.client.0.smithi134.stdout:6/758: creat d4/da/d15/d76/d8e/ff6 x:0 0 0 2024-04-13T10:59:19.740 INFO:tasks.workunit.client.0.smithi134.stdout:5/916: dwrite dc/d1d/d20/d23/f68 [0,4194304] 0 2024-04-13T10:59:19.742 INFO:tasks.workunit.client.0.smithi134.stdout:4/583: rename d4/d1f/d27/d3a/d53/d58/d7f to d4/d1f/d27/d3a/d53/dc1 0 2024-04-13T10:59:19.742 INFO:tasks.workunit.client.0.smithi134.stdout:5/917: chown dc/d15/df1/d3b/d6a/f83 68 1 2024-04-13T10:59:19.744 INFO:tasks.workunit.client.0.smithi134.stdout:6/759: dread - d4/da/f95 zero size 2024-04-13T10:59:19.745 INFO:tasks.workunit.client.0.smithi134.stdout:4/584: stat d4/d1f/d90/fa2 0 2024-04-13T10:59:19.747 INFO:tasks.workunit.client.0.smithi134.stdout:8/726: stat d8/dc/d16/d54/d6c/d7d/lf1 0 2024-04-13T10:59:19.754 INFO:tasks.workunit.client.0.smithi134.stdout:8/727: creat d8/dc/d16/d54/d6c/d94/de7/ff2 x:0 0 0 2024-04-13T10:59:19.755 INFO:tasks.workunit.client.0.smithi134.stdout:4/585: dwrite d4/f61 [0,4194304] 0 2024-04-13T10:59:19.756 INFO:tasks.workunit.client.0.smithi134.stdout:6/760: mkdir d4/da/dbb/dca/df7 0 2024-04-13T10:59:19.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/728: rmdir d8/dc/d9d/d69 39 2024-04-13T10:59:19.773 INFO:tasks.workunit.client.0.smithi134.stdout:4/586: creat d4/d48/d50/fc2 x:0 0 0 2024-04-13T10:59:19.775 INFO:tasks.workunit.client.0.smithi134.stdout:6/761: link d4/da/d15/d1f/c7a d4/da/d69/cf8 0 2024-04-13T10:59:19.777 INFO:tasks.workunit.client.0.smithi134.stdout:6/762: write d4/da/d15/d1f/d24/f3a [3905240,64831] 0 2024-04-13T10:59:19.777 INFO:tasks.workunit.client.0.smithi134.stdout:6/763: read - d4/da/d15/fed zero size 2024-04-13T10:59:19.779 INFO:tasks.workunit.client.0.smithi134.stdout:4/587: creat d4/d1f/d27/d75/d38/d79/d32/d67/d9b/fc3 x:0 0 0 2024-04-13T10:59:19.780 INFO:tasks.workunit.client.0.smithi134.stdout:4/588: read - d4/dd/d6d/d8c/fa7 zero size 2024-04-13T10:59:19.783 INFO:tasks.workunit.client.0.smithi134.stdout:8/729: link d8/dc/d16/d54/d98/d9b/da3/fd3 d8/dc/d16/d54/ff3 0 2024-04-13T10:59:19.785 INFO:tasks.workunit.client.0.smithi134.stdout:6/764: mkdir d4/da/dbb/dc3/da6/df9 0 2024-04-13T10:59:19.785 INFO:tasks.workunit.client.0.smithi134.stdout:5/918: dwrite dc/d15/df1/d3b/f53 [0,4194304] 0 2024-04-13T10:59:19.785 INFO:tasks.workunit.client.0.smithi134.stdout:4/589: rmdir d4/d48 39 2024-04-13T10:59:19.787 INFO:tasks.workunit.client.0.smithi134.stdout:4/590: chown d4/d1f/d27/d75/d38/d79/d73/c97 65210506 1 2024-04-13T10:59:19.789 INFO:tasks.workunit.client.0.smithi134.stdout:4/591: chown d4/d1f/d27/d75/d38/d79/f46 3 1 2024-04-13T10:59:19.791 INFO:tasks.workunit.client.0.smithi134.stdout:4/592: write d4/f61 [2775490,90912] 0 2024-04-13T10:59:19.796 INFO:tasks.workunit.client.0.smithi134.stdout:6/765: creat d4/da/d15/d76/d92/ffa x:0 0 0 2024-04-13T10:59:19.797 INFO:tasks.workunit.client.0.smithi134.stdout:6/766: dread - d4/da/d15/d1f/d24/d49/d91/dc9/fe7 zero size 2024-04-13T10:59:19.801 INFO:tasks.workunit.client.0.smithi134.stdout:6/767: mkdir d4/da/d15/d1f/d24/da4/dfb 0 2024-04-13T10:59:19.804 INFO:tasks.workunit.client.0.smithi134.stdout:5/919: rmdir dc/d1d/d2b/d127/d10f 0 2024-04-13T10:59:19.806 INFO:tasks.workunit.client.0.smithi134.stdout:6/768: dread d4/da/d15/d1f/d3c/f5e [0,4194304] 0 2024-04-13T10:59:19.806 INFO:tasks.workunit.client.0.smithi134.stdout:8/730: write d8/dc/d2c/d68/fb5 [1601799,80442] 0 2024-04-13T10:59:19.809 INFO:tasks.workunit.client.0.smithi134.stdout:6/769: chown d4/da/d15/d1f/d24/d2b/f2e 482968 1 2024-04-13T10:59:19.813 INFO:tasks.workunit.client.0.smithi134.stdout:8/731: creat d8/dc/d16/d54/d6c/d94/ff4 x:0 0 0 2024-04-13T10:59:19.815 INFO:tasks.workunit.client.0.smithi134.stdout:4/593: dwrite d4/d1f/d27/d75/f31 [8388608,4194304] 0 2024-04-13T10:59:19.818 INFO:tasks.workunit.client.0.smithi134.stdout:5/920: rename dc/d15/df1/d3b/d7f/d8d/ced to dc/c12b 0 2024-04-13T10:59:19.820 INFO:tasks.workunit.client.0.smithi134.stdout:6/770: write d4/da/f95 [238762,52956] 0 2024-04-13T10:59:19.820 INFO:tasks.workunit.client.0.smithi134.stdout:8/732: mknod d8/dc/d16/d54/d6c/cf5 0 2024-04-13T10:59:19.822 INFO:tasks.workunit.client.0.smithi134.stdout:4/594: fdatasync d4/d48/d50/da0/fad 0 2024-04-13T10:59:19.823 INFO:tasks.workunit.client.0.smithi134.stdout:5/921: truncate dc/d1d/d46/f70 1556967 0 2024-04-13T10:59:19.824 INFO:tasks.workunit.client.0.smithi134.stdout:5/922: stat dc/d15/d65 0 2024-04-13T10:59:19.825 INFO:tasks.workunit.client.0.smithi134.stdout:6/771: creat d4/da/d15/d1f/d24/d49/ffc x:0 0 0 2024-04-13T10:59:19.826 INFO:tasks.workunit.client.0.smithi134.stdout:8/733: mkdir d8/dc/d16/d54/d6c/d94/df6 0 2024-04-13T10:59:19.829 INFO:tasks.workunit.client.0.smithi134.stdout:6/772: truncate d4/da/d15/fed 252114 0 2024-04-13T10:59:19.831 INFO:tasks.workunit.client.0.smithi134.stdout:5/923: read dc/f14 [3876311,86246] 0 2024-04-13T10:59:19.831 INFO:tasks.workunit.client.0.smithi134.stdout:4/595: dwrite d4/d48/d4a/d7e/f9a [0,4194304] 0 2024-04-13T10:59:19.834 INFO:tasks.workunit.client.0.smithi134.stdout:6/773: mkdir d4/da/dbb/de5/dfd 0 2024-04-13T10:59:19.840 INFO:tasks.workunit.client.0.smithi134.stdout:4/596: read d4/f7a [603687,92999] 0 2024-04-13T10:59:19.843 INFO:tasks.workunit.client.0.smithi134.stdout:6/774: dwrite d4/f4d [0,4194304] 0 2024-04-13T10:59:19.844 INFO:tasks.workunit.client.0.smithi134.stdout:4/597: write d4/d1f/d27/d75/d38/d79/d32/d67/d9b/f9d [546487,100526] 0 2024-04-13T10:59:19.854 INFO:tasks.workunit.client.0.smithi134.stdout:5/924: link dc/d1d/d46/f4c dc/d15/df8/d115/f12c 0 2024-04-13T10:59:19.856 INFO:tasks.workunit.client.0.smithi134.stdout:8/734: truncate d8/dc/d16/d54/d6f/f90 1310335 0 2024-04-13T10:59:19.858 INFO:tasks.workunit.client.0.smithi134.stdout:6/775: mkdir d4/da/d15/d1f/d24/ddf/dfe 0 2024-04-13T10:59:19.861 INFO:tasks.workunit.client.0.smithi134.stdout:6/776: readlink d4/da/d15/d1f/d24/d49/lf0 0 2024-04-13T10:59:19.867 INFO:tasks.workunit.client.0.smithi134.stdout:8/735: mknod d8/dc/d16/ddd/cf7 0 2024-04-13T10:59:19.869 INFO:tasks.workunit.client.0.smithi134.stdout:4/598: dwrite d4/dd/d6d/d8c/f36 [0,4194304] 0 2024-04-13T10:59:19.872 INFO:tasks.workunit.client.0.smithi134.stdout:5/925: write dc/d1d/d20/fc8 [597984,118348] 0 2024-04-13T10:59:19.876 INFO:tasks.workunit.client.0.smithi134.stdout:6/777: dread d4/da/d1a/f29 [0,4194304] 0 2024-04-13T10:59:19.876 INFO:tasks.workunit.client.0.smithi134.stdout:4/599: rmdir d4/d1f/d56 39 2024-04-13T10:59:19.876 INFO:tasks.workunit.client.0.smithi134.stdout:4/600: readlink d4/d48/l4f 0 2024-04-13T10:59:19.878 INFO:tasks.workunit.client.0.smithi134.stdout:8/736: symlink d8/dc/d16/d54/lf8 0 2024-04-13T10:59:19.879 INFO:tasks.workunit.client.0.smithi134.stdout:4/601: mknod d4/d1f/d27/cc4 0 2024-04-13T10:59:19.887 INFO:tasks.workunit.client.0.smithi134.stdout:4/602: dwrite d4/f61 [0,4194304] 0 2024-04-13T10:59:19.888 INFO:tasks.workunit.client.0.smithi134.stdout:4/603: dread - d4/dd/d6d/d8c/fa7 zero size 2024-04-13T10:59:19.888 INFO:tasks.workunit.client.0.smithi134.stdout:5/926: dread dc/d1d/d20/f59 [0,4194304] 0 2024-04-13T10:59:19.890 INFO:tasks.workunit.client.0.smithi134.stdout:5/927: write dc/dc1/ffd [889176,23943] 0 2024-04-13T10:59:19.926 INFO:tasks.workunit.client.0.smithi134.stdout:2/541: sync 2024-04-13T10:59:19.926 INFO:tasks.workunit.client.0.smithi134.stdout:0/653: sync 2024-04-13T10:59:19.927 INFO:tasks.workunit.client.0.smithi134.stdout:7/594: sync 2024-04-13T10:59:19.929 INFO:tasks.workunit.client.0.smithi134.stdout:7/595: chown da/d15/d26/d27/d3d/d9c/fa6 2019 1 2024-04-13T10:59:19.930 INFO:tasks.workunit.client.0.smithi134.stdout:4/604: symlink d4/d48/d4a/lc5 0 2024-04-13T10:59:19.931 INFO:tasks.workunit.client.0.smithi134.stdout:8/737: write d8/dc/d16/d54/d6c/d94/dc1/fc6 [765863,106056] 0 2024-04-13T10:59:19.932 INFO:tasks.workunit.client.0.smithi134.stdout:4/605: chown d4/d48/d4a/c6e 896500990 1 2024-04-13T10:59:19.934 INFO:tasks.workunit.client.0.smithi134.stdout:0/654: creat d4/d17/d23/d51/d6b/d91/d98/d62/d7c/ff5 x:0 0 0 2024-04-13T10:59:19.939 INFO:tasks.workunit.client.0.smithi134.stdout:4/606: fdatasync d4/dd/d6d/d8c/ff 0 2024-04-13T10:59:19.939 INFO:tasks.workunit.client.0.smithi134.stdout:8/738: dread d8/dc/d13/f63 [0,4194304] 0 2024-04-13T10:59:19.945 INFO:tasks.workunit.client.0.smithi134.stdout:5/928: dread dc/d15/df1/d3b/f120 [0,4194304] 0 2024-04-13T10:59:19.946 INFO:tasks.workunit.client.0.smithi134.stdout:8/739: dread d8/dc/d16/d4e/f62 [0,4194304] 0 2024-04-13T10:59:19.946 INFO:tasks.workunit.client.0.smithi134.stdout:5/929: stat dc/d1d/d2b/d30/f7a 0 2024-04-13T10:59:19.947 INFO:tasks.workunit.client.0.smithi134.stdout:5/930: readlink dc/d15/df1/d3b/d7f/lac 0 2024-04-13T10:59:19.950 INFO:tasks.workunit.client.0.smithi134.stdout:2/542: getdents d5/d6/d57/d6f/d30 0 2024-04-13T10:59:19.951 INFO:tasks.workunit.client.0.smithi134.stdout:4/607: readlink d4/d48/l59 0 2024-04-13T10:59:19.954 INFO:tasks.workunit.client.0.smithi134.stdout:0/655: creat d4/d17/d23/d51/d6b/d91/d98/d92/dca/ff6 x:0 0 0 2024-04-13T10:59:19.959 INFO:tasks.workunit.client.0.smithi134.stdout:5/931: dwrite dc/d1d/d20/d23/f2a [4194304,4194304] 0 2024-04-13T10:59:19.965 INFO:tasks.workunit.client.0.smithi134.stdout:7/596: dwrite da/d15/f2e [4194304,4194304] 0 2024-04-13T10:59:19.966 INFO:tasks.workunit.client.0.smithi134.stdout:5/932: readlink dc/d1d/lce 0 2024-04-13T10:59:19.969 INFO:tasks.workunit.client.0.smithi134.stdout:7/597: write da/d15/d26/d27/d4f/f7d [113905,6108] 0 2024-04-13T10:59:19.970 INFO:tasks.workunit.client.0.smithi134.stdout:8/740: dwrite d8/dc/fbc [0,4194304] 0 2024-04-13T10:59:19.971 INFO:tasks.workunit.client.0.smithi134.stdout:7/598: write da/d15/f2e [6970331,47916] 0 2024-04-13T10:59:19.972 INFO:tasks.workunit.client.0.smithi134.stdout:4/608: rename d4/dd/d6d/d8c/f36 to d4/d1f/d27/d75/d38/d79/d73/fc6 0 2024-04-13T10:59:19.984 INFO:tasks.workunit.client.0.smithi134.stdout:4/609: creat d4/d1f/d27/d3a/d65/fc7 x:0 0 0 2024-04-13T10:59:19.987 INFO:tasks.workunit.client.0.smithi134.stdout:2/543: write d5/d6/f68 [2724440,38442] 0 2024-04-13T10:59:19.990 INFO:tasks.workunit.client.0.smithi134.stdout:7/599: dwrite da/d15/d26/d27/d4f/d5f/d67/d76/faa [0,4194304] 0 2024-04-13T10:59:19.991 INFO:tasks.workunit.client.0.smithi134.stdout:8/741: dwrite d8/dc/d16/d54/d6c/d94/de7/fef [0,4194304] 0 2024-04-13T10:59:19.992 INFO:tasks.workunit.client.0.smithi134.stdout:0/656: write d4/d17/d23/d51/d6b/d91/d98/d62/f70 [1275902,23702] 0 2024-04-13T10:59:19.993 INFO:tasks.workunit.client.0.smithi134.stdout:4/610: write d4/d1f/d27/d75/d38/f41 [3372827,21271] 0 2024-04-13T10:59:20.002 INFO:tasks.workunit.client.0.smithi134.stdout:0/657: symlink d4/d17/d20/d29/lf7 0 2024-04-13T10:59:20.003 INFO:tasks.workunit.client.0.smithi134.stdout:4/611: symlink d4/dd/d6d/lc8 0 2024-04-13T10:59:20.005 INFO:tasks.workunit.client.0.smithi134.stdout:7/600: fsync da/d15/d26/d27/d4f/d5f/d67/d73/d92/fa9 0 2024-04-13T10:59:20.006 INFO:tasks.workunit.client.0.smithi134.stdout:2/544: dread d5/de/d12/f43 [0,4194304] 0 2024-04-13T10:59:20.006 INFO:tasks.workunit.client.0.smithi134.stdout:8/742: symlink d8/dc/d9d/d69/lf9 0 2024-04-13T10:59:20.006 INFO:tasks.workunit.client.0.smithi134.stdout:0/658: chown d4/d17/da/d22/deb/fdc 596 1 2024-04-13T10:59:20.011 INFO:tasks.workunit.client.0.smithi134.stdout:2/545: read - d5/d6/d70/f90 zero size 2024-04-13T10:59:20.011 INFO:tasks.workunit.client.0.smithi134.stdout:2/546: chown d5 669776529 1 2024-04-13T10:59:20.012 INFO:tasks.workunit.client.0.smithi134.stdout:4/612: symlink d4/d48/d4a/d7e/lc9 0 2024-04-13T10:59:20.013 INFO:tasks.workunit.client.0.smithi134.stdout:2/547: readlink d5/d6/l3c 0 2024-04-13T10:59:20.015 INFO:tasks.workunit.client.0.smithi134.stdout:8/743: mkdir d8/dc/d16/d54/d98/dfa 0 2024-04-13T10:59:20.015 INFO:tasks.workunit.client.0.smithi134.stdout:4/613: write d4/d1f/d27/d3a/d65/fc7 [784311,7925] 0 2024-04-13T10:59:20.017 INFO:tasks.workunit.client.0.smithi134.stdout:5/933: dread dc/d15/f43 [0,4194304] 0 2024-04-13T10:59:20.018 INFO:tasks.workunit.client.0.smithi134.stdout:8/744: fsync d8/dc/d9d/d69/fe9 0 2024-04-13T10:59:20.021 INFO:tasks.workunit.client.0.smithi134.stdout:8/745: stat d8/dc/d16/f1b 0 2024-04-13T10:59:20.021 INFO:tasks.workunit.client.0.smithi134.stdout:4/614: mknod d4/d48/d4a/d7e/cca 0 2024-04-13T10:59:20.022 INFO:tasks.workunit.client.0.smithi134.stdout:2/548: dread d5/d6/d57/d6c/d29/f46 [0,4194304] 0 2024-04-13T10:59:20.024 INFO:tasks.workunit.client.0.smithi134.stdout:2/549: readlink d5/d6/l5a 0 2024-04-13T10:59:20.025 INFO:tasks.workunit.client.0.smithi134.stdout:0/659: dwrite d4/d17/d23/d51/d6b/d91/d98/d92/dca/fce [0,4194304] 0 2024-04-13T10:59:20.032 INFO:tasks.workunit.client.0.smithi134.stdout:5/934: dwrite dc/d1d/d20/d23/f32 [0,4194304] 0 2024-04-13T10:59:20.033 INFO:tasks.workunit.client.0.smithi134.stdout:2/550: fdatasync d5/de/d50/f5d 0 2024-04-13T10:59:20.035 INFO:tasks.workunit.client.0.smithi134.stdout:7/601: truncate da/d15/d26/d27/d3d/d9c/d48/f93 6481941 0 2024-04-13T10:59:20.037 INFO:tasks.workunit.client.0.smithi134.stdout:8/746: dwrite d8/dc/d13/ddf/fea [0,4194304] 0 2024-04-13T10:59:20.039 INFO:tasks.workunit.client.0.smithi134.stdout:8/747: readlink d8/dc/d16/l51 0 2024-04-13T10:59:20.047 INFO:tasks.workunit.client.0.smithi134.stdout:8/748: read d8/dc/f3e [348467,87913] 0 2024-04-13T10:59:20.048 INFO:tasks.workunit.client.0.smithi134.stdout:4/615: rename d4/d1f/d27/d75/d38/fa1 to d4/dd/fcb 0 2024-04-13T10:59:20.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/551: mkdir d5/da1 0 2024-04-13T10:59:20.051 INFO:tasks.workunit.client.0.smithi134.stdout:2/552: stat d5/d6/d57/d6f/d30/d58/d59/l87 0 2024-04-13T10:59:20.054 INFO:tasks.workunit.client.0.smithi134.stdout:8/749: read d8/dc/d16/d54/f65 [155961,64565] 0 2024-04-13T10:59:20.054 INFO:tasks.workunit.client.0.smithi134.stdout:4/616: truncate d4/d1f/d27/d75/d38/d79/d32/d67/d9b/fc3 518560 0 2024-04-13T10:59:20.055 INFO:tasks.workunit.client.0.smithi134.stdout:4/617: readlink d4/d1f/d27/l47 0 2024-04-13T10:59:20.060 INFO:tasks.workunit.client.0.smithi134.stdout:5/935: rename dc/d15/f94 to dc/d1d/d20/f12d 0 2024-04-13T10:59:20.061 INFO:tasks.workunit.client.0.smithi134.stdout:5/936: stat dc/d1d/d2b/d127 0 2024-04-13T10:59:20.063 INFO:tasks.workunit.client.0.smithi134.stdout:0/660: link d4/d17/da/d22/d37/c46 d4/d17/d23/d51/d6a/d94/db2/cf8 0 2024-04-13T10:59:20.071 INFO:tasks.workunit.client.0.smithi134.stdout:7/602: rename da/d15/d26/d27/d3d/d9c/d48/f50 to da/d15/d26/d27/d4f/d5f/d67/d76/fb6 0 2024-04-13T10:59:20.073 INFO:tasks.workunit.client.0.smithi134.stdout:0/661: stat d4/d17/d23/d51/d6b/lee 0 2024-04-13T10:59:20.074 INFO:tasks.workunit.client.0.smithi134.stdout:5/937: read dc/d39/f41 [263197,102511] 0 2024-04-13T10:59:20.074 INFO:tasks.workunit.client.0.smithi134.stdout:0/662: chown d4/d17/d23 214954 1 2024-04-13T10:59:20.077 INFO:tasks.workunit.client.0.smithi134.stdout:8/750: link d8/dc/d37/f64 d8/dc/d16/d54/d98/d9b/da3/ffb 0 2024-04-13T10:59:20.077 INFO:tasks.workunit.client.0.smithi134.stdout:8/751: readlink d8/dc/d13/l41 0 2024-04-13T10:59:20.078 INFO:tasks.workunit.client.0.smithi134.stdout:4/618: rename d4/d1f/d27/d75/d38/fab to d4/d48/d50/da0/fcc 0 2024-04-13T10:59:20.082 INFO:tasks.workunit.client.0.smithi134.stdout:2/553: link d5/d6/d57/d6f/d30/d58/f9d d5/de/d12/fa2 0 2024-04-13T10:59:20.082 INFO:tasks.workunit.client.0.smithi134.stdout:5/938: rmdir dc/d1d/d2b/d30/d100 39 2024-04-13T10:59:20.084 INFO:tasks.workunit.client.0.smithi134.stdout:0/663: symlink d4/d17/d23/d51/d6b/lf9 0 2024-04-13T10:59:20.086 INFO:tasks.workunit.client.0.smithi134.stdout:8/752: creat d8/dc/d16/d54/d98/d9b/da3/ffc x:0 0 0 2024-04-13T10:59:20.087 INFO:tasks.workunit.client.0.smithi134.stdout:8/753: chown d8/dc/d16/d54/d98/lb0 57450 1 2024-04-13T10:59:20.088 INFO:tasks.workunit.client.0.smithi134.stdout:4/619: symlink d4/d1f/d27/d75/d38/d79/d32/lcd 0 2024-04-13T10:59:20.089 INFO:tasks.workunit.client.0.smithi134.stdout:4/620: chown d4/d48/d4a/d7e/f9a 1 1 2024-04-13T10:59:20.090 INFO:tasks.workunit.client.0.smithi134.stdout:2/554: mknod d5/d6/d57/d6f/d30/ca3 0 2024-04-13T10:59:20.090 INFO:tasks.workunit.client.0.smithi134.stdout:4/621: dread - d4/d48/d50/da0/fad zero size 2024-04-13T10:59:20.091 INFO:tasks.workunit.client.0.smithi134.stdout:5/939: fdatasync dc/d15/df1/d3b/d7f/fd8 0 2024-04-13T10:59:20.093 INFO:tasks.workunit.client.0.smithi134.stdout:0/664: read d4/d17/da/d22/d37/d6d/da5/fab [10539,15732] 0 2024-04-13T10:59:20.095 INFO:tasks.workunit.client.0.smithi134.stdout:8/754: mknod d8/dc/d2c/d68/d8c/d8f/cfd 0 2024-04-13T10:59:20.099 INFO:tasks.workunit.client.0.smithi134.stdout:2/555: rename d5/de/c5c to d5/de/d12/ca4 0 2024-04-13T10:59:20.101 INFO:tasks.workunit.client.0.smithi134.stdout:2/556: stat d5/d6/d57/d6f 0 2024-04-13T10:59:20.104 INFO:tasks.workunit.client.0.smithi134.stdout:4/622: dwrite d4/d48/d50/f98 [4194304,4194304] 0 2024-04-13T10:59:20.105 INFO:tasks.workunit.client.0.smithi134.stdout:2/557: readlink d5/d6/d57/d6c/d29/l8a 0 2024-04-13T10:59:20.108 INFO:tasks.workunit.client.0.smithi134.stdout:7/603: dwrite da/d15/d26/f35 [4194304,4194304] 0 2024-04-13T10:59:20.109 INFO:tasks.workunit.client.0.smithi134.stdout:7/604: write da/f13 [1730555,63052] 0 2024-04-13T10:59:20.110 INFO:tasks.workunit.client.0.smithi134.stdout:0/665: creat d4/d17/d20/d29/d30/d64/d84/dd3/ffa x:0 0 0 2024-04-13T10:59:20.111 INFO:tasks.workunit.client.0.smithi134.stdout:8/755: creat d8/dc/d13/ddf/ffe x:0 0 0 2024-04-13T10:59:20.118 INFO:tasks.workunit.client.0.smithi134.stdout:4/623: mkdir d4/d1f/d27/d3a/d65/dce 0 2024-04-13T10:59:20.122 INFO:tasks.workunit.client.0.smithi134.stdout:7/605: unlink da/d15/d26/d27/d4f/d5f/d88/c8e 0 2024-04-13T10:59:20.123 INFO:tasks.workunit.client.0.smithi134.stdout:5/940: dwrite dc/d1d/d20/ddc/fc2 [0,4194304] 0 2024-04-13T10:59:20.125 INFO:tasks.workunit.client.0.smithi134.stdout:8/756: creat d8/dc/d16/d74/fff x:0 0 0 2024-04-13T10:59:20.130 INFO:tasks.workunit.client.0.smithi134.stdout:3/633: sync 2024-04-13T10:59:20.130 INFO:tasks.workunit.client.0.smithi134.stdout:9/802: sync 2024-04-13T10:59:20.130 INFO:tasks.workunit.client.0.smithi134.stdout:1/844: sync 2024-04-13T10:59:20.131 INFO:tasks.workunit.client.0.smithi134.stdout:7/606: symlink da/d15/d26/d27/d4f/lb7 0 2024-04-13T10:59:20.132 INFO:tasks.workunit.client.0.smithi134.stdout:5/941: mkdir dc/d15/d50/d12e 0 2024-04-13T10:59:20.133 INFO:tasks.workunit.client.0.smithi134.stdout:9/803: write d13/d39/f3b [2695616,17377] 0 2024-04-13T10:59:20.133 INFO:tasks.workunit.client.0.smithi134.stdout:7/607: dread - da/d15/d26/d27/d3d/d46/f4b zero size 2024-04-13T10:59:20.135 INFO:tasks.workunit.client.0.smithi134.stdout:9/804: readlink d13/l29 0 2024-04-13T10:59:20.135 INFO:tasks.workunit.client.0.smithi134.stdout:8/757: creat d8/dc/d16/d54/d6c/f100 x:0 0 0 2024-04-13T10:59:20.136 INFO:tasks.workunit.client.0.smithi134.stdout:5/942: chown dc/d1d/d20/l40 189 1 2024-04-13T10:59:20.141 INFO:tasks.workunit.client.0.smithi134.stdout:5/943: truncate dc/d1d/d20/ddc/fc2 4837357 0 2024-04-13T10:59:20.142 INFO:tasks.workunit.client.0.smithi134.stdout:9/805: stat d13/d2e/la7 0 2024-04-13T10:59:20.142 INFO:tasks.workunit.client.0.smithi134.stdout:5/944: readlink dc/l8a 0 2024-04-13T10:59:20.143 INFO:tasks.workunit.client.0.smithi134.stdout:1/845: mknod d3/d6/d20/d71/d9c/c114 0 2024-04-13T10:59:20.143 INFO:tasks.workunit.client.0.smithi134.stdout:7/608: dwrite da/f13 [0,4194304] 0 2024-04-13T10:59:20.144 INFO:tasks.workunit.client.0.smithi134.stdout:8/758: mknod d8/dc/d2c/d68/d8c/c101 0 2024-04-13T10:59:20.146 INFO:tasks.workunit.client.0.smithi134.stdout:2/558: dread f1 [0,4194304] 0 2024-04-13T10:59:20.147 INFO:tasks.workunit.client.0.smithi134.stdout:8/759: chown d8/dc/d16/f2d 11977830 1 2024-04-13T10:59:20.147 INFO:tasks.workunit.client.0.smithi134.stdout:4/624: getdents d4/d1f/d90 0 2024-04-13T10:59:20.148 INFO:tasks.workunit.client.0.smithi134.stdout:9/806: readlink d13/l56 0 2024-04-13T10:59:20.148 INFO:tasks.workunit.client.0.smithi134.stdout:4/625: readlink d4/d48/d4a/d7e/lc9 0 2024-04-13T10:59:20.148 INFO:tasks.workunit.client.0.smithi134.stdout:6/778: sync 2024-04-13T10:59:20.149 INFO:tasks.workunit.client.0.smithi134.stdout:8/760: readlink d8/dc/d16/d54/d6c/d94/dc0/le1 0 2024-04-13T10:59:20.150 INFO:tasks.workunit.client.0.smithi134.stdout:0/666: write d4/d17/d23/d51/d6a/fcb [206869,78688] 0 2024-04-13T10:59:20.152 INFO:tasks.workunit.client.0.smithi134.stdout:5/945: creat dc/d15/df1/d3b/d7f/d8d/d7d/dc0/f12f x:0 0 0 2024-04-13T10:59:20.153 INFO:tasks.workunit.client.0.smithi134.stdout:2/559: creat d5/de/d2e/d8f/fa5 x:0 0 0 2024-04-13T10:59:20.155 INFO:tasks.workunit.client.0.smithi134.stdout:4/626: read d4/d1f/d27/d75/d38/d79/f1c [933851,22821] 0 2024-04-13T10:59:20.157 INFO:tasks.workunit.client.0.smithi134.stdout:9/807: mknod d13/da3/c121 0 2024-04-13T10:59:20.158 INFO:tasks.workunit.client.0.smithi134.stdout:9/808: fdatasync d13/da3/d98/db3/fe6 0 2024-04-13T10:59:20.159 INFO:tasks.workunit.client.0.smithi134.stdout:3/634: write dc/d27/d19/d8b/da8/d50/d25/f51 [1177920,46847] 0 2024-04-13T10:59:20.160 INFO:tasks.workunit.client.0.smithi134.stdout:9/809: read - d13/d39/d58/dd5/de5/d10a/f10c zero size 2024-04-13T10:59:20.164 INFO:tasks.workunit.client.0.smithi134.stdout:0/667: mkdir d4/d17/d20/d29/dcd/dfb 0 2024-04-13T10:59:20.167 INFO:tasks.workunit.client.0.smithi134.stdout:8/761: write d8/ff [4319638,75643] 0 2024-04-13T10:59:20.170 INFO:tasks.workunit.client.0.smithi134.stdout:4/627: unlink d4/d1f/d27/d3a/d65/fc7 0 2024-04-13T10:59:20.172 INFO:tasks.workunit.client.0.smithi134.stdout:3/635: chown dc/d1d/c41 13346 1 2024-04-13T10:59:20.174 INFO:tasks.workunit.client.0.smithi134.stdout:9/810: mknod d13/d39/d58/dd5/de5/d10a/c122 0 2024-04-13T10:59:20.174 INFO:tasks.workunit.client.0.smithi134.stdout:6/779: getdents d4/da/dbb/dc3/da6/df9 0 2024-04-13T10:59:20.179 INFO:tasks.workunit.client.0.smithi134.stdout:2/560: rename d5/d6/c1f to d5/d6/d70/d9c/ca6 0 2024-04-13T10:59:20.179 INFO:tasks.workunit.client.0.smithi134.stdout:7/609: link da/d15/d26/d27/d4f/d5f/c7e da/d15/d85/cb8 0 2024-04-13T10:59:20.181 INFO:tasks.workunit.client.0.smithi134.stdout:7/610: chown da/d15/d26/d27/d3d/d9c/d48/f5d 240 1 2024-04-13T10:59:20.182 INFO:tasks.workunit.client.0.smithi134.stdout:1/846: getdents d3/d6/d16/d4d/d65 0 2024-04-13T10:59:20.183 INFO:tasks.workunit.client.0.smithi134.stdout:7/611: fdatasync da/d15/d26/d27/d3d/f7a 0 2024-04-13T10:59:20.186 INFO:tasks.workunit.client.0.smithi134.stdout:9/811: mkdir d13/d39/d64/db2/d123 0 2024-04-13T10:59:20.190 INFO:tasks.workunit.client.0.smithi134.stdout:0/668: dread d4/d17/d20/d29/d30/d64/d84/dd3/d8c/faa [0,4194304] 0 2024-04-13T10:59:20.191 INFO:tasks.workunit.client.0.smithi134.stdout:8/762: rename d8/dc/d9d/c84 to d8/dc/d16/d54/d6f/c102 0 2024-04-13T10:59:20.192 INFO:tasks.workunit.client.0.smithi134.stdout:8/763: chown d8/dcc/cd1 4069 1 2024-04-13T10:59:20.193 INFO:tasks.workunit.client.0.smithi134.stdout:2/561: dread d5/d6/d57/d6f/f44 [0,4194304] 0 2024-04-13T10:59:20.194 INFO:tasks.workunit.client.0.smithi134.stdout:2/562: readlink d5/d6/d34/l5f 0 2024-04-13T10:59:20.197 INFO:tasks.workunit.client.0.smithi134.stdout:7/612: stat da/d15/d26/d27/d4f/d5f/d67/d73/d92/ca1 0 2024-04-13T10:59:20.204 INFO:tasks.workunit.client.0.smithi134.stdout:8/764: write d8/dc/d2c/d68/d8c/fba [795897,1894] 0 2024-04-13T10:59:20.205 INFO:tasks.workunit.client.0.smithi134.stdout:8/765: chown d8/dc/d37/d3f/fa0 13165 1 2024-04-13T10:59:20.206 INFO:tasks.workunit.client.0.smithi134.stdout:8/766: write d8/dc/d9d/d69/fe9 [347061,107153] 0 2024-04-13T10:59:20.211 INFO:tasks.workunit.client.0.smithi134.stdout:1/847: write d3/d6/d6a/f78 [380645,61540] 0 2024-04-13T10:59:20.211 INFO:tasks.workunit.client.0.smithi134.stdout:3/636: link dc/d27/d19/d8b/da8/d50/d25/c6d dc/d27/d19/d8b/da8/d50/d25/d91/cd1 0 2024-04-13T10:59:20.214 INFO:tasks.workunit.client.0.smithi134.stdout:6/780: creat d4/da/d15/d1f/d24/fff x:0 0 0 2024-04-13T10:59:20.215 INFO:tasks.workunit.client.0.smithi134.stdout:6/781: dread - d4/da/d15/d1f/d24/d49/d91/dc9/fe7 zero size 2024-04-13T10:59:20.217 INFO:tasks.workunit.client.0.smithi134.stdout:8/767: readlink d8/dc/lac 0 2024-04-13T10:59:20.217 INFO:tasks.workunit.client.0.smithi134.stdout:2/563: write d5/d6/d57/d6c/d29/f46 [374095,85434] 0 2024-04-13T10:59:20.219 INFO:tasks.workunit.client.0.smithi134.stdout:4/628: getdents d4/d1f/d27/d75/d38/d79 0 2024-04-13T10:59:20.220 INFO:tasks.workunit.client.0.smithi134.stdout:0/669: truncate d4/d17/d23/d51/d6b/d91/d98/d92/dca/fce 638533 0 2024-04-13T10:59:20.221 INFO:tasks.workunit.client.0.smithi134.stdout:6/782: chown d4/da/d15/d1f/d3c/f5e 23188 1 2024-04-13T10:59:20.221 INFO:tasks.workunit.client.0.smithi134.stdout:1/848: symlink d3/d6/d20/d71/l115 0 2024-04-13T10:59:20.224 INFO:tasks.workunit.client.0.smithi134.stdout:9/812: dwrite d13/d2e/d35/d50/d59/fc3 [0,4194304] 0 2024-04-13T10:59:20.230 INFO:tasks.workunit.client.0.smithi134.stdout:9/813: truncate d13/d2e/d35/f4b 5038908 0 2024-04-13T10:59:20.232 INFO:tasks.workunit.client.0.smithi134.stdout:4/629: write d4/d1f/d27/d75/f31 [5624012,106140] 0 2024-04-13T10:59:20.233 INFO:tasks.workunit.client.0.smithi134.stdout:6/783: creat d4/da/dbb/de5/f100 x:0 0 0 2024-04-13T10:59:20.235 INFO:tasks.workunit.client.0.smithi134.stdout:7/613: write da/d15/d26/d38/f66 [4929266,49061] 0 2024-04-13T10:59:20.235 INFO:tasks.workunit.client.0.smithi134.stdout:9/814: chown d13/d39/d58/d5f/d6e/f101 8458348 1 2024-04-13T10:59:20.236 INFO:tasks.workunit.client.0.smithi134.stdout:2/564: dread d5/de/d2e/d8f/f6e [0,4194304] 0 2024-04-13T10:59:20.237 INFO:tasks.workunit.client.0.smithi134.stdout:8/768: dwrite d8/dc/d2c/d68/d8c/fba [0,4194304] 0 2024-04-13T10:59:20.238 INFO:tasks.workunit.client.0.smithi134.stdout:9/815: stat d13/d39/f4e 0 2024-04-13T10:59:20.241 INFO:tasks.workunit.client.0.smithi134.stdout:0/670: rename d4/d17/da/d22/d37 to d4/d17/d20/da9/de1/dfc 0 2024-04-13T10:59:20.241 INFO:tasks.workunit.client.0.smithi134.stdout:2/565: dread - d5/de/d12/f86 zero size 2024-04-13T10:59:20.245 INFO:tasks.workunit.client.0.smithi134.stdout:6/784: symlink d4/da/d15/d77/d63/l101 0 2024-04-13T10:59:20.248 INFO:tasks.workunit.client.0.smithi134.stdout:3/637: dread dc/d2a/f56 [0,4194304] 0 2024-04-13T10:59:20.249 INFO:tasks.workunit.client.0.smithi134.stdout:8/769: dread d8/dc/fbc [0,4194304] 0 2024-04-13T10:59:20.253 INFO:tasks.workunit.client.0.smithi134.stdout:9/816: dwrite d13/d39/d58/dd5/de5/d10a/f10c [0,4194304] 0 2024-04-13T10:59:20.258 INFO:tasks.workunit.client.0.smithi134.stdout:3/638: dwrite dc/d27/d19/d48/d8e/f9c [0,4194304] 0 2024-04-13T10:59:20.261 INFO:tasks.workunit.client.0.smithi134.stdout:7/614: write da/d15/d26/d27/d3d/d9c/d48/f93 [5149527,7876] 0 2024-04-13T10:59:20.264 INFO:tasks.workunit.client.0.smithi134.stdout:3/639: dread dc/d2a/f56 [0,4194304] 0 2024-04-13T10:59:20.270 INFO:tasks.workunit.client.0.smithi134.stdout:1/849: getdents d3 0 2024-04-13T10:59:20.273 INFO:tasks.workunit.client.0.smithi134.stdout:6/785: creat d4/da/f102 x:0 0 0 2024-04-13T10:59:20.275 INFO:tasks.workunit.client.0.smithi134.stdout:8/770: dread d8/dc/fd2 [4194304,4194304] 0 2024-04-13T10:59:20.278 INFO:tasks.workunit.client.0.smithi134.stdout:2/566: mknod d5/d6/d57/d6f/d30/d88/d94/ca7 0 2024-04-13T10:59:20.280 INFO:tasks.workunit.client.0.smithi134.stdout:0/671: truncate d4/d17/d20/d29/d30/d7f/dc0/fd8 241867 0 2024-04-13T10:59:20.281 INFO:tasks.workunit.client.0.smithi134.stdout:0/672: stat d4/d17/d23/d51/d6b/lf9 0 2024-04-13T10:59:20.283 INFO:tasks.workunit.client.0.smithi134.stdout:1/850: symlink d3/d6/d16/l116 0 2024-04-13T10:59:20.284 INFO:tasks.workunit.client.0.smithi134.stdout:1/851: write d3/d6/d16/d1d/fd9 [209595,73911] 0 2024-04-13T10:59:20.286 INFO:tasks.workunit.client.0.smithi134.stdout:6/786: mknod d4/da/d15/d1f/d24/da4/c103 0 2024-04-13T10:59:20.288 INFO:tasks.workunit.client.0.smithi134.stdout:9/817: rename d13/d2e/d35/d50/f7b to d13/d39/d58/d5f/f124 0 2024-04-13T10:59:20.292 INFO:tasks.workunit.client.0.smithi134.stdout:1/852: dwrite d3/d6/d20/d89/fd1 [0,4194304] 0 2024-04-13T10:59:20.298 INFO:tasks.workunit.client.0.smithi134.stdout:6/787: truncate d4/da/f25 1094424 0 2024-04-13T10:59:20.301 INFO:tasks.workunit.client.0.smithi134.stdout:7/615: dwrite f8 [0,4194304] 0 2024-04-13T10:59:20.302 INFO:tasks.workunit.client.0.smithi134.stdout:7/616: chown da/d15/d85/cb8 10184 1 2024-04-13T10:59:20.302 INFO:tasks.workunit.client.0.smithi134.stdout:9/818: symlink d13/d39/d58/dd5/l125 0 2024-04-13T10:59:20.312 INFO:tasks.workunit.client.0.smithi134.stdout:3/640: rename dc/l7d to dc/d27/d19/d8b/d9b/ld2 0 2024-04-13T10:59:20.315 INFO:tasks.workunit.client.0.smithi134.stdout:6/788: unlink d4/lc 0 2024-04-13T10:59:20.316 INFO:tasks.workunit.client.0.smithi134.stdout:7/617: creat da/d15/d26/d27/d4f/d5f/d67/d73/fb9 x:0 0 0 2024-04-13T10:59:20.317 INFO:tasks.workunit.client.0.smithi134.stdout:7/618: chown da/d15/d26/fb4 89852622 1 2024-04-13T10:59:20.319 INFO:tasks.workunit.client.0.smithi134.stdout:9/819: truncate d13/d40/d7d/dfb/f8c 2466505 0 2024-04-13T10:59:20.324 INFO:tasks.workunit.client.0.smithi134.stdout:0/673: truncate d4/d17/da/f27 208921 0 2024-04-13T10:59:20.324 INFO:tasks.workunit.client.0.smithi134.stdout:2/567: dwrite d5/d6/d57/d6c/f67 [0,4194304] 0 2024-04-13T10:59:20.325 INFO:tasks.workunit.client.0.smithi134.stdout:1/853: mkdir d3/d6/d16/d4d/d65/dcc/d117 0 2024-04-13T10:59:20.328 INFO:tasks.workunit.client.0.smithi134.stdout:3/641: unlink dc/d27/d19/d48/d49/c7b 0 2024-04-13T10:59:20.330 INFO:tasks.workunit.client.0.smithi134.stdout:6/789: creat d4/da/d15/d77/f104 x:0 0 0 2024-04-13T10:59:20.332 INFO:tasks.workunit.client.0.smithi134.stdout:7/619: creat da/d15/d26/d27/d4f/d5f/fba x:0 0 0 2024-04-13T10:59:20.338 INFO:tasks.workunit.client.0.smithi134.stdout:6/790: rename d4/da/d15/d1f/d24/d49/l70 to d4/da/d15/d1f/d24/d49/l105 0 2024-04-13T10:59:20.339 INFO:tasks.workunit.client.0.smithi134.stdout:9/820: mkdir d13/d39/d58/d5f/dac/d102/d126 0 2024-04-13T10:59:20.341 INFO:tasks.workunit.client.0.smithi134.stdout:7/620: mknod da/d15/d26/d27/d4f/d5f/d67/d73/d92/cbb 0 2024-04-13T10:59:20.347 INFO:tasks.workunit.client.0.smithi134.stdout:6/791: unlink d4/da/d15/d1f/d3c/dd0/fd9 0 2024-04-13T10:59:20.349 INFO:tasks.workunit.client.0.smithi134.stdout:9/821: rename d13/d2e/d35/d50/d59/c77 to d13/d39/d58/d5f/dbb/c127 0 2024-04-13T10:59:20.353 INFO:tasks.workunit.client.0.smithi134.stdout:2/568: creat d5/d6/d57/d6f/d30/fa8 x:0 0 0 2024-04-13T10:59:20.354 INFO:tasks.workunit.client.0.smithi134.stdout:2/569: write d5/d6/d57/d6c/f67 [170468,104998] 0 2024-04-13T10:59:20.359 INFO:tasks.workunit.client.0.smithi134.stdout:9/822: symlink d13/d39/d58/d5f/d6e/l128 0 2024-04-13T10:59:20.362 INFO:tasks.workunit.client.0.smithi134.stdout:2/570: rmdir d5/d6/d70 39 2024-04-13T10:59:20.368 INFO:tasks.workunit.client.0.smithi134.stdout:3/642: write dc/f10 [356168,38807] 0 2024-04-13T10:59:20.371 INFO:tasks.workunit.client.0.smithi134.stdout:9/823: rename d13/d2e/d35/d50/fe9 to d13/d40/f129 0 2024-04-13T10:59:20.375 INFO:tasks.workunit.client.0.smithi134.stdout:9/824: write d13/d39/d64/f92 [1162708,64239] 0 2024-04-13T10:59:20.375 INFO:tasks.workunit.client.0.smithi134.stdout:7/621: dread da/d15/f29 [0,4194304] 0 2024-04-13T10:59:20.376 INFO:tasks.workunit.client.0.smithi134.stdout:1/854: dwrite d3/d6/d16/d1d/f94 [0,4194304] 0 2024-04-13T10:59:20.379 INFO:tasks.workunit.client.0.smithi134.stdout:2/571: rmdir d5/d6 39 2024-04-13T10:59:20.381 INFO:tasks.workunit.client.0.smithi134.stdout:3/643: dread dc/d27/d19/d8b/d9b/f6b [0,4194304] 0 2024-04-13T10:59:20.397 INFO:tasks.workunit.client.0.smithi134.stdout:7/622: dread da/d15/d26/d38/f66 [0,4194304] 0 2024-04-13T10:59:20.397 INFO:tasks.workunit.client.0.smithi134.stdout:7/623: readlink da/l25 0 2024-04-13T10:59:20.425 INFO:tasks.workunit.client.0.smithi134.stdout:6/792: truncate d4/da/d15/d77/f82 2788518 0 2024-04-13T10:59:20.433 INFO:tasks.workunit.client.0.smithi134.stdout:1/855: truncate d3/d6/d16/d4d/d65/f82 187169 0 2024-04-13T10:59:20.438 INFO:tasks.workunit.client.0.smithi134.stdout:2/572: readlink d5/d6/d57/d6f/d30/d58/d73/l74 0 2024-04-13T10:59:20.444 INFO:tasks.workunit.client.0.smithi134.stdout:1/856: unlink d3/d6/d20/d89/la5 0 2024-04-13T10:59:20.445 INFO:tasks.workunit.client.0.smithi134.stdout:2/573: rmdir d5/de 39 2024-04-13T10:59:20.449 INFO:tasks.workunit.client.0.smithi134.stdout:6/793: creat d4/da/d15/d1f/d24/d49/d91/dc9/f106 x:0 0 0 2024-04-13T10:59:20.452 INFO:tasks.workunit.client.0.smithi134.stdout:1/857: creat d3/d6/d16/d1d/d110/f118 x:0 0 0 2024-04-13T10:59:20.452 INFO:tasks.workunit.client.0.smithi134.stdout:6/794: truncate d4/da/d15/d1f/d24/d49/ffc 964707 0 2024-04-13T10:59:20.456 INFO:tasks.workunit.client.0.smithi134.stdout:1/858: creat d3/d6/d20/d71/d9c/f119 x:0 0 0 2024-04-13T10:59:20.457 INFO:tasks.workunit.client.0.smithi134.stdout:2/574: dwrite d5/de/d12/f1d [0,4194304] 0 2024-04-13T10:59:20.459 INFO:tasks.workunit.client.0.smithi134.stdout:6/795: creat d4/da/f107 x:0 0 0 2024-04-13T10:59:20.464 INFO:tasks.workunit.client.0.smithi134.stdout:2/575: fsync d5/d6/d57/d6f/f44 0 2024-04-13T10:59:20.469 INFO:tasks.workunit.client.0.smithi134.stdout:6/796: write d4/da/d1a/de6/ff5 [523788,128402] 0 2024-04-13T10:59:20.471 INFO:tasks.workunit.client.0.smithi134.stdout:3/644: dwrite dc/d27/d19/d48/d8e/f92 [4194304,4194304] 0 2024-04-13T10:59:20.475 INFO:tasks.workunit.client.0.smithi134.stdout:2/576: creat d5/d6/d57/d6c/d29/fa9 x:0 0 0 2024-04-13T10:59:20.478 INFO:tasks.workunit.client.0.smithi134.stdout:3/645: write dc/d27/d19/faa [661788,98848] 0 2024-04-13T10:59:20.479 INFO:tasks.workunit.client.0.smithi134.stdout:1/859: dwrite d3/d6/d6a/dd8/f103 [0,4194304] 0 2024-04-13T10:59:20.480 INFO:tasks.workunit.client.0.smithi134.stdout:9/825: dwrite d13/d39/d58/dd5/dfc/f11b [0,4194304] 0 2024-04-13T10:59:20.487 INFO:tasks.workunit.client.0.smithi134.stdout:3/646: chown dc/d27/d19/d8b/da8/d50/d25/d91 44472 1 2024-04-13T10:59:20.489 INFO:tasks.workunit.client.0.smithi134.stdout:3/647: chown dc/d27/d19/d8b/da8/d50/d25/d5f/d75 13 1 2024-04-13T10:59:20.490 INFO:tasks.workunit.client.0.smithi134.stdout:2/577: dread - d5/d6/d57/d6f/d30/d58/d59/f7e zero size 2024-04-13T10:59:20.493 INFO:tasks.workunit.client.0.smithi134.stdout:6/797: dwrite d4/da/d15/d1f/fe8 [0,4194304] 0 2024-04-13T10:59:20.506 INFO:tasks.workunit.client.0.smithi134.stdout:9/826: rename d13/d40/d7d/dfb/l9e to d13/d39/d52/d86/d9f/db0/l12a 0 2024-04-13T10:59:20.508 INFO:tasks.workunit.client.0.smithi134.stdout:2/578: symlink d5/d6/d57/d6f/d30/d58/d59/laa 0 2024-04-13T10:59:20.508 INFO:tasks.workunit.client.0.smithi134.stdout:1/860: link d3/d6/d20/d28/fc9 d3/d6/dc5/f11a 0 2024-04-13T10:59:20.509 INFO:tasks.workunit.client.0.smithi134.stdout:3/648: dwrite dc/d1d/d58/f5d [0,4194304] 0 2024-04-13T10:59:20.511 INFO:tasks.workunit.client.0.smithi134.stdout:9/827: creat d13/d39/d64/f12b x:0 0 0 2024-04-13T10:59:20.513 INFO:tasks.workunit.client.0.smithi134.stdout:2/579: symlink d5/d6/d57/d6f/d30/d88/d96/lab 0 2024-04-13T10:59:20.514 INFO:tasks.workunit.client.0.smithi134.stdout:2/580: write d5/de/d50/f6b [3398198,6754] 0 2024-04-13T10:59:20.517 INFO:tasks.workunit.client.0.smithi134.stdout:3/649: creat dc/d1d/d58/db4/fd3 x:0 0 0 2024-04-13T10:59:20.521 INFO:tasks.workunit.client.0.smithi134.stdout:6/798: dwrite d4/da/d1a/f29 [0,4194304] 0 2024-04-13T10:59:20.522 INFO:tasks.workunit.client.0.smithi134.stdout:6/799: chown d4/da/d15/d1f/d24/fff 3339 1 2024-04-13T10:59:20.523 INFO:tasks.workunit.client.0.smithi134.stdout:9/828: mknod d13/d39/d64/db2/d123/c12c 0 2024-04-13T10:59:20.526 INFO:tasks.workunit.client.0.smithi134.stdout:1/861: rmdir d3/d6/d16/d1d/dab 0 2024-04-13T10:59:20.527 INFO:tasks.workunit.client.0.smithi134.stdout:3/650: dwrite dc/d27/d19/d8b/f90 [4194304,4194304] 0 2024-04-13T10:59:20.527 INFO:tasks.workunit.client.0.smithi134.stdout:2/581: symlink d5/d6/lac 0 2024-04-13T10:59:20.530 INFO:tasks.workunit.client.0.smithi134.stdout:3/651: chown dc/d27/d19/d48/l59 1770227 1 2024-04-13T10:59:20.530 INFO:tasks.workunit.client.0.smithi134.stdout:9/829: creat d13/d40/d7d/f12d x:0 0 0 2024-04-13T10:59:20.532 INFO:tasks.workunit.client.0.smithi134.stdout:9/830: chown d13/d2e/le4 20665 1 2024-04-13T10:59:20.533 INFO:tasks.workunit.client.0.smithi134.stdout:6/800: creat d4/da/d15/d1f/f108 x:0 0 0 2024-04-13T10:59:20.535 INFO:tasks.workunit.client.0.smithi134.stdout:3/652: rmdir dc/d1d/d58/d72 39 2024-04-13T10:59:20.538 INFO:tasks.workunit.client.0.smithi134.stdout:9/831: mkdir d13/d2e/d47/d12e 0 2024-04-13T10:59:20.540 INFO:tasks.workunit.client.0.smithi134.stdout:1/862: rename d3/d6/d20/d9f/ffb to d3/d6/dc5/f11b 0 2024-04-13T10:59:20.541 INFO:tasks.workunit.client.0.smithi134.stdout:1/863: dread - d3/d6/d16/d1d/d110/f118 zero size 2024-04-13T10:59:20.542 INFO:tasks.workunit.client.0.smithi134.stdout:1/864: chown d3/l1a 510271 1 2024-04-13T10:59:20.543 INFO:tasks.workunit.client.0.smithi134.stdout:1/865: write d3/d30/fb7 [5139614,31161] 0 2024-04-13T10:59:20.545 INFO:tasks.workunit.client.0.smithi134.stdout:1/866: write d3/d6/d20/d9f/dbe/fee [3627082,118345] 0 2024-04-13T10:59:20.546 INFO:tasks.workunit.client.0.smithi134.stdout:9/832: creat d13/d39/d64/db2/d123/f12f x:0 0 0 2024-04-13T10:59:20.547 INFO:tasks.workunit.client.0.smithi134.stdout:6/801: creat d4/da/d15/d1f/d24/da4/dfb/f109 x:0 0 0 2024-04-13T10:59:20.547 INFO:tasks.workunit.client.0.smithi134.stdout:1/867: write d3/d6/d20/d89/fd1 [2257860,71211] 0 2024-04-13T10:59:20.557 INFO:tasks.workunit.client.0.smithi134.stdout:3/653: creat dc/d27/fd4 x:0 0 0 2024-04-13T10:59:20.561 INFO:tasks.workunit.client.0.smithi134.stdout:6/802: unlink d4/da/d15/d1f/d24/f3e 0 2024-04-13T10:59:20.583 INFO:tasks.workunit.client.0.smithi134.stdout:8/771: sync 2024-04-13T10:59:20.583 INFO:tasks.workunit.client.0.smithi134.stdout:0/674: sync 2024-04-13T10:59:20.583 INFO:tasks.workunit.client.0.smithi134.stdout:5/946: sync 2024-04-13T10:59:20.586 INFO:tasks.workunit.client.0.smithi134.stdout:0/675: chown d4/d17/d20/da9/de1/dfc/d6d 210135 1 2024-04-13T10:59:20.587 INFO:tasks.workunit.client.0.smithi134.stdout:5/947: read dc/d1d/d67/fa6 [2395809,56158] 0 2024-04-13T10:59:20.599 INFO:tasks.workunit.client.0.smithi134.stdout:8/772: dwrite d8/dc/d9d/d69/fd8 [0,4194304] 0 2024-04-13T10:59:20.601 INFO:tasks.workunit.client.0.smithi134.stdout:8/773: chown d8/dc/d37/d3f/f73 1008 1 2024-04-13T10:59:20.615 INFO:tasks.workunit.client.0.smithi134.stdout:2/582: link d5/de/l7d d5/d6/d70/lad 0 2024-04-13T10:59:20.616 INFO:tasks.workunit.client.0.smithi134.stdout:9/833: mkdir d13/d39/d64/db2/d100/d130 0 2024-04-13T10:59:20.616 INFO:tasks.workunit.client.0.smithi134.stdout:2/583: chown d5/d6/d57/d6c/d29/f46 11 1 2024-04-13T10:59:20.617 INFO:tasks.workunit.client.0.smithi134.stdout:1/868: mkdir d3/d6/d16/d4d/d65/df7/d11c 0 2024-04-13T10:59:20.617 INFO:tasks.workunit.client.0.smithi134.stdout:1/869: stat d3/d6/d6a 0 2024-04-13T10:59:20.618 INFO:tasks.workunit.client.0.smithi134.stdout:9/834: truncate d13/d39/d58/d5f/d6e/f101 1427905 0 2024-04-13T10:59:20.620 INFO:tasks.workunit.client.0.smithi134.stdout:0/676: unlink d4/d17/d20/c39 0 2024-04-13T10:59:20.621 INFO:tasks.workunit.client.0.smithi134.stdout:5/948: mknod dc/d15/df1/d3b/d3c/c130 0 2024-04-13T10:59:20.623 INFO:tasks.workunit.client.0.smithi134.stdout:8/774: fsync d8/dc/d16/d54/ff3 0 2024-04-13T10:59:20.629 INFO:tasks.workunit.client.0.smithi134.stdout:0/677: dwrite d4/d17/d20/da9/de1/dfc/d6d/d97/fea [0,4194304] 0 2024-04-13T10:59:20.629 INFO:tasks.workunit.client.0.smithi134.stdout:5/949: write dc/d1d/d20/f59 [505486,83477] 0 2024-04-13T10:59:20.631 INFO:tasks.workunit.client.0.smithi134.stdout:0/678: stat d4/d17/da/d22/deb/fdc 0 2024-04-13T10:59:20.632 INFO:tasks.workunit.client.0.smithi134.stdout:6/803: symlink d4/da/d15/d1f/d3c/l10a 0 2024-04-13T10:59:20.635 INFO:tasks.workunit.client.0.smithi134.stdout:3/654: link dc/d27/d19/d48/d49/lb8 dc/d27/d19/d8b/da8/d50/d25/d5f/d75/d8f/ld5 0 2024-04-13T10:59:20.636 INFO:tasks.workunit.client.0.smithi134.stdout:9/835: getdents d13/d39/d64/db2/dd6/d10b 0 2024-04-13T10:59:20.638 INFO:tasks.workunit.client.0.smithi134.stdout:9/836: read d13/d2e/d35/d50/d59/fb5 [2713789,24190] 0 2024-04-13T10:59:20.647 INFO:tasks.workunit.client.0.smithi134.stdout:9/837: rmdir d13/d40/d7d/dfb 39 2024-04-13T10:59:20.652 INFO:tasks.workunit.client.0.smithi134.stdout:7/624: sync 2024-04-13T10:59:20.652 INFO:tasks.workunit.client.0.smithi134.stdout:4/630: sync 2024-04-13T10:59:20.653 INFO:tasks.workunit.client.0.smithi134.stdout:9/838: readlink d13/d2e/d47/l55 0 2024-04-13T10:59:20.653 INFO:tasks.workunit.client.0.smithi134.stdout:4/631: readlink d4/d1f/d27/d3a/d53/d58/l76 0 2024-04-13T10:59:20.655 INFO:tasks.workunit.client.0.smithi134.stdout:0/679: creat d4/d17/da/d22/ffd x:0 0 0 2024-04-13T10:59:20.658 INFO:tasks.workunit.client.0.smithi134.stdout:9/839: creat d13/d39/d52/da2/f131 x:0 0 0 2024-04-13T10:59:20.661 INFO:tasks.workunit.client.0.smithi134.stdout:6/804: getdents d4/da/d15/d1f 0 2024-04-13T10:59:20.665 INFO:tasks.workunit.client.0.smithi134.stdout:9/840: fdatasync d13/d2e/d35/d50/d59/fb5 0 2024-04-13T10:59:20.674 INFO:tasks.workunit.client.0.smithi134.stdout:9/841: unlink d13/d39/d52/da2/fed 0 2024-04-13T10:59:20.678 INFO:tasks.workunit.client.0.smithi134.stdout:3/655: link dc/d27/d4d/c40 dc/d27/d19/d48/cd6 0 2024-04-13T10:59:20.678 INFO:tasks.workunit.client.0.smithi134.stdout:6/805: mkdir d4/da/d15/d1f/d24/d10b 0 2024-04-13T10:59:20.678 INFO:tasks.workunit.client.0.smithi134.stdout:0/680: link d4/d17/d20/da9/de1/cd7 d4/d17/d20/d29/dcd/cfe 0 2024-04-13T10:59:20.678 INFO:tasks.workunit.client.0.smithi134.stdout:0/681: fdatasync d4/d17/fc5 0 2024-04-13T10:59:20.680 INFO:tasks.workunit.client.0.smithi134.stdout:4/632: getdents d4/d1f 0 2024-04-13T10:59:20.680 INFO:tasks.workunit.client.0.smithi134.stdout:4/633: readlink d4/d1f/d56/la3 0 2024-04-13T10:59:20.682 INFO:tasks.workunit.client.0.smithi134.stdout:4/634: write d4/d1f/d27/d75/d38/f4e [4011755,55133] 0 2024-04-13T10:59:20.683 INFO:tasks.workunit.client.0.smithi134.stdout:6/806: dread d4/da/f2f [0,4194304] 0 2024-04-13T10:59:20.691 INFO:tasks.workunit.client.0.smithi134.stdout:2/584: dwrite d5/de/f65 [4194304,4194304] 0 2024-04-13T10:59:20.694 INFO:tasks.workunit.client.0.smithi134.stdout:1/870: write d3/d6/d16/d4d/d111/f10f [1306226,47103] 0 2024-04-13T10:59:20.703 INFO:tasks.workunit.client.0.smithi134.stdout:0/682: mkdir d4/d17/da/d22/d41/d6e/d8a/d95/db9/dff 0 2024-04-13T10:59:20.710 INFO:tasks.workunit.client.0.smithi134.stdout:5/950: dwrite dc/d15/df1/d3b/d6a/ff0 [4194304,4194304] 0 2024-04-13T10:59:20.711 INFO:tasks.workunit.client.0.smithi134.stdout:6/807: creat d4/da/dbb/dca/df7/f10c x:0 0 0 2024-04-13T10:59:20.711 INFO:tasks.workunit.client.0.smithi134.stdout:2/585: dread d5/de/f75 [0,4194304] 0 2024-04-13T10:59:20.711 INFO:tasks.workunit.client.0.smithi134.stdout:8/775: dwrite d8/dc/f12 [0,4194304] 0 2024-04-13T10:59:20.713 INFO:tasks.workunit.client.0.smithi134.stdout:1/871: write d3/d6/d20/d9f/f99 [675132,117897] 0 2024-04-13T10:59:20.716 INFO:tasks.workunit.client.0.smithi134.stdout:0/683: write d4/d17/d20/da9/de1/dfc/d6d/d97/fea [1272152,124929] 0 2024-04-13T10:59:20.717 INFO:tasks.workunit.client.0.smithi134.stdout:7/625: dwrite da/d15/d26/d27/f58 [0,4194304] 0 2024-04-13T10:59:20.719 INFO:tasks.workunit.client.0.smithi134.stdout:8/776: fdatasync d8/dc/d13/f75 0 2024-04-13T10:59:20.722 INFO:tasks.workunit.client.0.smithi134.stdout:8/777: chown d8/dc/d16/ddd/cf7 47 1 2024-04-13T10:59:20.724 INFO:tasks.workunit.client.0.smithi134.stdout:9/842: write d13/d39/d64/f8a [786007,92615] 0 2024-04-13T10:59:20.728 INFO:tasks.workunit.client.0.smithi134.stdout:3/656: getdents dc/d27/d19 0 2024-04-13T10:59:20.732 INFO:tasks.workunit.client.0.smithi134.stdout:5/951: mkdir dc/dc1/d131 0 2024-04-13T10:59:20.736 INFO:tasks.workunit.client.0.smithi134.stdout:2/586: mknod d5/d6/d34/cae 0 2024-04-13T10:59:20.743 INFO:tasks.workunit.client.0.smithi134.stdout:9/843: mknod d13/d2e/d47/dc1/c132 0 2024-04-13T10:59:20.747 INFO:tasks.workunit.client.0.smithi134.stdout:3/657: dread dc/d27/d19/d8b/da8/d50/d25/f82 [0,4194304] 0 2024-04-13T10:59:20.755 INFO:tasks.workunit.client.0.smithi134.stdout:7/626: dread da/d15/d26/d27/d4f/d5f/d67/d76/f82 [0,4194304] 0 2024-04-13T10:59:20.755 INFO:tasks.workunit.client.0.smithi134.stdout:8/778: write d8/dc/d9d/d69/fa5 [612209,82493] 0 2024-04-13T10:59:20.757 INFO:tasks.workunit.client.0.smithi134.stdout:7/627: write da/d15/d26/f28 [2485583,81298] 0 2024-04-13T10:59:20.758 INFO:tasks.workunit.client.0.smithi134.stdout:0/684: rename c0 to d4/d17/d20/da9/de1/c100 0 2024-04-13T10:59:20.759 INFO:tasks.workunit.client.0.smithi134.stdout:0/685: chown d4/d17/d23/d51/d6b/lf9 5887778 1 2024-04-13T10:59:20.761 INFO:tasks.workunit.client.0.smithi134.stdout:6/808: rmdir d4/da/d68/ddb 0 2024-04-13T10:59:20.764 INFO:tasks.workunit.client.0.smithi134.stdout:6/809: write d4/da/dbb/de5/f100 [537876,79000] 0 2024-04-13T10:59:20.767 INFO:tasks.workunit.client.0.smithi134.stdout:9/844: rename d13/d39/d52/d71 to d13/d39/d58/d5f/dac/d11a/d133 0 2024-04-13T10:59:20.768 INFO:tasks.workunit.client.0.smithi134.stdout:0/686: dread d4/d17/d20/da9/de1/dcf/f5e [0,4194304] 0 2024-04-13T10:59:20.769 INFO:tasks.workunit.client.0.smithi134.stdout:7/628: dread da/d15/f77 [0,4194304] 0 2024-04-13T10:59:20.772 INFO:tasks.workunit.client.0.smithi134.stdout:2/587: dread d5/de/d50/f7c [0,4194304] 0 2024-04-13T10:59:20.773 INFO:tasks.workunit.client.0.smithi134.stdout:1/872: dwrite d3/d6/dc5/f11b [0,4194304] 0 2024-04-13T10:59:20.774 INFO:tasks.workunit.client.0.smithi134.stdout:2/588: readlink d5/l35 0 2024-04-13T10:59:20.774 INFO:tasks.workunit.client.0.smithi134.stdout:0/687: dread - d4/d17/d23/d51/d6b/d91/d98/d92/dca/ff6 zero size 2024-04-13T10:59:20.776 INFO:tasks.workunit.client.0.smithi134.stdout:2/589: dread - d5/de/d12/f86 zero size 2024-04-13T10:59:20.777 INFO:tasks.workunit.client.0.smithi134.stdout:5/952: rename dc/d1d/d20 to dc/d1d/d2b/d30/d100/d10e/d132 0 2024-04-13T10:59:20.778 INFO:tasks.workunit.client.0.smithi134.stdout:1/873: write d3/d6/d16/d4d/d111/ff6 [713031,113559] 0 2024-04-13T10:59:20.778 INFO:tasks.workunit.client.0.smithi134.stdout:0/688: chown d4/d17/d20/da9/de1/fba 16 1 2024-04-13T10:59:20.779 INFO:tasks.workunit.client.0.smithi134.stdout:1/874: chown d3/d6/d16/d1d/d68/f5d 8498 1 2024-04-13T10:59:20.780 INFO:tasks.workunit.client.0.smithi134.stdout:7/629: read da/d15/d26/d27/d4f/d5f/d67/d73/f91 [1308746,81316] 0 2024-04-13T10:59:20.781 INFO:tasks.workunit.client.0.smithi134.stdout:9/845: dread - d13/d2e/d35/fa8 zero size 2024-04-13T10:59:20.784 INFO:tasks.workunit.client.0.smithi134.stdout:3/658: link dc/d1d/d58/f7e dc/d27/d19/db1/fd7 0 2024-04-13T10:59:20.787 INFO:tasks.workunit.client.0.smithi134.stdout:2/590: creat d5/de/d12/faf x:0 0 0 2024-04-13T10:59:20.788 INFO:tasks.workunit.client.0.smithi134.stdout:5/953: symlink dc/d15/df8/l133 0 2024-04-13T10:59:20.788 INFO:tasks.workunit.client.0.smithi134.stdout:2/591: chown d5/d6/d57/d6f/d30/d88 104346382 1 2024-04-13T10:59:20.791 INFO:tasks.workunit.client.0.smithi134.stdout:0/689: unlink d4/d17/d23/d51/d6b/d91/d98/d62/d7c/ff5 0 2024-04-13T10:59:20.791 INFO:tasks.workunit.client.0.smithi134.stdout:1/875: symlink d3/d6/d16/dff/l11d 0 2024-04-13T10:59:20.794 INFO:tasks.workunit.client.0.smithi134.stdout:7/630: write da/d15/d26/d27/f2d [3727419,126376] 0 2024-04-13T10:59:20.795 INFO:tasks.workunit.client.0.smithi134.stdout:9/846: mkdir d13/da3/d134 0 2024-04-13T10:59:20.795 INFO:tasks.workunit.client.0.smithi134.stdout:6/810: dwrite d4/da/d15/d1f/d24/d2b/f51 [0,4194304] 0 2024-04-13T10:59:20.799 INFO:tasks.workunit.client.0.smithi134.stdout:9/847: fdatasync d13/d39/d64/f92 0 2024-04-13T10:59:20.802 INFO:tasks.workunit.client.0.smithi134.stdout:9/848: chown d13/d39/d58/dd5/l125 1207 1 2024-04-13T10:59:20.803 INFO:tasks.workunit.client.0.smithi134.stdout:8/779: rename d8/c33 to d8/dc/d13/c103 0 2024-04-13T10:59:20.804 INFO:tasks.workunit.client.0.smithi134.stdout:5/954: creat dc/df3/f134 x:0 0 0 2024-04-13T10:59:20.805 INFO:tasks.workunit.client.0.smithi134.stdout:9/849: read - d13/d2e/ffd zero size 2024-04-13T10:59:20.807 INFO:tasks.workunit.client.0.smithi134.stdout:1/876: dwrite d3/d30/feb [0,4194304] 0 2024-04-13T10:59:20.807 INFO:tasks.workunit.client.0.smithi134.stdout:8/780: chown d8/dc/d2c/d68/d8c/d8f 1 1 2024-04-13T10:59:20.813 INFO:tasks.workunit.client.0.smithi134.stdout:3/659: mknod dc/d1d/d58/dcd/cd8 0 2024-04-13T10:59:20.815 INFO:tasks.workunit.client.0.smithi134.stdout:6/811: stat d4/da/f25 0 2024-04-13T10:59:20.817 INFO:tasks.workunit.client.0.smithi134.stdout:9/850: dwrite d13/da3/fc9 [0,4194304] 0 2024-04-13T10:59:20.821 INFO:tasks.workunit.client.0.smithi134.stdout:0/690: dwrite d4/d17/d23/d51/d6a/d94/f6c [0,4194304] 0 2024-04-13T10:59:20.823 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:20 smithi194 ceph-mon[46737]: pgmap v44: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 61 MiB/s rd, 159 MiB/s wr, 381 op/s 2024-04-13T10:59:20.827 INFO:tasks.workunit.client.0.smithi134.stdout:5/955: rename dc/d15/df1/d3b/f125 to dc/df3/df9/f135 0 2024-04-13T10:59:20.830 INFO:tasks.workunit.client.0.smithi134.stdout:1/877: unlink d3/d30/c51 0 2024-04-13T10:59:20.831 INFO:tasks.workunit.client.0.smithi134.stdout:7/631: dread da/d15/d26/d27/d3d/d9c/f55 [0,4194304] 0 2024-04-13T10:59:20.832 INFO:tasks.workunit.client.0.smithi134.stdout:8/781: mknod d8/dc/d13/ddf/c104 0 2024-04-13T10:59:20.833 INFO:tasks.workunit.client.0.smithi134.stdout:8/782: readlink d8/dc/d2c/d68/d8c/lca 0 2024-04-13T10:59:20.836 INFO:tasks.workunit.client.0.smithi134.stdout:6/812: symlink d4/da/dbb/l10d 0 2024-04-13T10:59:20.841 INFO:tasks.workunit.client.0.smithi134.stdout:0/691: mkdir d4/d17/d20/da9/de1/dfc/d6d/d97/db6/d101 0 2024-04-13T10:59:20.842 INFO:tasks.workunit.client.0.smithi134.stdout:2/592: dwrite d5/d6/d57/d6c/f49 [4194304,4194304] 0 2024-04-13T10:59:20.845 INFO:tasks.workunit.client.0.smithi134.stdout:1/878: symlink d3/d6/d16/d4d/d111/l11e 0 2024-04-13T10:59:20.847 INFO:tasks.workunit.client.0.smithi134.stdout:3/660: dread dc/d27/f9d [0,4194304] 0 2024-04-13T10:59:20.847 INFO:tasks.workunit.client.0.smithi134.stdout:8/783: read d8/dc/d16/d54/d6c/f70 [2287542,51296] 0 2024-04-13T10:59:20.848 INFO:tasks.workunit.client.0.smithi134.stdout:9/851: mkdir d13/da3/d98/d103/d135 0 2024-04-13T10:59:20.855 INFO:tasks.workunit.client.0.smithi134.stdout:1/879: dread d3/d6/d16/d4d/d111/fd6 [0,4194304] 0 2024-04-13T10:59:20.856 INFO:tasks.workunit.client.0.smithi134.stdout:5/956: dwrite dc/d1d/d2b/d30/d100/d10e/d132/f12d [0,4194304] 0 2024-04-13T10:59:20.856 INFO:tasks.workunit.client.0.smithi134.stdout:2/593: fdatasync d5/de/d50/f7c 0 2024-04-13T10:59:20.860 INFO:tasks.workunit.client.0.smithi134.stdout:2/594: write d5/de/d2e/d8f/fa5 [782061,8752] 0 2024-04-13T10:59:20.862 INFO:tasks.workunit.client.0.smithi134.stdout:9/852: mknod d13/d39/d52/da2/c136 0 2024-04-13T10:59:20.871 INFO:tasks.workunit.client.0.smithi134.stdout:0/692: creat d4/d17/d20/d29/dcd/dfb/f102 x:0 0 0 2024-04-13T10:59:20.872 INFO:tasks.workunit.client.0.smithi134.stdout:8/784: truncate d8/dc/d37/f3a 561058 0 2024-04-13T10:59:20.872 INFO:tasks.workunit.client.0.smithi134.stdout:9/853: write d13/f2d [2421473,22734] 0 2024-04-13T10:59:20.872 INFO:tasks.workunit.client.0.smithi134.stdout:1/880: creat d3/d6/d16/d1d/d68/f11f x:0 0 0 2024-04-13T10:59:20.875 INFO:tasks.workunit.client.0.smithi134.stdout:2/595: creat d5/d6/d57/d6f/d30/d88/d96/fb0 x:0 0 0 2024-04-13T10:59:20.877 INFO:tasks.workunit.client.0.smithi134.stdout:8/785: write d8/dc/d16/d4e/fe5 [514879,20954] 0 2024-04-13T10:59:20.878 INFO:tasks.workunit.client.0.smithi134.stdout:6/813: dread d4/da/d15/d1f/d24/f3a [0,4194304] 0 2024-04-13T10:59:20.878 INFO:tasks.workunit.client.0.smithi134.stdout:9/854: chown d13/da3/d98/db3/lc2 115657105 1 2024-04-13T10:59:20.879 INFO:tasks.workunit.client.0.smithi134.stdout:0/693: symlink d4/d17/d20/d29/l103 0 2024-04-13T10:59:20.881 INFO:tasks.workunit.client.0.smithi134.stdout:8/786: write d8/dc/d16/d54/d6c/f9f [2850819,13462] 0 2024-04-13T10:59:20.883 INFO:tasks.workunit.client.0.smithi134.stdout:5/957: write dc/d15/df1/d3b/d7f/d8d/d7d/fde [3257395,124759] 0 2024-04-13T10:59:20.885 INFO:tasks.workunit.client.0.smithi134.stdout:8/787: stat d8/dc/lac 0 2024-04-13T10:59:20.887 INFO:tasks.workunit.client.0.smithi134.stdout:7/632: dwrite da/d15/d85/f8f [0,4194304] 0 2024-04-13T10:59:20.890 INFO:tasks.workunit.client.0.smithi134.stdout:2/596: creat d5/d6/d57/d6f/d30/d88/d96/fb1 x:0 0 0 2024-04-13T10:59:20.892 INFO:tasks.workunit.client.0.smithi134.stdout:6/814: creat d4/da/dbb/dc3/da6/f10e x:0 0 0 2024-04-13T10:59:20.892 INFO:tasks.workunit.client.0.smithi134.stdout:1/881: link d3/ff d3/d6/d16/d4d/d65/f120 0 2024-04-13T10:59:20.895 INFO:tasks.workunit.client.0.smithi134.stdout:9/855: mkdir d13/d2e/d35/d50/d60/d137 0 2024-04-13T10:59:20.899 INFO:tasks.workunit.client.0.smithi134.stdout:1/882: write d3/d6/d16/d1d/d86/fb4 [449033,41795] 0 2024-04-13T10:59:20.900 INFO:tasks.workunit.client.0.smithi134.stdout:0/694: dwrite d4/d17/d20/d29/d30/d3e/ff3 [0,4194304] 0 2024-04-13T10:59:20.901 INFO:tasks.workunit.client.0.smithi134.stdout:8/788: dread d8/dc/d9d/d69/fd8 [0,4194304] 0 2024-04-13T10:59:20.905 INFO:tasks.workunit.client.0.smithi134.stdout:6/815: mkdir d4/da/d15/d1f/d24/d49/d10f 0 2024-04-13T10:59:20.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/856: rmdir d13/d2e/d35 39 2024-04-13T10:59:20.911 INFO:tasks.workunit.client.0.smithi134.stdout:7/633: write da/d15/d26/f4d [985358,33587] 0 2024-04-13T10:59:20.915 INFO:tasks.workunit.client.0.smithi134.stdout:6/816: creat d4/da/d15/d1f/d24/db9/f110 x:0 0 0 2024-04-13T10:59:20.916 INFO:tasks.workunit.client.0.smithi134.stdout:6/817: readlink d4/da/d15/d77/l66 0 2024-04-13T10:59:20.916 INFO:tasks.workunit.client.0.smithi134.stdout:9/857: mkdir d13/d2e/d47/d138 0 2024-04-13T10:59:20.917 INFO:tasks.workunit.client.0.smithi134.stdout:5/958: dread dc/d15/df1/d3b/d7f/d8d/d7d/fd1 [0,4194304] 0 2024-04-13T10:59:20.918 INFO:tasks.workunit.client.0.smithi134.stdout:8/789: dread d8/dc/d16/d4e/f62 [0,4194304] 0 2024-04-13T10:59:20.918 INFO:tasks.workunit.client.0.smithi134.stdout:9/858: chown d13/d39/lf6 5 1 2024-04-13T10:59:20.918 INFO:tasks.workunit.client.0.smithi134.stdout:7/634: rmdir da/d15/d26/d27/d4f 39 2024-04-13T10:59:20.920 INFO:tasks.workunit.client.0.smithi134.stdout:9/859: write d13/d39/d52/fa4 [1243436,104661] 0 2024-04-13T10:59:20.920 INFO:tasks.workunit.client.0.smithi134.stdout:5/959: fdatasync dc/f1b 0 2024-04-13T10:59:20.921 INFO:tasks.workunit.client.0.smithi134.stdout:5/960: chown dc/d15/df1/d3b/f120 4 1 2024-04-13T10:59:20.928 INFO:tasks.workunit.client.0.smithi134.stdout:6/818: symlink d4/l111 0 2024-04-13T10:59:20.929 INFO:tasks.workunit.client.0.smithi134.stdout:6/819: fsync d4/da/d15/d77/d63/f8c 0 2024-04-13T10:59:20.930 INFO:tasks.workunit.client.0.smithi134.stdout:6/820: chown d4/da/dbb/l7f 10690 1 2024-04-13T10:59:20.931 INFO:tasks.workunit.client.0.smithi134.stdout:0/695: getdents d4/d17 0 2024-04-13T10:59:20.933 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:20 smithi134 ceph-mon[39696]: pgmap v44: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 61 MiB/s rd, 159 MiB/s wr, 381 op/s 2024-04-13T10:59:20.934 INFO:tasks.workunit.client.0.smithi134.stdout:2/597: write d5/d6/d57/d6f/d30/d58/d59/f7e [857974,113797] 0 2024-04-13T10:59:20.934 INFO:tasks.workunit.client.0.smithi134.stdout:8/790: creat d8/dc/d2c/d68/d8c/d8f/f105 x:0 0 0 2024-04-13T10:59:21.001 INFO:tasks.workunit.client.0.smithi134.stdout:5/961: mkdir dc/d15/df1/d3b/d6a/d136 0 2024-04-13T10:59:21.002 INFO:tasks.workunit.client.0.smithi134.stdout:0/696: dread - d4/d17/d23/d51/d6a/d94/db2/f63 zero size 2024-04-13T10:59:21.004 INFO:tasks.workunit.client.0.smithi134.stdout:5/962: write dc/d1d/d2b/d30/d100/d10e/d132/d23/f2a [2812280,84909] 0 2024-04-13T10:59:21.006 INFO:tasks.workunit.client.0.smithi134.stdout:6/821: link d4/da/d15/d1f/d24/d2b/f51 d4/da/dbb/dca/f112 0 2024-04-13T10:59:21.011 INFO:tasks.workunit.client.0.smithi134.stdout:7/635: rename da/d15/d26/d27/d4f/la7 to da/d15/d26/d27/d4f/d5f/d67/lbc 0 2024-04-13T10:59:21.013 INFO:tasks.workunit.client.0.smithi134.stdout:0/697: mkdir d4/d17/d23/d51/d6a/d104 0 2024-04-13T10:59:21.016 INFO:tasks.workunit.client.0.smithi134.stdout:5/963: rmdir dc/d1d/d67/d69 39 2024-04-13T10:59:21.025 INFO:tasks.workunit.client.0.smithi134.stdout:9/860: getdents d13/d39/d58/d5f/dac/d11a/d133 0 2024-04-13T10:59:21.032 INFO:tasks.workunit.client.0.smithi134.stdout:8/791: dwrite d8/dc/d16/d54/d6c/faa [0,4194304] 0 2024-04-13T10:59:21.045 INFO:tasks.workunit.client.0.smithi134.stdout:8/792: fsync d8/f10 0 2024-04-13T10:59:21.047 INFO:tasks.workunit.client.0.smithi134.stdout:5/964: mkdir dc/d39/d63/de2/d137 0 2024-04-13T10:59:21.049 INFO:tasks.workunit.client.0.smithi134.stdout:2/598: dwrite d5/d6/d57/d6f/d30/f42 [0,4194304] 0 2024-04-13T10:59:21.050 INFO:tasks.workunit.client.0.smithi134.stdout:8/793: chown d8/dc/d16/d54/d6c/f9f 116041204 1 2024-04-13T10:59:21.051 INFO:tasks.workunit.client.0.smithi134.stdout:6/822: dwrite d4/da/d15/d1f/fb6 [0,4194304] 0 2024-04-13T10:59:21.054 INFO:tasks.workunit.client.0.smithi134.stdout:9/861: dwrite d13/d2e/d35/ff0 [0,4194304] 0 2024-04-13T10:59:21.060 INFO:tasks.workunit.client.0.smithi134.stdout:8/794: truncate d8/dc/d16/d4e/d76/fda 457723 0 2024-04-13T10:59:21.060 INFO:tasks.workunit.client.0.smithi134.stdout:7/636: link da/d15/d26/d38/f84 da/d15/d26/d27/d3d/fbd 0 2024-04-13T10:59:21.063 INFO:tasks.workunit.client.0.smithi134.stdout:5/965: chown dc/f75 4667937 1 2024-04-13T10:59:21.065 INFO:tasks.workunit.client.0.smithi134.stdout:2/599: mkdir d5/d6/d70/db2 0 2024-04-13T10:59:21.067 INFO:tasks.workunit.client.0.smithi134.stdout:2/600: write d5/de/d12/fa2 [4116993,58385] 0 2024-04-13T10:59:21.070 INFO:tasks.workunit.client.0.smithi134.stdout:0/698: truncate d4/d17/d20/d29/d30/fd6 300483 0 2024-04-13T10:59:21.072 INFO:tasks.workunit.client.0.smithi134.stdout:6/823: creat d4/da/dbb/dc3/f113 x:0 0 0 2024-04-13T10:59:21.072 INFO:tasks.workunit.client.0.smithi134.stdout:0/699: write d4/d17/d23/d51/d6b/fcc [5157631,17568] 0 2024-04-13T10:59:21.075 INFO:tasks.workunit.client.0.smithi134.stdout:7/637: mknod da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/cbe 0 2024-04-13T10:59:21.078 INFO:tasks.workunit.client.0.smithi134.stdout:9/862: dwrite d13/d2e/d47/dc1/ff2 [0,4194304] 0 2024-04-13T10:59:21.081 INFO:tasks.workunit.client.0.smithi134.stdout:2/601: chown d5/de/l7d 391 1 2024-04-13T10:59:21.085 INFO:tasks.workunit.client.0.smithi134.stdout:8/795: creat d8/dc/d16/d4e/d9c/de0/f106 x:0 0 0 2024-04-13T10:59:21.088 INFO:tasks.workunit.client.0.smithi134.stdout:0/700: rmdir d4/d17/d20/da9/de1/dcf 39 2024-04-13T10:59:21.088 INFO:tasks.workunit.client.0.smithi134.stdout:6/824: unlink d4/da/d15/d77/l66 0 2024-04-13T10:59:21.093 INFO:tasks.workunit.client.0.smithi134.stdout:9/863: dwrite d13/d39/d58/d5f/d6e/f101 [0,4194304] 0 2024-04-13T10:59:21.095 INFO:tasks.workunit.client.0.smithi134.stdout:7/638: mkdir da/d15/d26/d27/d3d/d46/dbf 0 2024-04-13T10:59:21.097 INFO:tasks.workunit.client.0.smithi134.stdout:9/864: fsync d13/da3/d98/f116 0 2024-04-13T10:59:21.098 INFO:tasks.workunit.client.0.smithi134.stdout:9/865: chown d13/d39/d52/c120 32016502 1 2024-04-13T10:59:21.102 INFO:tasks.workunit.client.0.smithi134.stdout:2/602: dwrite d5/d6/d57/d6c/d29/fa9 [0,4194304] 0 2024-04-13T10:59:21.111 INFO:tasks.workunit.client.0.smithi134.stdout:5/966: dread dc/d15/df1/d3b/d7f/d8d/d7d/dc0/fc4 [0,4194304] 0 2024-04-13T10:59:21.114 INFO:tasks.workunit.client.0.smithi134.stdout:5/967: write dc/d1d/d2b/d30/d100/d10e/d132/fae [3800096,28117] 0 2024-04-13T10:59:21.158 INFO:tasks.workunit.client.0.smithi134.stdout:9/866: mkdir d13/d39/d58/d5f/dac/d11a/d133/d139 0 2024-04-13T10:59:21.158 INFO:tasks.workunit.client.0.smithi134.stdout:9/867: fsync d13/d39/d64/f12b 0 2024-04-13T10:59:21.165 INFO:tasks.workunit.client.0.smithi134.stdout:2/603: dwrite d5/d6/d57/d6f/d30/d58/d73/f8d [4194304,4194304] 0 2024-04-13T10:59:21.166 INFO:tasks.workunit.client.0.smithi134.stdout:8/796: creat d8/f107 x:0 0 0 2024-04-13T10:59:21.167 INFO:tasks.workunit.client.0.smithi134.stdout:5/968: dread dc/d1d/d2b/d30/d100/d10e/d132/d23/d36/f80 [0,4194304] 0 2024-04-13T10:59:21.167 INFO:tasks.workunit.client.0.smithi134.stdout:8/797: readlink d8/dc/d16/l24 0 2024-04-13T10:59:21.172 INFO:tasks.workunit.client.0.smithi134.stdout:0/701: mkdir d4/d17/d23/d51/d6a/d73/d105 0 2024-04-13T10:59:21.175 INFO:tasks.workunit.client.0.smithi134.stdout:9/868: unlink d13/cb8 0 2024-04-13T10:59:21.176 INFO:tasks.workunit.client.0.smithi134.stdout:2/604: rmdir d5/d6 39 2024-04-13T10:59:21.181 INFO:tasks.workunit.client.0.smithi134.stdout:8/798: rename d8 to d8/dc/d108 22 2024-04-13T10:59:21.183 INFO:tasks.workunit.client.0.smithi134.stdout:5/969: read - dc/d1d/d2b/d30/f54 zero size 2024-04-13T10:59:21.185 INFO:tasks.workunit.client.0.smithi134.stdout:0/702: truncate d4/d17/d20/d29/d30/d64/fb5 305669 0 2024-04-13T10:59:21.191 INFO:tasks.workunit.client.0.smithi134.stdout:2/605: mkdir d5/de/db3 0 2024-04-13T10:59:21.198 INFO:tasks.workunit.client.0.smithi134.stdout:2/606: chown d5/d6/d34 0 1 2024-04-13T10:59:21.202 INFO:tasks.workunit.client.0.smithi134.stdout:2/607: dread d5/de/d50/f5d [0,4194304] 0 2024-04-13T10:59:21.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/608: fsync d5/de/d12/faf 0 2024-04-13T10:59:21.204 INFO:tasks.workunit.client.0.smithi134.stdout:2/609: write d5/d6/d57/d6f/d30/d88/d96/fb1 [584013,4287] 0 2024-04-13T10:59:21.206 INFO:tasks.workunit.client.0.smithi134.stdout:2/610: read d5/d6/d57/d6f/d30/f42 [3824790,48383] 0 2024-04-13T10:59:21.209 INFO:tasks.workunit.client.0.smithi134.stdout:2/611: unlink d5/d6/d34/c9f 0 2024-04-13T10:59:21.210 INFO:tasks.workunit.client.0.smithi134.stdout:2/612: write d5/d6/d57/d6c/d29/f66 [1599657,129064] 0 2024-04-13T10:59:21.211 INFO:tasks.workunit.client.0.smithi134.stdout:2/613: read d5/de/f75 [3202377,85579] 0 2024-04-13T10:59:21.212 INFO:tasks.workunit.client.0.smithi134.stdout:2/614: write d5/de/d12/f86 [251221,12907] 0 2024-04-13T10:59:21.216 INFO:tasks.workunit.client.0.smithi134.stdout:6/825: link d4/da/d15/d1f/d24/d2b/lc0 d4/da/d15/d1f/d24/d49/l114 0 2024-04-13T10:59:21.218 INFO:tasks.workunit.client.0.smithi134.stdout:6/826: symlink d4/da/dbb/dca/df7/l115 0 2024-04-13T10:59:21.221 INFO:tasks.workunit.client.0.smithi134.stdout:6/827: unlink d4/da/f2f 0 2024-04-13T10:59:21.222 INFO:tasks.workunit.client.0.smithi134.stdout:7/639: write da/d15/d26/d27/d3d/d9c/d5a/f72 [4156715,24609] 0 2024-04-13T10:59:21.224 INFO:tasks.workunit.client.0.smithi134.stdout:6/828: mkdir d4/da/d15/d1f/d24/d10b/d116 0 2024-04-13T10:59:21.238 INFO:tasks.workunit.client.0.smithi134.stdout:8/799: write d8/dc/d16/d4e/d9c/f9e [243625,46518] 0 2024-04-13T10:59:21.240 INFO:tasks.workunit.client.0.smithi134.stdout:9/869: dwrite d13/d2e/f3e [0,4194304] 0 2024-04-13T10:59:21.243 INFO:tasks.workunit.client.0.smithi134.stdout:9/870: read d13/d2e/f3e [3152496,69694] 0 2024-04-13T10:59:21.252 INFO:tasks.workunit.client.0.smithi134.stdout:0/703: dwrite d4/d17/d23/d51/d6b/f7b [0,4194304] 0 2024-04-13T10:59:21.252 INFO:tasks.workunit.client.0.smithi134.stdout:5/970: dwrite dc/d15/df1/d3b/d6a/f6b [0,4194304] 0 2024-04-13T10:59:21.254 INFO:tasks.workunit.client.0.smithi134.stdout:8/800: creat d8/dc/d16/d54/d98/f109 x:0 0 0 2024-04-13T10:59:21.256 INFO:tasks.workunit.client.0.smithi134.stdout:8/801: readlink d8/dc/d13/l86 0 2024-04-13T10:59:21.259 INFO:tasks.workunit.client.0.smithi134.stdout:7/640: rename da/d15/d26/d27/f58 to da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/fc0 0 2024-04-13T10:59:21.261 INFO:tasks.workunit.client.0.smithi134.stdout:0/704: dwrite d4/d17/d20/d29/d30/d3e/f50 [4194304,4194304] 0 2024-04-13T10:59:21.263 INFO:tasks.workunit.client.0.smithi134.stdout:7/641: chown da/d15/d26/d27/d4f/d5f/d67/d73/f7b 15179 1 2024-04-13T10:59:21.271 INFO:tasks.workunit.client.0.smithi134.stdout:0/705: dwrite d4/d17/da/f10 [0,4194304] 0 2024-04-13T10:59:21.274 INFO:tasks.workunit.client.0.smithi134.stdout:6/829: rename d4/da/dbb/lec to d4/da/d15/d76/d8e/l117 0 2024-04-13T10:59:21.277 INFO:tasks.workunit.client.0.smithi134.stdout:6/830: chown d4/da/dbb/dc3/l8d 42 1 2024-04-13T10:59:21.281 INFO:tasks.workunit.client.0.smithi134.stdout:9/871: dwrite d13/d39/d52/fb6 [0,4194304] 0 2024-04-13T10:59:21.284 INFO:tasks.workunit.client.0.smithi134.stdout:6/831: chown d4/da/d15/d1f/d3c/fcd 29 1 2024-04-13T10:59:21.290 INFO:tasks.workunit.client.0.smithi134.stdout:0/706: rmdir d4/d17/d23/d51/d6b/d91/d98/df4 0 2024-04-13T10:59:21.291 INFO:tasks.workunit.client.0.smithi134.stdout:8/802: dwrite d8/f2b [0,4194304] 0 2024-04-13T10:59:21.295 INFO:tasks.workunit.client.0.smithi134.stdout:7/642: dwrite da/d15/d26/d27/d3d/d46/f4b [0,4194304] 0 2024-04-13T10:59:21.295 INFO:tasks.workunit.client.0.smithi134.stdout:9/872: mkdir d13/d39/d13a 0 2024-04-13T10:59:21.295 INFO:tasks.workunit.client.0.smithi134.stdout:0/707: fsync d4/d17/d23/d51/d6b/f7b 0 2024-04-13T10:59:21.295 INFO:tasks.workunit.client.0.smithi134.stdout:5/971: dread dc/d1d/d2b/d30/d100/d10e/d132/ddc/fc2 [0,4194304] 0 2024-04-13T10:59:21.302 INFO:tasks.workunit.client.0.smithi134.stdout:6/832: dread d4/da/d15/d1f/f4b [0,4194304] 0 2024-04-13T10:59:21.303 INFO:tasks.workunit.client.0.smithi134.stdout:5/972: dread - dc/d15/df1/d3b/faf zero size 2024-04-13T10:59:21.304 INFO:tasks.workunit.client.0.smithi134.stdout:8/803: symlink d8/dc/d13/ddf/l10a 0 2024-04-13T10:59:21.305 INFO:tasks.workunit.client.0.smithi134.stdout:6/833: dread - d4/da/dbb/fea zero size 2024-04-13T10:59:21.306 INFO:tasks.workunit.client.0.smithi134.stdout:9/873: unlink d13/l3a 0 2024-04-13T10:59:21.310 INFO:tasks.workunit.client.0.smithi134.stdout:5/973: dwrite dc/dc1/ffd [0,4194304] 0 2024-04-13T10:59:21.314 INFO:tasks.workunit.client.0.smithi134.stdout:6/834: unlink d4/da/d15/fed 0 2024-04-13T10:59:21.315 INFO:tasks.workunit.client.0.smithi134.stdout:8/804: symlink d8/dc/d16/d4e/d9c/de0/l10b 0 2024-04-13T10:59:21.318 INFO:tasks.workunit.client.0.smithi134.stdout:9/874: rmdir d13/d2e/d47 39 2024-04-13T10:59:21.320 INFO:tasks.workunit.client.0.smithi134.stdout:5/974: rename dc/d15/df1/d3b/d7f/d8d/l3d to dc/d39/dec/l138 0 2024-04-13T10:59:21.328 INFO:tasks.workunit.client.0.smithi134.stdout:6/835: creat d4/da/d15/d1f/d24/d10b/f118 x:0 0 0 2024-04-13T10:59:21.329 INFO:tasks.workunit.client.0.smithi134.stdout:8/805: creat d8/dc/d16/d54/d6c/d94/dc1/f10c x:0 0 0 2024-04-13T10:59:21.330 INFO:tasks.workunit.client.0.smithi134.stdout:9/875: mkdir d13/d39/d58/d5f/dac/d11a/d133/d13b 0 2024-04-13T10:59:21.330 INFO:tasks.workunit.client.0.smithi134.stdout:0/708: truncate d4/d17/d20/d29/d30/d3e/ff3 3605727 0 2024-04-13T10:59:21.331 INFO:tasks.workunit.client.0.smithi134.stdout:7/643: dread da/f11 [0,4194304] 0 2024-04-13T10:59:21.334 INFO:tasks.workunit.client.0.smithi134.stdout:6/836: write d4/da/d15/d1f/d24/f9a [286753,38848] 0 2024-04-13T10:59:21.335 INFO:tasks.workunit.client.0.smithi134.stdout:8/806: rename d8/dc/d16/d54/d6c/d94/fb2 to d8/dc/d2c/f10d 0 2024-04-13T10:59:21.335 INFO:tasks.workunit.client.0.smithi134.stdout:8/807: readlink d8/dc/d2c/l31 0 2024-04-13T10:59:21.356 INFO:tasks.workunit.client.0.smithi134.stdout:0/709: dread - d4/fa4 zero size 2024-04-13T10:59:21.549 INFO:tasks.workunit.client.0.smithi134.stdout:8/808: mknod d8/dc/d16/d54/d6c/d94/dc0/c10e 0 2024-04-13T10:59:21.564 INFO:tasks.workunit.client.0.smithi134.stdout:6/837: rename d4/da/l23 to d4/da/d1a/de6/l119 0 2024-04-13T10:59:21.565 INFO:tasks.workunit.client.0.smithi134.stdout:8/809: creat d8/dc/d16/d54/d6c/d94/de7/f10f x:0 0 0 2024-04-13T10:59:21.571 INFO:tasks.workunit.client.0.smithi134.stdout:7/644: dwrite da/d15/f77 [0,4194304] 0 2024-04-13T10:59:21.583 INFO:tasks.workunit.client.0.smithi134.stdout:0/710: dread d4/d17/da/d22/d41/f4b [0,4194304] 0 2024-04-13T10:59:21.594 INFO:tasks.workunit.client.0.smithi134.stdout:1/883: sync 2024-04-13T10:59:21.594 INFO:tasks.workunit.client.0.smithi134.stdout:3/661: sync 2024-04-13T10:59:21.594 INFO:tasks.workunit.client.0.smithi134.stdout:4/635: sync 2024-04-13T10:59:21.595 INFO:tasks.workunit.client.0.smithi134.stdout:1/884: dread - d3/d6/de3/f10d zero size 2024-04-13T10:59:21.596 INFO:tasks.workunit.client.0.smithi134.stdout:4/636: write d4/dd/d6d/f80 [427725,108894] 0 2024-04-13T10:59:21.607 INFO:tasks.workunit.client.0.smithi134.stdout:5/975: getdents dc/d1d/d2b/d30/d100/d10e/d132/d23/d38 0 2024-04-13T10:59:21.610 INFO:tasks.workunit.client.0.smithi134.stdout:7/645: mkdir da/d15/d26/d27/d4f/dc1 0 2024-04-13T10:59:21.614 INFO:tasks.workunit.client.0.smithi134.stdout:1/885: rmdir d3/d6/dd 39 2024-04-13T10:59:21.615 INFO:tasks.workunit.client.0.smithi134.stdout:4/637: symlink d4/d1f/d27/d2e/lcf 0 2024-04-13T10:59:21.616 INFO:tasks.workunit.client.0.smithi134.stdout:6/838: mknod d4/da/dbb/dc3/da6/df9/c11a 0 2024-04-13T10:59:21.617 INFO:tasks.workunit.client.0.smithi134.stdout:7/646: dread da/d15/d26/fae [0,4194304] 0 2024-04-13T10:59:21.618 INFO:tasks.workunit.client.0.smithi134.stdout:3/662: mkdir dc/d27/d19/d48/dd9 0 2024-04-13T10:59:21.623 INFO:tasks.workunit.client.0.smithi134.stdout:5/976: mkdir dc/d15/df1/d3b/d3c/d110/d139 0 2024-04-13T10:59:21.624 INFO:tasks.workunit.client.0.smithi134.stdout:6/839: dwrite d4/da/d15/d1f/d24/da4/dfb/f109 [0,4194304] 0 2024-04-13T10:59:21.632 INFO:tasks.workunit.client.0.smithi134.stdout:6/840: mknod d4/da/d15/d1f/d24/d10b/c11b 0 2024-04-13T10:59:21.634 INFO:tasks.workunit.client.0.smithi134.stdout:3/663: creat dc/fda x:0 0 0 2024-04-13T10:59:21.639 INFO:tasks.workunit.client.0.smithi134.stdout:6/841: dwrite d4/da/d15/d76/d8e/ff6 [0,4194304] 0 2024-04-13T10:59:21.647 INFO:tasks.workunit.client.0.smithi134.stdout:6/842: dread d4/da/d15/d1f/d24/d49/f50 [0,4194304] 0 2024-04-13T10:59:21.647 INFO:tasks.workunit.client.0.smithi134.stdout:6/843: chown d4/da/f25 27411 1 2024-04-13T10:59:21.648 INFO:tasks.workunit.client.0.smithi134.stdout:6/844: readlink d4/da/l81 0 2024-04-13T10:59:21.648 INFO:tasks.workunit.client.0.smithi134.stdout:6/845: readlink d4/da/d15/d1f/d3c/l10a 0 2024-04-13T10:59:21.655 INFO:tasks.workunit.client.0.smithi134.stdout:8/810: write d8/dc/d16/d54/ff3 [4508762,111932] 0 2024-04-13T10:59:21.659 INFO:tasks.workunit.client.0.smithi134.stdout:8/811: unlink d8/dc/d16/d54/f65 0 2024-04-13T10:59:21.668 INFO:tasks.workunit.client.0.smithi134.stdout:8/812: truncate d8/dc/d13/f40 4270366 0 2024-04-13T10:59:21.675 INFO:tasks.workunit.client.0.smithi134.stdout:0/711: dwrite d4/d17/da/d22/d41/d6e/f72 [0,4194304] 0 2024-04-13T10:59:21.684 INFO:tasks.workunit.client.0.smithi134.stdout:0/712: mknod d4/d17/c106 0 2024-04-13T10:59:21.686 INFO:tasks.workunit.client.0.smithi134.stdout:8/813: truncate d8/dc/d16/d54/d6f/f90 116081 0 2024-04-13T10:59:21.695 INFO:tasks.workunit.client.0.smithi134.stdout:1/886: dwrite d3/d6/d20/d71/f88 [0,4194304] 0 2024-04-13T10:59:21.696 INFO:tasks.workunit.client.0.smithi134.stdout:4/638: dwrite d4/d1f/d27/d3a/f6a [0,4194304] 0 2024-04-13T10:59:21.697 INFO:tasks.workunit.client.0.smithi134.stdout:8/814: truncate d8/dc/d13/f32 2417343 0 2024-04-13T10:59:21.702 INFO:tasks.workunit.client.0.smithi134.stdout:4/639: dread - d4/d82/fb4 zero size 2024-04-13T10:59:21.702 INFO:tasks.workunit.client.0.smithi134.stdout:8/815: symlink d8/dc/d37/d3f/l110 0 2024-04-13T10:59:21.705 INFO:tasks.workunit.client.0.smithi134.stdout:7/647: dwrite f4 [0,4194304] 0 2024-04-13T10:59:21.710 INFO:tasks.workunit.client.0.smithi134.stdout:1/887: unlink d3/d6/d16/d1d/d3c/fc6 0 2024-04-13T10:59:21.710 INFO:tasks.workunit.client.0.smithi134.stdout:7/648: fsync da/d15/d26/d27/d3d/d9c/fb5 0 2024-04-13T10:59:21.717 INFO:tasks.workunit.client.0.smithi134.stdout:4/640: dread d4/dd/d6d/d8c/f16 [0,4194304] 0 2024-04-13T10:59:21.717 INFO:tasks.workunit.client.0.smithi134.stdout:5/977: dwrite dc/d1d/d2b/d30/d100/d10e/d132/f2d [0,4194304] 0 2024-04-13T10:59:21.724 INFO:tasks.workunit.client.0.smithi134.stdout:8/816: creat d8/dc/d16/d54/d6c/d94/dc1/f111 x:0 0 0 2024-04-13T10:59:21.727 INFO:tasks.workunit.client.0.smithi134.stdout:1/888: chown d3/d6/dd 2908 1 2024-04-13T10:59:21.731 INFO:tasks.workunit.client.0.smithi134.stdout:4/641: mknod d4/dd/d6d/d8c/d5f/cd0 0 2024-04-13T10:59:21.733 INFO:tasks.workunit.client.0.smithi134.stdout:8/817: chown d8/dc/l11 12197351 1 2024-04-13T10:59:21.735 INFO:tasks.workunit.client.0.smithi134.stdout:4/642: rmdir d4/dd/d6d 39 2024-04-13T10:59:21.743 INFO:tasks.workunit.client.0.smithi134.stdout:4/643: truncate d4/dd/d6d/d8c/d5f/fa4 645505 0 2024-04-13T10:59:21.745 INFO:tasks.workunit.client.0.smithi134.stdout:0/713: readlink d4/d17/da/d22/d41/d6e/d8a/ld0 0 2024-04-13T10:59:21.745 INFO:tasks.workunit.client.0.smithi134.stdout:7/649: link da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/laf da/d15/d26/d27/d4f/lc2 0 2024-04-13T10:59:21.746 INFO:tasks.workunit.client.0.smithi134.stdout:7/650: fsync da/d15/d26/d27/d3d/d46/f4b 0 2024-04-13T10:59:21.747 INFO:tasks.workunit.client.0.smithi134.stdout:1/889: getdents d3/d6/d16/d1d/d68/de2 0 2024-04-13T10:59:21.755 INFO:tasks.workunit.client.0.smithi134.stdout:7/651: symlink da/d15/d26/d27/d3d/d9c/d5a/lc3 0 2024-04-13T10:59:21.757 INFO:tasks.workunit.client.0.smithi134.stdout:8/818: link d8/dc/d9d/f88 d8/f112 0 2024-04-13T10:59:21.759 INFO:tasks.workunit.client.0.smithi134.stdout:5/978: dwrite dc/d15/df1/d3b/d7f/fd8 [0,4194304] 0 2024-04-13T10:59:21.759 INFO:tasks.workunit.client.0.smithi134.stdout:4/644: dread d4/d1f/d27/d75/d38/d79/f28 [0,4194304] 0 2024-04-13T10:59:21.763 INFO:tasks.workunit.client.0.smithi134.stdout:5/979: read dc/d15/df1/d3b/f120 [963331,47666] 0 2024-04-13T10:59:21.764 INFO:tasks.workunit.client.0.smithi134.stdout:1/890: write d3/d6/fc [2484069,100116] 0 2024-04-13T10:59:21.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/819: fdatasync d8/f10 0 2024-04-13T10:59:21.766 INFO:tasks.workunit.client.0.smithi134.stdout:8/820: chown d8/dc/d16/d54/d98/dfa 3902 1 2024-04-13T10:59:21.766 INFO:tasks.workunit.client.0.smithi134.stdout:4/645: symlink d4/d48/d4a/d7e/ld1 0 2024-04-13T10:59:21.771 INFO:tasks.workunit.client.0.smithi134.stdout:7/652: write da/d15/d26/d38/f66 [4166615,120482] 0 2024-04-13T10:59:21.775 INFO:tasks.workunit.client.0.smithi134.stdout:4/646: mkdir d4/d1f/d27/dd2 0 2024-04-13T10:59:21.777 INFO:tasks.workunit.client.0.smithi134.stdout:8/821: rename c6 to d8/dc/d16/d54/d98/d9b/dd4/c113 0 2024-04-13T10:59:21.779 INFO:tasks.workunit.client.0.smithi134.stdout:7/653: creat da/d15/d26/d27/d3d/d46/d95/fc4 x:0 0 0 2024-04-13T10:59:21.780 INFO:tasks.workunit.client.0.smithi134.stdout:1/891: write d3/d6/f15 [874345,5003] 0 2024-04-13T10:59:21.782 INFO:tasks.workunit.client.0.smithi134.stdout:8/822: mknod d8/dc/d16/ddd/c114 0 2024-04-13T10:59:21.783 INFO:tasks.workunit.client.0.smithi134.stdout:4/647: dwrite d4/f2a [0,4194304] 0 2024-04-13T10:59:21.784 INFO:tasks.workunit.client.0.smithi134.stdout:8/823: write d8/dc/d16/d54/d98/d9b/da3/fd3 [1257686,126289] 0 2024-04-13T10:59:21.786 INFO:tasks.workunit.client.0.smithi134.stdout:5/980: getdents dc/dc1 0 2024-04-13T10:59:21.786 INFO:tasks.workunit.client.0.smithi134.stdout:8/824: fdatasync d8/dc/d16/d4e/d9c/f9e 0 2024-04-13T10:59:21.790 INFO:tasks.workunit.client.0.smithi134.stdout:7/654: mknod da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/cc5 0 2024-04-13T10:59:21.792 INFO:tasks.workunit.client.0.smithi134.stdout:1/892: dwrite d3/d6/d6a/dd8/f103 [4194304,4194304] 0 2024-04-13T10:59:21.795 INFO:tasks.workunit.client.0.smithi134.stdout:8/825: mknod d8/dc/d16/d54/d6c/d94/dc0/c115 0 2024-04-13T10:59:21.798 INFO:tasks.workunit.client.0.smithi134.stdout:5/981: write dc/d1d/d2b/d30/d100/d10e/d132/d23/f42 [1175489,120109] 0 2024-04-13T10:59:21.801 INFO:tasks.workunit.client.0.smithi134.stdout:8/826: creat d8/dc/d16/d54/d6c/f116 x:0 0 0 2024-04-13T10:59:21.801 INFO:tasks.workunit.client.0.smithi134.stdout:7/655: mknod da/d15/d26/d27/cc6 0 2024-04-13T10:59:21.802 INFO:tasks.workunit.client.0.smithi134.stdout:5/982: creat dc/df3/f13a x:0 0 0 2024-04-13T10:59:21.805 INFO:tasks.workunit.client.0.smithi134.stdout:7/656: mkdir da/d15/d26/d4a/dc7 0 2024-04-13T10:59:21.809 INFO:tasks.workunit.client.0.smithi134.stdout:5/983: rename dc/d15/dab/dd0/ff5 to dc/d1d/d2b/d30/d100/d10e/d132/d23/d36/dbd/f13b 0 2024-04-13T10:59:21.810 INFO:tasks.workunit.client.0.smithi134.stdout:7/657: rmdir da/d15/d26/d4a 39 2024-04-13T10:59:21.811 INFO:tasks.workunit.client.0.smithi134.stdout:7/658: write da/d15/f77 [568699,47209] 0 2024-04-13T10:59:21.815 INFO:tasks.workunit.client.0.smithi134.stdout:7/659: unlink da/d15/d26/d27/d4f/d5f/d88/f8d 0 2024-04-13T10:59:21.818 INFO:tasks.workunit.client.0.smithi134.stdout:7/660: truncate da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/fac 819396 0 2024-04-13T10:59:21.825 INFO:tasks.workunit.client.0.smithi134.stdout:7/661: link da/d15/d26/d4a/l57 da/d15/d26/d27/d4f/d5f/d67/lc8 0 2024-04-13T10:59:21.828 INFO:tasks.workunit.client.0.smithi134.stdout:1/893: dwrite d3/d6/d16/d4d/d111/f97 [0,4194304] 0 2024-04-13T10:59:21.833 INFO:tasks.workunit.client.0.smithi134.stdout:8/827: dwrite d8/dc/d13/fcb [0,4194304] 0 2024-04-13T10:59:21.835 INFO:tasks.workunit.client.0.smithi134.stdout:7/662: getdents da/d15/d26 0 2024-04-13T10:59:21.835 INFO:tasks.workunit.client.0.smithi134.stdout:8/828: read - d8/f107 zero size 2024-04-13T10:59:21.842 INFO:tasks.workunit.client.0.smithi134.stdout:8/829: link d8/dc/d16/d54/d6c/d94/dc1/f10c d8/dc/d9d/d69/f117 0 2024-04-13T10:59:21.845 INFO:tasks.workunit.client.0.smithi134.stdout:7/663: write da/d15/f22 [2132326,98227] 0 2024-04-13T10:59:21.846 INFO:tasks.workunit.client.0.smithi134.stdout:8/830: symlink d8/dc/d16/d74/l118 0 2024-04-13T10:59:21.847 INFO:tasks.workunit.client.0.smithi134.stdout:8/831: readlink d8/dc/d13/l5e 0 2024-04-13T10:59:21.851 INFO:tasks.workunit.client.0.smithi134.stdout:7/664: mkdir da/d15/d26/d27/dc9 0 2024-04-13T10:59:21.851 INFO:tasks.workunit.client.0.smithi134.stdout:1/894: dwrite d3/d6/d16/d1d/f58 [0,4194304] 0 2024-04-13T10:59:21.862 INFO:tasks.workunit.client.0.smithi134.stdout:7/665: write da/d15/f6e [2049746,99815] 0 2024-04-13T10:59:21.863 INFO:tasks.workunit.client.0.smithi134.stdout:1/895: write d3/d6/d20/ff2 [945706,31001] 0 2024-04-13T10:59:21.865 INFO:tasks.workunit.client.0.smithi134.stdout:1/896: write d3/d6/d20/f7b [4849249,64746] 0 2024-04-13T10:59:21.871 INFO:tasks.workunit.client.0.smithi134.stdout:1/897: rename d3/d6/d16/d4d/d111/l52 to d3/d6/d20/d6d/db1/l121 0 2024-04-13T10:59:21.873 INFO:tasks.workunit.client.0.smithi134.stdout:8/832: dread d8/dc/d13/f75 [0,4194304] 0 2024-04-13T10:59:21.875 INFO:tasks.workunit.client.0.smithi134.stdout:8/833: creat d8/dc/d13/ddf/f119 x:0 0 0 2024-04-13T10:59:21.878 INFO:tasks.workunit.client.0.smithi134.stdout:1/898: link d3/d6/de3/le9 d3/d6/d16/d1d/d110/l122 0 2024-04-13T10:59:21.878 INFO:tasks.workunit.client.0.smithi134.stdout:7/666: dwrite da/d15/d26/d27/d3d/d9c/fa6 [4194304,4194304] 0 2024-04-13T10:59:21.884 INFO:tasks.workunit.client.0.smithi134.stdout:8/834: dread d8/dc/d2c/d68/d8c/d8f/fd7 [0,4194304] 0 2024-04-13T10:59:21.887 INFO:tasks.workunit.client.0.smithi134.stdout:8/835: symlink d8/dc/d16/ddd/l11a 0 2024-04-13T10:59:21.888 INFO:tasks.workunit.client.0.smithi134.stdout:8/836: chown d8/dc/d16/d54/d6f/c83 26549753 1 2024-04-13T10:59:21.894 INFO:tasks.workunit.client.0.smithi134.stdout:7/667: dwrite da/d15/f29 [0,4194304] 0 2024-04-13T10:59:21.896 INFO:tasks.workunit.client.0.smithi134.stdout:7/668: stat da/d15/d26/d27/d4f 0 2024-04-13T10:59:21.896 INFO:tasks.workunit.client.0.smithi134.stdout:8/837: write d8/dc/d2c/fd5 [228040,27628] 0 2024-04-13T10:59:21.899 INFO:tasks.workunit.client.0.smithi134.stdout:8/838: symlink d8/dc/d37/d3f/l11b 0 2024-04-13T10:59:21.901 INFO:tasks.workunit.client.0.smithi134.stdout:7/669: read da/d15/d26/d27/d3d/fbd [2057263,48153] 0 2024-04-13T10:59:21.906 INFO:tasks.workunit.client.0.smithi134.stdout:8/839: creat d8/dc/d16/d54/d6c/d94/dc0/f11c x:0 0 0 2024-04-13T10:59:21.906 INFO:tasks.workunit.client.0.smithi134.stdout:7/670: readlink da/d15/d26/d27/d4f/d5f/d67/lc8 0 2024-04-13T10:59:21.907 INFO:tasks.workunit.client.0.smithi134.stdout:8/840: mknod d8/dc/d13/c11d 0 2024-04-13T10:59:21.908 INFO:tasks.workunit.client.0.smithi134.stdout:8/841: fsync d8/dc/d16/d54/d6c/d94/dc1/f111 0 2024-04-13T10:59:21.914 INFO:tasks.workunit.client.0.smithi134.stdout:7/671: dwrite da/d15/d26/d27/d3d/f7a [0,4194304] 0 2024-04-13T10:59:21.918 INFO:tasks.workunit.client.0.smithi134.stdout:8/842: dwrite d8/dc/d37/d3f/fa0 [4194304,4194304] 0 2024-04-13T10:59:21.924 INFO:tasks.workunit.client.0.smithi134.stdout:8/843: mkdir d8/dc/d16/d54/d98/d9b/da3/d11e 0 2024-04-13T10:59:21.925 INFO:tasks.workunit.client.0.smithi134.stdout:8/844: readlink d8/dc/d16/d74/l95 0 2024-04-13T10:59:21.933 INFO:tasks.workunit.client.0.smithi134.stdout:8/845: dwrite d8/dc/d16/d54/d6c/d94/dc1/fc6 [0,4194304] 0 2024-04-13T10:59:21.936 INFO:tasks.workunit.client.0.smithi134.stdout:8/846: mkdir d8/dc/d16/d54/d6c/d94/dc1/d11f 0 2024-04-13T10:59:21.937 INFO:tasks.workunit.client.0.smithi134.stdout:8/847: write d8/dc/d16/d54/d98/f109 [12319,31265] 0 2024-04-13T10:59:21.942 INFO:tasks.workunit.client.0.smithi134.stdout:8/848: truncate d8/dc/d16/d54/f77 901271 0 2024-04-13T10:59:21.944 INFO:tasks.workunit.client.0.smithi134.stdout:7/672: dread da/d15/d26/f28 [0,4194304] 0 2024-04-13T10:59:21.948 INFO:tasks.workunit.client.0.smithi134.stdout:7/673: symlink da/d15/d26/d27/d3d/d46/dbf/lca 0 2024-04-13T10:59:21.949 INFO:tasks.workunit.client.0.smithi134.stdout:7/674: stat da/d15/d26/d4a/c65 0 2024-04-13T10:59:21.952 INFO:tasks.workunit.client.0.smithi134.stdout:7/675: truncate da/d15/d26/d27/d3d/d46/d95/fc4 784876 0 2024-04-13T10:59:21.957 INFO:tasks.workunit.client.0.smithi134.stdout:8/849: write d8/f112 [3326715,6646] 0 2024-04-13T10:59:21.962 INFO:tasks.workunit.client.0.smithi134.stdout:8/850: unlink d8/dc/d16/l52 0 2024-04-13T10:59:21.963 INFO:tasks.workunit.client.0.smithi134.stdout:7/676: dread da/d15/d26/d27/d4f/d5f/d67/d73/f75 [0,4194304] 0 2024-04-13T10:59:21.965 INFO:tasks.workunit.client.0.smithi134.stdout:7/677: symlink da/d15/d26/d27/d4f/d5f/d88/lcb 0 2024-04-13T10:59:21.972 INFO:tasks.workunit.client.0.smithi134.stdout:8/851: dwrite d8/dc/d2c/d68/d8c/d8f/fd7 [0,4194304] 0 2024-04-13T10:59:21.975 INFO:tasks.workunit.client.0.smithi134.stdout:7/678: dwrite da/d15/d26/d27/d4f/d5f/d67/d76/faa [4194304,4194304] 0 2024-04-13T10:59:22.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.003+0000 7f70f682e700 1 -- 172.21.15.134:0/2615450572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f0100be0 msgr2=0x7f70f0102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:22.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.003+0000 7f70f682e700 1 --2- 172.21.15.134:0/2615450572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f0100be0 0x7f70f0102fc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009870 tx=0x7f70e0009b80 comp rx=0 tx=0).stop 2024-04-13T10:59:22.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.003+0000 7f70f682e700 1 -- 172.21.15.134:0/2615450572 shutdown_connections 2024-04-13T10:59:22.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.003+0000 7f70f682e700 1 --2- 172.21.15.134:0/2615450572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f0103500 0x7f70f01058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.003+0000 7f70f682e700 1 --2- 172.21.15.134:0/2615450572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f0100be0 0x7f70f0102fc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.003+0000 7f70f682e700 1 -- 172.21.15.134:0/2615450572 >> 172.21.15.134:0/2615450572 conn(0x7f70f00fa5e0 msgr2=0x7f70f00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:22.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.003+0000 7f70f682e700 1 -- 172.21.15.134:0/2615450572 shutdown_connections 2024-04-13T10:59:22.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.003+0000 7f70f682e700 1 -- 172.21.15.134:0/2615450572 wait complete. 2024-04-13T10:59:22.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.004+0000 7f70f682e700 1 Processor -- start 2024-04-13T10:59:22.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.004+0000 7f70f682e700 1 -- start start 2024-04-13T10:59:22.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.004+0000 7f70f682e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f0100be0 0x7f70f0100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:22.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.004+0000 7f70f682e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f0103500 0x7f70f00feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:22.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.004+0000 7f70f682e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00ff0d0 con 0x7f70f0103500 2024-04-13T10:59:22.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.004+0000 7f70f682e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00ff210 con 0x7f70f0100be0 2024-04-13T10:59:22.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70ef7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f0103500 0x7f70f00feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:22.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70ef7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f0103500 0x7f70f00feb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47132/0 (socket says 172.21.15.134:47132) 2024-04-13T10:59:22.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70ef7fe700 1 -- 172.21.15.134:0/1304836884 learned_addr learned my addr 172.21.15.134:0/1304836884 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:59:22.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70effff700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f0100be0 0x7f70f0100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:22.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70effff700 1 -- 172.21.15.134:0/1304836884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f0103500 msgr2=0x7f70f00feb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:22.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70effff700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f0103500 0x7f70f00feb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70effff700 1 -- 172.21.15.134:0/1304836884 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0009520 con 0x7f70f0100be0 2024-04-13T10:59:22.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70ef7fe700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f0103500 0x7f70f00feb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T10:59:22.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70effff700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f0100be0 0x7f70f0100540 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f70e0000c00 tx=0x7f70e0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:22.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70ed7fa700 1 -- 172.21.15.134:0/1304836884 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e001c070 con 0x7f70f0100be0 2024-04-13T10:59:22.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70ed7fa700 1 -- 172.21.15.134:0/1304836884 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f70e000fd30 con 0x7f70f0100be0 2024-04-13T10:59:22.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70ed7fa700 1 -- 172.21.15.134:0/1304836884 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e0022d40 con 0x7f70f0100be0 2024-04-13T10:59:22.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70f682e700 1 -- 172.21.15.134:0/1304836884 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f00ff490 con 0x7f70f0100be0 2024-04-13T10:59:22.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.005+0000 7f70f682e700 1 -- 172.21.15.134:0/1304836884 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f00ff980 con 0x7f70f0100be0 2024-04-13T10:59:22.007 INFO:tasks.workunit.client.0.smithi134.stdout:7/679: dread da/f13 [0,4194304] 0 2024-04-13T10:59:22.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.006+0000 7f70f682e700 1 -- 172.21.15.134:0/1304836884 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f018fa30 con 0x7f70f0100be0 2024-04-13T10:59:22.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.007+0000 7f70ed7fa700 1 -- 172.21.15.134:0/1304836884 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f70e0020070 con 0x7f70f0100be0 2024-04-13T10:59:22.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.008+0000 7f70ed7fa700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f70d806ce20 0x7f70d806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:22.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.008+0000 7f70ed7fa700 1 -- 172.21.15.134:0/1304836884 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f70e008dd10 con 0x7f70f0100be0 2024-04-13T10:59:22.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.008+0000 7f70ef7fe700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f70d806ce20 0x7f70d806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:22.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.008+0000 7f70ef7fe700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f70d806ce20 0x7f70d806f2d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f70e4005950 tx=0x7f70e4009310 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:22.011 INFO:tasks.workunit.client.0.smithi134.stdout:7/680: rename da/d15/d26/d27/d3d/d46/c56 to da/d15/d26/d27/d4f/d5f/d88/ccc 0 2024-04-13T10:59:22.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.012+0000 7f70ed7fa700 1 -- 172.21.15.134:0/1304836884 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f70e005b850 con 0x7f70f0100be0 2024-04-13T10:59:22.014 INFO:tasks.workunit.client.0.smithi134.stdout:7/681: unlink da/d15/d26/d27/d4f/d5f/d67/d73/ca4 0 2024-04-13T10:59:22.016 INFO:tasks.workunit.client.0.smithi134.stdout:7/682: mkdir da/d15/d26/d27/dc9/dcd 0 2024-04-13T10:59:22.020 INFO:tasks.workunit.client.0.smithi134.stdout:7/683: dread da/d15/d26/d27/d4f/d5f/d67/d76/fb6 [4194304,4194304] 0 2024-04-13T10:59:22.023 INFO:tasks.workunit.client.0.smithi134.stdout:7/684: symlink da/d15/d26/d27/d4f/d5f/lce 0 2024-04-13T10:59:22.035 INFO:tasks.workunit.client.0.smithi134.stdout:7/685: dread da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/fc0 [0,4194304] 0 2024-04-13T10:59:22.066 INFO:tasks.workunit.client.0.smithi134.stdout:2/615: sync 2024-04-13T10:59:22.069 INFO:tasks.workunit.client.0.smithi134.stdout:2/616: chown d5/d6/d57/d6f/d30/f63 133 1 2024-04-13T10:59:22.081 INFO:tasks.workunit.client.0.smithi134.stdout:2/617: write d5/de/d12/f6a [1576944,102625] 0 2024-04-13T10:59:22.082 INFO:tasks.workunit.client.0.smithi134.stdout:7/686: dwrite da/d15/d26/d27/d3d/d9c/d48/f5d [4194304,4194304] 0 2024-04-13T10:59:22.083 INFO:tasks.workunit.client.0.smithi134.stdout:2/618: chown d5/d6/d57/d6c/c3f 0 1 2024-04-13T10:59:22.093 INFO:tasks.workunit.client.0.smithi134.stdout:2/619: dread d5/d6/d57/d6c/d29/f66 [0,4194304] 0 2024-04-13T10:59:22.095 INFO:tasks.workunit.client.0.smithi134.stdout:7/687: getdents da/d15/d26/d27/dc9 0 2024-04-13T10:59:22.097 INFO:tasks.workunit.client.0.smithi134.stdout:2/620: symlink d5/d6/d34/lb4 0 2024-04-13T10:59:22.098 INFO:tasks.workunit.client.0.smithi134.stdout:2/621: chown d5/de/d2e/d8f/fa5 0 1 2024-04-13T10:59:22.099 INFO:tasks.workunit.client.0.smithi134.stdout:7/688: write da/d15/d26/d27/d4f/d5f/d67/d76/fb6 [7624181,85679] 0 2024-04-13T10:59:22.099 INFO:tasks.workunit.client.0.smithi134.stdout:7/689: fsync da/fa8 0 2024-04-13T10:59:22.102 INFO:tasks.workunit.client.0.smithi134.stdout:2/622: mkdir d5/d6/d70/db5 0 2024-04-13T10:59:22.103 INFO:tasks.workunit.client.0.smithi134.stdout:2/623: read d5/d6/f69 [1501666,88637] 0 2024-04-13T10:59:22.104 INFO:tasks.workunit.client.0.smithi134.stdout:2/624: chown d5/d6/d57/d6f/d30/d88/d96/fb0 4 1 2024-04-13T10:59:22.109 INFO:tasks.workunit.client.0.smithi134.stdout:2/625: symlink d5/d6/d34/lb6 0 2024-04-13T10:59:22.113 INFO:tasks.workunit.client.0.smithi134.stdout:2/626: write d5/d6/d57/d6f/d30/d58/d73/f83 [318585,40322] 0 2024-04-13T10:59:22.114 INFO:tasks.workunit.client.0.smithi134.stdout:2/627: truncate d5/d6/d57/d6c/d29/f46 1428517 0 2024-04-13T10:59:22.116 INFO:tasks.workunit.client.0.smithi134.stdout:7/690: write da/d15/f8a [1020548,126837] 0 2024-04-13T10:59:22.120 INFO:tasks.workunit.client.0.smithi134.stdout:7/691: truncate da/d15/d26/f62 285379 0 2024-04-13T10:59:22.121 INFO:tasks.workunit.client.0.smithi134.stdout:2/628: truncate d5/de/f10 2320787 0 2024-04-13T10:59:22.126 INFO:tasks.workunit.client.0.smithi134.stdout:2/629: creat d5/d6/d57/d6f/d30/fb7 x:0 0 0 2024-04-13T10:59:22.127 INFO:tasks.workunit.client.0.smithi134.stdout:7/692: dwrite f4 [4194304,4194304] 0 2024-04-13T10:59:22.129 INFO:tasks.workunit.client.0.smithi134.stdout:2/630: write d5/d6/d57/d6f/d30/d58/d73/f98 [713427,100765] 0 2024-04-13T10:59:22.134 INFO:tasks.workunit.client.0.smithi134.stdout:2/631: rename d5/de/d2e/f64 to d5/d6/d57/d6c/d29/fb8 0 2024-04-13T10:59:22.139 INFO:tasks.workunit.client.0.smithi134.stdout:2/632: mknod d5/da1/cb9 0 2024-04-13T10:59:22.146 INFO:tasks.workunit.client.0.smithi134.stdout:2/633: write d5/de/f37 [3180796,66104] 0 2024-04-13T10:59:22.149 INFO:tasks.workunit.client.0.smithi134.stdout:2/634: chown d5/de/c7f 7 1 2024-04-13T10:59:22.161 INFO:tasks.workunit.client.0.smithi134.stdout:7/693: truncate da/d15/d26/d27/d3d/d9c/d5a/f72 350471 0 2024-04-13T10:59:22.162 INFO:tasks.workunit.client.0.smithi134.stdout:7/694: write da/fb [2510687,69823] 0 2024-04-13T10:59:22.169 INFO:tasks.workunit.client.0.smithi134.stdout:7/695: getdents da/d15/d26/d38 0 2024-04-13T10:59:22.169 INFO:tasks.workunit.client.0.smithi134.stdout:7/696: readlink da/d15/d85/l9f 0 2024-04-13T10:59:22.186 INFO:tasks.workunit.client.0.smithi134.stdout:7/697: dread da/d15/d26/f30 [0,4194304] 0 2024-04-13T10:59:22.189 INFO:tasks.workunit.client.0.smithi134.stdout:7/698: dread da/d15/d26/d27/d3d/d46/d95/fc4 [0,4194304] 0 2024-04-13T10:59:22.190 INFO:tasks.workunit.client.0.smithi134.stdout:7/699: readlink da/d15/d26/d27/d4f/d5f/d67/d76/l97 0 2024-04-13T10:59:22.197 INFO:tasks.workunit.client.0.smithi134.stdout:7/700: dread da/d15/d26/d27/d4f/d5f/d67/d73/d92/fa9 [0,4194304] 0 2024-04-13T10:59:22.208 INFO:tasks.workunit.client.0.smithi134.stdout:7/701: write da/d15/d26/d38/f84 [3202997,81888] 0 2024-04-13T10:59:22.210 INFO:tasks.workunit.client.0.smithi134.stdout:7/702: creat da/d15/d85/fcf x:0 0 0 2024-04-13T10:59:22.212 INFO:tasks.workunit.client.0.smithi134.stdout:7/703: symlink da/d15/d26/d4a/dc7/ld0 0 2024-04-13T10:59:22.217 INFO:tasks.workunit.client.0.smithi134.stdout:7/704: dread da/d15/d26/f4d [0,4194304] 0 2024-04-13T10:59:22.219 INFO:tasks.workunit.client.0.smithi134.stdout:7/705: truncate da/d15/d26/d27/d4f/d5f/d67/d73/fb9 841344 0 2024-04-13T10:59:22.225 INFO:tasks.workunit.client.0.smithi134.stdout:9/876: sync 2024-04-13T10:59:22.230 INFO:tasks.workunit.client.0.smithi134.stdout:9/877: truncate d13/d40/d7d/fdd 192200 0 2024-04-13T10:59:22.230 INFO:tasks.workunit.client.0.smithi134.stdout:7/706: rmdir da 39 2024-04-13T10:59:22.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.296+0000 7f70f682e700 1 -- 172.21.15.134:0/1304836884 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70f0061190 con 0x7f70d806ce20 2024-04-13T10:59:22.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.297+0000 7f70ed7fa700 1 -- 172.21.15.134:0/1304836884 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f70f0061190 con 0x7f70d806ce20 2024-04-13T10:59:22.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 -- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f70d806ce20 msgr2=0x7f70d806f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f70d806ce20 0x7f70d806f2d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f70e4005950 tx=0x7f70e4009310 comp rx=0 tx=0).stop 2024-04-13T10:59:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 -- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f0100be0 msgr2=0x7f70f0100540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f0100be0 0x7f70f0100540 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f70e0000c00 tx=0x7f70e0004770 comp rx=0 tx=0).stop 2024-04-13T10:59:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 -- 172.21.15.134:0/1304836884 shutdown_connections 2024-04-13T10:59:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f70d806ce20 0x7f70d806f2d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f0100be0 0x7f70f0100540 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 --2- 172.21.15.134:0/1304836884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70f0103500 0x7f70f00feb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 -- 172.21.15.134:0/1304836884 >> 172.21.15.134:0/1304836884 conn(0x7f70f00fa5e0 msgr2=0x7f70f00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 -- 172.21.15.134:0/1304836884 shutdown_connections 2024-04-13T10:59:22.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.300+0000 7f70f682e700 1 -- 172.21.15.134:0/1304836884 wait complete. 2024-04-13T10:59:22.310 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T10:59:22.378 INFO:tasks.workunit.client.0.smithi134.stdout:9/878: mknod d13/da3/d98/d103/c13c 0 2024-04-13T10:59:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.405+0000 7f969c665700 1 -- 172.21.15.134:0/3593440014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9694100150 msgr2=0x7f9694100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.405+0000 7f969c665700 1 --2- 172.21.15.134:0/3593440014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9694100150 0x7f9694100560 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9690009870 tx=0x7f9690009b80 comp rx=0 tx=0).stop 2024-04-13T10:59:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.405+0000 7f969c665700 1 -- 172.21.15.134:0/3593440014 shutdown_connections 2024-04-13T10:59:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.405+0000 7f969c665700 1 --2- 172.21.15.134:0/3593440014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9694101350 0x7f96941017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.405+0000 7f969c665700 1 --2- 172.21.15.134:0/3593440014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9694100150 0x7f9694100560 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.405+0000 7f969c665700 1 -- 172.21.15.134:0/3593440014 >> 172.21.15.134:0/3593440014 conn(0x7f96940fb6e0 msgr2=0x7f96940fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969c665700 1 -- 172.21.15.134:0/3593440014 shutdown_connections 2024-04-13T10:59:22.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969c665700 1 -- 172.21.15.134:0/3593440014 wait complete. 2024-04-13T10:59:22.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969c665700 1 Processor -- start 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969c665700 1 -- start start 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969c665700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9694100150 0x7f9694074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969c665700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9694101350 0x7f9694073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969c665700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9694073680 con 0x7f9694100150 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969c665700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96940737c0 con 0x7f9694101350 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969a401700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9694100150 0x7f9694074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969a401700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9694100150 0x7f9694074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47152/0 (socket says 172.21.15.134:47152) 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.406+0000 7f969a401700 1 -- 172.21.15.134:0/1161468454 learned_addr learned my addr 172.21.15.134:0/1161468454 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.407+0000 7f9699c00700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9694101350 0x7f9694073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.407+0000 7f969a401700 1 -- 172.21.15.134:0/1161468454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9694101350 msgr2=0x7f9694073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.407+0000 7f969a401700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9694101350 0x7f9694073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.407+0000 7f969a401700 1 -- 172.21.15.134:0/1161468454 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690009520 con 0x7f9694100150 2024-04-13T10:59:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.407+0000 7f969a401700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9694100150 0x7f9694074af0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f969000b5b0 tx=0x7f969000f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.407+0000 7f968b7fe700 1 -- 172.21.15.134:0/1161468454 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f969001c070 con 0x7f9694100150 2024-04-13T10:59:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.407+0000 7f969c665700 1 -- 172.21.15.134:0/1161468454 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9694073a40 con 0x7f9694100150 2024-04-13T10:59:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.407+0000 7f968b7fe700 1 -- 172.21.15.134:0/1161468454 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f969000fce0 con 0x7f9694100150 2024-04-13T10:59:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.407+0000 7f968b7fe700 1 -- 172.21.15.134:0/1161468454 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9690022de0 con 0x7f9694100150 2024-04-13T10:59:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.407+0000 7f969c665700 1 -- 172.21.15.134:0/1161468454 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9694073f30 con 0x7f9694100150 2024-04-13T10:59:22.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.408+0000 7f969c665700 1 -- 172.21.15.134:0/1161468454 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9694108b60 con 0x7f9694100150 2024-04-13T10:59:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.409+0000 7f968b7fe700 1 -- 172.21.15.134:0/1161468454 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f9690020070 con 0x7f9694100150 2024-04-13T10:59:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.409+0000 7f968b7fe700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f968006ce10 0x7f968006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.409+0000 7f968b7fe700 1 -- 172.21.15.134:0/1161468454 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f969008d750 con 0x7f9694100150 2024-04-13T10:59:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.409+0000 7f9699c00700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f968006ce10 0x7f968006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:22.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.409+0000 7f9699c00700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f968006ce10 0x7f968006f2c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9684005fd0 tx=0x7f9684009310 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:22.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.414+0000 7f968b7fe700 1 -- 172.21.15.134:0/1161468454 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f969005b400 con 0x7f9694100150 2024-04-13T10:59:22.435 INFO:tasks.workunit.client.0.smithi134.stdout:3/664: sync 2024-04-13T10:59:22.446 INFO:tasks.workunit.client.0.smithi134.stdout:7/707: write da/d15/d26/d27/d4f/d5f/d67/d76/f82 [3104544,83110] 0 2024-04-13T10:59:22.451 INFO:tasks.workunit.client.0.smithi134.stdout:7/708: creat da/d15/d26/d4a/fd1 x:0 0 0 2024-04-13T10:59:22.453 INFO:tasks.workunit.client.0.smithi134.stdout:3/665: dwrite dc/d1d/d58/f7e [0,4194304] 0 2024-04-13T10:59:22.454 INFO:tasks.workunit.client.0.smithi134.stdout:9/879: dread d13/d2e/d47/dc1/ff2 [0,4194304] 0 2024-04-13T10:59:22.456 INFO:tasks.workunit.client.0.smithi134.stdout:3/666: chown dc/d1d/d58/f5d 25752 1 2024-04-13T10:59:22.456 INFO:tasks.workunit.client.0.smithi134.stdout:3/667: chown dc/d27/d19/f6a 20728198 1 2024-04-13T10:59:22.458 INFO:tasks.workunit.client.0.smithi134.stdout:3/668: chown dc/d1d/d58/db4/fd3 1 1 2024-04-13T10:59:22.458 INFO:tasks.workunit.client.0.smithi134.stdout:9/880: fsync d13/d2e/d35/d50/fcc 0 2024-04-13T10:59:22.459 INFO:tasks.workunit.client.0.smithi134.stdout:3/669: truncate dc/d1d/d58/db4/f89 5165162 0 2024-04-13T10:59:22.459 INFO:tasks.workunit.client.0.smithi134.stdout:7/709: link da/d15/d26/f35 da/d15/d26/d27/d4f/d5f/d67/fd2 0 2024-04-13T10:59:22.465 INFO:tasks.workunit.client.0.smithi134.stdout:7/710: dread da/d15/d26/d27/d4f/d5f/d67/d76/faa [4194304,4194304] 0 2024-04-13T10:59:22.471 INFO:tasks.workunit.client.0.smithi134.stdout:7/711: dread da/d15/d26/d27/d4f/d5f/d67/d73/fb9 [0,4194304] 0 2024-04-13T10:59:22.473 INFO:tasks.workunit.client.0.smithi134.stdout:7/712: write da/d15/d26/d27/d3d/f7a [1374626,67992] 0 2024-04-13T10:59:22.474 INFO:tasks.workunit.client.0.smithi134.stdout:7/713: chown da/d15/d26/d27/d3d/d46/d95/f98 5730 1 2024-04-13T10:59:22.475 INFO:tasks.workunit.client.0.smithi134.stdout:3/670: write dc/fbc [319402,110998] 0 2024-04-13T10:59:22.479 INFO:tasks.workunit.client.0.smithi134.stdout:7/714: unlink da/f33 0 2024-04-13T10:59:22.480 INFO:tasks.workunit.client.0.smithi134.stdout:7/715: write da/d15/f2e [4260796,78444] 0 2024-04-13T10:59:22.481 INFO:tasks.workunit.client.0.smithi134.stdout:3/671: creat dc/d27/d81/fdb x:0 0 0 2024-04-13T10:59:22.482 INFO:tasks.workunit.client.0.smithi134.stdout:3/672: chown dc/d1d/d58/c79 7 1 2024-04-13T10:59:22.485 INFO:tasks.workunit.client.0.smithi134.stdout:7/716: mkdir da/d15/d26/d27/d4f/dd3 0 2024-04-13T10:59:22.489 INFO:tasks.workunit.client.0.smithi134.stdout:3/673: creat dc/d27/d19/d8b/da8/d50/d25/d91/fdc x:0 0 0 2024-04-13T10:59:22.491 INFO:tasks.workunit.client.0.smithi134.stdout:3/674: read dc/d27/d19/d8b/d9b/f6b [891557,16367] 0 2024-04-13T10:59:22.495 INFO:tasks.workunit.client.0.smithi134.stdout:3/675: creat dc/d27/d19/d8b/da8/d50/d25/d91/d93/fdd x:0 0 0 2024-04-13T10:59:22.497 INFO:tasks.workunit.client.0.smithi134.stdout:7/717: dwrite da/d15/d26/d27/d4f/d5f/d67/d73/fb9 [0,4194304] 0 2024-04-13T10:59:22.500 INFO:tasks.workunit.client.0.smithi134.stdout:3/676: creat dc/d27/d19/db1/fde x:0 0 0 2024-04-13T10:59:22.501 INFO:tasks.workunit.client.0.smithi134.stdout:3/677: write dc/f42 [3176032,108891] 0 2024-04-13T10:59:22.503 INFO:tasks.workunit.client.0.smithi134.stdout:3/678: fdatasync dc/f10 0 2024-04-13T10:59:22.509 INFO:tasks.workunit.client.0.smithi134.stdout:0/714: sync 2024-04-13T10:59:22.509 INFO:tasks.workunit.client.0.smithi134.stdout:6/846: sync 2024-04-13T10:59:22.513 INFO:tasks.workunit.client.0.smithi134.stdout:3/679: symlink dc/d1d/dca/ldf 0 2024-04-13T10:59:22.516 INFO:tasks.workunit.client.0.smithi134.stdout:0/715: chown d4/d17/d20/cc1 499446825 1 2024-04-13T10:59:22.517 INFO:tasks.workunit.client.0.smithi134.stdout:7/718: getdents da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e 0 2024-04-13T10:59:22.517 INFO:tasks.workunit.client.0.smithi134.stdout:6/847: dwrite d4/da/dbb/dc3/f5a [4194304,4194304] 0 2024-04-13T10:59:22.525 INFO:tasks.workunit.client.0.smithi134.stdout:6/848: rmdir d4/da/d15/d1f/d24/d2b 39 2024-04-13T10:59:22.527 INFO:tasks.workunit.client.0.smithi134.stdout:7/719: write da/d15/d26/d27/d4f/d5f/d67/fd2 [8356404,110382] 0 2024-04-13T10:59:22.528 INFO:tasks.workunit.client.0.smithi134.stdout:6/849: creat d4/da/dbb/dc3/f11c x:0 0 0 2024-04-13T10:59:22.532 INFO:tasks.workunit.client.0.smithi134.stdout:3/680: getdents dc/d1d/d58 0 2024-04-13T10:59:22.534 INFO:tasks.workunit.client.0.smithi134.stdout:0/716: truncate d4/d17/d23/d51/d6b/f7b 1116792 0 2024-04-13T10:59:22.535 INFO:tasks.workunit.client.0.smithi134.stdout:7/720: dwrite da/d15/d26/d27/d3d/d9c/d48/f5d [4194304,4194304] 0 2024-04-13T10:59:22.535 INFO:tasks.workunit.client.0.smithi134.stdout:0/717: chown d4/d17/d23/d51/d6a/d73 298909 1 2024-04-13T10:59:22.544 INFO:tasks.workunit.client.0.smithi134.stdout:7/721: dwrite da/d15/d26/d27/d3d/fbd [0,4194304] 0 2024-04-13T10:59:22.546 INFO:tasks.workunit.client.0.smithi134.stdout:6/850: link d4/da/dbb/dc3/lc7 d4/da/d15/d1f/d24/d49/d91/l11d 0 2024-04-13T10:59:22.546 INFO:tasks.workunit.client.0.smithi134.stdout:7/722: chown da/d15/d85/f8f 131 1 2024-04-13T10:59:22.546 INFO:tasks.workunit.client.0.smithi134.stdout:6/851: chown d4/f5 4544258 1 2024-04-13T10:59:22.547 INFO:tasks.workunit.client.0.smithi134.stdout:0/718: read d4/d17/d20/da9/de1/dcf/f71 [239633,77103] 0 2024-04-13T10:59:22.552 INFO:tasks.workunit.client.0.smithi134.stdout:7/723: write da/d15/d26/f4d [151411,59319] 0 2024-04-13T10:59:22.555 INFO:tasks.workunit.client.0.smithi134.stdout:3/681: getdents dc/d27/d19/db1 0 2024-04-13T10:59:22.556 INFO:tasks.workunit.client.0.smithi134.stdout:0/719: dwrite d4/d17/d20/da9/de1/dfc/d6d/d97/fea [0,4194304] 0 2024-04-13T10:59:22.570 INFO:tasks.workunit.client.0.smithi134.stdout:6/852: truncate d4/da/d15/d1f/d24/da4/fc5 2864973 0 2024-04-13T10:59:22.578 INFO:tasks.workunit.client.0.smithi134.stdout:7/724: dwrite da/d15/d26/d27/d4f/d5f/d67/d73/f75 [4194304,4194304] 0 2024-04-13T10:59:22.580 INFO:tasks.workunit.client.0.smithi134.stdout:0/720: dread d4/d17/d23/d51/d6b/d91/d98/d62/f85 [0,4194304] 0 2024-04-13T10:59:22.612 INFO:tasks.workunit.client.0.smithi134.stdout:4/648: sync 2024-04-13T10:59:22.612 INFO:tasks.workunit.client.0.smithi134.stdout:1/899: sync 2024-04-13T10:59:22.612 INFO:tasks.workunit.client.0.smithi134.stdout:8/852: sync 2024-04-13T10:59:22.612 INFO:tasks.workunit.client.0.smithi134.stdout:5/984: sync 2024-04-13T10:59:22.612 INFO:tasks.workunit.client.0.smithi134.stdout:3/682: mknod dc/d27/d19/d48/ce0 0 2024-04-13T10:59:22.615 INFO:tasks.workunit.client.0.smithi134.stdout:8/853: write d8/dc/d9d/f88 [4456268,93691] 0 2024-04-13T10:59:22.618 INFO:tasks.workunit.client.0.smithi134.stdout:0/721: chown d4/d17/da/f27 1 1 2024-04-13T10:59:22.624 INFO:tasks.workunit.client.0.smithi134.stdout:6/853: symlink d4/da/d15/d1f/d24/d2b/l11e 0 2024-04-13T10:59:22.624 INFO:tasks.workunit.client.0.smithi134.stdout:6/854: stat d4/da/d15/d1f/d24/d49/d91 0 2024-04-13T10:59:22.625 INFO:tasks.workunit.client.0.smithi134.stdout:6/855: dread - d4/da/f107 zero size 2024-04-13T10:59:22.626 INFO:tasks.workunit.client.0.smithi134.stdout:6/856: write d4/da/d15/d1f/d24/f9a [1246622,59534] 0 2024-04-13T10:59:22.629 INFO:tasks.workunit.client.0.smithi134.stdout:3/683: creat dc/d27/d19/d8b/da8/d50/d25/d91/d93/fe1 x:0 0 0 2024-04-13T10:59:22.630 INFO:tasks.workunit.client.0.smithi134.stdout:7/725: symlink da/d15/d26/d27/d4f/dd3/ld4 0 2024-04-13T10:59:22.633 INFO:tasks.workunit.client.0.smithi134.stdout:8/854: rename d8/dc/d16/d4e/d9c/de0 to d8/dc/d9d/d69/d120 0 2024-04-13T10:59:22.635 INFO:tasks.workunit.client.0.smithi134.stdout:5/985: mknod dc/d15/c13c 0 2024-04-13T10:59:22.639 INFO:tasks.workunit.client.0.smithi134.stdout:1/900: creat d3/d6/d16/d1d/d86/d105/f123 x:0 0 0 2024-04-13T10:59:22.640 INFO:tasks.workunit.client.0.smithi134.stdout:1/901: write d3/d6/d20/d9f/dbe/fee [4811133,119571] 0 2024-04-13T10:59:22.644 INFO:tasks.workunit.client.0.smithi134.stdout:4/649: mkdir d4/d1f/d27/d3a/d65/dce/dd3 0 2024-04-13T10:59:22.647 INFO:tasks.workunit.client.0.smithi134.stdout:3/684: creat dc/d27/d19/d8b/d9b/fe2 x:0 0 0 2024-04-13T10:59:22.648 INFO:tasks.workunit.client.0.smithi134.stdout:7/726: creat da/d15/d26/d27/d3d/d9c/d5a/fd5 x:0 0 0 2024-04-13T10:59:22.650 INFO:tasks.workunit.client.0.smithi134.stdout:8/855: rename d8/dc/d16/d74/l95 to d8/dc/d37/l121 0 2024-04-13T10:59:22.651 INFO:tasks.workunit.client.0.smithi134.stdout:8/856: stat d8/dc/d2c/d68/fe4 0 2024-04-13T10:59:22.656 INFO:tasks.workunit.client.0.smithi134.stdout:3/685: dread - dc/d1d/f8d zero size 2024-04-13T10:59:22.661 INFO:tasks.workunit.client.0.smithi134.stdout:7/727: dread da/fb [0,4194304] 0 2024-04-13T10:59:22.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:22 smithi134 ceph-mon[39696]: pgmap v45: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 105 MiB/s wr, 257 op/s 2024-04-13T10:59:22.662 INFO:tasks.workunit.client.0.smithi134.stdout:3/686: mknod dc/d27/d19/ce3 0 2024-04-13T10:59:22.670 INFO:tasks.workunit.client.0.smithi134.stdout:0/722: link d4/d17/d20/d29/d30/d3e/c4e d4/d17/c107 0 2024-04-13T10:59:22.672 INFO:tasks.workunit.client.0.smithi134.stdout:4/650: link d4/d1f/d27/d3a/d65/c87 d4/d48/cd4 0 2024-04-13T10:59:22.673 INFO:tasks.workunit.client.0.smithi134.stdout:8/857: dread d8/dc/d13/f40 [0,4194304] 0 2024-04-13T10:59:22.674 INFO:tasks.workunit.client.0.smithi134.stdout:0/723: chown d4/c6 12115 1 2024-04-13T10:59:22.675 INFO:tasks.workunit.client.0.smithi134.stdout:4/651: mknod d4/d1f/d27/d3a/d53/d58/cd5 0 2024-04-13T10:59:22.677 INFO:tasks.workunit.client.0.smithi134.stdout:0/724: chown d4/d17/d23/d51/d6b/d91/d98/d92/dca 191150063 1 2024-04-13T10:59:22.678 INFO:tasks.workunit.client.0.smithi134.stdout:0/725: chown d4/d17/d23/d51/d6b/d91/d98/d62/daf/dc7 0 1 2024-04-13T10:59:22.683 INFO:tasks.workunit.client.0.smithi134.stdout:4/652: creat d4/d1f/d27/d3a/d65/dce/fd6 x:0 0 0 2024-04-13T10:59:22.685 INFO:tasks.workunit.client.0.smithi134.stdout:0/726: creat d4/d17/d23/d51/d6b/f108 x:0 0 0 2024-04-13T10:59:22.690 INFO:tasks.workunit.client.0.smithi134.stdout:8/858: rename d8/dc/d2c/d68/d8c/d8f/cc9 to d8/dc/d16/d4e/d9c/c122 0 2024-04-13T10:59:22.693 INFO:tasks.workunit.client.0.smithi134.stdout:9/881: sync 2024-04-13T10:59:22.693 INFO:tasks.workunit.client.0.smithi134.stdout:2/635: sync 2024-04-13T10:59:22.693 INFO:tasks.workunit.client.0.smithi134.stdout:0/727: stat d4/d17/da/d22/d41/d6e/d8a/d95/df2 0 2024-04-13T10:59:22.702 INFO:tasks.workunit.client.0.smithi134.stdout:4/653: dwrite d4/d48/d50/fc2 [0,4194304] 0 2024-04-13T10:59:22.703 INFO:tasks.workunit.client.0.smithi134.stdout:9/882: mkdir d13/d39/d64/db2/d100/d13d 0 2024-04-13T10:59:22.706 INFO:tasks.workunit.client.0.smithi134.stdout:0/728: fsync d4/d17/d20/da9/de1/dfc/fe9 0 2024-04-13T10:59:22.709 INFO:tasks.workunit.client.0.smithi134.stdout:2/636: creat d5/d6/d70/d84/fba x:0 0 0 2024-04-13T10:59:22.709 INFO:tasks.workunit.client.0.smithi134.stdout:4/654: read d4/d1f/d27/d75/d38/d79/d32/d67/d9b/fc3 [254844,12812] 0 2024-04-13T10:59:22.713 INFO:tasks.workunit.client.0.smithi134.stdout:2/637: read d5/d6/d57/d6f/d30/d58/f9d [341450,77800] 0 2024-04-13T10:59:22.721 INFO:tasks.workunit.client.0.smithi134.stdout:1/902: write d3/d6/d20/d6d/db1/fe8 [961892,18582] 0 2024-04-13T10:59:22.723 INFO:tasks.workunit.client.0.smithi134.stdout:5/986: write dc/d15/df1/d3b/fcb [1109841,121964] 0 2024-04-13T10:59:22.724 INFO:tasks.workunit.client.0.smithi134.stdout:0/729: chown d4/d17/da/d22/d41/d6e/d8a/d95/db9/ce4 16039 1 2024-04-13T10:59:22.731 INFO:tasks.workunit.client.0.smithi134.stdout:9/883: rename d13/d39/c36 to d13/da3/d134/c13e 0 2024-04-13T10:59:22.734 INFO:tasks.workunit.client.0.smithi134.stdout:0/730: chown d4/d17/d20/da9/de1/dfc/d6d/da5/dd9 41033 1 2024-04-13T10:59:22.735 INFO:tasks.workunit.client.0.smithi134.stdout:9/884: stat d13/d2e/d47/c75 0 2024-04-13T10:59:22.736 INFO:tasks.workunit.client.0.smithi134.stdout:4/655: symlink d4/d1f/d27/d3a/d53/dc1/ld7 0 2024-04-13T10:59:22.737 INFO:tasks.workunit.client.0.smithi134.stdout:6/857: dwrite d4/da/d1a/f44 [0,4194304] 0 2024-04-13T10:59:22.741 INFO:tasks.workunit.client.0.smithi134.stdout:9/885: chown d13/d39/d64/c96 16 1 2024-04-13T10:59:22.744 INFO:tasks.workunit.client.0.smithi134.stdout:2/638: symlink d5/de/d50/lbb 0 2024-04-13T10:59:22.745 INFO:tasks.workunit.client.0.smithi134.stdout:3/687: write dc/d2a/f56 [775026,50230] 0 2024-04-13T10:59:22.747 INFO:tasks.workunit.client.0.smithi134.stdout:9/886: fsync d13/d40/f6c 0 2024-04-13T10:59:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:22 smithi194 ceph-mon[46737]: pgmap v45: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 105 MiB/s wr, 257 op/s 2024-04-13T10:59:22.748 INFO:tasks.workunit.client.0.smithi134.stdout:2/639: fsync d5/de/d12/f6a 0 2024-04-13T10:59:22.755 INFO:tasks.workunit.client.0.smithi134.stdout:6/858: creat d4/da/dbb/dca/f11f x:0 0 0 2024-04-13T10:59:22.756 INFO:tasks.workunit.client.0.smithi134.stdout:1/903: dwrite d3/d6/d16/d1d/d110/f118 [0,4194304] 0 2024-04-13T10:59:22.758 INFO:tasks.workunit.client.0.smithi134.stdout:2/640: chown d5/d6/d57/d6f/d30/d58/f9d 1873940 1 2024-04-13T10:59:22.760 INFO:tasks.workunit.client.0.smithi134.stdout:1/904: fsync d3/d6/d20/f7b 0 2024-04-13T10:59:22.763 INFO:tasks.workunit.client.0.smithi134.stdout:7/728: dwrite da/d15/d26/d38/f8c [0,4194304] 0 2024-04-13T10:59:22.764 INFO:tasks.workunit.client.0.smithi134.stdout:8/859: dwrite d8/dc/f7b [0,4194304] 0 2024-04-13T10:59:22.766 INFO:tasks.workunit.client.0.smithi134.stdout:7/729: chown da/d15/d26/d27/d4f/d5f/lce 5212027 1 2024-04-13T10:59:22.767 INFO:tasks.workunit.client.0.smithi134.stdout:4/656: write d4/f7a [1226434,74034] 0 2024-04-13T10:59:22.767 INFO:tasks.workunit.client.0.smithi134.stdout:0/731: creat d4/d17/da/d22/d41/d6e/d8a/d95/db9/f109 x:0 0 0 2024-04-13T10:59:22.768 INFO:tasks.workunit.client.0.smithi134.stdout:8/860: chown d8/f107 43773 1 2024-04-13T10:59:22.775 INFO:tasks.workunit.client.0.smithi134.stdout:4/657: chown d4/d48/d4a/d7e/f9a 39 1 2024-04-13T10:59:22.775 INFO:tasks.workunit.client.0.smithi134.stdout:8/861: dread - d8/dc/d2c/d68/d8c/d8f/f105 zero size 2024-04-13T10:59:22.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.775+0000 7f969c665700 1 -- 172.21.15.134:0/1161468454 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9694105ca0 con 0x7f968006ce10 2024-04-13T10:59:22.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.778+0000 7f968b7fe700 1 -- 172.21.15.134:0/1161468454 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f9694105ca0 con 0x7f968006ce10 2024-04-13T10:59:22.779 INFO:tasks.workunit.client.0.smithi134.stdout:2/641: dread - d5/d6/f8b zero size 2024-04-13T10:59:22.781 INFO:tasks.workunit.client.0.smithi134.stdout:6/859: rmdir d4/da/d15/d76/dda 39 2024-04-13T10:59:22.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.782+0000 7f969c665700 1 -- 172.21.15.134:0/1161468454 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f968006ce10 msgr2=0x7f968006f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:22.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.782+0000 7f969c665700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f968006ce10 0x7f968006f2c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9684005fd0 tx=0x7f9684009310 comp rx=0 tx=0).stop 2024-04-13T10:59:22.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.782+0000 7f969c665700 1 -- 172.21.15.134:0/1161468454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9694100150 msgr2=0x7f9694074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:22.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.782+0000 7f969c665700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9694100150 0x7f9694074af0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f969000b5b0 tx=0x7f969000f460 comp rx=0 tx=0).stop 2024-04-13T10:59:22.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.782+0000 7f969c665700 1 -- 172.21.15.134:0/1161468454 shutdown_connections 2024-04-13T10:59:22.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.782+0000 7f969c665700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f968006ce10 0x7f968006f2c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.782+0000 7f969c665700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9694100150 0x7f9694074af0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.782+0000 7f969c665700 1 --2- 172.21.15.134:0/1161468454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9694101350 0x7f9694073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.782+0000 7f969c665700 1 -- 172.21.15.134:0/1161468454 >> 172.21.15.134:0/1161468454 conn(0x7f96940fb6e0 msgr2=0x7f9694104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:22.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.783+0000 7f969c665700 1 -- 172.21.15.134:0/1161468454 shutdown_connections 2024-04-13T10:59:22.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.783+0000 7f969c665700 1 -- 172.21.15.134:0/1161468454 wait complete. 2024-04-13T10:59:22.784 INFO:tasks.workunit.client.0.smithi134.stdout:7/730: dread da/f11 [0,4194304] 0 2024-04-13T10:59:22.788 INFO:tasks.workunit.client.0.smithi134.stdout:5/987: dread dc/d15/df8/d115/f12c [0,4194304] 0 2024-04-13T10:59:22.788 INFO:tasks.workunit.client.0.smithi134.stdout:1/905: mkdir d3/d6/de3/d124 0 2024-04-13T10:59:22.788 INFO:tasks.workunit.client.0.smithi134.stdout:2/642: write d5/d6/d57/d6f/d30/d58/d59/f7e [1227086,72118] 0 2024-04-13T10:59:22.788 INFO:tasks.workunit.client.0.smithi134.stdout:9/887: creat d13/d39/d13a/f13f x:0 0 0 2024-04-13T10:59:22.789 INFO:tasks.workunit.client.0.smithi134.stdout:0/732: rmdir d4/d17/d23/d51/d6b/d91/d98 39 2024-04-13T10:59:22.792 INFO:tasks.workunit.client.0.smithi134.stdout:8/862: dwrite d8/dc/d9d/d69/d120/f106 [0,4194304] 0 2024-04-13T10:59:22.794 INFO:tasks.workunit.client.0.smithi134.stdout:6/860: unlink d4/da/d15/d76/f9b 0 2024-04-13T10:59:22.802 INFO:tasks.workunit.client.0.smithi134.stdout:2/643: creat d5/de/d50/fbc x:0 0 0 2024-04-13T10:59:22.803 INFO:tasks.workunit.client.0.smithi134.stdout:8/863: truncate d8/dc/d16/d54/d6c/d94/dc1/f10c 370407 0 2024-04-13T10:59:22.803 INFO:tasks.workunit.client.0.smithi134.stdout:9/888: creat d13/d39/d52/d86/d9f/f140 x:0 0 0 2024-04-13T10:59:22.805 INFO:tasks.workunit.client.0.smithi134.stdout:7/731: rename da/d15/d26/d27/d4f/d5f/d67/d76/l97 to da/d15/d26/d27/d4f/dd3/ld6 0 2024-04-13T10:59:22.809 INFO:tasks.workunit.client.0.smithi134.stdout:4/658: write d4/d1f/d27/d75/f68 [870849,110498] 0 2024-04-13T10:59:22.809 INFO:tasks.workunit.client.0.smithi134.stdout:3/688: dwrite dc/f71 [0,4194304] 0 2024-04-13T10:59:22.810 INFO:tasks.workunit.client.0.smithi134.stdout:2/644: write d5/de/d12/f1d [2619245,117129] 0 2024-04-13T10:59:22.811 INFO:tasks.workunit.client.0.smithi134.stdout:8/864: mknod d8/dc/d16/d54/d6c/d7d/c123 0 2024-04-13T10:59:22.816 INFO:tasks.workunit.client.0.smithi134.stdout:5/988: write dc/d15/df1/d3b/f120 [17252,94609] 0 2024-04-13T10:59:22.823 INFO:tasks.workunit.client.0.smithi134.stdout:0/733: dwrite d4/d17/d20/d29/d30/d64/d84/dd3/ffa [0,4194304] 0 2024-04-13T10:59:22.828 INFO:tasks.workunit.client.0.smithi134.stdout:2/645: rmdir d5/d6/d70/d9c 39 2024-04-13T10:59:22.833 INFO:tasks.workunit.client.0.smithi134.stdout:6/861: dwrite d4/da/d15/d1f/d24/d2b/f3f [4194304,4194304] 0 2024-04-13T10:59:22.833 INFO:tasks.workunit.client.0.smithi134.stdout:7/732: fdatasync da/d15/d26/d27/d3d/d9c/fa6 0 2024-04-13T10:59:22.839 INFO:tasks.workunit.client.0.smithi134.stdout:0/734: creat d4/d17/d23/d51/d6a/d73/f10a x:0 0 0 2024-04-13T10:59:22.842 INFO:tasks.workunit.client.0.smithi134.stdout:4/659: dread d4/d48/d50/fc2 [0,4194304] 0 2024-04-13T10:59:22.842 INFO:tasks.workunit.client.0.smithi134.stdout:8/865: write d8/dc/d16/d54/d6c/d94/dc1/f10c [688590,80074] 0 2024-04-13T10:59:22.843 INFO:tasks.workunit.client.0.smithi134.stdout:2/646: chown d5/d6/df 308 1 2024-04-13T10:59:22.843 INFO:tasks.workunit.client.0.smithi134.stdout:9/889: write d13/d39/d58/d5f/dbb/fb9 [831440,60106] 0 2024-04-13T10:59:22.846 INFO:tasks.workunit.client.0.smithi134.stdout:1/906: link d3/d6/d20/d6d/db1/cf4 d3/d6/d20/d9f/c125 0 2024-04-13T10:59:22.846 INFO:tasks.workunit.client.0.smithi134.stdout:7/733: mkdir da/d15/d26/d27/d3d/d46/d95/dd7 0 2024-04-13T10:59:22.846 INFO:tasks.workunit.client.0.smithi134.stdout:6/862: truncate d4/da/d1a/fcf 408248 0 2024-04-13T10:59:22.850 INFO:tasks.workunit.client.0.smithi134.stdout:5/989: mkdir dc/d1d/d2b/d30/d100/d10e/d132/d23/d36/dbd/d13d 0 2024-04-13T10:59:22.855 INFO:tasks.workunit.client.0.smithi134.stdout:1/907: creat d3/d6/d16/d1d/d3c/f126 x:0 0 0 2024-04-13T10:59:22.857 INFO:tasks.workunit.client.0.smithi134.stdout:9/890: mknod d13/d2e/d35/d50/c141 0 2024-04-13T10:59:22.858 INFO:tasks.workunit.client.0.smithi134.stdout:3/689: dread dc/d27/d4d/f5e [0,4194304] 0 2024-04-13T10:59:22.859 INFO:tasks.workunit.client.0.smithi134.stdout:9/891: chown d13/d39/d58/dd5/de5/l10f 18593 1 2024-04-13T10:59:22.860 INFO:tasks.workunit.client.0.smithi134.stdout:9/892: chown d13/da3/d134 44736026 1 2024-04-13T10:59:22.862 INFO:tasks.workunit.client.0.smithi134.stdout:0/735: write d4/d17/d23/f2f [4589850,3205] 0 2024-04-13T10:59:22.864 INFO:tasks.workunit.client.0.smithi134.stdout:8/866: mknod d8/dc/d16/d54/c124 0 2024-04-13T10:59:22.870 INFO:tasks.workunit.client.0.smithi134.stdout:1/908: rmdir d3/d6/d16/d4d 39 2024-04-13T10:59:22.872 INFO:tasks.workunit.client.0.smithi134.stdout:4/660: dwrite d4/d1f/d90/fa2 [0,4194304] 0 2024-04-13T10:59:22.873 INFO:tasks.workunit.client.0.smithi134.stdout:2/647: dwrite d5/d6/d57/d6c/f4d [0,4194304] 0 2024-04-13T10:59:22.876 INFO:tasks.workunit.client.0.smithi134.stdout:4/661: read d4/f2a [2887970,92736] 0 2024-04-13T10:59:22.878 INFO:tasks.workunit.client.0.smithi134.stdout:6/863: dread d4/da/d15/d1f/d3c/f5e [0,4194304] 0 2024-04-13T10:59:22.884 INFO:tasks.workunit.client.0.smithi134.stdout:3/690: creat dc/d27/d19/d48/d8e/fe4 x:0 0 0 2024-04-13T10:59:22.887 INFO:tasks.workunit.client.0.smithi134.stdout:5/990: rename dc/d1d/d2b/d30/d100/d10e/d132/d23/d36/l3f to dc/d15/df1/d3b/d7f/l13e 0 2024-04-13T10:59:22.889 INFO:tasks.workunit.client.0.smithi134.stdout:9/893: unlink d13/d39/d64/db2/dd6/fe0 0 2024-04-13T10:59:22.889 INFO:tasks.workunit.client.0.smithi134.stdout:4/662: dwrite d4/d1f/d27/d2e/d84/fb7 [0,4194304] 0 2024-04-13T10:59:22.892 INFO:tasks.workunit.client.0.smithi134.stdout:7/734: truncate da/d15/d26/f28 1180909 0 2024-04-13T10:59:22.894 INFO:tasks.workunit.client.0.smithi134.stdout:7/735: readlink da/d15/d26/d27/d4f/lb7 0 2024-04-13T10:59:22.895 INFO:tasks.workunit.client.0.smithi134.stdout:8/867: rmdir d8/dc/d16/d74 39 2024-04-13T10:59:22.897 INFO:tasks.workunit.client.0.smithi134.stdout:2/648: symlink d5/d6/d70/d84/lbd 0 2024-04-13T10:59:22.899 INFO:tasks.workunit.client.0.smithi134.stdout:2/649: write d5/d6/d57/d6f/d30/d88/d96/fb1 [256616,121469] 0 2024-04-13T10:59:22.901 INFO:tasks.workunit.client.0.smithi134.stdout:2/650: fdatasync d5/de/d12/f1d 0 2024-04-13T10:59:22.905 INFO:tasks.workunit.client.0.smithi134.stdout:5/991: mknod dc/d39/dec/c13f 0 2024-04-13T10:59:22.910 INFO:tasks.workunit.client.0.smithi134.stdout:0/736: truncate d4/d17/d23/d51/d6a/d94/db2/f63 974933 0 2024-04-13T10:59:22.912 INFO:tasks.workunit.client.0.smithi134.stdout:0/737: fdatasync d4/d17/d20/da9/de1/dfc/ff1 0 2024-04-13T10:59:22.913 INFO:tasks.workunit.client.0.smithi134.stdout:6/864: write d4/da/dbb/dc3/fae [1376619,117098] 0 2024-04-13T10:59:22.922 INFO:tasks.workunit.client.0.smithi134.stdout:6/865: dread d4/da/d15/d1f/d24/d49/f50 [0,4194304] 0 2024-04-13T10:59:22.923 INFO:tasks.workunit.client.0.smithi134.stdout:9/894: getdents d13/d40/d7d/d118 0 2024-04-13T10:59:22.923 INFO:tasks.workunit.client.0.smithi134.stdout:4/663: link d4/d1f/d27/d2e/d84/fb7 d4/d1f/d27/d75/d38/fd8 0 2024-04-13T10:59:22.925 INFO:tasks.workunit.client.0.smithi134.stdout:7/736: link f4 da/d15/d26/d27/d3d/d9c/d5a/fd8 0 2024-04-13T10:59:22.925 INFO:tasks.workunit.client.0.smithi134.stdout:4/664: write d4/d1f/d27/d75/f31 [1800235,127265] 0 2024-04-13T10:59:22.927 INFO:tasks.workunit.client.0.smithi134.stdout:4/665: readlink d4/dd/l30 0 2024-04-13T10:59:22.929 INFO:tasks.workunit.client.0.smithi134.stdout:4/666: write d4/d1f/d27/d75/d38/f41 [231890,60384] 0 2024-04-13T10:59:22.929 INFO:tasks.workunit.client.0.smithi134.stdout:2/651: write d5/de/d12/f43 [71689,57743] 0 2024-04-13T10:59:22.931 INFO:tasks.workunit.client.0.smithi134.stdout:2/652: write d5/d6/d57/d6c/f49 [3109527,18538] 0 2024-04-13T10:59:22.932 INFO:tasks.workunit.client.0.smithi134.stdout:5/992: write f9 [1535671,69749] 0 2024-04-13T10:59:22.935 INFO:tasks.workunit.client.0.smithi134.stdout:1/909: rename d3/f108 to d3/d6/d16/f127 0 2024-04-13T10:59:22.943 INFO:tasks.workunit.client.0.smithi134.stdout:9/895: creat d13/d39/d58/d5f/dac/d11a/d133/f142 x:0 0 0 2024-04-13T10:59:22.947 INFO:tasks.workunit.client.0.smithi134.stdout:7/737: unlink da/d15/d26/d27/d3d/d46/c64 0 2024-04-13T10:59:22.948 INFO:tasks.workunit.client.0.smithi134.stdout:8/868: link d8/lcf d8/dc/d2c/d68/dae/l125 0 2024-04-13T10:59:22.950 INFO:tasks.workunit.client.0.smithi134.stdout:4/667: symlink d4/d1f/d27/d3a/d65/dce/ld9 0 2024-04-13T10:59:22.951 INFO:tasks.workunit.client.0.smithi134.stdout:4/668: dread - d4/d48/d50/da0/fcc zero size 2024-04-13T10:59:22.954 INFO:tasks.workunit.client.0.smithi134.stdout:2/653: creat d5/d6/d57/d6f/fbe x:0 0 0 2024-04-13T10:59:22.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.956+0000 7f64e8a82700 1 -- 172.21.15.134:0/871880874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64e41067a0 msgr2=0x7f64e4106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:22.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.956+0000 7f64e8a82700 1 --2- 172.21.15.134:0/871880874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64e41067a0 0x7f64e4106bb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009910 tx=0x7f64d4009c20 comp rx=0 tx=0).stop 2024-04-13T10:59:22.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.956+0000 7f64e8a82700 1 -- 172.21.15.134:0/871880874 shutdown_connections 2024-04-13T10:59:22.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.956+0000 7f64e8a82700 1 --2- 172.21.15.134:0/871880874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e41079a0 0x7f64e4107df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.956+0000 7f64e8a82700 1 --2- 172.21.15.134:0/871880874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64e41067a0 0x7f64e4106bb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.956+0000 7f64e8a82700 1 -- 172.21.15.134:0/871880874 >> 172.21.15.134:0/871880874 conn(0x7f64e4075910 msgr2=0x7f64e4077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:22.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.957+0000 7f64e8a82700 1 -- 172.21.15.134:0/871880874 shutdown_connections 2024-04-13T10:59:22.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.957+0000 7f64e8a82700 1 -- 172.21.15.134:0/871880874 wait complete. 2024-04-13T10:59:22.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.958+0000 7f64e8a82700 1 Processor -- start 2024-04-13T10:59:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.958+0000 7f64e8a82700 1 -- start start 2024-04-13T10:59:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.958+0000 7f64e8a82700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e41067a0 0x7f64e41936a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.958+0000 7f64e8a82700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64e41079a0 0x7f64e4193be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.958+0000 7f64e8a82700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e4194200 con 0x7f64e41079a0 2024-04-13T10:59:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.958+0000 7f64e8a82700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e4194340 con 0x7f64e41067a0 2024-04-13T10:59:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.958+0000 7f64e1d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64e41079a0 0x7f64e4193be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.958+0000 7f64e1d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64e41079a0 0x7f64e4193be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47166/0 (socket says 172.21.15.134:47166) 2024-04-13T10:59:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.958+0000 7f64e1d9b700 1 -- 172.21.15.134:0/2059118671 learned_addr learned my addr 172.21.15.134:0/2059118671 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:59:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.958+0000 7f64e259c700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e41067a0 0x7f64e41936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:22.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.959+0000 7f64e1d9b700 1 -- 172.21.15.134:0/2059118671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e41067a0 msgr2=0x7f64e41936a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:22.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.959+0000 7f64e1d9b700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e41067a0 0x7f64e41936a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:22.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.959+0000 7f64e1d9b700 1 -- 172.21.15.134:0/2059118671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d40095f0 con 0x7f64e41079a0 2024-04-13T10:59:22.960 INFO:tasks.workunit.client.0.smithi134.stdout:7/738: mkdir da/d15/d26/d27/d4f/d5f/d88/dd9 0 2024-04-13T10:59:22.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.959+0000 7f64e1d9b700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64e41079a0 0x7f64e4193be0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f64d800c8a0 tx=0x7f64d800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:22.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.960+0000 7f64d37fe700 1 -- 172.21.15.134:0/2059118671 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64d80078e0 con 0x7f64e41079a0 2024-04-13T10:59:22.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.960+0000 7f64d37fe700 1 -- 172.21.15.134:0/2059118671 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f64d800f450 con 0x7f64e41079a0 2024-04-13T10:59:22.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.960+0000 7f64e8a82700 1 -- 172.21.15.134:0/2059118671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e4079740 con 0x7f64e41079a0 2024-04-13T10:59:22.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.960+0000 7f64d37fe700 1 -- 172.21.15.134:0/2059118671 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64d800e5e0 con 0x7f64e41079a0 2024-04-13T10:59:22.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.960+0000 7f64e8a82700 1 -- 172.21.15.134:0/2059118671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e4079d10 con 0x7f64e41079a0 2024-04-13T10:59:22.962 INFO:tasks.workunit.client.0.smithi134.stdout:4/669: creat d4/d1f/d27/d3a/d65/dce/fda x:0 0 0 2024-04-13T10:59:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.962+0000 7f64e8a82700 1 -- 172.21.15.134:0/2059118671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e4072640 con 0x7f64e41079a0 2024-04-13T10:59:22.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.962+0000 7f64d37fe700 1 -- 172.21.15.134:0/2059118671 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f64d800f5c0 con 0x7f64e41079a0 2024-04-13T10:59:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.963+0000 7f64d37fe700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f64cc06ce10 0x7f64cc06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.963+0000 7f64d37fe700 1 -- 172.21.15.134:0/2059118671 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f64d808c5e0 con 0x7f64e41079a0 2024-04-13T10:59:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.963+0000 7f64e259c700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f64cc06ce10 0x7f64cc06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:22.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.964+0000 7f64e259c700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f64cc06ce10 0x7f64cc06f2c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009fd0 tx=0x7f64d402c040 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:22.967 INFO:tasks.workunit.client.0.smithi134.stdout:2/654: mknod d5/d6/d57/d6f/d30/d58/d59/cbf 0 2024-04-13T10:59:22.967 INFO:tasks.workunit.client.0.smithi134.stdout:4/670: write d4/d1f/d27/d3a/f6a [4806122,5165] 0 2024-04-13T10:59:22.968 INFO:tasks.workunit.client.0.smithi134.stdout:4/671: stat d4/c34 0 2024-04-13T10:59:22.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:22.970+0000 7f64d37fe700 1 -- 172.21.15.134:0/2059118671 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f64d805a0a0 con 0x7f64e41079a0 2024-04-13T10:59:22.976 INFO:tasks.workunit.client.0.smithi134.stdout:2/655: write d5/d6/d34/f9e [714401,78714] 0 2024-04-13T10:59:22.976 INFO:tasks.workunit.client.0.smithi134.stdout:8/869: unlink d8/cdc 0 2024-04-13T10:59:22.982 INFO:tasks.workunit.client.0.smithi134.stdout:7/739: dwrite da/f11 [0,4194304] 0 2024-04-13T10:59:22.986 INFO:tasks.workunit.client.0.smithi134.stdout:3/691: rename dc/d27/d19/d8b/da8/d50/d25/f74 to dc/d27/d4d/fe5 0 2024-04-13T10:59:22.987 INFO:tasks.workunit.client.0.smithi134.stdout:0/738: rename d4/d17/d23 to d4/d17/d23/d10b 22 2024-04-13T10:59:22.991 INFO:tasks.workunit.client.0.smithi134.stdout:4/672: write d4/d1f/d27/d75/d38/d79/d73/fc6 [3746241,51576] 0 2024-04-13T10:59:22.996 INFO:tasks.workunit.client.0.smithi134.stdout:2/656: mkdir d5/d6/d34/dc0 0 2024-04-13T10:59:22.997 INFO:tasks.workunit.client.0.smithi134.stdout:8/870: fdatasync d8/dc/d37/d3f/f89 0 2024-04-13T10:59:23.005 INFO:tasks.workunit.client.0.smithi134.stdout:1/910: truncate d3/d6/d20/f24 3020625 0 2024-04-13T10:59:23.008 INFO:tasks.workunit.client.0.smithi134.stdout:0/739: fsync d4/fa4 0 2024-04-13T10:59:23.008 INFO:tasks.workunit.client.0.smithi134.stdout:2/657: dwrite d5/de/d12/f43 [0,4194304] 0 2024-04-13T10:59:23.012 INFO:tasks.workunit.client.0.smithi134.stdout:3/692: chown dc/d2a/l3a 773868582 1 2024-04-13T10:59:23.015 INFO:tasks.workunit.client.0.smithi134.stdout:4/673: mkdir d4/d1f/d27/d2e/d84/ddb 0 2024-04-13T10:59:23.016 INFO:tasks.workunit.client.0.smithi134.stdout:9/896: getdents d13/d2e/d35/d50 0 2024-04-13T10:59:23.022 INFO:tasks.workunit.client.0.smithi134.stdout:8/871: dread d8/dc/fbc [0,4194304] 0 2024-04-13T10:59:23.022 INFO:tasks.workunit.client.0.smithi134.stdout:6/866: rename d4/da/d15/d76/d8e/da1 to d4/da/d1a/de6/d120 0 2024-04-13T10:59:23.030 INFO:tasks.workunit.client.0.smithi134.stdout:3/693: write dc/d1d/d58/f60 [797220,28663] 0 2024-04-13T10:59:23.031 INFO:tasks.workunit.client.0.smithi134.stdout:9/897: symlink d13/d39/d13a/l143 0 2024-04-13T10:59:23.037 INFO:tasks.workunit.client.0.smithi134.stdout:8/872: symlink d8/dc/d16/d54/d6c/d94/de7/l126 0 2024-04-13T10:59:23.044 INFO:tasks.workunit.client.0.smithi134.stdout:1/911: dread d3/d6/d16/d4d/d65/f82 [0,4194304] 0 2024-04-13T10:59:23.048 INFO:tasks.workunit.client.0.smithi134.stdout:6/867: dwrite d4/da/d15/d1f/d3c/fcd [0,4194304] 0 2024-04-13T10:59:23.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/658: truncate d5/de/d2e/d8f/fa5 134596 0 2024-04-13T10:59:23.052 INFO:tasks.workunit.client.0.smithi134.stdout:9/898: truncate d13/d39/d58/d5f/dbb/fcd 849032 0 2024-04-13T10:59:23.053 INFO:tasks.workunit.client.0.smithi134.stdout:4/674: truncate d4/d1f/d27/d75/d38/d79/f8b 3674332 0 2024-04-13T10:59:23.054 INFO:tasks.workunit.client.0.smithi134.stdout:4/675: write d4/d1f/d27/d3a/f6a [3736421,119681] 0 2024-04-13T10:59:23.062 INFO:tasks.workunit.client.0.smithi134.stdout:4/676: truncate d4/d82/fb4 777661 0 2024-04-13T10:59:23.062 INFO:tasks.workunit.client.0.smithi134.stdout:4/677: truncate d4/d48/d50/da0/fad 851224 0 2024-04-13T10:59:23.062 INFO:tasks.workunit.client.0.smithi134.stdout:8/873: creat d8/dc/d9d/d69/f127 x:0 0 0 2024-04-13T10:59:23.062 INFO:tasks.workunit.client.0.smithi134.stdout:3/694: symlink dc/le6 0 2024-04-13T10:59:23.063 INFO:tasks.workunit.client.0.smithi134.stdout:1/912: mknod d3/d6/d20/d71/d9c/dcb/c128 0 2024-04-13T10:59:23.064 INFO:tasks.workunit.client.0.smithi134.stdout:9/899: creat d13/da3/f144 x:0 0 0 2024-04-13T10:59:23.065 INFO:tasks.workunit.client.0.smithi134.stdout:7/740: rename da/d15/d26/d27/d4f/d5f/l7c to da/d15/d26/d27/d3d/d46/lda 0 2024-04-13T10:59:23.125 INFO:tasks.workunit.client.0.smithi134.stdout:1/913: write d3/d6/d20/d71/d9c/f119 [175916,73163] 0 2024-04-13T10:59:23.129 INFO:tasks.workunit.client.0.smithi134.stdout:8/874: fdatasync d8/dc/d2c/d68/fe4 0 2024-04-13T10:59:23.134 INFO:tasks.workunit.client.0.smithi134.stdout:8/875: chown d8/dc/d2c/d68/f61 39066725 1 2024-04-13T10:59:23.137 INFO:tasks.workunit.client.0.smithi134.stdout:9/900: write d13/d2e/d47/d113/f11e [42210,111739] 0 2024-04-13T10:59:23.139 INFO:tasks.workunit.client.0.smithi134.stdout:7/741: creat da/d15/d85/fdb x:0 0 0 2024-04-13T10:59:23.140 INFO:tasks.workunit.client.0.smithi134.stdout:0/740: link d4/d17/d23/d51/d6b/d91/d98/d92/dca/fce d4/d17/da/d22/d41/d6e/d8a/d95/f10c 0 2024-04-13T10:59:23.140 INFO:tasks.workunit.client.0.smithi134.stdout:3/695: dwrite dc/d27/d19/d8b/da8/d50/d25/d91/d93/fdd [0,4194304] 0 2024-04-13T10:59:23.141 INFO:tasks.workunit.client.0.smithi134.stdout:2/659: dread d5/de/d2e/d8f/f6e [0,4194304] 0 2024-04-13T10:59:23.144 INFO:tasks.workunit.client.0.smithi134.stdout:4/678: getdents d4/d48 0 2024-04-13T10:59:23.145 INFO:tasks.workunit.client.0.smithi134.stdout:1/914: dwrite d3/d6/de3/ff3 [0,4194304] 0 2024-04-13T10:59:23.145 INFO:tasks.workunit.client.0.smithi134.stdout:9/901: mknod d13/d2e/d35/c145 0 2024-04-13T10:59:23.147 INFO:tasks.workunit.client.0.smithi134.stdout:6/868: dwrite d4/da/d15/f8a [0,4194304] 0 2024-04-13T10:59:23.153 INFO:tasks.workunit.client.0.smithi134.stdout:8/876: creat d8/dc/d9d/d69/d120/f128 x:0 0 0 2024-04-13T10:59:23.154 INFO:tasks.workunit.client.0.smithi134.stdout:3/696: mkdir dc/d1d/d58/de7 0 2024-04-13T10:59:23.156 INFO:tasks.workunit.client.0.smithi134.stdout:4/679: mkdir d4/d1f/d27/d3a/d65/dce/ddc 0 2024-04-13T10:59:23.184 INFO:tasks.workunit.client.0.smithi134.stdout:6/869: dread d4/da/d15/d1f/d24/da4/fb2 [0,4194304] 0 2024-04-13T10:59:23.185 INFO:tasks.workunit.client.0.smithi134.stdout:6/870: chown d4/da/d15/d1f/d24/db9/cbe 6303 1 2024-04-13T10:59:23.253 INFO:tasks.workunit.client.0.smithi134.stdout:9/902: rename d13/c1c to d13/d39/d58/d5f/dac/d11a/d133/d139/c146 0 2024-04-13T10:59:23.253 INFO:tasks.workunit.client.0.smithi134.stdout:1/915: rename d3/d6/d16/d1d/d3c to d3/d6/d16/d1d/d3c/d129 22 2024-04-13T10:59:23.259 INFO:tasks.workunit.client.0.smithi134.stdout:2/660: mknod d5/d6/d57/d6f/d30/d88/d94/cc1 0 2024-04-13T10:59:23.260 INFO:tasks.workunit.client.0.smithi134.stdout:2/661: stat d5/d6/d57/d6c/d29/l8a 0 2024-04-13T10:59:23.262 INFO:tasks.workunit.client.0.smithi134.stdout:3/697: creat dc/d27/d19/d8b/da8/fe8 x:0 0 0 2024-04-13T10:59:23.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.264+0000 7f64e8a82700 1 -- 172.21.15.134:0/2059118671 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64e4061190 con 0x7f64cc06ce10 2024-04-13T10:59:23.271 INFO:tasks.workunit.client.0.smithi134.stdout:9/903: rmdir d13/d39/d58/dd5/de5/d10a 39 2024-04-13T10:59:23.273 INFO:tasks.workunit.client.0.smithi134.stdout:1/916: truncate d3/d6/d16/f36 705853 0 2024-04-13T10:59:23.274 INFO:tasks.workunit.client.0.smithi134.stdout:1/917: fsync d3/d6/d20/d71/d9c/f119 0 2024-04-13T10:59:23.275 INFO:tasks.workunit.client.0.smithi134.stdout:7/742: link da/d15/d26/fb4 da/d15/d26/d27/d3d/d46/dbf/fdc 0 2024-04-13T10:59:23.275 INFO:tasks.workunit.client.0.smithi134.stdout:1/918: fsync d3/d6/d20/f100 0 2024-04-13T10:59:23.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.276+0000 7f64d37fe700 1 -- 172.21.15.134:0/2059118671 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f64e4061190 con 0x7f64cc06ce10 2024-04-13T10:59:23.276 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T10:59:23.276 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (8m) 75s ago 9m 24.8M - 0.25.0 c8568f914cd2 8d2cf34cad2a 2024-04-13T10:59:23.276 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (9m) 75s ago 9m 7734k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T10:59:23.276 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (8m) 79s ago 8m 7356k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (9m) 75s ago 9m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (8m) 79s ago 8m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (7m) 75s ago 9m 87.2M - 9.4.7 954c08fa6188 1038718f4fd4 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (3m) 75s ago 3m 98.9M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (3m) 75s ago 3m 123M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (3m) 79s ago 3m 13.0M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (3m) 79s ago 3m 16.8M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 starting - - - - 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (96s) 79s ago 8m 480M - 18.2.2-1173-g5108bc67 3464fd31103e 870bcc3bd872 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (11m) 75s ago 11m 48.8M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (8m) 79s ago 8m 40.5M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (9m) 75s ago 9m 15.5M - 1.5.0 0da6a335fe13 da23f14cbdef 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (8m) 79s ago 8m 18.2M - 1.5.0 0da6a335fe13 242da19a461b 2024-04-13T10:59:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (7m) 75s ago 7m 71.9M 1227M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T10:59:23.278 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (7m) 75s ago 7m 70.6M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T10:59:23.278 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (6m) 75s ago 6m 66.4M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T10:59:23.278 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (6m) 79s ago 6m 73.6M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T10:59:23.278 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (5m) 79s ago 5m 68.9M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T10:59:23.278 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (5m) 79s ago 5m 71.7M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T10:59:23.278 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 starting - - - - 2024-04-13T10:59:23.278 INFO:tasks.workunit.client.0.smithi134.stdout:3/698: mkdir dc/d27/d19/d8b/da8/d50/d25/d91/de9 0 2024-04-13T10:59:23.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/871: write d4/da/d15/d1f/d24/d49/d91/fb0 [1016593,107304] 0 2024-04-13T10:59:23.279 INFO:tasks.workunit.client.0.smithi134.stdout:1/919: dread - d3/d6/d20/d71/d9c/dcb/ff9 zero size 2024-04-13T10:59:23.280 INFO:tasks.workunit.client.0.smithi134.stdout:0/741: rename d4/d17/d23/d51/d6a/l7e to d4/d17/d23/d51/d6b/d91/d98/d62/l10d 0 2024-04-13T10:59:23.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.281+0000 7f64e8a82700 1 -- 172.21.15.134:0/2059118671 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f64cc06ce10 msgr2=0x7f64cc06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:23.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.281+0000 7f64e8a82700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f64cc06ce10 0x7f64cc06f2c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009fd0 tx=0x7f64d402c040 comp rx=0 tx=0).stop 2024-04-13T10:59:23.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.281+0000 7f64e8a82700 1 -- 172.21.15.134:0/2059118671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64e41079a0 msgr2=0x7f64e4193be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:23.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.281+0000 7f64e8a82700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64e41079a0 0x7f64e4193be0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f64d800c8a0 tx=0x7f64d800cbb0 comp rx=0 tx=0).stop 2024-04-13T10:59:23.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.281+0000 7f64e8a82700 1 -- 172.21.15.134:0/2059118671 shutdown_connections 2024-04-13T10:59:23.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.281+0000 7f64e8a82700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f64cc06ce10 0x7f64cc06f2c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:23.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.281+0000 7f64e8a82700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64e41067a0 0x7f64e41936a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:23.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.281+0000 7f64e8a82700 1 --2- 172.21.15.134:0/2059118671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64e41079a0 0x7f64e4193be0 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f64d800c8a0 tx=0x7f64d800cbb0 comp rx=0 tx=0).stop 2024-04-13T10:59:23.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.281+0000 7f64e8a82700 1 -- 172.21.15.134:0/2059118671 >> 172.21.15.134:0/2059118671 conn(0x7f64e4075910 msgr2=0x7f64e406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:23.282 INFO:tasks.workunit.client.0.smithi134.stdout:6/872: dread - d4/da/d15/d1f/f108 zero size 2024-04-13T10:59:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.283+0000 7f64e8a82700 1 -- 172.21.15.134:0/2059118671 shutdown_connections 2024-04-13T10:59:23.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.283+0000 7f64e8a82700 1 -- 172.21.15.134:0/2059118671 wait complete. 2024-04-13T10:59:23.284 INFO:tasks.workunit.client.0.smithi134.stdout:1/920: write d3/d6/fc3 [798797,72281] 0 2024-04-13T10:59:23.284 INFO:tasks.workunit.client.0.smithi134.stdout:8/877: dwrite d8/dc/f45 [0,4194304] 0 2024-04-13T10:59:23.292 INFO:tasks.workunit.client.0.smithi134.stdout:3/699: dwrite dc/d27/d19/d8b/da8/d50/d25/d91/fdc [0,4194304] 0 2024-04-13T10:59:23.298 INFO:tasks.workunit.client.0.smithi134.stdout:6/873: mkdir d4/da/d15/d77/d63/d121 0 2024-04-13T10:59:23.301 INFO:tasks.workunit.client.0.smithi134.stdout:9/904: creat d13/d39/d58/dd5/de5/f147 x:0 0 0 2024-04-13T10:59:23.304 INFO:tasks.workunit.client.0.smithi134.stdout:1/921: rmdir d3/d6/de3 39 2024-04-13T10:59:23.306 INFO:tasks.workunit.client.0.smithi134.stdout:1/922: dread - d3/d6/d16/dff/f101 zero size 2024-04-13T10:59:23.307 INFO:tasks.workunit.client.0.smithi134.stdout:8/878: fdatasync d8/dc/d16/f2d 0 2024-04-13T10:59:23.307 INFO:tasks.workunit.client.0.smithi134.stdout:9/905: read d13/d39/d52/fb6 [773635,71257] 0 2024-04-13T10:59:23.309 INFO:tasks.workunit.client.0.smithi134.stdout:6/874: dwrite d4/da/d15/d1f/d24/d49/d91/fb0 [0,4194304] 0 2024-04-13T10:59:23.309 INFO:tasks.workunit.client.0.smithi134.stdout:3/700: fsync dc/d27/d19/d8b/d9b/f6b 0 2024-04-13T10:59:23.317 INFO:tasks.workunit.client.0.smithi134.stdout:9/906: write d13/d2e/d35/d50/d59/fc3 [1294111,55598] 0 2024-04-13T10:59:23.317 INFO:tasks.workunit.client.0.smithi134.stdout:4/680: rename d4/d1f/d56/l9f to d4/d1f/d27/d75/ldd 0 2024-04-13T10:59:23.319 INFO:tasks.workunit.client.0.smithi134.stdout:1/923: dwrite d3/d6/d20/d71/d9c/dcb/ff9 [0,4194304] 0 2024-04-13T10:59:23.320 INFO:tasks.workunit.client.0.smithi134.stdout:0/742: creat d4/f10e x:0 0 0 2024-04-13T10:59:23.324 INFO:tasks.workunit.client.0.smithi134.stdout:7/743: getdents da/d15/d26/d27/d3d/d46/d95 0 2024-04-13T10:59:23.325 INFO:tasks.workunit.client.0.smithi134.stdout:3/701: symlink dc/d27/d19/lea 0 2024-04-13T10:59:23.327 INFO:tasks.workunit.client.0.smithi134.stdout:3/702: write dc/d27/d19/d48/d8e/f92 [8120736,8898] 0 2024-04-13T10:59:23.333 INFO:tasks.workunit.client.0.smithi134.stdout:2/662: rename d5/l78 to d5/d6/d57/d6c/d29/lc2 0 2024-04-13T10:59:23.339 INFO:tasks.workunit.client.0.smithi134.stdout:2/663: dwrite d5/de/d50/f6b [4194304,4194304] 0 2024-04-13T10:59:23.344 INFO:tasks.workunit.client.0.smithi134.stdout:7/744: dread da/d15/f77 [0,4194304] 0 2024-04-13T10:59:23.345 INFO:tasks.workunit.client.0.smithi134.stdout:7/745: write da/d15/d26/d4a/fd1 [711962,21775] 0 2024-04-13T10:59:23.350 INFO:tasks.workunit.client.0.smithi134.stdout:3/703: creat dc/d27/d19/d8b/da8/d50/d25/d91/feb x:0 0 0 2024-04-13T10:59:23.352 INFO:tasks.workunit.client.0.smithi134.stdout:3/704: stat dc/d27/d19/d48/l59 0 2024-04-13T10:59:23.353 INFO:tasks.workunit.client.0.smithi134.stdout:1/924: dread d3/d6/dc5/f11b [0,4194304] 0 2024-04-13T10:59:23.354 INFO:tasks.workunit.client.0.smithi134.stdout:1/925: chown d3/d6/d16/d4d/l79 11 1 2024-04-13T10:59:23.356 INFO:tasks.workunit.client.0.smithi134.stdout:1/926: truncate d3/d6/d20/d6d/db1/fef 614459 0 2024-04-13T10:59:23.357 INFO:tasks.workunit.client.0.smithi134.stdout:0/743: dread d4/d17/d23/d51/d6b/f7b [0,4194304] 0 2024-04-13T10:59:23.357 INFO:tasks.workunit.client.0.smithi134.stdout:1/927: fdatasync d3/d6/d16/d1d/d68/f11f 0 2024-04-13T10:59:23.358 INFO:tasks.workunit.client.0.smithi134.stdout:6/875: rename d4/da/d15/d76/d8e/c60 to d4/da/d15/d1f/d24/db9/c122 0 2024-04-13T10:59:23.365 INFO:tasks.workunit.client.0.smithi134.stdout:2/664: mknod d5/d6/d57/d6f/d30/d88/d96/cc3 0 2024-04-13T10:59:23.365 INFO:tasks.workunit.client.0.smithi134.stdout:1/928: dwrite d3/d6/d16/f7d [4194304,4194304] 0 2024-04-13T10:59:23.374 INFO:tasks.workunit.client.0.smithi134.stdout:8/879: truncate d8/dc/d2c/d68/d8c/d8f/fd7 1445212 0 2024-04-13T10:59:23.375 INFO:tasks.workunit.client.0.smithi134.stdout:0/744: creat d4/d17/d23/f10f x:0 0 0 2024-04-13T10:59:23.376 INFO:tasks.workunit.client.0.smithi134.stdout:7/746: dwrite da/f13 [0,4194304] 0 2024-04-13T10:59:23.380 INFO:tasks.workunit.client.0.smithi134.stdout:4/681: rename d4/d1f/d27/d3a/d65/dce to d4/d1f/d27/d2e/d84/dde 0 2024-04-13T10:59:23.381 INFO:tasks.workunit.client.0.smithi134.stdout:6/876: stat d4/da/d1a/fcf 0 2024-04-13T10:59:23.383 INFO:tasks.workunit.client.0.smithi134.stdout:1/929: symlink d3/d6/d16/d1d/d3c/l12a 0 2024-04-13T10:59:23.384 INFO:tasks.workunit.client.0.smithi134.stdout:9/907: getdents d13/d39/d58/d5f/dac/d102 0 2024-04-13T10:59:23.391 INFO:tasks.workunit.client.0.smithi134.stdout:2/665: dread d5/de/d50/f6b [0,4194304] 0 2024-04-13T10:59:23.392 INFO:tasks.workunit.client.0.smithi134.stdout:2/666: read d5/d6/d57/d6c/f28 [1879195,90546] 0 2024-04-13T10:59:23.401 INFO:tasks.workunit.client.0.smithi134.stdout:6/877: chown d4/da/d15/d1f/d24/d49/l114 111 1 2024-04-13T10:59:23.402 INFO:tasks.workunit.client.0.smithi134.stdout:1/930: mkdir d3/d6/d16/d1d/d68/de2/d12b 0 2024-04-13T10:59:23.404 INFO:tasks.workunit.client.0.smithi134.stdout:9/908: mkdir d13/d2e/d47/d148 0 2024-04-13T10:59:23.405 INFO:tasks.workunit.client.0.smithi134.stdout:9/909: write d13/d40/f6c [7115720,76742] 0 2024-04-13T10:59:23.406 INFO:tasks.workunit.client.0.smithi134.stdout:8/880: unlink d8/dc/f4f 0 2024-04-13T10:59:23.406 INFO:tasks.workunit.client.0.smithi134.stdout:1/931: dread d3/d6/d16/d4d/fbb [0,4194304] 0 2024-04-13T10:59:23.409 INFO:tasks.workunit.client.0.smithi134.stdout:8/881: truncate d8/dc/d16/d54/d6c/f100 567451 0 2024-04-13T10:59:23.409 INFO:tasks.workunit.client.0.smithi134.stdout:3/705: creat dc/d1d/d58/d72/fec x:0 0 0 2024-04-13T10:59:23.410 INFO:tasks.workunit.client.0.smithi134.stdout:7/747: unlink da/d15/c16 0 2024-04-13T10:59:23.411 INFO:tasks.workunit.client.0.smithi134.stdout:8/882: dread - d8/dc/d13/ddf/f119 zero size 2024-04-13T10:59:23.413 INFO:tasks.workunit.client.0.smithi134.stdout:0/745: fsync d4/d17/da/d22/d41/d6e/d8a/d95/f10c 0 2024-04-13T10:59:23.413 INFO:tasks.workunit.client.0.smithi134.stdout:2/667: truncate d5/de/d50/f7b 668355 0 2024-04-13T10:59:23.415 INFO:tasks.workunit.client.0.smithi134.stdout:2/668: chown d5/de/l7d 41 1 2024-04-13T10:59:23.418 INFO:tasks.workunit.client.0.smithi134.stdout:9/910: chown d13/f57 581696 1 2024-04-13T10:59:23.419 INFO:tasks.workunit.client.0.smithi134.stdout:9/911: chown d13/d39/d13a/l143 191777 1 2024-04-13T10:59:23.419 INFO:tasks.workunit.client.0.smithi134.stdout:1/932: dread d3/d6/d16/f35 [0,4194304] 0 2024-04-13T10:59:23.422 INFO:tasks.workunit.client.0.smithi134.stdout:3/706: mknod dc/d27/d19/d8b/da8/d50/d25/d91/d93/ced 0 2024-04-13T10:59:23.425 INFO:tasks.workunit.client.0.smithi134.stdout:8/883: creat d8/dc/d16/d54/d6c/d94/dc0/f129 x:0 0 0 2024-04-13T10:59:23.427 INFO:tasks.workunit.client.0.smithi134.stdout:6/878: creat d4/da/dbb/de5/dfd/f123 x:0 0 0 2024-04-13T10:59:23.428 INFO:tasks.workunit.client.0.smithi134.stdout:2/669: symlink d5/de/d12/lc4 0 2024-04-13T10:59:23.430 INFO:tasks.workunit.client.0.smithi134.stdout:0/746: mknod d4/d17/d23/d51/d6b/d91/d98/d62/d7c/c110 0 2024-04-13T10:59:23.431 INFO:tasks.workunit.client.0.smithi134.stdout:0/747: readlink d4/d17/d20/da9/de1/dfc/d6d/le8 0 2024-04-13T10:59:23.433 INFO:tasks.workunit.client.0.smithi134.stdout:9/912: mknod d13/da3/c149 0 2024-04-13T10:59:23.434 INFO:tasks.workunit.client.0.smithi134.stdout:1/933: dread - d3/d6/d16/fba zero size 2024-04-13T10:59:23.438 INFO:tasks.workunit.client.0.smithi134.stdout:4/682: write d4/d1f/d27/d75/d38/d79/d32/f74 [27855,58651] 0 2024-04-13T10:59:23.441 INFO:tasks.workunit.client.0.smithi134.stdout:4/683: write d4/d1f/d27/d75/d38/d79/d32/d67/d9b/fbe [312923,10918] 0 2024-04-13T10:59:23.442 INFO:tasks.workunit.client.0.smithi134.stdout:8/884: rename d8/dc/d13/f1e to d8/dc/d16/d4e/d76/f12a 0 2024-04-13T10:59:23.443 INFO:tasks.workunit.client.0.smithi134.stdout:6/879: mknod d4/da/dbb/dc3/c124 0 2024-04-13T10:59:23.444 INFO:tasks.workunit.client.0.smithi134.stdout:2/670: fsync f1 0 2024-04-13T10:59:23.452 INFO:tasks.workunit.client.0.smithi134.stdout:8/885: read d8/dc/d16/d54/d6c/d7d/f85 [1495432,125548] 0 2024-04-13T10:59:23.455 INFO:tasks.workunit.client.0.smithi134.stdout:8/886: chown d8/dc/d16/d54/d6c/d94/de7/ff2 1 1 2024-04-13T10:59:23.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.456+0000 7f813c88c700 1 -- 172.21.15.134:0/3874004532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81380ff180 msgr2=0x7f81380ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:23.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.456+0000 7f813c88c700 1 --2- 172.21.15.134:0/3874004532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81380ff180 0x7f81380ff5f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8120009910 tx=0x7f8120009c20 comp rx=0 tx=0).stop 2024-04-13T10:59:23.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.456+0000 7f813c88c700 1 -- 172.21.15.134:0/3874004532 shutdown_connections 2024-04-13T10:59:23.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.456+0000 7f813c88c700 1 --2- 172.21.15.134:0/3874004532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81380ff180 0x7f81380ff5f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:23.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.456+0000 7f813c88c700 1 --2- 172.21.15.134:0/3874004532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81380fe410 0x7f81380fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:23.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.456+0000 7f813c88c700 1 -- 172.21.15.134:0/3874004532 >> 172.21.15.134:0/3874004532 conn(0x7f81380f9d80 msgr2=0x7f81380fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:23.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.457+0000 7f813c88c700 1 -- 172.21.15.134:0/3874004532 shutdown_connections 2024-04-13T10:59:23.458 INFO:tasks.workunit.client.0.smithi134.stdout:4/684: mknod d4/d1f/d27/d3a/d53/dc1/db3/cdf 0 2024-04-13T10:59:23.458 INFO:tasks.workunit.client.0.smithi134.stdout:9/913: dread d13/d39/d58/d5f/dbb/fcd [0,4194304] 0 2024-04-13T10:59:23.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.457+0000 7f813c88c700 1 -- 172.21.15.134:0/3874004532 wait complete. 2024-04-13T10:59:23.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.458+0000 7f813c88c700 1 Processor -- start 2024-04-13T10:59:23.459 INFO:tasks.workunit.client.0.smithi134.stdout:2/671: dread d5/d6/d57/d6c/f28 [4194304,4194304] 0 2024-04-13T10:59:23.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.458+0000 7f813c88c700 1 -- start start 2024-04-13T10:59:23.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.458+0000 7f813c88c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81380fe410 0x7f813810ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:23.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.458+0000 7f813c88c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81380ff180 0x7f813810d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:23.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.458+0000 7f813c88c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813810d960 con 0x7f81380fe410 2024-04-13T10:59:23.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.458+0000 7f813c88c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813810daa0 con 0x7f81380ff180 2024-04-13T10:59:23.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.459+0000 7f813659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81380fe410 0x7f813810ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:23.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.459+0000 7f813659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81380fe410 0x7f813810ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47194/0 (socket says 172.21.15.134:47194) 2024-04-13T10:59:23.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.459+0000 7f813659c700 1 -- 172.21.15.134:0/66197667 learned_addr learned my addr 172.21.15.134:0/66197667 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:59:23.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.459+0000 7f813659c700 1 -- 172.21.15.134:0/66197667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81380ff180 msgr2=0x7f813810d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:23.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.459+0000 7f813659c700 1 --2- 172.21.15.134:0/66197667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81380ff180 0x7f813810d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:23.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.459+0000 7f813659c700 1 -- 172.21.15.134:0/66197667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8128009520 con 0x7f81380fe410 2024-04-13T10:59:23.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.459+0000 7f813659c700 1 --2- 172.21.15.134:0/66197667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81380fe410 0x7f813810ce00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f812800eab0 tx=0x7f812800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:23.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.460+0000 7f812f7fe700 1 -- 172.21.15.134:0/66197667 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f812800cc60 con 0x7f81380fe410 2024-04-13T10:59:23.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.460+0000 7f812f7fe700 1 -- 172.21.15.134:0/66197667 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f81280044b0 con 0x7f81380fe410 2024-04-13T10:59:23.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.460+0000 7f812f7fe700 1 -- 172.21.15.134:0/66197667 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8128005080 con 0x7f81380fe410 2024-04-13T10:59:23.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.460+0000 7f813c88c700 1 -- 172.21.15.134:0/66197667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81200095f0 con 0x7f81380fe410 2024-04-13T10:59:23.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.460+0000 7f813c88c700 1 -- 172.21.15.134:0/66197667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813806ad50 con 0x7f81380fe410 2024-04-13T10:59:23.461 INFO:tasks.workunit.client.0.smithi134.stdout:3/707: dread dc/fd [0,4194304] 0 2024-04-13T10:59:23.461 INFO:tasks.workunit.client.0.smithi134.stdout:7/748: dread da/d15/d26/d27/d4f/d5f/d67/f90 [0,4194304] 0 2024-04-13T10:59:23.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.462+0000 7f813c88c700 1 -- 172.21.15.134:0/66197667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813810f160 con 0x7f81380fe410 2024-04-13T10:59:23.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.462+0000 7f812f7fe700 1 -- 172.21.15.134:0/66197667 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f81280048c0 con 0x7f81380fe410 2024-04-13T10:59:23.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.462+0000 7f812f7fe700 1 --2- 172.21.15.134:0/66197667 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f812406ce10 0x7f812406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:23.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.463+0000 7f812f7fe700 1 -- 172.21.15.134:0/66197667 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8128014070 con 0x7f81380fe410 2024-04-13T10:59:23.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.466+0000 7f8135d9b700 1 --2- 172.21.15.134:0/66197667 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f812406ce10 0x7f812406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:23.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.466+0000 7f8135d9b700 1 --2- 172.21.15.134:0/66197667 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f812406ce10 0x7f812406f2c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8120006010 tx=0x7f8120009f90 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:23.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.468+0000 7f812f7fe700 1 -- 172.21.15.134:0/66197667 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f812805a240 con 0x7f81380fe410 2024-04-13T10:59:23.469 INFO:tasks.workunit.client.0.smithi134.stdout:9/914: read - d13/d40/d7d/dfb/f115 zero size 2024-04-13T10:59:23.470 INFO:tasks.workunit.client.0.smithi134.stdout:2/672: dwrite d5/d6/d70/fa0 [0,4194304] 0 2024-04-13T10:59:23.474 INFO:tasks.workunit.client.0.smithi134.stdout:4/685: rename d4/d48/d4a/d7e/cca to d4/d48/d86/ce0 0 2024-04-13T10:59:23.474 INFO:tasks.workunit.client.0.smithi134.stdout:8/887: symlink d8/dc/d16/l12b 0 2024-04-13T10:59:23.475 INFO:tasks.workunit.client.0.smithi134.stdout:1/934: write d3/d6/d16/fa8 [5649980,46810] 0 2024-04-13T10:59:23.479 INFO:tasks.workunit.client.0.smithi134.stdout:6/880: getdents d4/da/d15/d77 0 2024-04-13T10:59:23.481 INFO:tasks.workunit.client.0.smithi134.stdout:7/749: write da/d15/d85/fdb [559020,89035] 0 2024-04-13T10:59:23.482 INFO:tasks.workunit.client.0.smithi134.stdout:3/708: truncate dc/d27/d19/d8b/da8/d50/f20 4298965 0 2024-04-13T10:59:23.486 INFO:tasks.workunit.client.0.smithi134.stdout:9/915: mkdir d13/d39/d58/d5f/dac/d11a/d133/d14a 0 2024-04-13T10:59:23.489 INFO:tasks.workunit.client.0.smithi134.stdout:4/686: symlink d4/d1f/d27/d75/d38/d79/d32/le1 0 2024-04-13T10:59:23.492 INFO:tasks.workunit.client.0.smithi134.stdout:0/748: dwrite d4/d17/d20/da9/de1/dfc/f5f [0,4194304] 0 2024-04-13T10:59:23.494 INFO:tasks.workunit.client.0.smithi134.stdout:8/888: unlink d8/dc/d16/d54/d98/d9b/da3/fd3 0 2024-04-13T10:59:23.501 INFO:tasks.workunit.client.0.smithi134.stdout:6/881: dwrite d4/da/d15/d1f/d24/fff [0,4194304] 0 2024-04-13T10:59:23.502 INFO:tasks.workunit.client.0.smithi134.stdout:8/889: stat d8/dc/d13/ddf/c104 0 2024-04-13T10:59:23.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/750: dread da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/fac [0,4194304] 0 2024-04-13T10:59:23.504 INFO:tasks.workunit.client.0.smithi134.stdout:2/673: mknod d5/d6/d57/d6f/d30/cc5 0 2024-04-13T10:59:23.504 INFO:tasks.workunit.client.0.smithi134.stdout:1/935: mkdir d3/d6/d20/d71/d107/d12c 0 2024-04-13T10:59:23.505 INFO:tasks.workunit.client.0.smithi134.stdout:1/936: stat d3/d6/d20/d71/lbf 0 2024-04-13T10:59:23.510 INFO:tasks.workunit.client.0.smithi134.stdout:5/993: sync 2024-04-13T10:59:23.511 INFO:tasks.workunit.client.0.smithi134.stdout:3/709: unlink dc/d27/d19/d8b/da8/d50/d25/d5f/c4e 0 2024-04-13T10:59:23.513 INFO:tasks.workunit.client.0.smithi134.stdout:1/937: write d3/d6/d16/d4d/d65/f10c [455737,17557] 0 2024-04-13T10:59:23.517 INFO:tasks.workunit.client.0.smithi134.stdout:3/710: write dc/d27/d19/db1/fde [1045005,112654] 0 2024-04-13T10:59:23.517 INFO:tasks.workunit.client.0.smithi134.stdout:7/751: mknod da/d15/d26/d4a/cdd 0 2024-04-13T10:59:23.519 INFO:tasks.workunit.client.0.smithi134.stdout:1/938: fsync d3/d6/d20/d89/fd1 0 2024-04-13T10:59:23.519 INFO:tasks.workunit.client.0.smithi134.stdout:9/916: write fd [7012008,97037] 0 2024-04-13T10:59:23.522 INFO:tasks.workunit.client.0.smithi134.stdout:6/882: creat d4/da/d15/d1f/d24/d49/d91/f125 x:0 0 0 2024-04-13T10:59:23.524 INFO:tasks.workunit.client.0.smithi134.stdout:2/674: dwrite d5/d6/d70/fa0 [0,4194304] 0 2024-04-13T10:59:23.529 INFO:tasks.workunit.client.0.smithi134.stdout:3/711: truncate dc/d27/d19/d8b/da8/d50/d25/d91/d93/fdd 5118550 0 2024-04-13T10:59:23.544 INFO:tasks.workunit.client.0.smithi134.stdout:9/917: symlink d13/d39/d52/d86/l14b 0 2024-04-13T10:59:23.547 INFO:tasks.workunit.client.0.smithi134.stdout:2/675: symlink d5/d6/d57/d6c/lc6 0 2024-04-13T10:59:23.547 INFO:tasks.workunit.client.0.smithi134.stdout:4/687: dwrite d4/d1f/d90/faa [0,4194304] 0 2024-04-13T10:59:23.554 INFO:tasks.workunit.client.0.smithi134.stdout:0/749: dwrite d4/d17/da/d22/deb/fdc [0,4194304] 0 2024-04-13T10:59:23.558 INFO:tasks.workunit.client.0.smithi134.stdout:6/883: truncate d4/da/d1a/f44 883129 0 2024-04-13T10:59:23.558 INFO:tasks.workunit.client.0.smithi134.stdout:2/676: dread - d5/de/d50/fbc zero size 2024-04-13T10:59:23.560 INFO:tasks.workunit.client.0.smithi134.stdout:5/994: dwrite dc/d15/d84/f9c [0,4194304] 0 2024-04-13T10:59:23.561 INFO:tasks.workunit.client.0.smithi134.stdout:3/712: link dc/d27/d19/f6a dc/d27/d19/d8b/da8/d50/d25/d91/d93/fee 0 2024-04-13T10:59:23.563 INFO:tasks.workunit.client.0.smithi134.stdout:7/752: rename da/d15/d26/d38/f84 to da/d15/d26/d27/d3d/d46/fde 0 2024-04-13T10:59:23.566 INFO:tasks.workunit.client.0.smithi134.stdout:8/890: dread d8/dc/f35 [0,4194304] 0 2024-04-13T10:59:23.566 INFO:tasks.workunit.client.0.smithi134.stdout:4/688: readlink d4/d82/lbd 0 2024-04-13T10:59:23.578 INFO:tasks.workunit.client.0.smithi134.stdout:1/939: dwrite d3/d30/fb7 [0,4194304] 0 2024-04-13T10:59:23.584 INFO:tasks.workunit.client.0.smithi134.stdout:1/940: chown d3/d6/c2f 1994386 1 2024-04-13T10:59:23.590 INFO:tasks.workunit.client.0.smithi134.stdout:3/713: dwrite dc/f10 [4194304,4194304] 0 2024-04-13T10:59:23.595 INFO:tasks.workunit.client.0.smithi134.stdout:0/750: dread d4/d17/d20/da9/de1/dfc/d6d/da5/fab [0,4194304] 0 2024-04-13T10:59:23.607 INFO:tasks.workunit.client.0.smithi134.stdout:5/995: dread f9 [0,4194304] 0 2024-04-13T10:59:23.620 INFO:tasks.workunit.client.0.smithi134.stdout:0/751: dread d4/d17/d20/d29/d30/d64/d84/f8e [0,4194304] 0 2024-04-13T10:59:23.621 INFO:tasks.workunit.client.0.smithi134.stdout:0/752: readlink d4/d17/d20/da9/de1/dfc/d6d/d97/db6/lc9 0 2024-04-13T10:59:23.625 INFO:tasks.workunit.client.0.smithi134.stdout:9/918: creat d13/d39/d58/f14c x:0 0 0 2024-04-13T10:59:23.625 INFO:tasks.workunit.client.0.smithi134.stdout:9/919: stat d13/d39/d64/l7e 0 2024-04-13T10:59:23.626 INFO:tasks.workunit.client.0.smithi134.stdout:9/920: read - d13/d39/d52/d86/d9f/f140 zero size 2024-04-13T10:59:23.628 INFO:tasks.workunit.client.0.smithi134.stdout:7/753: write da/d15/f8a [1604063,421] 0 2024-04-13T10:59:23.629 INFO:tasks.workunit.client.0.smithi134.stdout:7/754: chown da/d15/d26/d27/d3d/fbd 16014 1 2024-04-13T10:59:23.633 INFO:tasks.workunit.client.0.smithi134.stdout:4/689: creat d4/d48/d4a/d7e/fe2 x:0 0 0 2024-04-13T10:59:23.636 INFO:tasks.workunit.client.0.smithi134.stdout:8/891: mkdir d8/dc/d9d/d69/d12c 0 2024-04-13T10:59:23.638 INFO:tasks.workunit.client.0.smithi134.stdout:8/892: chown d8/dc/d16/d54/d6c/d94/de7/fef 12206 1 2024-04-13T10:59:23.646 INFO:tasks.workunit.client.0.smithi134.stdout:4/690: dread d4/d1f/d27/d75/d38/d79/f28 [0,4194304] 0 2024-04-13T10:59:23.648 INFO:tasks.workunit.client.0.smithi134.stdout:2/677: getdents d5/d6/d70/db2 0 2024-04-13T10:59:23.649 INFO:tasks.workunit.client.0.smithi134.stdout:8/893: read - d8/dc/d2c/d68/d8c/d8f/fde zero size 2024-04-13T10:59:23.650 INFO:tasks.workunit.client.0.smithi134.stdout:3/714: creat dc/d1d/d58/db4/fef x:0 0 0 2024-04-13T10:59:23.656 INFO:tasks.workunit.client.0.smithi134.stdout:8/894: dread d8/dc/d16/d54/d98/d9b/da3/ffb [0,4194304] 0 2024-04-13T10:59:23.657 INFO:tasks.workunit.client.0.smithi134.stdout:2/678: rmdir d5/da1 39 2024-04-13T10:59:23.662 INFO:tasks.workunit.client.0.smithi134.stdout:5/996: rename dc/d15/df1/d3b/d7f/d8d/d7d/cda to dc/d15/c140 0 2024-04-13T10:59:23.666 INFO:tasks.workunit.client.0.smithi134.stdout:8/895: dread - d8/dc/d2c/f10d zero size 2024-04-13T10:59:23.667 INFO:tasks.workunit.client.0.smithi134.stdout:2/679: fdatasync d5/de/d50/f5e 0 2024-04-13T10:59:23.669 INFO:tasks.workunit.client.0.smithi134.stdout:2/680: chown d5/d6/d57/d6c/f4d 16 1 2024-04-13T10:59:23.669 INFO:tasks.workunit.client.0.smithi134.stdout:2/681: chown d5/de/d50/f60 173 1 2024-04-13T10:59:23.670 INFO:tasks.workunit.client.0.smithi134.stdout:4/691: truncate d4/d1f/d27/d75/d38/f4e 888687 0 2024-04-13T10:59:23.671 INFO:tasks.workunit.client.0.smithi134.stdout:5/997: readlink dc/d15/d84/l92 0 2024-04-13T10:59:23.671 INFO:tasks.workunit.client.0.smithi134.stdout:0/753: link d4/c9 d4/d17/da/d22/d41/c111 0 2024-04-13T10:59:23.674 INFO:tasks.workunit.client.0.smithi134.stdout:8/896: truncate d8/dc/d16/d4e/fa2 602228 0 2024-04-13T10:59:23.678 INFO:tasks.workunit.client.0.smithi134.stdout:3/715: truncate dc/d27/d19/d8b/d9b/f6b 2381172 0 2024-04-13T10:59:23.678 INFO:tasks.workunit.client.0.smithi134.stdout:2/682: dread d5/de/d50/f7b [0,4194304] 0 2024-04-13T10:59:23.681 INFO:tasks.workunit.client.0.smithi134.stdout:5/998: dwrite dc/d1d/d2b/d30/d100/d10e/d132/d23/d36/f73 [0,4194304] 0 2024-04-13T10:59:23.682 INFO:tasks.workunit.client.0.smithi134.stdout:4/692: creat d4/d1f/d27/d2e/d84/ddb/fe3 x:0 0 0 2024-04-13T10:59:23.682 INFO:tasks.workunit.client.0.smithi134.stdout:8/897: chown d8/dc/l28 918 1 2024-04-13T10:59:23.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:23 smithi134 ceph-mon[39696]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:23.693 INFO:tasks.workunit.client.0.smithi134.stdout:4/693: dwrite d4/d1f/d90/faa [0,4194304] 0 2024-04-13T10:59:23.696 INFO:tasks.workunit.client.0.smithi134.stdout:3/716: creat dc/d1d/dca/ff0 x:0 0 0 2024-04-13T10:59:23.697 INFO:tasks.workunit.client.0.smithi134.stdout:2/683: rmdir d5/d6/d57 39 2024-04-13T10:59:23.698 INFO:tasks.workunit.client.0.smithi134.stdout:8/898: creat d8/dcc/f12d x:0 0 0 2024-04-13T10:59:23.698 INFO:tasks.workunit.client.0.smithi134.stdout:5/999: fdatasync dc/d1d/d46/f97 0 2024-04-13T10:59:23.712 INFO:tasks.workunit.client.0.smithi134.stdout:2/684: truncate d5/de/d50/f60 89168 0 2024-04-13T10:59:23.714 INFO:tasks.workunit.client.0.smithi134.stdout:4/694: rename d4/d1f/d27/d3a/d53/dc1/l92 to d4/le4 0 2024-04-13T10:59:23.718 INFO:tasks.workunit.client.0.smithi134.stdout:3/717: chown dc/d27/d19/d8b/da8/d50/d25/d5f/d75 8 1 2024-04-13T10:59:23.720 INFO:tasks.workunit.client.0.smithi134.stdout:4/695: creat d4/d1f/d27/d75/d38/d79/fe5 x:0 0 0 2024-04-13T10:59:23.720 INFO:tasks.workunit.client.0.smithi134.stdout:3/718: chown dc/d1d/d58/db4/fd3 212 1 2024-04-13T10:59:23.720 INFO:tasks.workunit.client.0.smithi134.stdout:6/884: truncate d4/da/fc8 2703910 0 2024-04-13T10:59:23.722 INFO:tasks.workunit.client.0.smithi134.stdout:4/696: chown d4/dd/d6d/d8c/d5f/fae 12 1 2024-04-13T10:59:23.727 INFO:tasks.workunit.client.0.smithi134.stdout:6/885: symlink d4/da/d1a/de6/d120/l126 0 2024-04-13T10:59:23.735 INFO:tasks.workunit.client.0.smithi134.stdout:6/886: dread - d4/da/d1a/fd6 zero size 2024-04-13T10:59:23.739 INFO:tasks.workunit.client.0.smithi134.stdout:2/685: dread d5/de/d50/f5d [0,4194304] 0 2024-04-13T10:59:23.742 INFO:tasks.workunit.client.0.smithi134.stdout:9/921: truncate d13/d39/d64/f8a 584019 0 2024-04-13T10:59:23.742 INFO:tasks.workunit.client.0.smithi134.stdout:3/719: dwrite dc/d27/d19/d8b/da8/d50/d25/d91/d93/fdd [0,4194304] 0 2024-04-13T10:59:23.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:23 smithi194 ceph-mon[46737]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:23.748 INFO:tasks.workunit.client.0.smithi134.stdout:7/755: dwrite da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/fac [0,4194304] 0 2024-04-13T10:59:23.748 INFO:tasks.workunit.client.0.smithi134.stdout:8/899: dread d8/dc/d16/d54/d6c/faa [0,4194304] 0 2024-04-13T10:59:23.748 INFO:tasks.workunit.client.0.smithi134.stdout:9/922: write d13/d2e/d35/d50/ffe [728163,31492] 0 2024-04-13T10:59:23.748 INFO:tasks.workunit.client.0.smithi134.stdout:6/887: write d4/da/d15/d77/d63/f8c [9284233,107001] 0 2024-04-13T10:59:23.760 INFO:tasks.workunit.client.0.smithi134.stdout:2/686: read d5/d6/d57/d6c/d29/f66 [1186711,21179] 0 2024-04-13T10:59:23.760 INFO:tasks.workunit.client.0.smithi134.stdout:3/720: mknod dc/d27/d19/d8b/da8/d50/d25/d5f/d99/cf1 0 2024-04-13T10:59:23.760 INFO:tasks.workunit.client.0.smithi134.stdout:6/888: symlink d4/da/d15/d1f/d24/d49/l127 0 2024-04-13T10:59:23.760 INFO:tasks.workunit.client.0.smithi134.stdout:0/754: write d4/d17/d23/d51/d6b/d91/f99 [2169346,57509] 0 2024-04-13T10:59:23.764 INFO:tasks.workunit.client.0.smithi134.stdout:3/721: stat dc/d27/d19/d8b/da8/d50 0 2024-04-13T10:59:23.764 INFO:tasks.workunit.client.0.smithi134.stdout:7/756: symlink da/d15/d26/d27/dc9/dcd/ldf 0 2024-04-13T10:59:23.766 INFO:tasks.workunit.client.0.smithi134.stdout:7/757: chown da/d15/d26/d4a/c74 61820 1 2024-04-13T10:59:23.767 INFO:tasks.workunit.client.0.smithi134.stdout:2/687: symlink d5/d6/d34/lc7 0 2024-04-13T10:59:23.770 INFO:tasks.workunit.client.0.smithi134.stdout:0/755: unlink d4/d17/da/d22/ffd 0 2024-04-13T10:59:23.775 INFO:tasks.workunit.client.0.smithi134.stdout:2/688: dwrite d5/d6/d57/d6c/d29/f46 [0,4194304] 0 2024-04-13T10:59:23.780 INFO:tasks.workunit.client.0.smithi134.stdout:7/758: mkdir da/d15/d26/d27/d4f/d5f/d67/de0 0 2024-04-13T10:59:23.782 INFO:tasks.workunit.client.0.smithi134.stdout:2/689: write d5/d6/d57/d6f/d30/d58/d73/f8d [3161685,23373] 0 2024-04-13T10:59:23.784 INFO:tasks.workunit.client.0.smithi134.stdout:2/690: write d5/de/d50/fbc [142640,108679] 0 2024-04-13T10:59:23.789 INFO:tasks.workunit.client.0.smithi134.stdout:3/722: mkdir dc/d1d/d58/df2 0 2024-04-13T10:59:23.791 INFO:tasks.workunit.client.0.smithi134.stdout:3/723: write dc/d27/d19/d8b/da8/d50/d25/d91/feb [494113,28063] 0 2024-04-13T10:59:23.794 INFO:tasks.workunit.client.0.smithi134.stdout:4/697: write d4/d1f/d27/d75/d38/d79/d32/d67/d9b/fc3 [1031912,106514] 0 2024-04-13T10:59:23.794 INFO:tasks.workunit.client.0.smithi134.stdout:7/759: rmdir da/d15/d26/d4a/dc7 39 2024-04-13T10:59:23.794 INFO:tasks.workunit.client.0.smithi134.stdout:8/900: dread d8/dc/d16/d54/d6c/f70 [0,4194304] 0 2024-04-13T10:59:23.798 INFO:tasks.workunit.client.0.smithi134.stdout:3/724: mkdir dc/d27/d19/df3 0 2024-04-13T10:59:23.798 INFO:tasks.workunit.client.0.smithi134.stdout:9/923: write d13/d40/d7d/fb4 [5043319,89053] 0 2024-04-13T10:59:23.800 INFO:tasks.workunit.client.0.smithi134.stdout:9/924: chown d13/d39/d52/d6b/fc5 62 1 2024-04-13T10:59:23.808 INFO:tasks.workunit.client.0.smithi134.stdout:4/698: symlink d4/dd/le6 0 2024-04-13T10:59:23.810 INFO:tasks.workunit.client.0.smithi134.stdout:9/925: truncate d13/d40/d7d/dfb/f7c 1087478 0 2024-04-13T10:59:23.811 INFO:tasks.workunit.client.0.smithi134.stdout:9/926: chown d13/d39/d58/d5f/dac/d11a/d133/d14a 514559 1 2024-04-13T10:59:23.815 INFO:tasks.workunit.client.0.smithi134.stdout:4/699: mknod d4/dd/d6d/d8c/ce7 0 2024-04-13T10:59:23.816 INFO:tasks.workunit.client.0.smithi134.stdout:8/901: dread d8/dc/d37/d3f/fa0 [4194304,4194304] 0 2024-04-13T10:59:23.816 INFO:tasks.workunit.client.0.smithi134.stdout:4/700: chown d4/d48/d4a/lc5 65940 1 2024-04-13T10:59:23.817 INFO:tasks.workunit.client.0.smithi134.stdout:2/691: getdents d5/d6/d57/d6f/d30/d58/d59 0 2024-04-13T10:59:23.818 INFO:tasks.workunit.client.0.smithi134.stdout:8/902: chown d8/dc/d16/d54/d6c/d94/dc1/f111 54 1 2024-04-13T10:59:23.819 INFO:tasks.workunit.client.0.smithi134.stdout:9/927: unlink d13/d2e/d35/d50/c5d 0 2024-04-13T10:59:23.823 INFO:tasks.workunit.client.0.smithi134.stdout:3/725: rmdir dc/d1d/d58/df2 0 2024-04-13T10:59:23.824 INFO:tasks.workunit.client.0.smithi134.stdout:0/756: dwrite d4/d17/d20/d29/d30/d64/d84/dd3/f93 [0,4194304] 0 2024-04-13T10:59:23.830 INFO:tasks.workunit.client.0.smithi134.stdout:3/726: dread dc/f10 [4194304,4194304] 0 2024-04-13T10:59:23.831 INFO:tasks.workunit.client.0.smithi134.stdout:6/889: truncate d4/da/dbb/dc3/fae 1073868 0 2024-04-13T10:59:23.833 INFO:tasks.workunit.client.0.smithi134.stdout:6/890: chown d4/da/d15/d76/d8e 357518 1 2024-04-13T10:59:23.834 INFO:tasks.workunit.client.0.smithi134.stdout:4/701: dwrite d4/d1f/d27/d75/d38/d79/f28 [0,4194304] 0 2024-04-13T10:59:23.836 INFO:tasks.workunit.client.0.smithi134.stdout:4/702: write d4/d1f/d27/d75/f44 [12677378,24187] 0 2024-04-13T10:59:23.841 INFO:tasks.workunit.client.0.smithi134.stdout:7/760: write da/d15/d26/d27/d4f/d5f/d67/d73/d92/fa9 [795974,24729] 0 2024-04-13T10:59:23.845 INFO:tasks.workunit.client.0.smithi134.stdout:3/727: symlink dc/d27/d19/d8b/da8/d50/d25/d91/lf4 0 2024-04-13T10:59:23.848 INFO:tasks.workunit.client.0.smithi134.stdout:4/703: dwrite d4/d1f/d27/d3a/f6a [0,4194304] 0 2024-04-13T10:59:23.850 INFO:tasks.workunit.client.0.smithi134.stdout:4/704: write d4/f61 [4446421,120697] 0 2024-04-13T10:59:23.854 INFO:tasks.workunit.client.0.smithi134.stdout:2/692: write d5/de/d50/f7c [7358905,52143] 0 2024-04-13T10:59:23.860 INFO:tasks.workunit.client.0.smithi134.stdout:0/757: mknod d4/d17/d20/da9/de1/dfc/d6d/da5/dd9/c112 0 2024-04-13T10:59:23.862 INFO:tasks.workunit.client.0.smithi134.stdout:7/761: fsync da/d15/d26/d27/d3d/d46/dbf/fdc 0 2024-04-13T10:59:23.863 INFO:tasks.workunit.client.0.smithi134.stdout:3/728: creat dc/d27/d81/ff5 x:0 0 0 2024-04-13T10:59:23.867 INFO:tasks.workunit.client.0.smithi134.stdout:2/693: dread d5/d6/d57/d6f/d30/d58/d59/f7e [0,4194304] 0 2024-04-13T10:59:23.869 INFO:tasks.workunit.client.0.smithi134.stdout:4/705: rename d4/d1f/d27/d2e/d84/dde/ld9 to d4/d82/le8 0 2024-04-13T10:59:23.870 INFO:tasks.workunit.client.0.smithi134.stdout:0/758: dwrite d4/d17/d23/f2f [0,4194304] 0 2024-04-13T10:59:23.873 INFO:tasks.workunit.client.0.smithi134.stdout:4/706: stat d4/d1f/d27/d75/d38/d79/d73 0 2024-04-13T10:59:23.876 INFO:tasks.workunit.client.0.smithi134.stdout:0/759: chown d4/d17/d23/d51/d6b/d91/d98/d92/dca/ff6 0 1 2024-04-13T10:59:23.876 INFO:tasks.workunit.client.0.smithi134.stdout:8/903: getdents d8/dc/d16/d54/d6c/d94/de7 0 2024-04-13T10:59:23.876 INFO:tasks.workunit.client.0.smithi134.stdout:0/760: write d4/d17/d20/da9/de1/dfc/ff1 [939931,63384] 0 2024-04-13T10:59:23.881 INFO:tasks.workunit.client.0.smithi134.stdout:7/762: unlink da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/fc0 0 2024-04-13T10:59:23.881 INFO:tasks.workunit.client.0.smithi134.stdout:9/928: link d13/f1e d13/d2e/d35/f14d 0 2024-04-13T10:59:23.884 INFO:tasks.workunit.client.0.smithi134.stdout:9/929: chown d13/d39/d64/db2/d123 62 1 2024-04-13T10:59:23.886 INFO:tasks.workunit.client.0.smithi134.stdout:8/904: dwrite d8/dc/d16/d54/d6c/f9f [4194304,4194304] 0 2024-04-13T10:59:23.890 INFO:tasks.workunit.client.0.smithi134.stdout:2/694: truncate d5/de/d50/f7b 39803 0 2024-04-13T10:59:23.892 INFO:tasks.workunit.client.0.smithi134.stdout:4/707: unlink d4/dd/l30 0 2024-04-13T10:59:23.893 INFO:tasks.workunit.client.0.smithi134.stdout:6/891: dwrite d4/da/d15/fd3 [0,4194304] 0 2024-04-13T10:59:23.895 INFO:tasks.workunit.client.0.smithi134.stdout:6/892: fsync d4/da/d15/d76/d92/ffa 0 2024-04-13T10:59:23.898 INFO:tasks.workunit.client.0.smithi134.stdout:7/763: creat da/fe1 x:0 0 0 2024-04-13T10:59:23.900 INFO:tasks.workunit.client.0.smithi134.stdout:4/708: dread d4/d1f/d90/faa [0,4194304] 0 2024-04-13T10:59:23.995 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.959+0000 7f813c88c700 1 -- 172.21.15.134:0/66197667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f813806b960 con 0x7f81380fe410 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T10:59:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.960+0000 7f812f7fe700 1 -- 172.21.15.134:0/66197667 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f812800cdc0 con 0x7f81380fe410 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 -- 172.21.15.134:0/66197667 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f812406ce10 msgr2=0x7f812406f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 --2- 172.21.15.134:0/66197667 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f812406ce10 0x7f812406f2c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8120006010 tx=0x7f8120009f90 comp rx=0 tx=0).stop 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 -- 172.21.15.134:0/66197667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81380fe410 msgr2=0x7f813810ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:23.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 --2- 172.21.15.134:0/66197667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81380fe410 0x7f813810ce00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f812800eab0 tx=0x7f812800ee70 comp rx=0 tx=0).stop 2024-04-13T10:59:23.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 -- 172.21.15.134:0/66197667 shutdown_connections 2024-04-13T10:59:23.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 --2- 172.21.15.134:0/66197667 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7f812406ce10 0x7f812406f2c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:23.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 --2- 172.21.15.134:0/66197667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81380fe410 0x7f813810ce00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:23.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 --2- 172.21.15.134:0/66197667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81380ff180 0x7f813810d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:23.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 -- 172.21.15.134:0/66197667 >> 172.21.15.134:0/66197667 conn(0x7f81380f9d80 msgr2=0x7f81381023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:23.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 -- 172.21.15.134:0/66197667 shutdown_connections 2024-04-13T10:59:23.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:23.962+0000 7f813c88c700 1 -- 172.21.15.134:0/66197667 wait complete. 2024-04-13T10:59:24.016 INFO:tasks.workunit.client.0.smithi134.stdout:7/764: creat da/d15/d26/d27/d4f/d5f/d67/d76/fe2 x:0 0 0 2024-04-13T10:59:24.016 INFO:tasks.workunit.client.0.smithi134.stdout:3/729: rename dc/d27/d81 to dc/d27/d19/d8b/da8/d50/d25/df6 0 2024-04-13T10:59:24.017 INFO:tasks.workunit.client.0.smithi134.stdout:7/765: fdatasync da/fb 0 2024-04-13T10:59:24.018 INFO:tasks.workunit.client.0.smithi134.stdout:8/905: fdatasync d8/dc/fad 0 2024-04-13T10:59:24.025 INFO:tasks.workunit.client.0.smithi134.stdout:8/906: dwrite d8/dc/d16/d4e/d76/fda [0,4194304] 0 2024-04-13T10:59:24.027 INFO:tasks.workunit.client.0.smithi134.stdout:8/907: chown d8/dc/fd2 212776 1 2024-04-13T10:59:24.027 INFO:tasks.workunit.client.0.smithi134.stdout:0/761: dread d4/d17/d20/d29/d30/d7f/dc0/fc6 [0,4194304] 0 2024-04-13T10:59:24.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.075+0000 7fa7d665f700 1 -- 172.21.15.134:0/143557138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d0101350 msgr2=0x7fa7d01017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.075+0000 7fa7d665f700 1 --2- 172.21.15.134:0/143557138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d0101350 0x7fa7d01017a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009910 tx=0x7fa7c0009c20 comp rx=0 tx=0).stop 2024-04-13T10:59:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.075+0000 7fa7d665f700 1 -- 172.21.15.134:0/143557138 shutdown_connections 2024-04-13T10:59:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.075+0000 7fa7d665f700 1 --2- 172.21.15.134:0/143557138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d0101350 0x7fa7d01017a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.075+0000 7fa7d665f700 1 --2- 172.21.15.134:0/143557138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d0100150 0x7fa7d0100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.075+0000 7fa7d665f700 1 -- 172.21.15.134:0/143557138 >> 172.21.15.134:0/143557138 conn(0x7fa7d00fb6e0 msgr2=0x7fa7d00fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.075+0000 7fa7d665f700 1 -- 172.21.15.134:0/143557138 shutdown_connections 2024-04-13T10:59:24.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.075+0000 7fa7d665f700 1 -- 172.21.15.134:0/143557138 wait complete. 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.076+0000 7fa7d665f700 1 Processor -- start 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.076+0000 7fa7d665f700 1 -- start start 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.076+0000 7fa7d665f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d0100150 0x7fa7d01958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.076+0000 7fa7d665f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d0101350 0x7fa7d0195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.076+0000 7fa7d665f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0196400 con 0x7fa7d0100150 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.076+0000 7fa7d665f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0196540 con 0x7fa7d0101350 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.076+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d0100150 0x7fa7d01958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.076+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d0100150 0x7fa7d01958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47210/0 (socket says 172.21.15.134:47210) 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.076+0000 7fa7cffff700 1 -- 172.21.15.134:0/3675287162 learned_addr learned my addr 172.21.15.134:0/3675287162 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.077+0000 7fa7cf7fe700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d0101350 0x7fa7d0195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:24.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.077+0000 7fa7cffff700 1 -- 172.21.15.134:0/3675287162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d0101350 msgr2=0x7fa7d0195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.077+0000 7fa7cffff700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d0101350 0x7fa7d0195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.077+0000 7fa7cffff700 1 -- 172.21.15.134:0/3675287162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c00095f0 con 0x7fa7d0100150 2024-04-13T10:59:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.077+0000 7fa7cffff700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d0100150 0x7fa7d01958a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800d900 tx=0x7fa7b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.077+0000 7fa7cd7fa700 1 -- 172.21.15.134:0/3675287162 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7b80041f0 con 0x7fa7d0100150 2024-04-13T10:59:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.077+0000 7fa7d665f700 1 -- 172.21.15.134:0/3675287162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d019aff0 con 0x7fa7d0100150 2024-04-13T10:59:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.077+0000 7fa7cd7fa700 1 -- 172.21.15.134:0/3675287162 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fa7b8004350 con 0x7fa7d0100150 2024-04-13T10:59:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.077+0000 7fa7cd7fa700 1 -- 172.21.15.134:0/3675287162 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7b8003cf0 con 0x7fa7d0100150 2024-04-13T10:59:24.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.077+0000 7fa7d665f700 1 -- 172.21.15.134:0/3675287162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d019b530 con 0x7fa7d0100150 2024-04-13T10:59:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.078+0000 7fa7d665f700 1 -- 172.21.15.134:0/3675287162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d0108b60 con 0x7fa7d0100150 2024-04-13T10:59:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.078+0000 7fa7cd7fa700 1 -- 172.21.15.134:0/3675287162 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 90946+0+0 (secure 0 0 0) 0x7fa7b8009730 con 0x7fa7d0100150 2024-04-13T10:59:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.079+0000 7fa7cd7fa700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa7bc06ce20 0x7fa7bc06f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.079+0000 7fa7cd7fa700 1 -- 172.21.15.134:0/3675287162 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa7b808c840 con 0x7fa7d0100150 2024-04-13T10:59:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.079+0000 7fa7cf7fe700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa7bc06ce20 0x7fa7bc06f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:24.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.080+0000 7fa7cf7fe700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa7bc06ce20 0x7fa7bc06f2d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000b5c0 tx=0x7fa7c0005960 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:24.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.084+0000 7fa7cd7fa700 1 -- 172.21.15.134:0/3675287162 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fa7b805a280 con 0x7fa7d0100150 2024-04-13T10:59:24.109 INFO:tasks.workunit.client.0.smithi134.stdout:7/766: dwrite f4 [0,4194304] 0 2024-04-13T10:59:24.116 INFO:tasks.workunit.client.0.smithi134.stdout:8/908: unlink d8/lcf 0 2024-04-13T10:59:24.116 INFO:tasks.workunit.client.0.smithi134.stdout:0/762: unlink d4/d17/d20/d29/d30/d7f/cec 0 2024-04-13T10:59:24.120 INFO:tasks.workunit.client.0.smithi134.stdout:4/709: write d4/d1f/d27/d75/d38/f4e [891871,59518] 0 2024-04-13T10:59:24.122 INFO:tasks.workunit.client.0.smithi134.stdout:4/710: write d4/d48/d4a/d7e/fe2 [75202,59212] 0 2024-04-13T10:59:24.126 INFO:tasks.workunit.client.0.smithi134.stdout:8/909: rmdir d8/dc/d2c/d68/dae 39 2024-04-13T10:59:24.127 INFO:tasks.workunit.client.0.smithi134.stdout:8/910: truncate d8/dc/d9d/d69/f117 1634719 0 2024-04-13T10:59:24.129 INFO:tasks.workunit.client.0.smithi134.stdout:9/930: link d13/d39/d52/d86/d9f/db0/l12a d13/d39/d58/d5f/l14e 0 2024-04-13T10:59:24.134 INFO:tasks.workunit.client.0.smithi134.stdout:7/767: write da/d15/d26/d27/d4f/d5f/d67/d73/f7b [554972,64290] 0 2024-04-13T10:59:24.136 INFO:tasks.workunit.client.0.smithi134.stdout:9/931: creat d13/d39/d64/db2/dd6/f14f x:0 0 0 2024-04-13T10:59:24.139 INFO:tasks.workunit.client.0.smithi134.stdout:0/763: write d4/d17/d20/da9/de1/dfc/f65 [2803211,15470] 0 2024-04-13T10:59:24.145 INFO:tasks.workunit.client.0.smithi134.stdout:7/768: rename da/d15/d26/d27/d3d/d46/d95 to da/dad/de3 0 2024-04-13T10:59:24.145 INFO:tasks.workunit.client.0.smithi134.stdout:9/932: stat d13/d39/d64/db2/c10e 0 2024-04-13T10:59:24.148 INFO:tasks.workunit.client.0.smithi134.stdout:4/711: link d4/d1f/d27/l47 d4/d1f/d27/d75/d38/d79/d32/le9 0 2024-04-13T10:59:24.150 INFO:tasks.workunit.client.0.smithi134.stdout:9/933: rename d13/d39/d52/d86 to d13/d39/d52/d6b/d150 0 2024-04-13T10:59:24.152 INFO:tasks.workunit.client.0.smithi134.stdout:0/764: symlink d4/d17/d20/l113 0 2024-04-13T10:59:24.153 INFO:tasks.workunit.client.0.smithi134.stdout:0/765: chown d4/d17/d20/d29/d30/d64/d84/ce0 319 1 2024-04-13T10:59:24.155 INFO:tasks.workunit.client.0.smithi134.stdout:4/712: creat d4/d1f/d90/fea x:0 0 0 2024-04-13T10:59:24.156 INFO:tasks.workunit.client.0.smithi134.stdout:9/934: fsync d13/d39/d58/f66 0 2024-04-13T10:59:24.162 INFO:tasks.workunit.client.0.smithi134.stdout:1/941: sync 2024-04-13T10:59:24.167 INFO:tasks.workunit.client.0.smithi134.stdout:1/942: creat d3/d6/d20/f12d x:0 0 0 2024-04-13T10:59:24.170 INFO:tasks.workunit.client.0.smithi134.stdout:9/935: link d13/d2e/d47/fc4 d13/d39/f151 0 2024-04-13T10:59:24.171 INFO:tasks.workunit.client.0.smithi134.stdout:9/936: chown d13/d2e/d35/d50/l6d 386411 1 2024-04-13T10:59:24.172 INFO:tasks.workunit.client.0.smithi134.stdout:4/713: truncate d4/dd/d6d/d8c/f16 549812 0 2024-04-13T10:59:24.172 INFO:tasks.workunit.client.0.smithi134.stdout:1/943: dread d3/d6/d20/d6d/db1/fe8 [0,4194304] 0 2024-04-13T10:59:24.174 INFO:tasks.workunit.client.0.smithi134.stdout:0/766: rename d4/d17/d23/d51/d6a/fcb to d4/d17/d23/d51/d6a/f114 0 2024-04-13T10:59:24.179 INFO:tasks.workunit.client.0.smithi134.stdout:4/714: chown d4/d1f/d27/d75/d38/d79/f8b 128911 1 2024-04-13T10:59:24.181 INFO:tasks.workunit.client.0.smithi134.stdout:0/767: rmdir d4/d17/d20/da9/de1/dfc/d6d 39 2024-04-13T10:59:24.182 INFO:tasks.workunit.client.0.smithi134.stdout:9/937: fsync d13/d40/d7d/dfb/f7c 0 2024-04-13T10:59:24.185 INFO:tasks.workunit.client.0.smithi134.stdout:1/944: getdents d3/d6/d20/d6d/d102 0 2024-04-13T10:59:24.186 INFO:tasks.workunit.client.0.smithi134.stdout:9/938: write d13/d39/d64/db2/dd6/f14f [986049,24501] 0 2024-04-13T10:59:24.188 INFO:tasks.workunit.client.0.smithi134.stdout:4/715: dwrite d4/d1f/d27/d2e/d84/dde/fda [0,4194304] 0 2024-04-13T10:59:24.192 INFO:tasks.workunit.client.0.smithi134.stdout:0/768: mkdir d4/d17/d20/d29/dcd/dfb/d115 0 2024-04-13T10:59:24.206 INFO:tasks.workunit.client.0.smithi134.stdout:0/769: dwrite d4/d17/d23/d51/d6a/f114 [0,4194304] 0 2024-04-13T10:59:24.206 INFO:tasks.workunit.client.0.smithi134.stdout:1/945: creat d3/d6/d20/d6d/f12e x:0 0 0 2024-04-13T10:59:24.212 INFO:tasks.workunit.client.0.smithi134.stdout:0/770: creat d4/d17/d20/d29/dcd/dfb/f116 x:0 0 0 2024-04-13T10:59:24.217 INFO:tasks.workunit.client.0.smithi134.stdout:9/939: dread d13/d39/d64/f92 [0,4194304] 0 2024-04-13T10:59:24.219 INFO:tasks.workunit.client.0.smithi134.stdout:4/716: dread d4/d1f/d27/d75/f52 [0,4194304] 0 2024-04-13T10:59:24.222 INFO:tasks.workunit.client.0.smithi134.stdout:1/946: dwrite d3/d6/fc3 [0,4194304] 0 2024-04-13T10:59:24.222 INFO:tasks.workunit.client.0.smithi134.stdout:9/940: write d13/d39/d64/f92 [4292454,4573] 0 2024-04-13T10:59:24.224 INFO:tasks.workunit.client.0.smithi134.stdout:1/947: chown d3/d6/d16/fbd 7215 1 2024-04-13T10:59:24.228 INFO:tasks.workunit.client.0.smithi134.stdout:0/771: creat d4/d17/d20/da9/de1/dfc/d6d/da5/f117 x:0 0 0 2024-04-13T10:59:24.232 INFO:tasks.workunit.client.0.smithi134.stdout:0/772: chown d4/d17/d20/d29/d30/d3e/l66 429535575 1 2024-04-13T10:59:24.236 INFO:tasks.workunit.client.0.smithi134.stdout:0/773: dread d4/d17/d20/d29/d30/d64/d84/f8e [0,4194304] 0 2024-04-13T10:59:24.238 INFO:tasks.workunit.client.0.smithi134.stdout:0/774: write d4/d17/d20/d29/dcd/dfb/f116 [954447,89711] 0 2024-04-13T10:59:24.244 INFO:tasks.workunit.client.0.smithi134.stdout:1/948: write d3/f41 [709671,5905] 0 2024-04-13T10:59:24.244 INFO:tasks.workunit.client.0.smithi134.stdout:9/941: truncate d13/d39/d58/d5f/f124 701781 0 2024-04-13T10:59:24.246 INFO:tasks.workunit.client.0.smithi134.stdout:4/717: dwrite d4/d1f/d27/d75/d38/d79/f1c [0,4194304] 0 2024-04-13T10:59:24.248 INFO:tasks.workunit.client.0.smithi134.stdout:1/949: rmdir d3/d6/d16/d4d/d65 39 2024-04-13T10:59:24.252 INFO:tasks.workunit.client.0.smithi134.stdout:0/775: dwrite d4/d17/d23/d51/d6a/f114 [0,4194304] 0 2024-04-13T10:59:24.254 INFO:tasks.workunit.client.0.smithi134.stdout:4/718: symlink d4/d1f/d27/d75/leb 0 2024-04-13T10:59:24.255 INFO:tasks.workunit.client.0.smithi134.stdout:4/719: write d4/dd/d6d/d8c/fa7 [828187,25972] 0 2024-04-13T10:59:24.262 INFO:tasks.workunit.client.0.smithi134.stdout:0/776: fsync d4/d17/d23/d51/d6b/f7b 0 2024-04-13T10:59:24.264 INFO:tasks.workunit.client.0.smithi134.stdout:9/942: dwrite d13/d2e/d35/ff0 [0,4194304] 0 2024-04-13T10:59:24.283 INFO:tasks.workunit.client.0.smithi134.stdout:4/720: getdents d4/d1f/d27/d75 0 2024-04-13T10:59:24.284 INFO:tasks.workunit.client.0.smithi134.stdout:1/950: write d3/d6/d16/d4d/d65/f120 [2890,61681] 0 2024-04-13T10:59:24.284 INFO:tasks.workunit.client.0.smithi134.stdout:0/777: link d4/d17/d20/da9/de1/dfc/d6d/d97/db6/cc8 d4/d17/d23/d51/d6b/d91/d98/d62/daf/dc7/c118 0 2024-04-13T10:59:24.287 INFO:tasks.workunit.client.0.smithi134.stdout:1/951: chown d3/d6/d20/d28/f37 968 1 2024-04-13T10:59:24.295 INFO:tasks.workunit.client.0.smithi134.stdout:9/943: dread fd [4194304,4194304] 0 2024-04-13T10:59:24.297 INFO:tasks.workunit.client.0.smithi134.stdout:1/952: truncate d3/d6/d20/f7b 3059485 0 2024-04-13T10:59:24.301 INFO:tasks.workunit.client.0.smithi134.stdout:0/778: dwrite d4/d17/d20/da9/de1/dfc/d6d/d97/db6/fb8 [0,4194304] 0 2024-04-13T10:59:24.304 INFO:tasks.workunit.client.0.smithi134.stdout:9/944: rename d13/d39/d64/db2/fd9 to d13/d2e/d47/de7/f152 0 2024-04-13T10:59:24.307 INFO:tasks.workunit.client.0.smithi134.stdout:0/779: chown d4/d17/d20/d29/f87 8 1 2024-04-13T10:59:24.307 INFO:tasks.workunit.client.0.smithi134.stdout:1/953: creat d3/d6/d16/d4d/d65/f12f x:0 0 0 2024-04-13T10:59:24.311 INFO:tasks.workunit.client.0.smithi134.stdout:9/945: rename d13/d2e/d35/cbf to d13/d40/d7d/d118/c153 0 2024-04-13T10:59:24.312 INFO:tasks.workunit.client.0.smithi134.stdout:9/946: write d13/d39/d64/f11f [1008181,71766] 0 2024-04-13T10:59:24.314 INFO:tasks.workunit.client.0.smithi134.stdout:0/780: creat d4/d17/d23/d51/d6a/d94/db2/f119 x:0 0 0 2024-04-13T10:59:24.314 INFO:tasks.workunit.client.0.smithi134.stdout:1/954: fdatasync d3/ff 0 2024-04-13T10:59:24.316 INFO:tasks.workunit.client.0.smithi134.stdout:0/781: stat d4/d17/d23/d51/d6a/d94/f67 0 2024-04-13T10:59:24.321 INFO:tasks.workunit.client.0.smithi134.stdout:9/947: getdents d13/d39/d13a 0 2024-04-13T10:59:24.323 INFO:tasks.workunit.client.0.smithi134.stdout:1/955: fsync d3/d6/d20/d6d/db1/fe8 0 2024-04-13T10:59:24.324 INFO:tasks.workunit.client.0.smithi134.stdout:1/956: dread - d3/d6/d20/f12d zero size 2024-04-13T10:59:24.337 INFO:tasks.workunit.client.0.smithi134.stdout:9/948: write d13/d39/d58/fcf [3585497,72640] 0 2024-04-13T10:59:24.338 INFO:tasks.workunit.client.0.smithi134.stdout:0/782: dread d4/d17/d20/da9/de1/dfc/d6d/d97/fea [0,4194304] 0 2024-04-13T10:59:24.340 INFO:tasks.workunit.client.0.smithi134.stdout:1/957: rename d3/d6/d20/d6d/db1/fef to d3/d6/d16/f130 0 2024-04-13T10:59:24.342 INFO:tasks.workunit.client.0.smithi134.stdout:9/949: symlink d13/d39/d64/db2/d123/l154 0 2024-04-13T10:59:24.344 INFO:tasks.workunit.client.0.smithi134.stdout:0/783: mknod d4/d17/d20/d29/dcd/dfb/c11a 0 2024-04-13T10:59:24.348 INFO:tasks.workunit.client.0.smithi134.stdout:0/784: stat d4/d17/d20/da9/de1/dfc/d6d/d97/fea 0 2024-04-13T10:59:24.350 INFO:tasks.workunit.client.0.smithi134.stdout:1/958: dwrite d3/d30/fb7 [0,4194304] 0 2024-04-13T10:59:24.351 INFO:tasks.workunit.client.0.smithi134.stdout:0/785: write d4/d17/d23/d51/d6b/f108 [30611,76334] 0 2024-04-13T10:59:24.353 INFO:tasks.workunit.client.0.smithi134.stdout:9/950: truncate d13/d39/f151 8125182 0 2024-04-13T10:59:24.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/786: rmdir d4/d17/d20/da9/de1/dcf/d96 39 2024-04-13T10:59:24.358 INFO:tasks.workunit.client.0.smithi134.stdout:1/959: write d3/d6/d20/f6b [545478,2262] 0 2024-04-13T10:59:24.359 INFO:tasks.workunit.client.0.smithi134.stdout:0/787: fsync d4/d17/d20/d29/d30/d64/d84/f86 0 2024-04-13T10:59:24.364 INFO:tasks.workunit.client.0.smithi134.stdout:1/960: link d3/d6/d20/ff2 d3/d6/d16/d1d/d110/f131 0 2024-04-13T10:59:24.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/961: chown d3/d6/d6a/cb2 2 1 2024-04-13T10:59:24.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/962: chown d3/d6/d16/f127 0 1 2024-04-13T10:59:24.371 INFO:tasks.workunit.client.0.smithi134.stdout:1/963: chown d3/d6/d20/f100 3933 1 2024-04-13T10:59:24.374 INFO:tasks.workunit.client.0.smithi134.stdout:9/951: write d13/d2e/d47/fc4 [89089,28169] 0 2024-04-13T10:59:24.377 INFO:tasks.workunit.client.0.smithi134.stdout:9/952: symlink d13/d39/d58/d5f/d107/l155 0 2024-04-13T10:59:24.381 INFO:tasks.workunit.client.0.smithi134.stdout:1/964: link d3/d6/d20/d71/d9c/cb3 d3/d6/d20/d6d/c132 0 2024-04-13T10:59:24.384 INFO:tasks.workunit.client.0.smithi134.stdout:1/965: creat d3/d6/d16/d1d/d3c/f133 x:0 0 0 2024-04-13T10:59:24.384 INFO:tasks.workunit.client.0.smithi134.stdout:9/953: link d13/d40/cdc d13/d39/d58/d5f/dac/c156 0 2024-04-13T10:59:24.387 INFO:tasks.workunit.client.0.smithi134.stdout:9/954: dread d13/d39/d58/d5f/dbb/fcd [0,4194304] 0 2024-04-13T10:59:24.388 INFO:tasks.workunit.client.0.smithi134.stdout:1/966: rename d3/d6/d20/d6d/c72 to d3/d6/d16/d4d/d65/df7/d11c/c134 0 2024-04-13T10:59:24.390 INFO:tasks.workunit.client.0.smithi134.stdout:1/967: write d3/d6/d16/d1d/f26 [5259387,10536] 0 2024-04-13T10:59:24.391 INFO:tasks.workunit.client.0.smithi134.stdout:9/955: creat d13/da3/f157 x:0 0 0 2024-04-13T10:59:24.395 INFO:tasks.workunit.client.0.smithi134.stdout:9/956: mknod d13/d40/c158 0 2024-04-13T10:59:24.397 INFO:tasks.workunit.client.0.smithi134.stdout:9/957: unlink d13/d40/d7d/l83 0 2024-04-13T10:59:24.398 INFO:tasks.workunit.client.0.smithi134.stdout:9/958: truncate d13/da3/fc9 5219438 0 2024-04-13T10:59:24.399 INFO:tasks.workunit.client.0.smithi134.stdout:9/959: chown d13/d2e/ffd 54866512 1 2024-04-13T10:59:24.401 INFO:tasks.workunit.client.0.smithi134.stdout:9/960: dread - d13/d39/d58/d5f/dac/d11a/d133/fa9 zero size 2024-04-13T10:59:24.403 INFO:tasks.workunit.client.0.smithi134.stdout:9/961: fdatasync d13/d39/f45 0 2024-04-13T10:59:24.404 INFO:tasks.workunit.client.0.smithi134.stdout:9/962: stat d13/d2e/d47/c75 0 2024-04-13T10:59:24.404 INFO:tasks.workunit.client.0.smithi134.stdout:9/963: fdatasync d13/da3/fc9 0 2024-04-13T10:59:24.407 INFO:tasks.workunit.client.0.smithi134.stdout:9/964: read d13/f76 [3424435,114066] 0 2024-04-13T10:59:24.415 INFO:tasks.workunit.client.0.smithi134.stdout:1/968: dwrite d3/d6/f31 [0,4194304] 0 2024-04-13T10:59:24.417 INFO:tasks.workunit.client.0.smithi134.stdout:1/969: chown d3/d6/dd/cc7 171640 1 2024-04-13T10:59:24.423 INFO:tasks.workunit.client.0.smithi134.stdout:9/965: dwrite d13/d39/d58/f66 [0,4194304] 0 2024-04-13T10:59:24.426 INFO:tasks.workunit.client.0.smithi134.stdout:1/970: dread d3/d6/d16/d4d/d111/f10f [0,4194304] 0 2024-04-13T10:59:24.429 INFO:tasks.workunit.client.0.smithi134.stdout:1/971: creat d3/d6/d20/f135 x:0 0 0 2024-04-13T10:59:24.435 INFO:tasks.workunit.client.0.smithi134.stdout:9/966: dwrite d13/d39/d13a/f13f [0,4194304] 0 2024-04-13T10:59:24.439 INFO:tasks.workunit.client.0.smithi134.stdout:9/967: truncate d13/d40/d7d/dfb/f8c 894739 0 2024-04-13T10:59:24.440 INFO:tasks.workunit.client.0.smithi134.stdout:9/968: write d13/d39/d64/f12b [257960,113267] 0 2024-04-13T10:59:24.442 INFO:tasks.workunit.client.0.smithi134.stdout:9/969: stat d13/d39/d58 0 2024-04-13T10:59:24.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.446+0000 7fa7d665f700 1 -- 172.21.15.134:0/3675287162 --> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7d0105ca0 con 0x7fa7bc06ce20 2024-04-13T10:59:24.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.447+0000 7fa7cd7fa700 1 -- 172.21.15.134:0/3675287162 <== mgr.24351 v2:172.21.15.194:6828/1685298182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fa7d0105ca0 con 0x7fa7bc06ce20 2024-04-13T10:59:24.448 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:59:24.448 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T10:59:24.448 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T10:59:24.448 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-13T10:59:24.448 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-04-13T10:59:24.448 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "", 2024-04-13T10:59:24.448 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mgr daemons", 2024-04-13T10:59:24.448 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T10:59:24.448 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:59:24.449 INFO:tasks.workunit.client.0.smithi134.stdout:9/970: creat d13/d40/d11c/f159 x:0 0 0 2024-04-13T10:59:24.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 -- 172.21.15.134:0/3675287162 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa7bc06ce20 msgr2=0x7fa7bc06f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:24.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa7bc06ce20 0x7fa7bc06f2d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000b5c0 tx=0x7fa7c0005960 comp rx=0 tx=0).stop 2024-04-13T10:59:24.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 -- 172.21.15.134:0/3675287162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d0100150 msgr2=0x7fa7d01958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:24.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d0100150 0x7fa7d01958a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800d900 tx=0x7fa7b800dcc0 comp rx=0 tx=0).stop 2024-04-13T10:59:24.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 -- 172.21.15.134:0/3675287162 shutdown_connections 2024-04-13T10:59:24.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.194:6828/1685298182,v1:172.21.15.194:6829/1685298182] conn(0x7fa7bc06ce20 0x7fa7bc06f2d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:24.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7d0100150 0x7fa7d01958a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:24.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 --2- 172.21.15.134:0/3675287162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d0101350 0x7fa7d0195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:24.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 -- 172.21.15.134:0/3675287162 >> 172.21.15.134:0/3675287162 conn(0x7fa7d00fb6e0 msgr2=0x7fa7d0104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:24.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 -- 172.21.15.134:0/3675287162 shutdown_connections 2024-04-13T10:59:24.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:24.450+0000 7fa7d665f700 1 -- 172.21.15.134:0/3675287162 wait complete. 2024-04-13T10:59:24.452 INFO:tasks.workunit.client.0.smithi134.stdout:9/971: creat d13/d39/d52/d6b/d150/d9f/db0/f15a x:0 0 0 2024-04-13T10:59:24.455 INFO:tasks.workunit.client.0.smithi134.stdout:9/972: fsync d13/d39/d58/d5f/d6e/fda 0 2024-04-13T10:59:24.457 INFO:tasks.workunit.client.0.smithi134.stdout:9/973: symlink d13/d2e/d35/d50/l15b 0 2024-04-13T10:59:24.468 INFO:tasks.workunit.client.0.smithi134.stdout:9/974: dwrite d13/d39/d58/dd5/de5/d10a/f10c [4194304,4194304] 0 2024-04-13T10:59:24.471 INFO:tasks.workunit.client.0.smithi134.stdout:9/975: symlink d13/d40/l15c 0 2024-04-13T10:59:24.474 INFO:tasks.workunit.client.0.smithi134.stdout:9/976: symlink d13/d39/d64/db2/dd6/l15d 0 2024-04-13T10:59:24.477 INFO:tasks.workunit.client.0.smithi134.stdout:9/977: mknod d13/d2e/d47/dc1/c15e 0 2024-04-13T10:59:24.481 INFO:tasks.workunit.client.0.smithi134.stdout:9/978: getdents d13/da3 0 2024-04-13T10:59:24.484 INFO:tasks.workunit.client.0.smithi134.stdout:9/979: mkdir d13/d39/d58/dd5/dfc/d15f 0 2024-04-13T10:59:24.486 INFO:tasks.workunit.client.0.smithi134.stdout:9/980: rmdir d13/d39/d13a 39 2024-04-13T10:59:24.488 INFO:tasks.workunit.client.0.smithi134.stdout:9/981: getdents d13/d39/d64/db2/d100/d13d 0 2024-04-13T10:59:24.490 INFO:tasks.workunit.client.0.smithi134.stdout:9/982: unlink d13/d2e/d35/c145 0 2024-04-13T10:59:24.494 INFO:tasks.workunit.client.0.smithi134.stdout:9/983: read d13/d39/f4e [470913,86130] 0 2024-04-13T10:59:24.498 INFO:tasks.workunit.client.0.smithi134.stdout:9/984: dread d13/d40/d7d/dfb/f7c [0,4194304] 0 2024-04-13T10:59:24.508 INFO:tasks.workunit.client.0.smithi134.stdout:9/985: dwrite d13/d39/d58/d5f/d6e/fda [0,4194304] 0 2024-04-13T10:59:24.513 INFO:tasks.workunit.client.0.smithi134.stdout:9/986: mknod d13/d2e/d35/d50/d60/c160 0 2024-04-13T10:59:24.528 INFO:tasks.workunit.client.0.smithi134.stdout:9/987: dread d13/d2e/d47/f94 [0,4194304] 0 2024-04-13T10:59:24.531 INFO:tasks.workunit.client.0.smithi134.stdout:9/988: rename d13/d40/d7d/dfb/f115 to d13/d39/d58/d5f/dac/d102/f161 0 2024-04-13T10:59:24.533 INFO:tasks.workunit.client.0.smithi134.stdout:9/989: creat d13/d2e/d35/f162 x:0 0 0 2024-04-13T10:59:24.537 INFO:tasks.workunit.client.0.smithi134.stdout:9/990: creat d13/d39/d58/d5f/dac/f163 x:0 0 0 2024-04-13T10:59:24.539 INFO:tasks.workunit.client.0.smithi134.stdout:9/991: creat d13/da3/d134/f164 x:0 0 0 2024-04-13T10:59:24.540 INFO:tasks.workunit.client.0.smithi134.stdout:9/992: truncate d13/d39/d52/da2/f131 728715 0 2024-04-13T10:59:24.542 INFO:tasks.workunit.client.0.smithi134.stdout:9/993: symlink d13/d39/d58/d5f/d107/l165 0 2024-04-13T10:59:24.543 INFO:tasks.workunit.client.0.smithi134.stdout:9/994: read - d13/d39/d58/dd5/dfc/f117 zero size 2024-04-13T10:59:24.543 INFO:tasks.workunit.client.0.smithi134.stdout:9/995: readlink d13/d2e/la7 0 2024-04-13T10:59:24.549 INFO:tasks.workunit.client.0.smithi134.stdout:9/996: link d13/d2e/d47/de7/l114 d13/d39/d58/dd5/dfc/l166 0 2024-04-13T10:59:24.553 INFO:tasks.workunit.client.0.smithi134.stdout:9/997: rename d13/d39/d64/db2/dd6/d10b to d13/d39/d58/d5f/d107/d167 0 2024-04-13T10:59:24.555 INFO:tasks.workunit.client.0.smithi134.stdout:9/998: mknod d13/d2e/d35/d50/d59/c168 0 2024-04-13T10:59:24.556 INFO:tasks.workunit.client.0.smithi134.stdout:9/999: stat d13/cf7 0 2024-04-13T10:59:24.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:24 smithi134 ceph-mon[39696]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:24.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:24 smithi134 ceph-mon[39696]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:24.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:24 smithi134 ceph-mon[39696]: pgmap v46: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 143 MiB/s wr, 350 op/s 2024-04-13T10:59:24.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:24 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/66197667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:59:24.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:24 smithi194 ceph-mon[46737]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:24.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:24 smithi194 ceph-mon[46737]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:24.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:24 smithi194 ceph-mon[46737]: pgmap v46: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 143 MiB/s wr, 350 op/s 2024-04-13T10:59:24.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:24 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/66197667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:59:24.818 INFO:tasks.workunit.client.0.smithi134.stdout:2/695: sync 2024-04-13T10:59:24.828 INFO:tasks.workunit.client.0.smithi134.stdout:2/696: dread d5/de/d50/f56 [0,4194304] 0 2024-04-13T10:59:24.831 INFO:tasks.workunit.client.0.smithi134.stdout:2/697: truncate d5/d6/d57/d6c/f67 724739 0 2024-04-13T10:59:24.834 INFO:tasks.workunit.client.0.smithi134.stdout:2/698: creat d5/d6/d57/fc8 x:0 0 0 2024-04-13T10:59:24.835 INFO:tasks.workunit.client.0.smithi134.stdout:2/699: readlink d5/l35 0 2024-04-13T10:59:24.846 INFO:tasks.workunit.client.0.smithi134.stdout:2/700: mknod d5/d6/d57/cc9 0 2024-04-13T10:59:24.849 INFO:tasks.workunit.client.0.smithi134.stdout:2/701: truncate d5/d6/d57/d6f/d30/d58/d73/f83 4870992 0 2024-04-13T10:59:24.856 INFO:tasks.workunit.client.0.smithi134.stdout:2/702: dwrite d5/de/d50/f6b [4194304,4194304] 0 2024-04-13T10:59:24.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/703: creat d5/d6/d57/d6f/fca x:0 0 0 2024-04-13T10:59:24.866 INFO:tasks.workunit.client.0.smithi134.stdout:2/704: dwrite d5/d6/d57/d6c/f49 [4194304,4194304] 0 2024-04-13T10:59:24.870 INFO:tasks.workunit.client.0.smithi134.stdout:2/705: link d5/d6/d57/d6f/d30/fb7 d5/de/db3/fcb 0 2024-04-13T10:59:24.873 INFO:tasks.workunit.client.0.smithi134.stdout:2/706: mknod d5/d6/d70/d84/ccc 0 2024-04-13T10:59:24.876 INFO:tasks.workunit.client.0.smithi134.stdout:2/707: mknod d5/ccd 0 2024-04-13T10:59:24.876 INFO:tasks.workunit.client.0.smithi134.stdout:2/708: chown d5/d6 1224019786 1 2024-04-13T10:59:24.883 INFO:tasks.workunit.client.0.smithi134.stdout:2/709: dwrite d5/d6/d57/d6f/fca [0,4194304] 0 2024-04-13T10:59:24.886 INFO:tasks.workunit.client.0.smithi134.stdout:2/710: creat d5/d6/d57/d6f/fce x:0 0 0 2024-04-13T10:59:24.893 INFO:tasks.workunit.client.0.smithi134.stdout:2/711: unlink d5/d6/d57/l47 0 2024-04-13T10:59:24.904 INFO:tasks.workunit.client.0.smithi134.stdout:2/712: dwrite d5/de/d50/f5d [0,4194304] 0 2024-04-13T10:59:24.911 INFO:tasks.workunit.client.0.smithi134.stdout:3/730: sync 2024-04-13T10:59:24.911 INFO:tasks.workunit.client.0.smithi134.stdout:8/911: sync 2024-04-13T10:59:24.911 INFO:tasks.workunit.client.0.smithi134.stdout:6/893: sync 2024-04-13T10:59:24.914 INFO:tasks.workunit.client.0.smithi134.stdout:6/894: chown d4/da/d15/d1f/d24/d49/f9e 0 1 2024-04-13T10:59:24.914 INFO:tasks.workunit.client.0.smithi134.stdout:8/912: creat d8/dc/d13/ddf/f12e x:0 0 0 2024-04-13T10:59:24.916 INFO:tasks.workunit.client.0.smithi134.stdout:2/713: dwrite d5/d6/d57/d6f/d30/f4f [0,4194304] 0 2024-04-13T10:59:24.920 INFO:tasks.workunit.client.0.smithi134.stdout:3/731: rename dc/d1d/d58/db4 to dc/d27/d19/db1/df7 0 2024-04-13T10:59:24.922 INFO:tasks.workunit.client.0.smithi134.stdout:8/913: dread d8/dc/d16/d4e/d76/fda [0,4194304] 0 2024-04-13T10:59:24.929 INFO:tasks.workunit.client.0.smithi134.stdout:2/714: symlink d5/de/d12/lcf 0 2024-04-13T10:59:24.931 INFO:tasks.workunit.client.0.smithi134.stdout:3/732: creat dc/d27/d19/d48/d49/ff8 x:0 0 0 2024-04-13T10:59:24.938 INFO:tasks.workunit.client.0.smithi134.stdout:6/895: mkdir d4/da/d15/d1f/d24/ddf/dfe/d128 0 2024-04-13T10:59:24.940 INFO:tasks.workunit.client.0.smithi134.stdout:6/896: dread - d4/da/d15/d1f/d24/ff2 zero size 2024-04-13T10:59:24.940 INFO:tasks.workunit.client.0.smithi134.stdout:2/715: symlink d5/d6/d57/d6f/d30/d58/d59/ld0 0 2024-04-13T10:59:24.941 INFO:tasks.workunit.client.0.smithi134.stdout:6/897: write d4/da/dbb/dc3/fab [5546246,33401] 0 2024-04-13T10:59:24.943 INFO:tasks.workunit.client.0.smithi134.stdout:3/733: dread - dc/d27/d95/fbe zero size 2024-04-13T10:59:24.944 INFO:tasks.workunit.client.0.smithi134.stdout:6/898: fdatasync d4/da/dbb/dc3/f113 0 2024-04-13T10:59:24.950 INFO:tasks.workunit.client.0.smithi134.stdout:2/716: dwrite d5/de/f65 [4194304,4194304] 0 2024-04-13T10:59:24.951 INFO:tasks.workunit.client.0.smithi134.stdout:8/914: dwrite d8/dc/d37/f64 [0,4194304] 0 2024-04-13T10:59:24.951 INFO:tasks.workunit.client.0.smithi134.stdout:6/899: truncate d4/da/d15/d1f/d24/f9a 2080456 0 2024-04-13T10:59:24.955 INFO:tasks.workunit.client.0.smithi134.stdout:2/717: write d5/d6/d70/f90 [752291,23611] 0 2024-04-13T10:59:24.956 INFO:tasks.workunit.client.0.smithi134.stdout:6/900: write d4/da/d1a/de6/ff5 [1283685,41331] 0 2024-04-13T10:59:24.959 INFO:tasks.workunit.client.0.smithi134.stdout:6/901: read - d4/da/dbb/dc3/f11c zero size 2024-04-13T10:59:24.960 INFO:tasks.workunit.client.0.smithi134.stdout:6/902: chown d4/da/dbb/dca/f112 25248 1 2024-04-13T10:59:24.961 INFO:tasks.workunit.client.0.smithi134.stdout:8/915: creat d8/dc/d2c/d68/d8c/f12f x:0 0 0 2024-04-13T10:59:24.963 INFO:tasks.workunit.client.0.smithi134.stdout:8/916: write d8/dc/d16/d4e/d9c/fd9 [2078775,107025] 0 2024-04-13T10:59:24.966 INFO:tasks.workunit.client.0.smithi134.stdout:3/734: getdents dc 0 2024-04-13T10:59:24.972 INFO:tasks.workunit.client.0.smithi134.stdout:2/718: mkdir d5/d6/d57/d6f/d30/dd1 0 2024-04-13T10:59:24.975 INFO:tasks.workunit.client.0.smithi134.stdout:8/917: getdents d8/dc/d9d/d69/d12c 0 2024-04-13T10:59:24.977 INFO:tasks.workunit.client.0.smithi134.stdout:2/719: dread d5/d6/d57/d6c/f28 [4194304,4194304] 0 2024-04-13T10:59:24.982 INFO:tasks.workunit.client.0.smithi134.stdout:2/720: creat d5/d6/df/fd2 x:0 0 0 2024-04-13T10:59:24.982 INFO:tasks.workunit.client.0.smithi134.stdout:6/903: truncate d4/da/d15/d1f/d24/d49/d91/fb0 1052135 0 2024-04-13T10:59:24.986 INFO:tasks.workunit.client.0.smithi134.stdout:3/735: rename dc/d27/d19/d8b/da8/d50/d25/d5f/d75/d8f/ld5 to dc/d27/d19/d8b/da8/d50/lf9 0 2024-04-13T10:59:24.988 INFO:tasks.workunit.client.0.smithi134.stdout:2/721: unlink d5/d6/d57/cc9 0 2024-04-13T10:59:24.989 INFO:tasks.workunit.client.0.smithi134.stdout:8/918: creat d8/dc/d16/d54/f130 x:0 0 0 2024-04-13T10:59:24.990 INFO:tasks.workunit.client.0.smithi134.stdout:8/919: fsync d8/f112 0 2024-04-13T10:59:24.990 INFO:tasks.workunit.client.0.smithi134.stdout:0/788: sync 2024-04-13T10:59:24.990 INFO:tasks.workunit.client.0.smithi134.stdout:1/972: sync 2024-04-13T10:59:24.990 INFO:tasks.workunit.client.0.smithi134.stdout:4/721: sync 2024-04-13T10:59:24.990 INFO:tasks.workunit.client.0.smithi134.stdout:7/769: sync 2024-04-13T10:59:24.991 INFO:tasks.workunit.client.0.smithi134.stdout:3/736: creat dc/d27/d19/d8b/ffa x:0 0 0 2024-04-13T10:59:24.994 INFO:tasks.workunit.client.0.smithi134.stdout:2/722: creat d5/d6/d57/d6f/d30/d88/fd3 x:0 0 0 2024-04-13T10:59:24.998 INFO:tasks.workunit.client.0.smithi134.stdout:3/737: write dc/fd [436321,45281] 0 2024-04-13T10:59:25.000 INFO:tasks.workunit.client.0.smithi134.stdout:0/789: dwrite d4/d17/d20/da9/de1/dfc/f5f [0,4194304] 0 2024-04-13T10:59:25.001 INFO:tasks.workunit.client.0.smithi134.stdout:8/920: rmdir d8/dc/d16/d54/d6c/d94/dc0 39 2024-04-13T10:59:25.008 INFO:tasks.workunit.client.0.smithi134.stdout:4/722: creat d4/d1f/d27/d2e/d84/dde/fec x:0 0 0 2024-04-13T10:59:25.013 INFO:tasks.workunit.client.0.smithi134.stdout:0/790: creat d4/d17/d20/d29/dcd/f11b x:0 0 0 2024-04-13T10:59:25.014 INFO:tasks.workunit.client.0.smithi134.stdout:6/904: dwrite d4/da/f25 [0,4194304] 0 2024-04-13T10:59:25.016 INFO:tasks.workunit.client.0.smithi134.stdout:4/723: creat d4/d1f/d27/d75/d38/fed x:0 0 0 2024-04-13T10:59:25.017 INFO:tasks.workunit.client.0.smithi134.stdout:4/724: chown d4/d48/d50/fc2 6077074 1 2024-04-13T10:59:25.020 INFO:tasks.workunit.client.0.smithi134.stdout:4/725: dread d4/d82/fb4 [0,4194304] 0 2024-04-13T10:59:25.022 INFO:tasks.workunit.client.0.smithi134.stdout:0/791: mknod d4/d17/d20/d29/d30/c11c 0 2024-04-13T10:59:25.023 INFO:tasks.workunit.client.0.smithi134.stdout:6/905: fdatasync d4/da/d15/d1f/d24/da4/fb2 0 2024-04-13T10:59:25.027 INFO:tasks.workunit.client.0.smithi134.stdout:1/973: getdents d3/d6/d16/d4d/d65/df7 0 2024-04-13T10:59:25.027 INFO:tasks.workunit.client.0.smithi134.stdout:6/906: dread d4/da/d15/fd3 [0,4194304] 0 2024-04-13T10:59:25.031 INFO:tasks.workunit.client.0.smithi134.stdout:8/921: creat d8/dc/d16/d54/d6c/d94/f131 x:0 0 0 2024-04-13T10:59:25.033 INFO:tasks.workunit.client.0.smithi134.stdout:4/726: mkdir d4/d1f/d27/d75/d38/d79/d73/dee 0 2024-04-13T10:59:25.036 INFO:tasks.workunit.client.0.smithi134.stdout:3/738: getdents dc/d27/d19/d8b/da8/d50 0 2024-04-13T10:59:25.038 INFO:tasks.workunit.client.0.smithi134.stdout:3/739: write dc/d27/d19/db1/fd7 [4570254,101340] 0 2024-04-13T10:59:25.041 INFO:tasks.workunit.client.0.smithi134.stdout:8/922: mkdir d8/dc/d13/ddf/d132 0 2024-04-13T10:59:25.045 INFO:tasks.workunit.client.0.smithi134.stdout:0/792: dwrite d4/d17/d23/d51/d6b/d91/d98/d62/d7c/fdb [0,4194304] 0 2024-04-13T10:59:25.050 INFO:tasks.workunit.client.0.smithi134.stdout:0/793: write d4/f10e [995823,126543] 0 2024-04-13T10:59:25.051 INFO:tasks.workunit.client.0.smithi134.stdout:4/727: creat d4/d1f/d27/d75/d38/d79/db9/fef x:0 0 0 2024-04-13T10:59:25.051 INFO:tasks.workunit.client.0.smithi134.stdout:3/740: dread dc/d27/d19/d8b/da8/f68 [0,4194304] 0 2024-04-13T10:59:25.053 INFO:tasks.workunit.client.0.smithi134.stdout:4/728: fsync d4/d1f/d27/d2e/d84/dde/fda 0 2024-04-13T10:59:25.056 INFO:tasks.workunit.client.0.smithi134.stdout:8/923: mkdir d8/dc/d16/d4e/d9c/d133 0 2024-04-13T10:59:25.058 INFO:tasks.workunit.client.0.smithi134.stdout:1/974: creat d3/d6/de3/d124/f136 x:0 0 0 2024-04-13T10:59:25.067 INFO:tasks.workunit.client.0.smithi134.stdout:6/907: dwrite d4/da/d15/d1f/d24/fb3 [0,4194304] 0 2024-04-13T10:59:25.069 INFO:tasks.workunit.client.0.smithi134.stdout:1/975: dwrite d3/d6/f31 [4194304,4194304] 0 2024-04-13T10:59:25.075 INFO:tasks.workunit.client.0.smithi134.stdout:4/729: link d4/f7a d4/dd/d6d/ff0 0 2024-04-13T10:59:25.077 INFO:tasks.workunit.client.0.smithi134.stdout:0/794: write d4/d17/d23/d51/d6a/d94/db2/f63 [210033,112162] 0 2024-04-13T10:59:25.080 INFO:tasks.workunit.client.0.smithi134.stdout:8/924: rmdir d8/dc/d16/d74 39 2024-04-13T10:59:25.085 INFO:tasks.workunit.client.0.smithi134.stdout:3/741: dwrite dc/d27/d4d/f34 [0,4194304] 0 2024-04-13T10:59:25.087 INFO:tasks.workunit.client.0.smithi134.stdout:4/730: creat d4/d48/d86/ff1 x:0 0 0 2024-04-13T10:59:25.088 INFO:tasks.workunit.client.0.smithi134.stdout:4/731: fdatasync d4/d1f/d27/d2e/d84/dde/fec 0 2024-04-13T10:59:25.094 INFO:tasks.workunit.client.0.smithi134.stdout:6/908: mknod d4/da/d15/d76/c129 0 2024-04-13T10:59:25.095 INFO:tasks.workunit.client.0.smithi134.stdout:6/909: chown d4/da/d15/d1f/d24/d10b/f118 59 1 2024-04-13T10:59:25.096 INFO:tasks.workunit.client.0.smithi134.stdout:3/742: unlink dc/d1d/l78 0 2024-04-13T10:59:25.099 INFO:tasks.workunit.client.0.smithi134.stdout:8/925: dread d8/dc/d16/d54/f77 [0,4194304] 0 2024-04-13T10:59:25.100 INFO:tasks.workunit.client.0.smithi134.stdout:4/732: rmdir d4/d1f/d27/d3a 39 2024-04-13T10:59:25.100 INFO:tasks.workunit.client.0.smithi134.stdout:8/926: dread - d8/dc/d16/d54/d6c/f116 zero size 2024-04-13T10:59:25.102 INFO:tasks.workunit.client.0.smithi134.stdout:1/976: link d3/d30/ff5 d3/d6/de3/f137 0 2024-04-13T10:59:25.106 INFO:tasks.workunit.client.0.smithi134.stdout:0/795: rename d4/d17/d23/d51/d6b/d91/d98/d62/d7c/l9f to d4/d17/d23/d51/d6a/l11d 0 2024-04-13T10:59:25.106 INFO:tasks.workunit.client.0.smithi134.stdout:6/910: dread d4/da/dbb/dad/fd8 [0,4194304] 0 2024-04-13T10:59:25.107 INFO:tasks.workunit.client.0.smithi134.stdout:0/796: chown d4/d17/d20/da9/de1/dfc/d6d/da5/dd9 16516199 1 2024-04-13T10:59:25.111 INFO:tasks.workunit.client.0.smithi134.stdout:0/797: dread d4/d17/da/f27 [0,4194304] 0 2024-04-13T10:59:25.111 INFO:tasks.workunit.client.0.smithi134.stdout:8/927: creat d8/dc/d16/d54/d6c/d94/dc0/f134 x:0 0 0 2024-04-13T10:59:25.112 INFO:tasks.workunit.client.0.smithi134.stdout:0/798: readlink d4/d17/d20/da9/de1/dfc/d6d/le8 0 2024-04-13T10:59:25.112 INFO:tasks.workunit.client.0.smithi134.stdout:6/911: creat d4/da/d1a/de6/d120/f12a x:0 0 0 2024-04-13T10:59:25.114 INFO:tasks.workunit.client.0.smithi134.stdout:0/799: write d4/d17/d23/d51/d6b/d91/f99 [999765,43419] 0 2024-04-13T10:59:25.114 INFO:tasks.workunit.client.0.smithi134.stdout:6/912: write d4/da/d15/d1f/fb6 [564496,97529] 0 2024-04-13T10:59:25.116 INFO:tasks.workunit.client.0.smithi134.stdout:1/977: creat d3/d6/d16/d4d/d65/dcc/d117/f138 x:0 0 0 2024-04-13T10:59:25.117 INFO:tasks.workunit.client.0.smithi134.stdout:3/743: rmdir dc/d27/d19/d8b/d9b/dab 0 2024-04-13T10:59:25.120 INFO:tasks.workunit.client.0.smithi134.stdout:3/744: write dc/d27/d19/db1/df7/fd3 [411490,91493] 0 2024-04-13T10:59:25.121 INFO:tasks.workunit.client.0.smithi134.stdout:3/745: write dc/d27/d19/d48/d49/ff8 [669614,68850] 0 2024-04-13T10:59:25.124 INFO:tasks.workunit.client.0.smithi134.stdout:0/800: symlink d4/d17/da/d22/d41/d6e/d8a/d95/l11e 0 2024-04-13T10:59:25.125 INFO:tasks.workunit.client.0.smithi134.stdout:0/801: fsync d4/d17/d23/f2f 0 2024-04-13T10:59:25.127 INFO:tasks.workunit.client.0.smithi134.stdout:6/913: dread d4/da/d15/d1f/d24/f3a [4194304,4194304] 0 2024-04-13T10:59:25.128 INFO:tasks.workunit.client.0.smithi134.stdout:4/733: rename d4/d1f/d27/d75/d38/d79/d73 to d4/dd/df2 0 2024-04-13T10:59:25.129 INFO:tasks.workunit.client.0.smithi134.stdout:8/928: mknod d8/dc/d16/d54/d6c/d94/c135 0 2024-04-13T10:59:25.136 INFO:tasks.workunit.client.0.smithi134.stdout:6/914: dread d4/da/d15/d1f/d24/da4/fb2 [0,4194304] 0 2024-04-13T10:59:25.137 INFO:tasks.workunit.client.0.smithi134.stdout:0/802: chown d4/c2c 1876 1 2024-04-13T10:59:25.143 INFO:tasks.workunit.client.0.smithi134.stdout:0/803: dread d4/d17/d20/da9/de1/dcf/f5e [0,4194304] 0 2024-04-13T10:59:25.145 INFO:tasks.workunit.client.0.smithi134.stdout:3/746: creat dc/d27/d19/d48/dd9/ffb x:0 0 0 2024-04-13T10:59:25.146 INFO:tasks.workunit.client.0.smithi134.stdout:6/915: symlink d4/da/d68/l12b 0 2024-04-13T10:59:25.147 INFO:tasks.workunit.client.0.smithi134.stdout:6/916: chown d4/da/f25 170261672 1 2024-04-13T10:59:25.149 INFO:tasks.workunit.client.0.smithi134.stdout:4/734: mkdir d4/dd/df2/dee/df3 0 2024-04-13T10:59:25.152 INFO:tasks.workunit.client.0.smithi134.stdout:0/804: rmdir d4/d17/d23/d51/d6b/d91 39 2024-04-13T10:59:25.156 INFO:tasks.workunit.client.0.smithi134.stdout:4/735: mknod d4/dd/df2/dee/cf4 0 2024-04-13T10:59:25.159 INFO:tasks.workunit.client.0.smithi134.stdout:1/978: write d3/d6/d20/d89/fe4 [3246447,85828] 0 2024-04-13T10:59:25.161 INFO:tasks.workunit.client.0.smithi134.stdout:6/917: creat d4/da/d15/d1f/d24/f12c x:0 0 0 2024-04-13T10:59:25.162 INFO:tasks.workunit.client.0.smithi134.stdout:4/736: dread d4/dd/d6d/ff0 [0,4194304] 0 2024-04-13T10:59:25.163 INFO:tasks.workunit.client.0.smithi134.stdout:1/979: mknod d3/d6/d16/dff/c139 0 2024-04-13T10:59:25.164 INFO:tasks.workunit.client.0.smithi134.stdout:4/737: chown d4/d1f/d27/d75/d38/d79/c25 80 1 2024-04-13T10:59:25.166 INFO:tasks.workunit.client.0.smithi134.stdout:4/738: chown d4/d1f/d27/d75/d38/d79/d32/le9 101 1 2024-04-13T10:59:25.169 INFO:tasks.workunit.client.0.smithi134.stdout:4/739: creat d4/dd/d6d/ff5 x:0 0 0 2024-04-13T10:59:25.172 INFO:tasks.workunit.client.0.smithi134.stdout:6/918: getdents d4/da/d1a/de6 0 2024-04-13T10:59:25.176 INFO:tasks.workunit.client.0.smithi134.stdout:6/919: stat d4/da/d15/d76/dda/ff4 0 2024-04-13T10:59:25.180 INFO:tasks.workunit.client.0.smithi134.stdout:8/929: dwrite d8/f44 [0,4194304] 0 2024-04-13T10:59:25.184 INFO:tasks.workunit.client.0.smithi134.stdout:1/980: write d3/d6/d16/d4d/d111/fd6 [1027646,56534] 0 2024-04-13T10:59:25.184 INFO:tasks.workunit.client.0.smithi134.stdout:3/747: dwrite dc/d27/d19/d8b/da8/d50/d25/d5f/d75/d8f/fa0 [0,4194304] 0 2024-04-13T10:59:25.185 INFO:tasks.workunit.client.0.smithi134.stdout:6/920: read d4/f75 [1535209,78650] 0 2024-04-13T10:59:25.186 INFO:tasks.workunit.client.0.smithi134.stdout:6/921: chown d4/da/d15/cf3 699969585 1 2024-04-13T10:59:25.189 INFO:tasks.workunit.client.0.smithi134.stdout:4/740: link d4/d1f/d90/faa d4/d48/d4a/d7e/ff6 0 2024-04-13T10:59:25.191 INFO:tasks.workunit.client.0.smithi134.stdout:4/741: read d4/d48/d50/f98 [3955196,89652] 0 2024-04-13T10:59:25.192 INFO:tasks.workunit.client.0.smithi134.stdout:8/930: mkdir d8/dc/d16/d4e/d76/d136 0 2024-04-13T10:59:25.192 INFO:tasks.workunit.client.0.smithi134.stdout:8/931: stat d8/dc 0 2024-04-13T10:59:25.195 INFO:tasks.workunit.client.0.smithi134.stdout:3/748: rename dc/d27/c26 to dc/d27/d19/d8b/cfc 0 2024-04-13T10:59:25.201 INFO:tasks.workunit.client.0.smithi134.stdout:4/742: chown d4/dd/l11 843471097 1 2024-04-13T10:59:25.204 INFO:tasks.workunit.client.0.smithi134.stdout:8/932: dwrite d8/f112 [4194304,4194304] 0 2024-04-13T10:59:25.210 INFO:tasks.workunit.client.0.smithi134.stdout:3/749: creat dc/d27/d19/d8b/da8/d50/d25/d91/de9/ffd x:0 0 0 2024-04-13T10:59:25.211 INFO:tasks.workunit.client.0.smithi134.stdout:1/981: dwrite d3/d6/f27 [4194304,4194304] 0 2024-04-13T10:59:25.218 INFO:tasks.workunit.client.0.smithi134.stdout:4/743: dwrite d4/dd/fcb [0,4194304] 0 2024-04-13T10:59:25.221 INFO:tasks.workunit.client.0.smithi134.stdout:6/922: dread d4/da/d15/d1f/d24/fff [0,4194304] 0 2024-04-13T10:59:25.223 INFO:tasks.workunit.client.0.smithi134.stdout:3/750: rename dc/d27/d4d/fe5 to dc/d1d/d58/d72/ffe 0 2024-04-13T10:59:25.226 INFO:tasks.workunit.client.0.smithi134.stdout:1/982: symlink d3/d6/d16/d1d/d68/de2/d12b/l13a 0 2024-04-13T10:59:25.227 INFO:tasks.workunit.client.0.smithi134.stdout:1/983: chown d3/d30/lf0 48548 1 2024-04-13T10:59:25.230 INFO:tasks.workunit.client.0.smithi134.stdout:4/744: truncate d4/d48/d50/f98 7925708 0 2024-04-13T10:59:25.232 INFO:tasks.workunit.client.0.smithi134.stdout:8/933: dread d8/dc/d37/f71 [0,4194304] 0 2024-04-13T10:59:25.233 INFO:tasks.workunit.client.0.smithi134.stdout:1/984: mkdir d3/d6/d16/dff/d13b 0 2024-04-13T10:59:25.234 INFO:tasks.workunit.client.0.smithi134.stdout:1/985: readlink d3/d6/d16/d4d/d111/l11e 0 2024-04-13T10:59:25.238 INFO:tasks.workunit.client.0.smithi134.stdout:8/934: symlink d8/dc/d9d/d69/d120/l137 0 2024-04-13T10:59:25.239 INFO:tasks.workunit.client.0.smithi134.stdout:3/751: creat dc/d27/d19/d8b/da8/d50/d25/fff x:0 0 0 2024-04-13T10:59:25.240 INFO:tasks.workunit.client.0.smithi134.stdout:1/986: truncate d3/d6/d16/d4d/fb5 696235 0 2024-04-13T10:59:25.242 INFO:tasks.workunit.client.0.smithi134.stdout:1/987: truncate d3/d6/d20/d6d/f12e 1035517 0 2024-04-13T10:59:25.243 INFO:tasks.workunit.client.0.smithi134.stdout:4/745: symlink d4/d1f/d27/d3a/d53/d58/lf7 0 2024-04-13T10:59:25.243 INFO:tasks.workunit.client.0.smithi134.stdout:1/988: read - d3/d6/d16/dff/f101 zero size 2024-04-13T10:59:25.244 INFO:tasks.workunit.client.0.smithi134.stdout:4/746: dread - d4/d48/d86/ff1 zero size 2024-04-13T10:59:25.246 INFO:tasks.workunit.client.0.smithi134.stdout:3/752: mkdir dc/d100 0 2024-04-13T10:59:25.246 INFO:tasks.workunit.client.0.smithi134.stdout:6/923: write d4/da/d68/fe2 [2494279,8839] 0 2024-04-13T10:59:25.249 INFO:tasks.workunit.client.0.smithi134.stdout:1/989: rmdir d3/d6/d20/d6d 39 2024-04-13T10:59:25.252 INFO:tasks.workunit.client.0.smithi134.stdout:4/747: unlink d4/d1f/d27/d75/d38/f4e 0 2024-04-13T10:59:25.256 INFO:tasks.workunit.client.0.smithi134.stdout:6/924: rename d4/da/f95 to d4/da/d15/d1f/d24/da4/dfb/f12d 0 2024-04-13T10:59:25.258 INFO:tasks.workunit.client.0.smithi134.stdout:8/935: write d8/dc/d37/f3a [1439204,1880] 0 2024-04-13T10:59:25.261 INFO:tasks.workunit.client.0.smithi134.stdout:4/748: creat d4/d1f/d90/ff8 x:0 0 0 2024-04-13T10:59:25.262 INFO:tasks.workunit.client.0.smithi134.stdout:4/749: write d4/d1f/d27/d75/d38/d79/f28 [317355,82988] 0 2024-04-13T10:59:25.268 INFO:tasks.workunit.client.0.smithi134.stdout:1/990: dwrite d3/d6/d20/d28/f95 [0,4194304] 0 2024-04-13T10:59:25.269 INFO:tasks.workunit.client.0.smithi134.stdout:8/936: creat d8/dc/d2c/d68/d8c/d8f/f138 x:0 0 0 2024-04-13T10:59:25.282 INFO:tasks.workunit.client.0.smithi134.stdout:8/937: fsync d8/dc/d2c/d68/d8c/d8f/fa9 0 2024-04-13T10:59:25.284 INFO:tasks.workunit.client.0.smithi134.stdout:3/753: creat dc/f101 x:0 0 0 2024-04-13T10:59:25.284 INFO:tasks.workunit.client.0.smithi134.stdout:8/938: dread - d8/dc/d16/d54/d6c/d94/de7/f10f zero size 2024-04-13T10:59:25.285 INFO:tasks.workunit.client.0.smithi134.stdout:8/939: write d8/dc/d2c/d68/d8c/fba [4472454,126078] 0 2024-04-13T10:59:25.287 INFO:tasks.workunit.client.0.smithi134.stdout:8/940: write d8/dc/d16/d54/d6c/f9f [200500,76750] 0 2024-04-13T10:59:25.287 INFO:tasks.workunit.client.0.smithi134.stdout:6/925: truncate d4/f4d 2875382 0 2024-04-13T10:59:25.289 INFO:tasks.workunit.client.0.smithi134.stdout:8/941: chown d8/dc/d13/ddf/fea 1902107 1 2024-04-13T10:59:25.289 INFO:tasks.workunit.client.0.smithi134.stdout:4/750: truncate d4/dd/d6d/f80 4087947 0 2024-04-13T10:59:25.291 INFO:tasks.workunit.client.0.smithi134.stdout:3/754: chown dc/d27/d19/d8b/da8/d50/d25/d5f/c61 318 1 2024-04-13T10:59:25.293 INFO:tasks.workunit.client.0.smithi134.stdout:1/991: link d3/d6/d16/c5a d3/d6/d16/d4d/d65/dcc/d117/c13c 0 2024-04-13T10:59:25.305 INFO:tasks.workunit.client.0.smithi134.stdout:1/992: dread d3/d6/f15 [0,4194304] 0 2024-04-13T10:59:25.306 INFO:tasks.workunit.client.0.smithi134.stdout:4/751: mknod d4/d1f/d27/cf9 0 2024-04-13T10:59:25.316 INFO:tasks.workunit.client.0.smithi134.stdout:4/752: creat d4/d1f/d27/d3a/d65/ffa x:0 0 0 2024-04-13T10:59:25.318 INFO:tasks.workunit.client.0.smithi134.stdout:8/942: dwrite d8/dc/d16/d54/ff3 [4194304,4194304] 0 2024-04-13T10:59:25.320 INFO:tasks.workunit.client.0.smithi134.stdout:6/926: rename d4/da/d15/d1f/d24/d49/d91/f125 to d4/da/d15/d1f/d3c/f12e 0 2024-04-13T10:59:25.321 INFO:tasks.workunit.client.0.smithi134.stdout:1/993: symlink d3/d6/d20/d71/d107/d12c/l13d 0 2024-04-13T10:59:25.326 INFO:tasks.workunit.client.0.smithi134.stdout:3/755: rename dc/d27/d4d to dc/d1d/d102 0 2024-04-13T10:59:25.327 INFO:tasks.workunit.client.0.smithi134.stdout:6/927: creat d4/da/d15/d1f/d24/d2b/f12f x:0 0 0 2024-04-13T10:59:25.327 INFO:tasks.workunit.client.0.smithi134.stdout:4/753: symlink d4/d1f/d27/dd2/lfb 0 2024-04-13T10:59:25.329 INFO:tasks.workunit.client.0.smithi134.stdout:1/994: rename d3/d6/dd/c6f to d3/d6/dd/de5/c13e 0 2024-04-13T10:59:25.329 INFO:tasks.workunit.client.0.smithi134.stdout:6/928: write d4/da/d15/d1f/d3c/f5e [5050137,99460] 0 2024-04-13T10:59:25.335 INFO:tasks.workunit.client.0.smithi134.stdout:4/754: dread - d4/d1f/d27/d75/d38/fed zero size 2024-04-13T10:59:25.336 INFO:tasks.workunit.client.0.smithi134.stdout:6/929: symlink d4/da/d15/d76/l130 0 2024-04-13T10:59:25.340 INFO:tasks.workunit.client.0.smithi134.stdout:4/755: mkdir d4/dd/d6d/d8c/d5f/dfc 0 2024-04-13T10:59:25.345 INFO:tasks.workunit.client.0.smithi134.stdout:8/943: dwrite d8/dc/d2c/d68/d8c/fe6 [0,4194304] 0 2024-04-13T10:59:25.347 INFO:tasks.workunit.client.0.smithi134.stdout:4/756: mkdir d4/d1f/d27/d3a/d53/d58/dfd 0 2024-04-13T10:59:25.350 INFO:tasks.workunit.client.0.smithi134.stdout:8/944: creat d8/dc/d2c/d68/d8c/f139 x:0 0 0 2024-04-13T10:59:25.352 INFO:tasks.workunit.client.0.smithi134.stdout:4/757: chown d4/d1f/d27/d75/d38/f9e 0 1 2024-04-13T10:59:25.354 INFO:tasks.workunit.client.0.smithi134.stdout:8/945: stat d8/dc/d2c/d68/fe4 0 2024-04-13T10:59:25.355 INFO:tasks.workunit.client.0.smithi134.stdout:1/995: dread d3/d6/d16/d1d/f94 [0,4194304] 0 2024-04-13T10:59:25.358 INFO:tasks.workunit.client.0.smithi134.stdout:3/756: dwrite dc/d1d/d58/d72/ffe [0,4194304] 0 2024-04-13T10:59:25.359 INFO:tasks.workunit.client.0.smithi134.stdout:4/758: chown d4/d1f/d27/l51 14264044 1 2024-04-13T10:59:25.360 INFO:tasks.workunit.client.0.smithi134.stdout:4/759: fdatasync d4/d1f/d27/d75/f68 0 2024-04-13T10:59:25.378 INFO:tasks.workunit.client.0.smithi134.stdout:3/757: truncate dc/f55 4982579 0 2024-04-13T10:59:25.378 INFO:tasks.workunit.client.0.smithi134.stdout:4/760: mknod d4/d1f/d27/d2e/d84/dde/dd3/cfe 0 2024-04-13T10:59:25.381 INFO:tasks.workunit.client.0.smithi134.stdout:1/996: rmdir d3/d6/d20/d6d/d102 0 2024-04-13T10:59:25.381 INFO:tasks.workunit.client.0.smithi134.stdout:8/946: dread d8/dc/f30 [0,4194304] 0 2024-04-13T10:59:25.383 INFO:tasks.workunit.client.0.smithi134.stdout:3/758: unlink dc/d27/d19/d8b/da8/cb2 0 2024-04-13T10:59:25.385 INFO:tasks.workunit.client.0.smithi134.stdout:3/759: stat dc/d27/c45 0 2024-04-13T10:59:25.387 INFO:tasks.workunit.client.0.smithi134.stdout:4/761: mkdir d4/dd/df2/dee/dff 0 2024-04-13T10:59:25.392 INFO:tasks.workunit.client.0.smithi134.stdout:1/997: mknod d3/c13f 0 2024-04-13T10:59:25.392 INFO:tasks.workunit.client.0.smithi134.stdout:8/947: dwrite d8/dcc/f12d [0,4194304] 0 2024-04-13T10:59:25.397 INFO:tasks.workunit.client.0.smithi134.stdout:8/948: chown d8/dc/d16/d54/d6c/d94/dc1/f111 923 1 2024-04-13T10:59:25.399 INFO:tasks.workunit.client.0.smithi134.stdout:4/762: rename d4/d48/d50/f98 to d4/d82/f100 0 2024-04-13T10:59:25.400 INFO:tasks.workunit.client.0.smithi134.stdout:4/763: stat d4/l24 0 2024-04-13T10:59:25.405 INFO:tasks.workunit.client.0.smithi134.stdout:8/949: symlink d8/dc/d16/d54/d6c/d7d/l13a 0 2024-04-13T10:59:25.407 INFO:tasks.workunit.client.0.smithi134.stdout:3/760: rename dc/d2a/fbd to dc/d27/d19/d48/d8e/f103 0 2024-04-13T10:59:25.410 INFO:tasks.workunit.client.0.smithi134.stdout:1/998: dwrite d3/d6/d16/d1d/f26 [0,4194304] 0 2024-04-13T10:59:25.416 INFO:tasks.workunit.client.0.smithi134.stdout:4/764: fdatasync d4/d1f/d90/faa 0 2024-04-13T10:59:25.423 INFO:tasks.workunit.client.0.smithi134.stdout:3/761: mknod dc/d27/d19/d8b/da8/d50/d25/d91/de9/c104 0 2024-04-13T10:59:25.423 INFO:tasks.workunit.client.0.smithi134.stdout:8/950: creat d8/dc/d16/d54/d6c/d7d/f13b x:0 0 0 2024-04-13T10:59:25.423 INFO:tasks.workunit.client.0.smithi134.stdout:1/999: dread d3/d30/f4b [0,4194304] 0 2024-04-13T10:59:25.423 INFO:tasks.workunit.client.0.smithi134.stdout:3/762: stat dc/d27/d19/d48/dd9/ffb 0 2024-04-13T10:59:25.427 INFO:tasks.workunit.client.0.smithi134.stdout:8/951: symlink d8/dc/d9d/d69/l13c 0 2024-04-13T10:59:25.427 INFO:tasks.workunit.client.0.smithi134.stdout:4/765: write d4/d1f/d27/d75/d38/d79/db9/fef [329555,109854] 0 2024-04-13T10:59:25.428 INFO:tasks.workunit.client.0.smithi134.stdout:3/763: mkdir dc/d27/d19/d48/d8e/d105 0 2024-04-13T10:59:25.432 INFO:tasks.workunit.client.0.smithi134.stdout:3/764: readlink dc/d27/l76 0 2024-04-13T10:59:25.434 INFO:tasks.workunit.client.0.smithi134.stdout:4/766: mknod d4/dd/df2/dee/c101 0 2024-04-13T10:59:25.434 INFO:tasks.workunit.client.0.smithi134.stdout:8/952: creat d8/dc/d16/d4e/d76/d136/f13d x:0 0 0 2024-04-13T10:59:25.437 INFO:tasks.workunit.client.0.smithi134.stdout:4/767: creat d4/dd/d6d/f102 x:0 0 0 2024-04-13T10:59:25.438 INFO:tasks.workunit.client.0.smithi134.stdout:3/765: read dc/d1d/d58/f7e [983122,21078] 0 2024-04-13T10:59:25.439 INFO:tasks.workunit.client.0.smithi134.stdout:4/768: dread - d4/d48/d50/da0/fcc zero size 2024-04-13T10:59:25.439 INFO:tasks.workunit.client.0.smithi134.stdout:8/953: symlink d8/dc/d16/d54/d98/d9b/da3/l13e 0 2024-04-13T10:59:25.440 INFO:tasks.workunit.client.0.smithi134.stdout:3/766: fdatasync dc/d27/fd4 0 2024-04-13T10:59:25.443 INFO:tasks.workunit.client.0.smithi134.stdout:3/767: mkdir dc/d27/d19/d8b/d9b/d106 0 2024-04-13T10:59:25.447 INFO:tasks.workunit.client.0.smithi134.stdout:3/768: read dc/d1d/d102/f5e [1147886,83691] 0 2024-04-13T10:59:25.452 INFO:tasks.workunit.client.0.smithi134.stdout:4/769: dwrite d4/dd/df2/fc6 [4194304,4194304] 0 2024-04-13T10:59:25.457 INFO:tasks.workunit.client.0.smithi134.stdout:3/769: getdents dc/d1d/d58/d72 0 2024-04-13T10:59:25.462 INFO:tasks.workunit.client.0.smithi134.stdout:8/954: write d8/dc/d16/d54/d98/d9b/da3/fc8 [815944,9920] 0 2024-04-13T10:59:25.468 INFO:tasks.workunit.client.0.smithi134.stdout:8/955: dwrite d8/dc/d9d/d69/fe9 [0,4194304] 0 2024-04-13T10:59:25.474 INFO:tasks.workunit.client.0.smithi134.stdout:8/956: truncate d8/dc/d16/d54/d6c/f70 613665 0 2024-04-13T10:59:25.478 INFO:tasks.workunit.client.0.smithi134.stdout:8/957: rename d8/dc/d9d/d69/d120/l10b to d8/dc/d16/d54/d6c/d94/de7/l13f 0 2024-04-13T10:59:25.485 INFO:tasks.workunit.client.0.smithi134.stdout:8/958: creat d8/dc/d9d/f140 x:0 0 0 2024-04-13T10:59:25.487 INFO:tasks.workunit.client.0.smithi134.stdout:8/959: symlink d8/dc/d37/l141 0 2024-04-13T10:59:25.494 INFO:tasks.workunit.client.0.smithi134.stdout:8/960: dread d8/dc/d2c/d68/fb5 [0,4194304] 0 2024-04-13T10:59:25.499 INFO:tasks.workunit.client.0.smithi134.stdout:8/961: rename d8/dc/d16/d4e/l6b to d8/dc/d16/l142 0 2024-04-13T10:59:25.501 INFO:tasks.workunit.client.0.smithi134.stdout:8/962: mknod d8/dc/d16/d4e/d9c/c143 0 2024-04-13T10:59:25.504 INFO:tasks.workunit.client.0.smithi134.stdout:8/963: unlink d8/dc/d16/fc2 0 2024-04-13T10:59:25.511 INFO:tasks.workunit.client.0.smithi134.stdout:8/964: rename d8/dc/d16/d54/d6c to d8/dc/d16/d74/d144 0 2024-04-13T10:59:25.516 INFO:tasks.workunit.client.0.smithi134.stdout:8/965: getdents d8/dc/d16/d74/d144/d94/dc1/d11f 0 2024-04-13T10:59:25.518 INFO:tasks.workunit.client.0.smithi134.stdout:8/966: write d8/dc/d2c/d68/d8c/d8f/f105 [824834,65547] 0 2024-04-13T10:59:25.521 INFO:tasks.workunit.client.0.smithi134.stdout:8/967: fdatasync d8/dc/d2c/d68/f61 0 2024-04-13T10:59:25.528 INFO:tasks.workunit.client.0.smithi134.stdout:8/968: dwrite d8/dc/d16/d4e/d9c/fd9 [0,4194304] 0 2024-04-13T10:59:25.529 INFO:tasks.workunit.client.0.smithi134.stdout:8/969: stat d8/dcc/cd1 0 2024-04-13T10:59:25.530 INFO:tasks.workunit.client.0.smithi134.stdout:8/970: fdatasync d8/dc/d16/d74/d144/d94/dc1/f10c 0 2024-04-13T10:59:25.579 INFO:tasks.workunit.client.0.smithi134.stdout:0/805: sync 2024-04-13T10:59:25.579 INFO:tasks.workunit.client.0.smithi134.stdout:2/723: sync 2024-04-13T10:59:25.584 INFO:tasks.workunit.client.0.smithi134.stdout:0/806: truncate d4/d17/d23/d51/d6a/d94/f67 272424 0 2024-04-13T10:59:25.595 INFO:tasks.workunit.client.0.smithi134.stdout:2/724: dread d5/d6/d57/d6c/f67 [0,4194304] 0 2024-04-13T10:59:25.596 INFO:tasks.workunit.client.0.smithi134.stdout:2/725: fdatasync d5/d6/d57/d6f/d30/d58/d73/f8d 0 2024-04-13T10:59:25.610 INFO:tasks.workunit.client.0.smithi134.stdout:2/726: dread d5/d6/d57/d6c/d29/fa9 [0,4194304] 0 2024-04-13T10:59:25.640 INFO:tasks.workunit.client.0.smithi134.stdout:0/807: creat d4/d17/d20/d29/f11f x:0 0 0 2024-04-13T10:59:25.656 INFO:tasks.workunit.client.0.smithi134.stdout:0/808: dread d4/d17/d23/d51/d6a/f114 [0,4194304] 0 2024-04-13T10:59:25.664 INFO:tasks.workunit.client.0.smithi134.stdout:0/809: fdatasync d4/fa4 0 2024-04-13T10:59:25.665 INFO:tasks.workunit.client.0.smithi134.stdout:2/727: getdents d5/d6/d70/d9c 0 2024-04-13T10:59:25.666 INFO:tasks.workunit.client.0.smithi134.stdout:0/810: write d4/d17/da/f15 [1034933,110585] 0 2024-04-13T10:59:25.675 INFO:tasks.workunit.client.0.smithi134.stdout:0/811: rename d4/d17/d20/da9/de1/dfc/d6d/d97/de5 to d4/d17/d20/da9/de1/dfc/d6d/d97/d120 0 2024-04-13T10:59:25.681 INFO:tasks.workunit.client.0.smithi134.stdout:0/812: link d4/d17/d20/da9/de1/dfc/d6d/da5/f117 d4/d17/d20/d29/dcd/f121 0 2024-04-13T10:59:25.682 INFO:tasks.workunit.client.0.smithi134.stdout:0/813: stat d4/d17/d20/d29/d30/fe3 0 2024-04-13T10:59:25.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:25 smithi134 ceph-mon[39696]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:25.684 INFO:tasks.workunit.client.0.smithi134.stdout:0/814: symlink d4/d17/d20/da9/de1/dcf/l122 0 2024-04-13T10:59:25.687 INFO:tasks.workunit.client.0.smithi134.stdout:0/815: mknod d4/d17/d1a/c123 0 2024-04-13T10:59:25.690 INFO:tasks.workunit.client.0.smithi134.stdout:0/816: mknod d4/d17/d23/d51/d6b/d91/d98/d62/daf/dc7/c124 0 2024-04-13T10:59:25.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/728: dwrite d5/d6/d57/d6f/d30/fb7 [0,4194304] 0 2024-04-13T10:59:25.711 INFO:tasks.workunit.client.0.smithi134.stdout:2/729: mknod d5/d6/d57/d6f/d30/dd1/cd4 0 2024-04-13T10:59:25.725 INFO:tasks.workunit.client.0.smithi134.stdout:0/817: dwrite d4/d17/d23/d51/d6a/d94/f67 [0,4194304] 0 2024-04-13T10:59:25.729 INFO:tasks.workunit.client.0.smithi134.stdout:0/818: write d4/d17/d23/d51/d6a/d94/db2/f119 [479600,114665] 0 2024-04-13T10:59:25.742 INFO:tasks.workunit.client.0.smithi134.stdout:2/730: dwrite d5/d6/d57/d6c/f28 [4194304,4194304] 0 2024-04-13T10:59:25.745 INFO:tasks.workunit.client.0.smithi134.stdout:2/731: chown f1 512887 1 2024-04-13T10:59:25.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:25 smithi194 ceph-mon[46737]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:25.748 INFO:tasks.workunit.client.0.smithi134.stdout:0/819: write d4/d17/d20/da9/de1/dcf/f71 [81226,12781] 0 2024-04-13T10:59:25.755 INFO:tasks.workunit.client.0.smithi134.stdout:2/732: truncate d5/d6/d57/d6c/d29/fb8 3501574 0 2024-04-13T10:59:25.758 INFO:tasks.workunit.client.0.smithi134.stdout:0/820: dread d4/d17/d20/da9/de1/dcf/d96/f9a [0,4194304] 0 2024-04-13T10:59:25.766 INFO:tasks.workunit.client.0.smithi134.stdout:2/733: dread d5/d6/d34/f9e [0,4194304] 0 2024-04-13T10:59:25.770 INFO:tasks.workunit.client.0.smithi134.stdout:2/734: symlink d5/d6/d70/d84/ld5 0 2024-04-13T10:59:25.776 INFO:tasks.workunit.client.0.smithi134.stdout:2/735: symlink d5/d6/d57/d6f/d30/ld6 0 2024-04-13T10:59:25.778 INFO:tasks.workunit.client.0.smithi134.stdout:0/821: dread d4/d17/d20/d29/d30/d3e/ff3 [0,4194304] 0 2024-04-13T10:59:25.779 INFO:tasks.workunit.client.0.smithi134.stdout:0/822: dread - d4/d17/d23/d51/d6a/d73/f10a zero size 2024-04-13T10:59:25.780 INFO:tasks.workunit.client.0.smithi134.stdout:2/736: creat d5/de/d2e/d8f/fd7 x:0 0 0 2024-04-13T10:59:25.780 INFO:tasks.workunit.client.0.smithi134.stdout:2/737: fdatasync d5/d6/d70/fa0 0 2024-04-13T10:59:25.782 INFO:tasks.workunit.client.0.smithi134.stdout:0/823: chown d4/d17/d23/d51/d6b/d91/d98/d62/l10d 1646 1 2024-04-13T10:59:25.787 INFO:tasks.workunit.client.0.smithi134.stdout:0/824: creat d4/d17/d23/d51/d6b/d91/d98/d92/dca/f125 x:0 0 0 2024-04-13T10:59:25.790 INFO:tasks.workunit.client.0.smithi134.stdout:0/825: symlink d4/d17/d23/d51/d6a/d94/db2/l126 0 2024-04-13T10:59:25.793 INFO:tasks.workunit.client.0.smithi134.stdout:0/826: fsync d4/d17/d23/d51/d6a/d94/db2/f44 0 2024-04-13T10:59:25.801 INFO:tasks.workunit.client.0.smithi134.stdout:2/738: write d5/de/d2e/d8f/fa5 [759088,55970] 0 2024-04-13T10:59:25.807 INFO:tasks.workunit.client.0.smithi134.stdout:0/827: write d4/d17/d23/d51/d6b/f7b [635733,120751] 0 2024-04-13T10:59:25.807 INFO:tasks.workunit.client.0.smithi134.stdout:2/739: write d5/d6/f69 [2704023,16498] 0 2024-04-13T10:59:25.809 INFO:tasks.workunit.client.0.smithi134.stdout:0/828: mkdir d4/d17/da/d22/d41/d6e/d8a/d95/db9/dff/d127 0 2024-04-13T10:59:25.810 INFO:tasks.workunit.client.0.smithi134.stdout:0/829: rename d4/d17 to d4/d17/d20/da9/de1/dcf/d9e/d128 22 2024-04-13T10:59:25.810 INFO:tasks.workunit.client.0.smithi134.stdout:2/740: truncate d5/d6/d57/d6f/d30/d58/f9b 359105 0 2024-04-13T10:59:25.817 INFO:tasks.workunit.client.0.smithi134.stdout:2/741: dwrite d5/de/d50/fbc [0,4194304] 0 2024-04-13T10:59:25.821 INFO:tasks.workunit.client.0.smithi134.stdout:2/742: creat d5/d6/df/fd8 x:0 0 0 2024-04-13T10:59:25.824 INFO:tasks.workunit.client.0.smithi134.stdout:0/830: dwrite d4/d17/da/d22/f31 [0,4194304] 0 2024-04-13T10:59:25.828 INFO:tasks.workunit.client.0.smithi134.stdout:2/743: creat d5/d6/d70/db2/fd9 x:0 0 0 2024-04-13T10:59:25.828 INFO:tasks.workunit.client.0.smithi134.stdout:2/744: readlink d5/d6/d70/d84/ld5 0 2024-04-13T10:59:25.834 INFO:tasks.workunit.client.0.smithi134.stdout:2/745: dread d5/d6/d57/d6f/d30/f71 [0,4194304] 0 2024-04-13T10:59:25.837 INFO:tasks.workunit.client.0.smithi134.stdout:0/831: write d4/d17/d23/f83 [129504,26704] 0 2024-04-13T10:59:25.838 INFO:tasks.workunit.client.0.smithi134.stdout:0/832: chown d4/d17/da/f1b 1756861 1 2024-04-13T10:59:25.842 INFO:tasks.workunit.client.0.smithi134.stdout:0/833: symlink d4/d17/d20/d29/d30/d7f/da2/l129 0 2024-04-13T10:59:25.843 INFO:tasks.workunit.client.0.smithi134.stdout:0/834: dread - d4/d17/d20/da9/de1/dfc/fe9 zero size 2024-04-13T10:59:25.850 INFO:tasks.workunit.client.0.smithi134.stdout:0/835: dwrite d4/d17/d23/f83 [0,4194304] 0 2024-04-13T10:59:25.854 INFO:tasks.workunit.client.0.smithi134.stdout:7/770: sync 2024-04-13T10:59:25.854 INFO:tasks.workunit.client.0.smithi134.stdout:6/930: sync 2024-04-13T10:59:25.855 INFO:tasks.workunit.client.0.smithi134.stdout:7/771: write da/fb [8236274,25455] 0 2024-04-13T10:59:25.858 INFO:tasks.workunit.client.0.smithi134.stdout:7/772: write da/d15/d26/d4a/fd1 [289816,17551] 0 2024-04-13T10:59:25.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/746: dread d5/d6/d57/d6c/f49 [0,4194304] 0 2024-04-13T10:59:25.937 INFO:tasks.workunit.client.0.smithi134.stdout:6/931: write d4/da/d15/d1f/d24/d49/f83 [489979,69886] 0 2024-04-13T10:59:25.938 INFO:tasks.workunit.client.0.smithi134.stdout:7/773: getdents da/d15/d26/d27/d3d/d9c/d5a 0 2024-04-13T10:59:25.941 INFO:tasks.workunit.client.0.smithi134.stdout:2/747: dwrite d5/d6/d57/d6f/d30/d88/d96/fb0 [0,4194304] 0 2024-04-13T10:59:25.944 INFO:tasks.workunit.client.0.smithi134.stdout:6/932: rmdir d4/da/d15/d1f/d3c/dd0 39 2024-04-13T10:59:25.948 INFO:tasks.workunit.client.0.smithi134.stdout:7/774: rename da/d15/f8a to da/d15/d26/d27/d4f/d5f/d67/d73/d92/fe4 0 2024-04-13T10:59:25.949 INFO:tasks.workunit.client.0.smithi134.stdout:7/775: chown da/c18 972839 1 2024-04-13T10:59:25.955 INFO:tasks.workunit.client.0.smithi134.stdout:7/776: write da/d15/d26/d27/d3d/d9c/d5a/fd8 [3932650,74042] 0 2024-04-13T10:59:25.960 INFO:tasks.workunit.client.0.smithi134.stdout:7/777: creat da/d15/d26/d27/d3d/d46/dbf/fe5 x:0 0 0 2024-04-13T10:59:25.960 INFO:tasks.workunit.client.0.smithi134.stdout:6/933: write d4/da/d15/d1f/fe8 [1136907,117251] 0 2024-04-13T10:59:25.962 INFO:tasks.workunit.client.0.smithi134.stdout:2/748: write d5/de/d50/f60 [464584,68883] 0 2024-04-13T10:59:25.964 INFO:tasks.workunit.client.0.smithi134.stdout:7/778: truncate da/d15/d26/d27/d4f/f7d 790548 0 2024-04-13T10:59:25.965 INFO:tasks.workunit.client.0.smithi134.stdout:6/934: mknod d4/da/d15/c131 0 2024-04-13T10:59:25.972 INFO:tasks.workunit.client.0.smithi134.stdout:7/779: dwrite da/d15/d26/d27/d3d/fbd [0,4194304] 0 2024-04-13T10:59:25.974 INFO:tasks.workunit.client.0.smithi134.stdout:2/749: truncate d5/d6/d57/d6c/f4d 263173 0 2024-04-13T10:59:25.976 INFO:tasks.workunit.client.0.smithi134.stdout:2/750: write d5/de/db3/fcb [1320110,20225] 0 2024-04-13T10:59:25.981 INFO:tasks.workunit.client.0.smithi134.stdout:2/751: mkdir d5/de/db3/dda 0 2024-04-13T10:59:25.986 INFO:tasks.workunit.client.0.smithi134.stdout:2/752: creat d5/de/d2e/fdb x:0 0 0 2024-04-13T10:59:25.991 INFO:tasks.workunit.client.0.smithi134.stdout:7/780: dwrite da/d15/d26/d27/d4f/d5f/fba [0,4194304] 0 2024-04-13T10:59:25.996 INFO:tasks.workunit.client.0.smithi134.stdout:2/753: dwrite d5/de/f37 [0,4194304] 0 2024-04-13T10:59:25.998 INFO:tasks.workunit.client.0.smithi134.stdout:6/935: dread d4/da/d15/d76/d92/fd5 [0,4194304] 0 2024-04-13T10:59:26.003 INFO:tasks.workunit.client.0.smithi134.stdout:2/754: creat d5/d6/d70/d84/fdc x:0 0 0 2024-04-13T10:59:26.012 INFO:tasks.workunit.client.0.smithi134.stdout:2/755: dwrite d5/d6/df/fd2 [0,4194304] 0 2024-04-13T10:59:26.013 INFO:tasks.workunit.client.0.smithi134.stdout:7/781: rename da/d15/d26/d27/d3d/d9c/l78 to da/d15/d26/d38/le6 0 2024-04-13T10:59:26.016 INFO:tasks.workunit.client.0.smithi134.stdout:6/936: getdents d4 0 2024-04-13T10:59:26.019 INFO:tasks.workunit.client.0.smithi134.stdout:6/937: mkdir d4/da/d15/d77/d63/d132 0 2024-04-13T10:59:26.022 INFO:tasks.workunit.client.0.smithi134.stdout:7/782: dwrite da/d15/d26/d27/d3d/d46/f4b [0,4194304] 0 2024-04-13T10:59:26.025 INFO:tasks.workunit.client.0.smithi134.stdout:6/938: rename d4/da/d1a/f88 to d4/da/d15/d77/d63/d121/f133 0 2024-04-13T10:59:26.032 INFO:tasks.workunit.client.0.smithi134.stdout:6/939: creat d4/da/d68/f134 x:0 0 0 2024-04-13T10:59:26.033 INFO:tasks.workunit.client.0.smithi134.stdout:7/783: dwrite da/d15/d26/d27/d3d/d9c/d48/f5d [4194304,4194304] 0 2024-04-13T10:59:26.035 INFO:tasks.workunit.client.0.smithi134.stdout:2/756: dwrite d5/d6/d57/d6f/d30/d58/d59/f7e [0,4194304] 0 2024-04-13T10:59:26.038 INFO:tasks.workunit.client.0.smithi134.stdout:6/940: fsync d4/da/d1a/f29 0 2024-04-13T10:59:26.041 INFO:tasks.workunit.client.0.smithi134.stdout:7/784: creat da/d15/d26/d27/d4f/d5f/d67/d73/fe7 x:0 0 0 2024-04-13T10:59:26.046 INFO:tasks.workunit.client.0.smithi134.stdout:2/757: link d5/d6/d57/d6c/f67 d5/d6/d70/fdd 0 2024-04-13T10:59:26.046 INFO:tasks.workunit.client.0.smithi134.stdout:7/785: link da/d15/d26/c4c da/d15/d26/d27/d4f/dd3/ce8 0 2024-04-13T10:59:26.048 INFO:tasks.workunit.client.0.smithi134.stdout:2/758: creat d5/d6/d70/d84/fde x:0 0 0 2024-04-13T10:59:26.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/759: write d5/de/f37 [3424234,27524] 0 2024-04-13T10:59:26.051 INFO:tasks.workunit.client.0.smithi134.stdout:7/786: creat da/d15/d26/d27/d4f/d5f/d88/dd9/fe9 x:0 0 0 2024-04-13T10:59:26.053 INFO:tasks.workunit.client.0.smithi134.stdout:7/787: write da/d15/d26/d27/d3d/d9c/d5a/fd5 [298818,97446] 0 2024-04-13T10:59:26.054 INFO:tasks.workunit.client.0.smithi134.stdout:2/760: unlink d5/de/f37 0 2024-04-13T10:59:26.057 INFO:tasks.workunit.client.0.smithi134.stdout:7/788: readlink da/d15/d26/d27/d4f/d5f/d67/lbc 0 2024-04-13T10:59:26.058 INFO:tasks.workunit.client.0.smithi134.stdout:7/789: fsync da/d15/d26/fae 0 2024-04-13T10:59:26.059 INFO:tasks.workunit.client.0.smithi134.stdout:2/761: symlink d5/d6/ldf 0 2024-04-13T10:59:26.062 INFO:tasks.workunit.client.0.smithi134.stdout:2/762: symlink d5/d6/d57/d6f/d30/d88/d96/le0 0 2024-04-13T10:59:26.063 INFO:tasks.workunit.client.0.smithi134.stdout:2/763: write d5/de/d2e/fdb [903931,24734] 0 2024-04-13T10:59:26.064 INFO:tasks.workunit.client.0.smithi134.stdout:7/790: link da/d15/d26/f35 da/dad/de3/fea 0 2024-04-13T10:59:26.072 INFO:tasks.workunit.client.0.smithi134.stdout:2/764: creat d5/fe1 x:0 0 0 2024-04-13T10:59:26.080 INFO:tasks.workunit.client.0.smithi134.stdout:7/791: write da/d15/d26/f28 [1281962,42070] 0 2024-04-13T10:59:26.083 INFO:tasks.workunit.client.0.smithi134.stdout:7/792: mkdir da/d15/deb 0 2024-04-13T10:59:26.084 INFO:tasks.workunit.client.0.smithi134.stdout:7/793: fsync da/d15/f6e 0 2024-04-13T10:59:26.085 INFO:tasks.workunit.client.0.smithi134.stdout:2/765: dread d5/d6/d57/d6f/d30/f4f [0,4194304] 0 2024-04-13T10:59:26.087 INFO:tasks.workunit.client.0.smithi134.stdout:7/794: mkdir da/d15/d85/db0/dec 0 2024-04-13T10:59:26.088 INFO:tasks.workunit.client.0.smithi134.stdout:7/795: dread - da/d15/d26/d27/d3d/d9c/fb5 zero size 2024-04-13T10:59:26.088 INFO:tasks.workunit.client.0.smithi134.stdout:2/766: rename d5/d6/l2d to d5/d6/d70/d84/le2 0 2024-04-13T10:59:26.089 INFO:tasks.workunit.client.0.smithi134.stdout:2/767: chown d5/de/d2e/d8f/fd7 913492 1 2024-04-13T10:59:26.094 INFO:tasks.workunit.client.0.smithi134.stdout:2/768: rename d5/d6/d57/d6f/f3a to d5/d6/d57/d6f/d30/d88/d96/fe3 0 2024-04-13T10:59:26.098 INFO:tasks.workunit.client.0.smithi134.stdout:7/796: write da/d15/d26/d27/d3d/d9c/d48/f93 [6334042,30972] 0 2024-04-13T10:59:26.110 INFO:tasks.workunit.client.0.smithi134.stdout:7/797: dread da/d15/d26/d27/d4f/d5f/d67/d73/f75 [0,4194304] 0 2024-04-13T10:59:26.180 INFO:tasks.workunit.client.0.smithi134.stdout:7/798: creat da/d15/deb/fed x:0 0 0 2024-04-13T10:59:26.189 INFO:tasks.workunit.client.0.smithi134.stdout:7/799: fdatasync da/d15/d26/d38/f66 0 2024-04-13T10:59:26.280 INFO:tasks.workunit.client.0.smithi134.stdout:2/769: dwrite d5/d6/d57/d6f/d30/d88/d96/fe3 [0,4194304] 0 2024-04-13T10:59:26.291 INFO:tasks.workunit.client.0.smithi134.stdout:2/770: dwrite d5/de/d2e/d8f/fd7 [0,4194304] 0 2024-04-13T10:59:26.330 INFO:tasks.workunit.client.0.smithi134.stdout:7/800: rename da/l2f to da/d15/d26/d27/d3d/d46/dbf/lee 0 2024-04-13T10:59:26.338 INFO:tasks.workunit.client.0.smithi134.stdout:2/771: truncate d5/de/db3/fcb 2034113 0 2024-04-13T10:59:26.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/772: symlink d5/d6/d57/d6f/d30/le4 0 2024-04-13T10:59:26.343 INFO:tasks.workunit.client.0.smithi134.stdout:2/773: write d5/d6/d57/d6f/d30/d88/d96/fb0 [4898383,100937] 0 2024-04-13T10:59:26.344 INFO:tasks.workunit.client.0.smithi134.stdout:7/801: link da/f54 da/d15/d26/d27/d4f/d5f/fef 0 2024-04-13T10:59:26.345 INFO:tasks.workunit.client.0.smithi134.stdout:2/774: read d5/d6/d57/d6f/d30/d58/d59/f7e [3047459,53815] 0 2024-04-13T10:59:26.345 INFO:tasks.workunit.client.0.smithi134.stdout:7/802: write da/fa8 [6845601,65283] 0 2024-04-13T10:59:26.348 INFO:tasks.workunit.client.0.smithi134.stdout:7/803: fdatasync da/d15/d26/d27/d3d/d9c/f55 0 2024-04-13T10:59:26.360 INFO:tasks.workunit.client.0.smithi134.stdout:7/804: link da/d15/d26/d27/d4f/d5f/d67/lbc da/d15/d26/d4a/dc7/lf0 0 2024-04-13T10:59:26.361 INFO:tasks.workunit.client.0.smithi134.stdout:2/775: dread d5/d6/d57/d6f/d30/f42 [0,4194304] 0 2024-04-13T10:59:26.415 INFO:tasks.workunit.client.0.smithi134.stdout:4/770: sync 2024-04-13T10:59:26.415 INFO:tasks.workunit.client.0.smithi134.stdout:7/805: truncate da/d15/d26/d27/d4f/d5f/d67/d76/fb6 3842890 0 2024-04-13T10:59:26.416 INFO:tasks.workunit.client.0.smithi134.stdout:2/776: dwrite d5/d6/d70/f90 [0,4194304] 0 2024-04-13T10:59:26.417 INFO:tasks.workunit.client.0.smithi134.stdout:7/806: readlink da/d15/d26/l31 0 2024-04-13T10:59:26.418 INFO:tasks.workunit.client.0.smithi134.stdout:2/777: read d5/de/d50/f5e [340911,41656] 0 2024-04-13T10:59:26.420 INFO:tasks.workunit.client.0.smithi134.stdout:4/771: mknod d4/dd/d6d/d8c/d5f/c103 0 2024-04-13T10:59:26.422 INFO:tasks.workunit.client.0.smithi134.stdout:7/807: creat da/d15/d26/d4a/dc7/ff1 x:0 0 0 2024-04-13T10:59:26.425 INFO:tasks.workunit.client.0.smithi134.stdout:7/808: symlink da/d15/d26/d27/dc9/dcd/lf2 0 2024-04-13T10:59:26.428 INFO:tasks.workunit.client.0.smithi134.stdout:4/772: read d4/d48/d4a/d7e/fe2 [89494,60096] 0 2024-04-13T10:59:26.430 INFO:tasks.workunit.client.0.smithi134.stdout:7/809: mknod da/d15/d26/d4a/dc7/cf3 0 2024-04-13T10:59:26.431 INFO:tasks.workunit.client.0.smithi134.stdout:4/773: mkdir d4/dd/d6d/d104 0 2024-04-13T10:59:26.433 INFO:tasks.workunit.client.0.smithi134.stdout:7/810: unlink da/dad/de3/f98 0 2024-04-13T10:59:26.434 INFO:tasks.workunit.client.0.smithi134.stdout:7/811: stat da/d15/d26/d27/d3d/d9c/d48 0 2024-04-13T10:59:26.439 INFO:tasks.workunit.client.0.smithi134.stdout:2/778: write d5/d6/d57/d6c/f4d [961120,32240] 0 2024-04-13T10:59:26.445 INFO:tasks.workunit.client.0.smithi134.stdout:4/774: dread d4/d1f/d27/d2e/d84/dde/fda [0,4194304] 0 2024-04-13T10:59:26.445 INFO:tasks.workunit.client.0.smithi134.stdout:2/779: dread d5/de/d50/fbc [0,4194304] 0 2024-04-13T10:59:26.446 INFO:tasks.workunit.client.0.smithi134.stdout:2/780: chown d5/d6/ldf 28309 1 2024-04-13T10:59:26.447 INFO:tasks.workunit.client.0.smithi134.stdout:2/781: rename d5/d6/d70/db5 to d5/d6/d70/db5/de5 22 2024-04-13T10:59:26.452 INFO:tasks.workunit.client.0.smithi134.stdout:7/812: dwrite da/d15/d26/d27/d4f/d5f/fef [0,4194304] 0 2024-04-13T10:59:26.458 INFO:tasks.workunit.client.0.smithi134.stdout:7/813: dread da/d15/d26/d27/d3d/d9c/f61 [0,4194304] 0 2024-04-13T10:59:26.460 INFO:tasks.workunit.client.0.smithi134.stdout:7/814: chown da/d15/d26/d27/dc9/dcd/lf2 418051921 1 2024-04-13T10:59:26.461 INFO:tasks.workunit.client.0.smithi134.stdout:2/782: write d5/d6/d57/d6f/d30/fa8 [569394,120070] 0 2024-04-13T10:59:26.462 INFO:tasks.workunit.client.0.smithi134.stdout:4/775: link d4/d48/c64 d4/d48/d4a/c105 0 2024-04-13T10:59:26.467 INFO:tasks.workunit.client.0.smithi134.stdout:2/783: unlink d5/d6/d57/d6f/d30/f63 0 2024-04-13T10:59:26.470 INFO:tasks.workunit.client.0.smithi134.stdout:2/784: dread - d5/d6/d57/d6f/fbe zero size 2024-04-13T10:59:26.472 INFO:tasks.workunit.client.0.smithi134.stdout:7/815: getdents da/d15/d26/d27/d3d/d9c/d48 0 2024-04-13T10:59:26.472 INFO:tasks.workunit.client.0.smithi134.stdout:4/776: dwrite d4/d1f/d90/ff8 [0,4194304] 0 2024-04-13T10:59:26.474 INFO:tasks.workunit.client.0.smithi134.stdout:7/816: readlink da/d15/d26/d27/d3d/d9c/d5a/l6b 0 2024-04-13T10:59:26.475 INFO:tasks.workunit.client.0.smithi134.stdout:4/777: chown d4/d1f/d90/faa 422898468 1 2024-04-13T10:59:26.476 INFO:tasks.workunit.client.0.smithi134.stdout:2/785: creat d5/d6/d57/d6f/d30/d88/fe6 x:0 0 0 2024-04-13T10:59:26.478 INFO:tasks.workunit.client.0.smithi134.stdout:2/786: stat d5/d6/d57/d6c/d29/f66 0 2024-04-13T10:59:26.480 INFO:tasks.workunit.client.0.smithi134.stdout:4/778: dread d4/d1f/d27/d75/d38/d79/d32/d67/d9b/fbe [0,4194304] 0 2024-04-13T10:59:26.481 INFO:tasks.workunit.client.0.smithi134.stdout:7/817: rename da/d15/d26/d27/d4f/d5f/d67/d73/fe7 to da/d15/d26/d27/d3d/d9c/d48/ff4 0 2024-04-13T10:59:26.488 INFO:tasks.workunit.client.0.smithi134.stdout:7/818: getdents da/d15/deb 0 2024-04-13T10:59:26.490 INFO:tasks.workunit.client.0.smithi134.stdout:7/819: rmdir da/d15/d26/d27/d3d/d9c/d5a 39 2024-04-13T10:59:26.494 INFO:tasks.workunit.client.0.smithi134.stdout:7/820: mkdir da/d15/df5 0 2024-04-13T10:59:26.500 INFO:tasks.workunit.client.0.smithi134.stdout:4/779: dread d4/d1f/d27/d75/d38/d79/f35 [0,4194304] 0 2024-04-13T10:59:26.505 INFO:tasks.workunit.client.0.smithi134.stdout:4/780: fsync d4/dd/d6d/f80 0 2024-04-13T10:59:26.622 INFO:tasks.workunit.client.0.smithi134.stdout:3/770: sync 2024-04-13T10:59:26.622 INFO:tasks.workunit.client.0.smithi134.stdout:8/971: sync 2024-04-13T10:59:26.629 INFO:tasks.workunit.client.0.smithi134.stdout:3/771: mknod dc/d27/d19/db1/c107 0 2024-04-13T10:59:26.631 INFO:tasks.workunit.client.0.smithi134.stdout:3/772: readlink dc/d27/d19/d8b/da8/d50/d25/df6/lc1 0 2024-04-13T10:59:26.638 INFO:tasks.workunit.client.0.smithi134.stdout:3/773: dwrite dc/d27/d19/d48/d8e/f103 [0,4194304] 0 2024-04-13T10:59:26.643 INFO:tasks.workunit.client.0.smithi134.stdout:8/972: write d8/dc/d2c/d68/d8c/d8f/fde [45767,97190] 0 2024-04-13T10:59:26.649 INFO:tasks.workunit.client.0.smithi134.stdout:8/973: link d8/dc/d2c/d68/d8c/lbb d8/dc/d16/d74/d144/l145 0 2024-04-13T10:59:26.651 INFO:tasks.workunit.client.0.smithi134.stdout:8/974: unlink d8/dc/d16/d4e/f62 0 2024-04-13T10:59:26.658 INFO:tasks.workunit.client.0.smithi134.stdout:3/774: dread dc/d27/d19/d8b/da8/d50/d25/f3e [0,4194304] 0 2024-04-13T10:59:26.659 INFO:tasks.workunit.client.0.smithi134.stdout:3/775: chown dc/d27/d19/db1/df7/f89 58 1 2024-04-13T10:59:26.666 INFO:tasks.workunit.client.0.smithi134.stdout:3/776: dwrite dc/d27/d19/d48/d8e/f103 [0,4194304] 0 2024-04-13T10:59:26.672 INFO:tasks.workunit.client.0.smithi134.stdout:8/975: link d8/dc/d16/d54/d6f/c102 d8/dc/d16/d54/d98/dfa/c146 0 2024-04-13T10:59:26.675 INFO:tasks.workunit.client.0.smithi134.stdout:3/777: symlink dc/d27/d19/d8b/da8/d50/d25/d5f/d75/l108 0 2024-04-13T10:59:26.676 INFO:tasks.workunit.client.0.smithi134.stdout:3/778: fsync dc/d27/d19/d48/d49/ff8 0 2024-04-13T10:59:26.677 INFO:tasks.workunit.client.0.smithi134.stdout:3/779: chown dc/d27/d19/d8b/da8/d50/d25/d91/fdc 1 1 2024-04-13T10:59:26.681 INFO:tasks.workunit.client.0.smithi134.stdout:8/976: creat d8/dc/d16/d74/d144/d94/df6/f147 x:0 0 0 2024-04-13T10:59:26.683 INFO:tasks.workunit.client.0.smithi134.stdout:3/780: rmdir dc/d27/d19/d8b/d9b 39 2024-04-13T10:59:26.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:26 smithi134 ceph-mon[39696]: pgmap v47: 65 pgs: 65 active+clean; 1.9 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 50 MiB/s rd, 114 MiB/s wr, 273 op/s 2024-04-13T10:59:26.689 INFO:tasks.workunit.client.0.smithi134.stdout:8/977: mknod d8/dc/d2c/d68/dae/c148 0 2024-04-13T10:59:26.691 INFO:tasks.workunit.client.0.smithi134.stdout:8/978: fdatasync d8/dc/d2c/f39 0 2024-04-13T10:59:26.694 INFO:tasks.workunit.client.0.smithi134.stdout:8/979: mknod d8/dc/d16/d54/d98/c149 0 2024-04-13T10:59:26.698 INFO:tasks.workunit.client.0.smithi134.stdout:8/980: creat d8/dc/d16/d74/d144/d94/dc1/d11f/f14a x:0 0 0 2024-04-13T10:59:26.700 INFO:tasks.workunit.client.0.smithi134.stdout:8/981: rmdir d8/dc/d2c/d68 39 2024-04-13T10:59:26.701 INFO:tasks.workunit.client.0.smithi134.stdout:3/781: dread dc/d27/fac [0,4194304] 0 2024-04-13T10:59:26.703 INFO:tasks.workunit.client.0.smithi134.stdout:8/982: truncate d8/dc/d16/d74/d144/d94/dc1/f111 654521 0 2024-04-13T10:59:26.703 INFO:tasks.workunit.client.0.smithi134.stdout:3/782: write dc/d1d/d58/d72/ffe [161341,62961] 0 2024-04-13T10:59:26.704 INFO:tasks.workunit.client.0.smithi134.stdout:3/783: stat dc/d27/d19/d48/d8e/f9c 0 2024-04-13T10:59:26.711 INFO:tasks.workunit.client.0.smithi134.stdout:8/983: dwrite d8/dc/d13/ddf/f12e [0,4194304] 0 2024-04-13T10:59:26.719 INFO:tasks.workunit.client.0.smithi134.stdout:8/984: truncate d8/dc/d37/f71 200025 0 2024-04-13T10:59:26.723 INFO:tasks.workunit.client.0.smithi134.stdout:3/784: dread dc/d27/d19/db1/df7/f89 [0,4194304] 0 2024-04-13T10:59:26.726 INFO:tasks.workunit.client.0.smithi134.stdout:8/985: dwrite d8/dc/f45 [0,4194304] 0 2024-04-13T10:59:26.733 INFO:tasks.workunit.client.0.smithi134.stdout:3/785: creat dc/d27/d19/d8b/d9b/f109 x:0 0 0 2024-04-13T10:59:26.741 INFO:tasks.workunit.client.0.smithi134.stdout:8/986: dread d8/dc/d2c/d68/f61 [0,4194304] 0 2024-04-13T10:59:26.742 INFO:tasks.workunit.client.0.smithi134.stdout:8/987: chown d8/dc/d16/d74/d144/d7d/f85 130 1 2024-04-13T10:59:26.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:26 smithi194 ceph-mon[46737]: pgmap v47: 65 pgs: 65 active+clean; 1.9 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 50 MiB/s rd, 114 MiB/s wr, 273 op/s 2024-04-13T10:59:26.749 INFO:tasks.workunit.client.0.smithi134.stdout:8/988: dread d8/dcc/f12d [0,4194304] 0 2024-04-13T10:59:26.755 INFO:tasks.workunit.client.0.smithi134.stdout:8/989: symlink d8/dc/d16/d54/d98/l14b 0 2024-04-13T10:59:26.759 INFO:tasks.workunit.client.0.smithi134.stdout:8/990: creat d8/dc/d37/d3f/f14c x:0 0 0 2024-04-13T10:59:26.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/991: write d8/dc/d2c/d68/d8c/d8f/f105 [32611,51856] 0 2024-04-13T10:59:26.783 INFO:tasks.workunit.client.0.smithi134.stdout:3/786: dwrite dc/d27/d19/db1/df7/fd0 [0,4194304] 0 2024-04-13T10:59:26.783 INFO:tasks.workunit.client.0.smithi134.stdout:8/992: dwrite d8/f112 [0,4194304] 0 2024-04-13T10:59:26.785 INFO:tasks.workunit.client.0.smithi134.stdout:3/787: dread - dc/f101 zero size 2024-04-13T10:59:26.785 INFO:tasks.workunit.client.0.smithi134.stdout:8/993: dread - d8/f107 zero size 2024-04-13T10:59:26.787 INFO:tasks.workunit.client.0.smithi134.stdout:3/788: write dc/d27/d19/d8b/da8/d50/d25/d91/d93/fe1 [642035,83327] 0 2024-04-13T10:59:26.787 INFO:tasks.workunit.client.0.smithi134.stdout:8/994: chown d8/dc/d2c/f10d 5095 1 2024-04-13T10:59:26.789 INFO:tasks.workunit.client.0.smithi134.stdout:8/995: fdatasync d8/dc/d2c/d68/d8c/f139 0 2024-04-13T10:59:26.794 INFO:tasks.workunit.client.0.smithi134.stdout:3/789: mknod dc/d1d/d58/de7/c10a 0 2024-04-13T10:59:26.796 INFO:tasks.workunit.client.0.smithi134.stdout:3/790: symlink dc/d27/d19/d48/d8e/l10b 0 2024-04-13T10:59:26.798 INFO:tasks.workunit.client.0.smithi134.stdout:3/791: rmdir dc/d27/d19/d8b/da8 39 2024-04-13T10:59:26.806 INFO:tasks.workunit.client.0.smithi134.stdout:3/792: truncate dc/d27/d19/db1/fde 645838 0 2024-04-13T10:59:26.808 INFO:tasks.workunit.client.0.smithi134.stdout:8/996: dwrite d8/dc/d37/d3f/f91 [0,4194304] 0 2024-04-13T10:59:26.810 INFO:tasks.workunit.client.0.smithi134.stdout:8/997: write d8/dc/d2c/d68/d8c/fba [17260,93038] 0 2024-04-13T10:59:26.814 INFO:tasks.workunit.client.0.smithi134.stdout:3/793: mknod dc/d27/d19/d8b/da8/d50/d25/d5f/d75/c10c 0 2024-04-13T10:59:26.816 INFO:tasks.workunit.client.0.smithi134.stdout:3/794: creat dc/d27/d19/d48/d49/f10d x:0 0 0 2024-04-13T10:59:26.817 INFO:tasks.workunit.client.0.smithi134.stdout:8/998: dread d8/dc/d13/f36 [0,4194304] 0 2024-04-13T10:59:26.824 INFO:tasks.workunit.client.0.smithi134.stdout:3/795: link dc/d27/d19/faa dc/d27/d19/db1/df7/f10e 0 2024-04-13T10:59:26.826 INFO:tasks.workunit.client.0.smithi134.stdout:8/999: link d8/dc/d37/d3f/l11b d8/dc/d2c/l14d 0 2024-04-13T10:59:26.845 INFO:tasks.workunit.client.0.smithi134.stdout:3/796: dwrite dc/d27/d19/d8b/da8/d50/d25/d91/fba [0,4194304] 0 2024-04-13T10:59:26.848 INFO:tasks.workunit.client.0.smithi134.stdout:3/797: symlink dc/d27/d19/d8b/da8/d50/d25/d5f/l10f 0 2024-04-13T10:59:26.849 INFO:tasks.workunit.client.0.smithi134.stdout:3/798: stat dc/d27/d19/d8b/da8/d50/d25/c6d 0 2024-04-13T10:59:26.850 INFO:tasks.workunit.client.0.smithi134.stdout:3/799: fsync dc/d27/d19/d8b/d9b/f109 0 2024-04-13T10:59:26.855 INFO:tasks.workunit.client.0.smithi134.stdout:3/800: getdents dc/d27/d95 0 2024-04-13T10:59:26.857 INFO:tasks.workunit.client.0.smithi134.stdout:3/801: truncate dc/d1d/dca/ff0 128337 0 2024-04-13T10:59:26.857 INFO:tasks.workunit.client.0.smithi134.stdout:3/802: readlink dc/d27/d19/d48/l59 0 2024-04-13T10:59:26.858 INFO:tasks.workunit.client.0.smithi134.stdout:3/803: chown dc/d1d/d58/d72/f87 11975 1 2024-04-13T10:59:26.862 INFO:tasks.workunit.client.0.smithi134.stdout:3/804: truncate dc/d27/d19/f3b 4110130 0 2024-04-13T10:59:26.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/805: write dc/d27/d19/d48/d8e/f92 [6556121,900] 0 2024-04-13T10:59:27.015 INFO:tasks.workunit.client.0.smithi134.stdout:0/836: sync 2024-04-13T10:59:27.019 INFO:tasks.workunit.client.0.smithi134.stdout:0/837: write d4/d17/da/f1b [1584786,96983] 0 2024-04-13T10:59:27.021 INFO:tasks.workunit.client.0.smithi134.stdout:0/838: creat d4/d17/d23/d51/d6b/d91/d98/d62/d7c/f12a x:0 0 0 2024-04-13T10:59:27.023 INFO:tasks.workunit.client.0.smithi134.stdout:0/839: chown d4/d17/d20/d29/d30/d64/d84/dd3/d8c/faa 3500 1 2024-04-13T10:59:27.034 INFO:tasks.workunit.client.0.smithi134.stdout:0/840: dwrite d4/d17/d20/da9/de1/dcf/f57 [0,4194304] 0 2024-04-13T10:59:27.035 INFO:tasks.workunit.client.0.smithi134.stdout:0/841: write d4/d17/d20/d29/dcd/dfb/f116 [1658598,7509] 0 2024-04-13T10:59:27.039 INFO:tasks.workunit.client.0.smithi134.stdout:0/842: rename d4/d17/d23/d51/d6b/d91/f99 to d4/d17/d20/da9/de1/dcf/d9e/f12b 0 2024-04-13T10:59:27.044 INFO:tasks.workunit.client.0.smithi134.stdout:0/843: rename d4/d17/d20/da9/de1/dcf/f57 to d4/d17/d20/da9/de1/dfc/d6d/d97/db6/d101/f12c 0 2024-04-13T10:59:27.049 INFO:tasks.workunit.client.0.smithi134.stdout:0/844: mkdir d4/d17/da/d22/d12d 0 2024-04-13T10:59:27.050 INFO:tasks.workunit.client.0.smithi134.stdout:0/845: readlink d4/d17/da/d22/d41/d6e/d8a/d95/l11e 0 2024-04-13T10:59:27.056 INFO:tasks.workunit.client.0.smithi134.stdout:0/846: mknod d4/d17/d20/da9/de1/dfc/c12e 0 2024-04-13T10:59:27.062 INFO:tasks.workunit.client.0.smithi134.stdout:0/847: dwrite d4/d17/d23/d51/d6a/d94/db2/f63 [0,4194304] 0 2024-04-13T10:59:27.065 INFO:tasks.workunit.client.0.smithi134.stdout:0/848: creat d4/d17/d20/da9/de1/dcf/d96/f12f x:0 0 0 2024-04-13T10:59:27.075 INFO:tasks.workunit.client.0.smithi134.stdout:0/849: write d4/d17/d20/d29/f87 [350539,54722] 0 2024-04-13T10:59:27.077 INFO:tasks.workunit.client.0.smithi134.stdout:0/850: fdatasync d4/d17/da/f54 0 2024-04-13T10:59:27.078 INFO:tasks.workunit.client.0.smithi134.stdout:0/851: chown d4/d17/d23/d51/d6a/d73/fed 0 1 2024-04-13T10:59:27.081 INFO:tasks.workunit.client.0.smithi134.stdout:0/852: read d4/d17/d23/d51/d6a/d73/f7a [2778538,9591] 0 2024-04-13T10:59:27.084 INFO:tasks.workunit.client.0.smithi134.stdout:0/853: creat d4/d17/d20/d29/d30/d64/d84/f130 x:0 0 0 2024-04-13T10:59:27.088 INFO:tasks.workunit.client.0.smithi134.stdout:0/854: link d4/d17/d23/d51/d6a/d94/f67 d4/d17/d20/da9/de1/dfc/d6d/d97/f131 0 2024-04-13T10:59:27.090 INFO:tasks.workunit.client.0.smithi134.stdout:0/855: symlink d4/d17/d20/d29/dcd/l132 0 2024-04-13T10:59:27.095 INFO:tasks.workunit.client.0.smithi134.stdout:0/856: creat d4/d17/d20/da9/de1/dcf/f133 x:0 0 0 2024-04-13T10:59:27.100 INFO:tasks.workunit.client.0.smithi134.stdout:0/857: dread d4/d17/d20/d29/dcd/dfb/f116 [0,4194304] 0 2024-04-13T10:59:27.102 INFO:tasks.workunit.client.0.smithi134.stdout:0/858: rmdir d4/d17/d20/d29/d30/d64 39 2024-04-13T10:59:27.109 INFO:tasks.workunit.client.0.smithi134.stdout:0/859: link d4/d17/f4a d4/d17/d23/d51/d6a/f134 0 2024-04-13T10:59:27.110 INFO:tasks.workunit.client.0.smithi134.stdout:0/860: truncate d4/d17/d20/da9/de1/dcf/f133 441028 0 2024-04-13T10:59:27.111 INFO:tasks.workunit.client.0.smithi134.stdout:0/861: chown d4/d17/da/d22/d41/d6e/d8a/d95/df2 449 1 2024-04-13T10:59:27.113 INFO:tasks.workunit.client.0.smithi134.stdout:0/862: symlink d4/d17/d20/da9/de1/dfc/d6d/d97/db6/l135 0 2024-04-13T10:59:27.116 INFO:tasks.workunit.client.0.smithi134.stdout:0/863: unlink d4/d17/da/d22/d41/d6e/la6 0 2024-04-13T10:59:27.118 INFO:tasks.workunit.client.0.smithi134.stdout:0/864: symlink d4/d17/d23/d51/d6b/d91/d98/d92/dca/l136 0 2024-04-13T10:59:27.132 INFO:tasks.workunit.client.0.smithi134.stdout:0/865: dwrite d4/d17/d20/d29/d30/fc3 [0,4194304] 0 2024-04-13T10:59:27.134 INFO:tasks.workunit.client.0.smithi134.stdout:0/866: write d4/d17/d20/da9/de1/dcf/d9e/f12b [2304611,123067] 0 2024-04-13T10:59:27.135 INFO:tasks.workunit.client.0.smithi134.stdout:0/867: readlink d4/d17/d23/d51/d6b/lee 0 2024-04-13T10:59:27.142 INFO:tasks.workunit.client.0.smithi134.stdout:0/868: dwrite d4/d17/da/f1b [0,4194304] 0 2024-04-13T10:59:27.149 INFO:tasks.workunit.client.0.smithi134.stdout:0/869: rename d4/d17/d20/d29/d30/c11c to d4/d17/d20/d29/d30/d64/c137 0 2024-04-13T10:59:27.157 INFO:tasks.workunit.client.0.smithi134.stdout:0/870: write d4/d17/da/d22/d41/d6e/d8a/d95/f10c [1360208,73682] 0 2024-04-13T10:59:27.160 INFO:tasks.workunit.client.0.smithi134.stdout:0/871: creat d4/d17/d20/d29/d30/d64/f138 x:0 0 0 2024-04-13T10:59:27.162 INFO:tasks.workunit.client.0.smithi134.stdout:2/787: sync 2024-04-13T10:59:27.162 INFO:tasks.workunit.client.0.smithi134.stdout:7/821: sync 2024-04-13T10:59:27.162 INFO:tasks.workunit.client.0.smithi134.stdout:6/941: sync 2024-04-13T10:59:27.163 INFO:tasks.workunit.client.0.smithi134.stdout:6/942: fdatasync d4/da/d15/d1f/d24/f9a 0 2024-04-13T10:59:27.165 INFO:tasks.workunit.client.0.smithi134.stdout:7/822: mkdir da/df6 0 2024-04-13T10:59:27.165 INFO:tasks.workunit.client.0.smithi134.stdout:6/943: write d4/da/d15/d1f/f108 [975617,75582] 0 2024-04-13T10:59:27.171 INFO:tasks.workunit.client.0.smithi134.stdout:7/823: mknod da/d15/d85/db0/cf7 0 2024-04-13T10:59:27.173 INFO:tasks.workunit.client.0.smithi134.stdout:7/824: write da/f13 [1485584,8497] 0 2024-04-13T10:59:27.174 INFO:tasks.workunit.client.0.smithi134.stdout:0/872: dread d4/d17/d23/d51/d6b/fcc [0,4194304] 0 2024-04-13T10:59:27.175 INFO:tasks.workunit.client.0.smithi134.stdout:6/944: truncate d4/da/d15/d1f/d24/d49/f50 201209 0 2024-04-13T10:59:27.177 INFO:tasks.workunit.client.0.smithi134.stdout:2/788: getdents d5/d6/d70/db2 0 2024-04-13T10:59:27.177 INFO:tasks.workunit.client.0.smithi134.stdout:0/873: chown d4/d17/d23/d51/d6b/fcc 43 1 2024-04-13T10:59:27.181 INFO:tasks.workunit.client.0.smithi134.stdout:6/945: chown d4/da/d15/d1f/d3c/dd0/fe0 177030251 1 2024-04-13T10:59:27.182 INFO:tasks.workunit.client.0.smithi134.stdout:7/825: dwrite da/d15/d85/fcf [0,4194304] 0 2024-04-13T10:59:27.183 INFO:tasks.workunit.client.0.smithi134.stdout:7/826: write f4 [3872794,128794] 0 2024-04-13T10:59:27.185 INFO:tasks.workunit.client.0.smithi134.stdout:2/789: mkdir d5/d6/d70/d84/de7 0 2024-04-13T10:59:27.192 INFO:tasks.workunit.client.0.smithi134.stdout:6/946: chown d4/da/d69/cf8 73 1 2024-04-13T10:59:27.207 INFO:tasks.workunit.client.0.smithi134.stdout:7/827: link da/d15/d26/l43 da/d15/d26/d27/lf8 0 2024-04-13T10:59:27.208 INFO:tasks.workunit.client.0.smithi134.stdout:7/828: stat da/d15/f29 0 2024-04-13T10:59:27.208 INFO:tasks.workunit.client.0.smithi134.stdout:0/874: dwrite d4/d17/d20/da9/de1/dcf/d96/f9a [0,4194304] 0 2024-04-13T10:59:27.209 INFO:tasks.workunit.client.0.smithi134.stdout:7/829: stat da/d15/d26/d27/dc9/dcd 0 2024-04-13T10:59:27.211 INFO:tasks.workunit.client.0.smithi134.stdout:7/830: write da/d15/d26/d27/d3d/d9c/fb5 [1012104,12181] 0 2024-04-13T10:59:27.218 INFO:tasks.workunit.client.0.smithi134.stdout:6/947: dwrite d4/da/d15/d1f/d24/d49/d91/fb0 [0,4194304] 0 2024-04-13T10:59:27.221 INFO:tasks.workunit.client.0.smithi134.stdout:0/875: rename d4/d17/d23/d51/d6a/f134 to d4/d17/d23/d51/d6b/d91/d98/d62/daf/f139 0 2024-04-13T10:59:27.227 INFO:tasks.workunit.client.0.smithi134.stdout:0/876: write d4/d17/da/d22/d41/d6e/f72 [2928943,114449] 0 2024-04-13T10:59:27.228 INFO:tasks.workunit.client.0.smithi134.stdout:7/831: link da/fb da/d15/d26/d27/d4f/d5f/d88/ff9 0 2024-04-13T10:59:27.231 INFO:tasks.workunit.client.0.smithi134.stdout:6/948: dwrite d4/da/d15/d1f/d24/fb3 [0,4194304] 0 2024-04-13T10:59:27.241 INFO:tasks.workunit.client.0.smithi134.stdout:6/949: creat d4/da/f135 x:0 0 0 2024-04-13T10:59:27.247 INFO:tasks.workunit.client.0.smithi134.stdout:7/832: write da/d15/d26/d27/d4f/d5f/d67/d73/d92/f9a [959347,38368] 0 2024-04-13T10:59:27.248 INFO:tasks.workunit.client.0.smithi134.stdout:7/833: readlink da/d15/d26/l31 0 2024-04-13T10:59:27.252 INFO:tasks.workunit.client.0.smithi134.stdout:0/877: dread d4/d17/d23/d51/d6b/d91/d98/d62/f85 [0,4194304] 0 2024-04-13T10:59:27.253 INFO:tasks.workunit.client.0.smithi134.stdout:7/834: creat da/d15/ffa x:0 0 0 2024-04-13T10:59:27.255 INFO:tasks.workunit.client.0.smithi134.stdout:0/878: read d4/d17/d20/d29/d30/d64/d84/dd3/f93 [50746,113826] 0 2024-04-13T10:59:27.255 INFO:tasks.workunit.client.0.smithi134.stdout:6/950: write d4/f5 [5053185,121905] 0 2024-04-13T10:59:27.257 INFO:tasks.workunit.client.0.smithi134.stdout:6/951: truncate d4/da/d68/f134 625020 0 2024-04-13T10:59:27.258 INFO:tasks.workunit.client.0.smithi134.stdout:6/952: chown d4/f4d 371 1 2024-04-13T10:59:27.261 INFO:tasks.workunit.client.0.smithi134.stdout:0/879: symlink d4/d17/da/l13a 0 2024-04-13T10:59:27.264 INFO:tasks.workunit.client.0.smithi134.stdout:0/880: rmdir d4/d17/d20/da9/de1/dfc/d6d/da5/dd9 39 2024-04-13T10:59:27.265 INFO:tasks.workunit.client.0.smithi134.stdout:7/835: write da/d15/d26/d27/d4f/d5f/d67/f90 [4921693,37050] 0 2024-04-13T10:59:27.266 INFO:tasks.workunit.client.0.smithi134.stdout:6/953: mkdir d4/da/d15/d1f/d24/d10b/d116/d136 0 2024-04-13T10:59:27.267 INFO:tasks.workunit.client.0.smithi134.stdout:0/881: truncate d4/d17/da/f27 882907 0 2024-04-13T10:59:27.268 INFO:tasks.workunit.client.0.smithi134.stdout:7/836: readlink da/d15/d26/d27/d4f/dd3/ld6 0 2024-04-13T10:59:27.270 INFO:tasks.workunit.client.0.smithi134.stdout:6/954: mkdir d4/da/d15/d1f/d24/da4/d137 0 2024-04-13T10:59:27.271 INFO:tasks.workunit.client.0.smithi134.stdout:7/837: creat da/d15/d26/d27/d3d/d46/dbf/ffb x:0 0 0 2024-04-13T10:59:27.272 INFO:tasks.workunit.client.0.smithi134.stdout:7/838: dread - da/d15/d26/d4a/dc7/ff1 zero size 2024-04-13T10:59:27.274 INFO:tasks.workunit.client.0.smithi134.stdout:6/955: symlink d4/da/d15/d1f/d24/ddf/dfe/d128/l138 0 2024-04-13T10:59:27.277 INFO:tasks.workunit.client.0.smithi134.stdout:6/956: symlink d4/da/dbb/dca/l139 0 2024-04-13T10:59:27.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/957: write d4/da/dbb/de5/dfd/f123 [639137,16140] 0 2024-04-13T10:59:27.285 INFO:tasks.workunit.client.0.smithi134.stdout:7/839: dread da/d15/d26/d27/d4f/d5f/d67/d73/fb9 [0,4194304] 0 2024-04-13T10:59:27.288 INFO:tasks.workunit.client.0.smithi134.stdout:6/958: write d4/da/d15/d1f/d24/d49/f9e [3607494,97086] 0 2024-04-13T10:59:27.289 INFO:tasks.workunit.client.0.smithi134.stdout:7/840: fdatasync da/d15/d26/d27/d4f/d5f/d67/f80 0 2024-04-13T10:59:27.289 INFO:tasks.workunit.client.0.smithi134.stdout:6/959: readlink d4/da/d15/l28 0 2024-04-13T10:59:27.293 INFO:tasks.workunit.client.0.smithi134.stdout:6/960: symlink d4/da/dbb/dc3/l13a 0 2024-04-13T10:59:27.300 INFO:tasks.workunit.client.0.smithi134.stdout:6/961: write d4/da/d15/d1f/f2a [3096836,71876] 0 2024-04-13T10:59:27.301 INFO:tasks.workunit.client.0.smithi134.stdout:4/781: sync 2024-04-13T10:59:27.301 INFO:tasks.workunit.client.0.smithi134.stdout:3/806: sync 2024-04-13T10:59:27.303 INFO:tasks.workunit.client.0.smithi134.stdout:6/962: mknod d4/da/d1a/de6/c13b 0 2024-04-13T10:59:27.303 INFO:tasks.workunit.client.0.smithi134.stdout:4/782: write d4/d1f/d27/d3a/d65/ffa [726121,90533] 0 2024-04-13T10:59:27.303 INFO:tasks.workunit.client.0.smithi134.stdout:4/783: stat d4/dd/c20 0 2024-04-13T10:59:27.305 INFO:tasks.workunit.client.0.smithi134.stdout:3/807: rmdir dc/d27/d19/d8b 39 2024-04-13T10:59:27.368 INFO:tasks.workunit.client.0.smithi134.stdout:4/784: mkdir d4/dd/d6d/d106 0 2024-04-13T10:59:27.376 INFO:tasks.workunit.client.0.smithi134.stdout:3/808: mknod dc/d27/d19/d8b/da8/d50/c110 0 2024-04-13T10:59:27.380 INFO:tasks.workunit.client.0.smithi134.stdout:4/785: truncate d4/f61 828923 0 2024-04-13T10:59:27.381 INFO:tasks.workunit.client.0.smithi134.stdout:6/963: dread d4/da/d15/d76/d92/fde [0,4194304] 0 2024-04-13T10:59:27.387 INFO:tasks.workunit.client.0.smithi134.stdout:6/964: read d4/da/d1a/f44 [79426,120134] 0 2024-04-13T10:59:27.387 INFO:tasks.workunit.client.0.smithi134.stdout:3/809: dread dc/d27/d19/d8b/da8/d50/d25/df6/f9e [0,4194304] 0 2024-04-13T10:59:27.388 INFO:tasks.workunit.client.0.smithi134.stdout:4/786: creat d4/f107 x:0 0 0 2024-04-13T10:59:27.389 INFO:tasks.workunit.client.0.smithi134.stdout:6/965: write d4/da/d15/d1f/fe8 [2755298,54393] 0 2024-04-13T10:59:27.390 INFO:tasks.workunit.client.0.smithi134.stdout:4/787: fdatasync d4/d48/f5a 0 2024-04-13T10:59:27.391 INFO:tasks.workunit.client.0.smithi134.stdout:3/810: write dc/d27/d19/db1/df7/fd0 [564720,45459] 0 2024-04-13T10:59:27.393 INFO:tasks.workunit.client.0.smithi134.stdout:3/811: chown dc/d27/d19/d48/d8e/d105 66 1 2024-04-13T10:59:27.396 INFO:tasks.workunit.client.0.smithi134.stdout:6/966: mknod d4/da/dbb/de5/c13c 0 2024-04-13T10:59:27.400 INFO:tasks.workunit.client.0.smithi134.stdout:3/812: truncate dc/d1d/d58/f7e 5457034 0 2024-04-13T10:59:27.402 INFO:tasks.workunit.client.0.smithi134.stdout:4/788: mkdir d4/dd/d6d/d8c/d5f/dfc/d108 0 2024-04-13T10:59:27.407 INFO:tasks.workunit.client.0.smithi134.stdout:3/813: dread dc/d27/d19/d8b/da8/d50/d25/d91/d93/f9a [0,4194304] 0 2024-04-13T10:59:27.408 INFO:tasks.workunit.client.0.smithi134.stdout:3/814: chown dc/d27/c7c 2451 1 2024-04-13T10:59:27.414 INFO:tasks.workunit.client.0.smithi134.stdout:4/789: truncate d4/f61 1122606 0 2024-04-13T10:59:27.419 INFO:tasks.workunit.client.0.smithi134.stdout:4/790: creat d4/d1f/d27/d3a/d65/f109 x:0 0 0 2024-04-13T10:59:27.419 INFO:tasks.workunit.client.0.smithi134.stdout:6/967: link d4/da/c5c d4/da/d15/d76/c13d 0 2024-04-13T10:59:27.424 INFO:tasks.workunit.client.0.smithi134.stdout:3/815: rename dc/fda to dc/d27/d19/d8b/da8/d50/d25/f111 0 2024-04-13T10:59:27.425 INFO:tasks.workunit.client.0.smithi134.stdout:6/968: mkdir d4/da/d15/d1f/d3c/d13e 0 2024-04-13T10:59:27.425 INFO:tasks.workunit.client.0.smithi134.stdout:3/816: dread - dc/d27/d19/d8b/da8/d50/d25/df6/ff5 zero size 2024-04-13T10:59:27.429 INFO:tasks.workunit.client.0.smithi134.stdout:6/969: creat d4/da/d15/d76/d92/f13f x:0 0 0 2024-04-13T10:59:27.430 INFO:tasks.workunit.client.0.smithi134.stdout:3/817: symlink dc/d27/d19/d8b/da8/d50/d25/d5f/d99/l112 0 2024-04-13T10:59:27.433 INFO:tasks.workunit.client.0.smithi134.stdout:4/791: link d4/d1f/d27/d75/d38/fd8 d4/d48/d4a/d7e/f10a 0 2024-04-13T10:59:27.435 INFO:tasks.workunit.client.0.smithi134.stdout:4/792: write d4/d1f/d90/fa2 [345649,55727] 0 2024-04-13T10:59:27.435 INFO:tasks.workunit.client.0.smithi134.stdout:3/818: dread dc/d1d/d102/f5e [0,4194304] 0 2024-04-13T10:59:27.435 INFO:tasks.workunit.client.0.smithi134.stdout:6/970: rename d4/da/d15/d1f/d3c/l84 to d4/da/dbb/dca/df7/l140 0 2024-04-13T10:59:27.438 INFO:tasks.workunit.client.0.smithi134.stdout:6/971: readlink d4/da/d15/d77/l6c 0 2024-04-13T10:59:27.440 INFO:tasks.workunit.client.0.smithi134.stdout:6/972: write d4/f5 [6006410,83812] 0 2024-04-13T10:59:27.444 INFO:tasks.workunit.client.0.smithi134.stdout:4/793: dwrite d4/dd/fcb [0,4194304] 0 2024-04-13T10:59:27.444 INFO:tasks.workunit.client.0.smithi134.stdout:4/794: readlink d4/l24 0 2024-04-13T10:59:27.448 INFO:tasks.workunit.client.0.smithi134.stdout:6/973: rename d4/da/d15/d1f/f98 to d4/da/d15/d1f/d3c/d13e/f141 0 2024-04-13T10:59:27.451 INFO:tasks.workunit.client.0.smithi134.stdout:3/819: dread dc/d27/d19/db1/fde [0,4194304] 0 2024-04-13T10:59:27.451 INFO:tasks.workunit.client.0.smithi134.stdout:3/820: chown dc 13 1 2024-04-13T10:59:27.453 INFO:tasks.workunit.client.0.smithi134.stdout:4/795: mknod d4/dd/d6d/d8c/da6/c10b 0 2024-04-13T10:59:27.457 INFO:tasks.workunit.client.0.smithi134.stdout:3/821: chown dc/d1d/d102/la4 85681141 1 2024-04-13T10:59:27.458 INFO:tasks.workunit.client.0.smithi134.stdout:3/822: fdatasync dc/d2a/f56 0 2024-04-13T10:59:27.470 INFO:tasks.workunit.client.0.smithi134.stdout:6/974: creat d4/da/d15/d1f/d24/da4/f142 x:0 0 0 2024-04-13T10:59:27.471 INFO:tasks.workunit.client.0.smithi134.stdout:6/975: getdents d4/da/d15/d76/ddd 0 2024-04-13T10:59:27.474 INFO:tasks.workunit.client.0.smithi134.stdout:6/976: read d4/da/d15/d1f/f108 [803086,129630] 0 2024-04-13T10:59:27.483 INFO:tasks.workunit.client.0.smithi134.stdout:4/796: dwrite d4/f61 [0,4194304] 0 2024-04-13T10:59:27.483 INFO:tasks.workunit.client.0.smithi134.stdout:3/823: dwrite dc/d1d/d102/f43 [0,4194304] 0 2024-04-13T10:59:27.485 INFO:tasks.workunit.client.0.smithi134.stdout:6/977: truncate d4/da/d15/d1f/f96 377569 0 2024-04-13T10:59:27.489 INFO:tasks.workunit.client.0.smithi134.stdout:3/824: creat dc/d2a/f113 x:0 0 0 2024-04-13T10:59:27.499 INFO:tasks.workunit.client.0.smithi134.stdout:3/825: dwrite dc/d27/d19/d8b/da8/d50/d25/d91/feb [0,4194304] 0 2024-04-13T10:59:27.502 INFO:tasks.workunit.client.0.smithi134.stdout:3/826: unlink dc/d27/d19/d8b/f90 0 2024-04-13T10:59:27.505 INFO:tasks.workunit.client.0.smithi134.stdout:4/797: dwrite d4/d82/f100 [0,4194304] 0 2024-04-13T10:59:27.508 INFO:tasks.workunit.client.0.smithi134.stdout:3/827: mkdir dc/d27/d19/d8b/d114 0 2024-04-13T10:59:27.514 INFO:tasks.workunit.client.0.smithi134.stdout:6/978: dread d4/da/d15/d77/f82 [0,4194304] 0 2024-04-13T10:59:27.518 INFO:tasks.workunit.client.0.smithi134.stdout:3/828: dwrite dc/d27/d19/d8b/da8/d50/d25/f3e [4194304,4194304] 0 2024-04-13T10:59:27.536 INFO:tasks.workunit.client.0.smithi134.stdout:4/798: write d4/dd/d6d/ff0 [298118,33463] 0 2024-04-13T10:59:27.539 INFO:tasks.workunit.client.0.smithi134.stdout:4/799: mknod d4/dd/d6d/d8c/d5f/dfc/c10c 0 2024-04-13T10:59:27.546 INFO:tasks.workunit.client.0.smithi134.stdout:3/829: dwrite dc/f10 [0,4194304] 0 2024-04-13T10:59:27.548 INFO:tasks.workunit.client.0.smithi134.stdout:6/979: dread d4/da/d15/d1f/d24/da4/fc5 [0,4194304] 0 2024-04-13T10:59:27.550 INFO:tasks.workunit.client.0.smithi134.stdout:3/830: unlink dc/d2a/fa7 0 2024-04-13T10:59:27.552 INFO:tasks.workunit.client.0.smithi134.stdout:6/980: unlink d4/da/leb 0 2024-04-13T10:59:27.553 INFO:tasks.workunit.client.0.smithi134.stdout:4/800: write d4/d1f/d27/d3a/d53/d58/f81 [7403170,39988] 0 2024-04-13T10:59:27.555 INFO:tasks.workunit.client.0.smithi134.stdout:3/831: symlink dc/d27/d19/d8b/d9b/l115 0 2024-04-13T10:59:27.556 INFO:tasks.workunit.client.0.smithi134.stdout:6/981: creat d4/da/d15/d1f/d24/d49/f143 x:0 0 0 2024-04-13T10:59:27.558 INFO:tasks.workunit.client.0.smithi134.stdout:4/801: symlink d4/d1f/d27/d75/d38/d79/l10d 0 2024-04-13T10:59:27.563 INFO:tasks.workunit.client.0.smithi134.stdout:4/802: mkdir d4/d1f/d27/d10e 0 2024-04-13T10:59:27.563 INFO:tasks.workunit.client.0.smithi134.stdout:6/982: dwrite d4/da/f107 [0,4194304] 0 2024-04-13T10:59:27.575 INFO:tasks.workunit.client.0.smithi134.stdout:4/803: rename d4/dd/df2/fc6 to d4/dd/d6d/f10f 0 2024-04-13T10:59:27.576 INFO:tasks.workunit.client.0.smithi134.stdout:4/804: chown d4/d48/f5a 84566655 1 2024-04-13T10:59:27.588 INFO:tasks.workunit.client.0.smithi134.stdout:6/983: write d4/da/fc8 [1881054,96601] 0 2024-04-13T10:59:27.590 INFO:tasks.workunit.client.0.smithi134.stdout:4/805: rename d4/dd/df2/c83 to d4/d1f/d27/d75/d38/c110 0 2024-04-13T10:59:27.593 INFO:tasks.workunit.client.0.smithi134.stdout:4/806: mkdir d4/d1f/d27/d3a/d53/dc1/db3/d111 0 2024-04-13T10:59:27.594 INFO:tasks.workunit.client.0.smithi134.stdout:6/984: mknod d4/da/d15/d1f/d24/c144 0 2024-04-13T10:59:27.599 INFO:tasks.workunit.client.0.smithi134.stdout:4/807: unlink d4/d1f/d27/d2e/f5c 0 2024-04-13T10:59:27.599 INFO:tasks.workunit.client.0.smithi134.stdout:6/985: mkdir d4/da/dbb/dca/d145 0 2024-04-13T10:59:27.641 INFO:tasks.workunit.client.0.smithi134.stdout:6/986: fdatasync d4/da/d15/d1f/d3c/d13e/f141 0 2024-04-13T10:59:27.675 INFO:tasks.workunit.client.0.smithi134.stdout:6/987: write d4/da/d15/d1f/d24/d2b/f67 [562777,98260] 0 2024-04-13T10:59:27.696 INFO:tasks.workunit.client.0.smithi134.stdout:6/988: chown d4/da/d15/d77/f82 639954 1 2024-04-13T10:59:27.696 INFO:tasks.workunit.client.0.smithi134.stdout:6/989: stat d4/da/d1a/fd6 0 2024-04-13T10:59:27.696 INFO:tasks.workunit.client.0.smithi134.stdout:6/990: unlink d4/da/l5d 0 2024-04-13T10:59:27.697 INFO:tasks.workunit.client.0.smithi134.stdout:6/991: creat d4/da/d15/d1f/d3c/dd0/f146 x:0 0 0 2024-04-13T10:59:27.697 INFO:tasks.workunit.client.0.smithi134.stdout:6/992: dread - d4/da/d15/d1f/d3c/dd0/f146 zero size 2024-04-13T10:59:27.697 INFO:tasks.workunit.client.0.smithi134.stdout:6/993: stat d4/da/dbb/de5/c13c 0 2024-04-13T10:59:27.704 INFO:tasks.workunit.client.0.smithi134.stdout:6/994: write d4/da/d15/fd3 [707158,45123] 0 2024-04-13T10:59:27.705 INFO:tasks.workunit.client.0.smithi134.stdout:6/995: dread - d4/da/d15/d1f/d24/d2b/f12f zero size 2024-04-13T10:59:27.709 INFO:tasks.workunit.client.0.smithi134.stdout:6/996: symlink d4/da/d15/d1f/d24/d49/d10f/l147 0 2024-04-13T10:59:27.710 INFO:tasks.workunit.client.0.smithi134.stdout:6/997: truncate d4/da/d15/d1f/d24/f12c 681136 0 2024-04-13T10:59:27.713 INFO:tasks.workunit.client.0.smithi134.stdout:6/998: fdatasync d4/da/d15/d77/d63/f86 0 2024-04-13T10:59:27.744 INFO:tasks.workunit.client.0.smithi134.stdout:6/999: dwrite d4/da/d15/d76/d92/fde [4194304,4194304] 0 2024-04-13T10:59:27.955 INFO:tasks.workunit.client.0.smithi134.stdout:2/790: sync 2024-04-13T10:59:27.955 INFO:tasks.workunit.client.0.smithi134.stdout:0/882: sync 2024-04-13T10:59:27.955 INFO:tasks.workunit.client.0.smithi134.stdout:7/841: sync 2024-04-13T10:59:27.956 INFO:tasks.workunit.client.0.smithi134.stdout:0/883: chown d4/d17/d20/d29/l35 27933 1 2024-04-13T10:59:27.960 INFO:tasks.workunit.client.0.smithi134.stdout:0/884: creat d4/d17/da/f13b x:0 0 0 2024-04-13T10:59:27.963 INFO:tasks.workunit.client.0.smithi134.stdout:2/791: rename d5/d6/d57/d6f/d30/d88/d94/ca7 to d5/da1/ce8 0 2024-04-13T10:59:27.966 INFO:tasks.workunit.client.0.smithi134.stdout:0/885: dwrite d4/d17/da/d22/d41/f4b [0,4194304] 0 2024-04-13T10:59:27.967 INFO:tasks.workunit.client.0.smithi134.stdout:2/792: rmdir d5/d6/d57/d6f/d30/d88/d96 39 2024-04-13T10:59:27.972 INFO:tasks.workunit.client.0.smithi134.stdout:0/886: creat d4/d17/d20/d29/d30/d64/d84/f13c x:0 0 0 2024-04-13T10:59:27.974 INFO:tasks.workunit.client.0.smithi134.stdout:7/842: dread da/d15/d26/d27/d3d/d46/fde [0,4194304] 0 2024-04-13T10:59:27.976 INFO:tasks.workunit.client.0.smithi134.stdout:7/843: fdatasync da/d15/d26/d27/d3d/d46/dbf/ffb 0 2024-04-13T10:59:27.980 INFO:tasks.workunit.client.0.smithi134.stdout:2/793: rename d5/d6/f69 to d5/d6/d57/d6f/d30/d58/fe9 0 2024-04-13T10:59:27.981 INFO:tasks.workunit.client.0.smithi134.stdout:7/844: mknod da/d15/d26/d27/cfc 0 2024-04-13T10:59:27.982 INFO:tasks.workunit.client.0.smithi134.stdout:7/845: chown da/c40 56715 1 2024-04-13T10:59:27.990 INFO:tasks.workunit.client.0.smithi134.stdout:7/846: write da/d15/d26/d27/d4f/d5f/d67/d73/fb9 [4175212,67425] 0 2024-04-13T10:59:27.994 INFO:tasks.workunit.client.0.smithi134.stdout:0/887: rename d4/d17/d20/da9/de1/cdf to d4/d17/c13d 0 2024-04-13T10:59:27.997 INFO:tasks.workunit.client.0.smithi134.stdout:4/808: sync 2024-04-13T10:59:27.997 INFO:tasks.workunit.client.0.smithi134.stdout:3/832: sync 2024-04-13T10:59:28.000 INFO:tasks.workunit.client.0.smithi134.stdout:4/809: read d4/d1f/f5b [3247735,69201] 0 2024-04-13T10:59:28.002 INFO:tasks.workunit.client.0.smithi134.stdout:7/847: rename da/d15/d26/d27/d4f/d5f/lce to da/d15/d26/d27/d3d/d46/lfd 0 2024-04-13T10:59:28.003 INFO:tasks.workunit.client.0.smithi134.stdout:0/888: dwrite d4/d17/da/d22/d41/d6e/d8a/d95/f10c [0,4194304] 0 2024-04-13T10:59:28.005 INFO:tasks.workunit.client.0.smithi134.stdout:2/794: dread d5/d6/d57/d6c/d29/f46 [0,4194304] 0 2024-04-13T10:59:28.007 INFO:tasks.workunit.client.0.smithi134.stdout:4/810: mknod d4/d1f/d27/d2e/d84/c112 0 2024-04-13T10:59:28.010 INFO:tasks.workunit.client.0.smithi134.stdout:7/848: dread da/d15/d26/d27/d4f/d5f/d67/f80 [0,4194304] 0 2024-04-13T10:59:28.013 INFO:tasks.workunit.client.0.smithi134.stdout:3/833: rename dc/d27/d19/d48/d49/f67 to dc/d27/d19/d8b/da8/d50/f116 0 2024-04-13T10:59:28.016 INFO:tasks.workunit.client.0.smithi134.stdout:4/811: rmdir d4/dd 39 2024-04-13T10:59:28.026 INFO:tasks.workunit.client.0.smithi134.stdout:2/795: symlink d5/d6/d34/dc0/lea 0 2024-04-13T10:59:28.026 INFO:tasks.workunit.client.0.smithi134.stdout:0/889: dwrite d4/d17/d20/d29/d30/d3e/f50 [0,4194304] 0 2024-04-13T10:59:28.027 INFO:tasks.workunit.client.0.smithi134.stdout:7/849: mkdir da/d15/dfe 0 2024-04-13T10:59:28.030 INFO:tasks.workunit.client.0.smithi134.stdout:3/834: mkdir dc/d1d/d58/dcd/d117 0 2024-04-13T10:59:28.030 INFO:tasks.workunit.client.0.smithi134.stdout:7/850: write da/d15/d26/fae [2332237,26619] 0 2024-04-13T10:59:28.032 INFO:tasks.workunit.client.0.smithi134.stdout:3/835: dread - dc/d27/d19/d48/dd9/ffb zero size 2024-04-13T10:59:28.038 INFO:tasks.workunit.client.0.smithi134.stdout:7/851: truncate da/d15/d26/d27/d4f/d5f/d67/d73/f75 468247 0 2024-04-13T10:59:28.038 INFO:tasks.workunit.client.0.smithi134.stdout:4/812: truncate d4/d82/fb4 205990 0 2024-04-13T10:59:28.040 INFO:tasks.workunit.client.0.smithi134.stdout:4/813: write d4/d1f/d27/d75/d38/d79/db9/fef [965225,21324] 0 2024-04-13T10:59:28.042 INFO:tasks.workunit.client.0.smithi134.stdout:0/890: link d4/d17/d20/da9/de1/fba d4/d17/da/d22/d41/dc2/f13e 0 2024-04-13T10:59:28.043 INFO:tasks.workunit.client.0.smithi134.stdout:7/852: dread da/d15/d26/d27/d4f/d5f/d67/f80 [0,4194304] 0 2024-04-13T10:59:28.045 INFO:tasks.workunit.client.0.smithi134.stdout:4/814: chown d4/d48/d86/ff1 177610 1 2024-04-13T10:59:28.046 INFO:tasks.workunit.client.0.smithi134.stdout:3/836: dread dc/d2a/f56 [0,4194304] 0 2024-04-13T10:59:28.053 INFO:tasks.workunit.client.0.smithi134.stdout:2/796: dwrite d5/d6/f68 [0,4194304] 0 2024-04-13T10:59:28.057 INFO:tasks.workunit.client.0.smithi134.stdout:2/797: write d5/d6/d57/d6f/fca [4754082,92031] 0 2024-04-13T10:59:28.058 INFO:tasks.workunit.client.0.smithi134.stdout:7/853: dread da/d15/d26/d27/d4f/d5f/d67/d73/fb9 [0,4194304] 0 2024-04-13T10:59:28.058 INFO:tasks.workunit.client.0.smithi134.stdout:4/815: rmdir d4/dd/d6d/d8c/d5f/dfc 39 2024-04-13T10:59:28.062 INFO:tasks.workunit.client.0.smithi134.stdout:3/837: mknod dc/d1d/d102/c118 0 2024-04-13T10:59:28.065 INFO:tasks.workunit.client.0.smithi134.stdout:2/798: fdatasync d5/d6/d34/f9e 0 2024-04-13T10:59:28.069 INFO:tasks.workunit.client.0.smithi134.stdout:7/854: mkdir da/d15/d26/d27/d4f/d5f/d88/dd9/dff 0 2024-04-13T10:59:28.071 INFO:tasks.workunit.client.0.smithi134.stdout:2/799: mknod d5/de/d50/ceb 0 2024-04-13T10:59:28.072 INFO:tasks.workunit.client.0.smithi134.stdout:2/800: chown d5/de/l89 77108752 1 2024-04-13T10:59:28.074 INFO:tasks.workunit.client.0.smithi134.stdout:3/838: truncate dc/d27/d19/f6a 3080337 0 2024-04-13T10:59:28.079 INFO:tasks.workunit.client.0.smithi134.stdout:2/801: rename d5/d6/d57/d6c/d29 to d5/d6/d70/db2/dec 0 2024-04-13T10:59:28.079 INFO:tasks.workunit.client.0.smithi134.stdout:2/802: readlink d5/d6/d57/d6c/lc6 0 2024-04-13T10:59:28.081 INFO:tasks.workunit.client.0.smithi134.stdout:2/803: chown d5/d6/d57/d6c/c97 0 1 2024-04-13T10:59:28.082 INFO:tasks.workunit.client.0.smithi134.stdout:2/804: write d5/d6/f68 [2725184,27971] 0 2024-04-13T10:59:28.082 INFO:tasks.workunit.client.0.smithi134.stdout:7/855: getdents da/d15/d26/d27/d4f/dd3 0 2024-04-13T10:59:28.085 INFO:tasks.workunit.client.0.smithi134.stdout:7/856: fdatasync da/d15/d26/f28 0 2024-04-13T10:59:28.086 INFO:tasks.workunit.client.0.smithi134.stdout:0/891: dread d4/d17/d20/da9/de1/dfc/f40 [0,4194304] 0 2024-04-13T10:59:28.088 INFO:tasks.workunit.client.0.smithi134.stdout:4/816: dread d4/d1f/d27/d75/d38/f9e [0,4194304] 0 2024-04-13T10:59:28.092 INFO:tasks.workunit.client.0.smithi134.stdout:3/839: dread dc/f71 [0,4194304] 0 2024-04-13T10:59:28.093 INFO:tasks.workunit.client.0.smithi134.stdout:3/840: chown dc/d1d/d58/de7 44506494 1 2024-04-13T10:59:28.096 INFO:tasks.workunit.client.0.smithi134.stdout:0/892: dwrite d4/d17/d20/da9/de1/dfc/d6d/d97/db6/fb8 [0,4194304] 0 2024-04-13T10:59:28.098 INFO:tasks.workunit.client.0.smithi134.stdout:0/893: chown d4/d17/d23/d51/d6a/d94/db2/f44 520 1 2024-04-13T10:59:28.099 INFO:tasks.workunit.client.0.smithi134.stdout:4/817: rename d4/dd/d6d/d106 to d4/d1f/d27/d75/d38/d79/d32/d67/d113 0 2024-04-13T10:59:28.099 INFO:tasks.workunit.client.0.smithi134.stdout:2/805: creat d5/d6/d57/d6c/fed x:0 0 0 2024-04-13T10:59:28.105 INFO:tasks.workunit.client.0.smithi134.stdout:2/806: write d5/d6/d70/db2/dec/f66 [148266,105149] 0 2024-04-13T10:59:28.107 INFO:tasks.workunit.client.0.smithi134.stdout:0/894: truncate d4/d17/d20/d29/d30/d7f/dc0/fc6 3743610 0 2024-04-13T10:59:28.112 INFO:tasks.workunit.client.0.smithi134.stdout:7/857: truncate da/d15/f6e 1232099 0 2024-04-13T10:59:28.115 INFO:tasks.workunit.client.0.smithi134.stdout:4/818: link d4/d1f/d27/d3a/d53/d58/f81 d4/dd/df2/dee/df3/f114 0 2024-04-13T10:59:28.120 INFO:tasks.workunit.client.0.smithi134.stdout:2/807: mknod d5/d6/cee 0 2024-04-13T10:59:28.124 INFO:tasks.workunit.client.0.smithi134.stdout:4/819: fsync d4/d1f/d27/d75/d38/f9e 0 2024-04-13T10:59:28.124 INFO:tasks.workunit.client.0.smithi134.stdout:3/841: dwrite dc/d27/d19/d8b/da8/d50/d25/d5f/d99/fc0 [0,4194304] 0 2024-04-13T10:59:28.124 INFO:tasks.workunit.client.0.smithi134.stdout:0/895: getdents d4/d17/da/d22/d12d 0 2024-04-13T10:59:28.125 INFO:tasks.workunit.client.0.smithi134.stdout:4/820: stat d4/d1f/d90 0 2024-04-13T10:59:28.131 INFO:tasks.workunit.client.0.smithi134.stdout:2/808: mkdir d5/de/d2e/def 0 2024-04-13T10:59:28.131 INFO:tasks.workunit.client.0.smithi134.stdout:2/809: readlink d5/de/d12/lcf 0 2024-04-13T10:59:28.132 INFO:tasks.workunit.client.0.smithi134.stdout:3/842: mkdir dc/d1d/d58/de7/d119 0 2024-04-13T10:59:28.135 INFO:tasks.workunit.client.0.smithi134.stdout:0/896: creat d4/d17/da/d22/deb/f13f x:0 0 0 2024-04-13T10:59:28.135 INFO:tasks.workunit.client.0.smithi134.stdout:0/897: stat d4/d17/c106 0 2024-04-13T10:59:28.138 INFO:tasks.workunit.client.0.smithi134.stdout:7/858: truncate da/d15/d26/d27/d3d/d9c/d48/f93 445906 0 2024-04-13T10:59:28.139 INFO:tasks.workunit.client.0.smithi134.stdout:3/843: creat dc/d27/d19/d8b/da8/f11a x:0 0 0 2024-04-13T10:59:28.144 INFO:tasks.workunit.client.0.smithi134.stdout:7/859: dwrite da/f54 [0,4194304] 0 2024-04-13T10:59:28.156 INFO:tasks.workunit.client.0.smithi134.stdout:4/821: write d4/d1f/d27/d75/d38/fba [750811,74488] 0 2024-04-13T10:59:28.158 INFO:tasks.workunit.client.0.smithi134.stdout:3/844: creat dc/d27/d19/df3/f11b x:0 0 0 2024-04-13T10:59:28.158 INFO:tasks.workunit.client.0.smithi134.stdout:4/822: chown d4/d1f/d90/faa 4136124 1 2024-04-13T10:59:28.162 INFO:tasks.workunit.client.0.smithi134.stdout:3/845: mkdir dc/d27/d19/d48/dd9/d11c 0 2024-04-13T10:59:28.166 INFO:tasks.workunit.client.0.smithi134.stdout:0/898: getdents d4/d17/d20/d29/d30 0 2024-04-13T10:59:28.166 INFO:tasks.workunit.client.0.smithi134.stdout:2/810: truncate d5/d6/d57/d6f/d30/d88/d96/fb0 1660730 0 2024-04-13T10:59:28.168 INFO:tasks.workunit.client.0.smithi134.stdout:2/811: dread - d5/fe1 zero size 2024-04-13T10:59:28.170 INFO:tasks.workunit.client.0.smithi134.stdout:0/899: read d4/d17/da/d22/deb/fdc [3324084,27309] 0 2024-04-13T10:59:28.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/846: dwrite dc/d27/d19/d48/dd9/ffb [0,4194304] 0 2024-04-13T10:59:28.173 INFO:tasks.workunit.client.0.smithi134.stdout:3/847: chown dc/d27/d19/d8b/da8/d50/d25/d5f/d75/lad 29255742 1 2024-04-13T10:59:28.177 INFO:tasks.workunit.client.0.smithi134.stdout:7/860: truncate da/d15/d26/d27/d3d/d46/f4b 2577824 0 2024-04-13T10:59:28.182 INFO:tasks.workunit.client.0.smithi134.stdout:2/812: rmdir d5/de/d50 39 2024-04-13T10:59:28.185 INFO:tasks.workunit.client.0.smithi134.stdout:4/823: write d4/d1f/d27/d2e/d84/fb7 [949069,92937] 0 2024-04-13T10:59:28.185 INFO:tasks.workunit.client.0.smithi134.stdout:0/900: read - d4/d17/d20/da9/de1/fba zero size 2024-04-13T10:59:28.188 INFO:tasks.workunit.client.0.smithi134.stdout:0/901: write d4/d17/d20/d29/d30/d64/d84/f13c [80647,42183] 0 2024-04-13T10:59:28.190 INFO:tasks.workunit.client.0.smithi134.stdout:7/861: write da/d15/d26/d38/f8c [1587858,98917] 0 2024-04-13T10:59:28.193 INFO:tasks.workunit.client.0.smithi134.stdout:2/813: symlink d5/d6/d34/dc0/lf0 0 2024-04-13T10:59:28.194 INFO:tasks.workunit.client.0.smithi134.stdout:4/824: creat d4/d48/d4a/d7e/f115 x:0 0 0 2024-04-13T10:59:28.195 INFO:tasks.workunit.client.0.smithi134.stdout:3/848: mkdir dc/d27/d19/d48/d8e/d105/d11d 0 2024-04-13T10:59:28.203 INFO:tasks.workunit.client.0.smithi134.stdout:3/849: rmdir dc/d27/d19/d48/d49 39 2024-04-13T10:59:28.208 INFO:tasks.workunit.client.0.smithi134.stdout:2/814: rename d5/d6/d70/d84/le2 to d5/de/d2e/d8f/lf1 0 2024-04-13T10:59:28.210 INFO:tasks.workunit.client.0.smithi134.stdout:7/862: link da/d15/d26/d38/cab da/d15/d85/c100 0 2024-04-13T10:59:28.214 INFO:tasks.workunit.client.0.smithi134.stdout:0/902: dread d4/d17/d20/d29/d30/d64/d84/f8d [0,4194304] 0 2024-04-13T10:59:28.215 INFO:tasks.workunit.client.0.smithi134.stdout:4/825: dwrite d4/dd/d6d/f80 [0,4194304] 0 2024-04-13T10:59:28.216 INFO:tasks.workunit.client.0.smithi134.stdout:4/826: stat d4/d1f/f5b 0 2024-04-13T10:59:28.218 INFO:tasks.workunit.client.0.smithi134.stdout:4/827: dread d4/d48/d50/da0/fad [0,4194304] 0 2024-04-13T10:59:28.222 INFO:tasks.workunit.client.0.smithi134.stdout:3/850: write dc/d27/d19/faa [1280151,117908] 0 2024-04-13T10:59:28.224 INFO:tasks.workunit.client.0.smithi134.stdout:7/863: write da/d15/d26/f30 [2426304,25946] 0 2024-04-13T10:59:28.226 INFO:tasks.workunit.client.0.smithi134.stdout:2/815: creat d5/d6/d70/ff2 x:0 0 0 2024-04-13T10:59:28.227 INFO:tasks.workunit.client.0.smithi134.stdout:4/828: write d4/d48/d50/da0/fcc [927011,45391] 0 2024-04-13T10:59:28.232 INFO:tasks.workunit.client.0.smithi134.stdout:7/864: mknod da/d15/df5/c101 0 2024-04-13T10:59:28.232 INFO:tasks.workunit.client.0.smithi134.stdout:3/851: write dc/d27/d19/d48/d49/f6c [1303673,5463] 0 2024-04-13T10:59:28.233 INFO:tasks.workunit.client.0.smithi134.stdout:7/865: dread - da/d15/d26/fb4 zero size 2024-04-13T10:59:28.234 INFO:tasks.workunit.client.0.smithi134.stdout:2/816: mknod d5/cf3 0 2024-04-13T10:59:28.235 INFO:tasks.workunit.client.0.smithi134.stdout:0/903: getdents d4/d17/da/d22/d41/d6e/d8a 0 2024-04-13T10:59:28.236 INFO:tasks.workunit.client.0.smithi134.stdout:7/866: read da/d15/d26/d4a/fd1 [94923,61362] 0 2024-04-13T10:59:28.236 INFO:tasks.workunit.client.0.smithi134.stdout:3/852: symlink dc/d27/d19/d8b/d9b/l11e 0 2024-04-13T10:59:28.240 INFO:tasks.workunit.client.0.smithi134.stdout:4/829: write d4/d1f/d27/d75/d38/d79/d32/d67/d9b/f9d [1037389,112354] 0 2024-04-13T10:59:28.242 INFO:tasks.workunit.client.0.smithi134.stdout:0/904: symlink d4/d17/d23/d51/d6b/d91/d98/d62/l140 0 2024-04-13T10:59:28.284 INFO:tasks.workunit.client.0.smithi134.stdout:7/867: fsync da/d15/d26/d27/d4f/d5f/d67/d73/d92/fe4 0 2024-04-13T10:59:28.285 INFO:tasks.workunit.client.0.smithi134.stdout:2/817: symlink d5/de/lf4 0 2024-04-13T10:59:28.286 INFO:tasks.workunit.client.0.smithi134.stdout:4/830: write d4/d48/d50/fc2 [1163958,13522] 0 2024-04-13T10:59:28.289 INFO:tasks.workunit.client.0.smithi134.stdout:7/868: dread da/d15/d26/d27/d3d/d46/fde [0,4194304] 0 2024-04-13T10:59:28.358 INFO:tasks.workunit.client.0.smithi134.stdout:2/818: mknod d5/de/cf5 0 2024-04-13T10:59:28.361 INFO:tasks.workunit.client.0.smithi134.stdout:4/831: mkdir d4/dd/d6d/d8c/d5f/dfc/d108/d116 0 2024-04-13T10:59:28.362 INFO:tasks.workunit.client.0.smithi134.stdout:0/905: dwrite d4/d17/d20/da9/de1/dfc/d6d/d97/f131 [0,4194304] 0 2024-04-13T10:59:28.365 INFO:tasks.workunit.client.0.smithi134.stdout:2/819: symlink d5/d6/d34/dc0/lf6 0 2024-04-13T10:59:28.368 INFO:tasks.workunit.client.0.smithi134.stdout:4/832: mkdir d4/d1f/d27/d2e/d117 0 2024-04-13T10:59:28.369 INFO:tasks.workunit.client.0.smithi134.stdout:7/869: write da/d15/f22 [509875,115196] 0 2024-04-13T10:59:28.371 INFO:tasks.workunit.client.0.smithi134.stdout:7/870: dread - da/d15/d26/d4a/dc7/ff1 zero size 2024-04-13T10:59:28.373 INFO:tasks.workunit.client.0.smithi134.stdout:0/906: creat d4/d17/da/d22/d41/dc2/f141 x:0 0 0 2024-04-13T10:59:28.376 INFO:tasks.workunit.client.0.smithi134.stdout:2/820: truncate d5/de/d12/fa2 1128268 0 2024-04-13T10:59:28.377 INFO:tasks.workunit.client.0.smithi134.stdout:7/871: mknod da/d15/d26/d27/d4f/d5f/d67/d76/c102 0 2024-04-13T10:59:28.378 INFO:tasks.workunit.client.0.smithi134.stdout:0/907: mkdir d4/d17/d23/d51/d6b/d91/d98/d62/d142 0 2024-04-13T10:59:28.379 INFO:tasks.workunit.client.0.smithi134.stdout:4/833: dread d4/d1f/d27/d75/d38/d79/d32/d67/d9b/fc3 [0,4194304] 0 2024-04-13T10:59:28.380 INFO:tasks.workunit.client.0.smithi134.stdout:7/872: fdatasync da/d15/d26/d27/f5c 0 2024-04-13T10:59:28.380 INFO:tasks.workunit.client.0.smithi134.stdout:2/821: truncate d5/d6/d57/d6f/d30/d58/d59/f7e 3879569 0 2024-04-13T10:59:28.383 INFO:tasks.workunit.client.0.smithi134.stdout:0/908: creat d4/d17/d23/d51/d6a/d104/f143 x:0 0 0 2024-04-13T10:59:28.385 INFO:tasks.workunit.client.0.smithi134.stdout:0/909: read d4/d17/da/d22/f25 [412724,38492] 0 2024-04-13T10:59:28.386 INFO:tasks.workunit.client.0.smithi134.stdout:2/822: dread d5/d6/d57/d6f/d30/d88/d96/fb1 [0,4194304] 0 2024-04-13T10:59:28.387 INFO:tasks.workunit.client.0.smithi134.stdout:0/910: write d4/d17/d20/da9/de1/dfc/f5f [553518,97150] 0 2024-04-13T10:59:28.389 INFO:tasks.workunit.client.0.smithi134.stdout:4/834: mknod d4/dd/d6d/d8c/d5f/dfc/d108/d116/c118 0 2024-04-13T10:59:28.399 INFO:tasks.workunit.client.0.smithi134.stdout:0/911: mknod d4/d17/da/d22/d41/c144 0 2024-04-13T10:59:28.402 INFO:tasks.workunit.client.0.smithi134.stdout:2/823: write d5/de/f75 [4386824,73464] 0 2024-04-13T10:59:28.403 INFO:tasks.workunit.client.0.smithi134.stdout:2/824: stat d5/d6/d70/d84 0 2024-04-13T10:59:28.407 INFO:tasks.workunit.client.0.smithi134.stdout:7/873: getdents da/d15/d26/d27/d3d/d46/dbf 0 2024-04-13T10:59:28.410 INFO:tasks.workunit.client.0.smithi134.stdout:4/835: truncate d4/dd/d6d/f10f 2529860 0 2024-04-13T10:59:28.411 INFO:tasks.workunit.client.0.smithi134.stdout:2/825: mknod d5/de/cf7 0 2024-04-13T10:59:28.413 INFO:tasks.workunit.client.0.smithi134.stdout:4/836: mkdir d4/d119 0 2024-04-13T10:59:28.415 INFO:tasks.workunit.client.0.smithi134.stdout:4/837: dread - d4/d1f/d27/d3a/d65/f8d zero size 2024-04-13T10:59:28.416 INFO:tasks.workunit.client.0.smithi134.stdout:4/838: stat d4/d48/d4a/l5d 0 2024-04-13T10:59:28.422 INFO:tasks.workunit.client.0.smithi134.stdout:7/874: dread da/d15/d85/f8f [0,4194304] 0 2024-04-13T10:59:28.432 INFO:tasks.workunit.client.0.smithi134.stdout:2/826: dread d5/de/d2e/d8f/f6e [4194304,4194304] 0 2024-04-13T10:59:28.433 INFO:tasks.workunit.client.0.smithi134.stdout:7/875: getdents da/d15/d26/d38 0 2024-04-13T10:59:28.435 INFO:tasks.workunit.client.0.smithi134.stdout:2/827: write d5/de/f10 [3598506,3596] 0 2024-04-13T10:59:28.436 INFO:tasks.workunit.client.0.smithi134.stdout:7/876: rmdir da/d15/d26/d27/d4f/d5f/d67/d73/d92 39 2024-04-13T10:59:28.436 INFO:tasks.workunit.client.0.smithi134.stdout:2/828: stat d5/de/d12/f43 0 2024-04-13T10:59:28.536 INFO:tasks.workunit.client.0.smithi134.stdout:4/839: dread d4/d48/f72 [4194304,4194304] 0 2024-04-13T10:59:28.537 INFO:tasks.workunit.client.0.smithi134.stdout:7/877: symlink da/d15/d26/d27/d4f/d5f/l103 0 2024-04-13T10:59:28.538 INFO:tasks.workunit.client.0.smithi134.stdout:7/878: chown da/d15/d26/d4a/c65 3276 1 2024-04-13T10:59:28.539 INFO:tasks.workunit.client.0.smithi134.stdout:2/829: dread d5/de/d2e/fdb [0,4194304] 0 2024-04-13T10:59:28.539 INFO:tasks.workunit.client.0.smithi134.stdout:4/840: rmdir d4/d1f/d27/d2e 39 2024-04-13T10:59:28.554 INFO:tasks.workunit.client.0.smithi134.stdout:4/841: dread d4/dd/df2/dee/df3/f114 [0,4194304] 0 2024-04-13T10:59:28.554 INFO:tasks.workunit.client.0.smithi134.stdout:4/842: chown d4/d1f/d27/c8e 33492959 1 2024-04-13T10:59:28.562 INFO:tasks.workunit.client.0.smithi134.stdout:7/879: creat da/d15/d26/d27/d4f/dd3/f104 x:0 0 0 2024-04-13T10:59:28.563 INFO:tasks.workunit.client.0.smithi134.stdout:7/880: fdatasync da/d15/d26/d27/d4f/dd3/f104 0 2024-04-13T10:59:28.564 INFO:tasks.workunit.client.0.smithi134.stdout:2/830: creat d5/de/d50/ff8 x:0 0 0 2024-04-13T10:59:28.570 INFO:tasks.workunit.client.0.smithi134.stdout:4/843: write d4/d1f/d27/d75/d38/d79/fb2 [1030664,68515] 0 2024-04-13T10:59:28.572 INFO:tasks.workunit.client.0.smithi134.stdout:4/844: fsync d4/dd/d6d/f102 0 2024-04-13T10:59:28.574 INFO:tasks.workunit.client.0.smithi134.stdout:7/881: write da/d15/d26/d27/d3d/d9c/d5a/f72 [996788,121463] 0 2024-04-13T10:59:28.574 INFO:tasks.workunit.client.0.smithi134.stdout:2/831: dwrite d5/d6/d57/d6f/fce [0,4194304] 0 2024-04-13T10:59:28.577 INFO:tasks.workunit.client.0.smithi134.stdout:4/845: fdatasync d4/d48/d50/da0/fad 0 2024-04-13T10:59:28.579 INFO:tasks.workunit.client.0.smithi134.stdout:2/832: stat d5/d6/c45 0 2024-04-13T10:59:28.583 INFO:tasks.workunit.client.0.smithi134.stdout:7/882: creat da/d15/d26/d38/f105 x:0 0 0 2024-04-13T10:59:28.583 INFO:tasks.workunit.client.0.smithi134.stdout:4/846: dread d4/d1f/d27/d75/d38/d79/f1c [4194304,4194304] 0 2024-04-13T10:59:28.585 INFO:tasks.workunit.client.0.smithi134.stdout:4/847: write d4/d1f/d27/d75/d38/d79/f46 [2639972,67905] 0 2024-04-13T10:59:28.586 INFO:tasks.workunit.client.0.smithi134.stdout:4/848: stat d4/d1f/d27/d75/d38/d79/l8a 0 2024-04-13T10:59:28.587 INFO:tasks.workunit.client.0.smithi134.stdout:4/849: readlink d4/d1f/d27/d75/d38/d79/l10d 0 2024-04-13T10:59:28.588 INFO:tasks.workunit.client.0.smithi134.stdout:2/833: creat d5/d6/d70/d9c/ff9 x:0 0 0 2024-04-13T10:59:28.589 INFO:tasks.workunit.client.0.smithi134.stdout:2/834: chown d5/de/d12/lc4 179000 1 2024-04-13T10:59:28.590 INFO:tasks.workunit.client.0.smithi134.stdout:7/883: mknod da/d15/d26/d27/d4f/d5f/d88/c106 0 2024-04-13T10:59:28.594 INFO:tasks.workunit.client.0.smithi134.stdout:7/884: dread da/d15/d26/d27/d3d/fbd [0,4194304] 0 2024-04-13T10:59:28.595 INFO:tasks.workunit.client.0.smithi134.stdout:4/850: creat d4/dd/d6d/d8c/d5f/dfc/d108/f11a x:0 0 0 2024-04-13T10:59:28.598 INFO:tasks.workunit.client.0.smithi134.stdout:2/835: symlink d5/d6/d57/d6f/d30/dd1/lfa 0 2024-04-13T10:59:28.605 INFO:tasks.workunit.client.0.smithi134.stdout:7/885: creat da/df6/f107 x:0 0 0 2024-04-13T10:59:28.607 INFO:tasks.workunit.client.0.smithi134.stdout:4/851: dwrite d4/d1f/d27/d75/f68 [0,4194304] 0 2024-04-13T10:59:28.693 INFO:tasks.workunit.client.0.smithi134.stdout:2/836: fdatasync d5/d6/d57/d6f/f44 0 2024-04-13T10:59:28.700 INFO:tasks.workunit.client.0.smithi134.stdout:2/837: dwrite d5/de/d50/f6b [4194304,4194304] 0 2024-04-13T10:59:28.702 INFO:tasks.workunit.client.0.smithi134.stdout:4/852: dread d4/d1f/d27/d75/d38/d79/d32/d67/d9b/fbe [0,4194304] 0 2024-04-13T10:59:28.704 INFO:tasks.workunit.client.0.smithi134.stdout:7/886: mknod da/d15/dfe/c108 0 2024-04-13T10:59:28.708 INFO:tasks.workunit.client.0.smithi134.stdout:4/853: symlink d4/dd/d6d/d8c/d5f/dfc/d108/l11b 0 2024-04-13T10:59:28.711 INFO:tasks.workunit.client.0.smithi134.stdout:7/887: rename da/d15/d26/c42 to da/d15/d26/c109 0 2024-04-13T10:59:28.714 INFO:tasks.workunit.client.0.smithi134.stdout:7/888: symlink da/d15/df5/l10a 0 2024-04-13T10:59:28.720 INFO:tasks.workunit.client.0.smithi134.stdout:7/889: truncate da/d15/f81 1053402 0 2024-04-13T10:59:28.726 INFO:tasks.workunit.client.0.smithi134.stdout:7/890: mknod da/d15/d26/d38/c10b 0 2024-04-13T10:59:28.726 INFO:tasks.workunit.client.0.smithi134.stdout:7/891: stat da/d15/d26/d27/d3d/f7a 0 2024-04-13T10:59:28.732 INFO:tasks.workunit.client.0.smithi134.stdout:4/854: dread d4/d1f/d27/d75/f31 [8388608,4194304] 0 2024-04-13T10:59:28.736 INFO:tasks.workunit.client.0.smithi134.stdout:4/855: creat d4/dd/d6d/d8c/d5f/dfc/d108/f11c x:0 0 0 2024-04-13T10:59:28.741 INFO:tasks.workunit.client.0.smithi134.stdout:4/856: dwrite d4/f7a [0,4194304] 0 2024-04-13T10:59:28.746 INFO:tasks.workunit.client.0.smithi134.stdout:4/857: symlink d4/d1f/d27/d3a/d53/d58/l11d 0 2024-04-13T10:59:28.751 INFO:tasks.workunit.client.0.smithi134.stdout:2/838: write d5/d6/d57/d6f/d30/f71 [776388,7779] 0 2024-04-13T10:59:28.752 INFO:tasks.workunit.client.0.smithi134.stdout:2/839: dread - d5/fe1 zero size 2024-04-13T10:59:28.756 INFO:tasks.workunit.client.0.smithi134.stdout:4/858: dwrite d4/d1f/d27/d2e/d84/fb7 [0,4194304] 0 2024-04-13T10:59:28.759 INFO:tasks.workunit.client.0.smithi134.stdout:4/859: fdatasync d4/d1f/d27/d75/d38/d79/f46 0 2024-04-13T10:59:28.762 INFO:tasks.workunit.client.0.smithi134.stdout:2/840: dwrite d5/d6/d57/d6f/d30/d88/fd3 [0,4194304] 0 2024-04-13T10:59:28.763 INFO:tasks.workunit.client.0.smithi134.stdout:4/860: chown d4/d1f/d27/l47 1361786 1 2024-04-13T10:59:28.775 INFO:tasks.workunit.client.0.smithi134.stdout:4/861: link d4/d82/l91 d4/d1f/d27/d75/l11e 0 2024-04-13T10:59:28.777 INFO:tasks.workunit.client.0.smithi134.stdout:4/862: rmdir d4/d1f/d27/d75 39 2024-04-13T10:59:28.785 INFO:tasks.workunit.client.0.smithi134.stdout:4/863: dwrite d4/d48/d50/fc2 [0,4194304] 0 2024-04-13T10:59:28.787 INFO:tasks.workunit.client.0.smithi134.stdout:7/892: dwrite da/dad/de3/fc4 [0,4194304] 0 2024-04-13T10:59:28.789 INFO:tasks.workunit.client.0.smithi134.stdout:4/864: symlink d4/d1f/d90/l11f 0 2024-04-13T10:59:28.792 INFO:tasks.workunit.client.0.smithi134.stdout:7/893: mkdir da/d15/d26/d27/d3d/d9c/d48/d10c 0 2024-04-13T10:59:28.793 INFO:tasks.workunit.client.0.smithi134.stdout:4/865: mkdir d4/dd/d120 0 2024-04-13T10:59:28.797 INFO:tasks.workunit.client.0.smithi134.stdout:4/866: creat d4/d48/d4a/f121 x:0 0 0 2024-04-13T10:59:28.800 INFO:tasks.workunit.client.0.smithi134.stdout:7/894: dwrite da/d15/d26/d27/d3d/d9c/f55 [4194304,4194304] 0 2024-04-13T10:59:28.802 INFO:tasks.workunit.client.0.smithi134.stdout:7/895: rmdir da/d15/d26 39 2024-04-13T10:59:28.802 INFO:tasks.workunit.client.0.smithi134.stdout:3/853: sync 2024-04-13T10:59:28.802 INFO:tasks.workunit.client.0.smithi134.stdout:0/912: sync 2024-04-13T10:59:28.804 INFO:tasks.workunit.client.0.smithi134.stdout:0/913: write d4/d17/d20/d29/f87 [653684,129805] 0 2024-04-13T10:59:28.814 INFO:tasks.workunit.client.0.smithi134.stdout:7/896: dwrite da/d15/d26/d38/f105 [0,4194304] 0 2024-04-13T10:59:28.815 INFO:tasks.workunit.client.0.smithi134.stdout:0/914: link d4/d17/d20/d29/d30/d3e/l66 d4/d17/d20/d29/d30/d7f/dc0/l145 0 2024-04-13T10:59:28.816 INFO:tasks.workunit.client.0.smithi134.stdout:3/854: getdents dc/d27/d19/d8b/da8 0 2024-04-13T10:59:28.821 INFO:tasks.workunit.client.0.smithi134.stdout:0/915: unlink d4/d17/d20/d29/d30/d64/d84/dd3/d8c/faa 0 2024-04-13T10:59:28.826 INFO:tasks.workunit.client.0.smithi134.stdout:3/855: read dc/d27/d19/d8b/da8/d50/f2d [439804,56054] 0 2024-04-13T10:59:28.835 INFO:tasks.workunit.client.0.smithi134.stdout:2/841: dwrite d5/d6/d57/d6f/d30/d58/f9b [0,4194304] 0 2024-04-13T10:59:28.838 INFO:tasks.workunit.client.0.smithi134.stdout:2/842: write d5/d6/d70/db2/fd9 [97136,75719] 0 2024-04-13T10:59:28.838 INFO:tasks.workunit.client.0.smithi134.stdout:2/843: truncate d5/fe1 624814 0 2024-04-13T10:59:28.853 INFO:tasks.workunit.client.0.smithi134.stdout:4/867: dread d4/d1f/d27/d75/d38/d79/f28 [0,4194304] 0 2024-04-13T10:59:28.919 INFO:tasks.workunit.client.0.smithi134.stdout:2/844: creat d5/d6/d34/dc0/ffb x:0 0 0 2024-04-13T10:59:28.922 INFO:tasks.workunit.client.0.smithi134.stdout:4/868: symlink d4/d1f/d27/l122 0 2024-04-13T10:59:28.925 INFO:tasks.workunit.client.0.smithi134.stdout:4/869: dread - d4/d48/d86/ff1 zero size 2024-04-13T10:59:28.925 INFO:tasks.workunit.client.0.smithi134.stdout:2/845: read d5/d6/d57/d6f/d30/d58/f9d [120853,43512] 0 2024-04-13T10:59:28.927 INFO:tasks.workunit.client.0.smithi134.stdout:4/870: write d4/d48/d4a/d7e/f10a [3226526,75248] 0 2024-04-13T10:59:28.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:28 smithi134 ceph-mon[39696]: pgmap v48: 65 pgs: 65 active+clean; 1.9 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 46 MiB/s rd, 103 MiB/s wr, 257 op/s 2024-04-13T10:59:28.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:28 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:59:28.937 INFO:tasks.workunit.client.0.smithi134.stdout:4/871: dread d4/f7a [0,4194304] 0 2024-04-13T10:59:28.944 INFO:tasks.workunit.client.0.smithi134.stdout:4/872: creat d4/d1f/d27/d2e/f123 x:0 0 0 2024-04-13T10:59:28.962 INFO:tasks.workunit.client.0.smithi134.stdout:2/846: getdents d5/d6/d34/dc0 0 2024-04-13T10:59:28.962 INFO:tasks.workunit.client.0.smithi134.stdout:0/916: write d4/d17/da/f15 [2083200,13643] 0 2024-04-13T10:59:28.969 INFO:tasks.workunit.client.0.smithi134.stdout:7/897: dwrite da/d15/d26/f35 [4194304,4194304] 0 2024-04-13T10:59:28.970 INFO:tasks.workunit.client.0.smithi134.stdout:0/917: truncate d4/d17/d23/d51/d6b/d91/d98/d62/f70 1070186 0 2024-04-13T10:59:28.971 INFO:tasks.workunit.client.0.smithi134.stdout:7/898: chown da/dad/de3/fa2 41596271 1 2024-04-13T10:59:28.972 INFO:tasks.workunit.client.0.smithi134.stdout:4/873: truncate d4/d1f/d27/d75/d38/fd8 3040983 0 2024-04-13T10:59:28.977 INFO:tasks.workunit.client.0.smithi134.stdout:2/847: rename d5/d6/d57/d6f to d5/d6/d70/dfc 0 2024-04-13T10:59:28.978 INFO:tasks.workunit.client.0.smithi134.stdout:0/918: creat d4/d17/d20/da9/de1/dfc/d6d/d97/dbe/f146 x:0 0 0 2024-04-13T10:59:28.985 INFO:tasks.workunit.client.0.smithi134.stdout:4/874: truncate d4/d1f/d27/d3a/d65/f66 657371 0 2024-04-13T10:59:28.987 INFO:tasks.workunit.client.0.smithi134.stdout:4/875: chown d4/d1f/cb0 1609958 1 2024-04-13T10:59:28.992 INFO:tasks.workunit.client.0.smithi134.stdout:0/919: dwrite d4/d17/d23/d51/d6b/d91/d98/d92/dca/f125 [0,4194304] 0 2024-04-13T10:59:28.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:28 smithi194 ceph-mon[46737]: pgmap v48: 65 pgs: 65 active+clean; 1.9 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 46 MiB/s rd, 103 MiB/s wr, 257 op/s 2024-04-13T10:59:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:28 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:59:29.002 INFO:tasks.workunit.client.0.smithi134.stdout:4/876: creat d4/d1f/d27/d3a/d53/f124 x:0 0 0 2024-04-13T10:59:29.005 INFO:tasks.workunit.client.0.smithi134.stdout:7/899: write da/d15/d26/d27/d4f/d5f/d67/d73/f75 [1120653,107962] 0 2024-04-13T10:59:29.009 INFO:tasks.workunit.client.0.smithi134.stdout:4/877: creat d4/d1f/d27/d2e/d84/ddb/f125 x:0 0 0 2024-04-13T10:59:29.010 INFO:tasks.workunit.client.0.smithi134.stdout:0/920: mknod d4/d17/d20/d29/dcd/dfb/d115/c147 0 2024-04-13T10:59:29.018 INFO:tasks.workunit.client.0.smithi134.stdout:0/921: mkdir d4/d17/d20/d29/dcd/d148 0 2024-04-13T10:59:29.019 INFO:tasks.workunit.client.0.smithi134.stdout:7/900: mkdir da/d15/d26/d27/d3d/d9c/d10d 0 2024-04-13T10:59:29.021 INFO:tasks.workunit.client.0.smithi134.stdout:2/848: write d5/d6/d70/dfc/d30/fb7 [675477,30458] 0 2024-04-13T10:59:29.022 INFO:tasks.workunit.client.0.smithi134.stdout:0/922: mknod d4/d17/d23/d51/d6b/d91/d98/d62/daf/dc7/c149 0 2024-04-13T10:59:29.024 INFO:tasks.workunit.client.0.smithi134.stdout:2/849: write d5/d6/f68 [3928602,30526] 0 2024-04-13T10:59:29.024 INFO:tasks.workunit.client.0.smithi134.stdout:7/901: truncate da/d15/d26/d27/d3d/d46/dbf/fe5 315134 0 2024-04-13T10:59:29.030 INFO:tasks.workunit.client.0.smithi134.stdout:4/878: dread d4/d1f/d27/d75/d38/f41 [0,4194304] 0 2024-04-13T10:59:29.036 INFO:tasks.workunit.client.0.smithi134.stdout:4/879: truncate d4/d1f/d27/d75/d38/d79/d32/f74 940409 0 2024-04-13T10:59:29.038 INFO:tasks.workunit.client.0.smithi134.stdout:7/902: getdents da 0 2024-04-13T10:59:29.042 INFO:tasks.workunit.client.0.smithi134.stdout:7/903: unlink da/c18 0 2024-04-13T10:59:29.043 INFO:tasks.workunit.client.0.smithi134.stdout:2/850: dwrite d5/d6/d70/dfc/d30/f4f [4194304,4194304] 0 2024-04-13T10:59:29.046 INFO:tasks.workunit.client.0.smithi134.stdout:7/904: chown da/d15/d26/d27/d4f/d5f/d88 3 1 2024-04-13T10:59:29.047 INFO:tasks.workunit.client.0.smithi134.stdout:0/923: dwrite d4/d17/da/f27 [0,4194304] 0 2024-04-13T10:59:29.050 INFO:tasks.workunit.client.0.smithi134.stdout:4/880: dread d4/dd/df2/dee/df3/f114 [0,4194304] 0 2024-04-13T10:59:29.051 INFO:tasks.workunit.client.0.smithi134.stdout:2/851: truncate d5/d6/d70/db2/fd9 1020864 0 2024-04-13T10:59:29.054 INFO:tasks.workunit.client.0.smithi134.stdout:4/881: chown d4/dd/d6d/d8c/d5f/dfc/d108/d116 209 1 2024-04-13T10:59:29.057 INFO:tasks.workunit.client.0.smithi134.stdout:2/852: unlink d5/d6/d70/dfc/d30/d88/d96/lab 0 2024-04-13T10:59:29.066 INFO:tasks.workunit.client.0.smithi134.stdout:7/905: write da/d15/d26/d27/d4f/d5f/d67/d76/faa [6847197,28659] 0 2024-04-13T10:59:29.066 INFO:tasks.workunit.client.0.smithi134.stdout:2/853: dwrite d5/de/d50/ff8 [0,4194304] 0 2024-04-13T10:59:29.068 INFO:tasks.workunit.client.0.smithi134.stdout:4/882: link d4/d1f/d27/c8e d4/d1f/d27/d75/d38/d79/db9/c126 0 2024-04-13T10:59:29.077 INFO:tasks.workunit.client.0.smithi134.stdout:4/883: creat d4/dd/d6d/d8c/d5f/dfc/d108/d116/f127 x:0 0 0 2024-04-13T10:59:29.079 INFO:tasks.workunit.client.0.smithi134.stdout:2/854: dwrite d5/d6/d70/fa0 [4194304,4194304] 0 2024-04-13T10:59:29.081 INFO:tasks.workunit.client.0.smithi134.stdout:7/906: mknod da/d15/d26/d27/d3d/d9c/c10e 0 2024-04-13T10:59:29.086 INFO:tasks.workunit.client.0.smithi134.stdout:2/855: symlink d5/d6/d34/dc0/lfd 0 2024-04-13T10:59:29.087 INFO:tasks.workunit.client.0.smithi134.stdout:4/884: creat d4/f128 x:0 0 0 2024-04-13T10:59:29.087 INFO:tasks.workunit.client.0.smithi134.stdout:4/885: stat d4/d1f/d27/d75/d38 0 2024-04-13T10:59:29.090 INFO:tasks.workunit.client.0.smithi134.stdout:4/886: write d4/d1f/d27/d3a/d53/d58/f81 [8978363,11916] 0 2024-04-13T10:59:29.092 INFO:tasks.workunit.client.0.smithi134.stdout:4/887: chown d4/dd/d6d/ff5 11648866 1 2024-04-13T10:59:29.102 INFO:tasks.workunit.client.0.smithi134.stdout:2/856: dread d5/d6/d70/db2/dec/fb8 [0,4194304] 0 2024-04-13T10:59:29.107 INFO:tasks.workunit.client.0.smithi134.stdout:7/907: dread da/d15/d26/d27/d4f/d5f/d67/d73/f91 [0,4194304] 0 2024-04-13T10:59:29.107 INFO:tasks.workunit.client.0.smithi134.stdout:2/857: creat d5/d6/d57/ffe x:0 0 0 2024-04-13T10:59:29.108 INFO:tasks.workunit.client.0.smithi134.stdout:2/858: stat d5/d6/d70/dfc/d30/d58/d59 0 2024-04-13T10:59:29.108 INFO:tasks.workunit.client.0.smithi134.stdout:2/859: readlink d5/d6/d70/dfc/d30/ld6 0 2024-04-13T10:59:29.110 INFO:tasks.workunit.client.0.smithi134.stdout:7/908: creat da/d15/d26/d38/f10f x:0 0 0 2024-04-13T10:59:29.112 INFO:tasks.workunit.client.0.smithi134.stdout:2/860: truncate d5/de/d50/fbc 1671827 0 2024-04-13T10:59:29.115 INFO:tasks.workunit.client.0.smithi134.stdout:7/909: dwrite f4 [0,4194304] 0 2024-04-13T10:59:29.118 INFO:tasks.workunit.client.0.smithi134.stdout:2/861: dread d5/d6/d57/d6c/f67 [0,4194304] 0 2024-04-13T10:59:29.126 INFO:tasks.workunit.client.0.smithi134.stdout:2/862: dwrite d5/d6/d70/dfc/fbe [0,4194304] 0 2024-04-13T10:59:29.130 INFO:tasks.workunit.client.0.smithi134.stdout:7/910: write da/d15/f29 [2584845,30034] 0 2024-04-13T10:59:29.130 INFO:tasks.workunit.client.0.smithi134.stdout:2/863: write d5/d6/d57/d6c/f28 [4945462,79768] 0 2024-04-13T10:59:29.133 INFO:tasks.workunit.client.0.smithi134.stdout:7/911: write da/d15/d26/d27/d3d/d9c/fb5 [1512854,126290] 0 2024-04-13T10:59:29.138 INFO:tasks.workunit.client.0.smithi134.stdout:2/864: write d5/de/d12/f86 [477247,21266] 0 2024-04-13T10:59:29.139 INFO:tasks.workunit.client.0.smithi134.stdout:2/865: stat d5/d6/d70/db2/dec/l92 0 2024-04-13T10:59:29.140 INFO:tasks.workunit.client.0.smithi134.stdout:2/866: readlink d5/de/d12/lc4 0 2024-04-13T10:59:29.147 INFO:tasks.workunit.client.0.smithi134.stdout:2/867: dread d5/d6/d70/dfc/f44 [0,4194304] 0 2024-04-13T10:59:29.148 INFO:tasks.workunit.client.0.smithi134.stdout:2/868: truncate d5/d6/d34/dc0/ffb 438055 0 2024-04-13T10:59:29.152 INFO:tasks.workunit.client.0.smithi134.stdout:2/869: link d5/d6/l2a d5/de/d50/lff 0 2024-04-13T10:59:29.154 INFO:tasks.workunit.client.0.smithi134.stdout:2/870: mkdir d5/d6/d70/d84/d100 0 2024-04-13T10:59:29.156 INFO:tasks.workunit.client.0.smithi134.stdout:2/871: symlink d5/d6/d57/d6c/l101 0 2024-04-13T10:59:29.157 INFO:tasks.workunit.client.0.smithi134.stdout:2/872: fdatasync d5/d6/f68 0 2024-04-13T10:59:29.171 INFO:tasks.workunit.client.0.smithi134.stdout:2/873: dwrite d5/d6/d70/dfc/d30/d58/d59/f7e [0,4194304] 0 2024-04-13T10:59:29.178 INFO:tasks.workunit.client.0.smithi134.stdout:2/874: link d5/d6/d70/dfc/d30/d88/d96/fb0 d5/d6/d70/dfc/d30/dd1/f102 0 2024-04-13T10:59:29.183 INFO:tasks.workunit.client.0.smithi134.stdout:2/875: dread d5/d6/d57/d6c/f4d [0,4194304] 0 2024-04-13T10:59:29.185 INFO:tasks.workunit.client.0.smithi134.stdout:2/876: rmdir d5/d6/df 39 2024-04-13T10:59:29.207 INFO:tasks.workunit.client.0.smithi134.stdout:2/877: dread d5/de/d12/f43 [0,4194304] 0 2024-04-13T10:59:29.217 INFO:tasks.workunit.client.0.smithi134.stdout:2/878: truncate d5/de/d50/f6b 7073958 0 2024-04-13T10:59:29.224 INFO:tasks.workunit.client.0.smithi134.stdout:2/879: dwrite d5/d6/d57/d6c/f4d [0,4194304] 0 2024-04-13T10:59:29.225 INFO:tasks.workunit.client.0.smithi134.stdout:2/880: chown d5/d6/d70/dfc/d30/d58/d59/f7e 6 1 2024-04-13T10:59:29.229 INFO:tasks.workunit.client.0.smithi134.stdout:2/881: mknod d5/d6/d70/dfc/d30/d58/d73/c103 0 2024-04-13T10:59:29.232 INFO:tasks.workunit.client.0.smithi134.stdout:2/882: rmdir d5/d6/d34/dc0 39 2024-04-13T10:59:29.237 INFO:tasks.workunit.client.0.smithi134.stdout:2/883: mkdir d5/de/d12/d104 0 2024-04-13T10:59:29.244 INFO:tasks.workunit.client.0.smithi134.stdout:2/884: write d5/de/d12/f43 [1781960,116843] 0 2024-04-13T10:59:29.249 INFO:tasks.workunit.client.0.smithi134.stdout:2/885: write d5/d6/d70/d84/fba [134343,12285] 0 2024-04-13T10:59:29.254 INFO:tasks.workunit.client.0.smithi134.stdout:2/886: dread d5/d6/d70/dfc/d30/d88/fd3 [0,4194304] 0 2024-04-13T10:59:29.255 INFO:tasks.workunit.client.0.smithi134.stdout:2/887: chown d5/d6/d70/dfc/d30/dd1/lfa 329675253 1 2024-04-13T10:59:29.258 INFO:tasks.workunit.client.0.smithi134.stdout:2/888: creat d5/d6/d57/f105 x:0 0 0 2024-04-13T10:59:29.260 INFO:tasks.workunit.client.0.smithi134.stdout:2/889: rmdir d5/d6 39 2024-04-13T10:59:29.279 INFO:tasks.workunit.client.0.smithi134.stdout:2/890: truncate d5/d6/d70/db2/dec/f72 3395730 0 2024-04-13T10:59:29.280 INFO:tasks.workunit.client.0.smithi134.stdout:2/891: write d5/d6/d57/ffe [411806,47870] 0 2024-04-13T10:59:29.286 INFO:tasks.workunit.client.0.smithi134.stdout:2/892: getdents d5/d6/d34/dc0 0 2024-04-13T10:59:29.300 INFO:tasks.workunit.client.0.smithi134.stdout:2/893: dread d5/d6/d57/d6c/f28 [0,4194304] 0 2024-04-13T10:59:29.305 INFO:tasks.workunit.client.0.smithi134.stdout:2/894: getdents d5/d6/d70/dfc/d30 0 2024-04-13T10:59:29.308 INFO:tasks.workunit.client.0.smithi134.stdout:2/895: creat d5/de/d2e/def/f106 x:0 0 0 2024-04-13T10:59:29.309 INFO:tasks.workunit.client.0.smithi134.stdout:2/896: creat d5/de/d50/f107 x:0 0 0 2024-04-13T10:59:29.384 INFO:tasks.workunit.client.0.smithi134.stdout:2/897: dwrite d5/d6/d70/dfc/d30/f4f [0,4194304] 0 2024-04-13T10:59:29.384 INFO:tasks.workunit.client.0.smithi134.stdout:2/898: write d5/de/d2e/def/f106 [73747,19327] 0 2024-04-13T10:59:29.385 INFO:tasks.workunit.client.0.smithi134.stdout:3/856: sync 2024-04-13T10:59:29.386 INFO:tasks.workunit.client.0.smithi134.stdout:2/899: write d5/de/d2e/d8f/f6e [8387122,43380] 0 2024-04-13T10:59:29.398 INFO:tasks.workunit.client.0.smithi134.stdout:3/857: read dc/d27/f9d [533325,99826] 0 2024-04-13T10:59:29.399 INFO:tasks.workunit.client.0.smithi134.stdout:3/858: dread - dc/d1d/f8d zero size 2024-04-13T10:59:29.399 INFO:tasks.workunit.client.0.smithi134.stdout:2/900: dwrite d5/d6/d70/db2/dec/f46 [0,4194304] 0 2024-04-13T10:59:29.400 INFO:tasks.workunit.client.0.smithi134.stdout:2/901: truncate d5/de/f65 8877254 0 2024-04-13T10:59:29.402 INFO:tasks.workunit.client.0.smithi134.stdout:3/859: unlink dc/d1d/d58/d72/fec 0 2024-04-13T10:59:29.403 INFO:tasks.workunit.client.0.smithi134.stdout:2/902: mkdir d5/de/d2e/def/d108 0 2024-04-13T10:59:29.407 INFO:tasks.workunit.client.0.smithi134.stdout:2/903: creat d5/d6/d70/f109 x:0 0 0 2024-04-13T10:59:29.408 INFO:tasks.workunit.client.0.smithi134.stdout:2/904: chown d5/d6/d70/d84/lbd 38020 1 2024-04-13T10:59:29.409 INFO:tasks.workunit.client.0.smithi134.stdout:3/860: dwrite dc/d27/d19/d48/d8e/f103 [0,4194304] 0 2024-04-13T10:59:29.409 INFO:tasks.workunit.client.0.smithi134.stdout:2/905: write d5/de/f65 [7566771,79137] 0 2024-04-13T10:59:29.411 INFO:tasks.workunit.client.0.smithi134.stdout:2/906: fdatasync d5/d6/d70/dfc/d30/f71 0 2024-04-13T10:59:29.411 INFO:tasks.workunit.client.0.smithi134.stdout:3/861: read dc/d27/d19/d48/d49/ff8 [279506,123633] 0 2024-04-13T10:59:29.413 INFO:tasks.workunit.client.0.smithi134.stdout:3/862: stat dc/d27/d19/d48/l59 0 2024-04-13T10:59:29.420 INFO:tasks.workunit.client.0.smithi134.stdout:3/863: dread dc/d27/d19/d8b/da8/d50/d25/d91/d93/fe1 [0,4194304] 0 2024-04-13T10:59:29.421 INFO:tasks.workunit.client.0.smithi134.stdout:3/864: chown dc/d27/d19/d8b/da8/d50/d25/d5f/d75/d8f/fa0 39468804 1 2024-04-13T10:59:29.426 INFO:tasks.workunit.client.0.smithi134.stdout:3/865: creat dc/d27/d19/d8b/d9b/d106/f11f x:0 0 0 2024-04-13T10:59:29.437 INFO:tasks.workunit.client.0.smithi134.stdout:3/866: dread dc/d27/d19/d48/d8e/f9c [0,4194304] 0 2024-04-13T10:59:29.448 INFO:tasks.workunit.client.0.smithi134.stdout:3/867: dwrite dc/f66 [0,4194304] 0 2024-04-13T10:59:29.452 INFO:tasks.workunit.client.0.smithi134.stdout:3/868: mkdir dc/d1d/d58/dcd/d117/d120 0 2024-04-13T10:59:29.454 INFO:tasks.workunit.client.0.smithi134.stdout:3/869: symlink dc/d27/d19/d8b/da8/d50/d25/df6/l121 0 2024-04-13T10:59:29.462 INFO:tasks.workunit.client.0.smithi134.stdout:3/870: dwrite dc/d27/d19/d8b/da8/d50/d25/d91/de9/ffd [0,4194304] 0 2024-04-13T10:59:29.468 INFO:tasks.workunit.client.0.smithi134.stdout:3/871: unlink dc/d27/d19/db1/fde 0 2024-04-13T10:59:29.472 INFO:tasks.workunit.client.0.smithi134.stdout:3/872: mkdir dc/d27/d19/d48/dd9/d122 0 2024-04-13T10:59:29.478 INFO:tasks.workunit.client.0.smithi134.stdout:3/873: symlink dc/d27/d19/l123 0 2024-04-13T10:59:29.481 INFO:tasks.workunit.client.0.smithi134.stdout:3/874: creat dc/d27/d19/d48/d49/f124 x:0 0 0 2024-04-13T10:59:29.483 INFO:tasks.workunit.client.0.smithi134.stdout:3/875: mknod dc/d27/d19/d8b/da8/d50/c125 0 2024-04-13T10:59:29.487 INFO:tasks.workunit.client.0.smithi134.stdout:3/876: truncate dc/d27/d19/d8b/da8/d50/d25/f51 1546450 0 2024-04-13T10:59:29.508 INFO:tasks.workunit.client.0.smithi134.stdout:3/877: write dc/d27/fac [151880,126756] 0 2024-04-13T10:59:29.516 INFO:tasks.workunit.client.0.smithi134.stdout:3/878: creat dc/d27/d19/d48/f126 x:0 0 0 2024-04-13T10:59:29.519 INFO:tasks.workunit.client.0.smithi134.stdout:3/879: mkdir dc/d27/d19/d8b/da8/d50/d25/d91/d93/d127 0 2024-04-13T10:59:29.527 INFO:tasks.workunit.client.0.smithi134.stdout:3/880: fsync dc/d27/d19/d48/f126 0 2024-04-13T10:59:29.530 INFO:tasks.workunit.client.0.smithi134.stdout:3/881: dread dc/d27/d19/db1/df7/f89 [4194304,4194304] 0 2024-04-13T10:59:29.534 INFO:tasks.workunit.client.0.smithi134.stdout:3/882: creat dc/d100/f128 x:0 0 0 2024-04-13T10:59:29.538 INFO:tasks.workunit.client.0.smithi134.stdout:3/883: truncate dc/d1d/d102/f69 4673434 0 2024-04-13T10:59:29.540 INFO:tasks.workunit.client.0.smithi134.stdout:3/884: symlink dc/d1d/d58/de7/l129 0 2024-04-13T10:59:29.545 INFO:tasks.workunit.client.0.smithi134.stdout:3/885: dwrite dc/d2a/f56 [0,4194304] 0 2024-04-13T10:59:29.550 INFO:tasks.workunit.client.0.smithi134.stdout:3/886: rmdir dc/d1d/d58/dcd/d117/d120 0 2024-04-13T10:59:29.553 INFO:tasks.workunit.client.0.smithi134.stdout:3/887: mkdir dc/d27/d19/d8b/da8/d50/d25/d5f/d12a 0 2024-04-13T10:59:29.559 INFO:tasks.workunit.client.0.smithi134.stdout:3/888: rename dc/l2c to dc/d27/d95/l12b 0 2024-04-13T10:59:29.562 INFO:tasks.workunit.client.0.smithi134.stdout:3/889: write dc/fd [1293945,68815] 0 2024-04-13T10:59:29.564 INFO:tasks.workunit.client.0.smithi134.stdout:3/890: creat dc/d27/d19/db1/f12c x:0 0 0 2024-04-13T10:59:29.569 INFO:tasks.workunit.client.0.smithi134.stdout:3/891: rename dc/d27/d19/d8b/da8/d50/d25/d91/de9 to dc/d27/d19/d8b/da8/d50/d25/d91/d93/d12d 0 2024-04-13T10:59:29.571 INFO:tasks.workunit.client.0.smithi134.stdout:3/892: symlink dc/d27/d19/d8b/da8/d50/d25/d5f/d75/d8f/l12e 0 2024-04-13T10:59:29.574 INFO:tasks.workunit.client.0.smithi134.stdout:3/893: creat dc/d27/d19/f12f x:0 0 0 2024-04-13T10:59:29.576 INFO:tasks.workunit.client.0.smithi134.stdout:3/894: mkdir dc/d1d/d58/de7/d130 0 2024-04-13T10:59:29.577 INFO:tasks.workunit.client.0.smithi134.stdout:3/895: readlink dc/d1d/d102/l35 0 2024-04-13T10:59:29.580 INFO:tasks.workunit.client.0.smithi134.stdout:3/896: unlink dc/d27/d95/ccb 0 2024-04-13T10:59:29.581 INFO:tasks.workunit.client.0.smithi134.stdout:3/897: mknod dc/d27/d19/d48/dd9/d122/c131 0 2024-04-13T10:59:29.582 INFO:tasks.workunit.client.0.smithi134.stdout:3/898: write dc/f66 [3180644,41827] 0 2024-04-13T10:59:29.586 INFO:tasks.workunit.client.0.smithi134.stdout:3/899: dread dc/d27/d19/d48/d8e/f103 [0,4194304] 0 2024-04-13T10:59:29.587 INFO:tasks.workunit.client.0.smithi134.stdout:3/900: rmdir dc/d27 39 2024-04-13T10:59:29.591 INFO:tasks.workunit.client.0.smithi134.stdout:3/901: rename dc/d27/d19/d8b/da8/f68 to dc/d27/d19/d8b/d114/f132 0 2024-04-13T10:59:29.592 INFO:tasks.workunit.client.0.smithi134.stdout:3/902: chown dc/d1d/d102/f43 28725384 1 2024-04-13T10:59:29.595 INFO:tasks.workunit.client.0.smithi134.stdout:3/903: creat dc/d27/d19/d8b/f133 x:0 0 0 2024-04-13T10:59:29.597 INFO:tasks.workunit.client.0.smithi134.stdout:3/904: unlink dc/d27/d19/d8b/da8/d50/d25/d91/d93/f9a 0 2024-04-13T10:59:29.598 INFO:tasks.workunit.client.0.smithi134.stdout:3/905: readlink dc/d27/l13 0 2024-04-13T10:59:29.600 INFO:tasks.workunit.client.0.smithi134.stdout:3/906: creat dc/d27/d19/d48/d8e/f134 x:0 0 0 2024-04-13T10:59:29.601 INFO:tasks.workunit.client.0.smithi134.stdout:3/907: chown dc/d1d/d58/lc2 248362805 1 2024-04-13T10:59:29.603 INFO:tasks.workunit.client.0.smithi134.stdout:3/908: mknod dc/d27/d19/d8b/da8/c135 0 2024-04-13T10:59:29.654 INFO:tasks.workunit.client.0.smithi134.stdout:0/924: sync 2024-04-13T10:59:29.655 INFO:tasks.workunit.client.0.smithi134.stdout:0/925: fdatasync d4/d17/d23/d51/d6a/d94/f67 0 2024-04-13T10:59:29.712 INFO:tasks.workunit.client.0.smithi134.stdout:3/909: creat dc/d27/d19/d8b/f136 x:0 0 0 2024-04-13T10:59:29.716 INFO:tasks.workunit.client.0.smithi134.stdout:0/926: link d4/d17/d23/d51/d6b/d91/d98/d62/c89 d4/d17/d20/da9/de1/dcf/d96/c14a 0 2024-04-13T10:59:29.720 INFO:tasks.workunit.client.0.smithi134.stdout:3/910: creat dc/d27/d19/d8b/da8/d50/d25/f137 x:0 0 0 2024-04-13T10:59:29.723 INFO:tasks.workunit.client.0.smithi134.stdout:0/927: rename d4/d17/c12 to d4/d17/d20/d29/d30/d7f/dc0/c14b 0 2024-04-13T10:59:29.724 INFO:tasks.workunit.client.0.smithi134.stdout:3/911: unlink dc/d1d/c29 0 2024-04-13T10:59:29.726 INFO:tasks.workunit.client.0.smithi134.stdout:0/928: symlink d4/d17/d20/da9/de1/dfc/d6d/d97/db6/l14c 0 2024-04-13T10:59:29.728 INFO:tasks.workunit.client.0.smithi134.stdout:3/912: fdatasync dc/d27/d95/fbe 0 2024-04-13T10:59:29.729 INFO:tasks.workunit.client.0.smithi134.stdout:3/913: chown dc/d27/d19/d8b/da8/d50/d25/d91/d93/d12d/c104 18 1 2024-04-13T10:59:29.730 INFO:tasks.workunit.client.0.smithi134.stdout:3/914: chown dc/d1d/l30 2512 1 2024-04-13T10:59:29.731 INFO:tasks.workunit.client.0.smithi134.stdout:0/929: unlink d4/d17/da/l13a 0 2024-04-13T10:59:29.733 INFO:tasks.workunit.client.0.smithi134.stdout:0/930: truncate d4/d17/d20/d29/dcd/f11b 681835 0 2024-04-13T10:59:29.736 INFO:tasks.workunit.client.0.smithi134.stdout:0/931: creat d4/d17/d23/d51/d6a/d94/db2/f14d x:0 0 0 2024-04-13T10:59:29.744 INFO:tasks.workunit.client.0.smithi134.stdout:3/915: creat dc/d27/d19/f138 x:0 0 0 2024-04-13T10:59:29.753 INFO:tasks.workunit.client.0.smithi134.stdout:0/932: dread d4/d17/d20/da9/de1/dfc/f4d [0,4194304] 0 2024-04-13T10:59:29.755 INFO:tasks.workunit.client.0.smithi134.stdout:0/933: symlink d4/d5d/l14e 0 2024-04-13T10:59:29.757 INFO:tasks.workunit.client.0.smithi134.stdout:0/934: readlink d4/d17/d20/da9/de1/dfc/d6d/d97/db6/lc9 0 2024-04-13T10:59:29.760 INFO:tasks.workunit.client.0.smithi134.stdout:3/916: dread dc/d1d/d102/f34 [0,4194304] 0 2024-04-13T10:59:29.763 INFO:tasks.workunit.client.0.smithi134.stdout:0/935: creat d4/d17/d20/da9/de1/dcf/d96/dd5/f14f x:0 0 0 2024-04-13T10:59:29.768 INFO:tasks.workunit.client.0.smithi134.stdout:0/936: mkdir d4/d17/d23/d51/d6b/d91/d98/d62/d7c/d150 0 2024-04-13T10:59:29.770 INFO:tasks.workunit.client.0.smithi134.stdout:4/888: sync 2024-04-13T10:59:29.775 INFO:tasks.workunit.client.0.smithi134.stdout:0/937: mknod d4/d17/d23/d51/d6b/d91/d98/d62/daf/c151 0 2024-04-13T10:59:29.779 INFO:tasks.workunit.client.0.smithi134.stdout:4/889: creat d4/dd/d6d/d8c/d5f/dfc/f129 x:0 0 0 2024-04-13T10:59:29.781 INFO:tasks.workunit.client.0.smithi134.stdout:0/938: mknod d4/d17/d23/d51/d6a/d73/c152 0 2024-04-13T10:59:29.783 INFO:tasks.workunit.client.0.smithi134.stdout:0/939: write d4/d17/d20/da9/de1/dfc/d6d/d97/db6/fb8 [283882,37937] 0 2024-04-13T10:59:29.788 INFO:tasks.workunit.client.0.smithi134.stdout:0/940: readlink d4/d17/l18 0 2024-04-13T10:59:29.790 INFO:tasks.workunit.client.0.smithi134.stdout:4/890: symlink d4/d119/l12a 0 2024-04-13T10:59:29.797 INFO:tasks.workunit.client.0.smithi134.stdout:4/891: creat d4/d1f/d27/d75/d38/d79/d32/d67/d9b/f12b x:0 0 0 2024-04-13T10:59:29.807 INFO:tasks.workunit.client.0.smithi134.stdout:4/892: dwrite d4/f7a [0,4194304] 0 2024-04-13T10:59:29.808 INFO:tasks.workunit.client.0.smithi134.stdout:4/893: write d4/d82/f100 [4703918,14514] 0 2024-04-13T10:59:29.815 INFO:tasks.workunit.client.0.smithi134.stdout:4/894: creat d4/d119/f12c x:0 0 0 2024-04-13T10:59:29.821 INFO:tasks.workunit.client.0.smithi134.stdout:4/895: mknod d4/c12d 0 2024-04-13T10:59:29.825 INFO:tasks.workunit.client.0.smithi134.stdout:4/896: rename d4/d1f/d27/d2e/d84/dde/dd3/cfe to d4/d1f/d90/c12e 0 2024-04-13T10:59:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:29 smithi134 ceph-mon[39696]: mgrmap e26: smithi194.tcpynt(active, since 91s), standbys: smithi134.tmanda 2024-04-13T10:59:29.978 INFO:tasks.workunit.client.0.smithi134.stdout:3/917: dwrite dc/fc9 [0,4194304] 0 2024-04-13T10:59:29.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:29 smithi194 ceph-mon[46737]: mgrmap e26: smithi194.tcpynt(active, since 91s), standbys: smithi134.tmanda 2024-04-13T10:59:29.999 INFO:tasks.workunit.client.0.smithi134.stdout:0/941: dwrite d4/d17/d23/d51/d6b/fcc [4194304,4194304] 0 2024-04-13T10:59:30.003 INFO:tasks.workunit.client.0.smithi134.stdout:3/918: dread dc/d27/d19/d8b/da8/d50/d25/d91/feb [0,4194304] 0 2024-04-13T10:59:30.005 INFO:tasks.workunit.client.0.smithi134.stdout:3/919: truncate dc/d27/d19/db1/df7/fd0 4862553 0 2024-04-13T10:59:30.005 INFO:tasks.workunit.client.0.smithi134.stdout:7/912: sync 2024-04-13T10:59:30.005 INFO:tasks.workunit.client.0.smithi134.stdout:2/907: sync 2024-04-13T10:59:30.006 INFO:tasks.workunit.client.0.smithi134.stdout:0/942: truncate d4/d17/da/d22/d41/d6e/d8a/d95/db9/f109 163627 0 2024-04-13T10:59:30.008 INFO:tasks.workunit.client.0.smithi134.stdout:2/908: truncate d5/d6/d70/dfc/d30/d88/d96/fb1 1568932 0 2024-04-13T10:59:30.010 INFO:tasks.workunit.client.0.smithi134.stdout:2/909: write d5/de/d2e/def/f106 [1091824,50140] 0 2024-04-13T10:59:30.010 INFO:tasks.workunit.client.0.smithi134.stdout:3/920: write dc/d27/d19/d8b/da8/d50/d25/f111 [732402,57697] 0 2024-04-13T10:59:30.013 INFO:tasks.workunit.client.0.smithi134.stdout:7/913: rename da/d15/d26/d27/d4f/d5f/d88/lcb to da/d15/d26/d27/d4f/d5f/l110 0 2024-04-13T10:59:30.014 INFO:tasks.workunit.client.0.smithi134.stdout:7/914: stat da/d15/d26/d27/d3d/d9c/f55 0 2024-04-13T10:59:30.015 INFO:tasks.workunit.client.0.smithi134.stdout:2/910: truncate d5/d6/d70/f109 592013 0 2024-04-13T10:59:30.015 INFO:tasks.workunit.client.0.smithi134.stdout:0/943: creat d4/d17/d20/da9/de1/dfc/d6d/d97/db6/d101/f153 x:0 0 0 2024-04-13T10:59:30.017 INFO:tasks.workunit.client.0.smithi134.stdout:7/915: readlink da/d15/d26/d27/d4f/d5f/l103 0 2024-04-13T10:59:30.017 INFO:tasks.workunit.client.0.smithi134.stdout:0/944: stat d4/d17/d20/da9/de1/dcf/d96 0 2024-04-13T10:59:30.018 INFO:tasks.workunit.client.0.smithi134.stdout:3/921: mknod dc/d27/d19/d8b/da8/c139 0 2024-04-13T10:59:30.019 INFO:tasks.workunit.client.0.smithi134.stdout:3/922: chown dc/d1d/c41 153225159 1 2024-04-13T10:59:30.021 INFO:tasks.workunit.client.0.smithi134.stdout:7/916: dread da/d15/d26/f35 [4194304,4194304] 0 2024-04-13T10:59:30.021 INFO:tasks.workunit.client.0.smithi134.stdout:2/911: unlink d5/d6/d57/d6c/f28 0 2024-04-13T10:59:30.027 INFO:tasks.workunit.client.0.smithi134.stdout:0/945: dread d4/d17/d20/d29/d30/d7f/dc0/fd8 [0,4194304] 0 2024-04-13T10:59:30.032 INFO:tasks.workunit.client.0.smithi134.stdout:2/912: dread d5/d6/d70/dfc/d30/d58/d73/f8d [0,4194304] 0 2024-04-13T10:59:30.033 INFO:tasks.workunit.client.0.smithi134.stdout:3/923: truncate dc/d27/d19/d8b/da8/d50/d25/df6/f9e 124533 0 2024-04-13T10:59:30.034 INFO:tasks.workunit.client.0.smithi134.stdout:0/946: dwrite d4/d17/da/f27 [0,4194304] 0 2024-04-13T10:59:30.034 INFO:tasks.workunit.client.0.smithi134.stdout:2/913: fsync d5/de/d2e/def/f106 0 2024-04-13T10:59:30.040 INFO:tasks.workunit.client.0.smithi134.stdout:3/924: dread dc/d27/d19/db1/df7/f10e [0,4194304] 0 2024-04-13T10:59:30.043 INFO:tasks.workunit.client.0.smithi134.stdout:7/917: getdents da/d15/d85/db0/dec 0 2024-04-13T10:59:30.047 INFO:tasks.workunit.client.0.smithi134.stdout:0/947: symlink d4/d17/d20/d29/l154 0 2024-04-13T10:59:30.050 INFO:tasks.workunit.client.0.smithi134.stdout:3/925: mknod dc/d27/d19/d48/d8e/d105/c13a 0 2024-04-13T10:59:30.052 INFO:tasks.workunit.client.0.smithi134.stdout:7/918: stat da/d15/c3c 0 2024-04-13T10:59:30.061 INFO:tasks.workunit.client.0.smithi134.stdout:7/919: write da/d15/d26/d27/d4f/d5f/d67/d73/fb9 [2430401,109795] 0 2024-04-13T10:59:30.064 INFO:tasks.workunit.client.0.smithi134.stdout:0/948: mkdir d4/d17/d20/d29/d30/d3e/d155 0 2024-04-13T10:59:30.069 INFO:tasks.workunit.client.0.smithi134.stdout:7/920: creat da/d15/d26/d27/dc9/f111 x:0 0 0 2024-04-13T10:59:30.070 INFO:tasks.workunit.client.0.smithi134.stdout:0/949: mkdir d4/d17/da/d22/d41/dc2/d156 0 2024-04-13T10:59:30.071 INFO:tasks.workunit.client.0.smithi134.stdout:0/950: stat d4/d17/da/d22/d41/d6e/d8a/d95/db9/ce4 0 2024-04-13T10:59:30.074 INFO:tasks.workunit.client.0.smithi134.stdout:7/921: creat da/d15/d26/f112 x:0 0 0 2024-04-13T10:59:30.078 INFO:tasks.workunit.client.0.smithi134.stdout:0/951: symlink d4/d17/d23/d51/d6b/d91/d98/d62/d142/l157 0 2024-04-13T10:59:30.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/952: mkdir d4/d17/d20/da9/de1/dfc/d6d/d158 0 2024-04-13T10:59:30.085 INFO:tasks.workunit.client.0.smithi134.stdout:7/922: creat da/d15/d26/d27/d3d/f113 x:0 0 0 2024-04-13T10:59:30.088 INFO:tasks.workunit.client.0.smithi134.stdout:0/953: rmdir d4/d17/d20/da9/de1/dfc/d6d/da5/dd9 39 2024-04-13T10:59:30.089 INFO:tasks.workunit.client.0.smithi134.stdout:7/923: symlink da/d15/d85/db0/l114 0 2024-04-13T10:59:30.093 INFO:tasks.workunit.client.0.smithi134.stdout:0/954: dwrite d4/d17/d23/f2f [0,4194304] 0 2024-04-13T10:59:30.099 INFO:tasks.workunit.client.0.smithi134.stdout:0/955: dread d4/d17/d23/d51/d6b/fcc [4194304,4194304] 0 2024-04-13T10:59:30.106 INFO:tasks.workunit.client.0.smithi134.stdout:0/956: rmdir d4/d17/d20/d29/d30/d7f/da2 39 2024-04-13T10:59:30.204 INFO:tasks.workunit.client.0.smithi134.stdout:2/914: dwrite d5/d6/d70/db2/dec/fb8 [0,4194304] 0 2024-04-13T10:59:30.206 INFO:tasks.workunit.client.0.smithi134.stdout:2/915: dread d5/de/d12/fa2 [0,4194304] 0 2024-04-13T10:59:30.207 INFO:tasks.workunit.client.0.smithi134.stdout:2/916: chown d5/de/d12/faf 1110 1 2024-04-13T10:59:30.214 INFO:tasks.workunit.client.0.smithi134.stdout:2/917: creat d5/d6/d70/d84/de7/f10a x:0 0 0 2024-04-13T10:59:30.218 INFO:tasks.workunit.client.0.smithi134.stdout:3/926: dwrite dc/f64 [0,4194304] 0 2024-04-13T10:59:30.222 INFO:tasks.workunit.client.0.smithi134.stdout:3/927: truncate dc/d27/d19/d8b/ffa 433041 0 2024-04-13T10:59:30.223 INFO:tasks.workunit.client.0.smithi134.stdout:2/918: dwrite d5/d6/d70/dfc/fca [4194304,4194304] 0 2024-04-13T10:59:30.233 INFO:tasks.workunit.client.0.smithi134.stdout:3/928: unlink dc/d27/f9d 0 2024-04-13T10:59:30.234 INFO:tasks.workunit.client.0.smithi134.stdout:7/924: rmdir da/d15/d26 39 2024-04-13T10:59:30.235 INFO:tasks.workunit.client.0.smithi134.stdout:3/929: write dc/d1d/d102/f43 [1743229,642] 0 2024-04-13T10:59:30.236 INFO:tasks.workunit.client.0.smithi134.stdout:4/897: sync 2024-04-13T10:59:30.241 INFO:tasks.workunit.client.0.smithi134.stdout:7/925: stat da/d15/d26/d4a/dc7/ff1 0 2024-04-13T10:59:30.243 INFO:tasks.workunit.client.0.smithi134.stdout:3/930: mkdir dc/d27/d19/d48/d49/d13b 0 2024-04-13T10:59:30.246 INFO:tasks.workunit.client.0.smithi134.stdout:4/898: rename d4/d1f/d27/d75/f68 to d4/d1f/d27/d3a/d53/dc1/db3/f12f 0 2024-04-13T10:59:30.249 INFO:tasks.workunit.client.0.smithi134.stdout:7/926: fdatasync da/d15/d26/d27/d4f/d5f/d67/d76/fe2 0 2024-04-13T10:59:30.253 INFO:tasks.workunit.client.0.smithi134.stdout:0/957: truncate d4/d17/d20/d29/d30/d3e/f50 4181626 0 2024-04-13T10:59:30.254 INFO:tasks.workunit.client.0.smithi134.stdout:3/931: creat dc/d27/d95/f13c x:0 0 0 2024-04-13T10:59:30.256 INFO:tasks.workunit.client.0.smithi134.stdout:7/927: dwrite da/d15/d26/f28 [0,4194304] 0 2024-04-13T10:59:30.256 INFO:tasks.workunit.client.0.smithi134.stdout:3/932: dread - dc/d27/d19/f138 zero size 2024-04-13T10:59:30.258 INFO:tasks.workunit.client.0.smithi134.stdout:0/958: dread - d4/d17/d20/da9/de1/dfc/d6d/d97/db6/d101/f153 zero size 2024-04-13T10:59:30.261 INFO:tasks.workunit.client.0.smithi134.stdout:3/933: dread dc/f64 [0,4194304] 0 2024-04-13T10:59:30.265 INFO:tasks.workunit.client.0.smithi134.stdout:4/899: link d4/dd/df2/dee/df3/f114 d4/d1f/d27/d75/d38/d79/d32/d67/d9b/f130 0 2024-04-13T10:59:30.273 INFO:tasks.workunit.client.0.smithi134.stdout:3/934: symlink dc/d27/d19/d48/dd9/d122/l13d 0 2024-04-13T10:59:30.274 INFO:tasks.workunit.client.0.smithi134.stdout:3/935: chown dc/d27/d19/d48/dd9/d122/l13d 4 1 2024-04-13T10:59:30.279 INFO:tasks.workunit.client.0.smithi134.stdout:7/928: rename da/d15/d26/d38/cab to da/d15/d85/db0/c115 0 2024-04-13T10:59:30.282 INFO:tasks.workunit.client.0.smithi134.stdout:0/959: symlink d4/d17/d23/d51/d6b/l159 0 2024-04-13T10:59:30.283 INFO:tasks.workunit.client.0.smithi134.stdout:4/900: symlink d4/d1f/d27/d3a/d53/d58/dfd/l131 0 2024-04-13T10:59:30.291 INFO:tasks.workunit.client.0.smithi134.stdout:3/936: dwrite dc/d1d/d102/f34 [0,4194304] 0 2024-04-13T10:59:30.292 INFO:tasks.workunit.client.0.smithi134.stdout:7/929: dread da/d15/f6e [0,4194304] 0 2024-04-13T10:59:30.294 INFO:tasks.workunit.client.0.smithi134.stdout:7/930: dread - da/d15/d26/d27/d4f/d5f/d88/dd9/fe9 zero size 2024-04-13T10:59:30.297 INFO:tasks.workunit.client.0.smithi134.stdout:4/901: fdatasync d4/d1f/d27/d75/d38/d79/d32/d67/d9b/f130 0 2024-04-13T10:59:30.298 INFO:tasks.workunit.client.0.smithi134.stdout:4/902: write d4/dd/d6d/d8c/d5f/dfc/f129 [32202,47837] 0 2024-04-13T10:59:30.305 INFO:tasks.workunit.client.0.smithi134.stdout:4/903: fdatasync d4/d1f/d27/d2e/d84/ddb/fe3 0 2024-04-13T10:59:30.310 INFO:tasks.workunit.client.0.smithi134.stdout:7/931: symlink da/d15/d26/d27/d4f/d5f/d67/de0/l116 0 2024-04-13T10:59:30.310 INFO:tasks.workunit.client.0.smithi134.stdout:7/932: readlink da/d15/d26/d27/d4f/dd3/ld6 0 2024-04-13T10:59:30.311 INFO:tasks.workunit.client.0.smithi134.stdout:7/933: read da/d15/d26/d27/d3d/d46/dbf/fe5 [276649,88348] 0 2024-04-13T10:59:30.322 INFO:tasks.workunit.client.0.smithi134.stdout:7/934: dwrite da/d15/d26/d38/f66 [4194304,4194304] 0 2024-04-13T10:59:30.333 INFO:tasks.workunit.client.0.smithi134.stdout:7/935: creat da/d15/d26/d27/d3d/d9c/d10d/f117 x:0 0 0 2024-04-13T10:59:30.335 INFO:tasks.workunit.client.0.smithi134.stdout:7/936: write da/d15/d26/d27/d4f/d5f/d67/d76/faa [3658755,115757] 0 2024-04-13T10:59:30.340 INFO:tasks.workunit.client.0.smithi134.stdout:7/937: mknod da/d15/d26/d4a/dc7/c118 0 2024-04-13T10:59:30.346 INFO:tasks.workunit.client.0.smithi134.stdout:7/938: dwrite da/d15/d26/d27/d3d/d9c/d10d/f117 [0,4194304] 0 2024-04-13T10:59:30.349 INFO:tasks.workunit.client.0.smithi134.stdout:7/939: fsync da/d15/d85/f8f 0 2024-04-13T10:59:30.358 INFO:tasks.workunit.client.0.smithi134.stdout:2/919: dwrite d5/d6/d70/dfc/d30/d58/d59/f8e [0,4194304] 0 2024-04-13T10:59:30.370 INFO:tasks.workunit.client.0.smithi134.stdout:2/920: creat d5/d6/d34/f10b x:0 0 0 2024-04-13T10:59:30.371 INFO:tasks.workunit.client.0.smithi134.stdout:2/921: fdatasync d5/d6/d57/f105 0 2024-04-13T10:59:30.373 INFO:tasks.workunit.client.0.smithi134.stdout:7/940: dread da/d15/d26/f35 [0,4194304] 0 2024-04-13T10:59:30.374 INFO:tasks.workunit.client.0.smithi134.stdout:7/941: chown da/d15/d85/fcf 0 1 2024-04-13T10:59:30.377 INFO:tasks.workunit.client.0.smithi134.stdout:2/922: dread d5/d6/d70/dfc/d30/d88/fd3 [0,4194304] 0 2024-04-13T10:59:30.380 INFO:tasks.workunit.client.0.smithi134.stdout:7/942: unlink da/d15/d26/d4a/dc7/cf3 0 2024-04-13T10:59:30.389 INFO:tasks.workunit.client.0.smithi134.stdout:7/943: creat da/d15/d26/d4a/f119 x:0 0 0 2024-04-13T10:59:30.391 INFO:tasks.workunit.client.0.smithi134.stdout:2/923: getdents d5/de/db3 0 2024-04-13T10:59:30.395 INFO:tasks.workunit.client.0.smithi134.stdout:7/944: rename da/d15/d85/db0/fb2 to da/d15/d26/d27/d4f/d5f/d88/f11a 0 2024-04-13T10:59:30.398 INFO:tasks.workunit.client.0.smithi134.stdout:2/924: dwrite d5/d6/d70/d84/de7/f10a [0,4194304] 0 2024-04-13T10:59:30.399 INFO:tasks.workunit.client.0.smithi134.stdout:7/945: read da/d15/d26/fae [1127651,86784] 0 2024-04-13T10:59:30.404 INFO:tasks.workunit.client.0.smithi134.stdout:7/946: chown da/d15/d26/d27/d3d/d9c/f61 450337433 1 2024-04-13T10:59:30.408 INFO:tasks.workunit.client.0.smithi134.stdout:2/925: dread d5/de/d50/f7b [0,4194304] 0 2024-04-13T10:59:30.413 INFO:tasks.workunit.client.0.smithi134.stdout:0/960: dwrite d4/d17/d20/d29/d30/d64/d84/dd3/ffa [0,4194304] 0 2024-04-13T10:59:30.416 INFO:tasks.workunit.client.0.smithi134.stdout:2/926: write d5/de/d12/f1d [1578455,80207] 0 2024-04-13T10:59:30.418 INFO:tasks.workunit.client.0.smithi134.stdout:3/937: dwrite dc/d1d/f8d [0,4194304] 0 2024-04-13T10:59:30.421 INFO:tasks.workunit.client.0.smithi134.stdout:3/938: stat dc/d27/d19/d48/d49/cc5 0 2024-04-13T10:59:30.423 INFO:tasks.workunit.client.0.smithi134.stdout:3/939: truncate dc/d27/d19/df3/f11b 721910 0 2024-04-13T10:59:30.425 INFO:tasks.workunit.client.0.smithi134.stdout:7/947: link da/d15/f22 da/d15/d26/d27/f11b 0 2024-04-13T10:59:30.431 INFO:tasks.workunit.client.0.smithi134.stdout:2/927: rename d5/d6/d70/db2/dec/fb8 to d5/de/db3/dda/f10c 0 2024-04-13T10:59:30.437 INFO:tasks.workunit.client.0.smithi134.stdout:0/961: mknod d4/d17/d23/d51/d6a/d73/d105/c15a 0 2024-04-13T10:59:30.437 INFO:tasks.workunit.client.0.smithi134.stdout:7/948: dread - da/fe1 zero size 2024-04-13T10:59:30.440 INFO:tasks.workunit.client.0.smithi134.stdout:4/904: dwrite d4/d48/d4a/d7e/ff6 [4194304,4194304] 0 2024-04-13T10:59:30.445 INFO:tasks.workunit.client.0.smithi134.stdout:3/940: rename dc/d27/d19/d8b/da8/c135 to dc/d27/d19/df3/c13e 0 2024-04-13T10:59:30.455 INFO:tasks.workunit.client.0.smithi134.stdout:4/905: mknod d4/d1f/d56/c132 0 2024-04-13T10:59:30.459 INFO:tasks.workunit.client.0.smithi134.stdout:2/928: truncate d5/de/d50/f56 4647115 0 2024-04-13T10:59:30.461 INFO:tasks.workunit.client.0.smithi134.stdout:2/929: fsync d5/d6/d70/dfc/d30/fb7 0 2024-04-13T10:59:30.463 INFO:tasks.workunit.client.0.smithi134.stdout:4/906: dwrite d4/d1f/d27/d75/d38/fed [0,4194304] 0 2024-04-13T10:59:30.473 INFO:tasks.workunit.client.0.smithi134.stdout:3/941: rename dc/l11 to dc/d27/d19/d8b/da8/d50/d25/d5f/d75/d8f/l13f 0 2024-04-13T10:59:30.479 INFO:tasks.workunit.client.0.smithi134.stdout:4/907: mknod d4/dd/df2/dee/c133 0 2024-04-13T10:59:30.483 INFO:tasks.workunit.client.0.smithi134.stdout:7/949: creat da/d15/d26/d38/f11c x:0 0 0 2024-04-13T10:59:30.484 INFO:tasks.workunit.client.0.smithi134.stdout:3/942: creat dc/d27/d19/d8b/d114/f140 x:0 0 0 2024-04-13T10:59:30.486 INFO:tasks.workunit.client.0.smithi134.stdout:4/908: dwrite d4/d48/d50/da0/fcc [0,4194304] 0 2024-04-13T10:59:30.492 INFO:tasks.workunit.client.0.smithi134.stdout:7/950: unlink da/d15/d26/d27/d3d/d9c/fb5 0 2024-04-13T10:59:30.493 INFO:tasks.workunit.client.0.smithi134.stdout:7/951: chown da/c40 85130 1 2024-04-13T10:59:30.494 INFO:tasks.workunit.client.0.smithi134.stdout:7/952: chown da/d15/d26/d27/d4f/d5f/d67/lc8 1 1 2024-04-13T10:59:30.502 INFO:tasks.workunit.client.0.smithi134.stdout:4/909: dwrite d4/d48/d4a/d7e/fe2 [0,4194304] 0 2024-04-13T10:59:30.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/953: rmdir da/df6 39 2024-04-13T10:59:30.503 INFO:tasks.workunit.client.0.smithi134.stdout:4/910: chown d4/d1f/d27/d2e/d84/ddb 826013507 1 2024-04-13T10:59:30.504 INFO:tasks.workunit.client.0.smithi134.stdout:7/954: write da/d15/d26/d27/d4f/d5f/fba [3357387,85233] 0 2024-04-13T10:59:30.508 INFO:tasks.workunit.client.0.smithi134.stdout:7/955: write da/d15/d26/d27/d4f/dd3/f104 [359442,35989] 0 2024-04-13T10:59:30.508 INFO:tasks.workunit.client.0.smithi134.stdout:3/943: mkdir dc/d27/d141 0 2024-04-13T10:59:30.514 INFO:tasks.workunit.client.0.smithi134.stdout:7/956: chown da/d15/d26/c109 15 1 2024-04-13T10:59:30.518 INFO:tasks.workunit.client.0.smithi134.stdout:4/911: rename d4/d1f/d90/c12e to d4/d1f/d27/d3a/d53/c134 0 2024-04-13T10:59:30.519 INFO:tasks.workunit.client.0.smithi134.stdout:3/944: rename dc/d1d/d58/de7/d130 to dc/d1d/d58/de7/d130/d142 22 2024-04-13T10:59:30.523 INFO:tasks.workunit.client.0.smithi134.stdout:4/912: rmdir d4/d1f/d27/d2e/d84/ddb 39 2024-04-13T10:59:30.527 INFO:tasks.workunit.client.0.smithi134.stdout:0/962: write d4/d17/d20/d29/f5b [3715475,118646] 0 2024-04-13T10:59:30.528 INFO:tasks.workunit.client.0.smithi134.stdout:4/913: dread d4/d1f/d27/d3a/d65/f66 [0,4194304] 0 2024-04-13T10:59:30.531 INFO:tasks.workunit.client.0.smithi134.stdout:0/963: mknod d4/d17/d20/d29/c15b 0 2024-04-13T10:59:30.534 INFO:tasks.workunit.client.0.smithi134.stdout:4/914: creat d4/d48/d86/f135 x:0 0 0 2024-04-13T10:59:30.535 INFO:tasks.workunit.client.0.smithi134.stdout:4/915: dread - d4/d119/f12c zero size 2024-04-13T10:59:30.538 INFO:tasks.workunit.client.0.smithi134.stdout:0/964: dwrite d4/d17/d20/da9/de1/dcf/d96/dd5/f14f [0,4194304] 0 2024-04-13T10:59:30.545 INFO:tasks.workunit.client.0.smithi134.stdout:2/930: write d5/de/f16 [4309812,45924] 0 2024-04-13T10:59:30.550 INFO:tasks.workunit.client.0.smithi134.stdout:4/916: dread d4/d48/d50/fc2 [0,4194304] 0 2024-04-13T10:59:30.550 INFO:tasks.workunit.client.0.smithi134.stdout:2/931: unlink d5/d6/d70/d84/ccc 0 2024-04-13T10:59:30.551 INFO:tasks.workunit.client.0.smithi134.stdout:4/917: dread - d4/d1f/d27/d3a/d65/f109 zero size 2024-04-13T10:59:30.552 INFO:tasks.workunit.client.0.smithi134.stdout:2/932: truncate d5/d6/d34/f10b 706108 0 2024-04-13T10:59:30.556 INFO:tasks.workunit.client.0.smithi134.stdout:0/965: getdents d4/d17/da/d22/d41/d6e/d8a/d95/db9/dff 0 2024-04-13T10:59:30.558 INFO:tasks.workunit.client.0.smithi134.stdout:2/933: creat d5/d6/d70/dfc/d30/d88/d94/f10d x:0 0 0 2024-04-13T10:59:30.563 INFO:tasks.workunit.client.0.smithi134.stdout:2/934: mknod d5/de/db3/c10e 0 2024-04-13T10:59:30.564 INFO:tasks.workunit.client.0.smithi134.stdout:2/935: write d5/d6/d70/dfc/d30/d88/fe6 [824051,5822] 0 2024-04-13T10:59:30.566 INFO:tasks.workunit.client.0.smithi134.stdout:4/918: creat d4/d1f/d27/d75/d38/f136 x:0 0 0 2024-04-13T10:59:30.570 INFO:tasks.workunit.client.0.smithi134.stdout:4/919: dread d4/d1f/d27/d75/d38/fed [0,4194304] 0 2024-04-13T10:59:30.570 INFO:tasks.workunit.client.0.smithi134.stdout:2/936: mkdir d5/de/d2e/d10f 0 2024-04-13T10:59:30.571 INFO:tasks.workunit.client.0.smithi134.stdout:2/937: write d5/de/d12/f86 [458716,5759] 0 2024-04-13T10:59:30.573 INFO:tasks.workunit.client.0.smithi134.stdout:7/957: write da/d15/d26/d27/d4f/d5f/d67/fd2 [3907369,43248] 0 2024-04-13T10:59:30.574 INFO:tasks.workunit.client.0.smithi134.stdout:7/958: fsync da/f54 0 2024-04-13T10:59:30.579 INFO:tasks.workunit.client.0.smithi134.stdout:3/945: truncate dc/d27/d19/d8b/da8/d50/d25/d5f/d75/d8f/fa0 2687583 0 2024-04-13T10:59:30.587 INFO:tasks.workunit.client.0.smithi134.stdout:3/946: readlink dc/le6 0 2024-04-13T10:59:30.598 INFO:tasks.workunit.client.0.smithi134.stdout:7/959: creat da/f11d x:0 0 0 2024-04-13T10:59:30.598 INFO:tasks.workunit.client.0.smithi134.stdout:4/920: link d4/d1f/d27/d75/l11e d4/d48/d50/da0/l137 0 2024-04-13T10:59:30.603 INFO:tasks.workunit.client.0.smithi134.stdout:0/966: dwrite d4/d17/d20/d29/d30/fe3 [0,4194304] 0 2024-04-13T10:59:30.605 INFO:tasks.workunit.client.0.smithi134.stdout:4/921: creat d4/dd/df2/dee/f138 x:0 0 0 2024-04-13T10:59:30.616 INFO:tasks.workunit.client.0.smithi134.stdout:0/967: rename d4/d17/d20/d29/dcd/ldd to d4/d17/d23/l15c 0 2024-04-13T10:59:30.617 INFO:tasks.workunit.client.0.smithi134.stdout:7/960: dwrite da/d15/d26/d27/d3d/d9c/d5a/fd5 [0,4194304] 0 2024-04-13T10:59:30.620 INFO:tasks.workunit.client.0.smithi134.stdout:0/968: readlink d4/d17/d20/da9/de1/dfc/d6d/d97/db6/lc9 0 2024-04-13T10:59:30.626 INFO:tasks.workunit.client.0.smithi134.stdout:2/938: truncate d5/de/d50/ff8 3800831 0 2024-04-13T10:59:30.634 INFO:tasks.workunit.client.0.smithi134.stdout:4/922: dread d4/d1f/d27/d75/d38/d79/f46 [0,4194304] 0 2024-04-13T10:59:30.673 INFO:tasks.workunit.client.0.smithi134.stdout:0/969: creat d4/d17/d23/d51/d6b/d91/d98/d62/daf/f15d x:0 0 0 2024-04-13T10:59:30.675 INFO:tasks.workunit.client.0.smithi134.stdout:4/923: truncate d4/dd/d6d/d8c/fa7 418976 0 2024-04-13T10:59:30.676 INFO:tasks.workunit.client.0.smithi134.stdout:7/961: truncate da/d15/d26/d27/d4f/d5f/d67/d76/fb6 4867150 0 2024-04-13T10:59:30.678 INFO:tasks.workunit.client.0.smithi134.stdout:7/962: truncate da/d15/d26/d27/d4f/d5f/d88/dd9/fe9 710664 0 2024-04-13T10:59:30.679 INFO:tasks.workunit.client.0.smithi134.stdout:0/970: symlink d4/d17/d20/d29/d30/d64/d84/dd3/d8c/l15e 0 2024-04-13T10:59:30.681 INFO:tasks.workunit.client.0.smithi134.stdout:0/971: chown d4/d17/d20/d29/dcd/cfe 7817 1 2024-04-13T10:59:30.683 INFO:tasks.workunit.client.0.smithi134.stdout:0/972: read d4/d17/d20/da9/de1/dfc/d6d/d97/db6/fb8 [3787782,82726] 0 2024-04-13T10:59:30.684 INFO:tasks.workunit.client.0.smithi134.stdout:7/963: creat da/dad/de3/dd7/f11e x:0 0 0 2024-04-13T10:59:30.690 INFO:tasks.workunit.client.0.smithi134.stdout:7/964: chown da/d15/d26/f62 1 1 2024-04-13T10:59:30.700 INFO:tasks.workunit.client.0.smithi134.stdout:4/924: getdents d4/d1f/d27/d75 0 2024-04-13T10:59:30.702 INFO:tasks.workunit.client.0.smithi134.stdout:0/973: getdents d4/d17/da/d22/d41/d6e/d8a/d95/db9/dff/d127 0 2024-04-13T10:59:30.703 INFO:tasks.workunit.client.0.smithi134.stdout:0/974: stat d4/d17/d23/d51/d6a/d94/cf0 0 2024-04-13T10:59:30.704 INFO:tasks.workunit.client.0.smithi134.stdout:7/965: mknod da/d15/d26/d27/d4f/d5f/d88/c11f 0 2024-04-13T10:59:30.705 INFO:tasks.workunit.client.0.smithi134.stdout:7/966: chown da/d15/d26/d27/d4f/d5f/fef 35724 1 2024-04-13T10:59:30.711 INFO:tasks.workunit.client.0.smithi134.stdout:7/967: dwrite da/d15/d26/d27/d4f/d5f/d67/d73/f75 [0,4194304] 0 2024-04-13T10:59:30.719 INFO:tasks.workunit.client.0.smithi134.stdout:0/975: creat d4/d17/d23/d51/d6a/f15f x:0 0 0 2024-04-13T10:59:30.719 INFO:tasks.workunit.client.0.smithi134.stdout:7/968: link da/d15/d26/d4a/f119 da/d15/d26/d27/dc9/dcd/f120 0 2024-04-13T10:59:30.724 INFO:tasks.workunit.client.0.smithi134.stdout:7/969: symlink da/d15/d26/d4a/dc7/l121 0 2024-04-13T10:59:30.726 INFO:tasks.workunit.client.0.smithi134.stdout:0/976: truncate d4/d17/fc5 1532994 0 2024-04-13T10:59:30.726 INFO:tasks.workunit.client.0.smithi134.stdout:7/970: read da/d15/d26/d27/d4f/d5f/d67/d73/f75 [3735479,19238] 0 2024-04-13T10:59:30.728 INFO:tasks.workunit.client.0.smithi134.stdout:7/971: fdatasync da/d15/d26/d27/d3d/d9c/d48/f5d 0 2024-04-13T10:59:30.739 INFO:tasks.workunit.client.0.smithi134.stdout:0/977: creat d4/d17/d23/d51/d6b/f160 x:0 0 0 2024-04-13T10:59:30.781 INFO:tasks.workunit.client.0.smithi134.stdout:2/939: truncate d5/d6/d70/dfc/d30/d58/d73/f8d 1435368 0 2024-04-13T10:59:30.781 INFO:tasks.workunit.client.0.smithi134.stdout:2/940: fdatasync d5/de/d12/f86 0 2024-04-13T10:59:30.790 INFO:tasks.workunit.client.0.smithi134.stdout:2/941: link d5/d6/d70/dfc/d30/ca3 d5/de/db3/c110 0 2024-04-13T10:59:30.820 INFO:tasks.workunit.client.0.smithi134.stdout:7/972: rmdir da/d15 39 2024-04-13T10:59:30.837 INFO:tasks.workunit.client.0.smithi134.stdout:0/978: write d4/d17/da/f54 [341429,11107] 0 2024-04-13T10:59:30.846 INFO:tasks.workunit.client.0.smithi134.stdout:0/979: creat d4/d17/d20/da9/de1/dfc/d6d/da5/dd9/f161 x:0 0 0 2024-04-13T10:59:30.846 INFO:tasks.workunit.client.0.smithi134.stdout:0/980: stat d4/d17/d20/d29/c15b 0 2024-04-13T10:59:30.849 INFO:tasks.workunit.client.0.smithi134.stdout:0/981: fdatasync d4/d17/d23/d51/d6a/d73/f7a 0 2024-04-13T10:59:30.850 INFO:tasks.workunit.client.0.smithi134.stdout:0/982: chown d4/d17/d23/d51/d6b/d91/d98/l75 95209 1 2024-04-13T10:59:30.853 INFO:tasks.workunit.client.0.smithi134.stdout:0/983: truncate d4/d17/d23/d51/d6a/d94/db2/f63 5052187 0 2024-04-13T10:59:30.854 INFO:tasks.workunit.client.0.smithi134.stdout:0/984: stat d4/d17/d20/da9/de1/dfc/d6d/d97 0 2024-04-13T10:59:30.922 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:30 smithi194 ceph-mon[46737]: pgmap v49: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 65 MiB/s rd, 143 MiB/s wr, 381 op/s 2024-04-13T10:59:30.922 INFO:tasks.workunit.client.0.smithi134.stdout:2/942: truncate d5/d6/d70/fa0 2096188 0 2024-04-13T10:59:30.923 INFO:tasks.workunit.client.0.smithi134.stdout:2/943: read d5/de/d12/f86 [271930,104698] 0 2024-04-13T10:59:30.933 INFO:tasks.workunit.client.0.smithi134.stdout:2/944: mknod d5/c111 0 2024-04-13T10:59:30.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:30 smithi134 ceph-mon[39696]: pgmap v49: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 65 MiB/s rd, 143 MiB/s wr, 381 op/s 2024-04-13T10:59:30.935 INFO:tasks.workunit.client.0.smithi134.stdout:2/945: rmdir d5/d6/d70/dfc/d30/d58/d59 39 2024-04-13T10:59:30.990 INFO:tasks.workunit.client.0.smithi134.stdout:0/985: write d4/d17/d23/d51/d6b/f108 [1147241,23325] 0 2024-04-13T10:59:31.005 INFO:tasks.workunit.client.0.smithi134.stdout:0/986: dread d4/d17/d20/da9/de1/dfc/d6d/d97/f131 [0,4194304] 0 2024-04-13T10:59:31.012 INFO:tasks.workunit.client.0.smithi134.stdout:0/987: rename d4/d17/da/d22/d41/d6e/d8a/d95/db9/f109 to d4/d17/d20/da9/de1/dfc/d6d/d97/dbe/f162 0 2024-04-13T10:59:31.013 INFO:tasks.workunit.client.0.smithi134.stdout:0/988: write d4/d17/d20/d29/f5b [2092483,107520] 0 2024-04-13T10:59:31.024 INFO:tasks.workunit.client.0.smithi134.stdout:0/989: getdents d4/d17/da/d22/deb 0 2024-04-13T10:59:31.028 INFO:tasks.workunit.client.0.smithi134.stdout:2/946: dwrite d5/d6/d70/fa0 [0,4194304] 0 2024-04-13T10:59:31.030 INFO:tasks.workunit.client.0.smithi134.stdout:0/990: creat d4/d17/da/d22/d41/d6e/d8a/f163 x:0 0 0 2024-04-13T10:59:31.045 INFO:tasks.workunit.client.0.smithi134.stdout:0/991: link d4/d17/d23/d51/d6b/d91/d98/d62/daf/f139 d4/d17/d23/d51/d6a/d94/db2/f164 0 2024-04-13T10:59:31.052 INFO:tasks.workunit.client.0.smithi134.stdout:0/992: dwrite d4/d17/d23/d51/d6a/d104/f143 [0,4194304] 0 2024-04-13T10:59:31.060 INFO:tasks.workunit.client.0.smithi134.stdout:0/993: dwrite d4/d17/da/d22/d41/f4b [0,4194304] 0 2024-04-13T10:59:31.100 INFO:tasks.workunit.client.0.smithi134.stdout:2/947: truncate d5/d6/d70/db2/fd9 621517 0 2024-04-13T10:59:31.106 INFO:tasks.workunit.client.0.smithi134.stdout:2/948: dwrite d5/de/db3/fcb [0,4194304] 0 2024-04-13T10:59:31.154 INFO:tasks.workunit.client.0.smithi134.stdout:2/949: rename d5/de/c7f to d5/d6/d70/d84/de7/c112 0 2024-04-13T10:59:31.161 INFO:tasks.workunit.client.0.smithi134.stdout:2/950: dwrite d5/d6/d70/db2/dec/f46 [0,4194304] 0 2024-04-13T10:59:31.168 INFO:tasks.workunit.client.0.smithi134.stdout:2/951: fdatasync d5/de/d2e/d8f/f6e 0 2024-04-13T10:59:31.176 INFO:tasks.workunit.client.0.smithi134.stdout:2/952: creat d5/d6/df/f113 x:0 0 0 2024-04-13T10:59:31.251 INFO:tasks.workunit.client.0.smithi134.stdout:2/953: write d5/d6/d70/dfc/d30/f42 [226291,9038] 0 2024-04-13T10:59:31.255 INFO:tasks.workunit.client.0.smithi134.stdout:2/954: dread d5/d6/d70/dfc/d30/f71 [0,4194304] 0 2024-04-13T10:59:31.287 INFO:tasks.workunit.client.0.smithi134.stdout:2/955: mkdir d5/d6/d70/d114 0 2024-04-13T10:59:31.288 INFO:tasks.workunit.client.0.smithi134.stdout:2/956: write d5/d6/d70/dfc/d30/d58/d59/f7e [3191942,63163] 0 2024-04-13T10:59:31.290 INFO:tasks.workunit.client.0.smithi134.stdout:2/957: mkdir d5/d6/d70/dfc/d30/d88/d94/d115 0 2024-04-13T10:59:31.296 INFO:tasks.workunit.client.0.smithi134.stdout:2/958: dwrite d5/d6/d70/dfc/d30/f4f [0,4194304] 0 2024-04-13T10:59:31.732 INFO:tasks.workunit.client.0.smithi134.stdout:3/947: sync 2024-04-13T10:59:31.743 INFO:tasks.workunit.client.0.smithi134.stdout:3/948: truncate dc/d27/d19/d8b/d114/f132 235861 0 2024-04-13T10:59:31.747 INFO:tasks.workunit.client.0.smithi134.stdout:3/949: symlink dc/d27/d19/d8b/d9b/d106/l143 0 2024-04-13T10:59:31.750 INFO:tasks.workunit.client.0.smithi134.stdout:3/950: symlink dc/d27/d19/d48/l144 0 2024-04-13T10:59:31.756 INFO:tasks.workunit.client.0.smithi134.stdout:3/951: fsync dc/d1d/d58/f7e 0 2024-04-13T10:59:31.759 INFO:tasks.workunit.client.0.smithi134.stdout:3/952: write dc/d27/d19/df3/f11b [724628,116871] 0 2024-04-13T10:59:31.764 INFO:tasks.workunit.client.0.smithi134.stdout:3/953: creat dc/d27/d19/f145 x:0 0 0 2024-04-13T10:59:31.768 INFO:tasks.workunit.client.0.smithi134.stdout:3/954: truncate dc/d27/d19/d8b/da8/d50/d25/f111 1611895 0 2024-04-13T10:59:31.786 INFO:tasks.workunit.client.0.smithi134.stdout:4/925: sync 2024-04-13T10:59:31.786 INFO:tasks.workunit.client.0.smithi134.stdout:0/994: sync 2024-04-13T10:59:31.786 INFO:tasks.workunit.client.0.smithi134.stdout:7/973: sync 2024-04-13T10:59:31.786 INFO:tasks.workunit.client.0.smithi134.stdout:2/959: sync 2024-04-13T10:59:31.792 INFO:tasks.workunit.client.0.smithi134.stdout:4/926: symlink d4/d48/l139 0 2024-04-13T10:59:31.794 INFO:tasks.workunit.client.0.smithi134.stdout:7/974: creat da/d15/d85/f122 x:0 0 0 2024-04-13T10:59:31.795 INFO:tasks.workunit.client.0.smithi134.stdout:3/955: dwrite dc/d27/d19/faa [0,4194304] 0 2024-04-13T10:59:31.798 INFO:tasks.workunit.client.0.smithi134.stdout:4/927: dread - d4/d1f/d27/d75/d38/d79/fe5 zero size 2024-04-13T10:59:31.803 INFO:tasks.workunit.client.0.smithi134.stdout:0/995: dwrite d4/d17/d23/f83 [0,4194304] 0 2024-04-13T10:59:31.806 INFO:tasks.workunit.client.0.smithi134.stdout:2/960: link d5/d6/d70/dfc/d30/dd1/lfa d5/de/d2e/d8f/l116 0 2024-04-13T10:59:31.808 INFO:tasks.workunit.client.0.smithi134.stdout:2/961: readlink d5/d6/d34/dc0/lfd 0 2024-04-13T10:59:31.808 INFO:tasks.workunit.client.0.smithi134.stdout:4/928: creat d4/d1f/d27/d2e/d84/dde/f13a x:0 0 0 2024-04-13T10:59:31.808 INFO:tasks.workunit.client.0.smithi134.stdout:4/929: fdatasync d4/f7a 0 2024-04-13T10:59:31.809 INFO:tasks.workunit.client.0.smithi134.stdout:0/996: creat d4/d17/d20/d29/d30/d7f/dc0/f165 x:0 0 0 2024-04-13T10:59:31.810 INFO:tasks.workunit.client.0.smithi134.stdout:2/962: truncate d5/d6/d34/f9e 1652734 0 2024-04-13T10:59:31.811 INFO:tasks.workunit.client.0.smithi134.stdout:7/975: mkdir da/d15/d26/d27/d3d/d46/d123 0 2024-04-13T10:59:31.812 INFO:tasks.workunit.client.0.smithi134.stdout:2/963: readlink d5/de/d2e/l5b 0 2024-04-13T10:59:31.813 INFO:tasks.workunit.client.0.smithi134.stdout:3/956: truncate dc/d1d/d58/f60 1525476 0 2024-04-13T10:59:31.817 INFO:tasks.workunit.client.0.smithi134.stdout:0/997: unlink d4/d17/d20/da9/de1/dfc/d6d/d97/db6/lc9 0 2024-04-13T10:59:31.817 INFO:tasks.workunit.client.0.smithi134.stdout:3/957: symlink dc/d27/d19/d48/d8e/l146 0 2024-04-13T10:59:31.818 INFO:tasks.workunit.client.0.smithi134.stdout:4/930: dread d4/d1f/d27/d75/f52 [0,4194304] 0 2024-04-13T10:59:31.820 INFO:tasks.workunit.client.0.smithi134.stdout:7/976: fsync da/d15/d26/d27/d3d/d9c/d48/ff4 0 2024-04-13T10:59:31.822 INFO:tasks.workunit.client.0.smithi134.stdout:2/964: mkdir d5/de/d12/d104/d117 0 2024-04-13T10:59:31.824 INFO:tasks.workunit.client.0.smithi134.stdout:2/965: write d5/d6/d70/dfc/fbe [3500257,43354] 0 2024-04-13T10:59:31.825 INFO:tasks.workunit.client.0.smithi134.stdout:2/966: stat d5/d6/f8b 0 2024-04-13T10:59:31.830 INFO:tasks.workunit.client.0.smithi134.stdout:2/967: dread d5/de/db3/fcb [0,4194304] 0 2024-04-13T10:59:31.834 INFO:tasks.workunit.client.0.smithi134.stdout:3/958: dread dc/d27/d19/d8b/da8/d50/d25/d5f/d99/fc0 [0,4194304] 0 2024-04-13T10:59:31.844 INFO:tasks.workunit.client.0.smithi134.stdout:7/977: unlink da/d15/d26/d27/d4f/d5f/d67/d73/d92/d9e/cbe 0 2024-04-13T10:59:31.847 INFO:tasks.workunit.client.0.smithi134.stdout:3/959: creat dc/d1d/dca/f147 x:0 0 0 2024-04-13T10:59:31.848 INFO:tasks.workunit.client.0.smithi134.stdout:4/931: rmdir d4/dd/d6d/d104 0 2024-04-13T10:59:31.855 INFO:tasks.workunit.client.0.smithi134.stdout:2/968: dwrite d5/de/d12/faf [0,4194304] 0 2024-04-13T10:59:31.855 INFO:tasks.workunit.client.0.smithi134.stdout:3/960: creat dc/d1d/d58/dcd/f148 x:0 0 0 2024-04-13T10:59:31.901 INFO:tasks.workunit.client.0.smithi134.stdout:0/998: link d4/d17/d20/da9/de1/dfc/f40 d4/d17/d20/d29/d30/d3e/f166 0 2024-04-13T10:59:31.902 INFO:tasks.workunit.client.0.smithi134.stdout:4/932: mkdir d4/dd/d120/d13b 0 2024-04-13T10:59:31.903 INFO:tasks.workunit.client.0.smithi134.stdout:0/999: readlink d4/d17/d20/d29/dcd/l132 0 2024-04-13T10:59:31.904 INFO:tasks.workunit.client.0.smithi134.stdout:2/969: mknod d5/de/d2e/def/d108/c118 0 2024-04-13T10:59:31.909 INFO:tasks.workunit.client.0.smithi134.stdout:2/970: mknod d5/de/d2e/d8f/c119 0 2024-04-13T10:59:31.909 INFO:tasks.workunit.client.0.smithi134.stdout:3/961: dread dc/f42 [0,4194304] 0 2024-04-13T10:59:31.910 INFO:tasks.workunit.client.0.smithi134.stdout:4/933: dwrite d4/d1f/d90/faa [4194304,4194304] 0 2024-04-13T10:59:31.913 INFO:tasks.workunit.client.0.smithi134.stdout:3/962: symlink dc/d27/d19/d8b/da8/l149 0 2024-04-13T10:59:31.913 INFO:tasks.workunit.client.0.smithi134.stdout:2/971: dread d5/d6/d70/dfc/d30/d58/d73/f8d [0,4194304] 0 2024-04-13T10:59:31.925 INFO:tasks.workunit.client.0.smithi134.stdout:2/972: write d5/de/d50/f5e [1240178,99291] 0 2024-04-13T10:59:31.927 INFO:tasks.workunit.client.0.smithi134.stdout:2/973: read d5/d6/d70/dfc/d30/f4f [366493,43527] 0 2024-04-13T10:59:31.930 INFO:tasks.workunit.client.0.smithi134.stdout:3/963: dwrite dc/d27/d19/d48/d8e/fe4 [0,4194304] 0 2024-04-13T10:59:31.938 INFO:tasks.workunit.client.0.smithi134.stdout:2/974: dread d5/d6/d70/dfc/d30/d58/d73/f98 [0,4194304] 0 2024-04-13T10:59:31.938 INFO:tasks.workunit.client.0.smithi134.stdout:3/964: link dc/d2a/l3a dc/d27/d19/d8b/da8/d50/d25/d5f/d75/l14a 0 2024-04-13T10:59:31.939 INFO:tasks.workunit.client.0.smithi134.stdout:2/975: dread - d5/d6/d70/ff2 zero size 2024-04-13T10:59:31.942 INFO:tasks.workunit.client.0.smithi134.stdout:2/976: rename d5/de/d12/lc4 to d5/d6/d70/d84/d100/l11a 0 2024-04-13T10:59:31.942 INFO:tasks.workunit.client.0.smithi134.stdout:2/977: chown d5/cf3 15846320 1 2024-04-13T10:59:31.944 INFO:tasks.workunit.client.0.smithi134.stdout:3/965: link dc/f42 dc/d27/d19/d8b/d9b/f14b 0 2024-04-13T10:59:31.944 INFO:tasks.workunit.client.0.smithi134.stdout:2/978: rmdir d5/da1 39 2024-04-13T10:59:31.949 INFO:tasks.workunit.client.0.smithi134.stdout:2/979: truncate d5/de/d50/f56 2420939 0 2024-04-13T10:59:31.950 INFO:tasks.workunit.client.0.smithi134.stdout:2/980: read d5/de/d12/fa2 [143613,35161] 0 2024-04-13T10:59:31.952 INFO:tasks.workunit.client.0.smithi134.stdout:3/966: write dc/d27/d19/d8b/d9b/f9f [1193008,91113] 0 2024-04-13T10:59:31.956 INFO:tasks.workunit.client.0.smithi134.stdout:2/981: rename d5/de/d2e/d8f/l116 to d5/d6/d70/db2/dec/l11b 0 2024-04-13T10:59:31.961 INFO:tasks.workunit.client.0.smithi134.stdout:2/982: creat d5/d6/d34/dc0/f11c x:0 0 0 2024-04-13T10:59:31.965 INFO:tasks.workunit.client.0.smithi134.stdout:2/983: rmdir d5/d6/df 39 2024-04-13T10:59:31.966 INFO:tasks.workunit.client.0.smithi134.stdout:3/967: link dc/f55 dc/d1d/d58/dcd/d117/f14c 0 2024-04-13T10:59:31.966 INFO:tasks.workunit.client.0.smithi134.stdout:2/984: write d5/d6/d70/fa0 [634953,68172] 0 2024-04-13T10:59:31.973 INFO:tasks.workunit.client.0.smithi134.stdout:2/985: unlink d5/d6/d70/dfc/fbe 0 2024-04-13T10:59:31.975 INFO:tasks.workunit.client.0.smithi134.stdout:3/968: dwrite dc/d27/d19/d48/d8e/fe4 [0,4194304] 0 2024-04-13T10:59:31.975 INFO:tasks.workunit.client.0.smithi134.stdout:2/986: read d5/de/d12/fa2 [339185,68088] 0 2024-04-13T10:59:31.976 INFO:tasks.workunit.client.0.smithi134.stdout:2/987: fdatasync d5/d6/d70/d9c/ff9 0 2024-04-13T10:59:31.977 INFO:tasks.workunit.client.0.smithi134.stdout:3/969: dread - dc/d1d/dca/f147 zero size 2024-04-13T10:59:31.985 INFO:tasks.workunit.client.0.smithi134.stdout:2/988: creat d5/de/d12/d104/d117/f11d x:0 0 0 2024-04-13T10:59:31.988 INFO:tasks.workunit.client.0.smithi134.stdout:2/989: write d5/d6/d70/dfc/d30/d58/d59/f7e [3588401,100388] 0 2024-04-13T10:59:31.990 INFO:tasks.workunit.client.0.smithi134.stdout:3/970: dwrite dc/d27/d19/d8b/da8/d50/d25/d91/feb [4194304,4194304] 0 2024-04-13T10:59:31.993 INFO:tasks.workunit.client.0.smithi134.stdout:3/971: chown dc/d27/d19/d8b/da8/d50/d25/d5f 130877151 1 2024-04-13T10:59:31.994 INFO:tasks.workunit.client.0.smithi134.stdout:2/990: creat d5/d6/d70/d84/de7/f11e x:0 0 0 2024-04-13T10:59:32.003 INFO:tasks.workunit.client.0.smithi134.stdout:2/991: link d5/d6/d70/dfc/d30/d58/d73/f8d d5/d6/d70/f11f 0 2024-04-13T10:59:32.008 INFO:tasks.workunit.client.0.smithi134.stdout:3/972: write dc/fe [7371729,7476] 0 2024-04-13T10:59:32.011 INFO:tasks.workunit.client.0.smithi134.stdout:2/992: write d5/d6/d70/dfc/d30/d58/d73/f83 [1227643,103225] 0 2024-04-13T10:59:32.011 INFO:tasks.workunit.client.0.smithi134.stdout:3/973: read dc/d1d/d102/f5e [976223,127135] 0 2024-04-13T10:59:32.015 INFO:tasks.workunit.client.0.smithi134.stdout:3/974: creat dc/d27/d19/d48/d8e/d105/d11d/f14d x:0 0 0 2024-04-13T10:59:32.016 INFO:tasks.workunit.client.0.smithi134.stdout:3/975: write dc/d100/f128 [688548,69091] 0 2024-04-13T10:59:32.031 INFO:tasks.workunit.client.0.smithi134.stdout:3/976: dread dc/d1d/d58/f5d [0,4194304] 0 2024-04-13T10:59:32.042 INFO:tasks.workunit.client.0.smithi134.stdout:3/977: dwrite dc/d27/d19/f5c [4194304,4194304] 0 2024-04-13T10:59:32.046 INFO:tasks.workunit.client.0.smithi134.stdout:3/978: creat dc/d27/d19/d8b/da8/d50/d25/d5f/d75/f14e x:0 0 0 2024-04-13T10:59:32.048 INFO:tasks.workunit.client.0.smithi134.stdout:3/979: chown dc/d1d/d102/l5b 119 1 2024-04-13T10:59:32.051 INFO:tasks.workunit.client.0.smithi134.stdout:3/980: symlink dc/d27/l14f 0 2024-04-13T10:59:32.068 INFO:tasks.workunit.client.0.smithi134.stdout:3/981: dwrite dc/d27/d19/d8b/da8/fe8 [0,4194304] 0 2024-04-13T10:59:32.088 INFO:tasks.workunit.client.0.smithi134.stdout:3/982: dread dc/d27/d19/f6a [0,4194304] 0 2024-04-13T10:59:32.090 INFO:tasks.workunit.client.0.smithi134.stdout:3/983: mknod dc/d1d/d58/c150 0 2024-04-13T10:59:32.093 INFO:tasks.workunit.client.0.smithi134.stdout:3/984: creat dc/d1d/d58/de7/d119/f151 x:0 0 0 2024-04-13T10:59:32.098 INFO:tasks.workunit.client.0.smithi134.stdout:3/985: dwrite dc/d27/f52 [0,4194304] 0 2024-04-13T10:59:32.426 INFO:tasks.workunit.client.0.smithi134.stdout:7/978: sync 2024-04-13T10:59:32.428 INFO:tasks.workunit.client.0.smithi134.stdout:7/979: creat da/d15/df5/f124 x:0 0 0 2024-04-13T10:59:32.430 INFO:tasks.workunit.client.0.smithi134.stdout:7/980: fsync da/d15/f6e 0 2024-04-13T10:59:32.432 INFO:tasks.workunit.client.0.smithi134.stdout:7/981: rmdir da/d15/d26/d27/d3d/d9c/d10d 39 2024-04-13T10:59:32.437 INFO:tasks.workunit.client.0.smithi134.stdout:7/982: read da/d15/d26/d27/d3d/d46/f4b [669813,92412] 0 2024-04-13T10:59:32.444 INFO:tasks.workunit.client.0.smithi134.stdout:7/983: dwrite da/d15/d26/d27/d4f/d5f/d67/d73/d92/fe4 [0,4194304] 0 2024-04-13T10:59:32.449 INFO:tasks.workunit.client.0.smithi134.stdout:7/984: creat da/d15/deb/f125 x:0 0 0 2024-04-13T10:59:32.450 INFO:tasks.workunit.client.0.smithi134.stdout:7/985: readlink da/d15/d26/d27/d4f/dd3/ld4 0 2024-04-13T10:59:32.467 INFO:tasks.workunit.client.0.smithi134.stdout:7/986: dread da/d15/d26/d27/d4f/d5f/d67/d76/fb6 [0,4194304] 0 2024-04-13T10:59:32.470 INFO:tasks.workunit.client.0.smithi134.stdout:7/987: chown da/d15/d26/d27/d3d/d46/lda 0 1 2024-04-13T10:59:32.470 INFO:tasks.workunit.client.0.smithi134.stdout:7/988: stat da/d15/d26/d27/l63 0 2024-04-13T10:59:32.478 INFO:tasks.workunit.client.0.smithi134.stdout:7/989: dwrite da/d15/f22 [0,4194304] 0 2024-04-13T10:59:32.484 INFO:tasks.workunit.client.0.smithi134.stdout:7/990: link da/d15/d26/d38/f10f da/d15/d26/d27/d4f/f126 0 2024-04-13T10:59:32.485 INFO:tasks.workunit.client.0.smithi134.stdout:7/991: write da/d15/f29 [4263167,103429] 0 2024-04-13T10:59:32.489 INFO:tasks.workunit.client.0.smithi134.stdout:7/992: getdents da/d15/d26/d27/dc9/dcd 0 2024-04-13T10:59:32.494 INFO:tasks.workunit.client.0.smithi134.stdout:7/993: rmdir da/df6 39 2024-04-13T10:59:32.496 INFO:tasks.workunit.client.0.smithi134.stdout:7/994: mknod da/d15/d26/d27/d4f/d5f/d67/c127 0 2024-04-13T10:59:32.498 INFO:tasks.workunit.client.0.smithi134.stdout:7/995: write da/dad/de3/fa2 [88446,42346] 0 2024-04-13T10:59:32.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/996: write da/d15/d26/d27/d3d/d46/dbf/fe5 [514065,77732] 0 2024-04-13T10:59:32.522 INFO:tasks.workunit.client.0.smithi134.stdout:7/997: dwrite da/d15/d26/d27/f5c [4194304,4194304] 0 2024-04-13T10:59:32.526 INFO:tasks.workunit.client.0.smithi134.stdout:7/998: mkdir da/d15/d26/d27/d3d/d46/dbf/d128 0 2024-04-13T10:59:32.543 INFO:tasks.workunit.client.0.smithi134.stdout:7/999: rename da/d15/d26 to da/d15/d85/db0/d129 0 2024-04-13T10:59:32.599 INFO:tasks.workunit.client.0.smithi134.stdout:4/934: sync 2024-04-13T10:59:32.601 INFO:tasks.workunit.client.0.smithi134.stdout:4/935: rename d4/d1f/d27/d75/f31 to d4/d48/f13c 0 2024-04-13T10:59:32.603 INFO:tasks.workunit.client.0.smithi134.stdout:4/936: read d4/d1f/d27/d3a/d53/dc1/db3/f12f [3947032,4175] 0 2024-04-13T10:59:32.606 INFO:tasks.workunit.client.0.smithi134.stdout:4/937: rename d4/d1f/f5b to d4/d1f/d27/d10e/f13d 0 2024-04-13T10:59:32.609 INFO:tasks.workunit.client.0.smithi134.stdout:4/938: symlink d4/dd/d6d/l13e 0 2024-04-13T10:59:32.622 INFO:tasks.workunit.client.0.smithi134.stdout:4/939: truncate d4/d1f/d90/faa 2535135 0 2024-04-13T10:59:32.657 INFO:tasks.workunit.client.0.smithi134.stdout:2/993: sync 2024-04-13T10:59:32.657 INFO:tasks.workunit.client.0.smithi134.stdout:3/986: sync 2024-04-13T10:59:32.658 INFO:tasks.workunit.client.0.smithi134.stdout:3/987: dread - dc/d27/d19/d48/d8e/f134 zero size 2024-04-13T10:59:32.659 INFO:tasks.workunit.client.0.smithi134.stdout:2/994: write d5/d6/d70/dfc/d30/f71 [1259060,11594] 0 2024-04-13T10:59:32.666 INFO:tasks.workunit.client.0.smithi134.stdout:3/988: dwrite dc/d27/d19/d8b/f133 [0,4194304] 0 2024-04-13T10:59:32.667 INFO:tasks.workunit.client.0.smithi134.stdout:2/995: dwrite d5/d6/d70/db2/dec/f66 [0,4194304] 0 2024-04-13T10:59:32.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:32 smithi134 ceph-mon[39696]: pgmap v50: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 43 MiB/s rd, 94 MiB/s wr, 252 op/s 2024-04-13T10:59:32.690 INFO:tasks.workunit.client.0.smithi134.stdout:2/996: write d5/d6/df/f113 [687278,57254] 0 2024-04-13T10:59:32.693 INFO:tasks.workunit.client.0.smithi134.stdout:2/997: creat d5/de/d2e/def/f120 x:0 0 0 2024-04-13T10:59:32.696 INFO:tasks.workunit.client.0.smithi134.stdout:4/940: mkdir d4/d1f/d27/d2e/d117/d13f 0 2024-04-13T10:59:32.699 INFO:tasks.workunit.client.0.smithi134.stdout:2/998: rename d5/de/d12/d104 to d5/d6/d70/d9c/d121 0 2024-04-13T10:59:32.700 INFO:tasks.workunit.client.0.smithi134.stdout:4/941: write d4/d48/d50/fc2 [3968767,16695] 0 2024-04-13T10:59:32.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/999: mknod d5/d6/d57/c122 0 2024-04-13T10:59:32.703 INFO:tasks.workunit.client.0.smithi134.stdout:4/942: creat d4/d48/d4a/d7e/f140 x:0 0 0 2024-04-13T10:59:32.716 INFO:tasks.workunit.client.0.smithi134.stdout:4/943: dread d4/f2a [0,4194304] 0 2024-04-13T10:59:32.724 INFO:tasks.workunit.client.0.smithi134.stdout:3/989: write dc/d1d/d58/f60 [1056298,22015] 0 2024-04-13T10:59:32.727 INFO:tasks.workunit.client.0.smithi134.stdout:3/990: creat dc/d27/d19/d48/d8e/d105/d11d/f152 x:0 0 0 2024-04-13T10:59:32.734 INFO:tasks.workunit.client.0.smithi134.stdout:3/991: creat dc/d1d/d102/f153 x:0 0 0 2024-04-13T10:59:32.738 INFO:tasks.workunit.client.0.smithi134.stdout:4/944: dwrite d4/d48/d50/da0/fad [0,4194304] 0 2024-04-13T10:59:32.744 INFO:tasks.workunit.client.0.smithi134.stdout:4/945: creat d4/dd/df2/dee/f141 x:0 0 0 2024-04-13T10:59:32.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:32 smithi194 ceph-mon[46737]: pgmap v50: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 43 MiB/s rd, 94 MiB/s wr, 252 op/s 2024-04-13T10:59:32.750 INFO:tasks.workunit.client.0.smithi134.stdout:3/992: rmdir dc/d27/d19 39 2024-04-13T10:59:32.759 INFO:tasks.workunit.client.0.smithi134.stdout:4/946: dread d4/d1f/d27/d75/f44 [0,4194304] 0 2024-04-13T10:59:32.762 INFO:tasks.workunit.client.0.smithi134.stdout:4/947: creat d4/dd/d120/d13b/f142 x:0 0 0 2024-04-13T10:59:32.764 INFO:tasks.workunit.client.0.smithi134.stdout:4/948: truncate d4/d1f/d27/d75/d38/f41 4819190 0 2024-04-13T10:59:32.767 INFO:tasks.workunit.client.0.smithi134.stdout:4/949: getdents d4/d1f/d27/d75/d38/d79/d32/d67/d113 0 2024-04-13T10:59:32.769 INFO:tasks.workunit.client.0.smithi134.stdout:4/950: fsync d4/d1f/d27/d2e/d84/dde/fda 0 2024-04-13T10:59:32.772 INFO:tasks.workunit.client.0.smithi134.stdout:4/951: symlink d4/d1f/d27/d2e/d84/dde/ddc/l143 0 2024-04-13T10:59:32.775 INFO:tasks.workunit.client.0.smithi134.stdout:4/952: mkdir d4/d1f/d27/d3a/d65/d144 0 2024-04-13T10:59:32.781 INFO:tasks.workunit.client.0.smithi134.stdout:3/993: dwrite dc/d27/d19/d8b/da8/d50/d25/d5f/d75/d8f/fa0 [0,4194304] 0 2024-04-13T10:59:32.788 INFO:tasks.workunit.client.0.smithi134.stdout:3/994: chown dc/d27/d19/d8b/d9b 14 1 2024-04-13T10:59:32.793 INFO:tasks.workunit.client.0.smithi134.stdout:3/995: unlink dc/d1d/d58/d72/ffe 0 2024-04-13T10:59:32.794 INFO:tasks.workunit.client.0.smithi134.stdout:3/996: dread - dc/d27/d19/d48/f126 zero size 2024-04-13T10:59:32.797 INFO:tasks.workunit.client.0.smithi134.stdout:3/997: readlink dc/d27/d19/d8b/da8/d50/d25/d5f/d75/l14a 0 2024-04-13T10:59:32.806 INFO:tasks.workunit.client.0.smithi134.stdout:4/953: write d4/d1f/d27/d2e/d84/fb7 [7785,93024] 0 2024-04-13T10:59:32.807 INFO:tasks.workunit.client.0.smithi134.stdout:4/954: fsync d4/f7a 0 2024-04-13T10:59:32.810 INFO:tasks.workunit.client.0.smithi134.stdout:4/955: mknod d4/d1f/d27/d3a/d53/dc1/db3/d111/c145 0 2024-04-13T10:59:32.812 INFO:tasks.workunit.client.0.smithi134.stdout:4/956: read d4/d1f/d27/d3a/d53/dc1/db3/f12f [3785600,6586] 0 2024-04-13T10:59:32.813 INFO:tasks.workunit.client.0.smithi134.stdout:3/998: rmdir dc/d1d 39 2024-04-13T10:59:32.813 INFO:tasks.workunit.client.0.smithi134.stdout:4/957: readlink d4/d1f/d27/dd2/lfb 0 2024-04-13T10:59:32.814 INFO:tasks.workunit.client.0.smithi134.stdout:4/958: chown d4/d1f/d27/d75/d38 5 1 2024-04-13T10:59:32.816 INFO:tasks.workunit.client.0.smithi134.stdout:4/959: fsync d4/d1f/d27/d75/d38/fed 0 2024-04-13T10:59:32.817 INFO:tasks.workunit.client.0.smithi134.stdout:4/960: chown d4/d1f/d27/d2e/d84/lb1 12659 1 2024-04-13T10:59:32.820 INFO:tasks.workunit.client.0.smithi134.stdout:4/961: mknod d4/d1f/d27/d75/d38/d79/d32/c146 0 2024-04-13T10:59:32.825 INFO:tasks.workunit.client.0.smithi134.stdout:4/962: creat d4/d1f/d27/d2e/d84/ddb/f147 x:0 0 0 2024-04-13T10:59:32.828 INFO:tasks.workunit.client.0.smithi134.stdout:4/963: mknod d4/dd/df2/dee/df3/c148 0 2024-04-13T10:59:32.830 INFO:tasks.workunit.client.0.smithi134.stdout:4/964: truncate d4/dd/df2/dee/df3/f114 9868253 0 2024-04-13T10:59:32.833 INFO:tasks.workunit.client.0.smithi134.stdout:4/965: read d4/d1f/d27/d75/d38/d79/d32/d67/d9b/fc3 [955157,90763] 0 2024-04-13T10:59:32.841 INFO:tasks.workunit.client.0.smithi134.stdout:4/966: dwrite d4/dd/d6d/d8c/d5f/dfc/f129 [0,4194304] 0 2024-04-13T10:59:32.842 INFO:tasks.workunit.client.0.smithi134.stdout:4/967: stat d4/d1f/d27/d75/d38/d79/d32/d67/d113 0 2024-04-13T10:59:32.860 INFO:tasks.workunit.client.0.smithi134.stdout:4/968: link d4/d1f/d27/d75/d38/d79/c45 d4/d1f/d27/c149 0 2024-04-13T10:59:32.860 INFO:tasks.workunit.client.0.smithi134.stdout:4/969: read - d4/d119/f12c zero size 2024-04-13T10:59:32.861 INFO:tasks.workunit.client.0.smithi134.stdout:4/970: fdatasync d4/dd/df2/dee/f141 0 2024-04-13T10:59:32.867 INFO:tasks.workunit.client.0.smithi134.stdout:4/971: truncate d4/d1f/d27/d75/d38/d79/f35 2345296 0 2024-04-13T10:59:32.892 INFO:tasks.workunit.client.0.smithi134.stdout:4/972: dread d4/dd/d6d/f80 [0,4194304] 0 2024-04-13T10:59:32.899 INFO:tasks.workunit.client.0.smithi134.stdout:4/973: stat d4/d1f/d27/d3a/d65/f109 0 2024-04-13T10:59:32.908 INFO:tasks.workunit.client.0.smithi134.stdout:4/974: link d4/d1f/d27/d75/lbf d4/d48/d86/l14a 0 2024-04-13T10:59:32.913 INFO:tasks.workunit.client.0.smithi134.stdout:4/975: readlink d4/d1f/d27/d2e/d84/lb1 0 2024-04-13T10:59:32.919 INFO:tasks.workunit.client.0.smithi134.stdout:4/976: fdatasync d4/d1f/d27/d75/f44 0 2024-04-13T10:59:32.924 INFO:tasks.workunit.client.0.smithi134.stdout:4/977: mkdir d4/d1f/d27/d3a/d65/d14b 0 2024-04-13T10:59:32.929 INFO:tasks.workunit.client.0.smithi134.stdout:4/978: truncate d4/d1f/d27/d2e/d84/dde/f13a 699866 0 2024-04-13T10:59:32.972 INFO:tasks.workunit.client.0.smithi134.stdout:4/979: dread d4/d48/d4a/d7e/ff6 [0,4194304] 0 2024-04-13T10:59:32.978 INFO:tasks.workunit.client.0.smithi134.stdout:4/980: mknod d4/d1f/d27/d3a/d53/dc1/db3/c14c 0 2024-04-13T10:59:33.005 INFO:tasks.workunit.client.0.smithi134.stdout:4/981: dread d4/d1f/d27/d75/d38/d79/f8b [0,4194304] 0 2024-04-13T10:59:33.337 INFO:tasks.workunit.client.0.smithi134.stdout:4/982: sync 2024-04-13T10:59:33.337 INFO:tasks.workunit.client.0.smithi134.stdout:3/999: sync 2024-04-13T10:59:33.339 INFO:tasks.workunit.client.0.smithi134.stdout:4/983: symlink d4/d1f/d27/d2e/d84/ddb/l14d 0 2024-04-13T10:59:33.626 INFO:tasks.workunit.client.0.smithi134.stdout:4/984: sync 2024-04-13T10:59:33.628 INFO:tasks.workunit.client.0.smithi134.stdout:4/985: write d4/dd/df2/dee/df3/f114 [8017247,82863] 0 2024-04-13T10:59:33.668 INFO:tasks.workunit.client.0.smithi134.stdout:4/986: dwrite d4/d1f/d27/d75/d38/d79/f28 [0,4194304] 0 2024-04-13T10:59:33.672 INFO:tasks.workunit.client.0.smithi134.stdout:4/987: creat d4/d48/d50/da0/f14e x:0 0 0 2024-04-13T10:59:33.675 INFO:tasks.workunit.client.0.smithi134.stdout:4/988: symlink d4/dd/d6d/d8c/d5f/dfc/l14f 0 2024-04-13T10:59:33.683 INFO:tasks.workunit.client.0.smithi134.stdout:4/989: dwrite d4/dd/d120/d13b/f142 [0,4194304] 0 2024-04-13T10:59:33.688 INFO:tasks.workunit.client.0.smithi134.stdout:4/990: getdents d4/dd 0 2024-04-13T10:59:33.693 INFO:tasks.workunit.client.0.smithi134.stdout:4/991: dread d4/dd/d6d/d8c/fa7 [0,4194304] 0 2024-04-13T10:59:33.694 INFO:tasks.workunit.client.0.smithi134.stdout:4/992: dread - d4/d119/f12c zero size 2024-04-13T10:59:33.694 INFO:tasks.workunit.client.0.smithi134.stdout:4/993: fdatasync d4/d48/d50/fc2 0 2024-04-13T10:59:33.701 INFO:tasks.workunit.client.0.smithi134.stdout:4/994: dread d4/d1f/d27/d75/d38/d79/db9/fef [0,4194304] 0 2024-04-13T10:59:33.713 INFO:tasks.workunit.client.0.smithi134.stdout:4/995: dread d4/d1f/d27/d2e/d84/fb7 [0,4194304] 0 2024-04-13T10:59:33.714 INFO:tasks.workunit.client.0.smithi134.stdout:4/996: readlink d4/d1f/d90/l11f 0 2024-04-13T10:59:33.734 INFO:tasks.workunit.client.0.smithi134.stdout:4/997: symlink d4/d48/d50/l150 0 2024-04-13T10:59:34.043 INFO:tasks.workunit.client.0.smithi134.stdout:4/998: sync 2024-04-13T10:59:34.057 INFO:tasks.workunit.client.0.smithi134.stdout:4/999: dread d4/dd/d6d/d8c/d5f/fae [8388608,4194304] 0 2024-04-13T10:59:34.061 INFO:tasks.workunit.client.0.smithi134.stderr:+ rm -rf -- ./tmp.Wq2SlnTEou 2024-04-13T10:59:34.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:34 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:34.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:34 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:34.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:34 smithi134 ceph-mon[39696]: pgmap v51: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 50 MiB/s rd, 110 MiB/s wr, 319 op/s 2024-04-13T10:59:34.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:34 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:34.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:34 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:34.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:34 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:34 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:34 smithi194 ceph-mon[46737]: pgmap v51: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 50 MiB/s rd, 110 MiB/s wr, 319 op/s 2024-04-13T10:59:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:34 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:34.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:34 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:36.843 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:36 smithi134 ceph-mon[39696]: pgmap v52: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 37 MiB/s rd, 82 MiB/s wr, 246 op/s 2024-04-13T10:59:36.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:36 smithi194 ceph-mon[46737]: pgmap v52: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 37 MiB/s rd, 82 MiB/s wr, 246 op/s 2024-04-13T10:59:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: pgmap v53: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 30 MiB/s rd, 66 MiB/s wr, 210 op/s 2024-04-13T10:59:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mgr fail", "who": "smithi194.tcpynt"}]: dispatch 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mgr fail", "who": "smithi194.tcpynt"}]: dispatch 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: osdmap e48: 6 total, 6 up, 6 in 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd='[{"prefix": "mgr fail", "who": "smithi194.tcpynt"}]': finished 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: mgrmap e27: smithi134.tmanda(active, starting, since 0.00545698s) 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:59:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.kachce"}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.wnddvg"}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr metadata", "who": "smithi134.tmanda", "id": "smithi134.tmanda"}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: Manager daemon smithi134.tmanda is now available 2024-04-13T10:59:39.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:59:39.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:59:39.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/mirror_snapshot_schedule"}]: dispatch 2024-04-13T10:59:39.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/trash_purge_schedule"}]: dispatch 2024-04-13T10:59:39.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: [13/Apr/2024:10:59:38] ENGINE Bus STARTING 2024-04-13T10:59:39.001 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:38 smithi194 ceph-mon[46737]: [13/Apr/2024:10:59:38] ENGINE Serving on http://172.21.15.134:8765 2024-04-13T10:59:39.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: pgmap v53: 65 pgs: 65 active+clean; 2.2 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 30 MiB/s rd, 66 MiB/s wr, 210 op/s 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.24351 172.21.15.194:0/3079194649' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mgr fail", "who": "smithi194.tcpynt"}]: dispatch 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "mgr fail", "who": "smithi194.tcpynt"}]: dispatch 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: osdmap e48: 6 total, 6 up, 6 in 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.24351 ' entity='mgr.smithi194.tcpynt' cmd='[{"prefix": "mgr fail", "who": "smithi194.tcpynt"}]': finished 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: mgrmap e27: smithi134.tmanda(active, starting, since 0.00545698s) 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T10:59:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.kachce"}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.wnddvg"}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr metadata", "who": "smithi134.tmanda", "id": "smithi134.tmanda"}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-13T10:59:39.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-13T10:59:39.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: Manager daemon smithi134.tmanda is now available 2024-04-13T10:59:39.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:59:39.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:59:39.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/mirror_snapshot_schedule"}]: dispatch 2024-04-13T10:59:39.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.tmanda/trash_purge_schedule"}]: dispatch 2024-04-13T10:59:39.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: [13/Apr/2024:10:59:38] ENGINE Bus STARTING 2024-04-13T10:59:39.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:38 smithi134 ceph-mon[39696]: [13/Apr/2024:10:59:38] ENGINE Serving on http://172.21.15.134:8765 2024-04-13T10:59:39.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:39 smithi134 ceph-mon[39696]: [13/Apr/2024:10:59:38] ENGINE Serving on https://172.21.15.134:7150 2024-04-13T10:59:39.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:39 smithi134 ceph-mon[39696]: [13/Apr/2024:10:59:38] ENGINE Bus STARTED 2024-04-13T10:59:39.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:39 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:39.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:39 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:39.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:39 smithi134 ceph-mon[39696]: mgrmap e28: smithi134.tmanda(active, since 1.00814s) 2024-04-13T10:59:39.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:39 smithi134 ceph-mon[39696]: pgmap v3: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail 2024-04-13T10:59:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:39 smithi194 ceph-mon[46737]: [13/Apr/2024:10:59:38] ENGINE Serving on https://172.21.15.134:7150 2024-04-13T10:59:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:39 smithi194 ceph-mon[46737]: [13/Apr/2024:10:59:38] ENGINE Bus STARTED 2024-04-13T10:59:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:39 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:39 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:39 smithi194 ceph-mon[46737]: mgrmap e28: smithi134.tmanda(active, since 1.00814s) 2024-04-13T10:59:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:39 smithi194 ceph-mon[46737]: pgmap v3: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail 2024-04-13T10:59:41.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:40 smithi134 ceph-mon[39696]: pgmap v4: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail 2024-04-13T10:59:41.215 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:40 smithi194 ceph-mon[46737]: pgmap v4: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail 2024-04-13T10:59:42.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:41 smithi134 ceph-mon[39696]: mgrmap e29: smithi134.tmanda(active, since 3s) 2024-04-13T10:59:42.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:41 smithi194 ceph-mon[46737]: mgrmap e29: smithi134.tmanda(active, since 3s) 2024-04-13T10:59:43.114 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:42 smithi194 ceph-mon[46737]: pgmap v5: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail 2024-04-13T10:59:43.114 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:42 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:43.114 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:42 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:43.114 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:42 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:43.114 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:42 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:43.363 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:42 smithi134 ceph-mon[39696]: pgmap v5: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail 2024-04-13T10:59:43.363 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:42 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:43.363 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:42 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:43.363 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:42 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:43.363 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:42 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:45.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:44 smithi194 ceph-mon[46737]: pgmap v6: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail 2024-04-13T10:59:45.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:44 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:45.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:44 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:45.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:44 smithi134 ceph-mon[39696]: pgmap v6: 65 pgs: 65 active+clean; 2.0 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail 2024-04-13T10:59:45.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:44 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:45.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:44 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:46.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:46 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:46.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:46 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:46.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:46 smithi134 ceph-mon[39696]: pgmap v7: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-04-13T10:59:46.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:46 smithi134 ceph-mon[39696]: Standby manager daemon smithi194.tcpynt started 2024-04-13T10:59:46.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:46 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/2139329267' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/crt"}]: dispatch 2024-04-13T10:59:46.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:46 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/2139329267' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T10:59:46.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:46 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/2139329267' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/key"}]: dispatch 2024-04-13T10:59:46.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:46 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/2139329267' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T10:59:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:46 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:46 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:46 smithi194 ceph-mon[46737]: pgmap v7: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-04-13T10:59:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:46 smithi194 ceph-mon[46737]: Standby manager daemon smithi194.tcpynt started 2024-04-13T10:59:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:46 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/2139329267' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/crt"}]: dispatch 2024-04-13T10:59:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:46 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/2139329267' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T10:59:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:46 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/2139329267' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/key"}]: dispatch 2024-04-13T10:59:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:46 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/2139329267' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T10:59:47.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:47 smithi134 ceph-mon[39696]: mgrmap e30: smithi134.tmanda(active, since 8s), standbys: smithi194.tcpynt 2024-04-13T10:59:47.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:47 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr metadata", "who": "smithi194.tcpynt", "id": "smithi194.tcpynt"}]: dispatch 2024-04-13T10:59:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:47 smithi194 ceph-mon[46737]: mgrmap e30: smithi134.tmanda(active, since 8s), standbys: smithi194.tcpynt 2024-04-13T10:59:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:47 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr metadata", "who": "smithi194.tcpynt", "id": "smithi194.tcpynt"}]: dispatch 2024-04-13T10:59:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:48 smithi194 ceph-mon[46737]: pgmap v8: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 104 op/s 2024-04-13T10:59:49.083 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:48 smithi134 ceph-mon[39696]: pgmap v8: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 104 op/s 2024-04-13T10:59:50.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:50 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:50.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:50 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:50.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:50 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:59:50.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:50 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:59:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:50 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:50 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:50 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T10:59:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:50 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T10:59:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: Updating smithi134:/etc/ceph/ceph.conf 2024-04-13T10:59:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: Updating smithi194:/etc/ceph/ceph.conf 2024-04-13T10:59:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: pgmap v9: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 160 op/s 2024-04-13T10:59:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:59:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:59:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:59:51.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:59:51.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.client.admin.keyring 2024-04-13T10:59:51.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.client.admin.keyring 2024-04-13T10:59:51.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:51.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:51.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:51.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:51.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:51 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: Updating smithi134:/etc/ceph/ceph.conf 2024-04-13T10:59:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: Updating smithi194:/etc/ceph/ceph.conf 2024-04-13T10:59:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: pgmap v9: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 160 op/s 2024-04-13T10:59:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:59:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.conf 2024-04-13T10:59:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:59:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-04-13T10:59:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: Updating smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.client.admin.keyring 2024-04-13T10:59:51.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: Updating smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/config/ceph.client.admin.keyring 2024-04-13T10:59:51.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:51.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:51.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:51.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:51.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:51 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:52.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:52 smithi134 ceph-mon[39696]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-04-13T10:59:52.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:52 smithi134 ceph-mon[39696]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-04-13T10:59:52.997 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:52 smithi194 ceph-mon[46737]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-04-13T10:59:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:52 smithi194 ceph-mon[46737]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-04-13T10:59:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:53 smithi134 ceph-mon[39696]: pgmap v10: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 147 op/s 2024-04-13T10:59:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:53 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:59:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:53 smithi194 ceph-mon[46737]: pgmap v10: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 147 op/s 2024-04-13T10:59:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:53 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T10:59:54.502 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-13T10:59:54.502 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-13T10:59:54.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.585+0000 7fba1f5a4700 1 -- 172.21.15.134:0/4107858030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba18100be0 msgr2=0x7fba18102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:54.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.585+0000 7fba1f5a4700 1 --2- 172.21.15.134:0/4107858030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba18100be0 0x7fba18102fc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fba14009910 tx=0x7fba14009c20 comp rx=0 tx=0).stop 2024-04-13T10:59:54.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.585+0000 7fba1f5a4700 1 -- 172.21.15.134:0/4107858030 shutdown_connections 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.585+0000 7fba1f5a4700 1 --2- 172.21.15.134:0/4107858030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba18103500 0x7fba181058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.585+0000 7fba1f5a4700 1 --2- 172.21.15.134:0/4107858030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba18100be0 0x7fba18102fc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.585+0000 7fba1f5a4700 1 -- 172.21.15.134:0/4107858030 >> 172.21.15.134:0/4107858030 conn(0x7fba180fa5e0 msgr2=0x7fba180fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.585+0000 7fba1f5a4700 1 -- 172.21.15.134:0/4107858030 shutdown_connections 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.585+0000 7fba1f5a4700 1 -- 172.21.15.134:0/4107858030 wait complete. 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1f5a4700 1 Processor -- start 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1f5a4700 1 -- start start 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1f5a4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba18100be0 0x7fba18195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1f5a4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba18103500 0x7fba18195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1f5a4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba181963a0 con 0x7fba18100be0 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1f5a4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba181964e0 con 0x7fba18103500 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1d340700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba18100be0 0x7fba18195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:54.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1d340700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba18100be0 0x7fba18195840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37980/0 (socket says 172.21.15.134:37980) 2024-04-13T10:59:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1d340700 1 -- 172.21.15.134:0/2721255170 learned_addr learned my addr 172.21.15.134:0/2721255170 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:59:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1cb3f700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba18103500 0x7fba18195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1d340700 1 -- 172.21.15.134:0/2721255170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba18103500 msgr2=0x7fba18195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1d340700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba18103500 0x7fba18195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1d340700 1 -- 172.21.15.134:0/2721255170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140095f0 con 0x7fba18100be0 2024-04-13T10:59:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.586+0000 7fba1d340700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba18100be0 0x7fba18195840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fba1400bde0 tx=0x7fba1400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.587+0000 7fba0e7fc700 1 -- 172.21.15.134:0/2721255170 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba1401d070 con 0x7fba18100be0 2024-04-13T10:59:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.587+0000 7fba0e7fc700 1 -- 172.21.15.134:0/2721255170 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fba14005710 con 0x7fba18100be0 2024-04-13T10:59:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.587+0000 7fba1f5a4700 1 -- 172.21.15.134:0/2721255170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1819af30 con 0x7fba18100be0 2024-04-13T10:59:54.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.587+0000 7fba0e7fc700 1 -- 172.21.15.134:0/2721255170 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba14003a30 con 0x7fba18100be0 2024-04-13T10:59:54.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.587+0000 7fba1f5a4700 1 -- 172.21.15.134:0/2721255170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1819b3c0 con 0x7fba18100be0 2024-04-13T10:59:54.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.588+0000 7fba1f5a4700 1 -- 172.21.15.134:0/2721255170 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1818fa30 con 0x7fba18100be0 2024-04-13T10:59:54.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.589+0000 7fba0e7fc700 1 -- 172.21.15.134:0/2721255170 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 30) v1 ==== 90946+0+0 (secure 0 0 0) 0x7fba140048e0 con 0x7fba18100be0 2024-04-13T10:59:54.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.590+0000 7fba0e7fc700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fba0406ce10 0x7fba0406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:54.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.590+0000 7fba0e7fc700 1 -- 172.21.15.134:0/2721255170 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fba1408e5b0 con 0x7fba18100be0 2024-04-13T10:59:54.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.590+0000 7fba1cb3f700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fba0406ce10 0x7fba0406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:54.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.590+0000 7fba1cb3f700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fba0406ce10 0x7fba0406f2c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba08009c60 tx=0x7fba08009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:54.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.597+0000 7fba0e7fc700 1 -- 172.21.15.134:0/2721255170 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fba1405c010 con 0x7fba18100be0 2024-04-13T10:59:54.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.886+0000 7fba1f5a4700 1 -- 172.21.15.134:0/2721255170 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba18061190 con 0x7fba0406ce10 2024-04-13T10:59:54.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.888+0000 7fba0e7fc700 1 -- 172.21.15.134:0/2721255170 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fba18061190 con 0x7fba0406ce10 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 -- 172.21.15.134:0/2721255170 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fba0406ce10 msgr2=0x7fba0406f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fba0406ce10 0x7fba0406f2c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba08009c60 tx=0x7fba08009260 comp rx=0 tx=0).stop 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 -- 172.21.15.134:0/2721255170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba18100be0 msgr2=0x7fba18195840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba18100be0 0x7fba18195840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fba1400bde0 tx=0x7fba1400be10 comp rx=0 tx=0).stop 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 -- 172.21.15.134:0/2721255170 shutdown_connections 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fba0406ce10 0x7fba0406f2c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba18100be0 0x7fba18195840 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 --2- 172.21.15.134:0/2721255170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba18103500 0x7fba18195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 -- 172.21.15.134:0/2721255170 >> 172.21.15.134:0/2721255170 conn(0x7fba180fa5e0 msgr2=0x7fba180fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 -- 172.21.15.134:0/2721255170 shutdown_connections 2024-04-13T10:59:54.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:54.890+0000 7fba1f5a4700 1 -- 172.21.15.134:0/2721255170 wait complete. 2024-04-13T10:59:54.901 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T10:59:54.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:54 smithi134 ceph-mon[39696]: pgmap v11: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 147 op/s 2024-04-13T10:59:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:54 smithi194 ceph-mon[46737]: pgmap v11: 65 pgs: 65 active+clean; 1.1 GiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 147 op/s 2024-04-13T10:59:55.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.035+0000 7f3a0771d700 1 -- 172.21.15.134:0/1717632297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a001013f0 msgr2=0x7f3a00101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:55.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.035+0000 7f3a0771d700 1 --2- 172.21.15.134:0/1717632297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a001013f0 0x7f3a00101840 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009910 tx=0x7f39f0009c20 comp rx=0 tx=0).stop 2024-04-13T10:59:55.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.035+0000 7f3a0771d700 1 -- 172.21.15.134:0/1717632297 shutdown_connections 2024-04-13T10:59:55.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.035+0000 7f3a0771d700 1 --2- 172.21.15.134:0/1717632297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a001013f0 0x7f3a00101840 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.035+0000 7f3a0771d700 1 --2- 172.21.15.134:0/1717632297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a000fe410 0x7f3a000fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.035+0000 7f3a0771d700 1 -- 172.21.15.134:0/1717632297 >> 172.21.15.134:0/1717632297 conn(0x7f3a000f9d80 msgr2=0x7f3a000fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:55.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.035+0000 7f3a0771d700 1 -- 172.21.15.134:0/1717632297 shutdown_connections 2024-04-13T10:59:55.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.035+0000 7f3a0771d700 1 -- 172.21.15.134:0/1717632297 wait complete. 2024-04-13T10:59:55.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.035+0000 7f3a0771d700 1 Processor -- start 2024-04-13T10:59:55.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.035+0000 7f3a0771d700 1 -- start start 2024-04-13T10:59:55.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a0771d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a000fe410 0x7f3a00195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:55.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a0771d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a001013f0 0x7f3a00195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:55.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a0771d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a001963d0 con 0x7f3a001013f0 2024-04-13T10:59:55.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a0771d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a00196510 con 0x7f3a000fe410 2024-04-13T10:59:55.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a04cb8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a001013f0 0x7f3a00195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:55.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a04cb8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a001013f0 0x7f3a00195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37994/0 (socket says 172.21.15.134:37994) 2024-04-13T10:59:55.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a04cb8700 1 -- 172.21.15.134:0/3503032846 learned_addr learned my addr 172.21.15.134:0/3503032846 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:59:55.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a054b9700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a000fe410 0x7f3a00195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:55.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a04cb8700 1 -- 172.21.15.134:0/3503032846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a000fe410 msgr2=0x7f3a00195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:55.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a04cb8700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a000fe410 0x7f3a00195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a04cb8700 1 -- 172.21.15.134:0/3503032846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00095f0 con 0x7f3a001013f0 2024-04-13T10:59:55.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a04cb8700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a001013f0 0x7f3a00195db0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f39f0006010 tx=0x7f39f000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:55.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f39f67fc700 1 -- 172.21.15.134:0/3503032846 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f001d070 con 0x7f3a001013f0 2024-04-13T10:59:55.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f39f67fc700 1 -- 172.21.15.134:0/3503032846 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f39f000f460 con 0x7f3a001013f0 2024-04-13T10:59:55.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f3a0771d700 1 -- 172.21.15.134:0/3503032846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0019af60 con 0x7f3a001013f0 2024-04-13T10:59:55.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.036+0000 7f39f67fc700 1 -- 172.21.15.134:0/3503032846 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f0021640 con 0x7f3a001013f0 2024-04-13T10:59:55.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.037+0000 7f3a0771d700 1 -- 172.21.15.134:0/3503032846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0019b4a0 con 0x7f3a001013f0 2024-04-13T10:59:55.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.038+0000 7f3a0771d700 1 -- 172.21.15.134:0/3503032846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a00108b50 con 0x7f3a001013f0 2024-04-13T10:59:55.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.038+0000 7f39f67fc700 1 -- 172.21.15.134:0/3503032846 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 30) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f39f0003a60 con 0x7f3a001013f0 2024-04-13T10:59:55.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.039+0000 7f39f67fc700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f39ec06ce20 0x7f39ec06f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:55.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.039+0000 7f39f67fc700 1 -- 172.21.15.134:0/3503032846 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f39f008d9b0 con 0x7f3a001013f0 2024-04-13T10:59:55.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.039+0000 7f3a054b9700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f39ec06ce20 0x7f39ec06f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:55.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.039+0000 7f3a054b9700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f39ec06ce20 0x7f39ec06f2d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3a000681d0 tx=0x7f39fc00b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:55.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.044+0000 7f39f67fc700 1 -- 172.21.15.134:0/3503032846 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f39f005b390 con 0x7f3a001013f0 2024-04-13T10:59:55.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.347+0000 7f3a0771d700 1 -- 172.21.15.134:0/3503032846 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a00105d40 con 0x7f39ec06ce20 2024-04-13T10:59:55.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.348+0000 7f39f67fc700 1 -- 172.21.15.134:0/3503032846 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f3a00105d40 con 0x7f39ec06ce20 2024-04-13T10:59:55.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 -- 172.21.15.134:0/3503032846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f39ec06ce20 msgr2=0x7f39ec06f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:55.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f39ec06ce20 0x7f39ec06f2d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3a000681d0 tx=0x7f39fc00b410 comp rx=0 tx=0).stop 2024-04-13T10:59:55.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 -- 172.21.15.134:0/3503032846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a001013f0 msgr2=0x7f3a00195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:55.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a001013f0 0x7f3a00195db0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f39f0006010 tx=0x7f39f000bd70 comp rx=0 tx=0).stop 2024-04-13T10:59:55.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 -- 172.21.15.134:0/3503032846 shutdown_connections 2024-04-13T10:59:55.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f39ec06ce20 0x7f39ec06f2d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a000fe410 0x7f3a00195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 --2- 172.21.15.134:0/3503032846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a001013f0 0x7f3a00195db0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 -- 172.21.15.134:0/3503032846 >> 172.21.15.134:0/3503032846 conn(0x7f3a000f9d80 msgr2=0x7f3a00104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:55.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 -- 172.21.15.134:0/3503032846 shutdown_connections 2024-04-13T10:59:55.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.351+0000 7f3a0771d700 1 -- 172.21.15.134:0/3503032846 wait complete. 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.500+0000 7fd064bc0700 1 -- 172.21.15.134:0/3762965399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd060100250 msgr2=0x7fd0601006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.500+0000 7fd064bc0700 1 --2- 172.21.15.134:0/3762965399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd060100250 0x7fd0601006a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd054009910 tx=0x7fd054009c20 comp rx=0 tx=0).stop 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.500+0000 7fd064bc0700 1 -- 172.21.15.134:0/3762965399 shutdown_connections 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.500+0000 7fd064bc0700 1 --2- 172.21.15.134:0/3762965399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd060100250 0x7fd0601006a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.500+0000 7fd064bc0700 1 --2- 172.21.15.134:0/3762965399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0600ff050 0x7fd0600ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.500+0000 7fd064bc0700 1 -- 172.21.15.134:0/3762965399 >> 172.21.15.134:0/3762965399 conn(0x7fd0600fa5e0 msgr2=0x7fd0600fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.500+0000 7fd064bc0700 1 -- 172.21.15.134:0/3762965399 shutdown_connections 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.500+0000 7fd064bc0700 1 -- 172.21.15.134:0/3762965399 wait complete. 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.501+0000 7fd064bc0700 1 Processor -- start 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.501+0000 7fd064bc0700 1 -- start start 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.501+0000 7fd064bc0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0600ff050 0x7fd0601958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:55.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.501+0000 7fd064bc0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd060100250 0x7fd060195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:55.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.501+0000 7fd064bc0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060196400 con 0x7fd0600ff050 2024-04-13T10:59:55.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.501+0000 7fd064bc0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060196540 con 0x7fd060100250 2024-04-13T10:59:55.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.501+0000 7fd05e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0600ff050 0x7fd0601958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:55.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd05e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0600ff050 0x7fd0601958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38008/0 (socket says 172.21.15.134:38008) 2024-04-13T10:59:55.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd05e59c700 1 -- 172.21.15.134:0/3549560474 learned_addr learned my addr 172.21.15.134:0/3549560474 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:59:55.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd05dd9b700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd060100250 0x7fd060195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:55.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd05e59c700 1 -- 172.21.15.134:0/3549560474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd060100250 msgr2=0x7fd060195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:55.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd05e59c700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd060100250 0x7fd060195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd05e59c700 1 -- 172.21.15.134:0/3549560474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540095f0 con 0x7fd0600ff050 2024-04-13T10:59:55.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd05e59c700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0600ff050 0x7fd0601958a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd05000d900 tx=0x7fd05000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:55.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd04f7fe700 1 -- 172.21.15.134:0/3549560474 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05000b920 con 0x7fd0600ff050 2024-04-13T10:59:55.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd064bc0700 1 -- 172.21.15.134:0/3549560474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06019aff0 con 0x7fd0600ff050 2024-04-13T10:59:55.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd04f7fe700 1 -- 172.21.15.134:0/3549560474 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fd050010460 con 0x7fd0600ff050 2024-04-13T10:59:55.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd04f7fe700 1 -- 172.21.15.134:0/3549560474 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05000f5d0 con 0x7fd0600ff050 2024-04-13T10:59:55.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.502+0000 7fd064bc0700 1 -- 172.21.15.134:0/3549560474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06019b4b0 con 0x7fd0600ff050 2024-04-13T10:59:55.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.503+0000 7fd064bc0700 1 -- 172.21.15.134:0/3549560474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd060108b60 con 0x7fd0600ff050 2024-04-13T10:59:55.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.504+0000 7fd04f7fe700 1 -- 172.21.15.134:0/3549560474 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 30) v1 ==== 90946+0+0 (secure 0 0 0) 0x7fd05000f890 con 0x7fd0600ff050 2024-04-13T10:59:55.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.504+0000 7fd04f7fe700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd04806ce20 0x7fd04806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:55.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.504+0000 7fd04f7fe700 1 -- 172.21.15.134:0/3549560474 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd05008c380 con 0x7fd0600ff050 2024-04-13T10:59:55.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.505+0000 7fd05dd9b700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd04806ce20 0x7fd04806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:55.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.505+0000 7fd05dd9b700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd04806ce20 0x7fd04806f2d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd05400b5c0 tx=0x7fd054005ee0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:55.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.509+0000 7fd04f7fe700 1 -- 172.21.15.134:0/3549560474 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fd050059d60 con 0x7fd0600ff050 2024-04-13T10:59:55.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.786+0000 7fd064bc0700 1 -- 172.21.15.134:0/3549560474 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd060104ba0 con 0x7fd04806ce20 2024-04-13T10:59:55.805 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T10:59:55.805 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (8m) 10s ago 10m 25.1M - 0.25.0 c8568f914cd2 8d2cf34cad2a 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (10m) 10s ago 10m 7868k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (9m) 13s ago 9m 7490k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (10m) 10s ago 10m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (9m) 13s ago 9m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (8m) 10s ago 9m 91.2M - 9.4.7 954c08fa6188 1038718f4fd4 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (4m) 10s ago 4m 265M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (4m) 10s ago 4m 248M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (4m) 13s ago 4m 13.9M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (4m) 13s ago 4m 17.8M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (84s) 10s ago 11m 476M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T10:59:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (2m) 13s ago 9m 66.9M - 18.2.2-1173-g5108bc67 3464fd31103e 870bcc3bd872 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (11m) 10s ago 11m 51.9M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (9m) 13s ago 8m 42.1M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (10m) 10s ago 10m 15.7M - 1.5.0 0da6a335fe13 da23f14cbdef 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (9m) 13s ago 9m 18.5M - 1.5.0 0da6a335fe13 242da19a461b 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (8m) 10s ago 8m 208M 1227M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (7m) 10s ago 7m 209M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (7m) 10s ago 7m 176M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (6m) 13s ago 6m 221M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (6m) 13s ago 6m 194M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (5m) 13s ago 5m 205M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T10:59:55.807 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (92s) 10s ago 9m 58.0M - 2.43.0 a07b618ecd1d e5d14ce2dbf9 2024-04-13T10:59:55.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.805+0000 7fd04f7fe700 1 -- 172.21.15.134:0/3549560474 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd060104ba0 con 0x7fd04806ce20 2024-04-13T10:59:55.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.807+0000 7fd064bc0700 1 -- 172.21.15.134:0/3549560474 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd04806ce20 msgr2=0x7fd04806f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:55.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.807+0000 7fd064bc0700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd04806ce20 0x7fd04806f2d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd05400b5c0 tx=0x7fd054005ee0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.807+0000 7fd064bc0700 1 -- 172.21.15.134:0/3549560474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0600ff050 msgr2=0x7fd0601958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:55.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.807+0000 7fd064bc0700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0600ff050 0x7fd0601958a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd05000d900 tx=0x7fd05000dc10 comp rx=0 tx=0).stop 2024-04-13T10:59:55.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.808+0000 7fd064bc0700 1 -- 172.21.15.134:0/3549560474 shutdown_connections 2024-04-13T10:59:55.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.808+0000 7fd064bc0700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd04806ce20 0x7fd04806f2d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.808+0000 7fd064bc0700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0600ff050 0x7fd0601958a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.808+0000 7fd064bc0700 1 --2- 172.21.15.134:0/3549560474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd060100250 0x7fd060195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.808+0000 7fd064bc0700 1 -- 172.21.15.134:0/3549560474 >> 172.21.15.134:0/3549560474 conn(0x7fd0600fa5e0 msgr2=0x7fd060103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:55.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.808+0000 7fd064bc0700 1 -- 172.21.15.134:0/3549560474 shutdown_connections 2024-04-13T10:59:55.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.808+0000 7fd064bc0700 1 -- 172.21.15.134:0/3549560474 wait complete. 2024-04-13T10:59:55.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:55 smithi134 ceph-mon[39696]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:55.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:55 smithi134 ceph-mon[39696]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:55.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.939+0000 7fcdecc1b700 1 -- 172.21.15.134:0/62170553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde80ff050 msgr2=0x7fcde80ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:55.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.939+0000 7fcdecc1b700 1 --2- 172.21.15.134:0/62170553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde80ff050 0x7fcde80ff460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009870 tx=0x7fcdd8009b80 comp rx=0 tx=0).stop 2024-04-13T10:59:55.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.939+0000 7fcdecc1b700 1 -- 172.21.15.134:0/62170553 shutdown_connections 2024-04-13T10:59:55.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.939+0000 7fcdecc1b700 1 --2- 172.21.15.134:0/62170553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde8100250 0x7fcde81006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.939+0000 7fcdecc1b700 1 --2- 172.21.15.134:0/62170553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde80ff050 0x7fcde80ff460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.939+0000 7fcdecc1b700 1 -- 172.21.15.134:0/62170553 >> 172.21.15.134:0/62170553 conn(0x7fcde80fa600 msgr2=0x7fcde80fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:55.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.939+0000 7fcdecc1b700 1 -- 172.21.15.134:0/62170553 shutdown_connections 2024-04-13T10:59:55.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.939+0000 7fcdecc1b700 1 -- 172.21.15.134:0/62170553 wait complete. 2024-04-13T10:59:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.940+0000 7fcdecc1b700 1 Processor -- start 2024-04-13T10:59:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.940+0000 7fcdecc1b700 1 -- start start 2024-04-13T10:59:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.940+0000 7fcdecc1b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde80ff050 0x7fcde80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:55.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.940+0000 7fcdecc1b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde8100250 0x7fcde819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:55.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.940+0000 7fcdecc1b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde819abc0 con 0x7fcde80ff050 2024-04-13T10:59:55.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.940+0000 7fcdecc1b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde819ad30 con 0x7fcde8100250 2024-04-13T10:59:55.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.941+0000 7fcde659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde80ff050 0x7fcde80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:55.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.941+0000 7fcde659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde80ff050 0x7fcde80697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38028/0 (socket says 172.21.15.134:38028) 2024-04-13T10:59:55.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.941+0000 7fcde659c700 1 -- 172.21.15.134:0/2618636723 learned_addr learned my addr 172.21.15.134:0/2618636723 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:59:55.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.941+0000 7fcde659c700 1 -- 172.21.15.134:0/2618636723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde8100250 msgr2=0x7fcde819a5f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-13T10:59:55.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.941+0000 7fcde659c700 1 --2- 172.21.15.134:0/2618636723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde8100250 0x7fcde819a5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:55.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.941+0000 7fcde659c700 1 -- 172.21.15.134:0/2618636723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd8009520 con 0x7fcde80ff050 2024-04-13T10:59:55.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.941+0000 7fcde659c700 1 --2- 172.21.15.134:0/2618636723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde80ff050 0x7fcde80697e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800f690 tx=0x7fcdd800f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.942+0000 7fcdd77fe700 1 -- 172.21.15.134:0/2618636723 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd801c070 con 0x7fcde80ff050 2024-04-13T10:59:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.942+0000 7fcdd77fe700 1 -- 172.21.15.134:0/2618636723 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fcdd800fe50 con 0x7fcde80ff050 2024-04-13T10:59:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.942+0000 7fcdecc1b700 1 -- 172.21.15.134:0/2618636723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde819afb0 con 0x7fcde80ff050 2024-04-13T10:59:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.942+0000 7fcdecc1b700 1 -- 172.21.15.134:0/2618636723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde819b4d0 con 0x7fcde80ff050 2024-04-13T10:59:55.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.942+0000 7fcdd77fe700 1 -- 172.21.15.134:0/2618636723 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd80173f0 con 0x7fcde80ff050 2024-04-13T10:59:55.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.943+0000 7fcdecc1b700 1 -- 172.21.15.134:0/2618636723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc8005320 con 0x7fcde80ff050 2024-04-13T10:59:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.944+0000 7fcdd77fe700 1 -- 172.21.15.134:0/2618636723 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 30) v1 ==== 90946+0+0 (secure 0 0 0) 0x7fcdd8020070 con 0x7fcde80ff050 2024-04-13T10:59:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.945+0000 7fcdd77fe700 1 --2- 172.21.15.134:0/2618636723 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcdd006ce50 0x7fcdd006f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.945+0000 7fcdd77fe700 1 -- 172.21.15.134:0/2618636723 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fcdd808e280 con 0x7fcde80ff050 2024-04-13T10:59:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.945+0000 7fcde5d9b700 1 --2- 172.21.15.134:0/2618636723 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcdd006ce50 0x7fcdd006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:55.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.946+0000 7fcde5d9b700 1 --2- 172.21.15.134:0/2618636723 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcdd006ce50 0x7fcdd006f300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcddc005e50 tx=0x7fcddc005de0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:55.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:55.949+0000 7fcdd77fe700 1 -- 172.21.15.134:0/2618636723 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fcdd805be90 con 0x7fcde80ff050 2024-04-13T10:59:55.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:55 smithi194 ceph-mon[46737]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:55.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:55 smithi194 ceph-mon[46737]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:56.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.401+0000 7fcdecc1b700 1 -- 172.21.15.134:0/2618636723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcdc8005cc0 con 0x7fcde80ff050 2024-04-13T10:59:56.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.402+0000 7fcdd77fe700 1 -- 172.21.15.134:0/2618636723 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fcdd805ba20 con 0x7fcde80ff050 2024-04-13T10:59:56.402 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:59:56.402 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T10:59:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T10:59:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:59:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T10:59:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T10:59:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:59:56.403 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T10:59:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T10:59:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:59:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T10:59:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T10:59:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T10:59:56.404 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T10:59:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-04-13T10:59:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T10:59:56.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T10:59:56.405 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:59:56.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 -- 172.21.15.134:0/2618636723 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcdd006ce50 msgr2=0x7fcdd006f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:56.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 --2- 172.21.15.134:0/2618636723 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcdd006ce50 0x7fcdd006f300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcddc005e50 tx=0x7fcddc005de0 comp rx=0 tx=0).stop 2024-04-13T10:59:56.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 -- 172.21.15.134:0/2618636723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde80ff050 msgr2=0x7fcde80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:56.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 --2- 172.21.15.134:0/2618636723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde80ff050 0x7fcde80697e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800f690 tx=0x7fcdd800f770 comp rx=0 tx=0).stop 2024-04-13T10:59:56.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 -- 172.21.15.134:0/2618636723 shutdown_connections 2024-04-13T10:59:56.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 --2- 172.21.15.134:0/2618636723 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcdd006ce50 0x7fcdd006f300 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:56.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 --2- 172.21.15.134:0/2618636723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde80ff050 0x7fcde80697e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:56.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 --2- 172.21.15.134:0/2618636723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde8100250 0x7fcde819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:56.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 -- 172.21.15.134:0/2618636723 >> 172.21.15.134:0/2618636723 conn(0x7fcde80fa600 msgr2=0x7fcde8103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:56.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 -- 172.21.15.134:0/2618636723 shutdown_connections 2024-04-13T10:59:56.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.404+0000 7fcdecc1b700 1 -- 172.21.15.134:0/2618636723 wait complete. 2024-04-13T10:59:56.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.545+0000 7fb280785700 1 -- 172.21.15.134:0/2847953267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb278100250 msgr2=0x7fb2781006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:56.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.545+0000 7fb280785700 1 --2- 172.21.15.134:0/2847953267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb278100250 0x7fb2781006a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb268009910 tx=0x7fb268009c20 comp rx=0 tx=0).stop 2024-04-13T10:59:56.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.545+0000 7fb280785700 1 -- 172.21.15.134:0/2847953267 shutdown_connections 2024-04-13T10:59:56.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.545+0000 7fb280785700 1 --2- 172.21.15.134:0/2847953267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb278100250 0x7fb2781006a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:56.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.545+0000 7fb280785700 1 --2- 172.21.15.134:0/2847953267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2780ff050 0x7fb2780ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:56.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.545+0000 7fb280785700 1 -- 172.21.15.134:0/2847953267 >> 172.21.15.134:0/2847953267 conn(0x7fb2780fa5e0 msgr2=0x7fb2780fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:56.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.545+0000 7fb280785700 1 -- 172.21.15.134:0/2847953267 shutdown_connections 2024-04-13T10:59:56.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.545+0000 7fb280785700 1 -- 172.21.15.134:0/2847953267 wait complete. 2024-04-13T10:59:56.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.545+0000 7fb280785700 1 Processor -- start 2024-04-13T10:59:56.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb280785700 1 -- start start 2024-04-13T10:59:56.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb280785700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2780ff050 0x7fb278071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:56.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb280785700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb278100250 0x7fb278072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:56.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb280785700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780728f0 con 0x7fb278100250 2024-04-13T10:59:56.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb280785700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2781911c0 con 0x7fb2780ff050 2024-04-13T10:59:56.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb27dd20700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb278100250 0x7fb278072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb27dd20700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb278100250 0x7fb278072280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38052/0 (socket says 172.21.15.134:38052) 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb27dd20700 1 -- 172.21.15.134:0/1376787258 learned_addr learned my addr 172.21.15.134:0/1376787258 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb27e521700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2780ff050 0x7fb278071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb27dd20700 1 -- 172.21.15.134:0/1376787258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2780ff050 msgr2=0x7fb278071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb27dd20700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2780ff050 0x7fb278071d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb27dd20700 1 -- 172.21.15.134:0/1376787258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680095f0 con 0x7fb278100250 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.546+0000 7fb27dd20700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb278100250 0x7fb278072280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb268006010 tx=0x7fb26800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.547+0000 7fb26f7fe700 1 -- 172.21.15.134:0/1376787258 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26801d070 con 0x7fb278100250 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.547+0000 7fb26f7fe700 1 -- 172.21.15.134:0/1376787258 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fb26800f460 con 0x7fb278100250 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.547+0000 7fb26f7fe700 1 -- 172.21.15.134:0/1376787258 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb268021640 con 0x7fb278100250 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.547+0000 7fb280785700 1 -- 172.21.15.134:0/1376787258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2780683d0 con 0x7fb278100250 2024-04-13T10:59:56.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.547+0000 7fb280785700 1 -- 172.21.15.134:0/1376787258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb278068920 con 0x7fb278100250 2024-04-13T10:59:56.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.548+0000 7fb280785700 1 -- 172.21.15.134:0/1376787258 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb278107a60 con 0x7fb278100250 2024-04-13T10:59:56.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.549+0000 7fb26f7fe700 1 -- 172.21.15.134:0/1376787258 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 30) v1 ==== 90946+0+0 (secure 0 0 0) 0x7fb26800f940 con 0x7fb278100250 2024-04-13T10:59:56.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.549+0000 7fb26f7fe700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb26406ce20 0x7fb26406f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T10:59:56.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.550+0000 7fb26f7fe700 1 -- 172.21.15.134:0/1376787258 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb26808d8e0 con 0x7fb278100250 2024-04-13T10:59:56.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.550+0000 7fb27e521700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb26406ce20 0x7fb26406f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T10:59:56.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.550+0000 7fb27e521700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb26406ce20 0x7fb26406f2d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb274005fd0 tx=0x7fb274005f60 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T10:59:56.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.554+0000 7fb26f7fe700 1 -- 172.21.15.134:0/1376787258 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fb2680578b0 con 0x7fb278100250 2024-04-13T10:59:56.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.850+0000 7fb280785700 1 -- 172.21.15.134:0/1376787258 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb278104ba0 con 0x7fb26406ce20 2024-04-13T10:59:56.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.851+0000 7fb26f7fe700 1 -- 172.21.15.134:0/1376787258 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fb278104ba0 con 0x7fb26406ce20 2024-04-13T10:59:56.851 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T10:59:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T10:59:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T10:59:56.851 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-13T10:59:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T10:59:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-04-13T10:59:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T10:59:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/2 daemons upgraded", 2024-04-13T10:59:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-04-13T10:59:56.852 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T10:59:56.852 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T10:59:56.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 -- 172.21.15.134:0/1376787258 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb26406ce20 msgr2=0x7fb26406f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:56.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb26406ce20 0x7fb26406f2d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb274005fd0 tx=0x7fb274005f60 comp rx=0 tx=0).stop 2024-04-13T10:59:56.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 -- 172.21.15.134:0/1376787258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb278100250 msgr2=0x7fb278072280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T10:59:56.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb278100250 0x7fb278072280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb268006010 tx=0x7fb26800be20 comp rx=0 tx=0).stop 2024-04-13T10:59:56.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 -- 172.21.15.134:0/1376787258 shutdown_connections 2024-04-13T10:59:56.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb26406ce20 0x7fb26406f2d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:56.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2780ff050 0x7fb278071d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:56.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 --2- 172.21.15.134:0/1376787258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb278100250 0x7fb278072280 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T10:59:56.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 -- 172.21.15.134:0/1376787258 >> 172.21.15.134:0/1376787258 conn(0x7fb2780fa5e0 msgr2=0x7fb278103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T10:59:56.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 -- 172.21.15.134:0/1376787258 shutdown_connections 2024-04-13T10:59:56.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T10:59:56.854+0000 7fb280785700 1 -- 172.21.15.134:0/1376787258 wait complete. 2024-04-13T10:59:57.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:57 smithi134 ceph-mon[39696]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:57.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:57 smithi134 ceph-mon[39696]: pgmap v12: 65 pgs: 65 active+clean; 653 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-04-13T10:59:57.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:57 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2618636723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:59:57.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:57 smithi194 ceph-mon[46737]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:57.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:57 smithi194 ceph-mon[46737]: pgmap v12: 65 pgs: 65 active+clean; 653 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-04-13T10:59:57.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:57 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/2618636723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T10:59:58.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:58 smithi134 ceph-mon[39696]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:58.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:58 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:58.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:58 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:58 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:59:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:58 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:59:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:58 smithi194 ceph-mon[46737]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T10:59:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:58 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:58 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T10:59:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:58 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:59:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:58 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T10:59:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:59 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:59:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 10:59:59 smithi134 ceph-mon[39696]: pgmap v13: 65 pgs: 65 active+clean; 653 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 132 op/s 2024-04-13T10:59:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:59 smithi194 ceph-mon[46737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T10:59:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 10:59:59 smithi194 ceph-mon[46737]: pgmap v13: 65 pgs: 65 active+clean; 653 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 132 op/s 2024-04-13T11:00:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:00 smithi134 ceph-mon[39696]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:00:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:00 smithi134 ceph-mon[39696]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:00:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:00 smithi134 ceph-mon[39696]: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:00:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:00 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.tcpynt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T11:00:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:00 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T11:00:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:00 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:00:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:00 smithi194 ceph-mon[46737]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:00:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:00 smithi194 ceph-mon[46737]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:00:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:00 smithi194 ceph-mon[46737]: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:00:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:00 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi194.tcpynt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-13T11:00:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:00 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-13T11:00:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:00 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:00:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:01 smithi134 ceph-mon[39696]: pgmap v14: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 206 op/s 2024-04-13T11:00:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:01 smithi134 ceph-mon[39696]: Upgrade: Updating mgr.smithi194.tcpynt 2024-04-13T11:00:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:01 smithi134 ceph-mon[39696]: Deploying daemon mgr.smithi194.tcpynt on smithi194 2024-04-13T11:00:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:01 smithi194 ceph-mon[46737]: pgmap v14: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 206 op/s 2024-04-13T11:00:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:01 smithi194 ceph-mon[46737]: Upgrade: Updating mgr.smithi194.tcpynt 2024-04-13T11:00:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:01 smithi194 ceph-mon[46737]: Deploying daemon mgr.smithi194.tcpynt on smithi194 2024-04-13T11:00:03.640 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:03 smithi194 ceph-mon[46737]: pgmap v15: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-04-13T11:00:03.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:03 smithi134 ceph-mon[39696]: pgmap v15: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-04-13T11:00:05.719 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:05 smithi194 ceph-mon[46737]: pgmap v16: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-04-13T11:00:05.719 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:05 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:05.719 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:05 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:05.719 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:05 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:00:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:05 smithi134 ceph-mon[39696]: pgmap v16: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 137 op/s 2024-04-13T11:00:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:05 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:05 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:05 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:00:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:07 smithi134 ceph-mon[39696]: pgmap v17: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 190 op/s 2024-04-13T11:00:07.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:07 smithi194 ceph-mon[46737]: pgmap v17: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 190 op/s 2024-04-13T11:00:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:08 smithi194 ceph-mon[46737]: pgmap v18: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 127 op/s 2024-04-13T11:00:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:08 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:08 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:08 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:00:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:08 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:08 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:09.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:08 smithi134 ceph-mon[39696]: pgmap v18: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 127 op/s 2024-04-13T11:00:09.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:08 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:09.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:08 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:09.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:08 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:00:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:08 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:08 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:10 smithi194 ceph-mon[46737]: pgmap v19: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 191 op/s 2024-04-13T11:00:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:10 smithi134 ceph-mon[39696]: pgmap v19: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 191 op/s 2024-04-13T11:00:12.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:12 smithi134 ceph-mon[39696]: Standby manager daemon smithi194.tcpynt restarted 2024-04-13T11:00:12.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:12 smithi134 ceph-mon[39696]: Standby manager daemon smithi194.tcpynt started 2024-04-13T11:00:12.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:12 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/4151798448' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/crt"}]: dispatch 2024-04-13T11:00:12.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:12 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/4151798448' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T11:00:12.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:12 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/4151798448' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/key"}]: dispatch 2024-04-13T11:00:12.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:12 smithi134 ceph-mon[39696]: from='mgr.? 172.21.15.194:0/4151798448' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T11:00:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:12 smithi194 ceph-mon[46737]: Standby manager daemon smithi194.tcpynt restarted 2024-04-13T11:00:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:12 smithi194 ceph-mon[46737]: Standby manager daemon smithi194.tcpynt started 2024-04-13T11:00:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:12 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/4151798448' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/crt"}]: dispatch 2024-04-13T11:00:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:12 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/4151798448' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-13T11:00:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:12 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/4151798448' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi194.tcpynt/key"}]: dispatch 2024-04-13T11:00:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:12 smithi194 ceph-mon[46737]: from='mgr.? 172.21.15.194:0/4151798448' entity='mgr.smithi194.tcpynt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-13T11:00:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: pgmap v20: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2024-04-13T11:00:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: mgrmap e31: smithi134.tmanda(active, since 34s), standbys: smithi194.tcpynt 2024-04-13T11:00:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.tmanda"}]: dispatch 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.tmanda"}]': finished 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.tcpynt"}]: dispatch 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.tcpynt"}]': finished 2024-04-13T11:00:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:13 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: pgmap v20: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2024-04-13T11:00:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: mgrmap e31: smithi134.tmanda(active, since 34s), standbys: smithi194.tcpynt 2024-04-13T11:00:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.tmanda"}]: dispatch 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.tmanda"}]': finished 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.tcpynt"}]: dispatch 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi194.tcpynt"}]': finished 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:13.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:13.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:13 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:14.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:14 smithi134 ceph-mon[39696]: Upgrade: Setting container_image for all mgr 2024-04-13T11:00:14.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:14 smithi134 ceph-mon[39696]: Upgrade: Setting container_image for all rgw 2024-04-13T11:00:14.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:14 smithi134 ceph-mon[39696]: Upgrade: Setting container_image for all rbd-mirror 2024-04-13T11:00:14.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:14 smithi134 ceph-mon[39696]: Upgrade: Setting container_image for all cephfs-mirror 2024-04-13T11:00:14.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:14 smithi134 ceph-mon[39696]: Upgrade: Setting container_image for all iscsi 2024-04-13T11:00:14.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:14 smithi134 ceph-mon[39696]: Upgrade: Setting container_image for all nfs 2024-04-13T11:00:14.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:14 smithi134 ceph-mon[39696]: Upgrade: Setting container_image for all nvmeof 2024-04-13T11:00:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:14 smithi194 ceph-mon[46737]: Upgrade: Setting container_image for all mgr 2024-04-13T11:00:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:14 smithi194 ceph-mon[46737]: Upgrade: Setting container_image for all rgw 2024-04-13T11:00:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:14 smithi194 ceph-mon[46737]: Upgrade: Setting container_image for all rbd-mirror 2024-04-13T11:00:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:14 smithi194 ceph-mon[46737]: Upgrade: Setting container_image for all cephfs-mirror 2024-04-13T11:00:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:14 smithi194 ceph-mon[46737]: Upgrade: Setting container_image for all iscsi 2024-04-13T11:00:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:14 smithi194 ceph-mon[46737]: Upgrade: Setting container_image for all nfs 2024-04-13T11:00:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:14 smithi194 ceph-mon[46737]: Upgrade: Setting container_image for all nvmeof 2024-04-13T11:00:15.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:15 smithi134 ceph-mon[39696]: pgmap v21: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2024-04-13T11:00:15.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:15 smithi194 ceph-mon[46737]: pgmap v21: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 117 op/s 2024-04-13T11:00:16.680 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:16 smithi134 ceph-mon[39696]: Upgrade: Updating node-exporter.smithi134 (1/2) 2024-04-13T11:00:16.680 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:16 smithi134 ceph-mon[39696]: Deploying daemon node-exporter.smithi134 on smithi134 2024-04-13T11:00:16.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:16 smithi194 ceph-mon[46737]: Upgrade: Updating node-exporter.smithi134 (1/2) 2024-04-13T11:00:16.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:16 smithi194 ceph-mon[46737]: Deploying daemon node-exporter.smithi134 on smithi134 2024-04-13T11:00:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:17 smithi134 ceph-mon[39696]: pgmap v22: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 186 op/s 2024-04-13T11:00:17.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:17 smithi194 ceph-mon[46737]: pgmap v22: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 186 op/s 2024-04-13T11:00:19.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:19 smithi134 ceph-mon[39696]: pgmap v23: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 134 op/s 2024-04-13T11:00:19.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:19 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:19.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:19 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:19 smithi194 ceph-mon[46737]: pgmap v23: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 134 op/s 2024-04-13T11:00:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:19 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:19 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:21.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:21 smithi134 ceph-mon[39696]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 350 op/s 2024-04-13T11:00:21.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:21 smithi134 ceph-mon[39696]: Upgrade: Updating node-exporter.smithi194 (2/2) 2024-04-13T11:00:21.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:21 smithi134 ceph-mon[39696]: Deploying daemon node-exporter.smithi194 on smithi194 2024-04-13T11:00:21.463 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:21 smithi194 ceph-mon[46737]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 350 op/s 2024-04-13T11:00:21.463 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:21 smithi194 ceph-mon[46737]: Upgrade: Updating node-exporter.smithi194 (2/2) 2024-04-13T11:00:21.463 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:21 smithi194 ceph-mon[46737]: Deploying daemon node-exporter.smithi194 on smithi194 2024-04-13T11:00:23.664 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-13T11:00:23.664 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-13T11:00:23.702 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:23 smithi194 ceph-mon[46737]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 285 op/s 2024-04-13T11:00:23.703 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:23 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:23.703 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:23 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:23.703 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:23 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:00:23.703 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:23 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:00:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:23 smithi134 ceph-mon[39696]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 285 op/s 2024-04-13T11:00:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:23 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:23 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:23 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:00:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:23 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:00:24.014 DEBUG:teuthology.parallel:result is None 2024-04-13T11:00:25.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:25 smithi134 ceph-mon[39696]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 285 op/s 2024-04-13T11:00:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:25 smithi194 ceph-mon[46737]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 285 op/s 2024-04-13T11:00:27.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.004+0000 7f863e69f700 1 -- 172.21.15.134:0/2672441509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8638100250 msgr2=0x7f86381006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:27.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.004+0000 7f863e69f700 1 --2- 172.21.15.134:0/2672441509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8638100250 0x7f86381006a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f862c009910 tx=0x7f862c009c20 comp rx=0 tx=0).stop 2024-04-13T11:00:27.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.004+0000 7f863e69f700 1 -- 172.21.15.134:0/2672441509 shutdown_connections 2024-04-13T11:00:27.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.004+0000 7f863e69f700 1 --2- 172.21.15.134:0/2672441509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8638100250 0x7f86381006a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.004+0000 7f863e69f700 1 --2- 172.21.15.134:0/2672441509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86380ff050 0x7f86380ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.004+0000 7f863e69f700 1 -- 172.21.15.134:0/2672441509 >> 172.21.15.134:0/2672441509 conn(0x7f86380fa5e0 msgr2=0x7f86380fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:27.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.004+0000 7f863e69f700 1 -- 172.21.15.134:0/2672441509 shutdown_connections 2024-04-13T11:00:27.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.004+0000 7f863e69f700 1 -- 172.21.15.134:0/2672441509 wait complete. 2024-04-13T11:00:27.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.005+0000 7f863e69f700 1 Processor -- start 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.005+0000 7f863e69f700 1 -- start start 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.005+0000 7f863e69f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86380ff050 0x7f863810b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.005+0000 7f863e69f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8638100250 0x7f863810b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.005+0000 7f863e69f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8638107b00 con 0x7f86380ff050 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.005+0000 7f863e69f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8638107c70 con 0x7f8638100250 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.005+0000 7f8637fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86380ff050 0x7f863810b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.005+0000 7f8637fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86380ff050 0x7f863810b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55966/0 (socket says 172.21.15.134:55966) 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.005+0000 7f8637fff700 1 -- 172.21.15.134:0/2552305414 learned_addr learned my addr 172.21.15.134:0/2552305414 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.005+0000 7f86377fe700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8638100250 0x7f863810b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.006+0000 7f8637fff700 1 -- 172.21.15.134:0/2552305414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8638100250 msgr2=0x7f863810b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.006+0000 7f8637fff700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8638100250 0x7f863810b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.006+0000 7f8637fff700 1 -- 172.21.15.134:0/2552305414 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c0095f0 con 0x7f86380ff050 2024-04-13T11:00:27.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.006+0000 7f8637fff700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86380ff050 0x7f863810b010 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f862800e8f0 tx=0x7f862800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.006+0000 7f86357fa700 1 -- 172.21.15.134:0/2552305414 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8628009790 con 0x7f86380ff050 2024-04-13T11:00:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.006+0000 7f86357fa700 1 -- 172.21.15.134:0/2552305414 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f862800c810 con 0x7f86380ff050 2024-04-13T11:00:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.006+0000 7f86357fa700 1 -- 172.21.15.134:0/2552305414 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8628003c20 con 0x7f86380ff050 2024-04-13T11:00:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.007+0000 7f863e69f700 1 -- 172.21.15.134:0/2552305414 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8638107f50 con 0x7f86380ff050 2024-04-13T11:00:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.007+0000 7f863e69f700 1 -- 172.21.15.134:0/2552305414 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8638108520 con 0x7f86380ff050 2024-04-13T11:00:27.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.008+0000 7f863e69f700 1 -- 172.21.15.134:0/2552305414 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8638106950 con 0x7f86380ff050 2024-04-13T11:00:27.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.014+0000 7f86357fa700 1 -- 172.21.15.134:0/2552305414 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f862800c980 con 0x7f86380ff050 2024-04-13T11:00:27.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.015+0000 7f86357fa700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862006ce20 0x7f862006f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:27.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.015+0000 7f86357fa700 1 -- 172.21.15.134:0/2552305414 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f8628014070 con 0x7f86380ff050 2024-04-13T11:00:27.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.015+0000 7f86377fe700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862006ce20 0x7f862006f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:27.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.015+0000 7f86357fa700 1 -- 172.21.15.134:0/2552305414 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f862808d0c0 con 0x7f86380ff050 2024-04-13T11:00:27.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.016+0000 7f86377fe700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862006ce20 0x7f862006f2d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f862c00b600 tx=0x7f862c005fd0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:27.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.293+0000 7f863e69f700 1 -- 172.21.15.134:0/2552305414 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f86381047a0 con 0x7f862006ce20 2024-04-13T11:00:27.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.294+0000 7f86357fa700 1 -- 172.21.15.134:0/2552305414 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f86381047a0 con 0x7f862006ce20 2024-04-13T11:00:27.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.297+0000 7f863e69f700 1 -- 172.21.15.134:0/2552305414 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862006ce20 msgr2=0x7f862006f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:27.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.297+0000 7f863e69f700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862006ce20 0x7f862006f2d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f862c00b600 tx=0x7f862c005fd0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.297+0000 7f863e69f700 1 -- 172.21.15.134:0/2552305414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86380ff050 msgr2=0x7f863810b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:27.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.297+0000 7f863e69f700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86380ff050 0x7f863810b010 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f862800e8f0 tx=0x7f862800ec00 comp rx=0 tx=0).stop 2024-04-13T11:00:27.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.298+0000 7f863e69f700 1 -- 172.21.15.134:0/2552305414 shutdown_connections 2024-04-13T11:00:27.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.298+0000 7f863e69f700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862006ce20 0x7f862006f2d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.298+0000 7f863e69f700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86380ff050 0x7f863810b010 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.298+0000 7f863e69f700 1 --2- 172.21.15.134:0/2552305414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8638100250 0x7f863810b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.298+0000 7f863e69f700 1 -- 172.21.15.134:0/2552305414 >> 172.21.15.134:0/2552305414 conn(0x7f86380fa5e0 msgr2=0x7f86380fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:27.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.298+0000 7f863e69f700 1 -- 172.21.15.134:0/2552305414 shutdown_connections 2024-04-13T11:00:27.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.298+0000 7f863e69f700 1 -- 172.21.15.134:0/2552305414 wait complete. 2024-04-13T11:00:27.311 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:00:27.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.435+0000 7f02d075d700 1 -- 172.21.15.134:0/214338928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c8071c50 msgr2=0x7f02c8072060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:27.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.435+0000 7f02d075d700 1 --2- 172.21.15.134:0/214338928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c8071c50 0x7f02c8072060 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f02c400aa20 tx=0x7f02c400ad30 comp rx=0 tx=0).stop 2024-04-13T11:00:27.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.435+0000 7f02d075d700 1 -- 172.21.15.134:0/214338928 shutdown_connections 2024-04-13T11:00:27.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.435+0000 7f02d075d700 1 --2- 172.21.15.134:0/214338928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02c8074f80 0x7f02c8077400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.435+0000 7f02d075d700 1 --2- 172.21.15.134:0/214338928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c8071c50 0x7f02c8072060 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.435+0000 7f02d075d700 1 -- 172.21.15.134:0/214338928 >> 172.21.15.134:0/214338928 conn(0x7f02c806d050 msgr2=0x7f02c806f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:27.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.435+0000 7f02d075d700 1 -- 172.21.15.134:0/214338928 shutdown_connections 2024-04-13T11:00:27.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.435+0000 7f02d075d700 1 -- 172.21.15.134:0/214338928 wait complete. 2024-04-13T11:00:27.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.436+0000 7f02d075d700 1 Processor -- start 2024-04-13T11:00:27.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.436+0000 7f02d075d700 1 -- start start 2024-04-13T11:00:27.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.436+0000 7f02d075d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02c8071c50 0x7f02c80822a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:27.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.436+0000 7f02d075d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c8074f80 0x7f02c80827e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:27.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.436+0000 7f02d075d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c8083d30 con 0x7f02c8074f80 2024-04-13T11:00:27.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.436+0000 7f02d075d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c8082d20 con 0x7f02c8071c50 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02cdcf8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c8074f80 0x7f02c80827e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02ce4f9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02c8071c50 0x7f02c80822a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02ce4f9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02c8071c50 0x7f02c80822a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.134:56408/0 (socket says 172.21.15.134:56408) 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02cdcf8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c8074f80 0x7f02c80827e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55988/0 (socket says 172.21.15.134:55988) 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02ce4f9700 1 -- 172.21.15.134:0/4187443069 learned_addr learned my addr 172.21.15.134:0/4187443069 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02cdcf8700 1 -- 172.21.15.134:0/4187443069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02c8071c50 msgr2=0x7f02c80822a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02cdcf8700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02c8071c50 0x7f02c80822a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02cdcf8700 1 -- 172.21.15.134:0/4187443069 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c400a700 con 0x7f02c8074f80 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02ce4f9700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02c8071c50 0x7f02c80822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02cdcf8700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c8074f80 0x7f02c80827e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f02b800b3d0 tx=0x7f02b800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02bf7fe700 1 -- 172.21.15.134:0/4187443069 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02b8011800 con 0x7f02c8074f80 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02d075d700 1 -- 172.21.15.134:0/4187443069 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c8083000 con 0x7f02c8074f80 2024-04-13T11:00:27.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02bf7fe700 1 -- 172.21.15.134:0/4187443069 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f02b800be90 con 0x7f02c8074f80 2024-04-13T11:00:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02bf7fe700 1 -- 172.21.15.134:0/4187443069 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02b8010db0 con 0x7f02c8074f80 2024-04-13T11:00:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.437+0000 7f02d075d700 1 -- 172.21.15.134:0/4187443069 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c81b4ef0 con 0x7f02c8074f80 2024-04-13T11:00:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.438+0000 7f02d075d700 1 -- 172.21.15.134:0/4187443069 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c807c5e0 con 0x7f02c8074f80 2024-04-13T11:00:27.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.440+0000 7f02bf7fe700 1 -- 172.21.15.134:0/4187443069 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f02b8011960 con 0x7f02c8074f80 2024-04-13T11:00:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.440+0000 7f02bf7fe700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f02b406ce10 0x7f02b406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.440+0000 7f02bf7fe700 1 -- 172.21.15.134:0/4187443069 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f02b808c4f0 con 0x7f02c8074f80 2024-04-13T11:00:27.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.441+0000 7f02ce4f9700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f02b406ce10 0x7f02b406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:27.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.441+0000 7f02ce4f9700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f02b406ce10 0x7f02b406f2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f02c400afd0 tx=0x7f02c400cf90 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.445+0000 7f02bf7fe700 1 -- 172.21.15.134:0/4187443069 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f02b805a110 con 0x7f02c8074f80 2024-04-13T11:00:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:27 smithi134 ceph-mon[39696]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 570 op/s 2024-04-13T11:00:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:27 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:27 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:27 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:27 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:27 smithi194 ceph-mon[46737]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 570 op/s 2024-04-13T11:00:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:27 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:27 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:27 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:27 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:27.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.801+0000 7f02d075d700 1 -- 172.21.15.134:0/4187443069 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02c8061190 con 0x7f02b406ce10 2024-04-13T11:00:27.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.803+0000 7f02bf7fe700 1 -- 172.21.15.134:0/4187443069 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f02c8061190 con 0x7f02b406ce10 2024-04-13T11:00:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 -- 172.21.15.134:0/4187443069 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f02b406ce10 msgr2=0x7f02b406f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f02b406ce10 0x7f02b406f2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f02c400afd0 tx=0x7f02c400cf90 comp rx=0 tx=0).stop 2024-04-13T11:00:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 -- 172.21.15.134:0/4187443069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c8074f80 msgr2=0x7f02c80827e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:27.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c8074f80 0x7f02c80827e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f02b800b3d0 tx=0x7f02b800b6e0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 -- 172.21.15.134:0/4187443069 shutdown_connections 2024-04-13T11:00:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f02b406ce10 0x7f02b406f2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02c8071c50 0x7f02c80822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 --2- 172.21.15.134:0/4187443069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02c8074f80 0x7f02c80827e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 -- 172.21.15.134:0/4187443069 >> 172.21.15.134:0/4187443069 conn(0x7f02c806d050 msgr2=0x7f02c8076ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 -- 172.21.15.134:0/4187443069 shutdown_connections 2024-04-13T11:00:27.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.808+0000 7f02d075d700 1 -- 172.21.15.134:0/4187443069 wait complete. 2024-04-13T11:00:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.946+0000 7fa4e284e700 1 -- 172.21.15.134:0/212862847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4dc101370 msgr2=0x7fa4dc1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.946+0000 7fa4e284e700 1 --2- 172.21.15.134:0/212862847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4dc101370 0x7fa4dc1017c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009910 tx=0x7fa4d0009c20 comp rx=0 tx=0).stop 2024-04-13T11:00:27.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.946+0000 7fa4e284e700 1 -- 172.21.15.134:0/212862847 shutdown_connections 2024-04-13T11:00:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.947+0000 7fa4e284e700 1 --2- 172.21.15.134:0/212862847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4dc101370 0x7fa4dc1017c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.947+0000 7fa4e284e700 1 --2- 172.21.15.134:0/212862847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc100170 0x7fa4dc100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.947+0000 7fa4e284e700 1 -- 172.21.15.134:0/212862847 >> 172.21.15.134:0/212862847 conn(0x7fa4dc0fb720 msgr2=0x7fa4dc0fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:27.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.947+0000 7fa4e284e700 1 -- 172.21.15.134:0/212862847 shutdown_connections 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.947+0000 7fa4e284e700 1 -- 172.21.15.134:0/212862847 wait complete. 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.947+0000 7fa4e284e700 1 Processor -- start 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.947+0000 7fa4e284e700 1 -- start start 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.948+0000 7fa4e284e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc100170 0x7fa4dc195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.948+0000 7fa4e284e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4dc101370 0x7fa4dc195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.948+0000 7fa4e284e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc1963d0 con 0x7fa4dc101370 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.948+0000 7fa4e284e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc196510 con 0x7fa4dc100170 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.948+0000 7fa4db7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4dc101370 0x7fa4dc195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.948+0000 7fa4db7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4dc101370 0x7fa4dc195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56012/0 (socket says 172.21.15.134:56012) 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.948+0000 7fa4db7fe700 1 -- 172.21.15.134:0/719797311 learned_addr learned my addr 172.21.15.134:0/719797311 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:00:27.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.948+0000 7fa4dbfff700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc100170 0x7fa4dc195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.949+0000 7fa4dbfff700 1 -- 172.21.15.134:0/719797311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4dc101370 msgr2=0x7fa4dc195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.949+0000 7fa4dbfff700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4dc101370 0x7fa4dc195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.949+0000 7fa4dbfff700 1 -- 172.21.15.134:0/719797311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00095f0 con 0x7fa4dc100170 2024-04-13T11:00:27.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.949+0000 7fa4db7fe700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4dc101370 0x7fa4dc195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T11:00:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.949+0000 7fa4dbfff700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc100170 0x7fa4dc195870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00e940 tx=0x7fa4cc00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.949+0000 7fa4d97fa700 1 -- 172.21.15.134:0/719797311 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4cc0041f0 con 0x7fa4dc100170 2024-04-13T11:00:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.949+0000 7fa4e284e700 1 -- 172.21.15.134:0/719797311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc19afc0 con 0x7fa4dc100170 2024-04-13T11:00:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.949+0000 7fa4d97fa700 1 -- 172.21.15.134:0/719797311 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fa4cc004350 con 0x7fa4dc100170 2024-04-13T11:00:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.949+0000 7fa4d97fa700 1 -- 172.21.15.134:0/719797311 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4cc003c10 con 0x7fa4dc100170 2024-04-13T11:00:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.949+0000 7fa4e284e700 1 -- 172.21.15.134:0/719797311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc19b500 con 0x7fa4dc100170 2024-04-13T11:00:27.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.950+0000 7fa4e284e700 1 -- 172.21.15.134:0/719797311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc108b80 con 0x7fa4dc100170 2024-04-13T11:00:27.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.951+0000 7fa4d97fa700 1 -- 172.21.15.134:0/719797311 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 31) v1 ==== 90946+0+0 (secure 0 0 0) 0x7fa4cc00c7c0 con 0x7fa4dc100170 2024-04-13T11:00:27.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.951+0000 7fa4d97fa700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa4c406ce10 0x7fa4c406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:27.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.951+0000 7fa4d97fa700 1 -- 172.21.15.134:0/719797311 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa4cc014070 con 0x7fa4dc100170 2024-04-13T11:00:27.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.952+0000 7fa4db7fe700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa4c406ce10 0x7fa4c406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:27.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.952+0000 7fa4db7fe700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa4c406ce10 0x7fa4c406f2c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009fd0 tx=0x7fa4d000b5a0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:27.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:27.956+0000 7fa4d97fa700 1 -- 172.21.15.134:0/719797311 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fa4cc05a430 con 0x7fa4dc100170 2024-04-13T11:00:28.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.219+0000 7fa4e284e700 1 -- 172.21.15.134:0/719797311 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4dc105cc0 con 0x7fa4c406ce10 2024-04-13T11:00:28.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.231+0000 7fa4d97fa700 1 -- 172.21.15.134:0/719797311 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fa4dc105cc0 con 0x7fa4c406ce10 2024-04-13T11:00:28.231 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:00:28.231 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (9m) 15s ago 10m 25.2M - 0.25.0 c8568f914cd2 8d2cf34cad2a 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (11m) 15s ago 11m 7902k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (9m) 1s ago 9m 7549k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (10m) 15s ago 10m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (9m) 1s ago 9m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (8m) 15s ago 10m 89.2M - 9.4.7 954c08fa6188 1038718f4fd4 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (4m) 15s ago 4m 257M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (4m) 15s ago 4m 241M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (4m) 1s ago 4m 14.4M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (4m) 1s ago 4m 18.3M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (117s) 15s ago 12m 490M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (24s) 1s ago 9m 449M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (12m) 15s ago 12m 51.9M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (9m) 1s ago 9m 45.5M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T11:00:28.232 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 starting - - - - 2024-04-13T11:00:28.233 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (6s) 1s ago 9m 3414k - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:00:28.233 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (8m) 15s ago 8m 198M 1227M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T11:00:28.233 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (8m) 15s ago 8m 194M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T11:00:28.233 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (7m) 15s ago 7m 161M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T11:00:28.233 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (7m) 1s ago 7m 251M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T11:00:28.233 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (6m) 1s ago 6m 208M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:00:28.233 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (6m) 1s ago 6m 205M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:00:28.233 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (31s) 15s ago 10m 49.3M - 2.43.0 a07b618ecd1d 84f8408ccf25 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 -- 172.21.15.134:0/719797311 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa4c406ce10 msgr2=0x7fa4c406f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa4c406ce10 0x7fa4c406f2c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009fd0 tx=0x7fa4d000b5a0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 -- 172.21.15.134:0/719797311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc100170 msgr2=0x7fa4dc195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc100170 0x7fa4dc195870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00e940 tx=0x7fa4cc00ec50 comp rx=0 tx=0).stop 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 -- 172.21.15.134:0/719797311 shutdown_connections 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa4c406ce10 0x7fa4c406f2c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4dc100170 0x7fa4dc195870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 --2- 172.21.15.134:0/719797311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4dc101370 0x7fa4dc195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 -- 172.21.15.134:0/719797311 >> 172.21.15.134:0/719797311 conn(0x7fa4dc0fb720 msgr2=0x7fa4dc1045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 -- 172.21.15.134:0/719797311 shutdown_connections 2024-04-13T11:00:28.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.233+0000 7fa4e284e700 1 -- 172.21.15.134:0/719797311 wait complete. 2024-04-13T11:00:28.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.362+0000 7fc7e4a94700 1 -- 172.21.15.134:0/2506189244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e0100270 msgr2=0x7fc7e01006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:28.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.362+0000 7fc7e4a94700 1 --2- 172.21.15.134:0/2506189244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e0100270 0x7fc7e01006c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009910 tx=0x7fc7d4009c20 comp rx=0 tx=0).stop 2024-04-13T11:00:28.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.362+0000 7fc7e4a94700 1 -- 172.21.15.134:0/2506189244 shutdown_connections 2024-04-13T11:00:28.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.362+0000 7fc7e4a94700 1 --2- 172.21.15.134:0/2506189244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e0100270 0x7fc7e01006c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.362+0000 7fc7e4a94700 1 --2- 172.21.15.134:0/2506189244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00ff070 0x7fc7e00ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.362+0000 7fc7e4a94700 1 -- 172.21.15.134:0/2506189244 >> 172.21.15.134:0/2506189244 conn(0x7fc7e00fa600 msgr2=0x7fc7e00fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:28.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.362+0000 7fc7e4a94700 1 -- 172.21.15.134:0/2506189244 shutdown_connections 2024-04-13T11:00:28.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.362+0000 7fc7e4a94700 1 -- 172.21.15.134:0/2506189244 wait complete. 2024-04-13T11:00:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.363+0000 7fc7e4a94700 1 Processor -- start 2024-04-13T11:00:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.363+0000 7fc7e4a94700 1 -- start start 2024-04-13T11:00:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.363+0000 7fc7e4a94700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00ff070 0x7fc7e0069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.363+0000 7fc7e4a94700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e0100270 0x7fc7e019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.363+0000 7fc7e4a94700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0196470 con 0x7fc7e0100270 2024-04-13T11:00:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.363+0000 7fc7e4a94700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e019cf40 con 0x7fc7e00ff070 2024-04-13T11:00:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.363+0000 7fc7ddd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e0100270 0x7fc7e019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.363+0000 7fc7ddd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e0100270 0x7fc7e019ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56036/0 (socket says 172.21.15.134:56036) 2024-04-13T11:00:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.363+0000 7fc7ddd9b700 1 -- 172.21.15.134:0/1847409131 learned_addr learned my addr 172.21.15.134:0/1847409131 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:00:28.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.363+0000 7fc7de59c700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00ff070 0x7fc7e0069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:28.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.364+0000 7fc7ddd9b700 1 -- 172.21.15.134:0/1847409131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00ff070 msgr2=0x7fc7e0069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:28.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.364+0000 7fc7ddd9b700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00ff070 0x7fc7e0069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.364+0000 7fc7ddd9b700 1 -- 172.21.15.134:0/1847409131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d40095f0 con 0x7fc7e0100270 2024-04-13T11:00:28.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.364+0000 7fc7de59c700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00ff070 0x7fc7e0069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T11:00:28.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.364+0000 7fc7ddd9b700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e0100270 0x7fc7e019ca00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400bda0 tx=0x7fc7d400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:28.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.364+0000 7fc7cf7fe700 1 -- 172.21.15.134:0/1847409131 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7d401d070 con 0x7fc7e0100270 2024-04-13T11:00:28.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.364+0000 7fc7cf7fe700 1 -- 172.21.15.134:0/1847409131 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7fc7d400f460 con 0x7fc7e0100270 2024-04-13T11:00:28.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.364+0000 7fc7cf7fe700 1 -- 172.21.15.134:0/1847409131 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7d4022650 con 0x7fc7e0100270 2024-04-13T11:00:28.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.364+0000 7fc7e4a94700 1 -- 172.21.15.134:0/1847409131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e019d190 con 0x7fc7e0100270 2024-04-13T11:00:28.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.364+0000 7fc7e4a94700 1 -- 172.21.15.134:0/1847409131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e019d6b0 con 0x7fc7e0100270 2024-04-13T11:00:28.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.365+0000 7fc7e4a94700 1 -- 172.21.15.134:0/1847409131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e0107bd0 con 0x7fc7e0100270 2024-04-13T11:00:28.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.371+0000 7fc7cf7fe700 1 -- 172.21.15.134:0/1847409131 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90946+0+0 (secure 0 0 0) 0x7fc7d400fa20 con 0x7fc7e0100270 2024-04-13T11:00:28.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.371+0000 7fc7cf7fe700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c806ce20 0x7fc7c806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:28.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.372+0000 7fc7cf7fe700 1 -- 172.21.15.134:0/1847409131 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc7d408dfa0 con 0x7fc7e0100270 2024-04-13T11:00:28.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.372+0000 7fc7de59c700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c806ce20 0x7fc7c806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:28.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.372+0000 7fc7cf7fe700 1 -- 172.21.15.134:0/1847409131 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fc7d408e4d0 con 0x7fc7e0100270 2024-04-13T11:00:28.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.372+0000 7fc7de59c700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c806ce20 0x7fc7c806f2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc7e01000d0 tx=0x7fc7d000b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:28.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:28 smithi194 ceph-mon[46737]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:00:28.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.781+0000 7fc7e4a94700 1 -- 172.21.15.134:0/1847409131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc7e019ddb0 con 0x7fc7e0100270 2024-04-13T11:00:28.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.781+0000 7fc7cf7fe700 1 -- 172.21.15.134:0/1847409131 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fc7d405ba00 con 0x7fc7e0100270 2024-04-13T11:00:28.782 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:00:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:00:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:00:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:00:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-04-13T11:00:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:00:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:00:28.784 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 -- 172.21.15.134:0/1847409131 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c806ce20 msgr2=0x7fc7c806f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c806ce20 0x7fc7c806f2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc7e01000d0 tx=0x7fc7d000b410 comp rx=0 tx=0).stop 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 -- 172.21.15.134:0/1847409131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e0100270 msgr2=0x7fc7e019ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e0100270 0x7fc7e019ca00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400bda0 tx=0x7fc7d400bdd0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 -- 172.21.15.134:0/1847409131 shutdown_connections 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c806ce20 0x7fc7c806f2d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00ff070 0x7fc7e0069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 --2- 172.21.15.134:0/1847409131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7e0100270 0x7fc7e019ca00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 -- 172.21.15.134:0/1847409131 >> 172.21.15.134:0/1847409131 conn(0x7fc7e00fa600 msgr2=0x7fc7e01034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 -- 172.21.15.134:0/1847409131 shutdown_connections 2024-04-13T11:00:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.784+0000 7fc7e4a94700 1 -- 172.21.15.134:0/1847409131 wait complete. 2024-04-13T11:00:28.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.917+0000 7f2a58b41700 1 -- 172.21.15.134:0/1815258691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a540fe410 msgr2=0x7f2a540fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:28.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.917+0000 7f2a58b41700 1 --2- 172.21.15.134:0/1815258691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a540fe410 0x7f2a540fe820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009870 tx=0x7f2a44009b80 comp rx=0 tx=0).stop 2024-04-13T11:00:28.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.917+0000 7f2a58b41700 1 -- 172.21.15.134:0/1815258691 shutdown_connections 2024-04-13T11:00:28.918 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.917+0000 7f2a58b41700 1 --2- 172.21.15.134:0/1815258691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a541013f0 0x7f2a54101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.917+0000 7f2a58b41700 1 --2- 172.21.15.134:0/1815258691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a540fe410 0x7f2a540fe820 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.917+0000 7f2a58b41700 1 -- 172.21.15.134:0/1815258691 >> 172.21.15.134:0/1815258691 conn(0x7f2a540f9d80 msgr2=0x7f2a540fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:28.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.917+0000 7f2a58b41700 1 -- 172.21.15.134:0/1815258691 shutdown_connections 2024-04-13T11:00:28.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.917+0000 7f2a58b41700 1 -- 172.21.15.134:0/1815258691 wait complete. 2024-04-13T11:00:28.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.918+0000 7f2a58b41700 1 Processor -- start 2024-04-13T11:00:28.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.918+0000 7f2a58b41700 1 -- start start 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a58b41700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a540fe410 0x7f2a541958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a58b41700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a541013f0 0x7f2a54195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a58b41700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54196420 con 0x7f2a541013f0 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a58b41700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54196560 con 0x7f2a540fe410 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a51d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a541013f0 0x7f2a54195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a51d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a541013f0 0x7f2a54195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56058/0 (socket says 172.21.15.134:56058) 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a51d9b700 1 -- 172.21.15.134:0/3293722819 learned_addr learned my addr 172.21.15.134:0/3293722819 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a5259c700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a540fe410 0x7f2a541958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a51d9b700 1 -- 172.21.15.134:0/3293722819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a540fe410 msgr2=0x7f2a541958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a51d9b700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a540fe410 0x7f2a541958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a51d9b700 1 -- 172.21.15.134:0/3293722819 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009520 con 0x7f2a541013f0 2024-04-13T11:00:28.921 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a51d9b700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a541013f0 0x7f2a54195e00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800e940 tx=0x7f2a4800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:28.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a437fe700 1 -- 172.21.15.134:0/3293722819 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a48004a00 con 0x7f2a541013f0 2024-04-13T11:00:28.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a437fe700 1 -- 172.21.15.134:0/3293722819 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f2a4800c7c0 con 0x7f2a541013f0 2024-04-13T11:00:28.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.919+0000 7f2a58b41700 1 -- 172.21.15.134:0/3293722819 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5419b010 con 0x7f2a541013f0 2024-04-13T11:00:28.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.920+0000 7f2a437fe700 1 -- 172.21.15.134:0/3293722819 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a48005480 con 0x7f2a541013f0 2024-04-13T11:00:28.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.920+0000 7f2a58b41700 1 -- 172.21.15.134:0/3293722819 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5419b5b0 con 0x7f2a541013f0 2024-04-13T11:00:28.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.921+0000 7f2a58b41700 1 -- 172.21.15.134:0/3293722819 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a54108b50 con 0x7f2a541013f0 2024-04-13T11:00:28.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.921+0000 7f2a437fe700 1 -- 172.21.15.134:0/3293722819 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f2a4800c930 con 0x7f2a541013f0 2024-04-13T11:00:28.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.922+0000 7f2a437fe700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2a3c06ce20 0x7f2a3c06f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:28.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.922+0000 7f2a437fe700 1 -- 172.21.15.134:0/3293722819 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2a48014070 con 0x7f2a541013f0 2024-04-13T11:00:28.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.922+0000 7f2a5259c700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2a3c06ce20 0x7f2a3c06f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:28.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.923+0000 7f2a5259c700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2a3c06ce20 0x7f2a3c06f2d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009840 tx=0x7f2a44019040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:28.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:28.929+0000 7f2a437fe700 1 -- 172.21.15.134:0/3293722819 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f2a4805a360 con 0x7f2a541013f0 2024-04-13T11:00:28.933 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:28 smithi134 ceph-mon[39696]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:00:29.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.226+0000 7f2a58b41700 1 -- 172.21.15.134:0/3293722819 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a54105d40 con 0x7f2a3c06ce20 2024-04-13T11:00:29.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.228+0000 7f2a437fe700 1 -- 172.21.15.134:0/3293722819 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f2a54105d40 con 0x7f2a3c06ce20 2024-04-13T11:00:29.228 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:00:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:00:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:00:29.228 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-13T11:00:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:00:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-04-13T11:00:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:00:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/2 daemons upgraded", 2024-04-13T11:00:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading node-exporter daemons", 2024-04-13T11:00:29.229 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:00:29.229 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:00:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.230+0000 7f2a58b41700 1 -- 172.21.15.134:0/3293722819 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2a3c06ce20 msgr2=0x7f2a3c06f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.230+0000 7f2a58b41700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2a3c06ce20 0x7f2a3c06f2d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009840 tx=0x7f2a44019040 comp rx=0 tx=0).stop 2024-04-13T11:00:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.230+0000 7f2a58b41700 1 -- 172.21.15.134:0/3293722819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a541013f0 msgr2=0x7f2a54195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.230+0000 7f2a58b41700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a541013f0 0x7f2a54195e00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800e940 tx=0x7f2a4800ec50 comp rx=0 tx=0).stop 2024-04-13T11:00:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.230+0000 7f2a58b41700 1 -- 172.21.15.134:0/3293722819 shutdown_connections 2024-04-13T11:00:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.230+0000 7f2a58b41700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2a3c06ce20 0x7f2a3c06f2d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.230+0000 7f2a58b41700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a540fe410 0x7f2a541958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:29.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.230+0000 7f2a58b41700 1 --2- 172.21.15.134:0/3293722819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a541013f0 0x7f2a54195e00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:29.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.230+0000 7f2a58b41700 1 -- 172.21.15.134:0/3293722819 >> 172.21.15.134:0/3293722819 conn(0x7f2a540f9d80 msgr2=0x7f2a54104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:29.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.231+0000 7f2a58b41700 1 -- 172.21.15.134:0/3293722819 shutdown_connections 2024-04-13T11:00:29.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:29.231+0000 7f2a58b41700 1 -- 172.21.15.134:0/3293722819 wait complete. 2024-04-13T11:00:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:29 smithi194 ceph-mon[46737]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:00:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:29 smithi194 ceph-mon[46737]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 500 op/s 2024-04-13T11:00:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:29 smithi194 ceph-mon[46737]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:00:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:29 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/1847409131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:29 smithi134 ceph-mon[39696]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:00:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:29 smithi134 ceph-mon[39696]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 500 op/s 2024-04-13T11:00:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:29 smithi134 ceph-mon[39696]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:00:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:29 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1847409131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:30.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:30 smithi134 ceph-mon[39696]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:00:30.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:30 smithi194 ceph-mon[46737]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:00:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:31 smithi194 ceph-mon[46737]: pgmap v29: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 645 op/s 2024-04-13T11:00:31.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:31 smithi134 ceph-mon[39696]: pgmap v29: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 645 op/s 2024-04-13T11:00:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:33 smithi194 ceph-mon[46737]: pgmap v30: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 429 op/s 2024-04-13T11:00:33.765 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:33 smithi134 ceph-mon[39696]: pgmap v30: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 429 op/s 2024-04-13T11:00:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:34 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:34 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:34 smithi194 ceph-mon[46737]: pgmap v31: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 429 op/s 2024-04-13T11:00:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:34 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:34 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:34 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:34 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:34 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:34 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:34 smithi134 ceph-mon[39696]: pgmap v31: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 429 op/s 2024-04-13T11:00:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:34 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:34 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:34 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:35.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:34 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:37.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:37 smithi134 ceph-mon[39696]: pgmap v32: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 537 op/s 2024-04-13T11:00:37.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:37 smithi194 ceph-mon[46737]: pgmap v32: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 537 op/s 2024-04-13T11:00:38.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:00:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:00:39.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:39 smithi134 ceph-mon[39696]: pgmap v33: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 252 op/s 2024-04-13T11:00:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:39 smithi194 ceph-mon[46737]: pgmap v33: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 252 op/s 2024-04-13T11:00:41.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: pgmap v34: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 311 op/s 2024-04-13T11:00:41.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:41.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:41.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:41 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: pgmap v34: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 311 op/s 2024-04-13T11:00:41.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:41.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:41.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:00:41.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:00:41.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:41.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:00:41.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:41.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:41 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:00:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:43 smithi134 ceph-mon[39696]: pgmap v35: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 992 KiB/s rd, 1.0 MiB/s wr, 167 op/s 2024-04-13T11:00:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:43 smithi194 ceph-mon[46737]: pgmap v35: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 992 KiB/s rd, 1.0 MiB/s wr, 167 op/s 2024-04-13T11:00:45.817 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:45 smithi134 ceph-mon[39696]: pgmap v36: 65 pgs: 65 active+clean; 273 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 216 op/s 2024-04-13T11:00:45.818 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-13T11:00:45.818 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-13T11:00:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:45 smithi194 ceph-mon[46737]: pgmap v36: 65 pgs: 65 active+clean; 273 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 216 op/s 2024-04-13T11:00:46.150 DEBUG:teuthology.parallel:result is None 2024-04-13T11:00:46.150 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-13T11:00:46.185 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-13T11:00:46.185 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-13T11:00:46.226 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-13T11:00:46.226 DEBUG:teuthology.parallel:result is None 2024-04-13T11:00:46.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:46 smithi194 ceph-mon[46737]: Upgrade: Updating prometheus.smithi134 2024-04-13T11:00:46.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:46 smithi194 ceph-mon[46737]: Deploying daemon prometheus.smithi134 on smithi134 2024-04-13T11:00:46.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:46 smithi134 ceph-mon[39696]: Upgrade: Updating prometheus.smithi134 2024-04-13T11:00:46.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:46 smithi134 ceph-mon[39696]: Deploying daemon prometheus.smithi134 on smithi134 2024-04-13T11:00:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:47 smithi134 ceph-mon[39696]: pgmap v37: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-04-13T11:00:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:47 smithi194 ceph-mon[46737]: pgmap v37: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-04-13T11:00:49.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:49 smithi134 ceph-mon[39696]: pgmap v38: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 926 KiB/s rd, 976 KiB/s wr, 149 op/s 2024-04-13T11:00:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:49 smithi194 ceph-mon[46737]: pgmap v38: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 926 KiB/s rd, 976 KiB/s wr, 149 op/s 2024-04-13T11:00:51.821 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:51 smithi194 ceph-mon[46737]: pgmap v39: 65 pgs: 65 active+clean; 261 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 201 op/s 2024-04-13T11:00:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:51 smithi134 ceph-mon[39696]: pgmap v39: 65 pgs: 65 active+clean; 261 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 201 op/s 2024-04-13T11:00:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:53 smithi134 ceph-mon[39696]: pgmap v40: 65 pgs: 65 active+clean; 261 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 688 KiB/s rd, 689 KiB/s wr, 142 op/s 2024-04-13T11:00:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:53 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:00:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:53 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:53.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:53 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:53.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:53 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:00:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:53 smithi194 ceph-mon[46737]: pgmap v40: 65 pgs: 65 active+clean; 261 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 688 KiB/s rd, 689 KiB/s wr, 142 op/s 2024-04-13T11:00:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:53 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:00:53.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:53 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:53.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:53 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:53.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:53 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:00:54.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:54 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:54.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:54 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:54 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:54 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:55.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:55 smithi134 ceph-mon[39696]: pgmap v41: 65 pgs: 65 active+clean; 261 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 718 KiB/s rd, 718 KiB/s wr, 144 op/s 2024-04-13T11:00:55.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:55 smithi194 ceph-mon[46737]: pgmap v41: 65 pgs: 65 active+clean; 261 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 718 KiB/s rd, 718 KiB/s wr, 144 op/s 2024-04-13T11:00:57.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:57 smithi134 ceph-mon[39696]: pgmap v42: 65 pgs: 65 active+clean; 261 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 542 KiB/s rd, 563 KiB/s wr, 95 op/s 2024-04-13T11:00:57.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:57 smithi194 ceph-mon[46737]: pgmap v42: 65 pgs: 65 active+clean; 261 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 542 KiB/s rd, 563 KiB/s wr, 95 op/s 2024-04-13T11:00:59.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.347+0000 7f8e969fe700 1 -- 172.21.15.134:0/1792148891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e90100250 msgr2=0x7f8e901006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:59.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.347+0000 7f8e969fe700 1 --2- 172.21.15.134:0/1792148891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e90100250 0x7f8e901006a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009910 tx=0x7f8e84009c20 comp rx=0 tx=0).stop 2024-04-13T11:00:59.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.347+0000 7f8e969fe700 1 -- 172.21.15.134:0/1792148891 shutdown_connections 2024-04-13T11:00:59.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.347+0000 7f8e969fe700 1 --2- 172.21.15.134:0/1792148891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e90100250 0x7f8e901006a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.347+0000 7f8e969fe700 1 --2- 172.21.15.134:0/1792148891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e900ff050 0x7f8e900ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.347+0000 7f8e969fe700 1 -- 172.21.15.134:0/1792148891 >> 172.21.15.134:0/1792148891 conn(0x7f8e900fa5e0 msgr2=0x7f8e900fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:59.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.347+0000 7f8e969fe700 1 -- 172.21.15.134:0/1792148891 shutdown_connections 2024-04-13T11:00:59.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.347+0000 7f8e969fe700 1 -- 172.21.15.134:0/1792148891 wait complete. 2024-04-13T11:00:59.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.348+0000 7f8e969fe700 1 Processor -- start 2024-04-13T11:00:59.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.348+0000 7f8e969fe700 1 -- start start 2024-04-13T11:00:59.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.348+0000 7f8e969fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e900ff050 0x7f8e901948b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.348+0000 7f8e969fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e90100250 0x7f8e90194df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.348+0000 7f8e969fe700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e90195410 con 0x7f8e900ff050 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.348+0000 7f8e969fe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e90195550 con 0x7f8e90100250 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.348+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e900ff050 0x7f8e901948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.348+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e900ff050 0x7f8e901948b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35522/0 (socket says 172.21.15.134:35522) 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.348+0000 7f8e8ffff700 1 -- 172.21.15.134:0/1871417442 learned_addr learned my addr 172.21.15.134:0/1871417442 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.348+0000 7f8e8f7fe700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e90100250 0x7f8e90194df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.349+0000 7f8e8ffff700 1 -- 172.21.15.134:0/1871417442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e90100250 msgr2=0x7f8e90194df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.349+0000 7f8e8ffff700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e90100250 0x7f8e90194df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.349+0000 7f8e8ffff700 1 -- 172.21.15.134:0/1871417442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e840095f0 con 0x7f8e900ff050 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.349+0000 7f8e8ffff700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e900ff050 0x7f8e901948b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000d930 tx=0x7f8e8000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:59.351 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.349+0000 7f8e8d7fa700 1 -- 172.21.15.134:0/1871417442 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e8000ec20 con 0x7f8e900ff050 2024-04-13T11:00:59.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.349+0000 7f8e8d7fa700 1 -- 172.21.15.134:0/1871417442 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f8e8000ed80 con 0x7f8e900ff050 2024-04-13T11:00:59.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.349+0000 7f8e969fe700 1 -- 172.21.15.134:0/1871417442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e90068430 con 0x7f8e900ff050 2024-04-13T11:00:59.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.349+0000 7f8e8d7fa700 1 -- 172.21.15.134:0/1871417442 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e80014730 con 0x7f8e900ff050 2024-04-13T11:00:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.349+0000 7f8e969fe700 1 -- 172.21.15.134:0/1871417442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e90068a00 con 0x7f8e900ff050 2024-04-13T11:00:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.350+0000 7f8e969fe700 1 -- 172.21.15.134:0/1871417442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e90107b00 con 0x7f8e900ff050 2024-04-13T11:00:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.350+0000 7f8e8d7fa700 1 -- 172.21.15.134:0/1871417442 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f8e80016440 con 0x7f8e900ff050 2024-04-13T11:00:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.351+0000 7f8e8d7fa700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8e7806ce20 0x7f8e7806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.351+0000 7f8e8d7fa700 1 -- 172.21.15.134:0/1871417442 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f8e8008df90 con 0x7f8e900ff050 2024-04-13T11:00:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.351+0000 7f8e8f7fe700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8e7806ce20 0x7f8e7806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.351+0000 7f8e8f7fe700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8e7806ce20 0x7f8e7806f2d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8e840059d0 tx=0x7f8e84005920 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:59.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.356+0000 7f8e8d7fa700 1 -- 172.21.15.134:0/1871417442 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f8e8005bb30 con 0x7f8e900ff050 2024-04-13T11:00:59.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.580+0000 7f8e969fe700 1 -- 172.21.15.134:0/1871417442 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e90104ba0 con 0x7f8e7806ce20 2024-04-13T11:00:59.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.581+0000 7f8e8d7fa700 1 -- 172.21.15.134:0/1871417442 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f8e90104ba0 con 0x7f8e7806ce20 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 -- 172.21.15.134:0/1871417442 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8e7806ce20 msgr2=0x7f8e7806f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8e7806ce20 0x7f8e7806f2d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8e840059d0 tx=0x7f8e84005920 comp rx=0 tx=0).stop 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 -- 172.21.15.134:0/1871417442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e900ff050 msgr2=0x7f8e901948b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e900ff050 0x7f8e901948b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000d930 tx=0x7f8e8000dcf0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 -- 172.21.15.134:0/1871417442 shutdown_connections 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8e7806ce20 0x7f8e7806f2d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e900ff050 0x7f8e901948b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 --2- 172.21.15.134:0/1871417442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e90100250 0x7f8e90194df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 -- 172.21.15.134:0/1871417442 >> 172.21.15.134:0/1871417442 conn(0x7f8e900fa5e0 msgr2=0x7f8e90103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 -- 172.21.15.134:0/1871417442 shutdown_connections 2024-04-13T11:00:59.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.584+0000 7f8e969fe700 1 -- 172.21.15.134:0/1871417442 wait complete. 2024-04-13T11:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:00:59.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.698+0000 7f89e50a7700 1 -- 172.21.15.134:0/984980946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e0100be0 msgr2=0x7f89e0102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:59.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.698+0000 7f89e50a7700 1 --2- 172.21.15.134:0/984980946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e0100be0 0x7f89e0102fc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009910 tx=0x7f89d0009c20 comp rx=0 tx=0).stop 2024-04-13T11:00:59.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.698+0000 7f89e50a7700 1 -- 172.21.15.134:0/984980946 shutdown_connections 2024-04-13T11:00:59.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.698+0000 7f89e50a7700 1 --2- 172.21.15.134:0/984980946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89e0103500 0x7f89e01058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.698+0000 7f89e50a7700 1 --2- 172.21.15.134:0/984980946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e0100be0 0x7f89e0102fc0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.698+0000 7f89e50a7700 1 -- 172.21.15.134:0/984980946 >> 172.21.15.134:0/984980946 conn(0x7f89e00fa5e0 msgr2=0x7f89e00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:59.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.698+0000 7f89e50a7700 1 -- 172.21.15.134:0/984980946 shutdown_connections 2024-04-13T11:00:59.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.698+0000 7f89e50a7700 1 -- 172.21.15.134:0/984980946 wait complete. 2024-04-13T11:00:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.699+0000 7f89e50a7700 1 Processor -- start 2024-04-13T11:00:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.699+0000 7f89e50a7700 1 -- start start 2024-04-13T11:00:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.699+0000 7f89e50a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e0100be0 0x7f89e0195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.699+0000 7f89e50a7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89e0103500 0x7f89e0195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.699+0000 7f89e50a7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e01963a0 con 0x7f89e0100be0 2024-04-13T11:00:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.699+0000 7f89e50a7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e01964e0 con 0x7f89e0103500 2024-04-13T11:00:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.699+0000 7f89ded9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e0100be0 0x7f89e0195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.699+0000 7f89ded9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e0100be0 0x7f89e0195840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35552/0 (socket says 172.21.15.134:35552) 2024-04-13T11:00:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.699+0000 7f89ded9d700 1 -- 172.21.15.134:0/1100663700 learned_addr learned my addr 172.21.15.134:0/1100663700 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:00:59.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.699+0000 7f89de59c700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89e0103500 0x7f89e0195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.700+0000 7f89ded9d700 1 -- 172.21.15.134:0/1100663700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89e0103500 msgr2=0x7f89e0195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.700+0000 7f89ded9d700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89e0103500 0x7f89e0195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.700+0000 7f89ded9d700 1 -- 172.21.15.134:0/1100663700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00095f0 con 0x7f89e0100be0 2024-04-13T11:00:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.700+0000 7f89ded9d700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e0100be0 0x7f89e0195840 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f89d0006010 tx=0x7f89d000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.700+0000 7f89c7fff700 1 -- 172.21.15.134:0/1100663700 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89d001d070 con 0x7f89e0100be0 2024-04-13T11:00:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.700+0000 7f89c7fff700 1 -- 172.21.15.134:0/1100663700 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f89d000f460 con 0x7f89e0100be0 2024-04-13T11:00:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.700+0000 7f89e50a7700 1 -- 172.21.15.134:0/1100663700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e019af30 con 0x7f89e0100be0 2024-04-13T11:00:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.700+0000 7f89c7fff700 1 -- 172.21.15.134:0/1100663700 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89d0021640 con 0x7f89e0100be0 2024-04-13T11:00:59.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.700+0000 7f89e50a7700 1 -- 172.21.15.134:0/1100663700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e019b420 con 0x7f89e0100be0 2024-04-13T11:00:59.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.701+0000 7f89e50a7700 1 -- 172.21.15.134:0/1100663700 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e018fa30 con 0x7f89e0100be0 2024-04-13T11:00:59.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.702+0000 7f89c7fff700 1 -- 172.21.15.134:0/1100663700 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f89d0003a60 con 0x7f89e0100be0 2024-04-13T11:00:59.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.702+0000 7f89c7fff700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f89c806ce20 0x7f89c806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:00:59.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.702+0000 7f89c7fff700 1 -- 172.21.15.134:0/1100663700 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f89d008d9e0 con 0x7f89e0100be0 2024-04-13T11:00:59.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.702+0000 7f89de59c700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f89c806ce20 0x7f89c806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:00:59.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.703+0000 7f89de59c700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f89c806ce20 0x7f89c806f2d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f89d4005950 tx=0x7f89d400b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:00:59.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.707+0000 7f89c7fff700 1 -- 172.21.15.134:0/1100663700 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f89d005b3c0 con 0x7f89e0100be0 2024-04-13T11:00:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:59 smithi134 ceph-mon[39696]: pgmap v43: 65 pgs: 65 active+clean; 261 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 344 KiB/s rd, 263 KiB/s wr, 54 op/s 2024-04-13T11:00:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:59 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:00:59 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:59.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.944+0000 7f89e50a7700 1 -- 172.21.15.134:0/1100663700 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89e0061190 con 0x7f89c806ce20 2024-04-13T11:00:59.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.946+0000 7f89c7fff700 1 -- 172.21.15.134:0/1100663700 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f89e0061190 con 0x7f89c806ce20 2024-04-13T11:00:59.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 -- 172.21.15.134:0/1100663700 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f89c806ce20 msgr2=0x7f89c806f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:59.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f89c806ce20 0x7f89c806f2d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f89d4005950 tx=0x7f89d400b410 comp rx=0 tx=0).stop 2024-04-13T11:00:59.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 -- 172.21.15.134:0/1100663700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e0100be0 msgr2=0x7f89e0195840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:00:59.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e0100be0 0x7f89e0195840 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f89d0006010 tx=0x7f89d000bd70 comp rx=0 tx=0).stop 2024-04-13T11:00:59.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 -- 172.21.15.134:0/1100663700 shutdown_connections 2024-04-13T11:00:59.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f89c806ce20 0x7f89c806f2d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e0100be0 0x7f89e0195840 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 --2- 172.21.15.134:0/1100663700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89e0103500 0x7f89e0195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:00:59.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 -- 172.21.15.134:0/1100663700 >> 172.21.15.134:0/1100663700 conn(0x7f89e00fa5e0 msgr2=0x7f89e00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:00:59.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 -- 172.21.15.134:0/1100663700 shutdown_connections 2024-04-13T11:00:59.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:00:59.948+0000 7f89e50a7700 1 -- 172.21.15.134:0/1100663700 wait complete. 2024-04-13T11:00:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:59 smithi194 ceph-mon[46737]: pgmap v43: 65 pgs: 65 active+clean; 261 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 344 KiB/s rd, 263 KiB/s wr, 54 op/s 2024-04-13T11:00:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:59 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:00:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:00:59 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.056+0000 7f9185fda700 1 -- 172.21.15.134:0/1308286930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101390 msgr2=0x7f91801017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.056+0000 7f9185fda700 1 --2- 172.21.15.134:0/1308286930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101390 0x7f91801017e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9174009910 tx=0x7f9174009c20 comp rx=0 tx=0).stop 2024-04-13T11:01:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.056+0000 7f9185fda700 1 -- 172.21.15.134:0/1308286930 shutdown_connections 2024-04-13T11:01:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.056+0000 7f9185fda700 1 --2- 172.21.15.134:0/1308286930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101390 0x7f91801017e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.056+0000 7f9185fda700 1 --2- 172.21.15.134:0/1308286930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9180100190 0x7f91801005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.056+0000 7f9185fda700 1 -- 172.21.15.134:0/1308286930 >> 172.21.15.134:0/1308286930 conn(0x7f91800fb720 msgr2=0x7f91800fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.056+0000 7f9185fda700 1 -- 172.21.15.134:0/1308286930 shutdown_connections 2024-04-13T11:01:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.056+0000 7f9185fda700 1 -- 172.21.15.134:0/1308286930 wait complete. 2024-04-13T11:01:00.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.056+0000 7f9185fda700 1 Processor -- start 2024-04-13T11:01:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f9185fda700 1 -- start start 2024-04-13T11:01:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f9185fda700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9180100190 0x7f91801958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f9185fda700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101390 0x7f9180195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f9185fda700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9180196400 con 0x7f9180101390 2024-04-13T11:01:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f9185fda700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9180196540 con 0x7f9180100190 2024-04-13T11:01:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f917effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101390 0x7f9180195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f917effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101390 0x7f9180195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35570/0 (socket says 172.21.15.134:35570) 2024-04-13T11:01:00.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f917effd700 1 -- 172.21.15.134:0/3720663493 learned_addr learned my addr 172.21.15.134:0/3720663493 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f917f7fe700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9180100190 0x7f91801958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f917effd700 1 -- 172.21.15.134:0/3720663493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9180100190 msgr2=0x7f91801958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f917effd700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9180100190 0x7f91801958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f917effd700 1 -- 172.21.15.134:0/3720663493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740095f0 con 0x7f9180101390 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f917f7fe700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9180100190 0x7f91801958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f917effd700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101390 0x7f9180195de0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f917400bd70 tx=0x7f917400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.057+0000 7f917cff9700 1 -- 172.21.15.134:0/3720663493 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f917401d070 con 0x7f9180101390 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.058+0000 7f917cff9700 1 -- 172.21.15.134:0/3720663493 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f917400f460 con 0x7f9180101390 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.058+0000 7f9185fda700 1 -- 172.21.15.134:0/3720663493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918019af90 con 0x7f9180101390 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.058+0000 7f917cff9700 1 -- 172.21.15.134:0/3720663493 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9174021640 con 0x7f9180101390 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.058+0000 7f9185fda700 1 -- 172.21.15.134:0/3720663493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918019b450 con 0x7f9180101390 2024-04-13T11:01:00.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.058+0000 7f9185fda700 1 -- 172.21.15.134:0/3720663493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9180108ba0 con 0x7f9180101390 2024-04-13T11:01:00.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.059+0000 7f917cff9700 1 -- 172.21.15.134:0/3720663493 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f917400f940 con 0x7f9180101390 2024-04-13T11:01:00.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.059+0000 7f917cff9700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f916806ce20 0x7f916806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:00.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.059+0000 7f917cff9700 1 -- 172.21.15.134:0/3720663493 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f917408da00 con 0x7f9180101390 2024-04-13T11:01:00.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.059+0000 7f917f7fe700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f916806ce20 0x7f916806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:00.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.060+0000 7f917f7fe700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f916806ce20 0x7f916806f2d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f91801011f0 tx=0x7f917000b670 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:00.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.064+0000 7f917cff9700 1 -- 172.21.15.134:0/3720663493 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f917405b3e0 con 0x7f9180101390 2024-04-13T11:01:00.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.278+0000 7f9185fda700 1 -- 172.21.15.134:0/3720663493 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9180105ce0 con 0x7f916806ce20 2024-04-13T11:01:00.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.289+0000 7f917cff9700 1 -- 172.21.15.134:0/3720663493 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9180105ce0 con 0x7f916806ce20 2024-04-13T11:01:00.290 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:01:00.290 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (9m) 1s ago 11m 25.2M - 0.25.0 c8568f914cd2 8d2cf34cad2a 2024-04-13T11:01:00.290 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (11m) 1s ago 11m 7960k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:01:00.290 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (10m) 33s ago 10m 7549k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:01:00.290 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (11m) 1s ago 11m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T11:01:00.290 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (10m) 33s ago 10m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T11:01:00.290 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (9m) 1s ago 11m 90.8M - 9.4.7 954c08fa6188 1038718f4fd4 2024-04-13T11:01:00.290 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (5m) 1s ago 5m 96.0M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (5m) 1s ago 5m 169M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (5m) 33s ago 5m 14.4M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (5m) 33s ago 5m 18.3M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (2m) 1s ago 12m 498M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (56s) 33s ago 10m 449M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (12m) 1s ago 12m 54.0M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (10m) 33s ago 10m 45.5M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (42s) 1s ago 11m 15.3M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (38s) 33s ago 10m 3414k - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (9m) 1s ago 9m 229M 1227M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (8m) 1s ago 8m 226M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T11:01:00.291 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (8m) 1s ago 8m 187M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T11:01:00.292 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (7m) 33s ago 7m 251M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T11:01:00.292 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (7m) 33s ago 7m 208M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:01:00.292 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (6m) 33s ago 6m 205M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:01:00.292 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (7s) 1s ago 10m 42.2M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:01:00.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 -- 172.21.15.134:0/3720663493 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f916806ce20 msgr2=0x7f916806f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:00.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f916806ce20 0x7f916806f2d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f91801011f0 tx=0x7f917000b670 comp rx=0 tx=0).stop 2024-04-13T11:01:00.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 -- 172.21.15.134:0/3720663493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101390 msgr2=0x7f9180195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:00.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101390 0x7f9180195de0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f917400bd70 tx=0x7f917400be50 comp rx=0 tx=0).stop 2024-04-13T11:01:00.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 -- 172.21.15.134:0/3720663493 shutdown_connections 2024-04-13T11:01:00.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f916806ce20 0x7f916806f2d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9180100190 0x7f91801958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 --2- 172.21.15.134:0/3720663493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9180101390 0x7f9180195de0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 -- 172.21.15.134:0/3720663493 >> 172.21.15.134:0/3720663493 conn(0x7f91800fb720 msgr2=0x7f91801045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:00.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 -- 172.21.15.134:0/3720663493 shutdown_connections 2024-04-13T11:01:00.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.291+0000 7f9185fda700 1 -- 172.21.15.134:0/3720663493 wait complete. 2024-04-13T11:01:00.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.397+0000 7f644e1fd700 1 -- 172.21.15.134:0/74464597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6448100250 msgr2=0x7f64481006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:00.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.397+0000 7f644e1fd700 1 --2- 172.21.15.134:0/74464597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6448100250 0x7f64481006a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6430009910 tx=0x7f6430009c20 comp rx=0 tx=0).stop 2024-04-13T11:01:00.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.397+0000 7f644e1fd700 1 -- 172.21.15.134:0/74464597 shutdown_connections 2024-04-13T11:01:00.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.397+0000 7f644e1fd700 1 --2- 172.21.15.134:0/74464597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6448100250 0x7f64481006a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.397+0000 7f644e1fd700 1 --2- 172.21.15.134:0/74464597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64480ff050 0x7f64480ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.397+0000 7f644e1fd700 1 -- 172.21.15.134:0/74464597 >> 172.21.15.134:0/74464597 conn(0x7f64480fa600 msgr2=0x7f64480fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:00.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.397+0000 7f644e1fd700 1 -- 172.21.15.134:0/74464597 shutdown_connections 2024-04-13T11:01:00.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.397+0000 7f644e1fd700 1 -- 172.21.15.134:0/74464597 wait complete. 2024-04-13T11:01:00.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.398+0000 7f644e1fd700 1 Processor -- start 2024-04-13T11:01:00.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.398+0000 7f644e1fd700 1 -- start start 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.398+0000 7f644e1fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64480ff050 0x7f6448069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.398+0000 7f644e1fd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6448100250 0x7f644819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.398+0000 7f644e1fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644819acd0 con 0x7f64480ff050 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.398+0000 7f644e1fd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644819ae10 con 0x7f6448100250 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.398+0000 7f64477fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64480ff050 0x7f6448069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.398+0000 7f64477fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64480ff050 0x7f6448069820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35598/0 (socket says 172.21.15.134:35598) 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.398+0000 7f64477fe700 1 -- 172.21.15.134:0/638012381 learned_addr learned my addr 172.21.15.134:0/638012381 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.398+0000 7f643effd700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6448100250 0x7f644819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.399+0000 7f64477fe700 1 -- 172.21.15.134:0/638012381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6448100250 msgr2=0x7f644819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.399+0000 7f64477fe700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6448100250 0x7f644819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.399+0000 7f64477fe700 1 -- 172.21.15.134:0/638012381 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64300095f0 con 0x7f64480ff050 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.399+0000 7f643effd700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6448100250 0x7f644819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.399+0000 7f64477fe700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64480ff050 0x7f6448069820 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f643800b480 tx=0x7f643800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:00.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.399+0000 7f64457fa700 1 -- 172.21.15.134:0/638012381 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64380118c0 con 0x7f64480ff050 2024-04-13T11:01:00.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.399+0000 7f644e1fd700 1 -- 172.21.15.134:0/638012381 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644819b0f0 con 0x7f64480ff050 2024-04-13T11:01:00.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.399+0000 7f64457fa700 1 -- 172.21.15.134:0/638012381 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f6438010380 con 0x7f64480ff050 2024-04-13T11:01:00.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.399+0000 7f64457fa700 1 -- 172.21.15.134:0/638012381 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f643800f510 con 0x7f64480ff050 2024-04-13T11:01:00.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.399+0000 7f644e1fd700 1 -- 172.21.15.134:0/638012381 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644819b6c0 con 0x7f64480ff050 2024-04-13T11:01:00.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.400+0000 7f644e1fd700 1 -- 172.21.15.134:0/638012381 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6448107b00 con 0x7f64480ff050 2024-04-13T11:01:00.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.400+0000 7f64457fa700 1 -- 172.21.15.134:0/638012381 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f64380104f0 con 0x7f64480ff050 2024-04-13T11:01:00.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.401+0000 7f64457fa700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f643406ce20 0x7f643406f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:00.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.401+0000 7f64457fa700 1 -- 172.21.15.134:0/638012381 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f643808c2a0 con 0x7f64480ff050 2024-04-13T11:01:00.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.401+0000 7f643effd700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f643406ce20 0x7f643406f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:00.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.401+0000 7f643effd700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f643406ce20 0x7f643406f2d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6430006010 tx=0x7f643000b540 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:00.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.405+0000 7f64457fa700 1 -- 172.21.15.134:0/638012381 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f6438059d90 con 0x7f64480ff050 2024-04-13T11:01:00.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.698+0000 7f644e1fd700 1 -- 172.21.15.134:0/638012381 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6448107cf0 con 0x7f64480ff050 2024-04-13T11:01:00.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.699+0000 7f64457fa700 1 -- 172.21.15.134:0/638012381 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f64380107a0 con 0x7f64480ff050 2024-04-13T11:01:00.699 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-04-13T11:01:00.700 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:01:00.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:01:00.701 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:01:00.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.701+0000 7f644e1fd700 1 -- 172.21.15.134:0/638012381 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f643406ce20 msgr2=0x7f643406f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:00.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.701+0000 7f644e1fd700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f643406ce20 0x7f643406f2d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6430006010 tx=0x7f643000b540 comp rx=0 tx=0).stop 2024-04-13T11:01:00.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.701+0000 7f644e1fd700 1 -- 172.21.15.134:0/638012381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64480ff050 msgr2=0x7f6448069820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:00.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.701+0000 7f644e1fd700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64480ff050 0x7f6448069820 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f643800b480 tx=0x7f643800b840 comp rx=0 tx=0).stop 2024-04-13T11:01:00.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.701+0000 7f644e1fd700 1 -- 172.21.15.134:0/638012381 shutdown_connections 2024-04-13T11:01:00.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.701+0000 7f644e1fd700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f643406ce20 0x7f643406f2d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.701+0000 7f644e1fd700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64480ff050 0x7f6448069820 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.701+0000 7f644e1fd700 1 --2- 172.21.15.134:0/638012381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6448100250 0x7f644819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.701+0000 7f644e1fd700 1 -- 172.21.15.134:0/638012381 >> 172.21.15.134:0/638012381 conn(0x7f64480fa600 msgr2=0x7f6448103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:00.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.701+0000 7f644e1fd700 1 -- 172.21.15.134:0/638012381 shutdown_connections 2024-04-13T11:01:00.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.702+0000 7f644e1fd700 1 -- 172.21.15.134:0/638012381 wait complete. 2024-04-13T11:01:00.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.808+0000 7f131438e700 1 -- 172.21.15.134:0/2521282961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f130c100250 msgr2=0x7f130c1006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:00.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.808+0000 7f131438e700 1 --2- 172.21.15.134:0/2521282961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f130c100250 0x7f130c1006a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1308009910 tx=0x7f1308009c20 comp rx=0 tx=0).stop 2024-04-13T11:01:00.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.808+0000 7f131438e700 1 -- 172.21.15.134:0/2521282961 shutdown_connections 2024-04-13T11:01:00.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.808+0000 7f131438e700 1 --2- 172.21.15.134:0/2521282961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f130c100250 0x7f130c1006a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.808+0000 7f131438e700 1 --2- 172.21.15.134:0/2521282961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f130c0ff050 0x7f130c0ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.808+0000 7f131438e700 1 -- 172.21.15.134:0/2521282961 >> 172.21.15.134:0/2521282961 conn(0x7f130c0fa600 msgr2=0x7f130c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:00.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.808+0000 7f131438e700 1 -- 172.21.15.134:0/2521282961 shutdown_connections 2024-04-13T11:01:00.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.808+0000 7f131438e700 1 -- 172.21.15.134:0/2521282961 wait complete. 2024-04-13T11:01:00.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f131438e700 1 Processor -- start 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f131438e700 1 -- start start 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f131438e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f130c0ff050 0x7f130c1958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f131438e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f130c100250 0x7f130c195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f131438e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c196410 con 0x7f130c100250 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f131438e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c196550 con 0x7f130c0ff050 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f1311929700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f130c100250 0x7f130c195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f1311929700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f130c100250 0x7f130c195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35612/0 (socket says 172.21.15.134:35612) 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f1311929700 1 -- 172.21.15.134:0/4026178436 learned_addr learned my addr 172.21.15.134:0/4026178436 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f131212a700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f130c0ff050 0x7f130c1958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.809+0000 7f1311929700 1 -- 172.21.15.134:0/4026178436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f130c0ff050 msgr2=0x7f130c1958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.810+0000 7f1311929700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f130c0ff050 0x7f130c1958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.810+0000 7f1311929700 1 -- 172.21.15.134:0/4026178436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080095f0 con 0x7f130c100250 2024-04-13T11:01:00.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.810+0000 7f131212a700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f130c0ff050 0x7f130c1958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:01:00.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.810+0000 7f1311929700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f130c100250 0x7f130c195df0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1308006010 tx=0x7f130800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:00.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.810+0000 7f13037fe700 1 -- 172.21.15.134:0/4026178436 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f130801d070 con 0x7f130c100250 2024-04-13T11:01:00.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.810+0000 7f13037fe700 1 -- 172.21.15.134:0/4026178436 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f1308022470 con 0x7f130c100250 2024-04-13T11:01:00.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.810+0000 7f131438e700 1 -- 172.21.15.134:0/4026178436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130c19afa0 con 0x7f130c100250 2024-04-13T11:01:00.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.810+0000 7f13037fe700 1 -- 172.21.15.134:0/4026178436 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f130800f690 con 0x7f130c100250 2024-04-13T11:01:00.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.810+0000 7f131438e700 1 -- 172.21.15.134:0/4026178436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c19b4e0 con 0x7f130c100250 2024-04-13T11:01:00.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.811+0000 7f131438e700 1 -- 172.21.15.134:0/4026178436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c107a60 con 0x7f130c100250 2024-04-13T11:01:00.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.811+0000 7f13037fe700 1 -- 172.21.15.134:0/4026178436 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90946+0+0 (secure 0 0 0) 0x7f1308022980 con 0x7f130c100250 2024-04-13T11:01:00.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.812+0000 7f13037fe700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f12f806ce20 0x7f12f806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:00.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.812+0000 7f13037fe700 1 -- 172.21.15.134:0/4026178436 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f130808df90 con 0x7f130c100250 2024-04-13T11:01:00.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.812+0000 7f131212a700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f12f806ce20 0x7f12f806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:00.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.812+0000 7f131212a700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f12f806ce20 0x7f12f806f2d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005fd0 tx=0x7f12fc005dc0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:00.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:00.816+0000 7f13037fe700 1 -- 172.21.15.134:0/4026178436 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f130805ba90 con 0x7f130c100250 2024-04-13T11:01:00.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:00 smithi134 ceph-mon[39696]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:00.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:00 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:00.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:00 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:00 smithi194 ceph-mon[46737]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:00 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:00 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:01.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.039+0000 7f131438e700 1 -- 172.21.15.134:0/4026178436 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f130c069370 con 0x7f12f806ce20 2024-04-13T11:01:01.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.040+0000 7f13037fe700 1 -- 172.21.15.134:0/4026178436 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f130c069370 con 0x7f12f806ce20 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/2 daemons upgraded", 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading prometheus daemons", 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:01:01.041 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:01:01.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.042+0000 7f131438e700 1 -- 172.21.15.134:0/4026178436 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f12f806ce20 msgr2=0x7f12f806f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:01.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.042+0000 7f131438e700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f12f806ce20 0x7f12f806f2d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005fd0 tx=0x7f12fc005dc0 comp rx=0 tx=0).stop 2024-04-13T11:01:01.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.042+0000 7f131438e700 1 -- 172.21.15.134:0/4026178436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f130c100250 msgr2=0x7f130c195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:01.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.042+0000 7f131438e700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f130c100250 0x7f130c195df0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1308006010 tx=0x7f130800be20 comp rx=0 tx=0).stop 2024-04-13T11:01:01.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.042+0000 7f131438e700 1 -- 172.21.15.134:0/4026178436 shutdown_connections 2024-04-13T11:01:01.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.042+0000 7f131438e700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f12f806ce20 0x7f12f806f2d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.042+0000 7f131438e700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f130c0ff050 0x7f130c1958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.042+0000 7f131438e700 1 --2- 172.21.15.134:0/4026178436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f130c100250 0x7f130c195df0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.042+0000 7f131438e700 1 -- 172.21.15.134:0/4026178436 >> 172.21.15.134:0/4026178436 conn(0x7f130c0fa600 msgr2=0x7f130c068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.043+0000 7f131438e700 1 -- 172.21.15.134:0/4026178436 shutdown_connections 2024-04-13T11:01:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:01.043+0000 7f131438e700 1 -- 172.21.15.134:0/4026178436 wait complete. 2024-04-13T11:01:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:01 smithi194 ceph-mon[46737]: pgmap v44: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 263 KiB/s wr, 55 op/s 2024-04-13T11:01:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:01 smithi194 ceph-mon[46737]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:01 smithi194 ceph-mon[46737]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:01 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/638012381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:01.846 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:01 smithi134 ceph-mon[39696]: pgmap v44: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 263 KiB/s wr, 55 op/s 2024-04-13T11:01:01.847 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:01 smithi134 ceph-mon[39696]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:01.847 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:01 smithi134 ceph-mon[39696]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:01.847 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:01 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/638012381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:02.834 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:02 smithi134 ceph-mon[39696]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:02.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:02 smithi194 ceph-mon[46737]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:03.927 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: pgmap v45: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 30 KiB/s wr, 3 op/s 2024-04-13T11:01:03.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:03.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:03.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:01:03.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:01:03.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:03.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T11:01:03.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:03.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.930 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:03 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: pgmap v45: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 30 KiB/s wr, 3 op/s 2024-04-13T11:01:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:03.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:03 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:04 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T11:01:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:04 smithi194 ceph-mon[46737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-13T11:01:05.838 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:05 smithi134 ceph-mon[39696]: pgmap v46: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 30 KiB/s wr, 4 op/s 2024-04-13T11:01:05.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:05 smithi194 ceph-mon[46737]: pgmap v46: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 30 KiB/s wr, 4 op/s 2024-04-13T11:01:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:06 smithi134 ceph-mon[39696]: Upgrade: Updating alertmanager.smithi134 2024-04-13T11:01:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:06 smithi134 ceph-mon[39696]: Deploying daemon alertmanager.smithi134 on smithi134 2024-04-13T11:01:06.958 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:06 smithi194 ceph-mon[46737]: Upgrade: Updating alertmanager.smithi134 2024-04-13T11:01:06.958 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:06 smithi194 ceph-mon[46737]: Deploying daemon alertmanager.smithi134 on smithi134 2024-04-13T11:01:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:07 smithi134 ceph-mon[39696]: pgmap v47: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-13T11:01:07.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:07 smithi194 ceph-mon[46737]: pgmap v47: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-13T11:01:08.854 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:08 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:01:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:08 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:01:09.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:09 smithi134 ceph-mon[39696]: pgmap v48: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-13T11:01:09.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:09 smithi194 ceph-mon[46737]: pgmap v48: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-13T11:01:10.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:10 smithi134 ceph-mon[39696]: mgrmap e32: smithi134.tmanda(active, since 91s), standbys: smithi194.tcpynt 2024-04-13T11:01:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:10 smithi194 ceph-mon[46737]: mgrmap e32: smithi134.tmanda(active, since 91s), standbys: smithi194.tcpynt 2024-04-13T11:01:11.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:11 smithi134 ceph-mon[39696]: pgmap v49: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-13T11:01:11.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:11 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:11.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:11 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:11.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:11 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:11 smithi194 ceph-mon[46737]: pgmap v49: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-13T11:01:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:11 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:11 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:11.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:11 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:13.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:13 smithi134 ceph-mon[39696]: pgmap v50: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-13T11:01:13.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:13 smithi194 ceph-mon[46737]: pgmap v50: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-13T11:01:15.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:15 smithi134 ceph-mon[39696]: pgmap v51: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-13T11:01:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:15 smithi194 ceph-mon[46737]: pgmap v51: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-13T11:01:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:17 smithi134 ceph-mon[39696]: pgmap v52: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-13T11:01:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:17 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:17 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:17 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:17 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:17 smithi194 ceph-mon[46737]: pgmap v52: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-13T11:01:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:17 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:17 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:17 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:17 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:19.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:19 smithi134 ceph-mon[39696]: pgmap v53: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-13T11:01:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:19 smithi194 ceph-mon[46737]: pgmap v53: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-13T11:01:21.899 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: pgmap v54: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.901 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.901 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.901 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.901 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.901 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:21 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: pgmap v54: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-13T11:01:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:01:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:01:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:21.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:21 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:22.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:22 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-13T11:01:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:22 smithi194 ceph-mon[46737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-13T11:01:23.875 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:23 smithi134 ceph-mon[39696]: pgmap v55: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:23.875 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:23 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:01:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:23 smithi194 ceph-mon[46737]: pgmap v55: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:23 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:01:24.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:24 smithi134 ceph-mon[39696]: Upgrade: Updating grafana.smithi134 2024-04-13T11:01:24.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:24 smithi134 ceph-mon[39696]: Deploying daemon grafana.smithi134 on smithi134 2024-04-13T11:01:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:24 smithi194 ceph-mon[46737]: Upgrade: Updating grafana.smithi134 2024-04-13T11:01:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:24 smithi194 ceph-mon[46737]: Deploying daemon grafana.smithi134 on smithi134 2024-04-13T11:01:25.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:25 smithi134 ceph-mon[39696]: pgmap v56: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:25 smithi194 ceph-mon[46737]: pgmap v56: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:27.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:27 smithi134 ceph-mon[39696]: pgmap v57: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:27 smithi194 ceph-mon[46737]: pgmap v57: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:29 smithi134 ceph-mon[39696]: pgmap v58: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:29.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:29 smithi194 ceph-mon[46737]: pgmap v58: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:31.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.161+0000 7f0aca42c700 1 -- 172.21.15.134:0/2504409236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ac4100190 msgr2=0x7f0ac41005a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:31.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.161+0000 7f0aca42c700 1 --2- 172.21.15.134:0/2504409236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ac4100190 0x7f0ac41005a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009910 tx=0x7f0ab4009c20 comp rx=0 tx=0).stop 2024-04-13T11:01:31.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.161+0000 7f0aca42c700 1 -- 172.21.15.134:0/2504409236 shutdown_connections 2024-04-13T11:01:31.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.161+0000 7f0aca42c700 1 --2- 172.21.15.134:0/2504409236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac4101390 0x7f0ac41017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.161+0000 7f0aca42c700 1 --2- 172.21.15.134:0/2504409236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ac4100190 0x7f0ac41005a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.161+0000 7f0aca42c700 1 -- 172.21.15.134:0/2504409236 >> 172.21.15.134:0/2504409236 conn(0x7f0ac40fb740 msgr2=0x7f0ac40fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:31.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.161+0000 7f0aca42c700 1 -- 172.21.15.134:0/2504409236 shutdown_connections 2024-04-13T11:01:31.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.161+0000 7f0aca42c700 1 -- 172.21.15.134:0/2504409236 wait complete. 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.162+0000 7f0aca42c700 1 Processor -- start 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.162+0000 7f0aca42c700 1 -- start start 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.162+0000 7f0aca42c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac4100190 0x7f0ac41958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.162+0000 7f0aca42c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ac4101390 0x7f0ac4195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.162+0000 7f0aca42c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4196400 con 0x7f0ac4101390 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.162+0000 7f0aca42c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4196540 con 0x7f0ac4100190 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ac4101390 0x7f0ac4195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ac4101390 0x7f0ac4195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37626/0 (socket says 172.21.15.134:37626) 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac37fe700 1 -- 172.21.15.134:0/2405060967 learned_addr learned my addr 172.21.15.134:0/2405060967 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac3fff700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac4100190 0x7f0ac41958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac37fe700 1 -- 172.21.15.134:0/2405060967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac4100190 msgr2=0x7f0ac41958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac37fe700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac4100190 0x7f0ac41958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac37fe700 1 -- 172.21.15.134:0/2405060967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40095f0 con 0x7f0ac4101390 2024-04-13T11:01:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac3fff700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac4100190 0x7f0ac41958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:01:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac37fe700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ac4101390 0x7f0ac4195de0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800d8d0 tx=0x7f0ab800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac17fa700 1 -- 172.21.15.134:0/2405060967 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab8009940 con 0x7f0ac4101390 2024-04-13T11:01:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0aca42c700 1 -- 172.21.15.134:0/2405060967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac419aff0 con 0x7f0ac4101390 2024-04-13T11:01:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac17fa700 1 -- 172.21.15.134:0/2405060967 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f0ab8010460 con 0x7f0ac4101390 2024-04-13T11:01:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0ac17fa700 1 -- 172.21.15.134:0/2405060967 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab800f5f0 con 0x7f0ac4101390 2024-04-13T11:01:31.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.163+0000 7f0aca42c700 1 -- 172.21.15.134:0/2405060967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac419b590 con 0x7f0ac4101390 2024-04-13T11:01:31.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.164+0000 7f0aca42c700 1 -- 172.21.15.134:0/2405060967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac4108ba0 con 0x7f0ac4101390 2024-04-13T11:01:31.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.165+0000 7f0ac17fa700 1 -- 172.21.15.134:0/2405060967 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f0ab80105d0 con 0x7f0ac4101390 2024-04-13T11:01:31.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.165+0000 7f0ac17fa700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0aac06cce0 0x7f0aac06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:31.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.165+0000 7f0ac17fa700 1 -- 172.21.15.134:0/2405060967 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f0ab808c480 con 0x7f0ac4101390 2024-04-13T11:01:31.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.165+0000 7f0ac3fff700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0aac06cce0 0x7f0aac06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:31.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.166+0000 7f0ac3fff700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0aac06cce0 0x7f0aac06f190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400b5c0 tx=0x7f0ab4005e20 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:31.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.170+0000 7f0ac17fa700 1 -- 172.21.15.134:0/2405060967 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f0ab805a080 con 0x7f0ac4101390 2024-04-13T11:01:31.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.385+0000 7f0aca42c700 1 -- 172.21.15.134:0/2405060967 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ac4105ce0 con 0x7f0aac06cce0 2024-04-13T11:01:31.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.387+0000 7f0ac17fa700 1 -- 172.21.15.134:0/2405060967 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f0ac4105ce0 con 0x7f0aac06cce0 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 -- 172.21.15.134:0/2405060967 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0aac06cce0 msgr2=0x7f0aac06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0aac06cce0 0x7f0aac06f190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400b5c0 tx=0x7f0ab4005e20 comp rx=0 tx=0).stop 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 -- 172.21.15.134:0/2405060967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ac4101390 msgr2=0x7f0ac4195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ac4101390 0x7f0ac4195de0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800d8d0 tx=0x7f0ab800dc90 comp rx=0 tx=0).stop 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 -- 172.21.15.134:0/2405060967 shutdown_connections 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0aac06cce0 0x7f0aac06f190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac4100190 0x7f0ac41958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 --2- 172.21.15.134:0/2405060967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ac4101390 0x7f0ac4195de0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 -- 172.21.15.134:0/2405060967 >> 172.21.15.134:0/2405060967 conn(0x7f0ac40fb740 msgr2=0x7f0ac41045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 -- 172.21.15.134:0/2405060967 shutdown_connections 2024-04-13T11:01:31.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.389+0000 7f0aca42c700 1 -- 172.21.15.134:0/2405060967 wait complete. 2024-04-13T11:01:31.400 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:01:31.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.496+0000 7f26ad60f700 1 -- 172.21.15.134:0/2615297001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26a80ff060 msgr2=0x7f26a80ff470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:31.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.496+0000 7f26ad60f700 1 --2- 172.21.15.134:0/2615297001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26a80ff060 0x7f26a80ff470 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009910 tx=0x7f26a0009c20 comp rx=0 tx=0).stop 2024-04-13T11:01:31.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.496+0000 7f26ad60f700 1 -- 172.21.15.134:0/2615297001 shutdown_connections 2024-04-13T11:01:31.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.496+0000 7f26ad60f700 1 --2- 172.21.15.134:0/2615297001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26a8100260 0x7f26a81006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.496+0000 7f26ad60f700 1 --2- 172.21.15.134:0/2615297001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26a80ff060 0x7f26a80ff470 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.496+0000 7f26ad60f700 1 -- 172.21.15.134:0/2615297001 >> 172.21.15.134:0/2615297001 conn(0x7f26a80fa610 msgr2=0x7f26a80fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:31.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.496+0000 7f26ad60f700 1 -- 172.21.15.134:0/2615297001 shutdown_connections 2024-04-13T11:01:31.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.496+0000 7f26ad60f700 1 -- 172.21.15.134:0/2615297001 wait complete. 2024-04-13T11:01:31.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26ad60f700 1 Processor -- start 2024-04-13T11:01:31.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26ad60f700 1 -- start start 2024-04-13T11:01:31.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26ad60f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26a80ff060 0x7f26a80698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26ad60f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26a8100260 0x7f26a819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26ad60f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a819abf0 con 0x7f26a80ff060 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26ad60f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a819ad30 con 0x7f26a8100260 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26a6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26a80ff060 0x7f26a80698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26a6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26a80ff060 0x7f26a80698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37652/0 (socket says 172.21.15.134:37652) 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26a6ffd700 1 -- 172.21.15.134:0/3312874073 learned_addr learned my addr 172.21.15.134:0/3312874073 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26a67fc700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26a8100260 0x7f26a819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26a6ffd700 1 -- 172.21.15.134:0/3312874073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26a8100260 msgr2=0x7f26a819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26a6ffd700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26a8100260 0x7f26a819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26a6ffd700 1 -- 172.21.15.134:0/3312874073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a00095f0 con 0x7f26a80ff060 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.497+0000 7f26a67fc700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26a8100260 0x7f26a819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.498+0000 7f26a6ffd700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26a80ff060 0x7f26a80698d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f26a000bda0 tx=0x7f26a000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:31.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.498+0000 7f268ffff700 1 -- 172.21.15.134:0/3312874073 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a001d070 con 0x7f26a80ff060 2024-04-13T11:01:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.498+0000 7f268ffff700 1 -- 172.21.15.134:0/3312874073 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f26a0022470 con 0x7f26a80ff060 2024-04-13T11:01:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.498+0000 7f26ad60f700 1 -- 172.21.15.134:0/3312874073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a819afb0 con 0x7f26a80ff060 2024-04-13T11:01:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.498+0000 7f268ffff700 1 -- 172.21.15.134:0/3312874073 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a000f690 con 0x7f26a80ff060 2024-04-13T11:01:31.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.498+0000 7f26ad60f700 1 -- 172.21.15.134:0/3312874073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a819b4f0 con 0x7f26a80ff060 2024-04-13T11:01:31.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.499+0000 7f26ad60f700 1 -- 172.21.15.134:0/3312874073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a8107a70 con 0x7f26a80ff060 2024-04-13T11:01:31.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.499+0000 7f268ffff700 1 -- 172.21.15.134:0/3312874073 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f26a00229c0 con 0x7f26a80ff060 2024-04-13T11:01:31.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.500+0000 7f268ffff700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f269006cce0 0x7f269006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:31.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.500+0000 7f268ffff700 1 -- 172.21.15.134:0/3312874073 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f26a008db60 con 0x7f26a80ff060 2024-04-13T11:01:31.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.500+0000 7f26a67fc700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f269006cce0 0x7f269006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:31.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.500+0000 7f26a67fc700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f269006cce0 0x7f269006f190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26a8069e50 tx=0x7f269c005f50 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:31.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.504+0000 7f268ffff700 1 -- 172.21.15.134:0/3312874073 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f26a005b890 con 0x7f26a80ff060 2024-04-13T11:01:31.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.724+0000 7f26ad60f700 1 -- 172.21.15.134:0/3312874073 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26a8104bb0 con 0x7f269006cce0 2024-04-13T11:01:31.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.725+0000 7f268ffff700 1 -- 172.21.15.134:0/3312874073 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f26a8104bb0 con 0x7f269006cce0 2024-04-13T11:01:31.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.727+0000 7f26ad60f700 1 -- 172.21.15.134:0/3312874073 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f269006cce0 msgr2=0x7f269006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:31.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.727+0000 7f26ad60f700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f269006cce0 0x7f269006f190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26a8069e50 tx=0x7f269c005f50 comp rx=0 tx=0).stop 2024-04-13T11:01:31.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.727+0000 7f26ad60f700 1 -- 172.21.15.134:0/3312874073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26a80ff060 msgr2=0x7f26a80698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:31.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.727+0000 7f26ad60f700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26a80ff060 0x7f26a80698d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f26a000bda0 tx=0x7f26a000be80 comp rx=0 tx=0).stop 2024-04-13T11:01:31.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.727+0000 7f26ad60f700 1 -- 172.21.15.134:0/3312874073 shutdown_connections 2024-04-13T11:01:31.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.727+0000 7f26ad60f700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f269006cce0 0x7f269006f190 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.727+0000 7f26ad60f700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26a80ff060 0x7f26a80698d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.727+0000 7f26ad60f700 1 --2- 172.21.15.134:0/3312874073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26a8100260 0x7f26a819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.727+0000 7f26ad60f700 1 -- 172.21.15.134:0/3312874073 >> 172.21.15.134:0/3312874073 conn(0x7f26a80fa610 msgr2=0x7f26a8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:31.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.728+0000 7f26ad60f700 1 -- 172.21.15.134:0/3312874073 shutdown_connections 2024-04-13T11:01:31.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.728+0000 7f26ad60f700 1 -- 172.21.15.134:0/3312874073 wait complete. 2024-04-13T11:01:31.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.832+0000 7f42af0e6700 1 -- 172.21.15.134:0/2680933513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a8103500 msgr2=0x7f42a81058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:31.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.832+0000 7f42af0e6700 1 --2- 172.21.15.134:0/2680933513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a8103500 0x7f42a81058e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4294009910 tx=0x7f4294009c20 comp rx=0 tx=0).stop 2024-04-13T11:01:31.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.832+0000 7f42af0e6700 1 -- 172.21.15.134:0/2680933513 shutdown_connections 2024-04-13T11:01:31.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.832+0000 7f42af0e6700 1 --2- 172.21.15.134:0/2680933513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a8103500 0x7f42a81058e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.832+0000 7f42af0e6700 1 --2- 172.21.15.134:0/2680933513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42a8100be0 0x7f42a8102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.832+0000 7f42af0e6700 1 -- 172.21.15.134:0/2680933513 >> 172.21.15.134:0/2680933513 conn(0x7f42a80fa5e0 msgr2=0x7f42a80fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:31.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.832+0000 7f42af0e6700 1 -- 172.21.15.134:0/2680933513 shutdown_connections 2024-04-13T11:01:31.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.832+0000 7f42af0e6700 1 -- 172.21.15.134:0/2680933513 wait complete. 2024-04-13T11:01:31.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42af0e6700 1 Processor -- start 2024-04-13T11:01:31.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42af0e6700 1 -- start start 2024-04-13T11:01:31.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42af0e6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42a8100be0 0x7f42a8195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:31.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42af0e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a8103500 0x7f42a8195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:31.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42af0e6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a81963c0 con 0x7f42a8103500 2024-04-13T11:01:31.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42af0e6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a8196500 con 0x7f42a8100be0 2024-04-13T11:01:31.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42a7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a8103500 0x7f42a8195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42a7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a8103500 0x7f42a8195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37666/0 (socket says 172.21.15.134:37666) 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42a7fff700 1 -- 172.21.15.134:0/1207248226 learned_addr learned my addr 172.21.15.134:0/1207248226 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42ace82700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42a8100be0 0x7f42a8195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42a7fff700 1 -- 172.21.15.134:0/1207248226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42a8100be0 msgr2=0x7f42a8195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42a7fff700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42a8100be0 0x7f42a8195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42a7fff700 1 -- 172.21.15.134:0/1207248226 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42940095f0 con 0x7f42a8103500 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.833+0000 7f42a7fff700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a8103500 0x7f42a8195da0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4294006010 tx=0x7f429400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.834+0000 7f42a5ffb700 1 -- 172.21.15.134:0/1207248226 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f429401d070 con 0x7f42a8103500 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.834+0000 7f42af0e6700 1 -- 172.21.15.134:0/1207248226 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a819af50 con 0x7f42a8103500 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.834+0000 7f42a5ffb700 1 -- 172.21.15.134:0/1207248226 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f4294022470 con 0x7f42a8103500 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.834+0000 7f42af0e6700 1 -- 172.21.15.134:0/1207248226 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a819b490 con 0x7f42a8103500 2024-04-13T11:01:31.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.834+0000 7f42a5ffb700 1 -- 172.21.15.134:0/1207248226 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f429400f630 con 0x7f42a8103500 2024-04-13T11:01:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.835+0000 7f42af0e6700 1 -- 172.21.15.134:0/1207248226 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a818fa30 con 0x7f42a8103500 2024-04-13T11:01:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.835+0000 7f42a5ffb700 1 -- 172.21.15.134:0/1207248226 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f4294022980 con 0x7f42a8103500 2024-04-13T11:01:31.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.836+0000 7f42a5ffb700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f429806cce0 0x7f429806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.836+0000 7f42a5ffb700 1 -- 172.21.15.134:0/1207248226 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f429408dab0 con 0x7f42a8103500 2024-04-13T11:01:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.836+0000 7f42ace82700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f429806cce0 0x7f429806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:31.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.836+0000 7f42ace82700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f429806cce0 0x7f429806f190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f429c005fd0 tx=0x7f429c00a560 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:31.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:31.840+0000 7f42a5ffb700 1 -- 172.21.15.134:0/1207248226 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f429405b880 con 0x7f42a8103500 2024-04-13T11:01:31.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:31 smithi134 ceph-mon[39696]: pgmap v59: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:31 smithi194 ceph-mon[46737]: pgmap v59: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:32.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.047+0000 7f42af0e6700 1 -- 172.21.15.134:0/1207248226 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f42a8061190 con 0x7f429806cce0 2024-04-13T11:01:32.075 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:01:32.075 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (21s) 15s ago 11m 15.5M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:01:32.075 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (12m) 15s ago 12m 7990k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (10m) 65s ago 10m 7549k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (12m) 15s ago 12m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (10m) 65s ago 10m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (10m) 15s ago 11m 91.0M - 9.4.7 954c08fa6188 1038718f4fd4 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (5m) 15s ago 5m 90.3M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (5m) 15s ago 5m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (5m) 65s ago 5m 14.4M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (5m) 65s ago 5m 18.3M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (3m) 15s ago 13m 498M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (88s) 65s ago 10m 449M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (13m) 15s ago 13m 55.1M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T11:01:32.076 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (10m) 65s ago 10m 45.5M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (74s) 15s ago 11m 17.6M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (70s) 65s ago 10m 3414k - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (9m) 15s ago 9m 229M 1227M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (9m) 15s ago 9m 226M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (8m) 15s ago 8m 188M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (8m) 65s ago 8m 251M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (7m) 65s ago 7m 208M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (7m) 65s ago 7m 205M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (39s) 15s ago 11m 51.3M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.057+0000 7f42a5ffb700 1 -- 172.21.15.134:0/1207248226 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f42a8061190 con 0x7f429806cce0 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 -- 172.21.15.134:0/1207248226 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f429806cce0 msgr2=0x7f429806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:32.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f429806cce0 0x7f429806f190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f429c005fd0 tx=0x7f429c00a560 comp rx=0 tx=0).stop 2024-04-13T11:01:32.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 -- 172.21.15.134:0/1207248226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a8103500 msgr2=0x7f42a8195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:32.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a8103500 0x7f42a8195da0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4294006010 tx=0x7f429400be20 comp rx=0 tx=0).stop 2024-04-13T11:01:32.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 -- 172.21.15.134:0/1207248226 shutdown_connections 2024-04-13T11:01:32.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f429806cce0 0x7f429806f190 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42a8100be0 0x7f42a8195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 --2- 172.21.15.134:0/1207248226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a8103500 0x7f42a8195da0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 -- 172.21.15.134:0/1207248226 >> 172.21.15.134:0/1207248226 conn(0x7f42a80fa5e0 msgr2=0x7f42a80fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:32.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 -- 172.21.15.134:0/1207248226 shutdown_connections 2024-04-13T11:01:32.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.059+0000 7f42af0e6700 1 -- 172.21.15.134:0/1207248226 wait complete. 2024-04-13T11:01:32.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.162+0000 7f09fd421700 1 -- 172.21.15.134:0/4051152613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f8101350 msgr2=0x7f09f81017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:32.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.162+0000 7f09fd421700 1 --2- 172.21.15.134:0/4051152613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f8101350 0x7f09f81017a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009910 tx=0x7f09e8009c20 comp rx=0 tx=0).stop 2024-04-13T11:01:32.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.162+0000 7f09fd421700 1 -- 172.21.15.134:0/4051152613 shutdown_connections 2024-04-13T11:01:32.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.162+0000 7f09fd421700 1 --2- 172.21.15.134:0/4051152613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f8101350 0x7f09f81017a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.162+0000 7f09fd421700 1 --2- 172.21.15.134:0/4051152613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f8100150 0x7f09f8100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.162+0000 7f09fd421700 1 -- 172.21.15.134:0/4051152613 >> 172.21.15.134:0/4051152613 conn(0x7f09f80fb6e0 msgr2=0x7f09f80fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:32.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.162+0000 7f09fd421700 1 -- 172.21.15.134:0/4051152613 shutdown_connections 2024-04-13T11:01:32.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.162+0000 7f09fd421700 1 -- 172.21.15.134:0/4051152613 wait complete. 2024-04-13T11:01:32.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.162+0000 7f09fd421700 1 Processor -- start 2024-04-13T11:01:32.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09fd421700 1 -- start start 2024-04-13T11:01:32.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09fd421700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f8100150 0x7f09f81959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:32.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09fd421700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f8101350 0x7f09f8195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:32.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09fd421700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f8196510 con 0x7f09f8100150 2024-04-13T11:01:32.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09fd421700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f8196650 con 0x7f09f8101350 2024-04-13T11:01:32.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09f6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f8100150 0x7f09f81959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:32.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09f6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f8100150 0x7f09f81959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37678/0 (socket says 172.21.15.134:37678) 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09f6ffd700 1 -- 172.21.15.134:0/204992802 learned_addr learned my addr 172.21.15.134:0/204992802 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09f67fc700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f8101350 0x7f09f8195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09f6ffd700 1 -- 172.21.15.134:0/204992802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f8101350 msgr2=0x7f09f8195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09f6ffd700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f8101350 0x7f09f8195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09f6ffd700 1 -- 172.21.15.134:0/204992802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e80095f0 con 0x7f09f8100150 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09f67fc700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f8101350 0x7f09f8195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.163+0000 7f09f6ffd700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f8100150 0x7f09f81959b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00b480 tx=0x7f09ec00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.164+0000 7f09dffff700 1 -- 172.21.15.134:0/204992802 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09ec0118c0 con 0x7f09f8100150 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.164+0000 7f09fd421700 1 -- 172.21.15.134:0/204992802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f819b100 con 0x7f09f8100150 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.164+0000 7f09dffff700 1 -- 172.21.15.134:0/204992802 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f09ec010380 con 0x7f09f8100150 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.164+0000 7f09dffff700 1 -- 172.21.15.134:0/204992802 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09ec00f510 con 0x7f09f8100150 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.164+0000 7f09fd421700 1 -- 172.21.15.134:0/204992802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f819b6d0 con 0x7f09f8100150 2024-04-13T11:01:32.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.164+0000 7f09fd421700 1 -- 172.21.15.134:0/204992802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f8108c00 con 0x7f09f8100150 2024-04-13T11:01:32.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.165+0000 7f09dffff700 1 -- 172.21.15.134:0/204992802 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f09ec0104f0 con 0x7f09f8100150 2024-04-13T11:01:32.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.165+0000 7f09dffff700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f09e006cce0 0x7f09e006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:32.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.166+0000 7f09dffff700 1 -- 172.21.15.134:0/204992802 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f09ec08c120 con 0x7f09f8100150 2024-04-13T11:01:32.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.166+0000 7f09f67fc700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f09e006cce0 0x7f09e006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:32.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.166+0000 7f09f67fc700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f09e006cce0 0x7f09e006f190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f09e800b5c0 tx=0x7f09e8005960 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:32.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.170+0000 7f09dffff700 1 -- 172.21.15.134:0/204992802 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f09ec059d20 con 0x7f09f8100150 2024-04-13T11:01:32.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.453+0000 7f09fd421700 1 -- 172.21.15.134:0/204992802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f09f8108df0 con 0x7f09f8100150 2024-04-13T11:01:32.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.453+0000 7f09dffff700 1 -- 172.21.15.134:0/204992802 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f09ec0107a0 con 0x7f09f8100150 2024-04-13T11:01:32.454 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:01:32.454 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:01:32.454 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T11:01:32.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:01:32.454 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:01:32.454 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:01:32.455 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:01:32.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.455+0000 7f09fd421700 1 -- 172.21.15.134:0/204992802 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f09e006cce0 msgr2=0x7f09e006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:32.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.455+0000 7f09fd421700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f09e006cce0 0x7f09e006f190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f09e800b5c0 tx=0x7f09e8005960 comp rx=0 tx=0).stop 2024-04-13T11:01:32.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.455+0000 7f09fd421700 1 -- 172.21.15.134:0/204992802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f8100150 msgr2=0x7f09f81959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:32.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.455+0000 7f09fd421700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f8100150 0x7f09f81959b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00b480 tx=0x7f09ec00b840 comp rx=0 tx=0).stop 2024-04-13T11:01:32.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.455+0000 7f09fd421700 1 -- 172.21.15.134:0/204992802 shutdown_connections 2024-04-13T11:01:32.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.455+0000 7f09fd421700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f09e006cce0 0x7f09e006f190 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.455+0000 7f09fd421700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09f8100150 0x7f09f81959b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.455+0000 7f09fd421700 1 --2- 172.21.15.134:0/204992802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f8101350 0x7f09f8195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.455+0000 7f09fd421700 1 -- 172.21.15.134:0/204992802 >> 172.21.15.134:0/204992802 conn(0x7f09f80fb6e0 msgr2=0x7f09f8104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:32.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.456+0000 7f09fd421700 1 -- 172.21.15.134:0/204992802 shutdown_connections 2024-04-13T11:01:32.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.456+0000 7f09fd421700 1 -- 172.21.15.134:0/204992802 wait complete. 2024-04-13T11:01:32.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.560+0000 7f1d899fa700 1 -- 172.21.15.134:0/4177204737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d840fe480 msgr2=0x7f1d840fe890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.560+0000 7f1d899fa700 1 --2- 172.21.15.134:0/4177204737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d840fe480 0x7f1d840fe890 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009910 tx=0x7f1d78009c20 comp rx=0 tx=0).stop 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.560+0000 7f1d899fa700 1 -- 172.21.15.134:0/4177204737 shutdown_connections 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.560+0000 7f1d899fa700 1 --2- 172.21.15.134:0/4177204737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d84101500 0x7f1d84101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.560+0000 7f1d899fa700 1 --2- 172.21.15.134:0/4177204737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d840fe480 0x7f1d840fe890 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.560+0000 7f1d899fa700 1 -- 172.21.15.134:0/4177204737 >> 172.21.15.134:0/4177204737 conn(0x7f1d840f9dd0 msgr2=0x7f1d840fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.560+0000 7f1d899fa700 1 -- 172.21.15.134:0/4177204737 shutdown_connections 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.560+0000 7f1d899fa700 1 -- 172.21.15.134:0/4177204737 wait complete. 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.560+0000 7f1d899fa700 1 Processor -- start 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d899fa700 1 -- start start 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d899fa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d840fe480 0x7f1d84195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:32.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d899fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84101500 0x7f1d84195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d899fa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d841964f0 con 0x7f1d84101500 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d899fa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d84196630 con 0x7f1d840fe480 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d827fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84101500 0x7f1d84195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d827fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84101500 0x7f1d84195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37696/0 (socket says 172.21.15.134:37696) 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d827fc700 1 -- 172.21.15.134:0/280593355 learned_addr learned my addr 172.21.15.134:0/280593355 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d82ffd700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d840fe480 0x7f1d84195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d827fc700 1 -- 172.21.15.134:0/280593355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d840fe480 msgr2=0x7f1d84195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d827fc700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d840fe480 0x7f1d84195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d827fc700 1 -- 172.21.15.134:0/280593355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d780095f0 con 0x7f1d84101500 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.561+0000 7f1d827fc700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84101500 0x7f1d84195ed0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400c8f0 tx=0x7f1d7400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.562+0000 7f1d889f8700 1 -- 172.21.15.134:0/280593355 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d74004a00 con 0x7f1d84101500 2024-04-13T11:01:32.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.562+0000 7f1d899fa700 1 -- 172.21.15.134:0/280593355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8419b0e0 con 0x7f1d84101500 2024-04-13T11:01:32.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.562+0000 7f1d889f8700 1 -- 172.21.15.134:0/280593355 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1066+0+0 (secure 0 0 0) 0x7f1d74005020 con 0x7f1d84101500 2024-04-13T11:01:32.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.562+0000 7f1d899fa700 1 -- 172.21.15.134:0/280593355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8419b6b0 con 0x7f1d84101500 2024-04-13T11:01:32.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.562+0000 7f1d889f8700 1 -- 172.21.15.134:0/280593355 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d74007c40 con 0x7f1d84101500 2024-04-13T11:01:32.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.563+0000 7f1d899fa700 1 -- 172.21.15.134:0/280593355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d84108bf0 con 0x7f1d84101500 2024-04-13T11:01:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.563+0000 7f1d889f8700 1 -- 172.21.15.134:0/280593355 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f1d74005190 con 0x7f1d84101500 2024-04-13T11:01:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.563+0000 7f1d889f8700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1d6c06cce0 0x7f1d6c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:01:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.563+0000 7f1d889f8700 1 -- 172.21.15.134:0/280593355 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1d74013070 con 0x7f1d84101500 2024-04-13T11:01:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.564+0000 7f1d82ffd700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1d6c06cce0 0x7f1d6c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:01:32.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.564+0000 7f1d82ffd700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1d6c06cce0 0x7f1d6c06f190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006010 tx=0x7f1d7800b560 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:01:32.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.568+0000 7f1d889f8700 1 -- 172.21.15.134:0/280593355 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f1d74059e20 con 0x7f1d84101500 2024-04-13T11:01:32.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.789+0000 7f1d899fa700 1 -- 172.21.15.134:0/280593355 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d84105e50 con 0x7f1d6c06cce0 2024-04-13T11:01:32.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.790+0000 7f1d889f8700 1 -- 172.21.15.134:0/280593355 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f1d84105e50 con 0x7f1d6c06cce0 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/2 daemons upgraded", 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading grafana daemons", 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:01:32.791 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:01:32.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 -- 172.21.15.134:0/280593355 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1d6c06cce0 msgr2=0x7f1d6c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:32.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1d6c06cce0 0x7f1d6c06f190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006010 tx=0x7f1d7800b560 comp rx=0 tx=0).stop 2024-04-13T11:01:32.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 -- 172.21.15.134:0/280593355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84101500 msgr2=0x7f1d84195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:01:32.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84101500 0x7f1d84195ed0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400c8f0 tx=0x7f1d7400cc00 comp rx=0 tx=0).stop 2024-04-13T11:01:32.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 -- 172.21.15.134:0/280593355 shutdown_connections 2024-04-13T11:01:32.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1d6c06cce0 0x7f1d6c06f190 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d840fe480 0x7f1d84195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 --2- 172.21.15.134:0/280593355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d84101500 0x7f1d84195ed0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:01:32.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 -- 172.21.15.134:0/280593355 >> 172.21.15.134:0/280593355 conn(0x7f1d840f9dd0 msgr2=0x7f1d84104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:01:32.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 -- 172.21.15.134:0/280593355 shutdown_connections 2024-04-13T11:01:32.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:01:32.793+0000 7f1d899fa700 1 -- 172.21.15.134:0/280593355 wait complete. 2024-04-13T11:01:32.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:32 smithi134 ceph-mon[39696]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:32.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:32 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/204992802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:32 smithi194 ceph-mon[46737]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:32 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/204992802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:33 smithi134 ceph-mon[39696]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:33 smithi134 ceph-mon[39696]: pgmap v60: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:33 smithi134 ceph-mon[39696]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:33 smithi194 ceph-mon[46737]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:33 smithi194 ceph-mon[46737]: pgmap v60: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:33 smithi194 ceph-mon[46737]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:34.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:34 smithi134 ceph-mon[39696]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:34 smithi194 ceph-mon[46737]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:01:35.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:35 smithi134 ceph-mon[39696]: pgmap v61: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:35 smithi194 ceph-mon[46737]: pgmap v61: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:37 smithi194 ceph-mon[46737]: pgmap v62: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:37.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:37 smithi134 ceph-mon[39696]: pgmap v62: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:38.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:01:38.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:38.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:38.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:01:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:39.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:39 smithi134 ceph-mon[39696]: pgmap v63: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:39 smithi194 ceph-mon[46737]: pgmap v63: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:41 smithi134 ceph-mon[39696]: pgmap v64: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:41 smithi194 ceph-mon[46737]: pgmap v64: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:43.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:43 smithi134 ceph-mon[39696]: pgmap v65: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:43 smithi194 ceph-mon[46737]: pgmap v65: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:45.307 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:45 smithi134 ceph-mon[39696]: pgmap v66: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:45.308 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:45 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:45.308 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:45 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:45.308 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:45 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:45.308 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:45 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:45 smithi194 ceph-mon[46737]: pgmap v66: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:45 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:45 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:45 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:45 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:47 smithi134 ceph-mon[39696]: pgmap v67: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:47 smithi194 ceph-mon[46737]: pgmap v67: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: pgmap v68: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:01:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:01:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-13T11:01:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-13T11:01:49.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: Upgrade: Finalizing container_image settings 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-04-13T11:01:49.502 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: Upgrade: Complete! 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:01:49.503 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:49 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: pgmap v68: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:49.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: Upgrade: Finalizing container_image settings 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-13T11:01:49.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: Upgrade: Complete! 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:49.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:01:49.590 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:01:49.590 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:01:49.590 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:49 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:51.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:51 smithi194 ceph-mon[46737]: pgmap v69: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:51.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:51 smithi134 ceph-mon[39696]: pgmap v69: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:53 smithi134 ceph-mon[39696]: pgmap v70: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:53 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:01:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:53 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:53 smithi194 ceph-mon[46737]: pgmap v70: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:53 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:01:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:53 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:01:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:55 smithi194 ceph-mon[46737]: pgmap v71: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:55.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:55 smithi134 ceph-mon[39696]: pgmap v71: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:01:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:57 smithi134 ceph-mon[39696]: pgmap v72: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:57.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:57 smithi194 ceph-mon[46737]: pgmap v72: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:01:59 smithi194 ceph-mon[46737]: pgmap v73: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:01:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:01:59 smithi134 ceph-mon[39696]: pgmap v73: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:01 smithi194 ceph-mon[46737]: pgmap v74: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:01.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:01 smithi134 ceph-mon[39696]: pgmap v74: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:02.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.912+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1007507632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f480ff050 msgr2=0x7f0f480ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:02.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.912+0000 7f0f4cbd0700 1 --2- 172.21.15.134:0/1007507632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f480ff050 0x7f0f480ff460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009910 tx=0x7f0f3c009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:02.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.912+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1007507632 shutdown_connections 2024-04-13T11:02:02.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.912+0000 7f0f4cbd0700 1 --2- 172.21.15.134:0/1007507632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48100250 0x7f0f481006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:02.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.912+0000 7f0f4cbd0700 1 --2- 172.21.15.134:0/1007507632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f480ff050 0x7f0f480ff460 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:02.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.912+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1007507632 >> 172.21.15.134:0/1007507632 conn(0x7f0f480fa600 msgr2=0x7f0f480fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:02.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.912+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1007507632 shutdown_connections 2024-04-13T11:02:02.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.912+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1007507632 wait complete. 2024-04-13T11:02:02.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4cbd0700 1 Processor -- start 2024-04-13T11:02:02.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4cbd0700 1 -- start start 2024-04-13T11:02:02.914 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4cbd0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f480ff050 0x7f0f481958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4cbd0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48100250 0x7f0f48195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4cbd0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48196410 con 0x7f0f480ff050 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4cbd0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48196550 con 0x7f0f48100250 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f480ff050 0x7f0f481958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f480ff050 0x7f0f481958b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59658/0 (socket says 172.21.15.134:59658) 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4659c700 1 -- 172.21.15.134:0/1244802707 learned_addr learned my addr 172.21.15.134:0/1244802707 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f45d9b700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48100250 0x7f0f48195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4659c700 1 -- 172.21.15.134:0/1244802707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48100250 msgr2=0x7f0f48195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4659c700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48100250 0x7f0f48195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f4659c700 1 -- 172.21.15.134:0/1244802707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0095f0 con 0x7f0f480ff050 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.913+0000 7f0f45d9b700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48100250 0x7f0f48195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.914+0000 7f0f4659c700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f480ff050 0x7f0f481958b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c000c00 tx=0x7f0f3c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:02.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.914+0000 7f0f377fe700 1 -- 172.21.15.134:0/1244802707 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f3c01d070 con 0x7f0f480ff050 2024-04-13T11:02:02.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.914+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1244802707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4819afa0 con 0x7f0f480ff050 2024-04-13T11:02:02.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.914+0000 7f0f377fe700 1 -- 172.21.15.134:0/1244802707 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f3c005dc0 con 0x7f0f480ff050 2024-04-13T11:02:02.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.914+0000 7f0f377fe700 1 -- 172.21.15.134:0/1244802707 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f3c003b10 con 0x7f0f480ff050 2024-04-13T11:02:02.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.914+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1244802707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4819b430 con 0x7f0f480ff050 2024-04-13T11:02:02.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.915+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1244802707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f48107a60 con 0x7f0f480ff050 2024-04-13T11:02:02.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.915+0000 7f0f377fe700 1 -- 172.21.15.134:0/1244802707 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f0f3c003d40 con 0x7f0f480ff050 2024-04-13T11:02:02.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.916+0000 7f0f377fe700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0f3006cce0 0x7f0f3006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:02.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.916+0000 7f0f377fe700 1 -- 172.21.15.134:0/1244802707 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f0f3c08dd70 con 0x7f0f480ff050 2024-04-13T11:02:02.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.916+0000 7f0f45d9b700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0f3006cce0 0x7f0f3006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:02.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.916+0000 7f0f45d9b700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0f3006cce0 0x7f0f3006f190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009cb0 tx=0x7f0f38009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:02.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:02.920+0000 7f0f377fe700 1 -- 172.21.15.134:0/1244802707 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f0f3c05ba90 con 0x7f0f480ff050 2024-04-13T11:02:03.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.134+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1244802707 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f48069370 con 0x7f0f3006cce0 2024-04-13T11:02:03.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.135+0000 7f0f377fe700 1 -- 172.21.15.134:0/1244802707 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f0f48069370 con 0x7f0f3006cce0 2024-04-13T11:02:03.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1244802707 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0f3006cce0 msgr2=0x7f0f3006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:03.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0f3006cce0 0x7f0f3006f190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009cb0 tx=0x7f0f38009260 comp rx=0 tx=0).stop 2024-04-13T11:02:03.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1244802707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f480ff050 msgr2=0x7f0f481958b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:03.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f480ff050 0x7f0f481958b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c000c00 tx=0x7f0f3c00be90 comp rx=0 tx=0).stop 2024-04-13T11:02:03.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1244802707 shutdown_connections 2024-04-13T11:02:03.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0f3006cce0 0x7f0f3006f190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:03.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f480ff050 0x7f0f481958b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:03.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 --2- 172.21.15.134:0/1244802707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f48100250 0x7f0f48195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:03.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1244802707 >> 172.21.15.134:0/1244802707 conn(0x7f0f480fa600 msgr2=0x7f0f48068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:03.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1244802707 shutdown_connections 2024-04-13T11:02:03.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:03.137+0000 7f0f4cbd0700 1 -- 172.21.15.134:0/1244802707 wait complete. 2024-04-13T11:02:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:03 smithi194 ceph-mon[46737]: pgmap v75: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:03.919 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:03 smithi134 ceph-mon[39696]: pgmap v75: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:03.941 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-04-13T11:02:04.213 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:04.744 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:04 smithi134 ceph-mon[39696]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:04.747 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:04 smithi194 ceph-mon[46737]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:05 smithi194 ceph-mon[46737]: pgmap v76: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:05 smithi134 ceph-mon[39696]: pgmap v76: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:07.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.154+0000 7f4b0a76f700 1 -- 172.21.15.134:0/2052021913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b040ff390 msgr2=0x7f4b040ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:07.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.154+0000 7f4b0a76f700 1 --2- 172.21.15.134:0/2052021913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b040ff390 0x7f4b040ff760 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009910 tx=0x7f4af4009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:07.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.154+0000 7f4b0a76f700 1 -- 172.21.15.134:0/2052021913 shutdown_connections 2024-04-13T11:02:07.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.154+0000 7f4b0a76f700 1 --2- 172.21.15.134:0/2052021913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040ffd30 0x7f4b04103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.154+0000 7f4b0a76f700 1 --2- 172.21.15.134:0/2052021913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b040ff390 0x7f4b040ff760 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.154+0000 7f4b0a76f700 1 -- 172.21.15.134:0/2052021913 >> 172.21.15.134:0/2052021913 conn(0x7f4b04074f50 msgr2=0x7f4b04075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.154+0000 7f4b0a76f700 1 -- 172.21.15.134:0/2052021913 shutdown_connections 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.154+0000 7f4b0a76f700 1 -- 172.21.15.134:0/2052021913 wait complete. 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.155+0000 7f4b0a76f700 1 Processor -- start 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.155+0000 7f4b0a76f700 1 -- start start 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.155+0000 7f4b0a76f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b040ff390 0x7f4b04196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.155+0000 7f4b0a76f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040ffd30 0x7f4b04196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.155+0000 7f4b0a76f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04197610 con 0x7f4b040ff390 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.155+0000 7f4b0a76f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04197750 con 0x7f4b040ffd30 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.155+0000 7f4b03fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b040ff390 0x7f4b04196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.155+0000 7f4b03fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b040ff390 0x7f4b04196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59682/0 (socket says 172.21.15.134:59682) 2024-04-13T11:02:07.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.155+0000 7f4b03fff700 1 -- 172.21.15.134:0/3946656289 learned_addr learned my addr 172.21.15.134:0/3946656289 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:07.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.156+0000 7f4b037fe700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040ffd30 0x7f4b04196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:07.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.156+0000 7f4b03fff700 1 -- 172.21.15.134:0/3946656289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040ffd30 msgr2=0x7f4b04196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:07.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.156+0000 7f4b03fff700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040ffd30 0x7f4b04196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:07.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.156+0000 7f4b03fff700 1 -- 172.21.15.134:0/3946656289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af40095f0 con 0x7f4b040ff390 2024-04-13T11:02:07.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.156+0000 7f4b03fff700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b040ff390 0x7f4b04196ab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4af4006010 tx=0x7f4af400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:07.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.156+0000 7f4b017fa700 1 -- 172.21.15.134:0/3946656289 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af401d070 con 0x7f4b040ff390 2024-04-13T11:02:07.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.156+0000 7f4b017fa700 1 -- 172.21.15.134:0/3946656289 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4af4005710 con 0x7f4b040ff390 2024-04-13T11:02:07.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.156+0000 7f4b0a76f700 1 -- 172.21.15.134:0/3946656289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0419fb20 con 0x7f4b040ff390 2024-04-13T11:02:07.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.156+0000 7f4b017fa700 1 -- 172.21.15.134:0/3946656289 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af400fe20 con 0x7f4b040ff390 2024-04-13T11:02:07.158 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.156+0000 7f4b0a76f700 1 -- 172.21.15.134:0/3946656289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0419ff30 con 0x7f4b040ff390 2024-04-13T11:02:07.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.157+0000 7f4b0a76f700 1 -- 172.21.15.134:0/3946656289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b04107650 con 0x7f4b040ff390 2024-04-13T11:02:07.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.158+0000 7f4b017fa700 1 -- 172.21.15.134:0/3946656289 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f4af4003a60 con 0x7f4b040ff390 2024-04-13T11:02:07.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.158+0000 7f4b017fa700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4af006cce0 0x7f4af006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:07.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.159+0000 7f4b017fa700 1 -- 172.21.15.134:0/3946656289 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f4af408da90 con 0x7f4b040ff390 2024-04-13T11:02:07.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.159+0000 7f4b037fe700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4af006cce0 0x7f4af006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:07.160 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.159+0000 7f4b037fe700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4af006cce0 0x7f4af006f190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b04068c80 tx=0x7f4aec00b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:07.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.162+0000 7f4b017fa700 1 -- 172.21.15.134:0/3946656289 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f4af4057b60 con 0x7f4b040ff390 2024-04-13T11:02:07.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.441+0000 7f4b0a76f700 1 -- 172.21.15.134:0/3946656289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b0404ea50 con 0x7f4b040ff390 2024-04-13T11:02:07.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.441+0000 7f4b017fa700 1 -- 172.21.15.134:0/3946656289 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f4af405b180 con 0x7f4b040ff390 2024-04-13T11:02:07.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 -- 172.21.15.134:0/3946656289 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4af006cce0 msgr2=0x7f4af006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4af006cce0 0x7f4af006f190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b04068c80 tx=0x7f4aec00b410 comp rx=0 tx=0).stop 2024-04-13T11:02:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 -- 172.21.15.134:0/3946656289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b040ff390 msgr2=0x7f4b04196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b040ff390 0x7f4b04196ab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4af4006010 tx=0x7f4af400bd70 comp rx=0 tx=0).stop 2024-04-13T11:02:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 -- 172.21.15.134:0/3946656289 shutdown_connections 2024-04-13T11:02:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4af006cce0 0x7f4af006f190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b040ff390 0x7f4b04196ab0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 --2- 172.21.15.134:0/3946656289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b040ffd30 0x7f4b04196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 -- 172.21.15.134:0/3946656289 >> 172.21.15.134:0/3946656289 conn(0x7f4b04074f50 msgr2=0x7f4b040fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 -- 172.21.15.134:0/3946656289 shutdown_connections 2024-04-13T11:02:07.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:07.444+0000 7f4b0a76f700 1 -- 172.21.15.134:0/3946656289 wait complete. 2024-04-13T11:02:07.454 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:02:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:07 smithi134 ceph-mon[39696]: pgmap v77: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:07 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/3946656289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:02:07.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:07 smithi194 ceph-mon[46737]: pgmap v77: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:07.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:07 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/3946656289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:02:08.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-04-13T11:02:08.546 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:08.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:08 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:02:08.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:08 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:02:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:09 smithi194 ceph-mon[46737]: pgmap v78: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:09.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:09 smithi134 ceph-mon[39696]: pgmap v78: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:10.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.597+0000 7ff41adde700 1 -- 172.21.15.134:0/3806230381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4140ffc60 msgr2=0x7ff414103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:10.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.597+0000 7ff41adde700 1 --2- 172.21.15.134:0/3806230381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4140ffc60 0x7ff414103c30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff400009910 tx=0x7ff400009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:10.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.597+0000 7ff41adde700 1 -- 172.21.15.134:0/3806230381 shutdown_connections 2024-04-13T11:02:10.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.597+0000 7ff41adde700 1 --2- 172.21.15.134:0/3806230381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4140ffc60 0x7ff414103c30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:10.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.597+0000 7ff41adde700 1 --2- 172.21.15.134:0/3806230381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4140ff2c0 0x7ff4140ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:10.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.597+0000 7ff41adde700 1 -- 172.21.15.134:0/3806230381 >> 172.21.15.134:0/3806230381 conn(0x7ff4140fab80 msgr2=0x7ff4140fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:10.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.597+0000 7ff41adde700 1 -- 172.21.15.134:0/3806230381 shutdown_connections 2024-04-13T11:02:10.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.597+0000 7ff41adde700 1 -- 172.21.15.134:0/3806230381 wait complete. 2024-04-13T11:02:10.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff41adde700 1 Processor -- start 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff41adde700 1 -- start start 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff41adde700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4140ff2c0 0x7ff4141948e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff41adde700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4140ffc60 0x7ff414194e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff41adde700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff414195360 con 0x7ff4140ff2c0 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff41adde700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4141954d0 con 0x7ff4140ffc60 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff418b7a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4140ff2c0 0x7ff4141948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff418b7a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4140ff2c0 0x7ff4141948e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54854/0 (socket says 172.21.15.134:54854) 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff418b7a700 1 -- 172.21.15.134:0/776546817 learned_addr learned my addr 172.21.15.134:0/776546817 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff413fff700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4140ffc60 0x7ff414194e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff418b7a700 1 -- 172.21.15.134:0/776546817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4140ffc60 msgr2=0x7ff414194e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff418b7a700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4140ffc60 0x7ff414194e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff418b7a700 1 -- 172.21.15.134:0/776546817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4000095f0 con 0x7ff4140ff2c0 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff418b7a700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4140ff2c0 0x7ff4141948e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff40800c8a0 tx=0x7ff40800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:10.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.598+0000 7ff411ffb700 1 -- 172.21.15.134:0/776546817 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff40800cea0 con 0x7ff4140ff2c0 2024-04-13T11:02:10.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.599+0000 7ff411ffb700 1 -- 172.21.15.134:0/776546817 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff408004830 con 0x7ff4140ff2c0 2024-04-13T11:02:10.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.599+0000 7ff41adde700 1 -- 172.21.15.134:0/776546817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4141a1f50 con 0x7ff4140ff2c0 2024-04-13T11:02:10.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.599+0000 7ff411ffb700 1 -- 172.21.15.134:0/776546817 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff408005500 con 0x7ff4140ff2c0 2024-04-13T11:02:10.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.599+0000 7ff41adde700 1 -- 172.21.15.134:0/776546817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4141a22b0 con 0x7ff4140ff2c0 2024-04-13T11:02:10.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.600+0000 7ff41adde700 1 -- 172.21.15.134:0/776546817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff414107630 con 0x7ff4140ff2c0 2024-04-13T11:02:10.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.600+0000 7ff411ffb700 1 -- 172.21.15.134:0/776546817 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7ff4080049a0 con 0x7ff4140ff2c0 2024-04-13T11:02:10.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.601+0000 7ff411ffb700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff40406cce0 0x7ff40406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:10.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.601+0000 7ff411ffb700 1 -- 172.21.15.134:0/776546817 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ff40808c0c0 con 0x7ff4140ff2c0 2024-04-13T11:02:10.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.601+0000 7ff413fff700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff40406cce0 0x7ff40406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:10.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.601+0000 7ff413fff700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff40406cce0 0x7ff40406f190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff414069650 tx=0x7ff40001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:10.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.605+0000 7ff411ffb700 1 -- 172.21.15.134:0/776546817 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7ff408059cc0 con 0x7ff4140ff2c0 2024-04-13T11:02:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.882+0000 7ff41adde700 1 -- 172.21.15.134:0/776546817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff41404ea50 con 0x7ff4140ff2c0 2024-04-13T11:02:10.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.882+0000 7ff411ffb700 1 -- 172.21.15.134:0/776546817 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7ff408059850 con 0x7ff4140ff2c0 2024-04-13T11:02:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 -- 172.21.15.134:0/776546817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff40406cce0 msgr2=0x7ff40406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff40406cce0 0x7ff40406f190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff414069650 tx=0x7ff40001a040 comp rx=0 tx=0).stop 2024-04-13T11:02:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 -- 172.21.15.134:0/776546817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4140ff2c0 msgr2=0x7ff4141948e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4140ff2c0 0x7ff4141948e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff40800c8a0 tx=0x7ff40800cc60 comp rx=0 tx=0).stop 2024-04-13T11:02:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 -- 172.21.15.134:0/776546817 shutdown_connections 2024-04-13T11:02:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff40406cce0 0x7ff40406f190 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4140ff2c0 0x7ff4141948e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:10.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 --2- 172.21.15.134:0/776546817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4140ffc60 0x7ff414194e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 -- 172.21.15.134:0/776546817 >> 172.21.15.134:0/776546817 conn(0x7ff4140fab80 msgr2=0x7ff4140fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 -- 172.21.15.134:0/776546817 shutdown_connections 2024-04-13T11:02:10.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:10.884+0000 7ff41adde700 1 -- 172.21.15.134:0/776546817 wait complete. 2024-04-13T11:02:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)" 2024-04-13T11:02:11.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:11 smithi134 ceph-mon[39696]: pgmap v79: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:11.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:11 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/776546817' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:02:11.735 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-04-13T11:02:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:11 smithi194 ceph-mon[46737]: pgmap v79: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:11 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/776546817' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:02:11.967 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:13 smithi134 ceph-mon[39696]: pgmap v80: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:13.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:13 smithi194 ceph-mon[46737]: pgmap v80: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.956+0000 7fcfcd64f700 1 -- 172.21.15.134:0/4016692108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc80ff340 msgr2=0x7fcfc80ff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.956+0000 7fcfcd64f700 1 --2- 172.21.15.134:0/4016692108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc80ff340 0x7fcfc80ff710 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009910 tx=0x7fcfb8009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.956+0000 7fcfcd64f700 1 -- 172.21.15.134:0/4016692108 shutdown_connections 2024-04-13T11:02:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.956+0000 7fcfcd64f700 1 --2- 172.21.15.134:0/4016692108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc80ffce0 0x7fcfc8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.956+0000 7fcfcd64f700 1 --2- 172.21.15.134:0/4016692108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc80ff340 0x7fcfc80ff710 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.956+0000 7fcfcd64f700 1 -- 172.21.15.134:0/4016692108 >> 172.21.15.134:0/4016692108 conn(0x7fcfc80fabe0 msgr2=0x7fcfc80fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.956+0000 7fcfcd64f700 1 -- 172.21.15.134:0/4016692108 shutdown_connections 2024-04-13T11:02:13.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.956+0000 7fcfcd64f700 1 -- 172.21.15.134:0/4016692108 wait complete. 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.956+0000 7fcfcd64f700 1 Processor -- start 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfcd64f700 1 -- start start 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfcd64f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc80ff340 0x7fcfc819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfcd64f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc80ffce0 0x7fcfc819ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfcd64f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc819b510 con 0x7fcfc80ffce0 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfcd64f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc81949c0 con 0x7fcfc80ff340 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfc67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc80ffce0 0x7fcfc819ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfc67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc80ffce0 0x7fcfc819ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54870/0 (socket says 172.21.15.134:54870) 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfc67fc700 1 -- 172.21.15.134:0/2484147323 learned_addr learned my addr 172.21.15.134:0/2484147323 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfc6ffd700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc80ff340 0x7fcfc819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:13.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfc67fc700 1 -- 172.21.15.134:0/2484147323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc80ff340 msgr2=0x7fcfc819a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfc67fc700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc80ff340 0x7fcfc819a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfc67fc700 1 -- 172.21.15.134:0/2484147323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80095f0 con 0x7fcfc80ffce0 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.957+0000 7fcfc67fc700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc80ffce0 0x7fcfc819ae80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc007b50 tx=0x7fcfbc007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.958+0000 7fcfaffff700 1 -- 172.21.15.134:0/2484147323 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfbc011070 con 0x7fcfc80ffce0 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.958+0000 7fcfcd64f700 1 -- 172.21.15.134:0/2484147323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc8194c40 con 0x7fcfc80ffce0 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.958+0000 7fcfaffff700 1 -- 172.21.15.134:0/2484147323 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcfbc00eaf0 con 0x7fcfc80ffce0 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.958+0000 7fcfaffff700 1 -- 172.21.15.134:0/2484147323 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfbc00ac10 con 0x7fcfc80ffce0 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.958+0000 7fcfcd64f700 1 -- 172.21.15.134:0/2484147323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc8195190 con 0x7fcfc80ffce0 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.959+0000 7fcfcd64f700 1 -- 172.21.15.134:0/2484147323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc804ea50 con 0x7fcfc80ffce0 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.959+0000 7fcfaffff700 1 -- 172.21.15.134:0/2484147323 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7fcfbc00a440 con 0x7fcfc80ffce0 2024-04-13T11:02:13.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.959+0000 7fcfaffff700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcfb006cce0 0x7fcfb006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:13.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.960+0000 7fcfaffff700 1 -- 172.21.15.134:0/2484147323 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fcfbc08da90 con 0x7fcfc80ffce0 2024-04-13T11:02:13.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.960+0000 7fcfc6ffd700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcfb006cce0 0x7fcfb006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:13.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.960+0000 7fcfc6ffd700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcfb006cce0 0x7fcfb006f190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800b5c0 tx=0x7fcfb8005fd0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:13.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:13.964+0000 7fcfaffff700 1 -- 172.21.15.134:0/2484147323 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fcfbc05b400 con 0x7fcfc80ffce0 2024-04-13T11:02:14.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.243+0000 7fcfcd64f700 1 -- 172.21.15.134:0/2484147323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcfc8195ed0 con 0x7fcfc80ffce0 2024-04-13T11:02:14.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.243+0000 7fcfaffff700 1 -- 172.21.15.134:0/2484147323 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fcfbc05b220 con 0x7fcfc80ffce0 2024-04-13T11:02:14.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 -- 172.21.15.134:0/2484147323 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcfb006cce0 msgr2=0x7fcfb006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:14.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcfb006cce0 0x7fcfb006f190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800b5c0 tx=0x7fcfb8005fd0 comp rx=0 tx=0).stop 2024-04-13T11:02:14.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 -- 172.21.15.134:0/2484147323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc80ffce0 msgr2=0x7fcfc819ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:14.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc80ffce0 0x7fcfc819ae80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc007b50 tx=0x7fcfbc007f10 comp rx=0 tx=0).stop 2024-04-13T11:02:14.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 -- 172.21.15.134:0/2484147323 shutdown_connections 2024-04-13T11:02:14.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fcfb006cce0 0x7fcfb006f190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:14.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfc80ff340 0x7fcfc819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:14.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 --2- 172.21.15.134:0/2484147323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc80ffce0 0x7fcfc819ae80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:14.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 -- 172.21.15.134:0/2484147323 >> 172.21.15.134:0/2484147323 conn(0x7fcfc80fabe0 msgr2=0x7fcfc80fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:14.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 -- 172.21.15.134:0/2484147323 shutdown_connections 2024-04-13T11:02:14.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:14.245+0000 7fcfcd64f700 1 -- 172.21.15.134:0/2484147323 wait complete. 2024-04-13T11:02:14.256 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:02:14.593 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:14 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/2484147323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:02:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:14 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/2484147323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:02:14.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-04-13T11:02:15.137 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:15.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:15 smithi134 ceph-mon[39696]: pgmap v81: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:15.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:15 smithi194 ceph-mon[46737]: pgmap v81: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.004+0000 7f85cc3af700 1 -- 172.21.15.134:0/3507263182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c4068fd0 msgr2=0x7f85c4104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.004+0000 7f85cc3af700 1 --2- 172.21.15.134:0/3507263182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c4068fd0 0x7f85c4104df0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009910 tx=0x7f85b4009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.004+0000 7f85cc3af700 1 -- 172.21.15.134:0/3507263182 shutdown_connections 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.004+0000 7f85cc3af700 1 --2- 172.21.15.134:0/3507263182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c4068fd0 0x7f85c4104df0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.004+0000 7f85cc3af700 1 --2- 172.21.15.134:0/3507263182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4068630 0x7f85c4068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.004+0000 7f85cc3af700 1 -- 172.21.15.134:0/3507263182 >> 172.21.15.134:0/3507263182 conn(0x7f85c4074f50 msgr2=0x7f85c4075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.004+0000 7f85cc3af700 1 -- 172.21.15.134:0/3507263182 shutdown_connections 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.004+0000 7f85cc3af700 1 -- 172.21.15.134:0/3507263182 wait complete. 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.004+0000 7f85cc3af700 1 Processor -- start 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.004+0000 7f85cc3af700 1 -- start start 2024-04-13T11:02:17.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85cc3af700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4068630 0x7f85c40ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85cc3af700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c4068fd0 0x7f85c40ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85cc3af700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40ffc80 con 0x7f85c4068fd0 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85cc3af700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40ffdc0 con 0x7f85c4068630 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85c994a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c4068fd0 0x7f85c40ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85c994a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c4068fd0 0x7f85c40ff740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54900/0 (socket says 172.21.15.134:54900) 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85c994a700 1 -- 172.21.15.134:0/3463987517 learned_addr learned my addr 172.21.15.134:0/3463987517 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85ca14b700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4068630 0x7f85c40ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85c994a700 1 -- 172.21.15.134:0/3463987517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4068630 msgr2=0x7f85c40ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85c994a700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4068630 0x7f85c40ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85c994a700 1 -- 172.21.15.134:0/3463987517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b40095f0 con 0x7f85c4068fd0 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85c994a700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c4068fd0 0x7f85c40ff740 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f85b40092e0 tx=0x7f85b400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85bb7fe700 1 -- 172.21.15.134:0/3463987517 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b401d070 con 0x7f85c4068fd0 2024-04-13T11:02:17.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85bb7fe700 1 -- 172.21.15.134:0/3463987517 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85b4005dc0 con 0x7f85c4068fd0 2024-04-13T11:02:17.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85cc3af700 1 -- 172.21.15.134:0/3463987517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4100040 con 0x7f85c4068fd0 2024-04-13T11:02:17.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.005+0000 7f85bb7fe700 1 -- 172.21.15.134:0/3463987517 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b4021410 con 0x7f85c4068fd0 2024-04-13T11:02:17.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.006+0000 7f85cc3af700 1 -- 172.21.15.134:0/3463987517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c41a22a0 con 0x7f85c4068fd0 2024-04-13T11:02:17.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.006+0000 7f85cc3af700 1 -- 172.21.15.134:0/3463987517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c41086d0 con 0x7f85c4068fd0 2024-04-13T11:02:17.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.007+0000 7f85bb7fe700 1 -- 172.21.15.134:0/3463987517 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f85b400f460 con 0x7f85c4068fd0 2024-04-13T11:02:17.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.007+0000 7f85bb7fe700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f85b006cce0 0x7f85b006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:17.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.007+0000 7f85bb7fe700 1 -- 172.21.15.134:0/3463987517 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f85b408d700 con 0x7f85c4068fd0 2024-04-13T11:02:17.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.007+0000 7f85ca14b700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f85b006cce0 0x7f85b006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:17.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.008+0000 7f85ca14b700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f85b006cce0 0x7f85b006f190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009a10 tx=0x7f85c0009190 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:17.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.012+0000 7f85bb7fe700 1 -- 172.21.15.134:0/3463987517 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f85b4057870 con 0x7f85c4068fd0 2024-04-13T11:02:17.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:17.225+0000 7f85cc3af700 1 -- 172.21.15.134:0/3463987517 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c", "target": ["mon-mgr", ""]}) v1 -- 0x7f85c402cd90 con 0x7f85b006cce0 2024-04-13T11:02:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:17 smithi134 ceph-mon[39696]: pgmap v82: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:17.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:17 smithi194 ceph-mon[46737]: pgmap v82: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:18.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:18 smithi194 ceph-mon[46737]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:18.800 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:18 smithi134 ceph-mon[39696]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:18.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.845+0000 7f85bb7fe700 1 -- 172.21.15.134:0/3463987517 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5393 (secure 0 0 0) 0x7f85c402cd90 con 0x7f85b006cce0 2024-04-13T11:02:18.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 -- 172.21.15.134:0/3463987517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f85b006cce0 msgr2=0x7f85b006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:18.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f85b006cce0 0x7f85b006f190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009a10 tx=0x7f85c0009190 comp rx=0 tx=0).stop 2024-04-13T11:02:18.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 -- 172.21.15.134:0/3463987517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c4068fd0 msgr2=0x7f85c40ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:18.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c4068fd0 0x7f85c40ff740 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f85b40092e0 tx=0x7f85b400bd70 comp rx=0 tx=0).stop 2024-04-13T11:02:18.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 -- 172.21.15.134:0/3463987517 shutdown_connections 2024-04-13T11:02:18.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f85b006cce0 0x7f85b006f190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:18.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4068630 0x7f85c40ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:18.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 --2- 172.21.15.134:0/3463987517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c4068fd0 0x7f85c40ff740 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:18.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 -- 172.21.15.134:0/3463987517 >> 172.21.15.134:0/3463987517 conn(0x7f85c4074f50 msgr2=0x7f85c40fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:18.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 -- 172.21.15.134:0/3463987517 shutdown_connections 2024-04-13T11:02:18.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:18.848+0000 7f85cc3af700 1 -- 172.21.15.134:0/3463987517 wait complete. 2024-04-13T11:02:18.860 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:02:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:19 smithi134 ceph-mon[39696]: pgmap v83: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:19.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph orch ps' 2024-04-13T11:02:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:19 smithi194 ceph-mon[46737]: pgmap v83: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:19.964 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:21.552 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:21 smithi134 ceph-mon[39696]: pgmap v84: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:21 smithi194 ceph-mon[46737]: pgmap v84: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.787+0000 7f102a0bd700 1 -- 172.21.15.134:0/2492464476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10240ffc30 msgr2=0x7f102410a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.787+0000 7f102a0bd700 1 --2- 172.21.15.134:0/2492464476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10240ffc30 0x7f102410a6a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1014009940 tx=0x7f1014009c50 comp rx=0 tx=0).stop 2024-04-13T11:02:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.787+0000 7f102a0bd700 1 -- 172.21.15.134:0/2492464476 shutdown_connections 2024-04-13T11:02:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.787+0000 7f102a0bd700 1 --2- 172.21.15.134:0/2492464476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10240ffc30 0x7f102410a6a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:21.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.787+0000 7f102a0bd700 1 --2- 172.21.15.134:0/2492464476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10240ff320 0x7f10240ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.787+0000 7f102a0bd700 1 -- 172.21.15.134:0/2492464476 >> 172.21.15.134:0/2492464476 conn(0x7f10240748b0 msgr2=0x7f1024074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.787+0000 7f102a0bd700 1 -- 172.21.15.134:0/2492464476 shutdown_connections 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.787+0000 7f102a0bd700 1 -- 172.21.15.134:0/2492464476 wait complete. 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f102a0bd700 1 Processor -- start 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f102a0bd700 1 -- start start 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f102a0bd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10240ff320 0x7f102419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f102a0bd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10240ffc30 0x7f102419bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f102a0bd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102419c570 con 0x7f10240ff320 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f102a0bd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1024195a20 con 0x7f10240ffc30 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f10237fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10240ff320 0x7f102419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f10237fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10240ff320 0x7f102419b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42596/0 (socket says 172.21.15.134:42596) 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f10237fe700 1 -- 172.21.15.134:0/1349023983 learned_addr learned my addr 172.21.15.134:0/1349023983 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:21.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f1022ffd700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10240ffc30 0x7f102419bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f10237fe700 1 -- 172.21.15.134:0/1349023983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10240ffc30 msgr2=0x7f102419bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f10237fe700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10240ffc30 0x7f102419bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f10237fe700 1 -- 172.21.15.134:0/1349023983 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140095f0 con 0x7f10240ff320 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f1022ffd700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10240ffc30 0x7f102419bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.788+0000 7f10237fe700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10240ff320 0x7f102419b9a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c8a0 tx=0x7f100c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.789+0000 7f1020ff9700 1 -- 172.21.15.134:0/1349023983 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f100c00cea0 con 0x7f10240ff320 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.789+0000 7f102a0bd700 1 -- 172.21.15.134:0/1349023983 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1024195d00 con 0x7f10240ff320 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.789+0000 7f1020ff9700 1 -- 172.21.15.134:0/1349023983 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f100c004830 con 0x7f10240ff320 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.789+0000 7f1020ff9700 1 -- 172.21.15.134:0/1349023983 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f100c005500 con 0x7f10240ff320 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.789+0000 7f102a0bd700 1 -- 172.21.15.134:0/1349023983 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1024196250 con 0x7f10240ff320 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.790+0000 7f102a0bd700 1 -- 172.21.15.134:0/1349023983 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1024107da0 con 0x7f10240ff320 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.790+0000 7f1020ff9700 1 -- 172.21.15.134:0/1349023983 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f100c0049a0 con 0x7f10240ff320 2024-04-13T11:02:21.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.790+0000 7f1020ff9700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f101006cce0 0x7f101006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:21.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.791+0000 7f1020ff9700 1 -- 172.21.15.134:0/1349023983 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f100c08c140 con 0x7f10240ff320 2024-04-13T11:02:21.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.791+0000 7f1022ffd700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f101006cce0 0x7f101006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:21.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.791+0000 7f1022ffd700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f101006cce0 0x7f101006f190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1014000c00 tx=0x7f1014005fb0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:21.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:21.795+0000 7f1020ff9700 1 -- 172.21.15.134:0/1349023983 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f100c059d40 con 0x7f10240ff320 2024-04-13T11:02:22.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.000+0000 7f102a0bd700 1 -- 172.21.15.134:0/1349023983 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1024196590 con 0x7f101006cce0 2024-04-13T11:02:22.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.010+0000 7f1020ff9700 1 -- 172.21.15.134:0/1349023983 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f1024196590 con 0x7f101006cce0 2024-04-13T11:02:22.011 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (71s) 37s ago 12m 15.5M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (12m) 37s ago 12m 8024k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (11m) 115s ago 11m 7549k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (12m) 37s ago 12m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (11m) 115s ago 11m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (44s) 37s ago 12m 46.4M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (6m) 37s ago 6m 90.1M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (6m) 37s ago 6m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (6m) 115s ago 6m 14.4M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (6m) 115s ago 6m 18.3M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (3m) 37s ago 14m 500M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (2m) 115s ago 11m 449M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (14m) 37s ago 14m 55.9M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T11:02:22.012 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (11m) 115s ago 11m 45.5M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T11:02:22.013 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 37s ago 12m 18.2M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:02:22.013 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (2m) 115s ago 11m 3414k - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:02:22.013 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (10m) 37s ago 10m 230M 1227M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T11:02:22.013 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (10m) 37s ago 10m 226M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T11:02:22.013 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (9m) 37s ago 9m 188M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T11:02:22.013 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (9m) 115s ago 9m 251M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T11:02:22.013 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (8m) 115s ago 8m 208M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:02:22.013 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (8m) 115s ago 8m 205M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:02:22.013 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (89s) 37s ago 12m 51.7M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:02:22.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 -- 172.21.15.134:0/1349023983 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f101006cce0 msgr2=0x7f101006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:22.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f101006cce0 0x7f101006f190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1014000c00 tx=0x7f1014005fb0 comp rx=0 tx=0).stop 2024-04-13T11:02:22.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 -- 172.21.15.134:0/1349023983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10240ff320 msgr2=0x7f102419b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:22.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10240ff320 0x7f102419b9a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c8a0 tx=0x7f100c00cc60 comp rx=0 tx=0).stop 2024-04-13T11:02:22.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 -- 172.21.15.134:0/1349023983 shutdown_connections 2024-04-13T11:02:22.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f101006cce0 0x7f101006f190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:22.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10240ff320 0x7f102419b9a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:22.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 --2- 172.21.15.134:0/1349023983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10240ffc30 0x7f102419bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:22.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 -- 172.21.15.134:0/1349023983 >> 172.21.15.134:0/1349023983 conn(0x7f10240748b0 msgr2=0x7f1024104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:22.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 -- 172.21.15.134:0/1349023983 shutdown_connections 2024-04-13T11:02:22.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:22.013+0000 7f102a0bd700 1 -- 172.21.15.134:0/1349023983 wait complete. 2024-04-13T11:02:22.771 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-13T11:02:22.772 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T11:02:22.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-04-13T11:02:23.001 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:23 smithi194 ceph-mon[46737]: pgmap v85: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:23 smithi194 ceph-mon[46737]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:23 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:02:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:23 smithi134 ceph-mon[39696]: pgmap v85: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:23 smithi134 ceph-mon[39696]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:23 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:02:24.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.897+0000 7fd444f1c700 1 -- 172.21.15.134:0/2895843646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd440100400 msgr2=0x7fd4401007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:24.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.897+0000 7fd444f1c700 1 --2- 172.21.15.134:0/2895843646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd440100400 0x7fd4401007d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd434009910 tx=0x7fd434009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:24.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.898+0000 7fd444f1c700 1 -- 172.21.15.134:0/2895843646 shutdown_connections 2024-04-13T11:02:24.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.898+0000 7fd444f1c700 1 --2- 172.21.15.134:0/2895843646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd440100da0 0x7fd440104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:24.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.898+0000 7fd444f1c700 1 --2- 172.21.15.134:0/2895843646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd440100400 0x7fd4401007d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:24.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.898+0000 7fd444f1c700 1 -- 172.21.15.134:0/2895843646 >> 172.21.15.134:0/2895843646 conn(0x7fd4400fbca0 msgr2=0x7fd4400fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.898+0000 7fd444f1c700 1 -- 172.21.15.134:0/2895843646 shutdown_connections 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.898+0000 7fd444f1c700 1 -- 172.21.15.134:0/2895843646 wait complete. 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.898+0000 7fd444f1c700 1 Processor -- start 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.898+0000 7fd444f1c700 1 -- start start 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd444f1c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd440100400 0x7fd440073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd444f1c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd440100da0 0x7fd440073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd444f1c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd440073ad0 con 0x7fd440100da0 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd444f1c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd440073c10 con 0x7fd440100400 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd43dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd440100da0 0x7fd440073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd43dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd440100da0 0x7fd440073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42614/0 (socket says 172.21.15.134:42614) 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd43dd9b700 1 -- 172.21.15.134:0/1349989428 learned_addr learned my addr 172.21.15.134:0/1349989428 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd43e59c700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd440100400 0x7fd440073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd43dd9b700 1 -- 172.21.15.134:0/1349989428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd440100400 msgr2=0x7fd440073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:24.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd43dd9b700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd440100400 0x7fd440073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:24.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd43dd9b700 1 -- 172.21.15.134:0/1349989428 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340095f0 con 0x7fd440100da0 2024-04-13T11:02:24.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd43dd9b700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd440100da0 0x7fd440073590 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd43000d900 tx=0x7fd43000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:24.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd42f7fe700 1 -- 172.21.15.134:0/1349989428 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd430009900 con 0x7fd440100da0 2024-04-13T11:02:24.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd444f1c700 1 -- 172.21.15.134:0/1349989428 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4401a1e10 con 0x7fd440100da0 2024-04-13T11:02:24.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd42f7fe700 1 -- 172.21.15.134:0/1349989428 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd430010460 con 0x7fd440100da0 2024-04-13T11:02:24.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd42f7fe700 1 -- 172.21.15.134:0/1349989428 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd43000f5f0 con 0x7fd440100da0 2024-04-13T11:02:24.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.899+0000 7fd444f1c700 1 -- 172.21.15.134:0/1349989428 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4401a2220 con 0x7fd440100da0 2024-04-13T11:02:24.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.900+0000 7fd444f1c700 1 -- 172.21.15.134:0/1349989428 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd440108710 con 0x7fd440100da0 2024-04-13T11:02:24.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.901+0000 7fd42f7fe700 1 -- 172.21.15.134:0/1349989428 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7fd4300105d0 con 0x7fd440100da0 2024-04-13T11:02:24.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.901+0000 7fd42f7fe700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd42806cce0 0x7fd42806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:24.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.901+0000 7fd42f7fe700 1 -- 172.21.15.134:0/1349989428 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd43008bfd0 con 0x7fd440100da0 2024-04-13T11:02:24.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.901+0000 7fd43e59c700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd42806cce0 0x7fd42806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:24.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.902+0000 7fd43e59c700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd42806cce0 0x7fd42806f190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd434006010 tx=0x7fd43401a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:24.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:24.906+0000 7fd42f7fe700 1 -- 172.21.15.134:0/1349989428 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fd430056140 con 0x7fd440100da0 2024-04-13T11:02:25.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.131+0000 7fd444f1c700 1 -- 172.21.15.134:0/1349989428 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fd44004ea50 con 0x7fd440100da0 2024-04-13T11:02:25.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.136+0000 7fd42f7fe700 1 -- 172.21.15.134:0/1349989428 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v45)=0 v45) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd430059760 con 0x7fd440100da0 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 -- 172.21.15.134:0/1349989428 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd42806cce0 msgr2=0x7fd42806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd42806cce0 0x7fd42806f190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd434006010 tx=0x7fd43401a040 comp rx=0 tx=0).stop 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 -- 172.21.15.134:0/1349989428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd440100da0 msgr2=0x7fd440073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd440100da0 0x7fd440073590 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd43000d900 tx=0x7fd43000dc10 comp rx=0 tx=0).stop 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 -- 172.21.15.134:0/1349989428 shutdown_connections 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd42806cce0 0x7fd42806f190 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd440100400 0x7fd440073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 --2- 172.21.15.134:0/1349989428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd440100da0 0x7fd440073590 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 -- 172.21.15.134:0/1349989428 >> 172.21.15.134:0/1349989428 conn(0x7fd4400fbca0 msgr2=0x7fd4400fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 -- 172.21.15.134:0/1349989428 shutdown_connections 2024-04-13T11:02:25.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:25.138+0000 7fd444f1c700 1 -- 172.21.15.134:0/1349989428 wait complete. 2024-04-13T11:02:25.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:25 smithi134 ceph-mon[39696]: pgmap v86: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:25.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:25 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/1349989428' entity='client.admin' 2024-04-13T11:02:25.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:25 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:02:25.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:25 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:02:25.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:25 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:02:25.535 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:25 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:25.860 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-13T11:02:25.860 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T11:02:25.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-13T11:02:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:25 smithi194 ceph-mon[46737]: pgmap v86: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:25 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/1349989428' entity='client.admin' 2024-04-13T11:02:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:25 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:02:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:25 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:02:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:25 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:02:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:25 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:26.089 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:27.670 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:27 smithi134 ceph-mon[39696]: pgmap v87: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:27.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.937+0000 7f62f63ed700 1 -- 172.21.15.134:0/3579374508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f00ff220 msgr2=0x7f62f00ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.937+0000 7f62f63ed700 1 --2- 172.21.15.134:0/3579374508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f00ff220 0x7f62f00ff5f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009910 tx=0x7f62e0009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.937+0000 7f62f63ed700 1 -- 172.21.15.134:0/3579374508 shutdown_connections 2024-04-13T11:02:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.937+0000 7f62f63ed700 1 --2- 172.21.15.134:0/3579374508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f00ffb30 0x7f62f010a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.937+0000 7f62f63ed700 1 --2- 172.21.15.134:0/3579374508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f00ff220 0x7f62f00ff5f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.937+0000 7f62f63ed700 1 -- 172.21.15.134:0/3579374508 >> 172.21.15.134:0/3579374508 conn(0x7f62f00747e0 msgr2=0x7f62f0074be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.937+0000 7f62f63ed700 1 -- 172.21.15.134:0/3579374508 shutdown_connections 2024-04-13T11:02:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.937+0000 7f62f63ed700 1 -- 172.21.15.134:0/3579374508 wait complete. 2024-04-13T11:02:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.938+0000 7f62f63ed700 1 Processor -- start 2024-04-13T11:02:27.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.938+0000 7f62f63ed700 1 -- start start 2024-04-13T11:02:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.938+0000 7f62f63ed700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f00ff220 0x7f62f019b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.938+0000 7f62f63ed700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f00ffb30 0x7f62f019bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.938+0000 7f62f63ed700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f019c530 con 0x7f62f00ffb30 2024-04-13T11:02:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.938+0000 7f62f63ed700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01959e0 con 0x7f62f00ff220 2024-04-13T11:02:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.938+0000 7f62ef7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f00ffb30 0x7f62f019bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62ef7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f00ffb30 0x7f62f019bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42644/0 (socket says 172.21.15.134:42644) 2024-04-13T11:02:27.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62ef7fe700 1 -- 172.21.15.134:0/2329571541 learned_addr learned my addr 172.21.15.134:0/2329571541 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62effff700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f00ff220 0x7f62f019b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62ef7fe700 1 -- 172.21.15.134:0/2329571541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f00ff220 msgr2=0x7f62f019b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62ef7fe700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f00ff220 0x7f62f019b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62ef7fe700 1 -- 172.21.15.134:0/2329571541 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00095f0 con 0x7f62f00ffb30 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62ef7fe700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f00ffb30 0x7f62f019bea0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f62e400d8d0 tx=0x7f62e400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62ed7fa700 1 -- 172.21.15.134:0/2329571541 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62e4009940 con 0x7f62f00ffb30 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62ed7fa700 1 -- 172.21.15.134:0/2329571541 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62e4010460 con 0x7f62f00ffb30 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62f63ed700 1 -- 172.21.15.134:0/2329571541 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f0195cc0 con 0x7f62f00ffb30 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62ed7fa700 1 -- 172.21.15.134:0/2329571541 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62e400f5f0 con 0x7f62f00ffb30 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.939+0000 7f62f63ed700 1 -- 172.21.15.134:0/2329571541 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f0196290 con 0x7f62f00ffb30 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.940+0000 7f62f63ed700 1 -- 172.21.15.134:0/2329571541 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f0107ca0 con 0x7f62f00ffb30 2024-04-13T11:02:27.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.941+0000 7f62ed7fa700 1 -- 172.21.15.134:0/2329571541 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f62e40105d0 con 0x7f62f00ffb30 2024-04-13T11:02:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.941+0000 7f62ed7fa700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f62d806cce0 0x7f62d806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.941+0000 7f62ed7fa700 1 -- 172.21.15.134:0/2329571541 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f62e408c3e0 con 0x7f62f00ffb30 2024-04-13T11:02:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.941+0000 7f62effff700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f62d806cce0 0x7f62d806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:27.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.942+0000 7f62effff700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f62d806cce0 0x7f62d806f190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62e0006010 tx=0x7f62e001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:27.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:27.946+0000 7f62ed7fa700 1 -- 172.21.15.134:0/2329571541 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f62e405a060 con 0x7f62f00ffb30 2024-04-13T11:02:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:27 smithi194 ceph-mon[46737]: pgmap v87: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.142+0000 7f62f63ed700 1 -- 172.21.15.134:0/2329571541 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f62f004ea50 con 0x7f62f00ffb30 2024-04-13T11:02:28.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.143+0000 7f62ed7fa700 1 -- 172.21.15.134:0/2329571541 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v45)=0 v45) v1 ==== 155+0+0 (secure 0 0 0) 0x7f62e4010880 con 0x7f62f00ffb30 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 -- 172.21.15.134:0/2329571541 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f62d806cce0 msgr2=0x7f62d806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f62d806cce0 0x7f62d806f190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62e0006010 tx=0x7f62e001a040 comp rx=0 tx=0).stop 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 -- 172.21.15.134:0/2329571541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f00ffb30 msgr2=0x7f62f019bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f00ffb30 0x7f62f019bea0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f62e400d8d0 tx=0x7f62e400dc90 comp rx=0 tx=0).stop 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 -- 172.21.15.134:0/2329571541 shutdown_connections 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f62d806cce0 0x7f62d806f190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62f00ff220 0x7f62f019b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 --2- 172.21.15.134:0/2329571541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62f00ffb30 0x7f62f019bea0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 -- 172.21.15.134:0/2329571541 >> 172.21.15.134:0/2329571541 conn(0x7f62f00747e0 msgr2=0x7f62f0104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 -- 172.21.15.134:0/2329571541 shutdown_connections 2024-04-13T11:02:28.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:28.145+0000 7f62f63ed700 1 -- 172.21.15.134:0/2329571541 wait complete. 2024-04-13T11:02:28.842 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-13T11:02:29.074 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:29.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:29 smithi134 ceph-mon[39696]: pgmap v88: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:29.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:29 smithi194 ceph-mon[46737]: pgmap v88: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:31.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.084+0000 7fc84c6dc700 1 -- 172.21.15.134:0/1373132189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8440ffc60 msgr2=0x7fc844103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:31.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.084+0000 7fc84c6dc700 1 --2- 172.21.15.134:0/1373132189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8440ffc60 0x7fc844103c30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc838009910 tx=0x7fc838009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:31.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 -- 172.21.15.134:0/1373132189 shutdown_connections 2024-04-13T11:02:31.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 --2- 172.21.15.134:0/1373132189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8440ffc60 0x7fc844103c30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:31.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 --2- 172.21.15.134:0/1373132189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440ff2c0 0x7fc8440ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 -- 172.21.15.134:0/1373132189 >> 172.21.15.134:0/1373132189 conn(0x7fc8440fab80 msgr2=0x7fc8440fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 -- 172.21.15.134:0/1373132189 shutdown_connections 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 -- 172.21.15.134:0/1373132189 wait complete. 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 Processor -- start 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 -- start start 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8440ff2c0 0x7fc84419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440ffc60 0x7fc84419bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84419c580 con 0x7fc8440ff2c0 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.085+0000 7fc84c6dc700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc844195ac0 con 0x7fc8440ffc60 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc84a478700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8440ff2c0 0x7fc84419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc84a478700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8440ff2c0 0x7fc84419ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59256/0 (socket says 172.21.15.134:59256) 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc84a478700 1 -- 172.21.15.134:0/708907846 learned_addr learned my addr 172.21.15.134:0/708907846 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:31.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc84a478700 1 -- 172.21.15.134:0/708907846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440ffc60 msgr2=0x7fc84419bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc84a478700 1 --2- 172.21.15.134:0/708907846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440ffc60 0x7fc84419bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc84a478700 1 -- 172.21.15.134:0/708907846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380095f0 con 0x7fc8440ff2c0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc84a478700 1 --2- 172.21.15.134:0/708907846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8440ff2c0 0x7fc84419ba40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c930 tx=0x7fc84000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc8377fe700 1 -- 172.21.15.134:0/708907846 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc840007ad0 con 0x7fc8440ff2c0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc8377fe700 1 -- 172.21.15.134:0/708907846 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc840007c30 con 0x7fc8440ff2c0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc8377fe700 1 -- 172.21.15.134:0/708907846 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc840018630 con 0x7fc8440ff2c0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc84c6dc700 1 -- 172.21.15.134:0/708907846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc844195da0 con 0x7fc8440ff2c0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.086+0000 7fc84c6dc700 1 -- 172.21.15.134:0/708907846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8441962f0 con 0x7fc8440ff2c0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.087+0000 7fc84c6dc700 1 -- 172.21.15.134:0/708907846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84404ea50 con 0x7fc8440ff2c0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.087+0000 7fc8377fe700 1 -- 172.21.15.134:0/708907846 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7fc84000f450 con 0x7fc8440ff2c0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.088+0000 7fc8377fe700 1 --2- 172.21.15.134:0/708907846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc83006cce0 0x7fc83006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.088+0000 7fc8377fe700 1 -- 172.21.15.134:0/708907846 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc84008c670 con 0x7fc8440ff2c0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.088+0000 7fc849c77700 1 --2- 172.21.15.134:0/708907846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc83006cce0 0x7fc83006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:31.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.088+0000 7fc849c77700 1 --2- 172.21.15.134:0/708907846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc83006cce0 0x7fc83006f190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc83800b5c0 tx=0x7fc838005960 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:31.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.092+0000 7fc8377fe700 1 -- 172.21.15.134:0/708907846 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fc84005a3a0 con 0x7fc8440ff2c0 2024-04-13T11:02:31.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.288+0000 7fc84c6dc700 1 -- 172.21.15.134:0/708907846 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fc844196fd0 con 0x7fc8440ff2c0 2024-04-13T11:02:31.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.288+0000 7fc8377fe700 1 -- 172.21.15.134:0/708907846 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v45)=0 v45) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc840059f30 con 0x7fc8440ff2c0 2024-04-13T11:02:31.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.290+0000 7fc84c6dc700 1 -- 172.21.15.134:0/708907846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc83006cce0 msgr2=0x7fc83006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:31.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.290+0000 7fc84c6dc700 1 --2- 172.21.15.134:0/708907846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc83006cce0 0x7fc83006f190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc83800b5c0 tx=0x7fc838005960 comp rx=0 tx=0).stop 2024-04-13T11:02:31.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.290+0000 7fc84c6dc700 1 -- 172.21.15.134:0/708907846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8440ff2c0 msgr2=0x7fc84419ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:31.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.290+0000 7fc84c6dc700 1 --2- 172.21.15.134:0/708907846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8440ff2c0 0x7fc84419ba40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc84000c930 tx=0x7fc84000ccf0 comp rx=0 tx=0).stop 2024-04-13T11:02:31.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.291+0000 7fc84c6dc700 1 -- 172.21.15.134:0/708907846 shutdown_connections 2024-04-13T11:02:31.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.291+0000 7fc84c6dc700 1 --2- 172.21.15.134:0/708907846 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc83006cce0 0x7fc83006f190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:31.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.291+0000 7fc84c6dc700 1 --2- 172.21.15.134:0/708907846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8440ff2c0 0x7fc84419ba40 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:31.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.291+0000 7fc84c6dc700 1 --2- 172.21.15.134:0/708907846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440ffc60 0x7fc84419bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:31.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.291+0000 7fc84c6dc700 1 -- 172.21.15.134:0/708907846 >> 172.21.15.134:0/708907846 conn(0x7fc8440fab80 msgr2=0x7fc844068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:31.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.291+0000 7fc84c6dc700 1 -- 172.21.15.134:0/708907846 shutdown_connections 2024-04-13T11:02:31.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:31.291+0000 7fc84c6dc700 1 -- 172.21.15.134:0/708907846 wait complete. 2024-04-13T11:02:31.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:31 smithi134 ceph-mon[39696]: pgmap v89: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:31 smithi194 ceph-mon[46737]: pgmap v89: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:32.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-13T11:02:32.283 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:33.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:33 smithi134 ceph-mon[39696]: pgmap v90: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:33 smithi194 ceph-mon[46737]: pgmap v90: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:34.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.393+0000 7ff7e31c1700 1 -- 172.21.15.134:0/1591062827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7dc0ffc30 msgr2=0x7ff7dc10a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:34.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.393+0000 7ff7e31c1700 1 --2- 172.21.15.134:0/1591062827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7dc0ffc30 0x7ff7dc10a6a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009940 tx=0x7ff7c8009c50 comp rx=0 tx=0).stop 2024-04-13T11:02:34.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.393+0000 7ff7e31c1700 1 -- 172.21.15.134:0/1591062827 shutdown_connections 2024-04-13T11:02:34.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.393+0000 7ff7e31c1700 1 --2- 172.21.15.134:0/1591062827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7dc0ffc30 0x7ff7dc10a6a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:34.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.393+0000 7ff7e31c1700 1 --2- 172.21.15.134:0/1591062827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7dc0ff320 0x7ff7dc0ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:34.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.393+0000 7ff7e31c1700 1 -- 172.21.15.134:0/1591062827 >> 172.21.15.134:0/1591062827 conn(0x7ff7dc0748b0 msgr2=0x7ff7dc074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:34.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.393+0000 7ff7e31c1700 1 -- 172.21.15.134:0/1591062827 shutdown_connections 2024-04-13T11:02:34.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.393+0000 7ff7e31c1700 1 -- 172.21.15.134:0/1591062827 wait complete. 2024-04-13T11:02:34.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e31c1700 1 Processor -- start 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e31c1700 1 -- start start 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e31c1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7dc0ff320 0x7ff7dc19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e31c1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7dc0ffc30 0x7ff7dc19e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e31c1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc19e6a0 con 0x7ff7dc0ff320 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e31c1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc197b50 con 0x7ff7dc0ffc30 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e0f5d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7dc0ff320 0x7ff7dc19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e0f5d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7dc0ff320 0x7ff7dc19dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59280/0 (socket says 172.21.15.134:59280) 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e0f5d700 1 -- 172.21.15.134:0/3160714095 learned_addr learned my addr 172.21.15.134:0/3160714095 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7dbfff700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7dc0ffc30 0x7ff7dc19e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e0f5d700 1 -- 172.21.15.134:0/3160714095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7dc0ffc30 msgr2=0x7ff7dc19e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e0f5d700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7dc0ffc30 0x7ff7dc19e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:34.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e0f5d700 1 -- 172.21.15.134:0/3160714095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80095f0 con 0x7ff7dc0ff320 2024-04-13T11:02:34.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7dbfff700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7dc0ffc30 0x7ff7dc19e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:02:34.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.394+0000 7ff7e0f5d700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7dc0ff320 0x7ff7dc19dad0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000d900 tx=0x7ff7d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:34.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.395+0000 7ff7d9ffb700 1 -- 172.21.15.134:0/3160714095 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7d00041f0 con 0x7ff7dc0ff320 2024-04-13T11:02:34.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.395+0000 7ff7d9ffb700 1 -- 172.21.15.134:0/3160714095 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff7d0004350 con 0x7ff7dc0ff320 2024-04-13T11:02:34.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.395+0000 7ff7e31c1700 1 -- 172.21.15.134:0/3160714095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7dc197e30 con 0x7ff7dc0ff320 2024-04-13T11:02:34.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.395+0000 7ff7d9ffb700 1 -- 172.21.15.134:0/3160714095 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7d0003d60 con 0x7ff7dc0ff320 2024-04-13T11:02:34.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.395+0000 7ff7e31c1700 1 -- 172.21.15.134:0/3160714095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc198400 con 0x7ff7dc0ff320 2024-04-13T11:02:34.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.396+0000 7ff7e31c1700 1 -- 172.21.15.134:0/3160714095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7dc10a200 con 0x7ff7dc0ff320 2024-04-13T11:02:34.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.396+0000 7ff7d9ffb700 1 -- 172.21.15.134:0/3160714095 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7ff7d0009730 con 0x7ff7dc0ff320 2024-04-13T11:02:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.397+0000 7ff7d9ffb700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7cc06cce0 0x7ff7cc06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.397+0000 7ff7d9ffb700 1 -- 172.21.15.134:0/3160714095 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ff7d008c5a0 con 0x7ff7dc0ff320 2024-04-13T11:02:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.397+0000 7ff7dbfff700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7cc06cce0 0x7ff7cc06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:34.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.397+0000 7ff7dbfff700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7cc06cce0 0x7ff7cc06f190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800b7d0 tx=0x7ff7c8005fb0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:34.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.401+0000 7ff7d9ffb700 1 -- 172.21.15.134:0/3160714095 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7ff7d005a220 con 0x7ff7dc0ff320 2024-04-13T11:02:34.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.596+0000 7ff7e31c1700 1 -- 172.21.15.134:0/3160714095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7ff7dc04ea50 con 0x7ff7dc0ff320 2024-04-13T11:02:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.596+0000 7ff7d9ffb700 1 -- 172.21.15.134:0/3160714095 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v45)=0 v45) v1 ==== 135+0+0 (secure 0 0 0) 0x7ff7d0009e60 con 0x7ff7dc0ff320 2024-04-13T11:02:34.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 -- 172.21.15.134:0/3160714095 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7cc06cce0 msgr2=0x7ff7cc06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7cc06cce0 0x7ff7cc06f190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800b7d0 tx=0x7ff7c8005fb0 comp rx=0 tx=0).stop 2024-04-13T11:02:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 -- 172.21.15.134:0/3160714095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7dc0ff320 msgr2=0x7ff7dc19dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7dc0ff320 0x7ff7dc19dad0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000d900 tx=0x7ff7d000dcc0 comp rx=0 tx=0).stop 2024-04-13T11:02:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 -- 172.21.15.134:0/3160714095 shutdown_connections 2024-04-13T11:02:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7cc06cce0 0x7ff7cc06f190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7dc0ff320 0x7ff7dc19dad0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 --2- 172.21.15.134:0/3160714095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7dc0ffc30 0x7ff7dc19e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 -- 172.21.15.134:0/3160714095 >> 172.21.15.134:0/3160714095 conn(0x7ff7dc0748b0 msgr2=0x7ff7dc100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 -- 172.21.15.134:0/3160714095 shutdown_connections 2024-04-13T11:02:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:34.599+0000 7ff7e31c1700 1 -- 172.21.15.134:0/3160714095 wait complete. 2024-04-13T11:02:35.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-13T11:02:35.645 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:35.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:35 smithi134 ceph-mon[39696]: pgmap v91: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:35 smithi194 ceph-mon[46737]: pgmap v91: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:37.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.388+0000 7fbd798ff700 1 -- 172.21.15.134:0/3819654566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd740ff390 msgr2=0x7fbd740ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:37.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.388+0000 7fbd798ff700 1 --2- 172.21.15.134:0/3819654566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd740ff390 0x7fbd740ff760 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400b0a0 tx=0x7fbd6400b3b0 comp rx=0 tx=0).stop 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.388+0000 7fbd798ff700 1 -- 172.21.15.134:0/3819654566 shutdown_connections 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.388+0000 7fbd798ff700 1 --2- 172.21.15.134:0/3819654566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd740ffd30 0x7fbd74103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.388+0000 7fbd798ff700 1 --2- 172.21.15.134:0/3819654566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd740ff390 0x7fbd740ff760 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.388+0000 7fbd798ff700 1 -- 172.21.15.134:0/3819654566 >> 172.21.15.134:0/3819654566 conn(0x7fbd74074f50 msgr2=0x7fbd74075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.388+0000 7fbd798ff700 1 -- 172.21.15.134:0/3819654566 shutdown_connections 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.388+0000 7fbd798ff700 1 -- 172.21.15.134:0/3819654566 wait complete. 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.389+0000 7fbd798ff700 1 Processor -- start 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.389+0000 7fbd798ff700 1 -- start start 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.389+0000 7fbd798ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd740ff390 0x7fbd7419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.389+0000 7fbd798ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd740ffd30 0x7fbd7419aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.389+0000 7fbd798ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74194aa0 con 0x7fbd740ffd30 2024-04-13T11:02:37.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.389+0000 7fbd798ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74194c10 con 0x7fbd740ff390 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.389+0000 7fbd727fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd740ffd30 0x7fbd7419aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.389+0000 7fbd727fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd740ffd30 0x7fbd7419aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59310/0 (socket says 172.21.15.134:59310) 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.389+0000 7fbd727fc700 1 -- 172.21.15.134:0/1561054306 learned_addr learned my addr 172.21.15.134:0/1561054306 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.389+0000 7fbd72ffd700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd740ff390 0x7fbd7419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.390+0000 7fbd727fc700 1 -- 172.21.15.134:0/1561054306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd740ff390 msgr2=0x7fbd7419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.390+0000 7fbd727fc700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd740ff390 0x7fbd7419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.390+0000 7fbd727fc700 1 -- 172.21.15.134:0/1561054306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd64009d00 con 0x7fbd740ffd30 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.390+0000 7fbd72ffd700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd740ff390 0x7fbd7419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.390+0000 7fbd727fc700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd740ffd30 0x7fbd7419aff0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00b480 tx=0x7fbd5c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.390+0000 7fbd788fd700 1 -- 172.21.15.134:0/1561054306 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd5c0118c0 con 0x7fbd740ffd30 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.390+0000 7fbd788fd700 1 -- 172.21.15.134:0/1561054306 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd5c010380 con 0x7fbd740ffd30 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.390+0000 7fbd798ff700 1 -- 172.21.15.134:0/1561054306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd74194ef0 con 0x7fbd740ffd30 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.390+0000 7fbd788fd700 1 -- 172.21.15.134:0/1561054306 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd5c00f510 con 0x7fbd740ffd30 2024-04-13T11:02:37.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.390+0000 7fbd798ff700 1 -- 172.21.15.134:0/1561054306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd74195440 con 0x7fbd740ffd30 2024-04-13T11:02:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.391+0000 7fbd798ff700 1 -- 172.21.15.134:0/1561054306 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd74107650 con 0x7fbd740ffd30 2024-04-13T11:02:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.391+0000 7fbd788fd700 1 -- 172.21.15.134:0/1561054306 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7fbd5c0104f0 con 0x7fbd740ffd30 2024-04-13T11:02:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.392+0000 7fbd788fd700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbd6006cce0 0x7fbd6006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.392+0000 7fbd788fd700 1 -- 172.21.15.134:0/1561054306 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fbd5c08c100 con 0x7fbd740ffd30 2024-04-13T11:02:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.392+0000 7fbd72ffd700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbd6006cce0 0x7fbd6006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.392+0000 7fbd72ffd700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbd6006cce0 0x7fbd6006f190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbd640062a0 tx=0x7fbd64006210 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:37.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.396+0000 7fbd788fd700 1 -- 172.21.15.134:0/1561054306 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7fbd5c056270 con 0x7fbd740ffd30 2024-04-13T11:02:37.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.612+0000 7fbd798ff700 1 -- 172.21.15.134:0/1561054306 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd741956c0 con 0x7fbd6006cce0 2024-04-13T11:02:37.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.620+0000 7fbd788fd700 1 -- 172.21.15.134:0/1561054306 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fbd741956c0 con 0x7fbd6006cce0 2024-04-13T11:02:37.622 INFO:teuthology.orchestra.run.smithi134.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 -- 172.21.15.134:0/1561054306 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbd6006cce0 msgr2=0x7fbd6006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbd6006cce0 0x7fbd6006f190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbd640062a0 tx=0x7fbd64006210 comp rx=0 tx=0).stop 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 -- 172.21.15.134:0/1561054306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd740ffd30 msgr2=0x7fbd7419aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd740ffd30 0x7fbd7419aff0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00b480 tx=0x7fbd5c00b840 comp rx=0 tx=0).stop 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 -- 172.21.15.134:0/1561054306 shutdown_connections 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbd6006cce0 0x7fbd6006f190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd740ff390 0x7fbd7419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 --2- 172.21.15.134:0/1561054306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd740ffd30 0x7fbd7419aff0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 -- 172.21.15.134:0/1561054306 >> 172.21.15.134:0/1561054306 conn(0x7fbd74074f50 msgr2=0x7fbd740fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 -- 172.21.15.134:0/1561054306 shutdown_connections 2024-04-13T11:02:37.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:37.622+0000 7fbd798ff700 1 -- 172.21.15.134:0/1561054306 wait complete. 2024-04-13T11:02:37.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:37 smithi194 ceph-mon[46737]: pgmap v92: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:37.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:37 smithi134 ceph-mon[39696]: pgmap v92: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:38.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:38 smithi134 ceph-mon[39696]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:38.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:38 smithi134 ceph-mon[39696]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c 2024-04-13T11:02:38.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:38.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:02:38.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:02:38.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:02:38.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:38.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:38 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:02:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:38 smithi194 ceph-mon[46737]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:38 smithi194 ceph-mon[46737]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c 2024-04-13T11:02:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:02:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:02:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:02:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:38 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:02:39.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:39 smithi134 ceph-mon[39696]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c 2024-04-13T11:02:39.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:39 smithi134 ceph-mon[39696]: pgmap v93: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:39 smithi194 ceph-mon[46737]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5108bc67b831101bc32a1061150595384640c56c 2024-04-13T11:02:39.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:39 smithi194 ceph-mon[46737]: pgmap v93: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:41.418 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-13T11:02:41.419 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T11:02:41.419 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-13T11:02:41.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:41 smithi134 ceph-mon[39696]: pgmap v94: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:41.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:41 smithi194 ceph-mon[46737]: pgmap v94: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:43.914 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:43 smithi134 ceph-mon[39696]: pgmap v95: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:43 smithi194 ceph-mon[46737]: pgmap v95: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:44.296 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:02:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:45 smithi134 ceph-mon[39696]: pgmap v96: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:45 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:45 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:02:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:45 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:45 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:02:45.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:45 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:45.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:45 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-13T11:02:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:45 smithi194 ceph-mon[46737]: pgmap v96: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:45 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:45 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:02:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:45 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:45 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:02:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:45 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:45 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-13T11:02:46.838 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:46 smithi134 ceph-mon[39696]: Upgrade: Target is version 18.2.2-1173-g5108bc67 (reef) 2024-04-13T11:02:46.839 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:46 smithi134 ceph-mon[39696]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39, digests ['quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39'] 2024-04-13T11:02:46.839 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:46 smithi134 ceph-mon[39696]: Upgrade: Setting container_image for all mgr 2024-04-13T11:02:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:46 smithi194 ceph-mon[46737]: Upgrade: Target is version 18.2.2-1173-g5108bc67 (reef) 2024-04-13T11:02:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:46 smithi194 ceph-mon[46737]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39, digests ['quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39'] 2024-04-13T11:02:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:46 smithi194 ceph-mon[46737]: Upgrade: Setting container_image for all mgr 2024-04-13T11:02:47.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.343+0000 7f821e840700 1 -- 172.21.15.134:0/2765023682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82180ffd30 msgr2=0x7f8218103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.343+0000 7f821e840700 1 --2- 172.21.15.134:0/2765023682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82180ffd30 0x7f8218103ce0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f820c009910 tx=0x7f820c009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.343+0000 7f821e840700 1 -- 172.21.15.134:0/2765023682 shutdown_connections 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.343+0000 7f821e840700 1 --2- 172.21.15.134:0/2765023682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82180ffd30 0x7f8218103ce0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.343+0000 7f821e840700 1 --2- 172.21.15.134:0/2765023682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82180ff390 0x7f82180ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.343+0000 7f821e840700 1 -- 172.21.15.134:0/2765023682 >> 172.21.15.134:0/2765023682 conn(0x7f8218074f50 msgr2=0x7f8218075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.343+0000 7f821e840700 1 -- 172.21.15.134:0/2765023682 shutdown_connections 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.343+0000 7f821e840700 1 -- 172.21.15.134:0/2765023682 wait complete. 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.344+0000 7f821e840700 1 Processor -- start 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.344+0000 7f821e840700 1 -- start start 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.344+0000 7f821e840700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82180ff390 0x7f8218196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.344+0000 7f821e840700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82180ffd30 0x7f8218197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:47.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.344+0000 7f821e840700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8218197620 con 0x7f82180ff390 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.344+0000 7f821e840700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8218197760 con 0x7f82180ffd30 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.344+0000 7f8217fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82180ff390 0x7f8218196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.344+0000 7f8217fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82180ff390 0x7f8218196ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58562/0 (socket says 172.21.15.134:58562) 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.344+0000 7f8217fff700 1 -- 172.21.15.134:0/149603423 learned_addr learned my addr 172.21.15.134:0/149603423 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.345+0000 7f82177fe700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82180ffd30 0x7f8218197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.345+0000 7f8217fff700 1 -- 172.21.15.134:0/149603423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82180ffd30 msgr2=0x7f8218197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.345+0000 7f8217fff700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82180ffd30 0x7f8218197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.345+0000 7f8217fff700 1 -- 172.21.15.134:0/149603423 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c0095f0 con 0x7f82180ff390 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.345+0000 7f8217fff700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82180ff390 0x7f8218196ac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f820800d8d0 tx=0x7f820800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.345+0000 7f82157fa700 1 -- 172.21.15.134:0/149603423 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82080098a0 con 0x7f82180ff390 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.345+0000 7f821e840700 1 -- 172.21.15.134:0/149603423 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821819fb30 con 0x7f82180ff390 2024-04-13T11:02:47.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.345+0000 7f82157fa700 1 -- 172.21.15.134:0/149603423 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8208010460 con 0x7f82180ff390 2024-04-13T11:02:47.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.345+0000 7f82157fa700 1 -- 172.21.15.134:0/149603423 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8208009ea0 con 0x7f82180ff390 2024-04-13T11:02:47.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.345+0000 7f821e840700 1 -- 172.21.15.134:0/149603423 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821819fff0 con 0x7f82180ff390 2024-04-13T11:02:47.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.346+0000 7f821e840700 1 -- 172.21.15.134:0/149603423 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8218107600 con 0x7f82180ff390 2024-04-13T11:02:47.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.347+0000 7f82157fa700 1 -- 172.21.15.134:0/149603423 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f82080105d0 con 0x7f82180ff390 2024-04-13T11:02:47.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.347+0000 7f82157fa700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f820006cce0 0x7f820006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:47.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.347+0000 7f82157fa700 1 -- 172.21.15.134:0/149603423 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f820808c390 con 0x7f82180ff390 2024-04-13T11:02:47.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.347+0000 7f82177fe700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f820006cce0 0x7f820006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:47.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.347+0000 7f82177fe700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f820006cce0 0x7f820006f190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f820c006010 tx=0x7f820c01a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:47.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.352+0000 7f82157fa700 1 -- 172.21.15.134:0/149603423 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f8208056500 con 0x7f82180ff390 2024-04-13T11:02:47.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.568+0000 7f821e840700 1 -- 172.21.15.134:0/149603423 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8218061190 con 0x7f820006cce0 2024-04-13T11:02:47.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.570+0000 7f82157fa700 1 -- 172.21.15.134:0/149603423 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8218061190 con 0x7f820006cce0 2024-04-13T11:02:47.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 -- 172.21.15.134:0/149603423 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f820006cce0 msgr2=0x7f820006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:47.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f820006cce0 0x7f820006f190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f820c006010 tx=0x7f820c01a040 comp rx=0 tx=0).stop 2024-04-13T11:02:47.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 -- 172.21.15.134:0/149603423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82180ff390 msgr2=0x7f8218196ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:47.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82180ff390 0x7f8218196ac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f820800d8d0 tx=0x7f820800dbe0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 -- 172.21.15.134:0/149603423 shutdown_connections 2024-04-13T11:02:47.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f820006cce0 0x7f820006f190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82180ff390 0x7f8218196ac0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 --2- 172.21.15.134:0/149603423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82180ffd30 0x7f8218197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 -- 172.21.15.134:0/149603423 >> 172.21.15.134:0/149603423 conn(0x7f8218074f50 msgr2=0x7f82180fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:47.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 -- 172.21.15.134:0/149603423 shutdown_connections 2024-04-13T11:02:47.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.572+0000 7f821e840700 1 -- 172.21.15.134:0/149603423 wait complete. 2024-04-13T11:02:47.583 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:02:47.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.681+0000 7faefc289700 1 -- 172.21.15.134:0/2122004479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef41011f0 msgr2=0x7faef41015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:47.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.681+0000 7faefc289700 1 --2- 172.21.15.134:0/2122004479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef41011f0 0x7faef41015c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7faee4009910 tx=0x7faee4009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:47.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.681+0000 7faefc289700 1 -- 172.21.15.134:0/2122004479 shutdown_connections 2024-04-13T11:02:47.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.681+0000 7faefc289700 1 --2- 172.21.15.134:0/2122004479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef4101b00 0x7faef410a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.681+0000 7faefc289700 1 --2- 172.21.15.134:0/2122004479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef41011f0 0x7faef41015c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.681+0000 7faefc289700 1 -- 172.21.15.134:0/2122004479 >> 172.21.15.134:0/2122004479 conn(0x7faef40fab80 msgr2=0x7faef40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.681+0000 7faefc289700 1 -- 172.21.15.134:0/2122004479 shutdown_connections 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.681+0000 7faefc289700 1 -- 172.21.15.134:0/2122004479 wait complete. 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.681+0000 7faefc289700 1 Processor -- start 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.681+0000 7faefc289700 1 -- start start 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefc289700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef41011f0 0x7faef419ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefc289700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef4101b00 0x7faef419bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefc289700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef419c620 con 0x7faef41011f0 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefc289700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef4195ad0 con 0x7faef4101b00 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefa025700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef41011f0 0x7faef419ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefa025700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef41011f0 0x7faef419ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58576/0 (socket says 172.21.15.134:58576) 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefa025700 1 -- 172.21.15.134:0/1594377923 learned_addr learned my addr 172.21.15.134:0/1594377923 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faef9824700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef4101b00 0x7faef419bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:47.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefa025700 1 -- 172.21.15.134:0/1594377923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef4101b00 msgr2=0x7faef419bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:47.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefa025700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef4101b00 0x7faef419bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefa025700 1 -- 172.21.15.134:0/1594377923 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40095f0 con 0x7faef41011f0 2024-04-13T11:02:47.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefa025700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef41011f0 0x7faef419ba50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faee4006010 tx=0x7faee400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:47.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faeeb7fe700 1 -- 172.21.15.134:0/1594377923 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faee401d070 con 0x7faef41011f0 2024-04-13T11:02:47.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faeeb7fe700 1 -- 172.21.15.134:0/1594377923 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faee400f460 con 0x7faef41011f0 2024-04-13T11:02:47.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faeeb7fe700 1 -- 172.21.15.134:0/1594377923 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faee4021620 con 0x7faef41011f0 2024-04-13T11:02:47.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefc289700 1 -- 172.21.15.134:0/1594377923 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef4195d50 con 0x7faef41011f0 2024-04-13T11:02:47.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.682+0000 7faefc289700 1 -- 172.21.15.134:0/1594377923 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef4196240 con 0x7faef41011f0 2024-04-13T11:02:47.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.683+0000 7faefc289700 1 -- 172.21.15.134:0/1594377923 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef4107870 con 0x7faef41011f0 2024-04-13T11:02:47.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.684+0000 7faeeb7fe700 1 -- 172.21.15.134:0/1594377923 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7faee400f5d0 con 0x7faef41011f0 2024-04-13T11:02:47.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.684+0000 7faeeb7fe700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faee006cce0 0x7faee006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:47.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.684+0000 7faeeb7fe700 1 -- 172.21.15.134:0/1594377923 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7faee408d6b0 con 0x7faef41011f0 2024-04-13T11:02:47.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.684+0000 7faef9824700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faee006cce0 0x7faee006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:47.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.685+0000 7faef9824700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faee006cce0 0x7faee006f190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faef40fc330 tx=0x7faef000a300 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:47.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.689+0000 7faeeb7fe700 1 -- 172.21.15.134:0/1594377923 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7faee405b2b0 con 0x7faef41011f0 2024-04-13T11:02:47.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.903+0000 7faefc289700 1 -- 172.21.15.134:0/1594377923 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faef41964b0 con 0x7faee006cce0 2024-04-13T11:02:47.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.904+0000 7faeeb7fe700 1 -- 172.21.15.134:0/1594377923 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7faef41964b0 con 0x7faee006cce0 2024-04-13T11:02:47.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.906+0000 7faefc289700 1 -- 172.21.15.134:0/1594377923 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faee006cce0 msgr2=0x7faee006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:47.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.906+0000 7faefc289700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faee006cce0 0x7faee006f190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faef40fc330 tx=0x7faef000a300 comp rx=0 tx=0).stop 2024-04-13T11:02:47.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.906+0000 7faefc289700 1 -- 172.21.15.134:0/1594377923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef41011f0 msgr2=0x7faef419ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:47.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.906+0000 7faefc289700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef41011f0 0x7faef419ba50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faee4006010 tx=0x7faee400bd70 comp rx=0 tx=0).stop 2024-04-13T11:02:47.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.907+0000 7faefc289700 1 -- 172.21.15.134:0/1594377923 shutdown_connections 2024-04-13T11:02:47.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.907+0000 7faefc289700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faee006cce0 0x7faee006f190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.907+0000 7faefc289700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faef41011f0 0x7faef419ba50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.907+0000 7faefc289700 1 --2- 172.21.15.134:0/1594377923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faef4101b00 0x7faef419bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:47.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.907+0000 7faefc289700 1 -- 172.21.15.134:0/1594377923 >> 172.21.15.134:0/1594377923 conn(0x7faef40fab80 msgr2=0x7faef41049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:47.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.907+0000 7faefc289700 1 -- 172.21.15.134:0/1594377923 shutdown_connections 2024-04-13T11:02:47.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:47.907+0000 7faefc289700 1 -- 172.21.15.134:0/1594377923 wait complete. 2024-04-13T11:02:47.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:47 smithi134 ceph-mon[39696]: pgmap v97: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:47 smithi194 ceph-mon[46737]: pgmap v97: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:48.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.010+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3450032658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4c40ffd30 msgr2=0x7ff4c4103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.010+0000 7ff4cc0c6700 1 --2- 172.21.15.134:0/3450032658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4c40ffd30 0x7ff4c4103ce0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009910 tx=0x7ff4c0009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.010+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3450032658 shutdown_connections 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.010+0000 7ff4cc0c6700 1 --2- 172.21.15.134:0/3450032658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4c40ffd30 0x7ff4c4103ce0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.010+0000 7ff4cc0c6700 1 --2- 172.21.15.134:0/3450032658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c40ff390 0x7ff4c40ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.010+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3450032658 >> 172.21.15.134:0/3450032658 conn(0x7ff4c4074f50 msgr2=0x7ff4c4075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.010+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3450032658 shutdown_connections 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.010+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3450032658 wait complete. 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4cc0c6700 1 Processor -- start 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4cc0c6700 1 -- start start 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4cc0c6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4c40ff390 0x7ff4c419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4cc0c6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c40ffd30 0x7ff4c419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:48.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4cc0c6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c419c5c0 con 0x7ff4c40ff390 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4cc0c6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4195a70 con 0x7ff4c40ffd30 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4c9e62700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4c40ff390 0x7ff4c419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4c9e62700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4c40ff390 0x7ff4c419b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58582/0 (socket says 172.21.15.134:58582) 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4c9e62700 1 -- 172.21.15.134:0/3565139445 learned_addr learned my addr 172.21.15.134:0/3565139445 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4c9661700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c40ffd30 0x7ff4c419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4c9e62700 1 -- 172.21.15.134:0/3565139445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c40ffd30 msgr2=0x7ff4c419bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4c9e62700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c40ffd30 0x7ff4c419bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.011+0000 7ff4c9e62700 1 -- 172.21.15.134:0/3565139445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00095f0 con 0x7ff4c40ff390 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.012+0000 7ff4c9e62700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4c40ff390 0x7ff4c419b9f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800d8d0 tx=0x7ff4b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.012+0000 7ff4b6ffd700 1 -- 172.21.15.134:0/3565139445 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b8009940 con 0x7ff4c40ff390 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.012+0000 7ff4b6ffd700 1 -- 172.21.15.134:0/3565139445 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff4b8010460 con 0x7ff4c40ff390 2024-04-13T11:02:48.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.012+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3565139445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c4195d50 con 0x7ff4c40ff390 2024-04-13T11:02:48.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.012+0000 7ff4b6ffd700 1 -- 172.21.15.134:0/3565139445 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b800f5f0 con 0x7ff4c40ff390 2024-04-13T11:02:48.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.012+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3565139445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c41962a0 con 0x7ff4c40ff390 2024-04-13T11:02:48.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.013+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3565139445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c404ea50 con 0x7ff4c40ff390 2024-04-13T11:02:48.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.013+0000 7ff4b6ffd700 1 -- 172.21.15.134:0/3565139445 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7ff4b80105d0 con 0x7ff4c40ff390 2024-04-13T11:02:48.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.014+0000 7ff4b6ffd700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff4b006cce0 0x7ff4b006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:48.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.014+0000 7ff4b6ffd700 1 -- 172.21.15.134:0/3565139445 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ff4b808c570 con 0x7ff4c40ff390 2024-04-13T11:02:48.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.014+0000 7ff4c9661700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff4b006cce0 0x7ff4b006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:48.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.014+0000 7ff4c9661700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff4b006cce0 0x7ff4b006f190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40767e0 tx=0x7ff4c001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:48.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.018+0000 7ff4b6ffd700 1 -- 172.21.15.134:0/3565139445 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7ff4b805a0d0 con 0x7ff4c40ff390 2024-04-13T11:02:48.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.236+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3565139445 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4c4196740 con 0x7ff4b006cce0 2024-04-13T11:02:48.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.246+0000 7ff4b6ffd700 1 -- 172.21.15.134:0/3565139445 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7ff4c4196740 con 0x7ff4b006cce0 2024-04-13T11:02:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:02:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (97s) 64s ago 13m 15.5M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:02:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (13m) 64s ago 13m 8024k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:02:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (12m) 2m ago 12m 7549k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:02:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (13m) 64s ago 13m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T11:02:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (12m) 2m ago 12m 6651k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T11:02:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (70s) 64s ago 12m 46.4M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:02:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (7m) 64s ago 7m 90.1M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:02:48.246 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (6m) 64s ago 6m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (6m) 2m ago 6m 14.4M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (7m) 2m ago 7m 18.3M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (4m) 64s ago 14m 500M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (2m) 2m ago 11m 449M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (14m) 64s ago 14m 55.9M 2048M 18.2.0 dc2bc1663786 049d3d5322ca 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (11m) 2m ago 11m 45.5M 2048M 18.2.0 dc2bc1663786 2b211bf255cf 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 64s ago 13m 18.2M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (2m) 2m ago 12m 3414k - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (11m) 64s ago 11m 230M 1227M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (10m) 64s ago 10m 226M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (10m) 64s ago 10m 188M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (9m) 2m ago 9m 251M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (9m) 2m ago 9m 208M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:02:48.247 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (8m) 2m ago 8m 205M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:02:48.248 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (115s) 64s ago 12m 51.7M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:02:48.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3565139445 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff4b006cce0 msgr2=0x7ff4b006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:48.248 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff4b006cce0 0x7ff4b006f190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40767e0 tx=0x7ff4c001a040 comp rx=0 tx=0).stop 2024-04-13T11:02:48.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3565139445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4c40ff390 msgr2=0x7ff4c419b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:48.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4c40ff390 0x7ff4c419b9f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800d8d0 tx=0x7ff4b800dc90 comp rx=0 tx=0).stop 2024-04-13T11:02:48.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3565139445 shutdown_connections 2024-04-13T11:02:48.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff4b006cce0 0x7ff4b006f190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4c40ff390 0x7ff4c419b9f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 --2- 172.21.15.134:0/3565139445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c40ffd30 0x7ff4c419bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3565139445 >> 172.21.15.134:0/3565139445 conn(0x7ff4c4074f50 msgr2=0x7ff4c41037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:48.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3565139445 shutdown_connections 2024-04-13T11:02:48.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.248+0000 7ff4cc0c6700 1 -- 172.21.15.134:0/3565139445 wait complete. 2024-04-13T11:02:48.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.359+0000 7f5f86f74700 1 -- 172.21.15.134:0/1795071374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f80100d50 msgr2=0x7f5f80104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:48.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.359+0000 7f5f86f74700 1 --2- 172.21.15.134:0/1795071374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f80100d50 0x7f5f80104d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009910 tx=0x7f5f6c009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:48.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.359+0000 7f5f86f74700 1 -- 172.21.15.134:0/1795071374 shutdown_connections 2024-04-13T11:02:48.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.359+0000 7f5f86f74700 1 --2- 172.21.15.134:0/1795071374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f80100d50 0x7f5f80104d20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.359+0000 7f5f86f74700 1 --2- 172.21.15.134:0/1795071374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f801003b0 0x7f5f80100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.359+0000 7f5f86f74700 1 -- 172.21.15.134:0/1795071374 >> 172.21.15.134:0/1795071374 conn(0x7f5f800fbc30 msgr2=0x7f5f800fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:48.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.359+0000 7f5f86f74700 1 -- 172.21.15.134:0/1795071374 shutdown_connections 2024-04-13T11:02:48.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.359+0000 7f5f86f74700 1 -- 172.21.15.134:0/1795071374 wait complete. 2024-04-13T11:02:48.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f86f74700 1 Processor -- start 2024-04-13T11:02:48.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f86f74700 1 -- start start 2024-04-13T11:02:48.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f86f74700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f801003b0 0x7f5f80073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:48.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f86f74700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f80100d50 0x7f5f80073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:48.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f86f74700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80073ad0 con 0x7f5f801003b0 2024-04-13T11:02:48.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f86f74700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80073c10 con 0x7f5f80100d50 2024-04-13T11:02:48.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f84d10700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f801003b0 0x7f5f80073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:48.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f84d10700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f801003b0 0x7f5f80073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58594/0 (socket says 172.21.15.134:58594) 2024-04-13T11:02:48.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f84d10700 1 -- 172.21.15.134:0/769438611 learned_addr learned my addr 172.21.15.134:0/769438611 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f84d10700 1 -- 172.21.15.134:0/769438611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f80100d50 msgr2=0x7f5f80073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f7ffff700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f80100d50 0x7f5f80073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f84d10700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f80100d50 0x7f5f80073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.360+0000 7f5f84d10700 1 -- 172.21.15.134:0/769438611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0095f0 con 0x7f5f801003b0 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.361+0000 7f5f84d10700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f801003b0 0x7f5f80073050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400c8a0 tx=0x7f5f7400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.361+0000 7f5f7dffb700 1 -- 172.21.15.134:0/769438611 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7400cea0 con 0x7f5f801003b0 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.361+0000 7f5f7dffb700 1 -- 172.21.15.134:0/769438611 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f74004830 con 0x7f5f801003b0 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.361+0000 7f5f86f74700 1 -- 172.21.15.134:0/769438611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f801a1ed0 con 0x7f5f801003b0 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.361+0000 7f5f7dffb700 1 -- 172.21.15.134:0/769438611 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f74005500 con 0x7f5f801003b0 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.361+0000 7f5f86f74700 1 -- 172.21.15.134:0/769438611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f801a22e0 con 0x7f5f801003b0 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.362+0000 7f5f86f74700 1 -- 172.21.15.134:0/769438611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f80108720 con 0x7f5f801003b0 2024-04-13T11:02:48.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.362+0000 7f5f7dffb700 1 -- 172.21.15.134:0/769438611 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f5f740049a0 con 0x7f5f801003b0 2024-04-13T11:02:48.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.363+0000 7f5f7dffb700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5f7006cce0 0x7f5f7006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:48.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.363+0000 7f5f7dffb700 1 -- 172.21.15.134:0/769438611 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5f7408c160 con 0x7f5f801003b0 2024-04-13T11:02:48.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.363+0000 7f5f7ffff700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5f7006cce0 0x7f5f7006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:48.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.363+0000 7f5f7ffff700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5f7006cce0 0x7f5f7006f190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00b5c0 tx=0x7f5f6c005fd0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:48.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.367+0000 7f5f7dffb700 1 -- 172.21.15.134:0/769438611 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f5f740562b0 con 0x7f5f801003b0 2024-04-13T11:02:48.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.664+0000 7f5f86f74700 1 -- 172.21.15.134:0/769438611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5f8002cc80 con 0x7f5f801003b0 2024-04-13T11:02:48.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.668+0000 7f5f7dffb700 1 -- 172.21.15.134:0/769438611 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f5f740598d0 con 0x7f5f801003b0 2024-04-13T11:02:48.668 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:02:48.668 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:02:48.668 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-04-13T11:02:48.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:02:48.668 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:02:48.668 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:02:48.669 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:02:48.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 -- 172.21.15.134:0/769438611 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5f7006cce0 msgr2=0x7f5f7006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:48.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5f7006cce0 0x7f5f7006f190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00b5c0 tx=0x7f5f6c005fd0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 -- 172.21.15.134:0/769438611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f801003b0 msgr2=0x7f5f80073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:48.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f801003b0 0x7f5f80073050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400c8a0 tx=0x7f5f7400cc60 comp rx=0 tx=0).stop 2024-04-13T11:02:48.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 -- 172.21.15.134:0/769438611 shutdown_connections 2024-04-13T11:02:48.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5f7006cce0 0x7f5f7006f190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f801003b0 0x7f5f80073050 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 --2- 172.21.15.134:0/769438611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f80100d50 0x7f5f80073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 -- 172.21.15.134:0/769438611 >> 172.21.15.134:0/769438611 conn(0x7f5f800fbc30 msgr2=0x7f5f800fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:48.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 -- 172.21.15.134:0/769438611 shutdown_connections 2024-04-13T11:02:48.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.672+0000 7f5f86f74700 1 -- 172.21.15.134:0/769438611 wait complete. 2024-04-13T11:02:48.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.777+0000 7f97778ae700 1 -- 172.21.15.134:0/377316421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9770100430 msgr2=0x7f9770100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:48.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.777+0000 7f97778ae700 1 --2- 172.21.15.134:0/377316421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9770100430 0x7f9770100800 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9760009940 tx=0x7f9760009c50 comp rx=0 tx=0).stop 2024-04-13T11:02:48.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.777+0000 7f97778ae700 1 -- 172.21.15.134:0/377316421 shutdown_connections 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.777+0000 7f97778ae700 1 --2- 172.21.15.134:0/377316421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9770100d40 0x7f97701094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.777+0000 7f97778ae700 1 --2- 172.21.15.134:0/377316421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9770100430 0x7f9770100800 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.777+0000 7f97778ae700 1 -- 172.21.15.134:0/377316421 >> 172.21.15.134:0/377316421 conn(0x7f97700748b0 msgr2=0x7f9770074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.777+0000 7f97778ae700 1 -- 172.21.15.134:0/377316421 shutdown_connections 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.777+0000 7f97778ae700 1 -- 172.21.15.134:0/377316421 wait complete. 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f97778ae700 1 Processor -- start 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f97778ae700 1 -- start start 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f97778ae700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9770100430 0x7f9770101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f97778ae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9770100d40 0x7f97701022e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f97778ae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770102820 con 0x7f9770100d40 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f97778ae700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770102960 con 0x7f9770100430 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f9774e49700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9770100d40 0x7f97701022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f9774e49700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9770100d40 0x7f97701022e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58610/0 (socket says 172.21.15.134:58610) 2024-04-13T11:02:48.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f9774e49700 1 -- 172.21.15.134:0/126130102 learned_addr learned my addr 172.21.15.134:0/126130102 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f977564a700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9770100430 0x7f9770101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f9774e49700 1 -- 172.21.15.134:0/126130102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9770100430 msgr2=0x7f9770101da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f9774e49700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9770100430 0x7f9770101da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.778+0000 7f9774e49700 1 -- 172.21.15.134:0/126130102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600095f0 con 0x7f9770100d40 2024-04-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.779+0000 7f9774e49700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9770100d40 0x7f97701022e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f976c00c8a0 tx=0x7f976c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.779+0000 7f97667fc700 1 -- 172.21.15.134:0/126130102 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976c0078e0 con 0x7f9770100d40 2024-04-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.779+0000 7f97778ae700 1 -- 172.21.15.134:0/126130102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97701a1cb0 con 0x7f9770100d40 2024-04-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.779+0000 7f97667fc700 1 -- 172.21.15.134:0/126130102 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f976c00f450 con 0x7f9770100d40 2024-04-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.779+0000 7f97667fc700 1 -- 172.21.15.134:0/126130102 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976c00e5e0 con 0x7f9770100d40 2024-04-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.779+0000 7f97778ae700 1 -- 172.21.15.134:0/126130102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97701a2140 con 0x7f9770100d40 2024-04-13T11:02:48.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.780+0000 7f97778ae700 1 -- 172.21.15.134:0/126130102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977004ea50 con 0x7f9770100d40 2024-04-13T11:02:48.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.780+0000 7f97667fc700 1 -- 172.21.15.134:0/126130102 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f976c00f5c0 con 0x7f9770100d40 2024-04-13T11:02:48.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.781+0000 7f97667fc700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f975c06cce0 0x7f975c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:48.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.781+0000 7f977564a700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f975c06cce0 0x7f975c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:48.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.781+0000 7f97667fc700 1 -- 172.21.15.134:0/126130102 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f976c08c370 con 0x7f9770100d40 2024-04-13T11:02:48.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.781+0000 7f977564a700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f975c06cce0 0x7f975c06f190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97600059d0 tx=0x7f9760005960 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:48.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:48.785+0000 7f97667fc700 1 -- 172.21.15.134:0/126130102 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f976c056560 con 0x7f9770100d40 2024-04-13T11:02:48.822 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:48 smithi134 ceph-mon[39696]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:48.822 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:48 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:48.823 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:48 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-13T11:02:48.823 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:48 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-13T11:02:48.823 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:48 smithi134 ceph-mon[39696]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:02:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:48 smithi194 ceph-mon[46737]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:48 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:48 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-13T11:02:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:48 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-13T11:02:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:48 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:02:49.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.042+0000 7f97778ae700 1 -- 172.21.15.134:0/126130102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f97701a2570 con 0x7f9770100d40 2024-04-13T11:02:49.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.042+0000 7f97667fc700 1 -- 172.21.15.134:0/126130102 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1859 (secure 0 0 0) 0x7f976c059b80 con 0x7f9770100d40 2024-04-13T11:02:49.042 INFO:teuthology.orchestra.run.smithi134.stdout:e18 2024-04-13T11:02:49.042 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:02:49.043 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:02:49.043 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:02:49.043 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:02:49.043 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:02:49.043 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:02:49.043 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 18 2024-04-13T11:02:49.043 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:02:49.043 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:02:49.043 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T10:55:58.861624+0000 2024-04-13T11:02:49.043 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:02:49.044 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14492} 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:02:49.045 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:02:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:02:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:02:49.046 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:02:49.046 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:02:49.046 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:02:49.046 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:02:49.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 -- 172.21.15.134:0/126130102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f975c06cce0 msgr2=0x7f975c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:49.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f975c06cce0 0x7f975c06f190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97600059d0 tx=0x7f9760005960 comp rx=0 tx=0).stop 2024-04-13T11:02:49.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 -- 172.21.15.134:0/126130102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9770100d40 msgr2=0x7f97701022e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:49.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9770100d40 0x7f97701022e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f976c00c8a0 tx=0x7f976c00cbb0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 -- 172.21.15.134:0/126130102 shutdown_connections 2024-04-13T11:02:49.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f975c06cce0 0x7f975c06f190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9770100430 0x7f9770101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 --2- 172.21.15.134:0/126130102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9770100d40 0x7f97701022e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 -- 172.21.15.134:0/126130102 >> 172.21.15.134:0/126130102 conn(0x7f97700748b0 msgr2=0x7f97700fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:49.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 -- 172.21.15.134:0/126130102 shutdown_connections 2024-04-13T11:02:49.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.044+0000 7f97778ae700 1 -- 172.21.15.134:0/126130102 wait complete. 2024-04-13T11:02:49.048 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T11:02:49.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.149+0000 7f280576e700 1 -- 172.21.15.134:0/379972068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000ff2c0 msgr2=0x7f28000ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:49.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.149+0000 7f280576e700 1 --2- 172.21.15.134:0/379972068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000ff2c0 0x7f28000ff690 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009910 tx=0x7f27e8009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:49.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.149+0000 7f280576e700 1 -- 172.21.15.134:0/379972068 shutdown_connections 2024-04-13T11:02:49.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.149+0000 7f280576e700 1 --2- 172.21.15.134:0/379972068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28000ffc60 0x7f2800103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.149+0000 7f280576e700 1 --2- 172.21.15.134:0/379972068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000ff2c0 0x7f28000ff690 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.149+0000 7f280576e700 1 -- 172.21.15.134:0/379972068 >> 172.21.15.134:0/379972068 conn(0x7f28000fab60 msgr2=0x7f28000fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:49.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.149+0000 7f280576e700 1 -- 172.21.15.134:0/379972068 shutdown_connections 2024-04-13T11:02:49.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.149+0000 7f280576e700 1 -- 172.21.15.134:0/379972068 wait complete. 2024-04-13T11:02:49.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f280576e700 1 Processor -- start 2024-04-13T11:02:49.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f280576e700 1 -- start start 2024-04-13T11:02:49.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f280576e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28000ff2c0 0x7f280019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:49.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f280576e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000ffc60 0x7f280019bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:49.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f280576e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280019c5f0 con 0x7f28000ffc60 2024-04-13T11:02:49.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f280576e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2800195aa0 con 0x7f28000ff2c0 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f27fe7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000ffc60 0x7f280019bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f27fe7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000ffc60 0x7f280019bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58636/0 (socket says 172.21.15.134:58636) 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f27fe7fc700 1 -- 172.21.15.134:0/617999770 learned_addr learned my addr 172.21.15.134:0/617999770 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f27feffd700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28000ff2c0 0x7f280019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f27fe7fc700 1 -- 172.21.15.134:0/617999770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28000ff2c0 msgr2=0x7f280019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f27fe7fc700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28000ff2c0 0x7f280019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.150+0000 7f27fe7fc700 1 -- 172.21.15.134:0/617999770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80095f0 con 0x7f28000ffc60 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.151+0000 7f27fe7fc700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000ffc60 0x7f280019bf60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f27f000e8f0 tx=0x7f27f000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.151+0000 7f27f7fff700 1 -- 172.21.15.134:0/617999770 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27f0009790 con 0x7f28000ffc60 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.151+0000 7f280576e700 1 -- 172.21.15.134:0/617999770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2800195d80 con 0x7f28000ffc60 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.151+0000 7f27f7fff700 1 -- 172.21.15.134:0/617999770 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27f000c810 con 0x7f28000ffc60 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.151+0000 7f27f7fff700 1 -- 172.21.15.134:0/617999770 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27f0005520 con 0x7f28000ffc60 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.151+0000 7f280576e700 1 -- 172.21.15.134:0/617999770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28001962d0 con 0x7f28000ffc60 2024-04-13T11:02:49.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.152+0000 7f280576e700 1 -- 172.21.15.134:0/617999770 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280004ea50 con 0x7f28000ffc60 2024-04-13T11:02:49.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.152+0000 7f27f7fff700 1 -- 172.21.15.134:0/617999770 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f27f000c980 con 0x7f28000ffc60 2024-04-13T11:02:49.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.153+0000 7f27f7fff700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27ec06cce0 0x7f27ec06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:49.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.153+0000 7f27f7fff700 1 -- 172.21.15.134:0/617999770 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f27f0014070 con 0x7f28000ffc60 2024-04-13T11:02:49.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.153+0000 7f27feffd700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27ec06cce0 0x7f27ec06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:49.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.153+0000 7f27feffd700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27ec06cce0 0x7f27ec06f190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009fd0 tx=0x7f27e8005940 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:49.157 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.157+0000 7f27f7fff700 1 -- 172.21.15.134:0/617999770 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f27f005a350 con 0x7f28000ffc60 2024-04-13T11:02:49.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.377+0000 7f280576e700 1 -- 172.21.15.134:0/617999770 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f28001967f0 con 0x7f27ec06cce0 2024-04-13T11:02:49.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.379+0000 7f27f7fff700 1 -- 172.21.15.134:0/617999770 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f28001967f0 con 0x7f27ec06cce0 2024-04-13T11:02:49.378 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:02:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:02:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:02:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:02:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:02:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-04-13T11:02:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:02:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/23 daemons upgraded", 2024-04-13T11:02:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mon daemons", 2024-04-13T11:02:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:02:49.379 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:02:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 -- 172.21.15.134:0/617999770 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27ec06cce0 msgr2=0x7f27ec06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27ec06cce0 0x7f27ec06f190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009fd0 tx=0x7f27e8005940 comp rx=0 tx=0).stop 2024-04-13T11:02:49.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 -- 172.21.15.134:0/617999770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000ffc60 msgr2=0x7f280019bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000ffc60 0x7f280019bf60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f27f000e8f0 tx=0x7f27f000ec00 comp rx=0 tx=0).stop 2024-04-13T11:02:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 -- 172.21.15.134:0/617999770 shutdown_connections 2024-04-13T11:02:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27ec06cce0 0x7f27ec06f190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28000ff2c0 0x7f280019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 --2- 172.21.15.134:0/617999770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28000ffc60 0x7f280019bf60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 -- 172.21.15.134:0/617999770 >> 172.21.15.134:0/617999770 conn(0x7f28000fab60 msgr2=0x7f2800068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 -- 172.21.15.134:0/617999770 shutdown_connections 2024-04-13T11:02:49.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.381+0000 7f280576e700 1 -- 172.21.15.134:0/617999770 wait complete. 2024-04-13T11:02:49.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.485+0000 7f5b7e420700 1 -- 172.21.15.134:0/2128382049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b780ff390 msgr2=0x7f5b780ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:49.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.485+0000 7f5b7e420700 1 --2- 172.21.15.134:0/2128382049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b780ff390 0x7f5b780ff760 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009910 tx=0x7f5b68009c20 comp rx=0 tx=0).stop 2024-04-13T11:02:49.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.485+0000 7f5b7e420700 1 -- 172.21.15.134:0/2128382049 shutdown_connections 2024-04-13T11:02:49.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.485+0000 7f5b7e420700 1 --2- 172.21.15.134:0/2128382049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780ffd30 0x7f5b78103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.485+0000 7f5b7e420700 1 --2- 172.21.15.134:0/2128382049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b780ff390 0x7f5b780ff760 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.485+0000 7f5b7e420700 1 -- 172.21.15.134:0/2128382049 >> 172.21.15.134:0/2128382049 conn(0x7f5b78074f50 msgr2=0x7f5b78075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:49.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.485+0000 7f5b7e420700 1 -- 172.21.15.134:0/2128382049 shutdown_connections 2024-04-13T11:02:49.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.485+0000 7f5b7e420700 1 -- 172.21.15.134:0/2128382049 wait complete. 2024-04-13T11:02:49.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.486+0000 7f5b7e420700 1 Processor -- start 2024-04-13T11:02:49.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.486+0000 7f5b7e420700 1 -- start start 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.486+0000 7f5b7e420700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780ff390 0x7f5b78196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.486+0000 7f5b7e420700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b780ffd30 0x7f5b78197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.486+0000 7f5b7e420700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78197740 con 0x7f5b780ffd30 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.486+0000 7f5b7e420700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78197880 con 0x7f5b780ff390 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.486+0000 7f5b777fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b780ffd30 0x7f5b78197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.486+0000 7f5b777fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b780ffd30 0x7f5b78197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56292/0 (socket says 172.21.15.134:56292) 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.486+0000 7f5b777fe700 1 -- 172.21.15.134:0/1335636122 learned_addr learned my addr 172.21.15.134:0/1335636122 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.487+0000 7f5b77fff700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780ff390 0x7f5b78196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.487+0000 7f5b777fe700 1 -- 172.21.15.134:0/1335636122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780ff390 msgr2=0x7f5b78196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.487+0000 7f5b777fe700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780ff390 0x7f5b78196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.487+0000 7f5b777fe700 1 -- 172.21.15.134:0/1335636122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680095f0 con 0x7f5b780ffd30 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.487+0000 7f5b777fe700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b780ffd30 0x7f5b78197120 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00b480 tx=0x7f5b6c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:49.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.487+0000 7f5b757fa700 1 -- 172.21.15.134:0/1335636122 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b6c0118c0 con 0x7f5b780ffd30 2024-04-13T11:02:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.487+0000 7f5b7e420700 1 -- 172.21.15.134:0/1335636122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7819fc50 con 0x7f5b780ffd30 2024-04-13T11:02:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.487+0000 7f5b757fa700 1 -- 172.21.15.134:0/1335636122 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5b6c010380 con 0x7f5b780ffd30 2024-04-13T11:02:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.487+0000 7f5b757fa700 1 -- 172.21.15.134:0/1335636122 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b6c00f510 con 0x7f5b780ffd30 2024-04-13T11:02:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.487+0000 7f5b7e420700 1 -- 172.21.15.134:0/1335636122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b781a0110 con 0x7f5b780ffd30 2024-04-13T11:02:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.488+0000 7f5b7e420700 1 -- 172.21.15.134:0/1335636122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b78107650 con 0x7f5b780ffd30 2024-04-13T11:02:49.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.488+0000 7f5b757fa700 1 -- 172.21.15.134:0/1335636122 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90844+0+0 (secure 0 0 0) 0x7f5b6c0104f0 con 0x7f5b780ffd30 2024-04-13T11:02:49.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.489+0000 7f5b757fa700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5b6006cce0 0x7f5b6006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:02:49.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.489+0000 7f5b757fa700 1 -- 172.21.15.134:0/1335636122 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5b6c08c0b0 con 0x7f5b780ffd30 2024-04-13T11:02:49.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.489+0000 7f5b77fff700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5b6006cce0 0x7f5b6006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:02:49.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.489+0000 7f5b77fff700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5b6006cce0 0x7f5b6006f190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006010 tx=0x7f5b6801a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:02:49.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.493+0000 7f5b757fa700 1 -- 172.21.15.134:0/1335636122 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182652 (secure 0 0 0) 0x7f5b6c056220 con 0x7f5b780ffd30 2024-04-13T11:02:49.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.788+0000 7f5b7e420700 1 -- 172.21.15.134:0/1335636122 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5b7804ea50 con 0x7f5b780ffd30 2024-04-13T11:02:49.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.789+0000 7f5b757fa700 1 -- 172.21.15.134:0/1335636122 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5b6c0107a0 con 0x7f5b780ffd30 2024-04-13T11:02:49.789 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:02:49.789 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:02:49.789 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:02:49.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 -- 172.21.15.134:0/1335636122 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5b6006cce0 msgr2=0x7f5b6006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:49.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5b6006cce0 0x7f5b6006f190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006010 tx=0x7f5b6801a040 comp rx=0 tx=0).stop 2024-04-13T11:02:49.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 -- 172.21.15.134:0/1335636122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b780ffd30 msgr2=0x7f5b78197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:02:49.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b780ffd30 0x7f5b78197120 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00b480 tx=0x7f5b6c00b840 comp rx=0 tx=0).stop 2024-04-13T11:02:49.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 -- 172.21.15.134:0/1335636122 shutdown_connections 2024-04-13T11:02:49.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5b6006cce0 0x7f5b6006f190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b780ff390 0x7f5b78196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 --2- 172.21.15.134:0/1335636122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b780ffd30 0x7f5b78197120 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:02:49.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 -- 172.21.15.134:0/1335636122 >> 172.21.15.134:0/1335636122 conn(0x7f5b78074f50 msgr2=0x7f5b780fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:02:49.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 -- 172.21.15.134:0/1335636122 shutdown_connections 2024-04-13T11:02:49.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:02:49.791+0000 7f5b7e420700 1 -- 172.21.15.134:0/1335636122 wait complete. 2024-04-13T11:02:49.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:49 smithi134 ceph-mon[39696]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:49.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:49 smithi134 ceph-mon[39696]: pgmap v98: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:49 smithi134 ceph-mon[39696]: Upgrade: Updating mon.smithi134 2024-04-13T11:02:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:49 smithi134 ceph-mon[39696]: Deploying daemon mon.smithi134 on smithi134 2024-04-13T11:02:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:49 smithi134 ceph-mon[39696]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:49 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/769438611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:02:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:49 smithi134 ceph-mon[39696]: from='client.? 172.21.15.134:0/126130102' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:02:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:49 smithi134 ceph-mon[39696]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:49 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:02:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:49 smithi194 ceph-mon[46737]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:49 smithi194 ceph-mon[46737]: pgmap v98: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:49 smithi194 ceph-mon[46737]: Upgrade: Updating mon.smithi134 2024-04-13T11:02:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:49 smithi194 ceph-mon[46737]: Deploying daemon mon.smithi134 on smithi134 2024-04-13T11:02:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:49 smithi194 ceph-mon[46737]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:49 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/769438611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:02:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:49 smithi194 ceph-mon[46737]: from='client.? 172.21.15.134:0/126130102' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:02:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:49 smithi194 ceph-mon[46737]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:02:50.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:50 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134[39673]: 2024-04-13T11:02:50.097+0000 7f3cac2b2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:02:50.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:50 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134[39673]: 2024-04-13T11:02:50.097+0000 7f3cac2b2700 -1 mon.smithi134@0(leader) e2 *** Got Signal Terminated *** 2024-04-13T11:02:50.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:50 smithi134 bash[111981]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134 2024-04-13T11:02:51.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 systemd[1]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi134.service: Succeeded. 2024-04-13T11:02:51.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 systemd[1]: Stopped Ceph mon.smithi134 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:02:51.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 systemd[1]: Starting Ceph mon.smithi134 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:02:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: set uid:gid to 167:167 (ceph:ceph) 2024-04-13T11:02:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable), process ceph-mon, pid 7 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: pidfile_write: ignore empty --pid-file 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: load: jerasure load: lrc 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: RocksDB version: 7.9.2 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Git sha 0 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Compile date 2024-04-07 20:35:11 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: DB SUMMARY 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: DB Session ID: LEQAOS98M4T1ZXA7ESA2 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: CURRENT file: CURRENT 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: IDENTITY file: IDENTITY 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1509 Bytes 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 1, files: 000032.sst 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000030.log size: 5207319 ; 2024-04-13T11:02:52.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.error_if_exists: 0 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.create_if_missing: 0 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.paranoid_checks: 1 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.env: 0x55a31cfe27a0 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.fs: PosixFileSystem 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.info_log: 0x55a320109380 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_file_opening_threads: 16 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.statistics: (nil) 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.use_fsync: 0 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_log_file_size: 0 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-13T11:02:52.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-13T11:02:52.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.keep_log_file_num: 1000 2024-04-13T11:02:52.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.recycle_log_file_num: 0 2024-04-13T11:02:52.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.allow_fallocate: 1 2024-04-13T11:02:52.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.allow_mmap_reads: 0 2024-04-13T11:02:52.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.allow_mmap_writes: 0 2024-04-13T11:02:52.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.use_direct_reads: 0 2024-04-13T11:02:52.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-13T11:02:52.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.create_missing_column_families: 0 2024-04-13T11:02:52.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.db_log_dir: 2024-04-13T11:02:52.187 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.wal_dir: 2024-04-13T11:02:52.189 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-13T11:02:52.189 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-13T11:02:52.189 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-13T11:02:52.189 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.advise_random_on_open: 1 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.db_write_buffer_size: 0 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.write_buffer_manager: 0x55a31f380140 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.rate_limiter: (nil) 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-13T11:02:52.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.wal_recovery_mode: 2 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.enable_thread_tracking: 0 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.enable_pipelined_write: 0 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.unordered_write: 0 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.row_cache: None 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.wal_filter: None 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.allow_ingest_behind: 0 2024-04-13T11:02:52.191 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.two_write_queues: 0 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.manual_wal_flush: 0 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.wal_compression: 0 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.atomic_flush: 0 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.log_readahead_size: 0 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.best_efforts_recovery: 0 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-13T11:02:52.192 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-13T11:02:52.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.allow_data_in_errors: 0 2024-04-13T11:02:52.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.db_host_id: __hostname__ 2024-04-13T11:02:52.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-13T11:02:52.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_background_jobs: 2 2024-04-13T11:02:52.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_background_compactions: -1 2024-04-13T11:02:52.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_subcompactions: 1 2024-04-13T11:02:52.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-13T11:02:52.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-13T11:02:52.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-13T11:02:52.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_total_wal_size: 0 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_open_files: -1 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bytes_per_sync: 0 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_readahead_size: 0 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_background_flushes: -1 2024-04-13T11:02:52.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Compression algorithms supported: 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: kZSTD supported: 0 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: kXpressCompression supported: 0 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: kLZ4HCCompression supported: 1 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: kZlibCompression supported: 1 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: kSnappyCompression supported: 1 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: kLZ4Compression supported: 1 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: kBZip2Compression supported: 0 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-13T11:02:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000015 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.merge_operator: 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_filter: None 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_filter_factory: None 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.sst_partitioner_factory: None 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a3201094a0) 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-04-13T11:02:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_type: 0 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_index_type: 0 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_shortening: 1 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: checksum: 4 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: no_block_cache: 0 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache: 0x55a31f4211f0 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-04-13T11:02:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_options: 2024-04-13T11:02:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: capacity : 536870912 2024-04-13T11:02:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_shard_bits : 4 2024-04-13T11:02:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: strict_capacity_limit : 0 2024-04-13T11:02:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-04-13T11:02:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_compressed: (nil) 2024-04-13T11:02:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: persistent_cache: (nil) 2024-04-13T11:02:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size: 4096 2024-04-13T11:02:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size_deviation: 10 2024-04-13T11:02:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_restart_interval: 16 2024-04-13T11:02:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_block_restart_interval: 1 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_block_size: 4096 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: partition_filters: 0 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: use_delta_encoding: 1 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: filter_policy: bloomfilter 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: whole_key_filtering: 1 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: verify_compression: 0 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: format_version: 5 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_index_compression: 1 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_align: 0 2024-04-13T11:02:52.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_auto_readahead_size: 262144 2024-04-13T11:02:52.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: prepopulate_block_cache: 0 2024-04-13T11:02:52.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: initial_auto_readahead_size: 8192 2024-04-13T11:02:52.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-04-13T11:02:52.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.write_buffer_size: 33554432 2024-04-13T11:02:52.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_write_buffer_number: 2 2024-04-13T11:02:52.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compression: NoCompression 2024-04-13T11:02:52.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bottommost_compression: Disabled 2024-04-13T11:02:52.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.prefix_extractor: nullptr 2024-04-13T11:02:52.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-13T11:02:52.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.num_levels: 7 2024-04-13T11:02:52.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-13T11:02:52.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-13T11:02:52.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-13T11:02:52.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-13T11:02:52.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-13T11:02:52.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-13T11:02:52.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compression_opts.level: 32767 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compression_opts.strategy: 0 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-13T11:02:52.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-13T11:02:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-13T11:02:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compression_opts.enabled: false 2024-04-13T11:02:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-13T11:02:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-13T11:02:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-13T11:02:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-13T11:02:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.target_file_size_base: 67108864 2024-04-13T11:02:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-13T11:02:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-13T11:02:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-13T11:02:52.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-13T11:02:52.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-13T11:02:52.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-13T11:02:52.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-13T11:02:52.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-13T11:02:52.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-13T11:02:52.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-13T11:02:52.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-13T11:02:52.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-13T11:02:52.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.arena_block_size: 1048576 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.disable_auto_compactions: 0 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-13T11:02:52.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-13T11:02:52.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-13T11:02:52.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-13T11:02:52.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-13T11:02:52.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-13T11:02:52.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.table_properties_collectors: 2024-04-13T11:02:52.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.inplace_update_support: 0 2024-04-13T11:02:52.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-13T11:02:52.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-13T11:02:52.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-13T11:02:52.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-13T11:02:52.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.bloom_locality: 0 2024-04-13T11:02:52.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.max_successive_merges: 0 2024-04-13T11:02:52.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-13T11:02:52.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.paranoid_file_checks: 0 2024-04-13T11:02:52.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.force_consistency_checks: 1 2024-04-13T11:02:52.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.report_bg_io_stats: 0 2024-04-13T11:02:52.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.ttl: 2592000 2024-04-13T11:02:52.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-13T11:02:52.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-13T11:02:52.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.enable_blob_files: false 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.min_blob_size: 0 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.blob_file_size: 268435456 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.blob_file_starting_level: 0 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12023, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-04-13T11:02:52.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1d3d4ebd-9179-4c9f-bea0-889289a70e40 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713006171767419, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713006171783425, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 4610475, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12024, "largest_seqno": 15758, "table_properties": {"data_size": 4596402, "index_size": 8956, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4101, "raw_key_size": 35878, "raw_average_key_size": 21, "raw_value_size": 4564320, "raw_average_value_size": 2791, "num_data_blocks": 405, "num_entries": 1635, "num_filter_entries": 1635, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713006171, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1d3d4ebd-9179-4c9f-bea0-889289a70e40", "db_session_id": "LEQAOS98M4T1ZXA7ESA2", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713006171783539, "job": 1, "event": "recovery_finished"} 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi134/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a31f4be000 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: DB pointer 0x55a31f4ac000 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** DB Stats ** 2024-04-13T11:02:52.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 1/0 4.40 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 544.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-13T11:02:52.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L6 1/0 4.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 9.25 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 544.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 544.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 544.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-13T11:02:52.211 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 236.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 236.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache BinnedLRUCache@0x55a31f4211f0#7 capacity: 512.00 MB usage: 13.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.53 KB,0.000864267%) IndexBlock(1,9.08 KB,0.00173151%) Misc(1,0.00 KB,0%) 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: starting mon.smithi134 rank 0 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: mon.smithi134@-1(???) e2 preinit fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T11:02:52.212 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: mon.smithi134@-1(???).mds e18 new map 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: mon.smithi134@-1(???).mds e18 print_map 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: e18 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: legacy client fscid: 1 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Filesystem 'cephfs' (1) 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: fs_name cephfs 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: epoch 18 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: modified 2024-04-13T10:55:58.861624+0000 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: tableserver 0 2024-04-13T11:02:52.213 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: root 0 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_timeout 60 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_autoclose 300 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_file_size 1099511627776 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_xattr_size 65536 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: required_client_features {} 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure 0 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure_osd_epoch 46 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_mds 1 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: in 0 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: up {0=14492} 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: failed 2024-04-13T11:02:52.214 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: damaged 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: stopped 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_pools [3] 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_pool 2 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: inline_data enabled 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: balancer 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: bal_rank_mask -1 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: standby_count_wanted 1 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Standby daemons: 2024-04-13T11:02:52.215 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-04-13T11:02:52.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:02:52.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:02:52.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: mon.smithi134@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-13T11:02:52.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: mon.smithi134@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-13T11:02:52.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: mon.smithi134@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-13T11:02:52.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: mon.smithi134@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-13T11:02:52.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 ceph-mon[112184]: mon.smithi134@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-04-13T11:02:52.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 bash[112146]: 1cfd91f5cdead5b36c8f4479236357127f0a62039dd13922b74cedd7eafacde8 2024-04-13T11:02:52.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:51 smithi134 systemd[1]: Started Ceph mon.smithi134 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:02:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T11:02:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T11:02:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: pgmap v100: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:02:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: mon.smithi134 calling monitor election 2024-04-13T11:02:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: mon.smithi134 is new leader, mons smithi134,smithi194 in quorum (ranks 0,1) 2024-04-13T11:02:53.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-13T11:02:53.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T11:02:53.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: osdmap e48: 6 total, 6 up, 6 in 2024-04-13T11:02:53.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: mgrmap e32: smithi134.tmanda(active, since 3m), standbys: smithi194.tcpynt 2024-04-13T11:02:53.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:02:53.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:02:53.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:02:53.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: from='mgr.14668 ' entity='' 2024-04-13T11:02:53.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:53 smithi134 ceph-mon[112184]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T11:02:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T11:02:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: pgmap v100: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:02:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: mon.smithi134 calling monitor election 2024-04-13T11:02:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: mon.smithi134 is new leader, mons smithi134,smithi194 in quorum (ranks 0,1) 2024-04-13T11:02:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-13T11:02:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T11:02:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: osdmap e48: 6 total, 6 up, 6 in 2024-04-13T11:02:53.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: mgrmap e32: smithi134.tmanda(active, since 3m), standbys: smithi194.tcpynt 2024-04-13T11:02:53.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:02:53.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:02:53.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:02:53.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: from='mgr.14668 ' entity='' 2024-04-13T11:02:53.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:53 smithi194 ceph-mon[46737]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:54.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:54 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:02:54.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:54 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:02:55.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:55 smithi134 ceph-mon[112184]: pgmap v101: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:55 smithi194 ceph-mon[46737]: pgmap v101: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:02:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:57 smithi134 ceph-mon[112184]: pgmap v102: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:57.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:57 smithi194 ceph-mon[46737]: pgmap v102: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:59 smithi134 ceph-mon[112184]: pgmap v103: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:59 smithi134 ceph-mon[112184]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:02:59 smithi134 ceph-mon[112184]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:59 smithi194 ceph-mon[46737]: pgmap v103: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:02:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:59 smithi194 ceph-mon[46737]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:02:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:02:59 smithi194 ceph-mon[46737]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:00.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:00 smithi134 ceph-mon[112184]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:00.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:00 smithi134 ceph-mon[112184]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:00.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:00 smithi134 ceph-mon[112184]: pgmap v104: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:00 smithi194 ceph-mon[46737]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:00 smithi194 ceph-mon[46737]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:00 smithi194 ceph-mon[46737]: pgmap v104: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:03.163 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:02 smithi134 ceph-mon[112184]: pgmap v105: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:02 smithi194 ceph-mon[46737]: pgmap v105: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:04 smithi134 ceph-mon[112184]: Detected new or changed devices on smithi134 2024-04-13T11:03:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:04 smithi134 ceph-mon[112184]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:04 smithi134 ceph-mon[112184]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:04 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:04 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:03:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:04 smithi134 ceph-mon[112184]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:04 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:04 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:04.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:04 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-13T11:03:04.935 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:04 smithi194 ceph-mon[46737]: Detected new or changed devices on smithi134 2024-04-13T11:03:04.935 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:04 smithi194 ceph-mon[46737]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:04.935 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:04 smithi194 ceph-mon[46737]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:04.935 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:04 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:04.936 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:04 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:03:04.936 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:04 smithi194 ceph-mon[46737]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:04.936 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:04 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:04.936 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:04 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:04.936 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:04 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-13T11:03:05.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:05 smithi134 ceph-mon[112184]: pgmap v106: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:05.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:05 smithi134 ceph-mon[112184]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:05.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:05 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-13T11:03:05.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:05 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-13T11:03:05.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:05 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:05 smithi194 ceph-mon[46737]: pgmap v106: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:05 smithi194 ceph-mon[46737]: from='mgr.14668 ' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:05 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-13T11:03:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:05 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-13T11:03:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:05 smithi194 ceph-mon[46737]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:06 smithi134 ceph-mon[112184]: Upgrade: Updating mon.smithi194 2024-04-13T11:03:06.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:06 smithi134 ceph-mon[112184]: Deploying daemon mon.smithi194 on smithi194 2024-04-13T11:03:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:06 smithi194 ceph-mon[46737]: Upgrade: Updating mon.smithi194 2024-04-13T11:03:06.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:06 smithi194 ceph-mon[46737]: Deploying daemon mon.smithi194 on smithi194 2024-04-13T11:03:07.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:07 smithi194 systemd[1]: Stopping Ceph mon.smithi194 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:03:07.987 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:07 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi194[46691]: 2024-04-13T11:03:07.608+0000 7fcb8ccf8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi194 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:03:07.987 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:07 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi194[46691]: 2024-04-13T11:03:07.608+0000 7fcb8ccf8700 -1 mon.smithi194@1(peon) e2 *** Got Signal Terminated *** 2024-04-13T11:03:08.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:08 smithi194 bash[82860]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi194 2024-04-13T11:03:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:08 smithi194 systemd[1]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi194.service: Succeeded. 2024-04-13T11:03:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:08 smithi194 systemd[1]: Stopped Ceph mon.smithi194 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:03:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:08 smithi194 systemd[1]: Starting Ceph mon.smithi194 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:03:09.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: set uid:gid to 167:167 (ceph:ceph) 2024-04-13T11:03:09.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable), process ceph-mon, pid 7 2024-04-13T11:03:09.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: pidfile_write: ignore empty --pid-file 2024-04-13T11:03:09.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: load: jerasure load: lrc 2024-04-13T11:03:09.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: RocksDB version: 7.9.2 2024-04-13T11:03:09.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Git sha 0 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Compile date 2024-04-07 20:35:11 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: DB SUMMARY 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: DB Session ID: WAISPIQOOBUKYSGF9D6Q 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: CURRENT file: CURRENT 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: IDENTITY file: IDENTITY 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1403 Bytes 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi194/store.db dir, Total Num: 1, files: 000027.sst 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi194/store.db: 000025.log size: 8383407 ; 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.error_if_exists: 0 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.create_if_missing: 0 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.paranoid_checks: 1 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-13T11:03:09.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.env: 0x55ef02b2c7a0 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.fs: PosixFileSystem 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.info_log: 0x55ef04231380 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_file_opening_threads: 16 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.statistics: (nil) 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.use_fsync: 0 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_log_file_size: 0 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.keep_log_file_num: 1000 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.recycle_log_file_num: 0 2024-04-13T11:03:09.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.allow_fallocate: 1 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.allow_mmap_reads: 0 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.allow_mmap_writes: 0 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.use_direct_reads: 0 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.create_missing_column_families: 0 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.db_log_dir: 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.wal_dir: 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-13T11:03:09.753 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.advise_random_on_open: 1 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.db_write_buffer_size: 0 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.write_buffer_manager: 0x55ef034a8140 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.rate_limiter: (nil) 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.wal_recovery_mode: 2 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.enable_thread_tracking: 0 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.enable_pipelined_write: 0 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.unordered_write: 0 2024-04-13T11:03:09.754 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.row_cache: None 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.wal_filter: None 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.allow_ingest_behind: 0 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.two_write_queues: 0 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.manual_wal_flush: 0 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.wal_compression: 0 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.atomic_flush: 0 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-13T11:03:09.755 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.log_readahead_size: 0 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.best_efforts_recovery: 0 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.allow_data_in_errors: 0 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.db_host_id: __hostname__ 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_background_jobs: 2 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_background_compactions: -1 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_subcompactions: 1 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-13T11:03:09.756 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_total_wal_size: 0 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_open_files: -1 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bytes_per_sync: 0 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_readahead_size: 0 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_background_flushes: -1 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Compression algorithms supported: 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: kZSTD supported: 0 2024-04-13T11:03:09.757 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: kXpressCompression supported: 0 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: kLZ4HCCompression supported: 1 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: kZlibCompression supported: 1 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: kSnappyCompression supported: 1 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: kLZ4Compression supported: 1 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: kBZip2Compression supported: 0 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi194/store.db/MANIFEST-000010 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.merge_operator: 2024-04-13T11:03:09.758 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_filter: None 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_filter_factory: None 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.sst_partitioner_factory: None 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ef042314a0) 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: cache_index_and_filter_blocks: 1 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: pin_top_level_index_and_filter: 1 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_type: 0 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_block_index_type: 0 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_shortening: 1 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-13T11:03:09.759 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: checksum: 4 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: no_block_cache: 0 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache: 0x55ef035491f0 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_name: BinnedLRUCache 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_options: 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: capacity : 536870912 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: num_shard_bits : 4 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: strict_capacity_limit : 0 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: high_pri_pool_ratio: 0.000 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_cache_compressed: (nil) 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: persistent_cache: (nil) 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_size: 4096 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_size_deviation: 10 2024-04-13T11:03:09.760 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_restart_interval: 16 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: index_block_restart_interval: 1 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: metadata_block_size: 4096 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: partition_filters: 0 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: use_delta_encoding: 1 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: filter_policy: bloomfilter 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: whole_key_filtering: 1 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: verify_compression: 0 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: read_amp_bytes_per_bit: 0 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: format_version: 5 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: enable_index_compression: 1 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: block_align: 0 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: max_auto_readahead_size: 262144 2024-04-13T11:03:09.761 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: prepopulate_block_cache: 0 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: initial_auto_readahead_size: 8192 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: num_file_reads_for_auto_readahead: 2 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.write_buffer_size: 33554432 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_write_buffer_number: 2 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compression: NoCompression 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bottommost_compression: Disabled 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.prefix_extractor: nullptr 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.num_levels: 7 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-13T11:03:09.762 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compression_opts.level: 32767 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compression_opts.strategy: 0 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-13T11:03:09.763 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compression_opts.enabled: false 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.target_file_size_base: 67108864 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-13T11:03:09.764 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.arena_block_size: 1048576 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-13T11:03:09.765 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.disable_auto_compactions: 0 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.table_properties_collectors: 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.inplace_update_support: 0 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-13T11:03:09.766 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.bloom_locality: 0 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.max_successive_merges: 0 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.paranoid_file_checks: 0 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.force_consistency_checks: 1 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.report_bg_io_stats: 0 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.ttl: 2592000 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-13T11:03:09.767 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.enable_blob_files: false 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.min_blob_size: 0 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.blob_file_size: 268435456 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.blob_file_starting_level: 0 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi194/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12029, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-13T11:03:09.768 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ea9ef67e-d9f4-42e4-a42c-6c442e3f65e3 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713006189344976, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713006189365872, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4925352, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12034, "largest_seqno": 16458, "table_properties": {"data_size": 4910254, "index_size": 9725, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4357, "raw_key_size": 38273, "raw_average_key_size": 21, "raw_value_size": 4875878, "raw_average_value_size": 2802, "num_data_blocks": 440, "num_entries": 1740, "num_filter_entries": 1740, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713006189, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ea9ef67e-d9f4-42e4-a42c-6c442e3f65e3", "db_session_id": "WAISPIQOOBUKYSGF9D6Q", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713006189365947, "job": 1, "event": "recovery_finished"} 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi194/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ef035e6000 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: DB pointer 0x55ef035d4000 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** DB Stats ** 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-13T11:03:09.769 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: L0 1/0 4.70 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 540.3 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: L6 1/0 4.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Sum 2/0 9.55 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 540.3 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-04-13T11:03:09.770 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 540.3 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** Compaction Stats [default] ** 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 540.3 0.01 0.00 1 0.009 0 0 0.0 0.0 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Flush(GB): cumulative 0.005, interval 0.005 2024-04-13T11:03:09.771 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Cumulative compaction: 0.00 GB write, 183.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Interval compaction: 0.00 GB write, 183.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Block cache BinnedLRUCache@0x55ef035491f0#7 capacity: 512.00 MB usage: 14.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.53 KB,0.000864267%) IndexBlock(1,10.08 KB,0.00192225%) Misc(1,0.00 KB,0%) 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: starting mon.smithi194 rank 1 at public addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] at bind addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi194 fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: mon.smithi194@-1(???) e2 preinit fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T11:03:09.772 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: mon.smithi194@-1(???).mds e18 new map 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: mon.smithi194@-1(???).mds e18 print_map 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: e18 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: legacy client fscid: 1 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Filesystem 'cephfs' (1) 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: fs_name cephfs 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: epoch 18 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: modified 2024-04-13T10:55:58.861624+0000 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: tableserver 0 2024-04-13T11:03:09.773 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: root 0 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: session_timeout 60 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: session_autoclose 300 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: max_file_size 1099511627776 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: max_xattr_size 65536 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: required_client_features {} 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: last_failure 0 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: last_failure_osd_epoch 46 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: max_mds 1 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: in 0 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: up {0=14492} 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: failed 2024-04-13T11:03:09.774 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: damaged 2024-04-13T11:03:09.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: stopped 2024-04-13T11:03:09.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: data_pools [3] 2024-04-13T11:03:09.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: metadata_pool 2 2024-04-13T11:03:09.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: inline_data enabled 2024-04-13T11:03:09.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: balancer 2024-04-13T11:03:09.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: bal_rank_mask -1 2024-04-13T11:03:09.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: standby_count_wanted 1 2024-04-13T11:03:09.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:09.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:09.775 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: Standby daemons: 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout: [mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: mon.smithi194@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: mon.smithi194@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: mon.smithi194@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: mon.smithi194@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 ceph-mon[83053]: mon.smithi194@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 bash[83015]: 90c450150c9c420ae4acf51af951a2848dc757317886c484835c9b21334121fb 2024-04-13T11:03:09.776 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:09 smithi194 systemd[1]: Started Ceph mon.smithi194 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:03:10.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:10 smithi134 ceph-mon[112184]: pgmap v107: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:10 smithi194 ceph-mon[83053]: pgmap v107: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T11:03:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T11:03:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: pgmap v108: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:03:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: pgmap v109: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: mon.smithi194 calling monitor election 2024-04-13T11:03:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: mon.smithi134 calling monitor election 2024-04-13T11:03:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: mon.smithi134 is new leader, mons smithi134,smithi194 in quorum (ranks 0,1) 2024-04-13T11:03:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-13T11:03:11.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T11:03:11.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: osdmap e48: 6 total, 6 up, 6 in 2024-04-13T11:03:11.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: mgrmap e32: smithi134.tmanda(active, since 3m), standbys: smithi194.tcpynt 2024-04-13T11:03:11.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:03:11.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:03:11.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:03:11.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:11.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:11.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:11 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:11.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-04-13T11:03:11.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mon metadata", "id": "smithi194"}]: dispatch 2024-04-13T11:03:11.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: pgmap v108: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: pgmap v109: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: mon.smithi194 calling monitor election 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: mon.smithi134 calling monitor election 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: mon.smithi134 is new leader, mons smithi134,smithi194 in quorum (ranks 0,1) 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi194=[v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: osdmap e48: 6 total, 6 up, 6 in 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: mgrmap e32: smithi134.tmanda(active, since 3m), standbys: smithi194.tcpynt 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:11.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:11.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:11 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:13.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:13 smithi134 ceph-mon[112184]: pgmap v110: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:13.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:13 smithi194 ceph-mon[83053]: pgmap v110: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:14 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:14 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:14 smithi194 ceph-mon[83053]: pgmap v111: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:15.144 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:14 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:15.145 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:14 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:15.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:14 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:15.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:14 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:15.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:14 smithi134 ceph-mon[112184]: pgmap v111: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:15.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:14 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:15.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:14 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:17.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:16 smithi194 ceph-mon[83053]: pgmap v112: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:17.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:16 smithi134 ceph-mon[112184]: pgmap v112: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: pgmap v113: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: Detected new or changed devices on smithi194 2024-04-13T11:03:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:03:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: Upgrade: Setting container_image for all mon 2024-04-13T11:03:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]: dispatch 2024-04-13T11:03:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2024-04-13T11:03:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]: dispatch 2024-04-13T11:03:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]': finished 2024-04-13T11:03:19.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.899+0000 7fd1fe220700 1 -- 172.21.15.134:0/3438542793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1f80ffd30 msgr2=0x7fd1f8103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:19.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.899+0000 7fd1fe220700 1 --2- 172.21.15.134:0/3438542793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1f80ffd30 0x7fd1f8103ce0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009910 tx=0x7fd1ec009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:19.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.900+0000 7fd1fe220700 1 -- 172.21.15.134:0/3438542793 shutdown_connections 2024-04-13T11:03:19.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.900+0000 7fd1fe220700 1 --2- 172.21.15.134:0/3438542793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1f80ffd30 0x7fd1f8103ce0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:19.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.900+0000 7fd1fe220700 1 --2- 172.21.15.134:0/3438542793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f80ff390 0x7fd1f80ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:19.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.900+0000 7fd1fe220700 1 -- 172.21.15.134:0/3438542793 >> 172.21.15.134:0/3438542793 conn(0x7fd1f8074f50 msgr2=0x7fd1f8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:19.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.900+0000 7fd1fe220700 1 -- 172.21.15.134:0/3438542793 shutdown_connections 2024-04-13T11:03:19.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.900+0000 7fd1fe220700 1 -- 172.21.15.134:0/3438542793 wait complete. 2024-04-13T11:03:19.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.900+0000 7fd1fe220700 1 Processor -- start 2024-04-13T11:03:19.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1fe220700 1 -- start start 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1fe220700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f80ff390 0x7fd1f8196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1fe220700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1f80ffd30 0x7fd1f8196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1fe220700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f8197570 con 0x7fd1f80ffd30 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1fe220700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f81976e0 con 0x7fd1f80ff390 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1f6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1f80ffd30 0x7fd1f8196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1f6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1f80ffd30 0x7fd1f8196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55468/0 (socket says 172.21.15.134:55468) 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1f6ffd700 1 -- 172.21.15.134:0/4217127799 learned_addr learned my addr 172.21.15.134:0/4217127799 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1f77fe700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f80ff390 0x7fd1f8196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1f6ffd700 1 -- 172.21.15.134:0/4217127799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f80ff390 msgr2=0x7fd1f8196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1f6ffd700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f80ff390 0x7fd1f8196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1f6ffd700 1 -- 172.21.15.134:0/4217127799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0095f0 con 0x7fd1f80ffd30 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.901+0000 7fd1f6ffd700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1f80ffd30 0x7fd1f8196fe0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00bda0 tx=0x7fd1ec00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:19.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.902+0000 7fd1f4ff9700 1 -- 172.21.15.134:0/4217127799 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ec01d070 con 0x7fd1f80ffd30 2024-04-13T11:03:19.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.902+0000 7fd1fe220700 1 -- 172.21.15.134:0/4217127799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f819fb10 con 0x7fd1f80ffd30 2024-04-13T11:03:19.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.902+0000 7fd1f4ff9700 1 -- 172.21.15.134:0/4217127799 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd1ec00f460 con 0x7fd1f80ffd30 2024-04-13T11:03:19.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.902+0000 7fd1f4ff9700 1 -- 172.21.15.134:0/4217127799 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ec021620 con 0x7fd1f80ffd30 2024-04-13T11:03:19.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.902+0000 7fd1fe220700 1 -- 172.21.15.134:0/4217127799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f819fec0 con 0x7fd1f80ffd30 2024-04-13T11:03:19.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.903+0000 7fd1fe220700 1 -- 172.21.15.134:0/4217127799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f8107600 con 0x7fd1f80ffd30 2024-04-13T11:03:19.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.903+0000 7fd1f4ff9700 1 -- 172.21.15.134:0/4217127799 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd1ec00fa40 con 0x7fd1f80ffd30 2024-04-13T11:03:19.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.903+0000 7fd1f4ff9700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1e006cce0 0x7fd1e006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:19.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.904+0000 7fd1f4ff9700 1 -- 172.21.15.134:0/4217127799 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd1ec08d6c0 con 0x7fd1f80ffd30 2024-04-13T11:03:19.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.904+0000 7fd1f77fe700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1e006cce0 0x7fd1e006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:19.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.904+0000 7fd1f77fe700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1e006cce0 0x7fd1e006f190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800ac50 tx=0x7fd1e800a380 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:19.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:19.908+0000 7fd1f4ff9700 1 -- 172.21.15.134:0/4217127799 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fd1ec057830 con 0x7fd1f80ffd30 2024-04-13T11:03:19.927 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: pgmap v113: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: Detected new or changed devices on smithi194 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: Upgrade: Setting container_image for all mon 2024-04-13T11:03:19.928 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:19.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]: dispatch 2024-04-13T11:03:19.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2024-04-13T11:03:19.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]: dispatch 2024-04-13T11:03:19.929 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi194"}]': finished 2024-04-13T11:03:20.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.127+0000 7fd1fe220700 1 -- 172.21.15.134:0/4217127799 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1f802cca0 con 0x7fd1e006cce0 2024-04-13T11:03:20.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.129+0000 7fd1f4ff9700 1 -- 172.21.15.134:0/4217127799 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fd1f802cca0 con 0x7fd1e006cce0 2024-04-13T11:03:20.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 -- 172.21.15.134:0/4217127799 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1e006cce0 msgr2=0x7fd1e006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1e006cce0 0x7fd1e006f190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800ac50 tx=0x7fd1e800a380 comp rx=0 tx=0).stop 2024-04-13T11:03:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 -- 172.21.15.134:0/4217127799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1f80ffd30 msgr2=0x7fd1f8196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1f80ffd30 0x7fd1f8196fe0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00bda0 tx=0x7fd1ec00bdd0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 -- 172.21.15.134:0/4217127799 shutdown_connections 2024-04-13T11:03:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1e006cce0 0x7fd1e006f190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f80ff390 0x7fd1f8196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 --2- 172.21.15.134:0/4217127799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1f80ffd30 0x7fd1f8196fe0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 -- 172.21.15.134:0/4217127799 >> 172.21.15.134:0/4217127799 conn(0x7fd1f8074f50 msgr2=0x7fd1f80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 -- 172.21.15.134:0/4217127799 shutdown_connections 2024-04-13T11:03:20.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.131+0000 7fd1fe220700 1 -- 172.21.15.134:0/4217127799 wait complete. 2024-04-13T11:03:20.142 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:03:20.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.236+0000 7fe8e7015700 1 -- 172.21.15.134:0/3723020989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e00ff390 msgr2=0x7fe8e00ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.236+0000 7fe8e7015700 1 --2- 172.21.15.134:0/3723020989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e00ff390 0x7fe8e00ff760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009910 tx=0x7fe8d4009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:20.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.236+0000 7fe8e7015700 1 -- 172.21.15.134:0/3723020989 shutdown_connections 2024-04-13T11:03:20.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.236+0000 7fe8e7015700 1 --2- 172.21.15.134:0/3723020989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e00ffd30 0x7fe8e0103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.236+0000 7fe8e7015700 1 --2- 172.21.15.134:0/3723020989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e00ff390 0x7fe8e00ff760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.236+0000 7fe8e7015700 1 -- 172.21.15.134:0/3723020989 >> 172.21.15.134:0/3723020989 conn(0x7fe8e0074f50 msgr2=0x7fe8e0075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:20.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.236+0000 7fe8e7015700 1 -- 172.21.15.134:0/3723020989 shutdown_connections 2024-04-13T11:03:20.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.236+0000 7fe8e7015700 1 -- 172.21.15.134:0/3723020989 wait complete. 2024-04-13T11:03:20.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e7015700 1 Processor -- start 2024-04-13T11:03:20.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e7015700 1 -- start start 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e7015700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e00ff390 0x7fe8e0196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e7015700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e00ffd30 0x7fe8e0196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e7015700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01975f0 con 0x7fe8e00ff390 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e7015700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e0197760 con 0x7fe8e00ffd30 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e4db1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e00ff390 0x7fe8e0196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e4db1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e00ff390 0x7fe8e0196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55484/0 (socket says 172.21.15.134:55484) 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e4db1700 1 -- 172.21.15.134:0/1284488190 learned_addr learned my addr 172.21.15.134:0/1284488190 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8dffff700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e00ffd30 0x7fe8e0196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e4db1700 1 -- 172.21.15.134:0/1284488190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e00ffd30 msgr2=0x7fe8e0196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e4db1700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e00ffd30 0x7fe8e0196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.237+0000 7fe8e4db1700 1 -- 172.21.15.134:0/1284488190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40095f0 con 0x7fe8e00ff390 2024-04-13T11:03:20.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.238+0000 7fe8e4db1700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e00ff390 0x7fe8e0196a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4006010 tx=0x7fe8d400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.238+0000 7fe8ddffb700 1 -- 172.21.15.134:0/1284488190 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d401d070 con 0x7fe8e00ff390 2024-04-13T11:03:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.238+0000 7fe8ddffb700 1 -- 172.21.15.134:0/1284488190 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe8d400f460 con 0x7fe8e00ff390 2024-04-13T11:03:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.238+0000 7fe8e7015700 1 -- 172.21.15.134:0/1284488190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e019fb00 con 0x7fe8e00ff390 2024-04-13T11:03:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.238+0000 7fe8ddffb700 1 -- 172.21.15.134:0/1284488190 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d4021640 con 0x7fe8e00ff390 2024-04-13T11:03:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.238+0000 7fe8e7015700 1 -- 172.21.15.134:0/1284488190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e019ff70 con 0x7fe8e00ff390 2024-04-13T11:03:20.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.239+0000 7fe8e7015700 1 -- 172.21.15.134:0/1284488190 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e0107650 con 0x7fe8e00ff390 2024-04-13T11:03:20.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.240+0000 7fe8ddffb700 1 -- 172.21.15.134:0/1284488190 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe8d400f9e0 con 0x7fe8e00ff390 2024-04-13T11:03:20.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.240+0000 7fe8ddffb700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe8d006cce0 0x7fe8d006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:20.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.240+0000 7fe8ddffb700 1 -- 172.21.15.134:0/1284488190 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe8d408dac0 con 0x7fe8e00ff390 2024-04-13T11:03:20.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.240+0000 7fe8dffff700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe8d006cce0 0x7fe8d006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:20.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.241+0000 7fe8dffff700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe8d006cce0 0x7fe8d006f190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0068ca0 tx=0x7fe8cc005db0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:20.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.244+0000 7fe8ddffb700 1 -- 172.21.15.134:0/1284488190 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fe8d4057dd0 con 0x7fe8e00ff390 2024-04-13T11:03:20.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.478+0000 7fe8e7015700 1 -- 172.21.15.134:0/1284488190 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8e002cd40 con 0x7fe8d006cce0 2024-04-13T11:03:20.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.479+0000 7fe8ddffb700 1 -- 172.21.15.134:0/1284488190 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fe8e002cd40 con 0x7fe8d006cce0 2024-04-13T11:03:20.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.481+0000 7fe8e7015700 1 -- 172.21.15.134:0/1284488190 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe8d006cce0 msgr2=0x7fe8d006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.481+0000 7fe8e7015700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe8d006cce0 0x7fe8d006f190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0068ca0 tx=0x7fe8cc005db0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.481+0000 7fe8e7015700 1 -- 172.21.15.134:0/1284488190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e00ff390 msgr2=0x7fe8e0196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.481+0000 7fe8e7015700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e00ff390 0x7fe8e0196a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4006010 tx=0x7fe8d400be20 comp rx=0 tx=0).stop 2024-04-13T11:03:20.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.482+0000 7fe8e7015700 1 -- 172.21.15.134:0/1284488190 shutdown_connections 2024-04-13T11:03:20.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.482+0000 7fe8e7015700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe8d006cce0 0x7fe8d006f190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.482+0000 7fe8e7015700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e00ff390 0x7fe8e0196a90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.482+0000 7fe8e7015700 1 --2- 172.21.15.134:0/1284488190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8e00ffd30 0x7fe8e0196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.482+0000 7fe8e7015700 1 -- 172.21.15.134:0/1284488190 >> 172.21.15.134:0/1284488190 conn(0x7fe8e0074f50 msgr2=0x7fe8e00fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:20.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.482+0000 7fe8e7015700 1 -- 172.21.15.134:0/1284488190 shutdown_connections 2024-04-13T11:03:20.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.482+0000 7fe8e7015700 1 -- 172.21.15.134:0/1284488190 wait complete. 2024-04-13T11:03:20.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.600+0000 7f0b50e95700 1 -- 172.21.15.134:0/394374349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b4c0ffcb0 msgr2=0x7f0b4c103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.600+0000 7f0b50e95700 1 --2- 172.21.15.134:0/394374349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b4c0ffcb0 0x7f0b4c103c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009910 tx=0x7f0b34009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:20.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.601+0000 7f0b50e95700 1 -- 172.21.15.134:0/394374349 shutdown_connections 2024-04-13T11:03:20.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.601+0000 7f0b50e95700 1 --2- 172.21.15.134:0/394374349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b4c0ffcb0 0x7f0b4c103c80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.601+0000 7f0b50e95700 1 --2- 172.21.15.134:0/394374349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b4c0ff310 0x7f0b4c0ff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.601+0000 7f0b50e95700 1 -- 172.21.15.134:0/394374349 >> 172.21.15.134:0/394374349 conn(0x7f0b4c0fabb0 msgr2=0x7f0b4c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:20.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.601+0000 7f0b50e95700 1 -- 172.21.15.134:0/394374349 shutdown_connections 2024-04-13T11:03:20.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.601+0000 7f0b50e95700 1 -- 172.21.15.134:0/394374349 wait complete. 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b50e95700 1 Processor -- start 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b50e95700 1 -- start start 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b50e95700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b4c0ff310 0x7f0b4c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b50e95700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b4c0ffcb0 0x7f0b4c19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b50e95700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c19b540 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b50e95700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c1949f0 con 0x7f0b4c0ff310 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b4c0ffcb0 0x7f0b4c19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b4c0ffcb0 0x7f0b4c19aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55498/0 (socket says 172.21.15.134:55498) 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b43fff700 1 -- 172.21.15.134:0/3238339957 learned_addr learned my addr 172.21.15.134:0/3238339957 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b4a59c700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b4c0ff310 0x7f0b4c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:20.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b43fff700 1 -- 172.21.15.134:0/3238339957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b4c0ff310 msgr2=0x7f0b4c19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b43fff700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b4c0ff310 0x7f0b4c19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b43fff700 1 -- 172.21.15.134:0/3238339957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340095f0 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.602+0000 7f0b43fff700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b4c0ffcb0 0x7f0b4c19aeb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b340092e0 tx=0x7f0b3400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:20.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.603+0000 7f0b437fe700 1 -- 172.21.15.134:0/3238339957 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b3401d070 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.603+0000 7f0b437fe700 1 -- 172.21.15.134:0/3238339957 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b34005940 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.603+0000 7f0b50e95700 1 -- 172.21.15.134:0/3238339957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4c194c70 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.603+0000 7f0b437fe700 1 -- 172.21.15.134:0/3238339957 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b3400fe50 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.603+0000 7f0b50e95700 1 -- 172.21.15.134:0/3238339957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c195160 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.604+0000 7f0b50e95700 1 -- 172.21.15.134:0/3238339957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c107680 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.604+0000 7f0b437fe700 1 -- 172.21.15.134:0/3238339957 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0b34003a60 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.605+0000 7f0b437fe700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0b3806cce0 0x7f0b3806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:20.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.605+0000 7f0b4a59c700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0b3806cce0 0x7f0b3806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:20.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.605+0000 7f0b437fe700 1 -- 172.21.15.134:0/3238339957 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f0b3408d6e0 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.605+0000 7f0b4a59c700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0b3806cce0 0x7f0b3806f190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c005950 tx=0x7f0b3c0058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:20.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.609+0000 7f0b437fe700 1 -- 172.21.15.134:0/3238339957 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f0b3405b2e0 con 0x7f0b4c0ffcb0 2024-04-13T11:03:20.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.819+0000 7f0b50e95700 1 -- 172.21.15.134:0/3238339957 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b4c02ccf0 con 0x7f0b3806cce0 2024-04-13T11:03:20.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.830+0000 7f0b437fe700 1 -- 172.21.15.134:0/3238339957 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f0b4c02ccf0 con 0x7f0b3806cce0 2024-04-13T11:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (2m) 21s ago 13m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (13m) 21s ago 13m 8124k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (12m) 6s ago 12m 7768k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (13m) 21s ago 13m 6651k - 18.2.0 dc2bc1663786 92c021d16280 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (12m) 6s ago 12m 6656k - 18.2.0 dc2bc1663786 b1899bcb2f75 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (103s) 21s ago 13m 78.3M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (7m) 21s ago 7m 89.6M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (7m) 21s ago 7m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (7m) 6s ago 7m 16.0M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (7m) 6s ago 7m 19.5M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (4m) 21s ago 15m 502M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (3m) 6s ago 12m 452M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (29s) 21s ago 15m 23.7M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (12s) 6s ago 12m 24.5M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (3m) 21s ago 13m 19.0M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (2m) 6s ago 12m 16.7M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (11m) 21s ago 11m 230M 1227M 18.2.0 dc2bc1663786 83f5bf6269a6 2024-04-13T11:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (11m) 21s ago 11m 227M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T11:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (10m) 21s ago 10m 189M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T11:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (10m) 6s ago 10m 257M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T11:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (9m) 6s ago 9m 214M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (9m) 6s ago 9m 219M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (2m) 21s ago 13m 64.1M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 -- 172.21.15.134:0/3238339957 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0b3806cce0 msgr2=0x7f0b3806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0b3806cce0 0x7f0b3806f190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c005950 tx=0x7f0b3c0058e0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 -- 172.21.15.134:0/3238339957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b4c0ffcb0 msgr2=0x7f0b4c19aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b4c0ffcb0 0x7f0b4c19aeb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b340092e0 tx=0x7f0b3400be20 comp rx=0 tx=0).stop 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 -- 172.21.15.134:0/3238339957 shutdown_connections 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0b3806cce0 0x7f0b3806f190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b4c0ff310 0x7f0b4c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 --2- 172.21.15.134:0/3238339957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b4c0ffcb0 0x7f0b4c19aeb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 -- 172.21.15.134:0/3238339957 >> 172.21.15.134:0/3238339957 conn(0x7f0b4c0fabb0 msgr2=0x7f0b4c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 -- 172.21.15.134:0/3238339957 shutdown_connections 2024-04-13T11:03:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.833+0000 7f0b50e95700 1 -- 172.21.15.134:0/3238339957 wait complete. 2024-04-13T11:03:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.937+0000 7f36f6b9f700 1 -- 172.21.15.134:0/19330951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f00ffad0 msgr2=0x7f36f0103aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.937+0000 7f36f6b9f700 1 --2- 172.21.15.134:0/19330951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f00ffad0 0x7f36f0103aa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009910 tx=0x7f36e0009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.937+0000 7f36f6b9f700 1 -- 172.21.15.134:0/19330951 shutdown_connections 2024-04-13T11:03:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.937+0000 7f36f6b9f700 1 --2- 172.21.15.134:0/19330951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f00ffad0 0x7f36f0103aa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.937+0000 7f36f6b9f700 1 --2- 172.21.15.134:0/19330951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f00ff130 0x7f36f00ff500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.937+0000 7f36f6b9f700 1 -- 172.21.15.134:0/19330951 >> 172.21.15.134:0/19330951 conn(0x7f36f00fa9d0 msgr2=0x7f36f00fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:20.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.937+0000 7f36f6b9f700 1 -- 172.21.15.134:0/19330951 shutdown_connections 2024-04-13T11:03:20.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.937+0000 7f36f6b9f700 1 -- 172.21.15.134:0/19330951 wait complete. 2024-04-13T11:03:20.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.938+0000 7f36f6b9f700 1 Processor -- start 2024-04-13T11:03:20.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.938+0000 7f36f6b9f700 1 -- start start 2024-04-13T11:03:20.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.938+0000 7f36f6b9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f00ff130 0x7f36f0100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:20.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.938+0000 7f36f6b9f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f00ffad0 0x7f36f0101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.938+0000 7f36f6b9f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f01015c0 con 0x7f36f00ff130 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.938+0000 7f36f6b9f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0101700 con 0x7f36f00ffad0 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.938+0000 7f36f5b9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f00ff130 0x7f36f0100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.938+0000 7f36f5b9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f00ff130 0x7f36f0100b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55524/0 (socket says 172.21.15.134:55524) 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.938+0000 7f36f5b9d700 1 -- 172.21.15.134:0/1509865859 learned_addr learned my addr 172.21.15.134:0/1509865859 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36f539c700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f00ffad0 0x7f36f0101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36f5b9d700 1 -- 172.21.15.134:0/1509865859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f00ffad0 msgr2=0x7f36f0101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36f5b9d700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f00ffad0 0x7f36f0101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36f5b9d700 1 -- 172.21.15.134:0/1509865859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e00095f0 con 0x7f36f00ff130 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36f539c700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f00ffad0 0x7f36f0101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36f5b9d700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f00ff130 0x7f36f0100b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00d8d0 tx=0x7f36ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36e6ffd700 1 -- 172.21.15.134:0/1509865859 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36ec009940 con 0x7f36f00ff130 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36e6ffd700 1 -- 172.21.15.134:0/1509865859 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36ec010460 con 0x7f36f00ff130 2024-04-13T11:03:20.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36f6b9f700 1 -- 172.21.15.134:0/1509865859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f01a1c60 con 0x7f36f00ff130 2024-04-13T11:03:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36e6ffd700 1 -- 172.21.15.134:0/1509865859 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36ec00f5f0 con 0x7f36f00ff130 2024-04-13T11:03:20.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.939+0000 7f36f6b9f700 1 -- 172.21.15.134:0/1509865859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f01a2070 con 0x7f36f00ff130 2024-04-13T11:03:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.940+0000 7f36f6b9f700 1 -- 172.21.15.134:0/1509865859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f004f2a0 con 0x7f36f00ff130 2024-04-13T11:03:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.940+0000 7f36e6ffd700 1 -- 172.21.15.134:0/1509865859 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f36ec00f870 con 0x7f36f00ff130 2024-04-13T11:03:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.941+0000 7f36e6ffd700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f36dc06cce0 0x7f36dc06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.941+0000 7f36e6ffd700 1 -- 172.21.15.134:0/1509865859 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f36ec08c4e0 con 0x7f36f00ff130 2024-04-13T11:03:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.941+0000 7f36f539c700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f36dc06cce0 0x7f36dc06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:20.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.941+0000 7f36f539c700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f36dc06cce0 0x7f36dc06f190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36f0102330 tx=0x7f36e001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:20.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:20.945+0000 7f36e6ffd700 1 -- 172.21.15.134:0/1509865859 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f36ec056650 con 0x7f36f00ff130 2024-04-13T11:03:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.232+0000 7f36f6b9f700 1 -- 172.21.15.134:0/1509865859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f36f01a2260 con 0x7f36f00ff130 2024-04-13T11:03:21.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.233+0000 7f36e6ffd700 1 -- 172.21.15.134:0/1509865859 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7f36ec059c70 con 0x7f36f00ff130 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:03:21.234 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:03:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:03:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:03:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:03:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-04-13T11:03:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 4 2024-04-13T11:03:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:03:21.235 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 -- 172.21.15.134:0/1509865859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f36dc06cce0 msgr2=0x7f36dc06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f36dc06cce0 0x7f36dc06f190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36f0102330 tx=0x7f36e001a040 comp rx=0 tx=0).stop 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 -- 172.21.15.134:0/1509865859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f00ff130 msgr2=0x7f36f0100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f00ff130 0x7f36f0100b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00d8d0 tx=0x7f36ec00dc90 comp rx=0 tx=0).stop 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 -- 172.21.15.134:0/1509865859 shutdown_connections 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f36dc06cce0 0x7f36dc06f190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f00ff130 0x7f36f0100b40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 --2- 172.21.15.134:0/1509865859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f00ffad0 0x7f36f0101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 -- 172.21.15.134:0/1509865859 >> 172.21.15.134:0/1509865859 conn(0x7f36f00fa9d0 msgr2=0x7f36f01031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 -- 172.21.15.134:0/1509865859 shutdown_connections 2024-04-13T11:03:21.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.235+0000 7f36f6b9f700 1 -- 172.21.15.134:0/1509865859 wait complete. 2024-04-13T11:03:21.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.341+0000 7ff6a4784700 1 -- 172.21.15.134:0/1322684325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c101cb0 msgr2=0x7ff69c10a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:21.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.341+0000 7ff6a4784700 1 --2- 172.21.15.134:0/1322684325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c101cb0 0x7ff69c10a1b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009910 tx=0x7ff68c009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:21.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.341+0000 7ff6a4784700 1 -- 172.21.15.134:0/1322684325 shutdown_connections 2024-04-13T11:03:21.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.341+0000 7ff6a4784700 1 --2- 172.21.15.134:0/1322684325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c101cb0 0x7ff69c10a1b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.341+0000 7ff6a4784700 1 --2- 172.21.15.134:0/1322684325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c1013a0 0x7ff69c101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.341+0000 7ff6a4784700 1 -- 172.21.15.134:0/1322684325 >> 172.21.15.134:0/1322684325 conn(0x7ff69c0fac00 msgr2=0x7ff69c0fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:21.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.341+0000 7ff6a4784700 1 -- 172.21.15.134:0/1322684325 shutdown_connections 2024-04-13T11:03:21.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.341+0000 7ff6a4784700 1 -- 172.21.15.134:0/1322684325 wait complete. 2024-04-13T11:03:21.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.342+0000 7ff6a4784700 1 Processor -- start 2024-04-13T11:03:21.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.342+0000 7ff6a4784700 1 -- start start 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.342+0000 7ff6a4784700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c1013a0 0x7ff69c0ff000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.342+0000 7ff6a4784700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c101cb0 0x7ff69c0ff540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.342+0000 7ff6a4784700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0ffa80 con 0x7ff69c1013a0 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.342+0000 7ff6a4784700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0ffbc0 con 0x7ff69c101cb0 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.342+0000 7ff6a2520700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c1013a0 0x7ff69c0ff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.342+0000 7ff6a2520700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c1013a0 0x7ff69c0ff000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55548/0 (socket says 172.21.15.134:55548) 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.342+0000 7ff6a2520700 1 -- 172.21.15.134:0/2094807018 learned_addr learned my addr 172.21.15.134:0/2094807018 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6a1d1f700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c101cb0 0x7ff69c0ff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6a2520700 1 -- 172.21.15.134:0/2094807018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c101cb0 msgr2=0x7ff69c0ff540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6a2520700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c101cb0 0x7ff69c0ff540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6a2520700 1 -- 172.21.15.134:0/2094807018 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c0095f0 con 0x7ff69c1013a0 2024-04-13T11:03:21.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6a1d1f700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c101cb0 0x7ff69c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6a2520700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c1013a0 0x7ff69c0ff000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff69800d8d0 tx=0x7ff69800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6937fe700 1 -- 172.21.15.134:0/2094807018 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff698009940 con 0x7ff69c1013a0 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6a4784700 1 -- 172.21.15.134:0/2094807018 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c1a1e80 con 0x7ff69c1013a0 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6937fe700 1 -- 172.21.15.134:0/2094807018 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff698010460 con 0x7ff69c1013a0 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6937fe700 1 -- 172.21.15.134:0/2094807018 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69800f5f0 con 0x7ff69c1013a0 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.343+0000 7ff6a4784700 1 -- 172.21.15.134:0/2094807018 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c1a2290 con 0x7ff69c1013a0 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.344+0000 7ff6a4784700 1 -- 172.21.15.134:0/2094807018 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c107820 con 0x7ff69c1013a0 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.344+0000 7ff6937fe700 1 -- 172.21.15.134:0/2094807018 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff69800f870 con 0x7ff69c1013a0 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.345+0000 7ff6937fe700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff68806cce0 0x7ff68806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.345+0000 7ff6937fe700 1 -- 172.21.15.134:0/2094807018 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ff69808c4d0 con 0x7ff69c1013a0 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.345+0000 7ff6a1d1f700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff68806cce0 0x7ff68806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:21.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.345+0000 7ff6a1d1f700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff68806cce0 0x7ff68806f190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00b5c0 tx=0x7ff68c005960 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:21.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.349+0000 7ff6937fe700 1 -- 172.21.15.134:0/2094807018 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7ff6980566b0 con 0x7ff69c1013a0 2024-04-13T11:03:21.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:21 smithi134 ceph-mon[112184]: pgmap v114: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:21.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:21 smithi134 ceph-mon[112184]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:21.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:21 smithi134 ceph-mon[112184]: Upgrade: Updating crash.smithi134 (1/2) 2024-04-13T11:03:21.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:21 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:21.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:21 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-13T11:03:21.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:21 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:21.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:21 smithi134 ceph-mon[112184]: Deploying daemon crash.smithi134 on smithi134 2024-04-13T11:03:21.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:21 smithi134 ceph-mon[112184]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:21.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:21 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1509865859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.594+0000 7ff6a4784700 1 -- 172.21.15.134:0/2094807018 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff69c02cc80 con 0x7ff69c1013a0 2024-04-13T11:03:21.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.595+0000 7ff6937fe700 1 -- 172.21.15.134:0/2094807018 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1880 (secure 0 0 0) 0x7ff698059cd0 con 0x7ff69c1013a0 2024-04-13T11:03:21.596 INFO:teuthology.orchestra.run.smithi134.stdout:e18 2024-04-13T11:03:21.597 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:03:21.597 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:03:21.597 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:03:21.597 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:03:21.597 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:03:21.597 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:03:21.598 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 18 2024-04-13T11:03:21.598 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:03:21.598 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:03:21.598 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T10:55:58.861624+0000 2024-04-13T11:03:21.598 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:03:21.598 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:03:21.599 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:03:21.599 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:03:21.599 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:03:21.599 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:03:21.599 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:03:21.600 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:03:21.600 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-04-13T11:03:21.600 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:03:21.600 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:03:21.600 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:03:21.600 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14492} 2024-04-13T11:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 -- 172.21.15.134:0/2094807018 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff68806cce0 msgr2=0x7ff68806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff68806cce0 0x7ff68806f190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00b5c0 tx=0x7ff68c005960 comp rx=0 tx=0).stop 2024-04-13T11:03:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 -- 172.21.15.134:0/2094807018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c1013a0 msgr2=0x7ff69c0ff000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c1013a0 0x7ff69c0ff000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff69800d8d0 tx=0x7ff69800dc90 comp rx=0 tx=0).stop 2024-04-13T11:03:21.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 -- 172.21.15.134:0/2094807018 shutdown_connections 2024-04-13T11:03:21.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff68806cce0 0x7ff68806f190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c1013a0 0x7ff69c0ff000 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 --2- 172.21.15.134:0/2094807018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c101cb0 0x7ff69c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 -- 172.21.15.134:0/2094807018 >> 172.21.15.134:0/2094807018 conn(0x7ff69c0fac00 msgr2=0x7ff69c104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:21.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 -- 172.21.15.134:0/2094807018 shutdown_connections 2024-04-13T11:03:21.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.597+0000 7ff6a4784700 1 -- 172.21.15.134:0/2094807018 wait complete. 2024-04-13T11:03:21.607 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T11:03:21.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.702+0000 7f1585d55700 1 -- 172.21.15.134:0/1411734392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15800ff390 msgr2=0x7f15800ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:21.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.702+0000 7f1585d55700 1 --2- 172.21.15.134:0/1411734392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15800ff390 0x7f15800ff760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1570009910 tx=0x7f1570009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:21.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.702+0000 7f1585d55700 1 -- 172.21.15.134:0/1411734392 shutdown_connections 2024-04-13T11:03:21.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.702+0000 7f1585d55700 1 --2- 172.21.15.134:0/1411734392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15800ffd30 0x7f1580103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.702+0000 7f1585d55700 1 --2- 172.21.15.134:0/1411734392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15800ff390 0x7f15800ff760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.702+0000 7f1585d55700 1 -- 172.21.15.134:0/1411734392 >> 172.21.15.134:0/1411734392 conn(0x7f1580074f50 msgr2=0x7f1580075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:21.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.703+0000 7f1585d55700 1 -- 172.21.15.134:0/1411734392 shutdown_connections 2024-04-13T11:03:21.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.703+0000 7f1585d55700 1 -- 172.21.15.134:0/1411734392 wait complete. 2024-04-13T11:03:21.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.703+0000 7f1585d55700 1 Processor -- start 2024-04-13T11:03:21.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.703+0000 7f1585d55700 1 -- start start 2024-04-13T11:03:21.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.703+0000 7f1585d55700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15800ff390 0x7f158019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:21.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.703+0000 7f1585d55700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15800ffd30 0x7f158019bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:21.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.703+0000 7f1585d55700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158019c600 con 0x7f15800ffd30 2024-04-13T11:03:21.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.703+0000 7f1585d55700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1580195ab0 con 0x7f15800ff390 2024-04-13T11:03:21.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15800ffd30 0x7f158019bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15800ffd30 0x7f158019bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55578/0 (socket says 172.21.15.134:55578) 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157effd700 1 -- 172.21.15.134:0/2572652667 learned_addr learned my addr 172.21.15.134:0/2572652667 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157f7fe700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15800ff390 0x7f158019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157effd700 1 -- 172.21.15.134:0/2572652667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15800ff390 msgr2=0x7f158019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157effd700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15800ff390 0x7f158019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157effd700 1 -- 172.21.15.134:0/2572652667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15700095f0 con 0x7f15800ffd30 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157effd700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15800ffd30 0x7f158019bf70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f157400e970 tx=0x7f157400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157cff9700 1 -- 172.21.15.134:0/2572652667 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1574009750 con 0x7f15800ffd30 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f1585d55700 1 -- 172.21.15.134:0/2572652667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1580195d90 con 0x7f15800ffd30 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157cff9700 1 -- 172.21.15.134:0/2572652667 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1574004cd0 con 0x7f15800ffd30 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f157cff9700 1 -- 172.21.15.134:0/2572652667 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1574005590 con 0x7f15800ffd30 2024-04-13T11:03:21.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.704+0000 7f1585d55700 1 -- 172.21.15.134:0/2572652667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15801962e0 con 0x7f15800ffd30 2024-04-13T11:03:21.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.705+0000 7f1585d55700 1 -- 172.21.15.134:0/2572652667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158004ea50 con 0x7f15800ffd30 2024-04-13T11:03:21.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.706+0000 7f157cff9700 1 -- 172.21.15.134:0/2572652667 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1574004750 con 0x7f15800ffd30 2024-04-13T11:03:21.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.706+0000 7f157cff9700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f156806cce0 0x7f156806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:21.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.706+0000 7f157cff9700 1 -- 172.21.15.134:0/2572652667 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1574014070 con 0x7f15800ffd30 2024-04-13T11:03:21.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.706+0000 7f157f7fe700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f156806cce0 0x7f156806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:21.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.707+0000 7f157f7fe700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f156806cce0 0x7f156806f190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1570000c00 tx=0x7f1570009f70 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:21.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.711+0000 7f157cff9700 1 -- 172.21.15.134:0/2572652667 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f157405a450 con 0x7f15800ffd30 2024-04-13T11:03:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:21 smithi194 ceph-mon[83053]: pgmap v114: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:21 smithi194 ceph-mon[83053]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:21 smithi194 ceph-mon[83053]: Upgrade: Updating crash.smithi134 (1/2) 2024-04-13T11:03:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:21 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:21 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-13T11:03:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:21 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:21 smithi194 ceph-mon[83053]: Deploying daemon crash.smithi134 on smithi134 2024-04-13T11:03:21.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:21 smithi194 ceph-mon[83053]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:21.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:21 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1509865859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:21.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.930+0000 7f1585d55700 1 -- 172.21.15.134:0/2572652667 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1580196800 con 0x7f156806cce0 2024-04-13T11:03:21.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.931+0000 7f157cff9700 1 -- 172.21.15.134:0/2572652667 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f1580196800 con 0x7f156806cce0 2024-04-13T11:03:21.932 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:03:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:03:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:03:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:03:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:03:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:03:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-04-13T11:03:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:03:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "4/23 daemons upgraded", 2024-04-13T11:03:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading crash daemons", 2024-04-13T11:03:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:03:21.933 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 -- 172.21.15.134:0/2572652667 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f156806cce0 msgr2=0x7f156806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f156806cce0 0x7f156806f190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1570000c00 tx=0x7f1570009f70 comp rx=0 tx=0).stop 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 -- 172.21.15.134:0/2572652667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15800ffd30 msgr2=0x7f158019bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15800ffd30 0x7f158019bf70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f157400e970 tx=0x7f157400ed30 comp rx=0 tx=0).stop 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 -- 172.21.15.134:0/2572652667 shutdown_connections 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f156806cce0 0x7f156806f190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15800ff390 0x7f158019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 --2- 172.21.15.134:0/2572652667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15800ffd30 0x7f158019bf70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 -- 172.21.15.134:0/2572652667 >> 172.21.15.134:0/2572652667 conn(0x7f1580074f50 msgr2=0x7f1580103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 -- 172.21.15.134:0/2572652667 shutdown_connections 2024-04-13T11:03:21.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:21.934+0000 7f1585d55700 1 -- 172.21.15.134:0/2572652667 wait complete. 2024-04-13T11:03:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.040+0000 7fa48506e700 1 -- 172.21.15.134:0/480168177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4800ff2c0 msgr2=0x7fa4800ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.040+0000 7fa48506e700 1 --2- 172.21.15.134:0/480168177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4800ff2c0 0x7fa4800ff690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa474009910 tx=0x7fa474009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.040+0000 7fa48506e700 1 -- 172.21.15.134:0/480168177 shutdown_connections 2024-04-13T11:03:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.040+0000 7fa48506e700 1 --2- 172.21.15.134:0/480168177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4800ffc60 0x7fa480103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.040+0000 7fa48506e700 1 --2- 172.21.15.134:0/480168177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4800ff2c0 0x7fa4800ff690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.040+0000 7fa48506e700 1 -- 172.21.15.134:0/480168177 >> 172.21.15.134:0/480168177 conn(0x7fa4800fab80 msgr2=0x7fa4800fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.040+0000 7fa48506e700 1 -- 172.21.15.134:0/480168177 shutdown_connections 2024-04-13T11:03:22.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.040+0000 7fa48506e700 1 -- 172.21.15.134:0/480168177 wait complete. 2024-04-13T11:03:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.041+0000 7fa48506e700 1 Processor -- start 2024-04-13T11:03:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.041+0000 7fa48506e700 1 -- start start 2024-04-13T11:03:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.041+0000 7fa48506e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4800ff2c0 0x7fa48019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.041+0000 7fa48506e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4800ffc60 0x7fa48019ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.041+0000 7fa48506e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48019b4f0 con 0x7fa4800ff2c0 2024-04-13T11:03:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.041+0000 7fa48506e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801949a0 con 0x7fa4800ffc60 2024-04-13T11:03:22.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.041+0000 7fa47ed9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4800ff2c0 0x7fa48019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.041+0000 7fa47ed9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4800ff2c0 0x7fa48019a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55592/0 (socket says 172.21.15.134:55592) 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.041+0000 7fa47ed9d700 1 -- 172.21.15.134:0/1098249420 learned_addr learned my addr 172.21.15.134:0/1098249420 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.042+0000 7fa47e59c700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4800ffc60 0x7fa48019ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.042+0000 7fa47ed9d700 1 -- 172.21.15.134:0/1098249420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4800ffc60 msgr2=0x7fa48019ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.042+0000 7fa47ed9d700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4800ffc60 0x7fa48019ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.042+0000 7fa47ed9d700 1 -- 172.21.15.134:0/1098249420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4740095f0 con 0x7fa4800ff2c0 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.042+0000 7fa47ed9d700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4800ff2c0 0x7fa48019a920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa474006010 tx=0x7fa47400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.042+0000 7fa467fff700 1 -- 172.21.15.134:0/1098249420 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47401d070 con 0x7fa4800ff2c0 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.042+0000 7fa48506e700 1 -- 172.21.15.134:0/1098249420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa480194c20 con 0x7fa4800ff2c0 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.042+0000 7fa467fff700 1 -- 172.21.15.134:0/1098249420 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa47400f460 con 0x7fa4800ff2c0 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.042+0000 7fa467fff700 1 -- 172.21.15.134:0/1098249420 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa474021640 con 0x7fa4800ff2c0 2024-04-13T11:03:22.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.042+0000 7fa48506e700 1 -- 172.21.15.134:0/1098249420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa480195110 con 0x7fa4800ff2c0 2024-04-13T11:03:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.043+0000 7fa48506e700 1 -- 172.21.15.134:0/1098249420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4801075d0 con 0x7fa4800ff2c0 2024-04-13T11:03:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.043+0000 7fa467fff700 1 -- 172.21.15.134:0/1098249420 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa47400fa20 con 0x7fa4800ff2c0 2024-04-13T11:03:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.044+0000 7fa467fff700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa46806cce0 0x7fa46806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.044+0000 7fa467fff700 1 -- 172.21.15.134:0/1098249420 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa47408d730 con 0x7fa4800ff2c0 2024-04-13T11:03:22.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.044+0000 7fa47e59c700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa46806cce0 0x7fa46806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:22.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.044+0000 7fa47e59c700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa46806cce0 0x7fa46806f190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa470005fd0 tx=0x7fa470005f60 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:22.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.048+0000 7fa467fff700 1 -- 172.21.15.134:0/1098249420 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fa47405b330 con 0x7fa4800ff2c0 2024-04-13T11:03:22.362 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:03:22.363 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:03:22.363 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:03:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.361+0000 7fa48506e700 1 -- 172.21.15.134:0/1098249420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa480195f40 con 0x7fa4800ff2c0 2024-04-13T11:03:22.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.361+0000 7fa467fff700 1 -- 172.21.15.134:0/1098249420 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa480195f40 con 0x7fa4800ff2c0 2024-04-13T11:03:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.363+0000 7fa48506e700 1 -- 172.21.15.134:0/1098249420 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa46806cce0 msgr2=0x7fa46806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.363+0000 7fa48506e700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa46806cce0 0x7fa46806f190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa470005fd0 tx=0x7fa470005f60 comp rx=0 tx=0).stop 2024-04-13T11:03:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.363+0000 7fa48506e700 1 -- 172.21.15.134:0/1098249420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4800ff2c0 msgr2=0x7fa48019a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.363+0000 7fa48506e700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4800ff2c0 0x7fa48019a920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa474006010 tx=0x7fa47400be20 comp rx=0 tx=0).stop 2024-04-13T11:03:22.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.364+0000 7fa48506e700 1 -- 172.21.15.134:0/1098249420 shutdown_connections 2024-04-13T11:03:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.364+0000 7fa48506e700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa46806cce0 0x7fa46806f190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.364+0000 7fa48506e700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4800ff2c0 0x7fa48019a920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.364+0000 7fa48506e700 1 --2- 172.21.15.134:0/1098249420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4800ffc60 0x7fa48019ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.364+0000 7fa48506e700 1 -- 172.21.15.134:0/1098249420 >> 172.21.15.134:0/1098249420 conn(0x7fa4800fab80 msgr2=0x7fa4800fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.364+0000 7fa48506e700 1 -- 172.21.15.134:0/1098249420 shutdown_connections 2024-04-13T11:03:22.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:22.364+0000 7fa48506e700 1 -- 172.21.15.134:0/1098249420 wait complete. 2024-04-13T11:03:22.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:22 smithi134 ceph-mon[112184]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:22.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:22 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2094807018' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:03:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:22 smithi194 ceph-mon[83053]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:22 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2094807018' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:03:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:23 smithi194 ceph-mon[83053]: pgmap v115: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:23 smithi194 ceph-mon[83053]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:23 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1098249420' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:03:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:03:23.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:23 smithi134 ceph-mon[112184]: pgmap v115: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:23.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:23 smithi134 ceph-mon[112184]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:23.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:23 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1098249420' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:03:23.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:03:25.652 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:25 smithi194 ceph-mon[83053]: pgmap v116: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:25.652 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:25 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:25.652 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:25 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:25 smithi134 ceph-mon[112184]: pgmap v116: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:25 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:25 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:27 smithi134 ceph-mon[112184]: pgmap v117: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:27 smithi134 ceph-mon[112184]: Upgrade: Updating crash.smithi194 (2/2) 2024-04-13T11:03:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:27 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:27 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-13T11:03:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:27 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:27 smithi134 ceph-mon[112184]: Deploying daemon crash.smithi194 on smithi194 2024-04-13T11:03:27.462 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:27 smithi194 ceph-mon[83053]: pgmap v117: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:27.462 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:27 smithi194 ceph-mon[83053]: Upgrade: Updating crash.smithi194 (2/2) 2024-04-13T11:03:27.463 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:27 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:27.463 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:27 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi194", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-13T11:03:27.463 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:27 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:27.463 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:27 smithi194 ceph-mon[83053]: Deploying daemon crash.smithi194 on smithi194 2024-04-13T11:03:29.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:29 smithi134 ceph-mon[112184]: pgmap v118: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:29 smithi194 ceph-mon[83053]: pgmap v118: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:30.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:30 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:30.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:30 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:30.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:30 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:30.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:30 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:30.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:30 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:30.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:30 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:31.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:31 smithi134 ceph-mon[112184]: pgmap v119: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:31 smithi194 ceph-mon[83053]: pgmap v119: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:33.925 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:33 smithi194 ceph-mon[83053]: pgmap v120: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:33.925 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:33.926 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:33.926 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:33.926 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:33 smithi134 ceph-mon[112184]: pgmap v120: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:35.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:35 smithi134 ceph-mon[112184]: pgmap v121: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:35.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:35 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:35.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:35 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:35 smithi194 ceph-mon[83053]: pgmap v121: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:35.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:35 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:35.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:35 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:37.191 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:37 smithi194 ceph-mon[83053]: pgmap v122: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:37.192 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:37 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:37.192 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:37 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:37.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:37 smithi134 ceph-mon[112184]: pgmap v122: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:37.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:37 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:37.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:37 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:38.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:38.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:38.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:03:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:03:39.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:39 smithi194 ceph-mon[83053]: pgmap v123: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:39.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:39 smithi134 ceph-mon[112184]: pgmap v123: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:41.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:41.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: pgmap v124: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: Upgrade: Setting container_image for all crash 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]: dispatch 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2024-04-13T11:03:41.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]: dispatch 2024-04-13T11:03:41.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]': finished 2024-04-13T11:03:41.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-13T11:03:41.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-13T11:03:41.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:40 smithi134 ceph-mon[112184]: Upgrade: osd.0 is safe to restart 2024-04-13T11:03:41.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: pgmap v124: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: Upgrade: Setting container_image for all crash 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]: dispatch 2024-04-13T11:03:41.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2024-04-13T11:03:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]: dispatch 2024-04-13T11:03:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi194"}]': finished 2024-04-13T11:03:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-13T11:03:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-13T11:03:41.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:40 smithi194 ceph-mon[83053]: Upgrade: osd.0 is safe to restart 2024-04-13T11:03:42.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:42 smithi134 ceph-mon[112184]: Upgrade: Updating osd.0 2024-04-13T11:03:42.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:42 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:42.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:42 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-13T11:03:42.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:42 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:42 smithi194 ceph-mon[83053]: Upgrade: Updating osd.0 2024-04-13T11:03:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:42 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:42 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-13T11:03:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:42 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:03:43.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:43 smithi134 ceph-mon[112184]: Deploying daemon osd.0 on smithi134 2024-04-13T11:03:43.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:43 smithi134 ceph-mon[112184]: pgmap v125: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:43 smithi194 ceph-mon[83053]: Deploying daemon osd.0 on smithi134 2024-04-13T11:03:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:43 smithi194 ceph-mon[83053]: pgmap v125: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:03:44.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:44 smithi134 ceph-mon[112184]: pgmap v126: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:44 smithi194 ceph-mon[83053]: pgmap v126: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:03:45.781 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:45 smithi134 systemd[1]: Stopping Ceph osd.0 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:03:46.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:45 smithi134 ceph-mon[112184]: osd.0 marked itself down and dead 2024-04-13T11:03:46.184 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:45 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[57973]: 2024-04-13T11:03:45.779+0000 7f86d1896700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:03:46.184 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:45 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[57973]: 2024-04-13T11:03:45.779+0000 7f86d1896700 -1 osd.0 48 *** Got signal Terminated *** 2024-04-13T11:03:46.184 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:45 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[57973]: 2024-04-13T11:03:45.779+0000 7f86d1896700 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:03:46.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:45 smithi194 ceph-mon[83053]: osd.0 marked itself down and dead 2024-04-13T11:03:46.861 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:46 smithi134 bash[123511]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0 2024-04-13T11:03:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:46 smithi134 ceph-mon[112184]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:03:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:46 smithi134 ceph-mon[112184]: osdmap e49: 6 total, 5 up, 6 in 2024-04-13T11:03:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:46 smithi134 ceph-mon[112184]: pgmap v128: 65 pgs: 9 stale+active+clean, 56 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-13T11:03:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:46 smithi134 ceph-mon[112184]: osdmap e50: 6 total, 5 up, 6 in 2024-04-13T11:03:47.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:46 smithi194 ceph-mon[83053]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:03:47.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:46 smithi194 ceph-mon[83053]: osdmap e49: 6 total, 5 up, 6 in 2024-04-13T11:03:47.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:46 smithi194 ceph-mon[83053]: pgmap v128: 65 pgs: 9 stale+active+clean, 56 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-13T11:03:47.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:46 smithi194 ceph-mon[83053]: osdmap e50: 6 total, 5 up, 6 in 2024-04-13T11:03:48.934 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:48 smithi134 systemd[1]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.0.service: Succeeded. 2024-04-13T11:03:48.934 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:48 smithi134 systemd[1]: Stopped Ceph osd.0 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:03:48.934 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:48 smithi134 systemd[1]: Starting Ceph osd.0 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:03:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:48 smithi194 ceph-mon[83053]: pgmap v130: 65 pgs: 9 stale+active+clean, 56 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-13T11:03:49.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:48 smithi134 ceph-mon[112184]: pgmap v130: 65 pgs: 9 stale+active+clean, 56 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-13T11:03:50.033 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:49 smithi134 bash[123791]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-13T11:03:50.033 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:49 smithi134 bash[123791]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-13T11:03:50.033 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:49 smithi134 bash[123791]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-13T11:03:50.034 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:49 smithi134 bash[123791]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-13T11:03:50.034 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:49 smithi134 bash[123791]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-13T11:03:50.034 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:49 smithi134 bash[123791]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-13T11:03:50.034 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:49 smithi134 bash[123791]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-13T11:03:50.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:50 smithi134 ceph-mon[112184]: Health check failed: Degraded data redundancy: 51/267 objects degraded (19.101%), 19 pgs degraded (PG_DEGRADED) 2024-04-13T11:03:50.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:50 smithi194 ceph-mon[83053]: Health check failed: Degraded data redundancy: 51/267 objects degraded (19.101%), 19 pgs degraded (PG_DEGRADED) 2024-04-13T11:03:51.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:51 smithi134 ceph-mon[112184]: pgmap v131: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 51/267 objects degraded (19.101%) 2024-04-13T11:03:51.129 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:51 smithi134 ceph-osd[124117]: -- 172.21.15.134:0/2091283495 <== mon.0 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557faf4111e0 con 0x557faf3e1000 2024-04-13T11:03:51.434 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:51 smithi134 bash[124078]: c27312e25d54dc1ab3ccd4fdb514da07bc7deeb6eee038fab10af79ae4f4bfaa 2024-04-13T11:03:51.434 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:51 smithi134 systemd[1]: Started Ceph osd.0 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:03:51.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:51 smithi194 ceph-mon[83053]: pgmap v131: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 51/267 objects degraded (19.101%) 2024-04-13T11:03:51.934 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:51 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[124094]: 2024-04-13T11:03:51.529+0000 7f478de567c0 -1 Falling back to public interface 2024-04-13T11:03:52.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:52 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:52.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:52 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:52.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:52 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:52.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.488+0000 7fb0e03b9700 1 -- 172.21.15.134:0/4164187210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d80ff390 msgr2=0x7fb0d80ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:52.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.488+0000 7fb0e03b9700 1 --2- 172.21.15.134:0/4164187210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d80ff390 0x7fb0d80ff760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009910 tx=0x7fb0d0009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:52.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.488+0000 7fb0e03b9700 1 -- 172.21.15.134:0/4164187210 shutdown_connections 2024-04-13T11:03:52.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.488+0000 7fb0e03b9700 1 --2- 172.21.15.134:0/4164187210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0d80ffd30 0x7fb0d8103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:52.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.488+0000 7fb0e03b9700 1 --2- 172.21.15.134:0/4164187210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d80ff390 0x7fb0d80ff760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.488+0000 7fb0e03b9700 1 -- 172.21.15.134:0/4164187210 >> 172.21.15.134:0/4164187210 conn(0x7fb0d8074f50 msgr2=0x7fb0d8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.488+0000 7fb0e03b9700 1 -- 172.21.15.134:0/4164187210 shutdown_connections 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.488+0000 7fb0e03b9700 1 -- 172.21.15.134:0/4164187210 wait complete. 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.489+0000 7fb0e03b9700 1 Processor -- start 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.489+0000 7fb0e03b9700 1 -- start start 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.489+0000 7fb0e03b9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0d80ff390 0x7fb0d819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.489+0000 7fb0e03b9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d80ffd30 0x7fb0d819bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.489+0000 7fb0e03b9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d819c5e0 con 0x7fb0d80ffd30 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.489+0000 7fb0e03b9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8195a90 con 0x7fb0d80ff390 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.489+0000 7fb0dd954700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d80ffd30 0x7fb0d819bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.489+0000 7fb0dd954700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d80ffd30 0x7fb0d819bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49186/0 (socket says 172.21.15.134:49186) 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.489+0000 7fb0dd954700 1 -- 172.21.15.134:0/3882048332 learned_addr learned my addr 172.21.15.134:0/3882048332 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:52.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.490+0000 7fb0de155700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0d80ff390 0x7fb0d819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:52.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.490+0000 7fb0dd954700 1 -- 172.21.15.134:0/3882048332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0d80ff390 msgr2=0x7fb0d819ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:52.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.490+0000 7fb0dd954700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0d80ff390 0x7fb0d819ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:52.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.490+0000 7fb0dd954700 1 -- 172.21.15.134:0/3882048332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d00095f0 con 0x7fb0d80ffd30 2024-04-13T11:03:52.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.490+0000 7fb0dd954700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d80ffd30 0x7fb0d819bf50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00d900 tx=0x7fb0cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:52.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.490+0000 7fb0d77fe700 1 -- 172.21.15.134:0/3882048332 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0cc009900 con 0x7fb0d80ffd30 2024-04-13T11:03:52.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.490+0000 7fb0e03b9700 1 -- 172.21.15.134:0/3882048332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d8195d70 con 0x7fb0d80ffd30 2024-04-13T11:03:52.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.490+0000 7fb0d77fe700 1 -- 172.21.15.134:0/3882048332 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0cc010460 con 0x7fb0d80ffd30 2024-04-13T11:03:52.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.490+0000 7fb0d77fe700 1 -- 172.21.15.134:0/3882048332 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0cc00f5f0 con 0x7fb0d80ffd30 2024-04-13T11:03:52.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.490+0000 7fb0e03b9700 1 -- 172.21.15.134:0/3882048332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d81962c0 con 0x7fb0d80ffd30 2024-04-13T11:03:52.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.491+0000 7fb0e03b9700 1 -- 172.21.15.134:0/3882048332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d804ea50 con 0x7fb0d80ffd30 2024-04-13T11:03:52.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.492+0000 7fb0d77fe700 1 -- 172.21.15.134:0/3882048332 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb0cc0105d0 con 0x7fb0d80ffd30 2024-04-13T11:03:52.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.492+0000 7fb0d77fe700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb0c006cce0 0x7fb0c006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:52.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.492+0000 7fb0d77fe700 1 -- 172.21.15.134:0/3882048332 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb0cc08c360 con 0x7fb0d80ffd30 2024-04-13T11:03:52.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.492+0000 7fb0de155700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb0c006cce0 0x7fb0c006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:52.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.493+0000 7fb0de155700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb0c006cce0 0x7fb0c006f190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0006010 tx=0x7fb0d001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:52.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.496+0000 7fb0d77fe700 1 -- 172.21.15.134:0/3882048332 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fb0cc059fc0 con 0x7fb0d80ffd30 2024-04-13T11:03:52.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:52 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:52.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:52 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:52.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:52 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:03:52.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.719+0000 7fb0e03b9700 1 -- 172.21.15.134:0/3882048332 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0d8196760 con 0x7fb0c006cce0 2024-04-13T11:03:52.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.720+0000 7fb0d77fe700 1 -- 172.21.15.134:0/3882048332 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb0d8196760 con 0x7fb0c006cce0 2024-04-13T11:03:52.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.722+0000 7fb0e03b9700 1 -- 172.21.15.134:0/3882048332 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb0c006cce0 msgr2=0x7fb0c006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:52.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.722+0000 7fb0e03b9700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb0c006cce0 0x7fb0c006f190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0006010 tx=0x7fb0d001a040 comp rx=0 tx=0).stop 2024-04-13T11:03:52.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.722+0000 7fb0e03b9700 1 -- 172.21.15.134:0/3882048332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d80ffd30 msgr2=0x7fb0d819bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:52.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.722+0000 7fb0e03b9700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d80ffd30 0x7fb0d819bf50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00d900 tx=0x7fb0cc00dcc0 comp rx=0 tx=0).stop 2024-04-13T11:03:52.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.722+0000 7fb0e03b9700 1 -- 172.21.15.134:0/3882048332 shutdown_connections 2024-04-13T11:03:52.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.723+0000 7fb0e03b9700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb0c006cce0 0x7fb0c006f190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:52.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.723+0000 7fb0e03b9700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0d80ff390 0x7fb0d819ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:52.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.723+0000 7fb0e03b9700 1 --2- 172.21.15.134:0/3882048332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d80ffd30 0x7fb0d819bf50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:52.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.723+0000 7fb0e03b9700 1 -- 172.21.15.134:0/3882048332 >> 172.21.15.134:0/3882048332 conn(0x7fb0d8074f50 msgr2=0x7fb0d8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:52.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.723+0000 7fb0e03b9700 1 -- 172.21.15.134:0/3882048332 shutdown_connections 2024-04-13T11:03:52.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.723+0000 7fb0e03b9700 1 -- 172.21.15.134:0/3882048332 wait complete. 2024-04-13T11:03:52.734 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:03:52.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.833+0000 7f6854147700 1 -- 172.21.15.134:0/2633990361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c1013d0 msgr2=0x7f684c1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:52.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.833+0000 7f6854147700 1 --2- 172.21.15.134:0/2633990361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c1013d0 0x7f684c1017a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6844009910 tx=0x7f6844009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:52.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.833+0000 7f6854147700 1 -- 172.21.15.134:0/2633990361 shutdown_connections 2024-04-13T11:03:52.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.833+0000 7f6854147700 1 --2- 172.21.15.134:0/2633990361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f684c101ce0 0x7f684c10a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:52.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.833+0000 7f6854147700 1 --2- 172.21.15.134:0/2633990361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c1013d0 0x7f684c1017a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:52.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.833+0000 7f6854147700 1 -- 172.21.15.134:0/2633990361 >> 172.21.15.134:0/2633990361 conn(0x7f684c0fabb0 msgr2=0x7f684c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:52.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.833+0000 7f6854147700 1 -- 172.21.15.134:0/2633990361 shutdown_connections 2024-04-13T11:03:52.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.833+0000 7f6854147700 1 -- 172.21.15.134:0/2633990361 wait complete. 2024-04-13T11:03:52.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6854147700 1 Processor -- start 2024-04-13T11:03:52.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6854147700 1 -- start start 2024-04-13T11:03:52.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6854147700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c1013d0 0x7f684c19ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:52.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6854147700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f684c101ce0 0x7f684c19bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:52.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6854147700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c19c600 con 0x7f684c1013d0 2024-04-13T11:03:52.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6854147700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c195ab0 con 0x7f684c101ce0 2024-04-13T11:03:52.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6851ee3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c1013d0 0x7f684c19ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6851ee3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c1013d0 0x7f684c19ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49202/0 (socket says 172.21.15.134:49202) 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6851ee3700 1 -- 172.21.15.134:0/2346726386 learned_addr learned my addr 172.21.15.134:0/2346726386 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f68516e2700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f684c101ce0 0x7f684c19bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6851ee3700 1 -- 172.21.15.134:0/2346726386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f684c101ce0 msgr2=0x7f684c19bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6851ee3700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f684c101ce0 0x7f684c19bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.834+0000 7f6851ee3700 1 -- 172.21.15.134:0/2346726386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68440095f0 con 0x7f684c1013d0 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.835+0000 7f6851ee3700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c1013d0 0x7f684c19ba30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f68440092e0 tx=0x7f684400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.835+0000 7f684affd700 1 -- 172.21.15.134:0/2346726386 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f684401d070 con 0x7f684c1013d0 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.835+0000 7f684affd700 1 -- 172.21.15.134:0/2346726386 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6844005e00 con 0x7f684c1013d0 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.835+0000 7f6854147700 1 -- 172.21.15.134:0/2346726386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c195d30 con 0x7f684c1013d0 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.835+0000 7f684affd700 1 -- 172.21.15.134:0/2346726386 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f684400fe60 con 0x7f684c1013d0 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.835+0000 7f6854147700 1 -- 172.21.15.134:0/2346726386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c196220 con 0x7f684c1013d0 2024-04-13T11:03:52.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.836+0000 7f6854147700 1 -- 172.21.15.134:0/2346726386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684c1078b0 con 0x7f684c1013d0 2024-04-13T11:03:52.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.836+0000 7f684affd700 1 -- 172.21.15.134:0/2346726386 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f684400f6d0 con 0x7f684c1013d0 2024-04-13T11:03:52.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.836+0000 7f684affd700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f683406cce0 0x7f683406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:52.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.837+0000 7f684affd700 1 -- 172.21.15.134:0/2346726386 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f684408d7b0 con 0x7f684c1013d0 2024-04-13T11:03:52.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.837+0000 7f68516e2700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f683406cce0 0x7f683406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:52.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.837+0000 7f68516e2700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f683406cce0 0x7f683406f190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6840005950 tx=0x7f68400058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:52.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:52.841+0000 7f684affd700 1 -- 172.21.15.134:0/2346726386 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f684405b3b0 con 0x7f684c1013d0 2024-04-13T11:03:53.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.063+0000 7f6854147700 1 -- 172.21.15.134:0/2346726386 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f684c02cc80 con 0x7f683406cce0 2024-04-13T11:03:53.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.064+0000 7f684affd700 1 -- 172.21.15.134:0/2346726386 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f684c02cc80 con 0x7f683406cce0 2024-04-13T11:03:53.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.066+0000 7f6854147700 1 -- 172.21.15.134:0/2346726386 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f683406cce0 msgr2=0x7f683406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.066+0000 7f6854147700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f683406cce0 0x7f683406f190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6840005950 tx=0x7f68400058e0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.066+0000 7f6854147700 1 -- 172.21.15.134:0/2346726386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c1013d0 msgr2=0x7f684c19ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.066+0000 7f6854147700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c1013d0 0x7f684c19ba30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f68440092e0 tx=0x7f684400be20 comp rx=0 tx=0).stop 2024-04-13T11:03:53.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.066+0000 7f6854147700 1 -- 172.21.15.134:0/2346726386 shutdown_connections 2024-04-13T11:03:53.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.066+0000 7f6854147700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f683406cce0 0x7f683406f190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.066+0000 7f6854147700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f684c1013d0 0x7f684c19ba30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.066+0000 7f6854147700 1 --2- 172.21.15.134:0/2346726386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f684c101ce0 0x7f684c19bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.066+0000 7f6854147700 1 -- 172.21.15.134:0/2346726386 >> 172.21.15.134:0/2346726386 conn(0x7f684c0fabb0 msgr2=0x7f684c1049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:53.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.067+0000 7f6854147700 1 -- 172.21.15.134:0/2346726386 shutdown_connections 2024-04-13T11:03:53.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.067+0000 7f6854147700 1 -- 172.21.15.134:0/2346726386 wait complete. 2024-04-13T11:03:53.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.171+0000 7fe9708a3700 1 -- 172.21.15.134:0/2969823289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe96c0ff310 msgr2=0x7fe96c0ff6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.171+0000 7fe9708a3700 1 --2- 172.21.15.134:0/2969823289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe96c0ff310 0x7fe96c0ff6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009910 tx=0x7fe95c009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:53.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.171+0000 7fe9708a3700 1 -- 172.21.15.134:0/2969823289 shutdown_connections 2024-04-13T11:03:53.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.171+0000 7fe9708a3700 1 --2- 172.21.15.134:0/2969823289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96c0ffcb0 0x7fe96c103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.171+0000 7fe9708a3700 1 --2- 172.21.15.134:0/2969823289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe96c0ff310 0x7fe96c0ff6e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.171+0000 7fe9708a3700 1 -- 172.21.15.134:0/2969823289 >> 172.21.15.134:0/2969823289 conn(0x7fe96c0fabb0 msgr2=0x7fe96c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:53.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.171+0000 7fe9708a3700 1 -- 172.21.15.134:0/2969823289 shutdown_connections 2024-04-13T11:03:53.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.171+0000 7fe9708a3700 1 -- 172.21.15.134:0/2969823289 wait complete. 2024-04-13T11:03:53.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.172+0000 7fe9708a3700 1 Processor -- start 2024-04-13T11:03:53.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.172+0000 7fe9708a3700 1 -- start start 2024-04-13T11:03:53.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.172+0000 7fe9708a3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96c0ff310 0x7fe96c194900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:53.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.172+0000 7fe9708a3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe96c0ffcb0 0x7fe96c194e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:53.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.172+0000 7fe9708a3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c195380 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.172+0000 7fe9708a3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c1954f0 con 0x7fe96c0ff310 2024-04-13T11:03:53.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.172+0000 7fe969d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe96c0ffcb0 0x7fe96c194e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:53.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.172+0000 7fe969d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe96c0ffcb0 0x7fe96c194e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49220/0 (socket says 172.21.15.134:49220) 2024-04-13T11:03:53.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.172+0000 7fe969d9b700 1 -- 172.21.15.134:0/1221239094 learned_addr learned my addr 172.21.15.134:0/1221239094 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:53.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.173+0000 7fe96a59c700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96c0ff310 0x7fe96c194900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:53.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.173+0000 7fe969d9b700 1 -- 172.21.15.134:0/1221239094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96c0ff310 msgr2=0x7fe96c194900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.173+0000 7fe969d9b700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96c0ff310 0x7fe96c194900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.173+0000 7fe969d9b700 1 -- 172.21.15.134:0/1221239094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c0095f0 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.173+0000 7fe969d9b700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe96c0ffcb0 0x7fe96c194e40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe96000d900 tx=0x7fe96000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:53.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.173+0000 7fe95b7fe700 1 -- 172.21.15.134:0/1221239094 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe960009900 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.173+0000 7fe95b7fe700 1 -- 172.21.15.134:0/1221239094 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe960010460 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.173+0000 7fe9708a3700 1 -- 172.21.15.134:0/1221239094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c1a1f70 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.173+0000 7fe95b7fe700 1 -- 172.21.15.134:0/1221239094 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe96000f5f0 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.173+0000 7fe9708a3700 1 -- 172.21.15.134:0/1221239094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c1a22d0 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.174+0000 7fe9708a3700 1 -- 172.21.15.134:0/1221239094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c107620 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.175+0000 7fe95b7fe700 1 -- 172.21.15.134:0/1221239094 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe9600105d0 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.175+0000 7fe95b7fe700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe95406cce0 0x7fe95406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:53.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.175+0000 7fe96a59c700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe95406cce0 0x7fe95406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:53.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.175+0000 7fe95b7fe700 1 -- 172.21.15.134:0/1221239094 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe96008bec0 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.176+0000 7fe96a59c700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe95406cce0 0x7fe95406f190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe95c006010 tx=0x7fe95c01a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:53.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.180+0000 7fe95b7fe700 1 -- 172.21.15.134:0/1221239094 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fe960059b40 con 0x7fe96c0ffcb0 2024-04-13T11:03:53.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.420+0000 7fe9708a3700 1 -- 172.21.15.134:0/1221239094 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe96c02cc80 con 0x7fe95406cce0 2024-04-13T11:03:53.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.431+0000 7fe95b7fe700 1 -- 172.21.15.134:0/1221239094 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe96c02cc80 con 0x7fe95406cce0 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (2m) 17s ago 14m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (14m) 17s ago 14m 8170k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (13m) 20s ago 13m 7796k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (29s) 17s ago 14m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (24s) 20s ago 13m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (2m) 17s ago 13m 79.3M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (8m) 17s ago 8m 89.7M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (8m) 17s ago 8m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (8m) 20s ago 7m 16.1M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (8m) 20s ago 8m 19.6M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:03:53.433 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (5m) 17s ago 15m 503M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (3m) 20s ago 13m 452M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (62s) 17s ago 15m 38.7M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (44s) 20s ago 12m 28.7M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (3m) 17s ago 14m 18.3M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (3m) 20s ago 13m 16.6M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 starting - - - 1227M 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (11m) 17s ago 11m 227M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (11m) 17s ago 11m 190M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (10m) 20s ago 10m 257M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (10m) 20s ago 10m 215M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (9m) 20s ago 9m 219M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:03:53.434 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 17s ago 13m 64.1M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:03:53.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.433+0000 7fe9708a3700 1 -- 172.21.15.134:0/1221239094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe95406cce0 msgr2=0x7fe95406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.433+0000 7fe9708a3700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe95406cce0 0x7fe95406f190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe95c006010 tx=0x7fe95c01a040 comp rx=0 tx=0).stop 2024-04-13T11:03:53.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.433+0000 7fe9708a3700 1 -- 172.21.15.134:0/1221239094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe96c0ffcb0 msgr2=0x7fe96c194e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.433+0000 7fe9708a3700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe96c0ffcb0 0x7fe96c194e40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe96000d900 tx=0x7fe96000dc10 comp rx=0 tx=0).stop 2024-04-13T11:03:53.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.434+0000 7fe9708a3700 1 -- 172.21.15.134:0/1221239094 shutdown_connections 2024-04-13T11:03:53.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.434+0000 7fe9708a3700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe95406cce0 0x7fe95406f190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.434+0000 7fe9708a3700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe96c0ff310 0x7fe96c194900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.434+0000 7fe9708a3700 1 --2- 172.21.15.134:0/1221239094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe96c0ffcb0 0x7fe96c194e40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.434+0000 7fe9708a3700 1 -- 172.21.15.134:0/1221239094 >> 172.21.15.134:0/1221239094 conn(0x7fe96c0fabb0 msgr2=0x7fe96c0fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:53.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.434+0000 7fe9708a3700 1 -- 172.21.15.134:0/1221239094 shutdown_connections 2024-04-13T11:03:53.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.434+0000 7fe9708a3700 1 -- 172.21.15.134:0/1221239094 wait complete. 2024-04-13T11:03:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:53 smithi194 ceph-mon[83053]: pgmap v132: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 51/267 objects degraded (19.101%) 2024-04-13T11:03:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:03:53.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.538+0000 7f3504430700 1 -- 172.21.15.134:0/3694951484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc0ff390 msgr2=0x7f34fc0ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.538+0000 7f3504430700 1 --2- 172.21.15.134:0/3694951484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc0ff390 0x7f34fc0ff760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009910 tx=0x7f34f0009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:53.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.538+0000 7f3504430700 1 -- 172.21.15.134:0/3694951484 shutdown_connections 2024-04-13T11:03:53.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.538+0000 7f3504430700 1 --2- 172.21.15.134:0/3694951484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34fc0ffd30 0x7f34fc103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.538+0000 7f3504430700 1 --2- 172.21.15.134:0/3694951484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc0ff390 0x7f34fc0ff760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.538+0000 7f3504430700 1 -- 172.21.15.134:0/3694951484 >> 172.21.15.134:0/3694951484 conn(0x7f34fc074f50 msgr2=0x7f34fc075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:53.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.538+0000 7f3504430700 1 -- 172.21.15.134:0/3694951484 shutdown_connections 2024-04-13T11:03:53.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.538+0000 7f3504430700 1 -- 172.21.15.134:0/3694951484 wait complete. 2024-04-13T11:03:53.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f3504430700 1 Processor -- start 2024-04-13T11:03:53.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f3504430700 1 -- start start 2024-04-13T11:03:53.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f3504430700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34fc0ff390 0x7f34fc19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:53.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f3504430700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc0ffd30 0x7f34fc19ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:53.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f3504430700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc19b4e0 con 0x7f34fc0ffd30 2024-04-13T11:03:53.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f3504430700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc194990 con 0x7f34fc0ff390 2024-04-13T11:03:53.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f35019cb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc0ffd30 0x7f34fc19ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:53.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f35019cb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc0ffd30 0x7f34fc19ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49250/0 (socket says 172.21.15.134:49250) 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f35019cb700 1 -- 172.21.15.134:0/3163567696 learned_addr learned my addr 172.21.15.134:0/3163567696 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f35021cc700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34fc0ff390 0x7f34fc19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f35019cb700 1 -- 172.21.15.134:0/3163567696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34fc0ff390 msgr2=0x7f34fc19a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f35019cb700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34fc0ff390 0x7f34fc19a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.539+0000 7f35019cb700 1 -- 172.21.15.134:0/3163567696 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f00095f0 con 0x7f34fc0ffd30 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.540+0000 7f35019cb700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc0ffd30 0x7f34fc19ae50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f34f80098f0 tx=0x7f34f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.540+0000 7f34ef7fe700 1 -- 172.21.15.134:0/3163567696 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34f8012070 con 0x7f34fc0ffd30 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.540+0000 7f34ef7fe700 1 -- 172.21.15.134:0/3163567696 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34f800d1f0 con 0x7f34fc0ffd30 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.540+0000 7f3504430700 1 -- 172.21.15.134:0/3163567696 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34fc194c10 con 0x7f34fc0ffd30 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.540+0000 7f34ef7fe700 1 -- 172.21.15.134:0/3163567696 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34f800c850 con 0x7f34fc0ffd30 2024-04-13T11:03:53.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.540+0000 7f3504430700 1 -- 172.21.15.134:0/3163567696 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc195160 con 0x7f34fc0ffd30 2024-04-13T11:03:53.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.541+0000 7f3504430700 1 -- 172.21.15.134:0/3163567696 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc04ea50 con 0x7f34fc0ffd30 2024-04-13T11:03:53.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.541+0000 7f34ef7fe700 1 -- 172.21.15.134:0/3163567696 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f34f8016070 con 0x7f34fc0ffd30 2024-04-13T11:03:53.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.542+0000 7f34ef7fe700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f34e806cce0 0x7f34e806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:53.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.542+0000 7f34ef7fe700 1 -- 172.21.15.134:0/3163567696 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f34f808d640 con 0x7f34fc0ffd30 2024-04-13T11:03:53.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.542+0000 7f35021cc700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f34e806cce0 0x7f34e806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:53.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.542+0000 7f35021cc700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f34e806cce0 0x7f34e806f190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f34f0006010 tx=0x7f34f001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:53.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.546+0000 7f34ef7fe700 1 -- 172.21.15.134:0/3163567696 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f34f805b240 con 0x7f34fc0ffd30 2024-04-13T11:03:53.672 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:53 smithi134 ceph-mon[112184]: pgmap v132: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 51/267 objects degraded (19.101%) 2024-04-13T11:03:53.672 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:53.672 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:03:53.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.835+0000 7f3504430700 1 -- 172.21.15.134:0/3163567696 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f34fc195ea0 con 0x7f34fc0ffd30 2024-04-13T11:03:53.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.836+0000 7f34ef7fe700 1 -- 172.21.15.134:0/3163567696 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+693 (secure 0 0 0) 0x7f34f805add0 con 0x7f34fc0ffd30 2024-04-13T11:03:53.836 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:03:53.836 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 4 2024-04-13T11:03:53.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:03:53.838 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 -- 172.21.15.134:0/3163567696 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f34e806cce0 msgr2=0x7f34e806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f34e806cce0 0x7f34e806f190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f34f0006010 tx=0x7f34f001a040 comp rx=0 tx=0).stop 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 -- 172.21.15.134:0/3163567696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc0ffd30 msgr2=0x7f34fc19ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc0ffd30 0x7f34fc19ae50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f34f80098f0 tx=0x7f34f8009c00 comp rx=0 tx=0).stop 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 -- 172.21.15.134:0/3163567696 shutdown_connections 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f34e806cce0 0x7f34e806f190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34fc0ff390 0x7f34fc19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 --2- 172.21.15.134:0/3163567696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc0ffd30 0x7f34fc19ae50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 -- 172.21.15.134:0/3163567696 >> 172.21.15.134:0/3163567696 conn(0x7f34fc074f50 msgr2=0x7f34fc0fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 -- 172.21.15.134:0/3163567696 shutdown_connections 2024-04-13T11:03:53.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.838+0000 7f3504430700 1 -- 172.21.15.134:0/3163567696 wait complete. 2024-04-13T11:03:53.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.942+0000 7fb1db06a700 1 -- 172.21.15.134:0/3987143532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1d40ffe90 msgr2=0x7fb1d4103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.942+0000 7fb1db06a700 1 --2- 172.21.15.134:0/3987143532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1d40ffe90 0x7fb1d4103450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009910 tx=0x7fb1c0009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:53.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.942+0000 7fb1db06a700 1 -- 172.21.15.134:0/3987143532 shutdown_connections 2024-04-13T11:03:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.942+0000 7fb1db06a700 1 --2- 172.21.15.134:0/3987143532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1d40ffe90 0x7fb1d4103450 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.942+0000 7fb1db06a700 1 --2- 172.21.15.134:0/3987143532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d40ff4f0 0x7fb1d40ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.942+0000 7fb1db06a700 1 -- 172.21.15.134:0/3987143532 >> 172.21.15.134:0/3987143532 conn(0x7fb1d4074850 msgr2=0x7fb1d4074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.942+0000 7fb1db06a700 1 -- 172.21.15.134:0/3987143532 shutdown_connections 2024-04-13T11:03:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.943+0000 7fb1db06a700 1 -- 172.21.15.134:0/3987143532 wait complete. 2024-04-13T11:03:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.943+0000 7fb1db06a700 1 Processor -- start 2024-04-13T11:03:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.943+0000 7fb1db06a700 1 -- start start 2024-04-13T11:03:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.943+0000 7fb1db06a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1d40ff4f0 0x7fb1d4196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.943+0000 7fb1db06a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d40ffe90 0x7fb1d4196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.943+0000 7fb1db06a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4197600 con 0x7fb1d40ff4f0 2024-04-13T11:03:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.943+0000 7fb1db06a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4197740 con 0x7fb1d40ffe90 2024-04-13T11:03:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.943+0000 7fb1d8e06700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1d40ff4f0 0x7fb1d4196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.943+0000 7fb1d8e06700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1d40ff4f0 0x7fb1d4196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49272/0 (socket says 172.21.15.134:49272) 2024-04-13T11:03:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.943+0000 7fb1d8e06700 1 -- 172.21.15.134:0/1719324676 learned_addr learned my addr 172.21.15.134:0/1719324676 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1d3fff700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d40ffe90 0x7fb1d4196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1d8e06700 1 -- 172.21.15.134:0/1719324676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d40ffe90 msgr2=0x7fb1d4196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1d8e06700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d40ffe90 0x7fb1d4196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1d8e06700 1 -- 172.21.15.134:0/1719324676 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00095f0 con 0x7fb1d40ff4f0 2024-04-13T11:03:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1d3fff700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d40ffe90 0x7fb1d4196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:03:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1d8e06700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1d40ff4f0 0x7fb1d4196aa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800d8d0 tx=0x7fb1c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:53.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1d1ffb700 1 -- 172.21.15.134:0/1719324676 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c8009940 con 0x7fb1d40ff4f0 2024-04-13T11:03:53.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1d1ffb700 1 -- 172.21.15.134:0/1719324676 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1c8010460 con 0x7fb1d40ff4f0 2024-04-13T11:03:53.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1db06a700 1 -- 172.21.15.134:0/1719324676 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d419fb10 con 0x7fb1d40ff4f0 2024-04-13T11:03:53.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1d1ffb700 1 -- 172.21.15.134:0/1719324676 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1c800f5f0 con 0x7fb1d40ff4f0 2024-04-13T11:03:53.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.944+0000 7fb1db06a700 1 -- 172.21.15.134:0/1719324676 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d419ffd0 con 0x7fb1d40ff4f0 2024-04-13T11:03:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.945+0000 7fb1db06a700 1 -- 172.21.15.134:0/1719324676 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d4106cf0 con 0x7fb1d40ff4f0 2024-04-13T11:03:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.946+0000 7fb1d1ffb700 1 -- 172.21.15.134:0/1719324676 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb1c80105d0 con 0x7fb1d40ff4f0 2024-04-13T11:03:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.946+0000 7fb1d1ffb700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb1c406cce0 0x7fb1c406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.946+0000 7fb1d3fff700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb1c406cce0 0x7fb1c406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.946+0000 7fb1d1ffb700 1 -- 172.21.15.134:0/1719324676 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb1c808c4e0 con 0x7fb1d40ff4f0 2024-04-13T11:03:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.947+0000 7fb1d3fff700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb1c406cce0 0x7fb1c406f190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0006010 tx=0x7fb1c001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:53.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:53.951+0000 7fb1d1ffb700 1 -- 172.21.15.134:0/1719324676 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fb1c8056650 con 0x7fb1d40ff4f0 2024-04-13T11:03:54.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.211+0000 7fb1db06a700 1 -- 172.21.15.134:0/1719324676 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb1d404ea50 con 0x7fb1d40ff4f0 2024-04-13T11:03:54.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.211+0000 7fb1d1ffb700 1 -- 172.21.15.134:0/1719324676 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1880 (secure 0 0 0) 0x7fb1c8010880 con 0x7fb1d40ff4f0 2024-04-13T11:03:54.212 INFO:teuthology.orchestra.run.smithi134.stdout:e18 2024-04-13T11:03:54.212 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:03:54.212 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 18 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T10:55:58.861624+0000 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:03:54.213 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14492} 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:03:54.214 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:54.215 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:03:54.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 -- 172.21.15.134:0/1719324676 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb1c406cce0 msgr2=0x7fb1c406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:54.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb1c406cce0 0x7fb1c406f190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0006010 tx=0x7fb1c001a040 comp rx=0 tx=0).stop 2024-04-13T11:03:54.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 -- 172.21.15.134:0/1719324676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1d40ff4f0 msgr2=0x7fb1d4196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:54.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1d40ff4f0 0x7fb1d4196aa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800d8d0 tx=0x7fb1c800dc90 comp rx=0 tx=0).stop 2024-04-13T11:03:54.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 -- 172.21.15.134:0/1719324676 shutdown_connections 2024-04-13T11:03:54.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb1c406cce0 0x7fb1c406f190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1d40ff4f0 0x7fb1d4196aa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 --2- 172.21.15.134:0/1719324676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d40ffe90 0x7fb1d4196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 -- 172.21.15.134:0/1719324676 >> 172.21.15.134:0/1719324676 conn(0x7fb1d4074850 msgr2=0x7fb1d4102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:54.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 -- 172.21.15.134:0/1719324676 shutdown_connections 2024-04-13T11:03:54.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.214+0000 7fb1db06a700 1 -- 172.21.15.134:0/1719324676 wait complete. 2024-04-13T11:03:54.217 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T11:03:54.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.334+0000 7fafd074a700 1 -- 172.21.15.134:0/2275149918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafc8068fd0 msgr2=0x7fafc8104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:54.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.334+0000 7fafd074a700 1 --2- 172.21.15.134:0/2275149918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafc8068fd0 0x7fafc8104df0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009910 tx=0x7fafc4009c20 comp rx=0 tx=0).stop 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.334+0000 7fafd074a700 1 -- 172.21.15.134:0/2275149918 shutdown_connections 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.334+0000 7fafd074a700 1 --2- 172.21.15.134:0/2275149918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafc8068fd0 0x7fafc8104df0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.334+0000 7fafd074a700 1 --2- 172.21.15.134:0/2275149918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc8068630 0x7fafc8068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.334+0000 7fafd074a700 1 -- 172.21.15.134:0/2275149918 >> 172.21.15.134:0/2275149918 conn(0x7fafc8074f50 msgr2=0x7fafc8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.334+0000 7fafd074a700 1 -- 172.21.15.134:0/2275149918 shutdown_connections 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.334+0000 7fafd074a700 1 -- 172.21.15.134:0/2275149918 wait complete. 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.334+0000 7fafd074a700 1 Processor -- start 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.334+0000 7fafd074a700 1 -- start start 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafd074a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc8068630 0x7fafc8195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafd074a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafc8068fd0 0x7fafc81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:54.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafd074a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc81969c0 con 0x7fafc8068fd0 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafd074a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc819a750 con 0x7fafc8068630 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafcdce5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafc8068fd0 0x7fafc81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafcdce5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafc8068fd0 0x7fafc81962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49288/0 (socket says 172.21.15.134:49288) 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafcdce5700 1 -- 172.21.15.134:0/1118269648 learned_addr learned my addr 172.21.15.134:0/1118269648 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafce4e6700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc8068630 0x7fafc8195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafcdce5700 1 -- 172.21.15.134:0/1118269648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc8068630 msgr2=0x7fafc8195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafcdce5700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc8068630 0x7fafc8195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafcdce5700 1 -- 172.21.15.134:0/1118269648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40095f0 con 0x7fafc8068fd0 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafcdce5700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafc8068fd0 0x7fafc81962e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fafc40092e0 tx=0x7fafc400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafbf7fe700 1 -- 172.21.15.134:0/1118269648 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafc401d070 con 0x7fafc8068fd0 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafbf7fe700 1 -- 172.21.15.134:0/1118269648 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fafc400f460 con 0x7fafc8068fd0 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafd074a700 1 -- 172.21.15.134:0/1118269648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc819a9d0 con 0x7fafc8068fd0 2024-04-13T11:03:54.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafbf7fe700 1 -- 172.21.15.134:0/1118269648 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafc4021620 con 0x7fafc8068fd0 2024-04-13T11:03:54.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.335+0000 7fafd074a700 1 -- 172.21.15.134:0/1118269648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc819aec0 con 0x7fafc8068fd0 2024-04-13T11:03:54.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.336+0000 7fafd074a700 1 -- 172.21.15.134:0/1118269648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc81086d0 con 0x7fafc8068fd0 2024-04-13T11:03:54.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.337+0000 7fafbf7fe700 1 -- 172.21.15.134:0/1118269648 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fafc400f5d0 con 0x7fafc8068fd0 2024-04-13T11:03:54.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.337+0000 7fafbf7fe700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 0x7fafb406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:54.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.337+0000 7fafbf7fe700 1 -- 172.21.15.134:0/1118269648 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fafc408d680 con 0x7fafc8068fd0 2024-04-13T11:03:54.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.337+0000 7fafce4e6700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 0x7fafb406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:54.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.338+0000 7fafce4e6700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 0x7fafb406f190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009a10 tx=0x7fafb8009190 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:54.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.342+0000 7fafbf7fe700 1 -- 172.21.15.134:0/1118269648 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fafc4057870 con 0x7fafc8068fd0 2024-04-13T11:03:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:54 smithi194 ceph-mon[83053]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:54 smithi194 ceph-mon[83053]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:54 smithi194 ceph-mon[83053]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:54.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:54 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3163567696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:54.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:54 smithi134 ceph-mon[112184]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:54.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:54 smithi134 ceph-mon[112184]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:54.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:54 smithi134 ceph-mon[112184]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:54.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:54 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3163567696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:03:54.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.573+0000 7fafd074a700 1 -- 172.21.15.134:0/1118269648 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafc802cd40 con 0x7fafb406cce0 2024-04-13T11:03:54.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.574+0000 7fafbf7fe700 1 -- 172.21.15.134:0/1118269648 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fafc802cd40 con 0x7fafb406cce0 2024-04-13T11:03:54.575 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:03:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:03:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:03:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:03:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:03:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-04-13T11:03:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:03:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-04-13T11:03:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:03:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "6/23 daemons upgraded", 2024-04-13T11:03:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-04-13T11:03:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:03:54.576 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:03:54.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 -- 172.21.15.134:0/1118269648 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 msgr2=0x7fafb406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:54.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 0x7fafb406f190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009a10 tx=0x7fafb8009190 comp rx=0 tx=0).stop 2024-04-13T11:03:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 -- 172.21.15.134:0/1118269648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafc8068fd0 msgr2=0x7fafc81962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafc8068fd0 0x7fafc81962e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fafc40092e0 tx=0x7fafc400bd70 comp rx=0 tx=0).stop 2024-04-13T11:03:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 -- 172.21.15.134:0/1118269648 shutdown_connections 2024-04-13T11:03:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 0x7fafb406f190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafc8068630 0x7fafc8195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 --2- 172.21.15.134:0/1118269648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafc8068fd0 0x7fafc81962e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 -- 172.21.15.134:0/1118269648 >> 172.21.15.134:0/1118269648 conn(0x7fafc8074f50 msgr2=0x7fafc80fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 -- 172.21.15.134:0/1118269648 shutdown_connections 2024-04-13T11:03:54.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.577+0000 7fafd074a700 1 -- 172.21.15.134:0/1118269648 wait complete. 2024-04-13T11:03:54.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.685+0000 7fb5cde8a700 1 -- 172.21.15.134:0/4188058703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c80ffbb0 msgr2=0x7fb5c80fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:54.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.685+0000 7fb5cde8a700 1 --2- 172.21.15.134:0/4188058703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c80ffbb0 0x7fb5c80fff80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009940 tx=0x7fb5b8009c50 comp rx=0 tx=0).stop 2024-04-13T11:03:54.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.685+0000 7fb5cde8a700 1 -- 172.21.15.134:0/4188058703 shutdown_connections 2024-04-13T11:03:54.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.685+0000 7fb5cde8a700 1 --2- 172.21.15.134:0/4188058703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5c81004c0 0x7fb5c810c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.685+0000 7fb5cde8a700 1 --2- 172.21.15.134:0/4188058703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c80ffbb0 0x7fb5c80fff80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.685+0000 7fb5cde8a700 1 -- 172.21.15.134:0/4188058703 >> 172.21.15.134:0/4188058703 conn(0x7fb5c8074f50 msgr2=0x7fb5c8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:54.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.685+0000 7fb5cde8a700 1 -- 172.21.15.134:0/4188058703 shutdown_connections 2024-04-13T11:03:54.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.685+0000 7fb5cde8a700 1 -- 172.21.15.134:0/4188058703 wait complete. 2024-04-13T11:03:54.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.685+0000 7fb5cde8a700 1 Processor -- start 2024-04-13T11:03:54.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5cde8a700 1 -- start start 2024-04-13T11:03:54.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5cde8a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5c80ffbb0 0x7fb5c8197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5cde8a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c81004c0 0x7fb5c81982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5cde8a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c81989d0 con 0x7fb5c81004c0 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5cde8a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c819c760 con 0x7fb5c80ffbb0 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5c6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c81004c0 0x7fb5c81982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5c6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c81004c0 0x7fb5c81982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49296/0 (socket says 172.21.15.134:49296) 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5c6ffd700 1 -- 172.21.15.134:0/2878421438 learned_addr learned my addr 172.21.15.134:0/2878421438 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5c77fe700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5c80ffbb0 0x7fb5c8197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5c6ffd700 1 -- 172.21.15.134:0/2878421438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5c80ffbb0 msgr2=0x7fb5c8197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5c6ffd700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5c80ffbb0 0x7fb5c8197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5c6ffd700 1 -- 172.21.15.134:0/2878421438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b80095f0 con 0x7fb5c81004c0 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.686+0000 7fb5c77fe700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5c80ffbb0 0x7fb5c8197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:03:54.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.687+0000 7fb5c6ffd700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c81004c0 0x7fb5c81982f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00e940 tx=0x7fb5bc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.687+0000 7fb5c4ff9700 1 -- 172.21.15.134:0/2878421438 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5bc0097b0 con 0x7fb5c81004c0 2024-04-13T11:03:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.687+0000 7fb5c4ff9700 1 -- 172.21.15.134:0/2878421438 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5bc004830 con 0x7fb5c81004c0 2024-04-13T11:03:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.687+0000 7fb5cde8a700 1 -- 172.21.15.134:0/2878421438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c819ca40 con 0x7fb5c81004c0 2024-04-13T11:03:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.687+0000 7fb5c4ff9700 1 -- 172.21.15.134:0/2878421438 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5bc0055b0 con 0x7fb5c81004c0 2024-04-13T11:03:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.687+0000 7fb5cde8a700 1 -- 172.21.15.134:0/2878421438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c819cf90 con 0x7fb5c81004c0 2024-04-13T11:03:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.688+0000 7fb5c4ff9700 1 -- 172.21.15.134:0/2878421438 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb5bc00cba0 con 0x7fb5c81004c0 2024-04-13T11:03:54.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.688+0000 7fb5cde8a700 1 -- 172.21.15.134:0/2878421438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c8109f10 con 0x7fb5c81004c0 2024-04-13T11:03:54.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.688+0000 7fb5c4ff9700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb5b006cce0 0x7fb5b006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:03:54.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.689+0000 7fb5c4ff9700 1 -- 172.21.15.134:0/2878421438 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb5bc014070 con 0x7fb5c81004c0 2024-04-13T11:03:54.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.689+0000 7fb5c77fe700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb5b006cce0 0x7fb5b006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:03:54.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.689+0000 7fb5c77fe700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb5b006cce0 0x7fb5b006f190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8005b40 tx=0x7fb5b8005a90 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:03:54.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:54.693+0000 7fb5c4ff9700 1 -- 172.21.15.134:0/2878421438 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fb5bc0569a0 con 0x7fb5c81004c0 2024-04-13T11:03:55.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.018+0000 7fb5cde8a700 1 -- 172.21.15.134:0/2878421438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb5c804ea50 con 0x7fb5c81004c0 2024-04-13T11:03:55.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.018+0000 7fb5c4ff9700 1 -- 172.21.15.134:0/2878421438 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1517 (secure 0 0 0) 0x7fb5bc059fc0 con 0x7fb5c81004c0 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 51/267 objects degraded (19.101%), 19 pgs degraded 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd.0 (root=default,host=smithi134) is down 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 51/267 objects degraded (19.101%), 19 pgs degraded 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-04-13T11:03:55.020 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-04-13T11:03:55.021 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-04-13T11:03:55.022 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-04-13T11:03:55.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.020+0000 7fb5cde8a700 1 -- 172.21.15.134:0/2878421438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb5b006cce0 msgr2=0x7fb5b006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.020+0000 7fb5cde8a700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb5b006cce0 0x7fb5b006f190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8005b40 tx=0x7fb5b8005a90 comp rx=0 tx=0).stop 2024-04-13T11:03:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.020+0000 7fb5cde8a700 1 -- 172.21.15.134:0/2878421438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c81004c0 msgr2=0x7fb5c81982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:03:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.020+0000 7fb5cde8a700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c81004c0 0x7fb5c81982f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00e940 tx=0x7fb5bc00ed00 comp rx=0 tx=0).stop 2024-04-13T11:03:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.021+0000 7fb5cde8a700 1 -- 172.21.15.134:0/2878421438 shutdown_connections 2024-04-13T11:03:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.021+0000 7fb5cde8a700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb5b006cce0 0x7fb5b006f190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.021+0000 7fb5cde8a700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5c80ffbb0 0x7fb5c8197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.021+0000 7fb5cde8a700 1 --2- 172.21.15.134:0/2878421438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c81004c0 0x7fb5c81982f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:03:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.021+0000 7fb5cde8a700 1 -- 172.21.15.134:0/2878421438 >> 172.21.15.134:0/2878421438 conn(0x7fb5c8074f50 msgr2=0x7fb5c80fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:03:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.021+0000 7fb5cde8a700 1 -- 172.21.15.134:0/2878421438 shutdown_connections 2024-04-13T11:03:55.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:03:55.021+0000 7fb5cde8a700 1 -- 172.21.15.134:0/2878421438 wait complete. 2024-04-13T11:03:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:55 smithi194 ceph-mon[83053]: pgmap v133: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 51/267 objects degraded (19.101%) 2024-04-13T11:03:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:55 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1719324676' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:03:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:55 smithi194 ceph-mon[83053]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:55 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2878421438' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:03:55.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:55 smithi134 ceph-mon[112184]: pgmap v133: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 51/267 objects degraded (19.101%) 2024-04-13T11:03:55.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:55 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1719324676' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:03:55.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:55 smithi134 ceph-mon[112184]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:03:55.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:55 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2878421438' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:03:56.184 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:56 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[124094]: 2024-04-13T11:03:56.006+0000 7f478de567c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-04-13T11:03:56.686 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:56 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[124094]: 2024-04-13T11:03:56.344+0000 7f478de567c0 -1 osd.0 48 log_to_monitors true 2024-04-13T11:03:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:57 smithi194 ceph-mon[83053]: pgmap v134: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 51/267 objects degraded (19.101%) 2024-04-13T11:03:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:57 smithi194 ceph-mon[83053]: from='osd.0 [v2:172.21.15.134:6802/3712938281,v1:172.21.15.134:6803/3712938281]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-13T11:03:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:57.684 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:03:57 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[124094]: 2024-04-13T11:03:57.211+0000 7f477f2b0700 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T11:03:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:57 smithi134 ceph-mon[112184]: pgmap v134: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 51/267 objects degraded (19.101%) 2024-04-13T11:03:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:57 smithi134 ceph-mon[112184]: from='osd.0 [v2:172.21.15.134:6802/3712938281,v1:172.21.15.134:6803/3712938281]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-13T11:03:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:58.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:58 smithi134 ceph-mon[112184]: from='osd.0 [v2:172.21.15.134:6802/3712938281,v1:172.21.15.134:6803/3712938281]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-13T11:03:58.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:58 smithi134 ceph-mon[112184]: osdmap e51: 6 total, 5 up, 6 in 2024-04-13T11:03:58.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:58 smithi134 ceph-mon[112184]: from='osd.0 [v2:172.21.15.134:6802/3712938281,v1:172.21.15.134:6803/3712938281]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T11:03:58.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:58.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:58.473 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:58 smithi194 ceph-mon[83053]: from='osd.0 [v2:172.21.15.134:6802/3712938281,v1:172.21.15.134:6803/3712938281]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-13T11:03:58.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:58 smithi194 ceph-mon[83053]: osdmap e51: 6 total, 5 up, 6 in 2024-04-13T11:03:58.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:58 smithi194 ceph-mon[83053]: from='osd.0 [v2:172.21.15.134:6802/3712938281,v1:172.21.15.134:6803/3712938281]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T11:03:58.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:58.474 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:03:59.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:59 smithi134 ceph-mon[112184]: pgmap v136: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 51/267 objects degraded (19.101%) 2024-04-13T11:03:59.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:59 smithi134 ceph-mon[112184]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:03:59.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:59 smithi134 ceph-mon[112184]: osd.0 [v2:172.21.15.134:6802/3712938281,v1:172.21.15.134:6803/3712938281] boot 2024-04-13T11:03:59.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:59 smithi134 ceph-mon[112184]: osdmap e52: 6 total, 6 up, 6 in 2024-04-13T11:03:59.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:59 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T11:03:59.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:03:59 smithi134 ceph-mon[112184]: osdmap e53: 6 total, 6 up, 6 in 2024-04-13T11:03:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:59 smithi194 ceph-mon[83053]: pgmap v136: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 51/267 objects degraded (19.101%) 2024-04-13T11:03:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:59 smithi194 ceph-mon[83053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:03:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:59 smithi194 ceph-mon[83053]: osd.0 [v2:172.21.15.134:6802/3712938281,v1:172.21.15.134:6803/3712938281] boot 2024-04-13T11:03:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:59 smithi194 ceph-mon[83053]: osdmap e52: 6 total, 6 up, 6 in 2024-04-13T11:03:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:59 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-13T11:03:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:03:59 smithi194 ceph-mon[83053]: osdmap e53: 6 total, 6 up, 6 in 2024-04-13T11:04:00.676 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:00 smithi134 ceph-mon[112184]: Health check update: Degraded data redundancy: 7/267 objects degraded (2.622%), 3 pgs degraded (PG_DEGRADED) 2024-04-13T11:04:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:00 smithi194 ceph-mon[83053]: Health check update: Degraded data redundancy: 7/267 objects degraded (2.622%), 3 pgs degraded (PG_DEGRADED) 2024-04-13T11:04:01.618 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:01 smithi134 ceph-mon[112184]: pgmap v139: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 7/267 objects degraded (2.622%) 2024-04-13T11:04:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:01 smithi194 ceph-mon[83053]: pgmap v139: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 7/267 objects degraded (2.622%) 2024-04-13T11:04:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:04:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:04:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:04:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:02.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:02.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-13T11:04:02.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-13T11:04:02.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:02 smithi194 ceph-mon[83053]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-13T11:04:02.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:02.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:02.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:04:02.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:04:02.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:02.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:04:02.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:02.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:02.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:02.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-13T11:04:02.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-13T11:04:02.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:02 smithi134 ceph-mon[112184]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-13T11:04:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:03 smithi194 ceph-mon[83053]: pgmap v140: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 7/267 objects degraded (2.622%) 2024-04-13T11:04:03.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:03 smithi134 ceph-mon[112184]: pgmap v140: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 7/267 objects degraded (2.622%) 2024-04-13T11:04:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:04 smithi134 ceph-mon[112184]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/267 objects degraded (2.622%), 3 pgs degraded) 2024-04-13T11:04:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:04 smithi194 ceph-mon[83053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/267 objects degraded (2.622%), 3 pgs degraded) 2024-04-13T11:04:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:05 smithi134 ceph-mon[112184]: pgmap v141: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-13T11:04:05.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:05 smithi194 ceph-mon[83053]: pgmap v141: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-13T11:04:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:07 smithi134 ceph-mon[112184]: pgmap v142: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-13T11:04:07.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:07 smithi194 ceph-mon[83053]: pgmap v142: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-13T11:04:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:08 smithi194 ceph-mon[83053]: pgmap v143: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 947 B/s rd, 1 op/s 2024-04-13T11:04:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:04:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:08 smithi134 ceph-mon[112184]: pgmap v143: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 947 B/s rd, 1 op/s 2024-04-13T11:04:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:04:11.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:10 smithi194 ceph-mon[83053]: pgmap v144: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 858 B/s rd, 1 op/s 2024-04-13T11:04:11.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:10 smithi134 ceph-mon[112184]: pgmap v144: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 858 B/s rd, 1 op/s 2024-04-13T11:04:13.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:12 smithi194 ceph-mon[83053]: pgmap v145: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:04:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:12 smithi134 ceph-mon[112184]: pgmap v145: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:04:14.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:14 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:14 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:15.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:15 smithi134 ceph-mon[112184]: pgmap v146: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:04:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:15 smithi194 ceph-mon[83053]: pgmap v146: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:04:17.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:17 smithi134 ceph-mon[112184]: pgmap v147: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:17.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:17 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-13T11:04:17.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:17 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-13T11:04:17.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:17 smithi134 ceph-mon[112184]: Upgrade: osd.1 is safe to restart 2024-04-13T11:04:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:17 smithi194 ceph-mon[83053]: pgmap v147: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:17 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-13T11:04:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:17 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-13T11:04:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:17 smithi194 ceph-mon[83053]: Upgrade: osd.1 is safe to restart 2024-04-13T11:04:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:19 smithi134 ceph-mon[112184]: pgmap v148: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:19 smithi134 ceph-mon[112184]: Upgrade: Updating osd.1 2024-04-13T11:04:19.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:19.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-13T11:04:19.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:04:19.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:19 smithi134 ceph-mon[112184]: Deploying daemon osd.1 on smithi134 2024-04-13T11:04:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:19 smithi194 ceph-mon[83053]: pgmap v148: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:19 smithi194 ceph-mon[83053]: Upgrade: Updating osd.1 2024-04-13T11:04:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-13T11:04:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:04:19.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:19 smithi194 ceph-mon[83053]: Deploying daemon osd.1 on smithi134 2024-04-13T11:04:21.592 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:21 smithi134 ceph-mon[112184]: pgmap v149: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:04:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:21 smithi194 ceph-mon[83053]: pgmap v149: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:04:21.934 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:21 smithi134 systemd[1]: Stopping Ceph osd.1 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:04:22.309 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:21 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1[64404]: 2024-04-13T11:04:21.967+0000 7f080e89b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:04:22.310 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:21 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1[64404]: 2024-04-13T11:04:21.967+0000 7f080e89b700 -1 osd.1 53 *** Got signal Terminated *** 2024-04-13T11:04:22.310 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:21 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1[64404]: 2024-04-13T11:04:21.967+0000 7f080e89b700 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:04:22.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:22 smithi134 ceph-mon[112184]: osd.1 marked itself down and dead 2024-04-13T11:04:22.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:22 smithi194 ceph-mon[83053]: osd.1 marked itself down and dead 2024-04-13T11:04:23.184 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:23 smithi134 bash[130387]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1 2024-04-13T11:04:23.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:23 smithi134 ceph-mon[112184]: pgmap v150: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:23.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:23 smithi134 ceph-mon[112184]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:04:23.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:23 smithi134 ceph-mon[112184]: osdmap e54: 6 total, 5 up, 6 in 2024-04-13T11:04:23.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:23.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:04:23.702 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:23 smithi194 ceph-mon[83053]: pgmap v150: 65 pgs: 65 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:23.702 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:23 smithi194 ceph-mon[83053]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:04:23.702 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:23 smithi194 ceph-mon[83053]: osdmap e54: 6 total, 5 up, 6 in 2024-04-13T11:04:23.702 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:23.702 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:04:24.606 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:24 smithi134 ceph-mon[112184]: osdmap e55: 6 total, 5 up, 6 in 2024-04-13T11:04:24.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:24 smithi194 ceph-mon[83053]: osdmap e55: 6 total, 5 up, 6 in 2024-04-13T11:04:25.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.138+0000 7f6439525700 1 -- 172.21.15.134:0/3454972517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6434100e00 msgr2=0x7f6434104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.138+0000 7f6439525700 1 --2- 172.21.15.134:0/3454972517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6434100e00 0x7f6434104dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6428009910 tx=0x7f6428009c20 comp rx=0 tx=0).stop 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.138+0000 7f6439525700 1 -- 172.21.15.134:0/3454972517 shutdown_connections 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.138+0000 7f6439525700 1 --2- 172.21.15.134:0/3454972517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6434100e00 0x7f6434104dd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.138+0000 7f6439525700 1 --2- 172.21.15.134:0/3454972517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6434100460 0x7f6434100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.138+0000 7f6439525700 1 -- 172.21.15.134:0/3454972517 >> 172.21.15.134:0/3454972517 conn(0x7f64340fbd00 msgr2=0x7f64340fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.138+0000 7f6439525700 1 -- 172.21.15.134:0/3454972517 shutdown_connections 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.138+0000 7f6439525700 1 -- 172.21.15.134:0/3454972517 wait complete. 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.139+0000 7f6439525700 1 Processor -- start 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.139+0000 7f6439525700 1 -- start start 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.139+0000 7f6439525700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6434100460 0x7f643419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:25.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.139+0000 7f6439525700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6434100e00 0x7f643419bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.139+0000 7f6439525700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643419c5f0 con 0x7f6434100460 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.139+0000 7f6439525700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6434195b30 con 0x7f6434100e00 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.139+0000 7f6432ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6434100460 0x7f643419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f6432ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6434100460 0x7f643419bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42446/0 (socket says 172.21.15.134:42446) 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f6432ffd700 1 -- 172.21.15.134:0/1322751031 learned_addr learned my addr 172.21.15.134:0/1322751031 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f64327fc700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6434100e00 0x7f643419bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f6432ffd700 1 -- 172.21.15.134:0/1322751031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6434100e00 msgr2=0x7f643419bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f6432ffd700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6434100e00 0x7f643419bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f6432ffd700 1 -- 172.21.15.134:0/1322751031 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64280095f0 con 0x7f6434100460 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f6432ffd700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6434100460 0x7f643419bab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f642400c930 tx=0x7f642400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f641bfff700 1 -- 172.21.15.134:0/1322751031 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6424007ad0 con 0x7f6434100460 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f6439525700 1 -- 172.21.15.134:0/1322751031 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6434195e10 con 0x7f6434100460 2024-04-13T11:04:25.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f641bfff700 1 -- 172.21.15.134:0/1322751031 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f642400ce80 con 0x7f6434100460 2024-04-13T11:04:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f641bfff700 1 -- 172.21.15.134:0/1322751031 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6424018630 con 0x7f6434100460 2024-04-13T11:04:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.140+0000 7f6439525700 1 -- 172.21.15.134:0/1322751031 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6434196360 con 0x7f6434100460 2024-04-13T11:04:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.142+0000 7f6439525700 1 -- 172.21.15.134:0/1322751031 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64341087d0 con 0x7f6434100460 2024-04-13T11:04:25.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.142+0000 7f641bfff700 1 -- 172.21.15.134:0/1322751031 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f642400f450 con 0x7f6434100460 2024-04-13T11:04:25.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.142+0000 7f641bfff700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f641c06cce0 0x7f641c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:25.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.142+0000 7f641bfff700 1 -- 172.21.15.134:0/1322751031 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f642408c4b0 con 0x7f6434100460 2024-04-13T11:04:25.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.142+0000 7f64327fc700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f641c06cce0 0x7f641c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:25.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.143+0000 7f64327fc700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f641c06cce0 0x7f641c06f190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64340fc4c0 tx=0x7f642801a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:25.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.148+0000 7f641bfff700 1 -- 172.21.15.134:0/1322751031 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f642405a0b0 con 0x7f6434100460 2024-04-13T11:04:25.324 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:24 smithi134 systemd[1]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.1.service: Succeeded. 2024-04-13T11:04:25.324 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:24 smithi134 systemd[1]: Stopped Ceph osd.1 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:04:25.324 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:25 smithi134 systemd[1]: Starting Ceph osd.1 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:04:25.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.402+0000 7f6439525700 1 -- 172.21.15.134:0/1322751031 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64341965e0 con 0x7f641c06cce0 2024-04-13T11:04:25.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.403+0000 7f641bfff700 1 -- 172.21.15.134:0/1322751031 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f64341965e0 con 0x7f641c06cce0 2024-04-13T11:04:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 -- 172.21.15.134:0/1322751031 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f641c06cce0 msgr2=0x7f641c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f641c06cce0 0x7f641c06f190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64340fc4c0 tx=0x7f642801a040 comp rx=0 tx=0).stop 2024-04-13T11:04:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 -- 172.21.15.134:0/1322751031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6434100460 msgr2=0x7f643419bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6434100460 0x7f643419bab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f642400c930 tx=0x7f642400cc40 comp rx=0 tx=0).stop 2024-04-13T11:04:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 -- 172.21.15.134:0/1322751031 shutdown_connections 2024-04-13T11:04:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f641c06cce0 0x7f641c06f190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6434100460 0x7f643419bab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 --2- 172.21.15.134:0/1322751031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6434100e00 0x7f643419bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 -- 172.21.15.134:0/1322751031 >> 172.21.15.134:0/1322751031 conn(0x7f64340fbd00 msgr2=0x7f64340fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:25.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 -- 172.21.15.134:0/1322751031 shutdown_connections 2024-04-13T11:04:25.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.406+0000 7f6439525700 1 -- 172.21.15.134:0/1322751031 wait complete. 2024-04-13T11:04:25.417 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:04:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.512+0000 7f1e85bd4700 1 -- 172.21.15.134:0/1859407291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e800ff2c0 msgr2=0x7f1e800ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.512+0000 7f1e85bd4700 1 --2- 172.21.15.134:0/1859407291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e800ff2c0 0x7f1e800ff690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009910 tx=0x7f1e70009c20 comp rx=0 tx=0).stop 2024-04-13T11:04:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.512+0000 7f1e85bd4700 1 -- 172.21.15.134:0/1859407291 shutdown_connections 2024-04-13T11:04:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.512+0000 7f1e85bd4700 1 --2- 172.21.15.134:0/1859407291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e800ffc60 0x7f1e80103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.512+0000 7f1e85bd4700 1 --2- 172.21.15.134:0/1859407291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e800ff2c0 0x7f1e800ff690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.512+0000 7f1e85bd4700 1 -- 172.21.15.134:0/1859407291 >> 172.21.15.134:0/1859407291 conn(0x7f1e800fab80 msgr2=0x7f1e800fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.512+0000 7f1e85bd4700 1 -- 172.21.15.134:0/1859407291 shutdown_connections 2024-04-13T11:04:25.513 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.512+0000 7f1e85bd4700 1 -- 172.21.15.134:0/1859407291 wait complete. 2024-04-13T11:04:25.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.512+0000 7f1e85bd4700 1 Processor -- start 2024-04-13T11:04:25.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e85bd4700 1 -- start start 2024-04-13T11:04:25.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e85bd4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e800ff2c0 0x7f1e8019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e85bd4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e800ffc60 0x7f1e8019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e85bd4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8019b5f0 con 0x7f1e800ffc60 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e85bd4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80194aa0 con 0x7f1e800ff2c0 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e7effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e800ffc60 0x7f1e8019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e7effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e800ffc60 0x7f1e8019af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42470/0 (socket says 172.21.15.134:42470) 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e7effd700 1 -- 172.21.15.134:0/111269102 learned_addr learned my addr 172.21.15.134:0/111269102 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e7f7fe700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e800ff2c0 0x7f1e8019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e7effd700 1 -- 172.21.15.134:0/111269102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e800ff2c0 msgr2=0x7f1e8019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e7effd700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e800ff2c0 0x7f1e8019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.513+0000 7f1e7effd700 1 -- 172.21.15.134:0/111269102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e700095f0 con 0x7f1e800ffc60 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.514+0000 7f1e7effd700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e800ffc60 0x7f1e8019af60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400d930 tx=0x7f1e7400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:25.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.514+0000 7f1e7cff9700 1 -- 172.21.15.134:0/111269102 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e7400ec20 con 0x7f1e800ffc60 2024-04-13T11:04:25.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.514+0000 7f1e7cff9700 1 -- 172.21.15.134:0/111269102 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e7400ed80 con 0x7f1e800ffc60 2024-04-13T11:04:25.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.514+0000 7f1e85bd4700 1 -- 172.21.15.134:0/111269102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e80194d20 con 0x7f1e800ffc60 2024-04-13T11:04:25.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.514+0000 7f1e7cff9700 1 -- 172.21.15.134:0/111269102 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e74014730 con 0x7f1e800ffc60 2024-04-13T11:04:25.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.514+0000 7f1e85bd4700 1 -- 172.21.15.134:0/111269102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e80195270 con 0x7f1e800ffc60 2024-04-13T11:04:25.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.515+0000 7f1e85bd4700 1 -- 172.21.15.134:0/111269102 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8004ea50 con 0x7f1e800ffc60 2024-04-13T11:04:25.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.516+0000 7f1e7cff9700 1 -- 172.21.15.134:0/111269102 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1e74016440 con 0x7f1e800ffc60 2024-04-13T11:04:25.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.516+0000 7f1e7cff9700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e6806cce0 0x7f1e6806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:25.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.516+0000 7f1e7cff9700 1 -- 172.21.15.134:0/111269102 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1e7408ddb0 con 0x7f1e800ffc60 2024-04-13T11:04:25.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.516+0000 7f1e7f7fe700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e6806cce0 0x7f1e6806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:25.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.517+0000 7f1e7f7fe700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e6806cce0 0x7f1e6806f190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000b5c0 tx=0x7f1e70005fb0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:25.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.521+0000 7f1e7cff9700 1 -- 172.21.15.134:0/111269102 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f1e7405ba60 con 0x7f1e800ffc60 2024-04-13T11:04:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:25 smithi134 ceph-mon[112184]: pgmap v153: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 33/267 objects degraded (12.360%) 2024-04-13T11:04:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:25 smithi134 ceph-mon[112184]: Health check failed: Degraded data redundancy: 33/267 objects degraded (12.360%), 11 pgs degraded (PG_DEGRADED) 2024-04-13T11:04:25.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.744+0000 7f1e85bd4700 1 -- 172.21.15.134:0/111269102 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e80195760 con 0x7f1e6806cce0 2024-04-13T11:04:25.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.746+0000 7f1e7cff9700 1 -- 172.21.15.134:0/111269102 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1e80195760 con 0x7f1e6806cce0 2024-04-13T11:04:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:25 smithi194 ceph-mon[83053]: pgmap v153: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 33/267 objects degraded (12.360%) 2024-04-13T11:04:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:25 smithi194 ceph-mon[83053]: Health check failed: Degraded data redundancy: 33/267 objects degraded (12.360%), 11 pgs degraded (PG_DEGRADED) 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 -- 172.21.15.134:0/111269102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e6806cce0 msgr2=0x7f1e6806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e6806cce0 0x7f1e6806f190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000b5c0 tx=0x7f1e70005fb0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 -- 172.21.15.134:0/111269102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e800ffc60 msgr2=0x7f1e8019af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e800ffc60 0x7f1e8019af60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400d930 tx=0x7f1e7400dcf0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 -- 172.21.15.134:0/111269102 shutdown_connections 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e6806cce0 0x7f1e6806f190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e800ff2c0 0x7f1e8019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 --2- 172.21.15.134:0/111269102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e800ffc60 0x7f1e8019af60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 -- 172.21.15.134:0/111269102 >> 172.21.15.134:0/111269102 conn(0x7f1e800fab80 msgr2=0x7f1e800fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 -- 172.21.15.134:0/111269102 shutdown_connections 2024-04-13T11:04:25.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.748+0000 7f1e85bd4700 1 -- 172.21.15.134:0/111269102 wait complete. 2024-04-13T11:04:25.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.856+0000 7f1bb8925700 1 -- 172.21.15.134:0/2027005362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb40ff390 msgr2=0x7f1bb40ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:25.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.856+0000 7f1bb8925700 1 --2- 172.21.15.134:0/2027005362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb40ff390 0x7f1bb40ff760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4009910 tx=0x7f1ba4009c20 comp rx=0 tx=0).stop 2024-04-13T11:04:25.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.856+0000 7f1bb8925700 1 -- 172.21.15.134:0/2027005362 shutdown_connections 2024-04-13T11:04:25.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.856+0000 7f1bb8925700 1 --2- 172.21.15.134:0/2027005362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb40ffd30 0x7f1bb4103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.856+0000 7f1bb8925700 1 --2- 172.21.15.134:0/2027005362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb40ff390 0x7f1bb40ff760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.856+0000 7f1bb8925700 1 -- 172.21.15.134:0/2027005362 >> 172.21.15.134:0/2027005362 conn(0x7f1bb4074f50 msgr2=0x7f1bb4075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:25.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.856+0000 7f1bb8925700 1 -- 172.21.15.134:0/2027005362 shutdown_connections 2024-04-13T11:04:25.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.856+0000 7f1bb8925700 1 -- 172.21.15.134:0/2027005362 wait complete. 2024-04-13T11:04:25.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb8925700 1 Processor -- start 2024-04-13T11:04:25.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb8925700 1 -- start start 2024-04-13T11:04:25.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb8925700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb40ff390 0x7f1bb41948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:25.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb8925700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb40ffd30 0x7f1bb4194de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:25.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb8925700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb4195320 con 0x7f1bb40ff390 2024-04-13T11:04:25.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb8925700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb4195490 con 0x7f1bb40ffd30 2024-04-13T11:04:25.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb40ff390 0x7f1bb41948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:25.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb40ff390 0x7f1bb41948a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42480/0 (socket says 172.21.15.134:42480) 2024-04-13T11:04:25.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb259c700 1 -- 172.21.15.134:0/812294270 learned_addr learned my addr 172.21.15.134:0/812294270 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:25.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb1d9b700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb40ffd30 0x7f1bb4194de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:25.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb259c700 1 -- 172.21.15.134:0/812294270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb40ffd30 msgr2=0x7f1bb4194de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:25.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb259c700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb40ffd30 0x7f1bb4194de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:25.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.857+0000 7f1bb259c700 1 -- 172.21.15.134:0/812294270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba40095f0 con 0x7f1bb40ff390 2024-04-13T11:04:25.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.858+0000 7f1bb259c700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb40ff390 0x7f1bb41948a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4000c00 tx=0x7f1ba400bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:25.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.858+0000 7f1ba37fe700 1 -- 172.21.15.134:0/812294270 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ba401d070 con 0x7f1bb40ff390 2024-04-13T11:04:25.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.858+0000 7f1bb8925700 1 -- 172.21.15.134:0/812294270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb4195710 con 0x7f1bb40ff390 2024-04-13T11:04:25.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.858+0000 7f1ba37fe700 1 -- 172.21.15.134:0/812294270 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1ba4005dc0 con 0x7f1bb40ff390 2024-04-13T11:04:25.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.858+0000 7f1ba37fe700 1 -- 172.21.15.134:0/812294270 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ba4003940 con 0x7f1bb40ff390 2024-04-13T11:04:25.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.858+0000 7f1bb8925700 1 -- 172.21.15.134:0/812294270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb41a2130 con 0x7f1bb40ff390 2024-04-13T11:04:25.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.859+0000 7f1bb8925700 1 -- 172.21.15.134:0/812294270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb4107650 con 0x7f1bb40ff390 2024-04-13T11:04:25.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.859+0000 7f1ba37fe700 1 -- 172.21.15.134:0/812294270 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1ba4004ae0 con 0x7f1bb40ff390 2024-04-13T11:04:25.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.860+0000 7f1ba37fe700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b9c06cce0 0x7f1b9c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:25.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.860+0000 7f1bb1d9b700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b9c06cce0 0x7f1b9c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:25.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.860+0000 7f1ba37fe700 1 -- 172.21.15.134:0/812294270 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1ba408d910 con 0x7f1bb40ff390 2024-04-13T11:04:25.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.860+0000 7f1bb1d9b700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b9c06cce0 0x7f1b9c06f190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4068d30 tx=0x7f1ba8009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:25.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:25.864+0000 7f1ba37fe700 1 -- 172.21.15.134:0/812294270 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f1ba405b510 con 0x7f1bb40ff390 2024-04-13T11:04:26.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.098+0000 7f1bb8925700 1 -- 172.21.15.134:0/812294270 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bb4195710 con 0x7f1b9c06cce0 2024-04-13T11:04:26.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.108+0000 7f1ba37fe700 1 -- 172.21.15.134:0/812294270 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f1bb4195710 con 0x7f1b9c06cce0 2024-04-13T11:04:26.109 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (3m) 29s ago 14m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (14m) 29s ago 14m 8200k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (13m) 53s ago 13m 7796k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (62s) 29s ago 14m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (57s) 53s ago 13m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (2m) 29s ago 14m 79.5M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (8m) 29s ago 8m 90.0M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (8m) 29s ago 8m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (8m) 53s ago 8m 16.1M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (8m) 53s ago 8m 19.6M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (5m) 29s ago 16m 505M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (4m) 53s ago 13m 452M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:04:26.110 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (94s) 29s ago 16m 41.9M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:04:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (77s) 53s ago 13m 28.7M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:04:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 29s ago 14m 18.4M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:04:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (4m) 53s ago 13m 16.6M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:04:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (35s) 29s ago 12m 13.9M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:04:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (12m) 29s ago 12m 225M 1227M 18.2.0 dc2bc1663786 6a6881b2dab6 2024-04-13T11:04:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (11m) 29s ago 11m 189M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T11:04:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (11m) 53s ago 11m 257M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T11:04:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (10m) 53s ago 10m 215M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:04:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (10m) 53s ago 10m 219M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:04:26.111 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 29s ago 14m 64.1M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:04:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 -- 172.21.15.134:0/812294270 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b9c06cce0 msgr2=0x7f1b9c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b9c06cce0 0x7f1b9c06f190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4068d30 tx=0x7f1ba8009260 comp rx=0 tx=0).stop 2024-04-13T11:04:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 -- 172.21.15.134:0/812294270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb40ff390 msgr2=0x7f1bb41948a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb40ff390 0x7f1bb41948a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4000c00 tx=0x7f1ba400bde0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 -- 172.21.15.134:0/812294270 shutdown_connections 2024-04-13T11:04:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b9c06cce0 0x7f1b9c06f190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bb40ff390 0x7f1bb41948a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 --2- 172.21.15.134:0/812294270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb40ffd30 0x7f1bb4194de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 -- 172.21.15.134:0/812294270 >> 172.21.15.134:0/812294270 conn(0x7f1bb4074f50 msgr2=0x7f1bb40fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:26.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 -- 172.21.15.134:0/812294270 shutdown_connections 2024-04-13T11:04:26.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.111+0000 7f1bb8925700 1 -- 172.21.15.134:0/812294270 wait complete. 2024-04-13T11:04:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.221+0000 7fafd0fd7700 1 -- 172.21.15.134:0/3155395543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafcc101ca0 msgr2=0x7fafcc10a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.221+0000 7fafd0fd7700 1 --2- 172.21.15.134:0/3155395543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafcc101ca0 0x7fafcc10a1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009910 tx=0x7fafc0009c20 comp rx=0 tx=0).stop 2024-04-13T11:04:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.221+0000 7fafd0fd7700 1 -- 172.21.15.134:0/3155395543 shutdown_connections 2024-04-13T11:04:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.221+0000 7fafd0fd7700 1 --2- 172.21.15.134:0/3155395543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafcc101ca0 0x7fafcc10a1a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.221+0000 7fafd0fd7700 1 --2- 172.21.15.134:0/3155395543 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc101390 0x7fafcc101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.221+0000 7fafd0fd7700 1 -- 172.21.15.134:0/3155395543 >> 172.21.15.134:0/3155395543 conn(0x7fafcc0fabb0 msgr2=0x7fafcc0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:26.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.221+0000 7fafd0fd7700 1 -- 172.21.15.134:0/3155395543 shutdown_connections 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.221+0000 7fafd0fd7700 1 -- 172.21.15.134:0/3155395543 wait complete. 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafd0fd7700 1 Processor -- start 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafd0fd7700 1 -- start start 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafd0fd7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafcc101390 0x7fafcc0feff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafd0fd7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc101ca0 0x7fafcc0ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafd0fd7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0ffa70 con 0x7fafcc101390 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafd0fd7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0ffbb0 con 0x7fafcc101ca0 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafca59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafcc101390 0x7fafcc0feff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafca59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafcc101390 0x7fafcc0feff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42496/0 (socket says 172.21.15.134:42496) 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafca59c700 1 -- 172.21.15.134:0/784333189 learned_addr learned my addr 172.21.15.134:0/784333189 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafc9d9b700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc101ca0 0x7fafcc0ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:26.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafca59c700 1 -- 172.21.15.134:0/784333189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc101ca0 msgr2=0x7fafcc0ff530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:26.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafca59c700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc101ca0 0x7fafcc0ff530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.222+0000 7fafca59c700 1 -- 172.21.15.134:0/784333189 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc00095f0 con 0x7fafcc101390 2024-04-13T11:04:26.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.223+0000 7fafca59c700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafcc101390 0x7fafcc0feff0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00d8d0 tx=0x7fafbc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:26.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.223+0000 7fafbb7fe700 1 -- 172.21.15.134:0/784333189 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafbc009940 con 0x7fafcc101390 2024-04-13T11:04:26.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.223+0000 7fafd0fd7700 1 -- 172.21.15.134:0/784333189 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc1a1eb0 con 0x7fafcc101390 2024-04-13T11:04:26.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.223+0000 7fafbb7fe700 1 -- 172.21.15.134:0/784333189 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fafbc010460 con 0x7fafcc101390 2024-04-13T11:04:26.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.223+0000 7fafbb7fe700 1 -- 172.21.15.134:0/784333189 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafbc00f5f0 con 0x7fafcc101390 2024-04-13T11:04:26.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.223+0000 7fafd0fd7700 1 -- 172.21.15.134:0/784333189 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc1a22c0 con 0x7fafcc101390 2024-04-13T11:04:26.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.224+0000 7fafd0fd7700 1 -- 172.21.15.134:0/784333189 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc107810 con 0x7fafcc101390 2024-04-13T11:04:26.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.225+0000 7fafbb7fe700 1 -- 172.21.15.134:0/784333189 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fafbc00f870 con 0x7fafcc101390 2024-04-13T11:04:26.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.225+0000 7fafbb7fe700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 0x7fafb406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:26.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.225+0000 7fafbb7fe700 1 -- 172.21.15.134:0/784333189 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fafbc08c560 con 0x7fafcc101390 2024-04-13T11:04:26.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.225+0000 7fafc9d9b700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 0x7fafb406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:26.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.226+0000 7fafc9d9b700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 0x7fafb406f190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fafcc1007e0 tx=0x7fafc001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:26.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.231+0000 7fafbb7fe700 1 -- 172.21.15.134:0/784333189 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fafbc0566e0 con 0x7fafcc101390 2024-04-13T11:04:26.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:26 smithi134 ceph-mon[112184]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:26.434 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:26 smithi134 bash[130692]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-13T11:04:26.434 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:26 smithi134 bash[130692]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-13T11:04:26.435 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:26 smithi134 bash[130692]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-13T11:04:26.435 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:26 smithi134 bash[130692]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-13T11:04:26.435 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:26 smithi134 bash[130692]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-13T11:04:26.435 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:26 smithi134 bash[130692]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-13T11:04:26.435 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:26 smithi134 bash[130692]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-13T11:04:26.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.517+0000 7fafd0fd7700 1 -- 172.21.15.134:0/784333189 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fafcc02cc80 con 0x7fafcc101390 2024-04-13T11:04:26.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.517+0000 7fafbb7fe700 1 -- 172.21.15.134:0/784333189 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fafbc059d00 con 0x7fafcc101390 2024-04-13T11:04:26.518 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:04:26.518 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 1 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-04-13T11:04:26.519 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 5 2024-04-13T11:04:26.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:04:26.520 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:04:26.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.519+0000 7fafd0fd7700 1 -- 172.21.15.134:0/784333189 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 msgr2=0x7fafb406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:26.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.519+0000 7fafd0fd7700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 0x7fafb406f190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fafcc1007e0 tx=0x7fafc001a040 comp rx=0 tx=0).stop 2024-04-13T11:04:26.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.519+0000 7fafd0fd7700 1 -- 172.21.15.134:0/784333189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafcc101390 msgr2=0x7fafcc0feff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:26.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.519+0000 7fafd0fd7700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafcc101390 0x7fafcc0feff0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00d8d0 tx=0x7fafbc00dc90 comp rx=0 tx=0).stop 2024-04-13T11:04:26.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.520+0000 7fafd0fd7700 1 -- 172.21.15.134:0/784333189 shutdown_connections 2024-04-13T11:04:26.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.520+0000 7fafd0fd7700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fafb406cce0 0x7fafb406f190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.520+0000 7fafd0fd7700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafcc101390 0x7fafcc0feff0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.520+0000 7fafd0fd7700 1 --2- 172.21.15.134:0/784333189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc101ca0 0x7fafcc0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.520+0000 7fafd0fd7700 1 -- 172.21.15.134:0/784333189 >> 172.21.15.134:0/784333189 conn(0x7fafcc0fabb0 msgr2=0x7fafcc104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:26.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.520+0000 7fafd0fd7700 1 -- 172.21.15.134:0/784333189 shutdown_connections 2024-04-13T11:04:26.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.520+0000 7fafd0fd7700 1 -- 172.21.15.134:0/784333189 wait complete. 2024-04-13T11:04:26.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.627+0000 7fc7e2338700 1 -- 172.21.15.134:0/1312506774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7dc0ff320 msgr2=0x7fc7dc0ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:26.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.627+0000 7fc7e2338700 1 --2- 172.21.15.134:0/1312506774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7dc0ff320 0x7fc7dc0ff6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009940 tx=0x7fc7d0009c50 comp rx=0 tx=0).stop 2024-04-13T11:04:26.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.627+0000 7fc7e2338700 1 -- 172.21.15.134:0/1312506774 shutdown_connections 2024-04-13T11:04:26.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.627+0000 7fc7e2338700 1 --2- 172.21.15.134:0/1312506774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc0ffc30 0x7fc7dc10a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.627+0000 7fc7e2338700 1 --2- 172.21.15.134:0/1312506774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7dc0ff320 0x7fc7dc0ff6f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.627+0000 7fc7e2338700 1 -- 172.21.15.134:0/1312506774 >> 172.21.15.134:0/1312506774 conn(0x7fc7dc0748b0 msgr2=0x7fc7dc074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:26.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.627+0000 7fc7e2338700 1 -- 172.21.15.134:0/1312506774 shutdown_connections 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.627+0000 7fc7e2338700 1 -- 172.21.15.134:0/1312506774 wait complete. 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.627+0000 7fc7e2338700 1 Processor -- start 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.627+0000 7fc7e2338700 1 -- start start 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7e2338700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7dc0ff320 0x7fc7dc19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7e2338700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc0ffc30 0x7fc7dc19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7e2338700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc19c520 con 0x7fc7dc0ff320 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7e2338700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc1959d0 con 0x7fc7dc0ffc30 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7dc0ff320 0x7fc7dc19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7dc0ff320 0x7fc7dc19b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42520/0 (socket says 172.21.15.134:42520) 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7dbfff700 1 -- 172.21.15.134:0/3258492537 learned_addr learned my addr 172.21.15.134:0/3258492537 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7db7fe700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc0ffc30 0x7fc7dc19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7dbfff700 1 -- 172.21.15.134:0/3258492537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc0ffc30 msgr2=0x7fc7dc19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:26.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7dbfff700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc0ffc30 0x7fc7dc19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7dbfff700 1 -- 172.21.15.134:0/3258492537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d00095f0 con 0x7fc7dc0ff320 2024-04-13T11:04:26.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7dbfff700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7dc0ff320 0x7fc7dc19b950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00059d0 tx=0x7fc7d00056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:26.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7d97fa700 1 -- 172.21.15.134:0/3258492537 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7d001d070 con 0x7fc7dc0ff320 2024-04-13T11:04:26.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7e2338700 1 -- 172.21.15.134:0/3258492537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7dc195cb0 con 0x7fc7dc0ff320 2024-04-13T11:04:26.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7d97fa700 1 -- 172.21.15.134:0/3258492537 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc7d000be80 con 0x7fc7dc0ff320 2024-04-13T11:04:26.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7d97fa700 1 -- 172.21.15.134:0/3258492537 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7d0021410 con 0x7fc7dc0ff320 2024-04-13T11:04:26.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.628+0000 7fc7e2338700 1 -- 172.21.15.134:0/3258492537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7dc196200 con 0x7fc7dc0ff320 2024-04-13T11:04:26.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.629+0000 7fc7e2338700 1 -- 172.21.15.134:0/3258492537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7dc107da0 con 0x7fc7dc0ff320 2024-04-13T11:04:26.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.630+0000 7fc7d97fa700 1 -- 172.21.15.134:0/3258492537 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc7d000f460 con 0x7fc7dc0ff320 2024-04-13T11:04:26.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.631+0000 7fc7d97fa700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c406cce0 0x7fc7c406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:26.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.631+0000 7fc7d97fa700 1 -- 172.21.15.134:0/3258492537 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc7d008db80 con 0x7fc7dc0ff320 2024-04-13T11:04:26.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.631+0000 7fc7db7fe700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c406cce0 0x7fc7c406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:26.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.631+0000 7fc7db7fe700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c406cce0 0x7fc7c406f190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc005950 tx=0x7fc7cc0058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:26.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.634+0000 7fc7d97fa700 1 -- 172.21.15.134:0/3258492537 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fc7d005b780 con 0x7fc7dc0ff320 2024-04-13T11:04:26.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:26 smithi194 ceph-mon[83053]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:26.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.881+0000 7fc7e2338700 1 -- 172.21.15.134:0/3258492537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc7dc04ea50 con 0x7fc7dc0ff320 2024-04-13T11:04:26.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.882+0000 7fc7d97fa700 1 -- 172.21.15.134:0/3258492537 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1880 (secure 0 0 0) 0x7fc7d005b310 con 0x7fc7dc0ff320 2024-04-13T11:04:26.883 INFO:teuthology.orchestra.run.smithi134.stdout:e18 2024-04-13T11:04:26.883 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:04:26.883 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:04:26.883 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:04:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 18 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T10:55:58.861624+0000 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:04:26.884 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14492} 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:04:26.885 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:04:26.886 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:04:26.886 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:04:26.886 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:04:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:04:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:04:26.886 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:04:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:04:26.886 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:04:26.886 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:04:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 -- 172.21.15.134:0/3258492537 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c406cce0 msgr2=0x7fc7c406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c406cce0 0x7fc7c406f190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc005950 tx=0x7fc7cc0058e0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 -- 172.21.15.134:0/3258492537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7dc0ff320 msgr2=0x7fc7dc19b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7dc0ff320 0x7fc7dc19b950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00059d0 tx=0x7fc7d00056a0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 -- 172.21.15.134:0/3258492537 shutdown_connections 2024-04-13T11:04:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc7c406cce0 0x7fc7c406f190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7dc0ff320 0x7fc7dc19b950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 --2- 172.21.15.134:0/3258492537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7dc0ffc30 0x7fc7dc19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 -- 172.21.15.134:0/3258492537 >> 172.21.15.134:0/3258492537 conn(0x7fc7dc0748b0 msgr2=0x7fc7dc104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 -- 172.21.15.134:0/3258492537 shutdown_connections 2024-04-13T11:04:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.884+0000 7fc7e2338700 1 -- 172.21.15.134:0/3258492537 wait complete. 2024-04-13T11:04:26.888 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T11:04:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.998+0000 7f547a36d700 1 -- 172.21.15.134:0/3192817038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5474101c30 msgr2=0x7f547410a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.998+0000 7f547a36d700 1 --2- 172.21.15.134:0/3192817038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5474101c30 0x7f547410a130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5468009910 tx=0x7f5468009c20 comp rx=0 tx=0).stop 2024-04-13T11:04:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.999+0000 7f547a36d700 1 -- 172.21.15.134:0/3192817038 shutdown_connections 2024-04-13T11:04:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.999+0000 7f547a36d700 1 --2- 172.21.15.134:0/3192817038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5474101c30 0x7f547410a130 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.999+0000 7f547a36d700 1 --2- 172.21.15.134:0/3192817038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474101320 0x7f54741016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.999+0000 7f547a36d700 1 -- 172.21.15.134:0/3192817038 >> 172.21.15.134:0/3192817038 conn(0x7f54740fab80 msgr2=0x7f54740fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.999+0000 7f547a36d700 1 -- 172.21.15.134:0/3192817038 shutdown_connections 2024-04-13T11:04:27.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.999+0000 7f547a36d700 1 -- 172.21.15.134:0/3192817038 wait complete. 2024-04-13T11:04:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.999+0000 7f547a36d700 1 Processor -- start 2024-04-13T11:04:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:26.999+0000 7f547a36d700 1 -- start start 2024-04-13T11:04:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f547a36d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5474101320 0x7f547419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f547a36d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474101c30 0x7f547419bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f547a36d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547419c5f0 con 0x7f5474101320 2024-04-13T11:04:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f547a36d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5474195aa0 con 0x7f5474101c30 2024-04-13T11:04:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f5473fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5474101320 0x7f547419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:27.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f5473fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5474101320 0x7f547419ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42542/0 (socket says 172.21.15.134:42542) 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f5473fff700 1 -- 172.21.15.134:0/643092339 learned_addr learned my addr 172.21.15.134:0/643092339 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f54737fe700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474101c30 0x7f547419bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f5473fff700 1 -- 172.21.15.134:0/643092339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474101c30 msgr2=0x7f547419bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f5473fff700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474101c30 0x7f547419bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.000+0000 7f5473fff700 1 -- 172.21.15.134:0/643092339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54680095f0 con 0x7f5474101320 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.001+0000 7f5473fff700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5474101320 0x7f547419ba20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f546400c8a0 tx=0x7f546400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.001+0000 7f54717fa700 1 -- 172.21.15.134:0/643092339 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54640078e0 con 0x7f5474101320 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.001+0000 7f547a36d700 1 -- 172.21.15.134:0/643092339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5474195d80 con 0x7f5474101320 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.001+0000 7f54717fa700 1 -- 172.21.15.134:0/643092339 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f546400f450 con 0x7f5474101320 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.001+0000 7f54717fa700 1 -- 172.21.15.134:0/643092339 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f546400e5e0 con 0x7f5474101320 2024-04-13T11:04:27.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.001+0000 7f547a36d700 1 -- 172.21.15.134:0/643092339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54741962d0 con 0x7f5474101320 2024-04-13T11:04:27.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.002+0000 7f547a36d700 1 -- 172.21.15.134:0/643092339 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54741077a0 con 0x7f5474101320 2024-04-13T11:04:27.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.002+0000 7f54717fa700 1 -- 172.21.15.134:0/643092339 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f546400f5c0 con 0x7f5474101320 2024-04-13T11:04:27.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.003+0000 7f54717fa700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f545c06cce0 0x7f545c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:27.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.003+0000 7f54717fa700 1 -- 172.21.15.134:0/643092339 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f546408c170 con 0x7f5474101320 2024-04-13T11:04:27.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.003+0000 7f54737fe700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f545c06cce0 0x7f545c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:27.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.003+0000 7f54737fe700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f545c06cce0 0x7f545c06f190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54740fc330 tx=0x7f546801a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:27.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.012+0000 7f54717fa700 1 -- 172.21.15.134:0/643092339 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f5464059cd0 con 0x7f5474101320 2024-04-13T11:04:27.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.232+0000 7f547a36d700 1 -- 172.21.15.134:0/643092339 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54741965c0 con 0x7f545c06cce0 2024-04-13T11:04:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.234+0000 7f54717fa700 1 -- 172.21.15.134:0/643092339 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f54741965c0 con 0x7f545c06cce0 2024-04-13T11:04:27.235 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:04:27.235 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:04:27.235 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:04:27.235 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:04:27.235 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:04:27.235 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-04-13T11:04:27.235 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:04:27.235 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-04-13T11:04:27.235 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:04:27.236 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "7/23 daemons upgraded", 2024-04-13T11:04:27.236 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-04-13T11:04:27.236 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:04:27.236 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:04:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 -- 172.21.15.134:0/643092339 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f545c06cce0 msgr2=0x7f545c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f545c06cce0 0x7f545c06f190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54740fc330 tx=0x7f546801a040 comp rx=0 tx=0).stop 2024-04-13T11:04:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 -- 172.21.15.134:0/643092339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5474101320 msgr2=0x7f547419ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5474101320 0x7f547419ba20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f546400c8a0 tx=0x7f546400cbb0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 -- 172.21.15.134:0/643092339 shutdown_connections 2024-04-13T11:04:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f545c06cce0 0x7f545c06f190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5474101320 0x7f547419ba20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 --2- 172.21.15.134:0/643092339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5474101c30 0x7f547419bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 -- 172.21.15.134:0/643092339 >> 172.21.15.134:0/643092339 conn(0x7f54740fab80 msgr2=0x7f54741048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 -- 172.21.15.134:0/643092339 shutdown_connections 2024-04-13T11:04:27.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.236+0000 7f547a36d700 1 -- 172.21.15.134:0/643092339 wait complete. 2024-04-13T11:04:27.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.343+0000 7fd834799700 1 -- 172.21.15.134:0/3174340274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c0ff320 msgr2=0x7fd82c0ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:27.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.343+0000 7fd834799700 1 --2- 172.21.15.134:0/3174340274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c0ff320 0x7fd82c0ff6f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd828009940 tx=0x7fd828009c50 comp rx=0 tx=0).stop 2024-04-13T11:04:27.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 -- 172.21.15.134:0/3174340274 shutdown_connections 2024-04-13T11:04:27.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 --2- 172.21.15.134:0/3174340274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c0ffc30 0x7fd82c10a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 --2- 172.21.15.134:0/3174340274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c0ff320 0x7fd82c0ff6f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 -- 172.21.15.134:0/3174340274 >> 172.21.15.134:0/3174340274 conn(0x7fd82c0748b0 msgr2=0x7fd82c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:27.346 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 -- 172.21.15.134:0/3174340274 shutdown_connections 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 -- 172.21.15.134:0/3174340274 wait complete. 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 Processor -- start 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 -- start start 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c0ff320 0x7fd82c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c0ffc30 0x7fd82c19bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c19c5b0 con 0x7fd82c0ffc30 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd834799700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c195a60 con 0x7fd82c0ff320 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.344+0000 7fd831d34700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c0ffc30 0x7fd82c19bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd831d34700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c0ffc30 0x7fd82c19bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42552/0 (socket says 172.21.15.134:42552) 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd831d34700 1 -- 172.21.15.134:0/340076003 learned_addr learned my addr 172.21.15.134:0/340076003 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd832535700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c0ff320 0x7fd82c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd831d34700 1 -- 172.21.15.134:0/340076003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c0ff320 msgr2=0x7fd82c19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:27.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd831d34700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c0ff320 0x7fd82c19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd831d34700 1 -- 172.21.15.134:0/340076003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280095f0 con 0x7fd82c0ffc30 2024-04-13T11:04:27.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd831d34700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c0ffc30 0x7fd82c19bf20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00c8a0 tx=0x7fd81c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:27.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd8237fe700 1 -- 172.21.15.134:0/340076003 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd81c0078e0 con 0x7fd82c0ffc30 2024-04-13T11:04:27.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd834799700 1 -- 172.21.15.134:0/340076003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c195d40 con 0x7fd82c0ffc30 2024-04-13T11:04:27.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd8237fe700 1 -- 172.21.15.134:0/340076003 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd81c00f450 con 0x7fd82c0ffc30 2024-04-13T11:04:27.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd8237fe700 1 -- 172.21.15.134:0/340076003 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd81c00e5e0 con 0x7fd82c0ffc30 2024-04-13T11:04:27.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.345+0000 7fd834799700 1 -- 172.21.15.134:0/340076003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c196290 con 0x7fd82c0ffc30 2024-04-13T11:04:27.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.346+0000 7fd834799700 1 -- 172.21.15.134:0/340076003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c107da0 con 0x7fd82c0ffc30 2024-04-13T11:04:27.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.346+0000 7fd8237fe700 1 -- 172.21.15.134:0/340076003 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd81c00f5c0 con 0x7fd82c0ffc30 2024-04-13T11:04:27.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.347+0000 7fd8237fe700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd81806cce0 0x7fd81806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:27.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.347+0000 7fd832535700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd81806cce0 0x7fd81806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:27.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.347+0000 7fd8237fe700 1 -- 172.21.15.134:0/340076003 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd81c08c0d0 con 0x7fd82c0ffc30 2024-04-13T11:04:27.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.347+0000 7fd832535700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd81806cce0 0x7fd81806f190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8280059d0 tx=0x7fd828005960 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:27.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.351+0000 7fd8237fe700 1 -- 172.21.15.134:0/340076003 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fd81c059cd0 con 0x7fd82c0ffc30 2024-04-13T11:04:27.584 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:27 smithi134 ceph-osd[131150]: -- 172.21.15.134:0/2476680847 <== mon.0 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561ea04271e0 con 0x561ea03f6c00 2024-04-13T11:04:27.584 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:27 smithi134 ceph-mon[112184]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:27.584 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:27 smithi134 ceph-mon[112184]: pgmap v154: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 33/267 objects degraded (12.360%) 2024-04-13T11:04:27.584 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:27 smithi134 ceph-mon[112184]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:27.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:27 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/784333189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:27.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:27 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3258492537' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:04:27.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.641+0000 7fd834799700 1 -- 172.21.15.134:0/340076003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd82c196510 con 0x7fd82c0ffc30 2024-04-13T11:04:27.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.641+0000 7fd8237fe700 1 -- 172.21.15.134:0/340076003 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1071 (secure 0 0 0) 0x7fd81c059860 con 0x7fd82c0ffc30 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 33/267 objects degraded (12.360%), 11 pgs degraded 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout: osd.1 (root=default,host=smithi134) is down 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 33/267 objects degraded (12.360%), 11 pgs degraded 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-04-13T11:04:27.643 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-04-13T11:04:27.644 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-04-13T11:04:27.644 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-04-13T11:04:27.644 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-04-13T11:04:27.644 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-04-13T11:04:27.644 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-04-13T11:04:27.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.643+0000 7fd834799700 1 -- 172.21.15.134:0/340076003 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd81806cce0 msgr2=0x7fd81806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.644+0000 7fd834799700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd81806cce0 0x7fd81806f190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8280059d0 tx=0x7fd828005960 comp rx=0 tx=0).stop 2024-04-13T11:04:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.644+0000 7fd834799700 1 -- 172.21.15.134:0/340076003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c0ffc30 msgr2=0x7fd82c19bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.644+0000 7fd834799700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c0ffc30 0x7fd82c19bf20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00c8a0 tx=0x7fd81c00cbb0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.644+0000 7fd834799700 1 -- 172.21.15.134:0/340076003 shutdown_connections 2024-04-13T11:04:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.644+0000 7fd834799700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd81806cce0 0x7fd81806f190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.644+0000 7fd834799700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c0ff320 0x7fd82c19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.644+0000 7fd834799700 1 --2- 172.21.15.134:0/340076003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c0ffc30 0x7fd82c19bf20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.644+0000 7fd834799700 1 -- 172.21.15.134:0/340076003 >> 172.21.15.134:0/340076003 conn(0x7fd82c0748b0 msgr2=0x7fd82c104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.644+0000 7fd834799700 1 -- 172.21.15.134:0/340076003 shutdown_connections 2024-04-13T11:04:27.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:27.644+0000 7fd834799700 1 -- 172.21.15.134:0/340076003 wait complete. 2024-04-13T11:04:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:27 smithi194 ceph-mon[83053]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:27 smithi194 ceph-mon[83053]: pgmap v154: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 33/267 objects degraded (12.360%) 2024-04-13T11:04:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:27 smithi194 ceph-mon[83053]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:27 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/784333189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:27 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3258492537' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:04:27.934 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:27 smithi134 bash[131080]: fc8474d8910fd1202d8154e862b1595af809a08428ad9490ee6f1a625ee7d3d7 2024-04-13T11:04:27.935 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:27 smithi134 systemd[1]: Started Ceph osd.1 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:04:28.376 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:27 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1[131107]: 2024-04-13T11:04:27.993+0000 7feb99e7c7c0 -1 Falling back to public interface 2024-04-13T11:04:28.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:28 smithi134 ceph-mon[112184]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:28.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:28 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:28.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:28 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:28.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:28 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/340076003' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:04:28.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:28 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:04:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:28 smithi194 ceph-mon[83053]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:28 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:28 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:28 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/340076003' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:04:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:28 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:04:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:29 smithi134 ceph-mon[112184]: pgmap v155: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:29.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:29 smithi194 ceph-mon[83053]: pgmap v155: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:31.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:31 smithi134 ceph-mon[112184]: pgmap v156: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:31 smithi194 ceph-mon[83053]: pgmap v156: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:32.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:32 smithi134 ceph-mon[112184]: Health check update: Degraded data redundancy: 35/267 objects degraded (13.109%), 13 pgs degraded (PG_DEGRADED) 2024-04-13T11:04:32.932 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:32 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1[131107]: 2024-04-13T11:04:32.508+0000 7feb99e7c7c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-04-13T11:04:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:32 smithi194 ceph-mon[83053]: Health check update: Degraded data redundancy: 35/267 objects degraded (13.109%), 13 pgs degraded (PG_DEGRADED) 2024-04-13T11:04:33.184 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:32 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1[131107]: 2024-04-13T11:04:32.930+0000 7feb99e7c7c0 -1 osd.1 53 log_to_monitors true 2024-04-13T11:04:33.934 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:04:33 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1[131107]: 2024-04-13T11:04:33.663+0000 7feb8b2d6700 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T11:04:33.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:33 smithi134 ceph-mon[112184]: pgmap v157: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:33.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:33 smithi134 ceph-mon[112184]: from='osd.1 [v2:172.21.15.134:6810/1751594116,v1:172.21.15.134:6811/1751594116]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-13T11:04:33.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:33.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:33 smithi194 ceph-mon[83053]: pgmap v157: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 257 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:33 smithi194 ceph-mon[83053]: from='osd.1 [v2:172.21.15.134:6810/1751594116,v1:172.21.15.134:6811/1751594116]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-13T11:04:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:34.899 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:34 smithi134 ceph-mon[112184]: from='osd.1 [v2:172.21.15.134:6810/1751594116,v1:172.21.15.134:6811/1751594116]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-13T11:04:34.899 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:34 smithi134 ceph-mon[112184]: osdmap e56: 6 total, 5 up, 6 in 2024-04-13T11:04:34.899 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:34 smithi134 ceph-mon[112184]: from='osd.1 [v2:172.21.15.134:6810/1751594116,v1:172.21.15.134:6811/1751594116]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T11:04:34.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:34 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:34.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:34 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:34 smithi194 ceph-mon[83053]: from='osd.1 [v2:172.21.15.134:6810/1751594116,v1:172.21.15.134:6811/1751594116]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-13T11:04:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:34 smithi194 ceph-mon[83053]: osdmap e56: 6 total, 5 up, 6 in 2024-04-13T11:04:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:34 smithi194 ceph-mon[83053]: from='osd.1 [v2:172.21.15.134:6810/1751594116,v1:172.21.15.134:6811/1751594116]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T11:04:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:34 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:34 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:35.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:35 smithi134 ceph-mon[112184]: pgmap v159: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:35 smithi134 ceph-mon[112184]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:04:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:35 smithi134 ceph-mon[112184]: osd.1 [v2:172.21.15.134:6810/1751594116,v1:172.21.15.134:6811/1751594116] boot 2024-04-13T11:04:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:35 smithi134 ceph-mon[112184]: osdmap e57: 6 total, 6 up, 6 in 2024-04-13T11:04:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:35 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T11:04:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:35 smithi194 ceph-mon[83053]: pgmap v159: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:35 smithi194 ceph-mon[83053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:04:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:35 smithi194 ceph-mon[83053]: osd.1 [v2:172.21.15.134:6810/1751594116,v1:172.21.15.134:6811/1751594116] boot 2024-04-13T11:04:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:35 smithi194 ceph-mon[83053]: osdmap e57: 6 total, 6 up, 6 in 2024-04-13T11:04:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:35 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-13T11:04:36.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:36 smithi134 ceph-mon[112184]: osdmap e58: 6 total, 6 up, 6 in 2024-04-13T11:04:36.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:36 smithi194 ceph-mon[83053]: osdmap e58: 6 total, 6 up, 6 in 2024-04-13T11:04:37.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:37 smithi134 ceph-mon[112184]: pgmap v162: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:37 smithi194 ceph-mon[83053]: pgmap v162: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: pgmap v163: 65 pgs: 13 active+undersized+degraded, 19 active+undersized, 33 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-13T11:04:39.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:38 smithi194 ceph-mon[83053]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-13T11:04:39.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: pgmap v163: 65 pgs: 13 active+undersized+degraded, 19 active+undersized, 33 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:04:39.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-13T11:04:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:38 smithi134 ceph-mon[112184]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-13T11:04:40.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:39 smithi134 ceph-mon[112184]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/267 objects degraded (13.109%), 13 pgs degraded) 2024-04-13T11:04:40.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:39 smithi194 ceph-mon[83053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/267 objects degraded (13.109%), 13 pgs degraded) 2024-04-13T11:04:41.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:40 smithi134 ceph-mon[112184]: pgmap v164: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-13T11:04:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:41 smithi194 ceph-mon[83053]: pgmap v164: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-13T11:04:43.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:43 smithi134 ceph-mon[112184]: pgmap v165: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-13T11:04:43.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:43 smithi194 ceph-mon[83053]: pgmap v165: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-13T11:04:45.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:45 smithi134 ceph-mon[112184]: pgmap v166: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-13T11:04:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:45 smithi194 ceph-mon[83053]: pgmap v166: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-13T11:04:47.373 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:47 smithi134 ceph-mon[112184]: pgmap v167: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 996 B/s rd, 1 op/s 2024-04-13T11:04:47.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:47 smithi194 ceph-mon[83053]: pgmap v167: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 996 B/s rd, 1 op/s 2024-04-13T11:04:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:49 smithi194 ceph-mon[83053]: pgmap v168: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:49.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:49 smithi134 ceph-mon[112184]: pgmap v168: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:49.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:51.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:51 smithi134 ceph-mon[112184]: pgmap v169: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:04:51.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:51 smithi194 ceph-mon[83053]: pgmap v169: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:04:53.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:53 smithi134 ceph-mon[112184]: pgmap v170: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:53.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:53.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:04:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:53 smithi194 ceph-mon[83053]: pgmap v170: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:04:54.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:54 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-13T11:04:54.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:54 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-13T11:04:54.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:54 smithi194 ceph-mon[83053]: Upgrade: osd.2 is safe to restart 2024-04-13T11:04:54.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:54 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-13T11:04:54.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:54 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-13T11:04:54.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:54 smithi134 ceph-mon[112184]: Upgrade: osd.2 is safe to restart 2024-04-13T11:04:55.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:55 smithi134 ceph-mon[112184]: pgmap v171: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:04:55.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:55 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:55.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:55 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-13T11:04:55.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:55 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:04:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:55 smithi194 ceph-mon[83053]: pgmap v171: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:04:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:55 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:04:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:55 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-13T11:04:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:55 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:04:56.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:56 smithi134 ceph-mon[112184]: Upgrade: Updating osd.2 2024-04-13T11:04:56.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:56 smithi134 ceph-mon[112184]: Deploying daemon osd.2 on smithi134 2024-04-13T11:04:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:56 smithi194 ceph-mon[83053]: Upgrade: Updating osd.2 2024-04-13T11:04:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:56 smithi194 ceph-mon[83053]: Deploying daemon osd.2 on smithi134 2024-04-13T11:04:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:57 smithi134 ceph-mon[112184]: pgmap v172: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:57 smithi194 ceph-mon[83053]: pgmap v172: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:57.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.753+0000 7fab33c01700 1 -- 172.21.15.134:0/807995028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2c103860 msgr2=0x7fab2c103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.753+0000 7fab33c01700 1 --2- 172.21.15.134:0/807995028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2c103860 0x7fab2c103c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fab2800aa20 tx=0x7fab2800ad30 comp rx=0 tx=0).stop 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.753+0000 7fab33c01700 1 -- 172.21.15.134:0/807995028 shutdown_connections 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.753+0000 7fab33c01700 1 --2- 172.21.15.134:0/807995028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab2c0ff320 0x7fab2c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.753+0000 7fab33c01700 1 --2- 172.21.15.134:0/807995028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2c103860 0x7fab2c103c30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.753+0000 7fab33c01700 1 -- 172.21.15.134:0/807995028 >> 172.21.15.134:0/807995028 conn(0x7fab2c0748b0 msgr2=0x7fab2c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.753+0000 7fab33c01700 1 -- 172.21.15.134:0/807995028 shutdown_connections 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.753+0000 7fab33c01700 1 -- 172.21.15.134:0/807995028 wait complete. 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab33c01700 1 Processor -- start 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab33c01700 1 -- start start 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab33c01700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab2c0ff320 0x7fab2c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:57.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab33c01700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2c103860 0x7fab2c19bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab33c01700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c1959f0 con 0x7fab2c103860 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab33c01700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c195b60 con 0x7fab2c0ff320 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab3119c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2c103860 0x7fab2c19bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab3119c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2c103860 0x7fab2c19bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37550/0 (socket says 172.21.15.134:37550) 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab3119c700 1 -- 172.21.15.134:0/4097123232 learned_addr learned my addr 172.21.15.134:0/4097123232 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab3199d700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab2c0ff320 0x7fab2c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab3119c700 1 -- 172.21.15.134:0/4097123232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab2c0ff320 msgr2=0x7fab2c19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab3119c700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab2c0ff320 0x7fab2c19ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab3119c700 1 -- 172.21.15.134:0/4097123232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2800a700 con 0x7fab2c103860 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.754+0000 7fab3119c700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2c103860 0x7fab2c19bf40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00d8d0 tx=0x7fab1c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.755+0000 7fab22ffd700 1 -- 172.21.15.134:0/4097123232 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab1c0098a0 con 0x7fab2c103860 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.755+0000 7fab33c01700 1 -- 172.21.15.134:0/4097123232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c195e40 con 0x7fab2c103860 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.755+0000 7fab22ffd700 1 -- 172.21.15.134:0/4097123232 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab1c010460 con 0x7fab2c103860 2024-04-13T11:04:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.755+0000 7fab22ffd700 1 -- 172.21.15.134:0/4097123232 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab1c009ea0 con 0x7fab2c103860 2024-04-13T11:04:57.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.755+0000 7fab33c01700 1 -- 172.21.15.134:0/4097123232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2c196410 con 0x7fab2c103860 2024-04-13T11:04:57.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.756+0000 7fab33c01700 1 -- 172.21.15.134:0/4097123232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2c106e00 con 0x7fab2c103860 2024-04-13T11:04:57.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.757+0000 7fab22ffd700 1 -- 172.21.15.134:0/4097123232 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fab1c0105d0 con 0x7fab2c103860 2024-04-13T11:04:57.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.758+0000 7fab22ffd700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab1806cce0 0x7fab1806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:57.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.758+0000 7fab22ffd700 1 -- 172.21.15.134:0/4097123232 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fab1c08c390 con 0x7fab2c103860 2024-04-13T11:04:57.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.758+0000 7fab3199d700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab1806cce0 0x7fab1806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:57.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.758+0000 7fab3199d700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab1806cce0 0x7fab1806f190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab2800afd0 tx=0x7fab28005a90 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:57.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.761+0000 7fab22ffd700 1 -- 172.21.15.134:0/4097123232 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fab1c056630 con 0x7fab2c103860 2024-04-13T11:04:57.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.979+0000 7fab33c01700 1 -- 172.21.15.134:0/4097123232 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab2c10aff0 con 0x7fab1806cce0 2024-04-13T11:04:57.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.980+0000 7fab22ffd700 1 -- 172.21.15.134:0/4097123232 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fab2c10aff0 con 0x7fab1806cce0 2024-04-13T11:04:57.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 -- 172.21.15.134:0/4097123232 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab1806cce0 msgr2=0x7fab1806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:57.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab1806cce0 0x7fab1806f190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab2800afd0 tx=0x7fab28005a90 comp rx=0 tx=0).stop 2024-04-13T11:04:57.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 -- 172.21.15.134:0/4097123232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2c103860 msgr2=0x7fab2c19bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:57.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2c103860 0x7fab2c19bf40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00d8d0 tx=0x7fab1c00dbe0 comp rx=0 tx=0).stop 2024-04-13T11:04:57.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 -- 172.21.15.134:0/4097123232 shutdown_connections 2024-04-13T11:04:57.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab1806cce0 0x7fab1806f190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:57.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab2c0ff320 0x7fab2c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:57.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 --2- 172.21.15.134:0/4097123232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2c103860 0x7fab2c19bf40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:57.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 -- 172.21.15.134:0/4097123232 >> 172.21.15.134:0/4097123232 conn(0x7fab2c0748b0 msgr2=0x7fab2c0fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:57.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 -- 172.21.15.134:0/4097123232 shutdown_connections 2024-04-13T11:04:57.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:57.982+0000 7fab33c01700 1 -- 172.21.15.134:0/4097123232 wait complete. 2024-04-13T11:04:57.994 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:04:58.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.088+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/3815321493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b280ffc60 msgr2=0x7f1b28103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:58.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.088+0000 7f1b2cfd4700 1 --2- 172.21.15.134:0/3815321493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b280ffc60 0x7f1b28103c30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009910 tx=0x7f1b18009c20 comp rx=0 tx=0).stop 2024-04-13T11:04:58.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.088+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/3815321493 shutdown_connections 2024-04-13T11:04:58.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.088+0000 7f1b2cfd4700 1 --2- 172.21.15.134:0/3815321493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b280ffc60 0x7f1b28103c30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.088+0000 7f1b2cfd4700 1 --2- 172.21.15.134:0/3815321493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b280ff2c0 0x7f1b280ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.088+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/3815321493 >> 172.21.15.134:0/3815321493 conn(0x7f1b280fab80 msgr2=0x7f1b280fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:58.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.088+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/3815321493 shutdown_connections 2024-04-13T11:04:58.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.088+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/3815321493 wait complete. 2024-04-13T11:04:58.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.089+0000 7f1b2cfd4700 1 Processor -- start 2024-04-13T11:04:58.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.089+0000 7f1b2cfd4700 1 -- start start 2024-04-13T11:04:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.089+0000 7f1b2cfd4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b280ff2c0 0x7f1b2819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.089+0000 7f1b2cfd4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b280ffc60 0x7f1b2819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.089+0000 7f1b2cfd4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2819b520 con 0x7f1b280ffc60 2024-04-13T11:04:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.089+0000 7f1b2cfd4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b281949d0 con 0x7f1b280ff2c0 2024-04-13T11:04:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b25d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b280ffc60 0x7f1b2819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b25d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b280ffc60 0x7f1b2819ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37578/0 (socket says 172.21.15.134:37578) 2024-04-13T11:04:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b25d9b700 1 -- 172.21.15.134:0/992713566 learned_addr learned my addr 172.21.15.134:0/992713566 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b2659c700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b280ff2c0 0x7f1b2819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:58.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b25d9b700 1 -- 172.21.15.134:0/992713566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b280ff2c0 msgr2=0x7f1b2819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b25d9b700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b280ff2c0 0x7f1b2819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b25d9b700 1 -- 172.21.15.134:0/992713566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b180095f0 con 0x7f1b280ffc60 2024-04-13T11:04:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b25d9b700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b280ffc60 0x7f1b2819ae90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b180092e0 tx=0x7f1b1800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b1f7fe700 1 -- 172.21.15.134:0/992713566 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b1801f070 con 0x7f1b280ffc60 2024-04-13T11:04:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b1f7fe700 1 -- 172.21.15.134:0/992713566 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b18005940 con 0x7f1b280ffc60 2024-04-13T11:04:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/992713566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b28194c50 con 0x7f1b280ffc60 2024-04-13T11:04:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b1f7fe700 1 -- 172.21.15.134:0/992713566 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b1800f460 con 0x7f1b280ffc60 2024-04-13T11:04:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.090+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/992713566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b28195140 con 0x7f1b280ffc60 2024-04-13T11:04:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.091+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/992713566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2804ea50 con 0x7f1b280ffc60 2024-04-13T11:04:58.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.092+0000 7f1b1f7fe700 1 -- 172.21.15.134:0/992713566 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1b1800f690 con 0x7f1b280ffc60 2024-04-13T11:04:58.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.092+0000 7f1b1f7fe700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b1406cce0 0x7f1b1406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:58.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.092+0000 7f1b1f7fe700 1 -- 172.21.15.134:0/992713566 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1b1808f8b0 con 0x7f1b280ffc60 2024-04-13T11:04:58.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.092+0000 7f1b2659c700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b1406cce0 0x7f1b1406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:58.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.092+0000 7f1b2659c700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b1406cce0 0x7f1b1406f190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b10005950 tx=0x7f1b100058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:58.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.096+0000 7f1b1f7fe700 1 -- 172.21.15.134:0/992713566 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f1b1805d4b0 con 0x7f1b280ffc60 2024-04-13T11:04:58.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.319+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/992713566 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b281955b0 con 0x7f1b1406cce0 2024-04-13T11:04:58.321 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.321+0000 7f1b1f7fe700 1 -- 172.21.15.134:0/992713566 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1b281955b0 con 0x7f1b1406cce0 2024-04-13T11:04:58.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/992713566 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b1406cce0 msgr2=0x7f1b1406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:58.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b1406cce0 0x7f1b1406f190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b10005950 tx=0x7f1b100058e0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/992713566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b280ffc60 msgr2=0x7f1b2819ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:58.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b280ffc60 0x7f1b2819ae90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b180092e0 tx=0x7f1b1800be20 comp rx=0 tx=0).stop 2024-04-13T11:04:58.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/992713566 shutdown_connections 2024-04-13T11:04:58.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1b1406cce0 0x7f1b1406f190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b280ff2c0 0x7f1b2819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 --2- 172.21.15.134:0/992713566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b280ffc60 0x7f1b2819ae90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/992713566 >> 172.21.15.134:0/992713566 conn(0x7f1b280fab80 msgr2=0x7f1b280fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:58.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/992713566 shutdown_connections 2024-04-13T11:04:58.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.323+0000 7f1b2cfd4700 1 -- 172.21.15.134:0/992713566 wait complete. 2024-04-13T11:04:58.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.429+0000 7f2f46808700 1 -- 172.21.15.134:0/1584080098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f401003b0 msgr2=0x7f2f40100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:58.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.429+0000 7f2f46808700 1 --2- 172.21.15.134:0/1584080098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f401003b0 0x7f2f40100780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009910 tx=0x7f2f30009c20 comp rx=0 tx=0).stop 2024-04-13T11:04:58.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.429+0000 7f2f46808700 1 -- 172.21.15.134:0/1584080098 shutdown_connections 2024-04-13T11:04:58.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.429+0000 7f2f46808700 1 --2- 172.21.15.134:0/1584080098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f40100d50 0x7f2f40104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.429+0000 7f2f46808700 1 --2- 172.21.15.134:0/1584080098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f401003b0 0x7f2f40100780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.429+0000 7f2f46808700 1 -- 172.21.15.134:0/1584080098 >> 172.21.15.134:0/1584080098 conn(0x7f2f400fbc30 msgr2=0x7f2f400fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:58.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.429+0000 7f2f46808700 1 -- 172.21.15.134:0/1584080098 shutdown_connections 2024-04-13T11:04:58.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.429+0000 7f2f46808700 1 -- 172.21.15.134:0/1584080098 wait complete. 2024-04-13T11:04:58.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.430+0000 7f2f46808700 1 Processor -- start 2024-04-13T11:04:58.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.430+0000 7f2f46808700 1 -- start start 2024-04-13T11:04:58.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.430+0000 7f2f46808700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f401003b0 0x7f2f40197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:58.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.430+0000 7f2f46808700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f40100d50 0x7f2f401984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:58.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.430+0000 7f2f46808700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40198b90 con 0x7f2f40100d50 2024-04-13T11:04:58.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.430+0000 7f2f46808700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4019c920 con 0x7f2f401003b0 2024-04-13T11:04:58.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.430+0000 7f2f3f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f40100d50 0x7f2f401984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:58.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.430+0000 7f2f3f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f40100d50 0x7f2f401984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37590/0 (socket says 172.21.15.134:37590) 2024-04-13T11:04:58.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.430+0000 7f2f3f7fe700 1 -- 172.21.15.134:0/1069339439 learned_addr learned my addr 172.21.15.134:0/1069339439 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:58.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.431+0000 7f2f3ffff700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f401003b0 0x7f2f40197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:58.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.431+0000 7f2f3f7fe700 1 -- 172.21.15.134:0/1069339439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f401003b0 msgr2=0x7f2f40197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:58.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.431+0000 7f2f3f7fe700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f401003b0 0x7f2f40197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.431+0000 7f2f3f7fe700 1 -- 172.21.15.134:0/1069339439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f300095f0 con 0x7f2f40100d50 2024-04-13T11:04:58.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.431+0000 7f2f3f7fe700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f40100d50 0x7f2f401984b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400b480 tx=0x7f2f3400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:58.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.431+0000 7f2f3d7fa700 1 -- 172.21.15.134:0/1069339439 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f34011800 con 0x7f2f40100d50 2024-04-13T11:04:58.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.431+0000 7f2f46808700 1 -- 172.21.15.134:0/1069339439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4019cc00 con 0x7f2f40100d50 2024-04-13T11:04:58.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.431+0000 7f2f46808700 1 -- 172.21.15.134:0/1069339439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4019d150 con 0x7f2f40100d50 2024-04-13T11:04:58.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.432+0000 7f2f3d7fa700 1 -- 172.21.15.134:0/1069339439 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f34011e00 con 0x7f2f40100d50 2024-04-13T11:04:58.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.432+0000 7f2f3d7fa700 1 -- 172.21.15.134:0/1069339439 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f34010e30 con 0x7f2f40100d50 2024-04-13T11:04:58.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.432+0000 7f2f46808700 1 -- 172.21.15.134:0/1069339439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f401044a0 con 0x7f2f40100d50 2024-04-13T11:04:58.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.433+0000 7f2f3d7fa700 1 -- 172.21.15.134:0/1069339439 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2f3401a460 con 0x7f2f40100d50 2024-04-13T11:04:58.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.433+0000 7f2f3d7fa700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f2806cce0 0x7f2f2806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:58.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.433+0000 7f2f3d7fa700 1 -- 172.21.15.134:0/1069339439 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2f3408cee0 con 0x7f2f40100d50 2024-04-13T11:04:58.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.433+0000 7f2f3ffff700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f2806cce0 0x7f2f2806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:58.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.434+0000 7f2f3ffff700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f2806cce0 0x7f2f2806f190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f30006010 tx=0x7f2f3001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:58.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.445+0000 7f2f3d7fa700 1 -- 172.21.15.134:0/1069339439 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f2f340570d0 con 0x7f2f40100d50 2024-04-13T11:04:58.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.712+0000 7f2f46808700 1 -- 172.21.15.134:0/1069339439 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f4019d530 con 0x7f2f2806cce0 2024-04-13T11:04:58.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.723+0000 7f2f3d7fa700 1 -- 172.21.15.134:0/1069339439 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f2f4019d530 con 0x7f2f2806cce0 2024-04-13T11:04:58.724 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:04:58.724 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (3m) 25s ago 15m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:04:58.724 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (15m) 25s ago 15m 8254k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:04:58.724 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (14m) 85s ago 14m 7796k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:04:58.724 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (94s) 25s ago 15m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:04:58.724 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (89s) 85s ago 14m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (3m) 25s ago 14m 81.5M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (9m) 25s ago 9m 90.0M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (9m) 25s ago 9m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (9m) 85s ago 9m 16.1M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (9m) 85s ago 9m 19.6M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (6m) 25s ago 16m 506M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (4m) 85s ago 14m 452M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (2m) 25s ago 16m 44.2M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (109s) 85s ago 14m 28.7M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 25s ago 15m 18.8M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (4m) 85s ago 14m 16.6M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:04:58.725 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (68s) 25s ago 13m 91.3M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:04:58.726 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (31s) 25s ago 12m 13.9M 1227M 18.2.2-1173-g5108bc67 3464fd31103e fc8474d8910f 2024-04-13T11:04:58.726 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (12m) 25s ago 12m 189M 1227M 18.2.0 dc2bc1663786 f5e6f27150a8 2024-04-13T11:04:58.726 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (11m) 85s ago 11m 257M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T11:04:58.726 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (11m) 85s ago 11m 215M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:04:58.726 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (10m) 85s ago 10m 219M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:04:58.726 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (4m) 25s ago 14m 66.5M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:04:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.725+0000 7f2f46808700 1 -- 172.21.15.134:0/1069339439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f2806cce0 msgr2=0x7f2f2806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.725+0000 7f2f46808700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f2806cce0 0x7f2f2806f190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f30006010 tx=0x7f2f3001a040 comp rx=0 tx=0).stop 2024-04-13T11:04:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.725+0000 7f2f46808700 1 -- 172.21.15.134:0/1069339439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f40100d50 msgr2=0x7f2f401984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.725+0000 7f2f46808700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f40100d50 0x7f2f401984b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400b480 tx=0x7f2f3400b790 comp rx=0 tx=0).stop 2024-04-13T11:04:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.726+0000 7f2f46808700 1 -- 172.21.15.134:0/1069339439 shutdown_connections 2024-04-13T11:04:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.726+0000 7f2f46808700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f2806cce0 0x7f2f2806f190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.726+0000 7f2f46808700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f401003b0 0x7f2f40197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.726+0000 7f2f46808700 1 --2- 172.21.15.134:0/1069339439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f40100d50 0x7f2f401984b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.726+0000 7f2f46808700 1 -- 172.21.15.134:0/1069339439 >> 172.21.15.134:0/1069339439 conn(0x7f2f400fbc30 msgr2=0x7f2f400fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.726+0000 7f2f46808700 1 -- 172.21.15.134:0/1069339439 shutdown_connections 2024-04-13T11:04:58.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.726+0000 7f2f46808700 1 -- 172.21.15.134:0/1069339439 wait complete. 2024-04-13T11:04:58.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.831+0000 7f2980c33700 1 -- 172.21.15.134:0/2590447602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f297c0ffd30 msgr2=0x7f297c103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:58.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.831+0000 7f2980c33700 1 --2- 172.21.15.134:0/2590447602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f297c0ffd30 0x7f297c103ce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2970009910 tx=0x7f2970009c20 comp rx=0 tx=0).stop 2024-04-13T11:04:58.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.832+0000 7f2980c33700 1 -- 172.21.15.134:0/2590447602 shutdown_connections 2024-04-13T11:04:58.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.832+0000 7f2980c33700 1 --2- 172.21.15.134:0/2590447602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f297c0ffd30 0x7f297c103ce0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.832+0000 7f2980c33700 1 --2- 172.21.15.134:0/2590447602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f297c0ff390 0x7f297c0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.832+0000 7f2980c33700 1 -- 172.21.15.134:0/2590447602 >> 172.21.15.134:0/2590447602 conn(0x7f297c074f50 msgr2=0x7f297c075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:58.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.832+0000 7f2980c33700 1 -- 172.21.15.134:0/2590447602 shutdown_connections 2024-04-13T11:04:58.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.832+0000 7f2980c33700 1 -- 172.21.15.134:0/2590447602 wait complete. 2024-04-13T11:04:58.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2980c33700 1 Processor -- start 2024-04-13T11:04:58.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2980c33700 1 -- start start 2024-04-13T11:04:58.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2980c33700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f297c0ff390 0x7f297c196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:58.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2980c33700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f297c0ffd30 0x7f297c196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:58.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2980c33700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c1975b0 con 0x7f297c0ffd30 2024-04-13T11:04:58.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2980c33700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c1976f0 con 0x7f297c0ff390 2024-04-13T11:04:58.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2979d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f297c0ffd30 0x7f297c196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:58.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2979d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f297c0ffd30 0x7f297c196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37616/0 (socket says 172.21.15.134:37616) 2024-04-13T11:04:58.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2979d9b700 1 -- 172.21.15.134:0/3590045561 learned_addr learned my addr 172.21.15.134:0/3590045561 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:58.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f297a59c700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f297c0ff390 0x7f297c196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:58.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2979d9b700 1 -- 172.21.15.134:0/3590045561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f297c0ff390 msgr2=0x7f297c196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:58.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2979d9b700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f297c0ff390 0x7f297c196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:58.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.833+0000 7f2979d9b700 1 -- 172.21.15.134:0/3590045561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700095f0 con 0x7f297c0ffd30 2024-04-13T11:04:58.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.834+0000 7f2979d9b700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f297c0ffd30 0x7f297c196fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29700092e0 tx=0x7f297000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:58.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.834+0000 7f296b7fe700 1 -- 172.21.15.134:0/3590045561 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297001d070 con 0x7f297c0ffd30 2024-04-13T11:04:58.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.834+0000 7f296b7fe700 1 -- 172.21.15.134:0/3590045561 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f297000f460 con 0x7f297c0ffd30 2024-04-13T11:04:58.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.834+0000 7f2980c33700 1 -- 172.21.15.134:0/3590045561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c19fb10 con 0x7f297c0ffd30 2024-04-13T11:04:58.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.834+0000 7f296b7fe700 1 -- 172.21.15.134:0/3590045561 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2970021620 con 0x7f297c0ffd30 2024-04-13T11:04:58.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.834+0000 7f2980c33700 1 -- 172.21.15.134:0/3590045561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297c19fec0 con 0x7f297c0ffd30 2024-04-13T11:04:58.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.835+0000 7f2980c33700 1 -- 172.21.15.134:0/3590045561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c107600 con 0x7f297c0ffd30 2024-04-13T11:04:58.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.836+0000 7f296b7fe700 1 -- 172.21.15.134:0/3590045561 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f297000f5d0 con 0x7f297c0ffd30 2024-04-13T11:04:58.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.836+0000 7f296b7fe700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f296406cce0 0x7f296406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:58.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.836+0000 7f296b7fe700 1 -- 172.21.15.134:0/3590045561 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f297008d680 con 0x7f297c0ffd30 2024-04-13T11:04:58.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.836+0000 7f297a59c700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f296406cce0 0x7f296406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:58.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.836+0000 7f297a59c700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f296406cce0 0x7f296406f190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f296c005950 tx=0x7f296c00a300 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:58.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:58.840+0000 7f296b7fe700 1 -- 172.21.15.134:0/3590045561 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f2970057870 con 0x7f297c0ffd30 2024-04-13T11:04:58.851 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:04:58 smithi134 systemd[1]: Stopping Ceph osd.2 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:04:59.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.125+0000 7f2980c33700 1 -- 172.21.15.134:0/3590045561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f297c04ea50 con 0x7f297c0ffd30 2024-04-13T11:04:59.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.126+0000 7f296b7fe700 1 -- 172.21.15.134:0/3590045561 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f297008be60 con 0x7f297c0ffd30 2024-04-13T11:04:59.127 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:04:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:04:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:04:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:04:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:04:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 6 2024-04-13T11:04:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:04:59.129 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:04:59.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 -- 172.21.15.134:0/3590045561 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f296406cce0 msgr2=0x7f296406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f296406cce0 0x7f296406f190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f296c005950 tx=0x7f296c00a300 comp rx=0 tx=0).stop 2024-04-13T11:04:59.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 -- 172.21.15.134:0/3590045561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f297c0ffd30 msgr2=0x7f297c196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f297c0ffd30 0x7f297c196fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29700092e0 tx=0x7f297000bd70 comp rx=0 tx=0).stop 2024-04-13T11:04:59.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 -- 172.21.15.134:0/3590045561 shutdown_connections 2024-04-13T11:04:59.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f296406cce0 0x7f296406f190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f297c0ff390 0x7f297c196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 --2- 172.21.15.134:0/3590045561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f297c0ffd30 0x7f297c196fe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 -- 172.21.15.134:0/3590045561 >> 172.21.15.134:0/3590045561 conn(0x7f297c074f50 msgr2=0x7f297c0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:59.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 -- 172.21.15.134:0/3590045561 shutdown_connections 2024-04-13T11:04:59.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.129+0000 7f2980c33700 1 -- 172.21.15.134:0/3590045561 wait complete. 2024-04-13T11:04:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:59 smithi134 ceph-mon[112184]: pgmap v173: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:59 smithi134 ceph-mon[112184]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:59 smithi134 ceph-mon[112184]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:59.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:04:59 smithi134 ceph-mon[112184]: osd.2 marked itself down and dead 2024-04-13T11:04:59.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:04:58 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2[70866]: 2024-04-13T11:04:58.850+0000 7f70394eb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:04:59.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:04:58 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2[70866]: 2024-04-13T11:04:58.850+0000 7f70394eb700 -1 osd.2 58 *** Got signal Terminated *** 2024-04-13T11:04:59.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:04:58 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2[70866]: 2024-04-13T11:04:58.850+0000 7f70394eb700 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:04:59.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.233+0000 7fd0f6b15700 1 -- 172.21.15.134:0/432785534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0f00ff390 msgr2=0x7fd0f00ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.233+0000 7fd0f6b15700 1 --2- 172.21.15.134:0/432785534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0f00ff390 0x7fd0f00ff760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009910 tx=0x7fd0e4009c20 comp rx=0 tx=0).stop 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.233+0000 7fd0f6b15700 1 -- 172.21.15.134:0/432785534 shutdown_connections 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.233+0000 7fd0f6b15700 1 --2- 172.21.15.134:0/432785534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0f00ffd30 0x7fd0f0103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.233+0000 7fd0f6b15700 1 --2- 172.21.15.134:0/432785534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0f00ff390 0x7fd0f00ff760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.233+0000 7fd0f6b15700 1 -- 172.21.15.134:0/432785534 >> 172.21.15.134:0/432785534 conn(0x7fd0f0074f50 msgr2=0x7fd0f0075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.233+0000 7fd0f6b15700 1 -- 172.21.15.134:0/432785534 shutdown_connections 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.233+0000 7fd0f6b15700 1 -- 172.21.15.134:0/432785534 wait complete. 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.233+0000 7fd0f6b15700 1 Processor -- start 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0f6b15700 1 -- start start 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0f6b15700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0f00ff390 0x7fd0f0196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0f6b15700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0f00ffd30 0x7fd0f0196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0f6b15700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f0197610 con 0x7fd0f00ffd30 2024-04-13T11:04:59.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0f6b15700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f0197750 con 0x7fd0f00ff390 2024-04-13T11:04:59.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0effff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0f00ffd30 0x7fd0f0196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:59.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0effff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0f00ffd30 0x7fd0f0196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37638/0 (socket says 172.21.15.134:37638) 2024-04-13T11:04:59.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0effff700 1 -- 172.21.15.134:0/2847107138 learned_addr learned my addr 172.21.15.134:0/2847107138 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:59.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0f48b1700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0f00ff390 0x7fd0f0196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:59.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0effff700 1 -- 172.21.15.134:0/2847107138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0f00ff390 msgr2=0x7fd0f0196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0effff700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0f00ff390 0x7fd0f0196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0effff700 1 -- 172.21.15.134:0/2847107138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e40095f0 con 0x7fd0f00ffd30 2024-04-13T11:04:59.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0effff700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0f00ffd30 0x7fd0f0196ff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00c8f0 tx=0x7fd0dc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0edffb700 1 -- 172.21.15.134:0/2847107138 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0dc0078a0 con 0x7fd0f00ffd30 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0edffb700 1 -- 172.21.15.134:0/2847107138 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0dc00f450 con 0x7fd0f00ffd30 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.234+0000 7fd0f6b15700 1 -- 172.21.15.134:0/2847107138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f019fb20 con 0x7fd0f00ffd30 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.235+0000 7fd0edffb700 1 -- 172.21.15.134:0/2847107138 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0dc007ea0 con 0x7fd0f00ffd30 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.235+0000 7fd0f6b15700 1 -- 172.21.15.134:0/2847107138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f019ffe0 con 0x7fd0f00ffd30 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.236+0000 7fd0f6b15700 1 -- 172.21.15.134:0/2847107138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f0107650 con 0x7fd0f00ffd30 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.236+0000 7fd0edffb700 1 -- 172.21.15.134:0/2847107138 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd0dc00f5c0 con 0x7fd0f00ffd30 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.236+0000 7fd0edffb700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd0e006cce0 0x7fd0e006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.236+0000 7fd0edffb700 1 -- 172.21.15.134:0/2847107138 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd0dc08c350 con 0x7fd0f00ffd30 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.236+0000 7fd0f48b1700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd0e006cce0 0x7fd0e006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:59.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.237+0000 7fd0f48b1700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd0e006cce0 0x7fd0e006f190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4006010 tx=0x7fd0e401a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:59.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.241+0000 7fd0edffb700 1 -- 172.21.15.134:0/2847107138 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fd0dc056540 con 0x7fd0f00ffd30 2024-04-13T11:04:59.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.490+0000 7fd0f6b15700 1 -- 172.21.15.134:0/2847107138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd0f004ea50 con 0x7fd0f00ffd30 2024-04-13T11:04:59.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.490+0000 7fd0edffb700 1 -- 172.21.15.134:0/2847107138 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1880 (secure 0 0 0) 0x7fd0dc059b60 con 0x7fd0f00ffd30 2024-04-13T11:04:59.491 INFO:teuthology.orchestra.run.smithi134.stdout:e18 2024-04-13T11:04:59.491 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:04:59.491 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:04:59.491 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:04:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 18 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T10:55:58.861624+0000 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:04:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14492} 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:04:59.493 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:04:59.494 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:04:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:04:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:04:59.494 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:04:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:04:59.494 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:04:59.494 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:04:59.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.492+0000 7fd0f6b15700 1 -- 172.21.15.134:0/2847107138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd0e006cce0 msgr2=0x7fd0e006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.492+0000 7fd0f6b15700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd0e006cce0 0x7fd0e006f190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4006010 tx=0x7fd0e401a040 comp rx=0 tx=0).stop 2024-04-13T11:04:59.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.492+0000 7fd0f6b15700 1 -- 172.21.15.134:0/2847107138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0f00ffd30 msgr2=0x7fd0f0196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.492+0000 7fd0f6b15700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0f00ffd30 0x7fd0f0196ff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00c8f0 tx=0x7fd0dc00cc00 comp rx=0 tx=0).stop 2024-04-13T11:04:59.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.493+0000 7fd0f6b15700 1 -- 172.21.15.134:0/2847107138 shutdown_connections 2024-04-13T11:04:59.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.493+0000 7fd0f6b15700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd0e006cce0 0x7fd0e006f190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.493+0000 7fd0f6b15700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0f00ff390 0x7fd0f0196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.493+0000 7fd0f6b15700 1 --2- 172.21.15.134:0/2847107138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0f00ffd30 0x7fd0f0196ff0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.493+0000 7fd0f6b15700 1 -- 172.21.15.134:0/2847107138 >> 172.21.15.134:0/2847107138 conn(0x7fd0f0074f50 msgr2=0x7fd0f00fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:59.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.493+0000 7fd0f6b15700 1 -- 172.21.15.134:0/2847107138 shutdown_connections 2024-04-13T11:04:59.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.493+0000 7fd0f6b15700 1 -- 172.21.15.134:0/2847107138 wait complete. 2024-04-13T11:04:59.496 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T11:04:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:59 smithi194 ceph-mon[83053]: pgmap v173: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:04:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:59 smithi194 ceph-mon[83053]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:59 smithi194 ceph-mon[83053]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:04:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:04:59 smithi194 ceph-mon[83053]: osd.2 marked itself down and dead 2024-04-13T11:04:59.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.597+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/1792496610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e080ffc30 msgr2=0x7f1e0810a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.597+0000 7f1e0ff2c700 1 --2- 172.21.15.134:0/1792496610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e080ffc30 0x7f1e0810a6a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009940 tx=0x7f1df8009c50 comp rx=0 tx=0).stop 2024-04-13T11:04:59.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.597+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/1792496610 shutdown_connections 2024-04-13T11:04:59.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.597+0000 7f1e0ff2c700 1 --2- 172.21.15.134:0/1792496610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e080ffc30 0x7f1e0810a6a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.597+0000 7f1e0ff2c700 1 --2- 172.21.15.134:0/1792496610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e080ff320 0x7f1e080ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.597+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/1792496610 >> 172.21.15.134:0/1792496610 conn(0x7f1e080748b0 msgr2=0x7f1e08074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:59.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.597+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/1792496610 shutdown_connections 2024-04-13T11:04:59.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.597+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/1792496610 wait complete. 2024-04-13T11:04:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.598+0000 7f1e0ff2c700 1 Processor -- start 2024-04-13T11:04:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.598+0000 7f1e0ff2c700 1 -- start start 2024-04-13T11:04:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.598+0000 7f1e0ff2c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e080ff320 0x7f1e08197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.598+0000 7f1e0ff2c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e080ffc30 0x7f1e081982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.598+0000 7f1e0ff2c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e081989d0 con 0x7f1e080ff320 2024-04-13T11:04:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.598+0000 7f1e0ff2c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0819c760 con 0x7f1e080ffc30 2024-04-13T11:04:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.598+0000 7f1e0dcc8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e080ff320 0x7f1e08197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.598+0000 7f1e0dcc8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e080ff320 0x7f1e08197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44556/0 (socket says 172.21.15.134:44556) 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.598+0000 7f1e0dcc8700 1 -- 172.21.15.134:0/2573705444 learned_addr learned my addr 172.21.15.134:0/2573705444 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.599+0000 7f1e0d4c7700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e080ffc30 0x7f1e081982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.599+0000 7f1e0dcc8700 1 -- 172.21.15.134:0/2573705444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e080ffc30 msgr2=0x7f1e081982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.599+0000 7f1e0dcc8700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e080ffc30 0x7f1e081982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.599+0000 7f1e0dcc8700 1 -- 172.21.15.134:0/2573705444 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df80095f0 con 0x7f1e080ff320 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.599+0000 7f1e0dcc8700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e080ff320 0x7f1e08197db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c8a0 tx=0x7f1e0400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.599+0000 7f1dfeffd700 1 -- 172.21.15.134:0/2573705444 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e0400cea0 con 0x7f1e080ff320 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.599+0000 7f1dfeffd700 1 -- 172.21.15.134:0/2573705444 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e04004830 con 0x7f1e080ff320 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.599+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/2573705444 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0819ca40 con 0x7f1e080ff320 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.599+0000 7f1dfeffd700 1 -- 172.21.15.134:0/2573705444 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e04005500 con 0x7f1e080ff320 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.599+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/2573705444 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0819cf90 con 0x7f1e080ff320 2024-04-13T11:04:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.600+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/2573705444 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0810a200 con 0x7f1e080ff320 2024-04-13T11:04:59.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.600+0000 7f1dfeffd700 1 -- 172.21.15.134:0/2573705444 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1e040049a0 con 0x7f1e080ff320 2024-04-13T11:04:59.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.601+0000 7f1dfeffd700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1df406cce0 0x7f1df406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:59.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.601+0000 7f1dfeffd700 1 -- 172.21.15.134:0/2573705444 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1e0408c170 con 0x7f1e080ff320 2024-04-13T11:04:59.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.601+0000 7f1e0d4c7700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1df406cce0 0x7f1df406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:59.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.601+0000 7f1e0d4c7700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1df406cce0 0x7f1df406f190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1df800b7d0 tx=0x7f1df8005e60 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:59.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.605+0000 7f1dfeffd700 1 -- 172.21.15.134:0/2573705444 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f1e040562c0 con 0x7f1e080ff320 2024-04-13T11:04:59.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.823+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/2573705444 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e0819d340 con 0x7f1df406cce0 2024-04-13T11:04:59.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.825+0000 7f1dfeffd700 1 -- 172.21.15.134:0/2573705444 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1e0819d340 con 0x7f1df406cce0 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "8/23 daemons upgraded", 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-04-13T11:04:59.826 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:04:59.827 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/2573705444 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1df406cce0 msgr2=0x7f1df406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1df406cce0 0x7f1df406f190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1df800b7d0 tx=0x7f1df8005e60 comp rx=0 tx=0).stop 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/2573705444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e080ff320 msgr2=0x7f1e08197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e080ff320 0x7f1e08197db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c8a0 tx=0x7f1e0400cc60 comp rx=0 tx=0).stop 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/2573705444 shutdown_connections 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1df406cce0 0x7f1df406f190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e080ff320 0x7f1e08197db0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 --2- 172.21.15.134:0/2573705444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e080ffc30 0x7f1e081982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/2573705444 >> 172.21.15.134:0/2573705444 conn(0x7f1e080748b0 msgr2=0x7f1e08100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/2573705444 shutdown_connections 2024-04-13T11:04:59.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.827+0000 7f1e0ff2c700 1 -- 172.21.15.134:0/2573705444 wait complete. 2024-04-13T11:04:59.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.953+0000 7f6cc1d37700 1 -- 172.21.15.134:0/3621036472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cbc101c30 msgr2=0x7f6cbc10a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.953+0000 7f6cc1d37700 1 --2- 172.21.15.134:0/3621036472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cbc101c30 0x7f6cbc10a130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009910 tx=0x7f6cb0009c20 comp rx=0 tx=0).stop 2024-04-13T11:04:59.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.953+0000 7f6cc1d37700 1 -- 172.21.15.134:0/3621036472 shutdown_connections 2024-04-13T11:04:59.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.953+0000 7f6cc1d37700 1 --2- 172.21.15.134:0/3621036472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cbc101c30 0x7f6cbc10a130 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.953+0000 7f6cc1d37700 1 --2- 172.21.15.134:0/3621036472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cbc101320 0x7f6cbc1016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.953+0000 7f6cc1d37700 1 -- 172.21.15.134:0/3621036472 >> 172.21.15.134:0/3621036472 conn(0x7f6cbc0fab80 msgr2=0x7f6cbc0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:04:59.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.953+0000 7f6cc1d37700 1 -- 172.21.15.134:0/3621036472 shutdown_connections 2024-04-13T11:04:59.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.953+0000 7f6cc1d37700 1 -- 172.21.15.134:0/3621036472 wait complete. 2024-04-13T11:04:59.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.954+0000 7f6cc1d37700 1 Processor -- start 2024-04-13T11:04:59.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.954+0000 7f6cc1d37700 1 -- start start 2024-04-13T11:04:59.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.954+0000 7f6cc1d37700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cbc101320 0x7f6cbc19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:59.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.954+0000 7f6cc1d37700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cbc101c30 0x7f6cbc19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:59.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.954+0000 7f6cc1d37700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc19c5f0 con 0x7f6cbc101320 2024-04-13T11:04:59.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.954+0000 7f6cc1d37700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc195aa0 con 0x7f6cbc101c30 2024-04-13T11:04:59.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.954+0000 7f6cbb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cbc101320 0x7f6cbc19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:59.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.954+0000 7f6cbb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cbc101320 0x7f6cbc19ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:44586/0 (socket says 172.21.15.134:44586) 2024-04-13T11:04:59.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.954+0000 7f6cbb7fe700 1 -- 172.21.15.134:0/57503138 learned_addr learned my addr 172.21.15.134:0/57503138 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:04:59.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.955+0000 7f6cbaffd700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cbc101c30 0x7f6cbc19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:59.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.955+0000 7f6cbb7fe700 1 -- 172.21.15.134:0/57503138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cbc101c30 msgr2=0x7f6cbc19bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:04:59.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.955+0000 7f6cbb7fe700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cbc101c30 0x7f6cbc19bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:04:59.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.955+0000 7f6cbb7fe700 1 -- 172.21.15.134:0/57503138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb00095f0 con 0x7f6cbc101320 2024-04-13T11:04:59.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.955+0000 7f6cbb7fe700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cbc101320 0x7f6cbc19ba20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00d8d0 tx=0x7f6cac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:59.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.955+0000 7f6cb8ff9700 1 -- 172.21.15.134:0/57503138 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cac009940 con 0x7f6cbc101320 2024-04-13T11:04:59.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.955+0000 7f6cb8ff9700 1 -- 172.21.15.134:0/57503138 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6cac010460 con 0x7f6cbc101320 2024-04-13T11:04:59.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.955+0000 7f6cc1d37700 1 -- 172.21.15.134:0/57503138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc195d80 con 0x7f6cbc101320 2024-04-13T11:04:59.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.955+0000 7f6cb8ff9700 1 -- 172.21.15.134:0/57503138 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cac00f5f0 con 0x7f6cbc101320 2024-04-13T11:04:59.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.955+0000 7f6cc1d37700 1 -- 172.21.15.134:0/57503138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc1962d0 con 0x7f6cbc101320 2024-04-13T11:04:59.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.956+0000 7f6cc1d37700 1 -- 172.21.15.134:0/57503138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc1077a0 con 0x7f6cbc101320 2024-04-13T11:04:59.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.956+0000 7f6cb8ff9700 1 -- 172.21.15.134:0/57503138 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6cac0105d0 con 0x7f6cbc101320 2024-04-13T11:04:59.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.957+0000 7f6cb8ff9700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6ca406cce0 0x7f6ca406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:04:59.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.957+0000 7f6cb8ff9700 1 -- 172.21.15.134:0/57503138 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f6cac08c4e0 con 0x7f6cbc101320 2024-04-13T11:04:59.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.957+0000 7f6cbaffd700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6ca406cce0 0x7f6ca406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:04:59.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.957+0000 7f6cbaffd700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6ca406cce0 0x7f6ca406f190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000b5c0 tx=0x7f6cb0005fd0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:04:59.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:04:59.962+0000 7f6cb8ff9700 1 -- 172.21.15.134:0/57503138 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f6cac05a0e0 con 0x7f6cbc101320 2024-04-13T11:05:00.037 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:04:59 smithi134 bash[137174]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2 2024-04-13T11:05:00.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.257+0000 7f6cc1d37700 1 -- 172.21.15.134:0/57503138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6cbc1964f0 con 0x7f6cbc101320 2024-04-13T11:05:00.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.257+0000 7f6cb8ff9700 1 -- 172.21.15.134:0/57503138 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+290 (secure 0 0 0) 0x7f6cac010880 con 0x7f6cbc101320 2024-04-13T11:05:00.258 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-04-13T11:05:00.258 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:05:00.258 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:05:00.259 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-13T11:05:00.259 INFO:teuthology.orchestra.run.smithi134.stdout: osd.2 (root=default,host=smithi134) is down 2024-04-13T11:05:00.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 -- 172.21.15.134:0/57503138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6ca406cce0 msgr2=0x7f6ca406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:00.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6ca406cce0 0x7f6ca406f190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000b5c0 tx=0x7f6cb0005fd0 comp rx=0 tx=0).stop 2024-04-13T11:05:00.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 -- 172.21.15.134:0/57503138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cbc101320 msgr2=0x7f6cbc19ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:00.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cbc101320 0x7f6cbc19ba20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00d8d0 tx=0x7f6cac00dc90 comp rx=0 tx=0).stop 2024-04-13T11:05:00.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 -- 172.21.15.134:0/57503138 shutdown_connections 2024-04-13T11:05:00.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6ca406cce0 0x7f6ca406f190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:00.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cbc101320 0x7f6cbc19ba20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:00.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 --2- 172.21.15.134:0/57503138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cbc101c30 0x7f6cbc19bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:00.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 -- 172.21.15.134:0/57503138 >> 172.21.15.134:0/57503138 conn(0x7f6cbc0fab80 msgr2=0x7f6cbc1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:00.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 -- 172.21.15.134:0/57503138 shutdown_connections 2024-04-13T11:05:00.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:00.260+0000 7f6cc1d37700 1 -- 172.21.15.134:0/57503138 wait complete. 2024-04-13T11:05:00.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:00 smithi134 ceph-mon[112184]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:00.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:00 smithi134 ceph-mon[112184]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:05:00.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:00 smithi134 ceph-mon[112184]: osdmap e59: 6 total, 5 up, 6 in 2024-04-13T11:05:00.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:00 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3590045561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:00.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:00 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2847107138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:05:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:00 smithi194 ceph-mon[83053]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:00 smithi194 ceph-mon[83053]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:05:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:00 smithi194 ceph-mon[83053]: osdmap e59: 6 total, 5 up, 6 in 2024-04-13T11:05:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:00 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3590045561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:00 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2847107138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:05:01.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:01 smithi134 ceph-mon[112184]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:01.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:01 smithi134 ceph-mon[112184]: pgmap v175: 65 pgs: 9 stale+active+clean, 56 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-13T11:05:01.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:01 smithi134 ceph-mon[112184]: osdmap e60: 6 total, 5 up, 6 in 2024-04-13T11:05:01.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:01 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/57503138' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:05:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:01 smithi194 ceph-mon[83053]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:01 smithi194 ceph-mon[83053]: pgmap v175: 65 pgs: 9 stale+active+clean, 56 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-13T11:05:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:01 smithi194 ceph-mon[83053]: osdmap e60: 6 total, 5 up, 6 in 2024-04-13T11:05:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:01 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/57503138' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:05:02.184 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:01 smithi134 systemd[1]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.2.service: Succeeded. 2024-04-13T11:05:02.184 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:01 smithi134 systemd[1]: Stopped Ceph osd.2 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:05:02.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:01 smithi134 systemd[1]: Starting Ceph osd.2 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:05:03.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:03 smithi134 ceph-mon[112184]: pgmap v177: 65 pgs: 9 stale+active+clean, 56 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-13T11:05:03.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:02 smithi134 bash[137540]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-13T11:05:03.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:02 smithi134 bash[137540]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-13T11:05:03.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:02 smithi134 bash[137540]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-13T11:05:03.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:02 smithi134 bash[137540]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-13T11:05:03.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:02 smithi134 bash[137540]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-13T11:05:03.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:02 smithi134 bash[137540]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-13T11:05:03.185 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:02 smithi134 bash[137540]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-13T11:05:03.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:03 smithi194 ceph-mon[83053]: pgmap v177: 65 pgs: 9 stale+active+clean, 56 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-13T11:05:04.221 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:04 smithi134 ceph-mon[112184]: Health check failed: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded (PG_DEGRADED) 2024-04-13T11:05:04.221 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:04 smithi134 ceph-osd[137867]: -- 172.21.15.134:0/3272612559 <== mon.0 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5600b67ad1e0 con 0x5600b677cc00 2024-04-13T11:05:04.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:04 smithi194 ceph-mon[83053]: Health check failed: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded (PG_DEGRADED) 2024-04-13T11:05:04.668 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:04 smithi134 bash[137828]: b24ce165bc9f5bb1e0d027eaf8ce65ac98ae99c78dd042467303ffa51c5dd4ba 2024-04-13T11:05:04.669 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:04 smithi134 systemd[1]: Started Ceph osd.2 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:05:04.934 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:04 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2[137844]: 2024-04-13T11:05:04.667+0000 7fd69a34e7c0 -1 Falling back to public interface 2024-04-13T11:05:05.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:05 smithi134 ceph-mon[112184]: pgmap v178: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:05:05.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:05 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:05.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:05 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:05.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:05 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:05:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:05 smithi194 ceph-mon[83053]: pgmap v178: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:05:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:05 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:05 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:05 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:05:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:07 smithi134 ceph-mon[112184]: pgmap v179: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:05:07.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:07 smithi194 ceph-mon[83053]: pgmap v179: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:05:08.837 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:08 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2[137844]: 2024-04-13T11:05:08.575+0000 7fd69a34e7c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-04-13T11:05:08.837 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:08 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2[137844]: 2024-04-13T11:05:08.836+0000 7fd69a34e7c0 -1 osd.2 58 log_to_monitors true 2024-04-13T11:05:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:08 smithi134 ceph-mon[112184]: pgmap v180: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 345 B/s rd, 0 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:05:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:05:09.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:08 smithi134 ceph-mon[112184]: from='osd.2 [v2:172.21.15.134:6818/1661014044,v1:172.21.15.134:6819/1661014044]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-13T11:05:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:08 smithi194 ceph-mon[83053]: pgmap v180: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 345 B/s rd, 0 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:05:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:05:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:08 smithi194 ceph-mon[83053]: from='osd.2 [v2:172.21.15.134:6818/1661014044,v1:172.21.15.134:6819/1661014044]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-13T11:05:09.684 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:05:09 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2[137844]: 2024-04-13T11:05:09.290+0000 7fd68b7a8700 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T11:05:10.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:10 smithi134 ceph-mon[112184]: from='osd.2 [v2:172.21.15.134:6818/1661014044,v1:172.21.15.134:6819/1661014044]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-13T11:05:10.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:10 smithi134 ceph-mon[112184]: osdmap e61: 6 total, 5 up, 6 in 2024-04-13T11:05:10.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:10 smithi134 ceph-mon[112184]: from='osd.2 [v2:172.21.15.134:6818/1661014044,v1:172.21.15.134:6819/1661014044]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T11:05:10.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:10.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:10 smithi194 ceph-mon[83053]: from='osd.2 [v2:172.21.15.134:6818/1661014044,v1:172.21.15.134:6819/1661014044]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-13T11:05:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:10 smithi194 ceph-mon[83053]: osdmap e61: 6 total, 5 up, 6 in 2024-04-13T11:05:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:10 smithi194 ceph-mon[83053]: from='osd.2 [v2:172.21.15.134:6818/1661014044,v1:172.21.15.134:6819/1661014044]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-04-13T11:05:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:11.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:11 smithi134 ceph-mon[112184]: pgmap v182: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 827 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:05:11.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:11 smithi134 ceph-mon[112184]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:05:11.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:11 smithi134 ceph-mon[112184]: osd.2 [v2:172.21.15.134:6818/1661014044,v1:172.21.15.134:6819/1661014044] boot 2024-04-13T11:05:11.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:11 smithi134 ceph-mon[112184]: osdmap e62: 6 total, 6 up, 6 in 2024-04-13T11:05:11.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:11 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T11:05:11.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:11 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:11.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:11 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:11 smithi194 ceph-mon[83053]: pgmap v182: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 827 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:05:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:11 smithi194 ceph-mon[83053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:05:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:11 smithi194 ceph-mon[83053]: osd.2 [v2:172.21.15.134:6818/1661014044,v1:172.21.15.134:6819/1661014044] boot 2024-04-13T11:05:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:11 smithi194 ceph-mon[83053]: osdmap e62: 6 total, 6 up, 6 in 2024-04-13T11:05:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:11 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-13T11:05:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:11 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:11 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:12.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:12 smithi134 ceph-mon[112184]: osdmap e63: 6 total, 6 up, 6 in 2024-04-13T11:05:12.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:12 smithi194 ceph-mon[83053]: osdmap e63: 6 total, 6 up, 6 in 2024-04-13T11:05:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:13 smithi134 ceph-mon[112184]: pgmap v185: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:05:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:13 smithi194 ceph-mon[83053]: pgmap v185: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-04-13T11:05:14.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:14 smithi134 ceph-mon[112184]: Health check update: Degraded data redundancy: 18/267 objects degraded (6.742%), 5 pgs degraded (PG_DEGRADED) 2024-04-13T11:05:14.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:14 smithi194 ceph-mon[83053]: Health check update: Degraded data redundancy: 18/267 objects degraded (6.742%), 5 pgs degraded (PG_DEGRADED) 2024-04-13T11:05:15.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: pgmap v186: 65 pgs: 5 active+undersized+degraded, 4 active+undersized, 56 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 18/267 objects degraded (6.742%) 2024-04-13T11:05:15.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:15.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:15.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:05:15.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:05:15.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:15.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:05:15.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:15.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:15.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:15.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:15 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-13T11:05:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: pgmap v186: 65 pgs: 5 active+undersized+degraded, 4 active+undersized, 56 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 18/267 objects degraded (6.742%) 2024-04-13T11:05:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:05:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:05:15.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:15.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:05:15.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:15.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:15.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:15.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:15 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-13T11:05:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:16 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-13T11:05:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:16 smithi134 ceph-mon[112184]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-04-13T11:05:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:16 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-13T11:05:16.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:16 smithi194 ceph-mon[83053]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-04-13T11:05:17.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:17 smithi134 ceph-mon[112184]: pgmap v187: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:05:17.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:17 smithi134 ceph-mon[112184]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/267 objects degraded (6.742%), 5 pgs degraded) 2024-04-13T11:05:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:17 smithi194 ceph-mon[83053]: pgmap v187: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:05:17.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:17 smithi194 ceph-mon[83053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/267 objects degraded (6.742%), 5 pgs degraded) 2024-04-13T11:05:19.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:19 smithi134 ceph-mon[112184]: pgmap v188: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-13T11:05:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:19 smithi194 ceph-mon[83053]: pgmap v188: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-13T11:05:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:21 smithi134 ceph-mon[112184]: pgmap v189: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-13T11:05:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:21 smithi194 ceph-mon[83053]: pgmap v189: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-13T11:05:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:23 smithi134 ceph-mon[112184]: pgmap v190: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 959 B/s rd, 1 op/s 2024-04-13T11:05:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:23.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:05:23.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:23 smithi194 ceph-mon[83053]: pgmap v190: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 959 B/s rd, 1 op/s 2024-04-13T11:05:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:05:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:25.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:25 smithi134 ceph-mon[112184]: pgmap v191: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:05:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:25 smithi194 ceph-mon[83053]: pgmap v191: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:05:27.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:27 smithi134 ceph-mon[112184]: pgmap v192: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:05:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:27 smithi194 ceph-mon[83053]: pgmap v192: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:05:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:29 smithi134 ceph-mon[112184]: pgmap v193: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:05:29.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:29 smithi194 ceph-mon[83053]: pgmap v193: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:05:30.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.378+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/4177797374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa00ff390 msgr2=0x7fdaa00ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:30.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.378+0000 7fdaa6ff4700 1 --2- 172.21.15.134:0/4177797374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa00ff390 0x7fdaa00ff760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda94009910 tx=0x7fda94009c20 comp rx=0 tx=0).stop 2024-04-13T11:05:30.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.378+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/4177797374 shutdown_connections 2024-04-13T11:05:30.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.378+0000 7fdaa6ff4700 1 --2- 172.21.15.134:0/4177797374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa00ffd30 0x7fdaa0103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.378+0000 7fdaa6ff4700 1 --2- 172.21.15.134:0/4177797374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa00ff390 0x7fdaa00ff760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.381 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.378+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/4177797374 >> 172.21.15.134:0/4177797374 conn(0x7fdaa0074f50 msgr2=0x7fdaa0075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.378+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/4177797374 shutdown_connections 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.378+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/4177797374 wait complete. 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.379+0000 7fdaa6ff4700 1 Processor -- start 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.379+0000 7fdaa6ff4700 1 -- start start 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.379+0000 7fdaa6ff4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa00ff390 0x7fdaa019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.379+0000 7fdaa6ff4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa00ffd30 0x7fdaa019af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.379+0000 7fdaa6ff4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa019b610 con 0x7fdaa00ffd30 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.379+0000 7fdaa6ff4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0194ac0 con 0x7fdaa00ff390 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.379+0000 7fda9ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa00ffd30 0x7fdaa019af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.379+0000 7fdaa4d90700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa00ff390 0x7fdaa019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.379+0000 7fda9ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa00ffd30 0x7fdaa019af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35078/0 (socket says 172.21.15.134:35078) 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.379+0000 7fda9ffff700 1 -- 172.21.15.134:0/747884058 learned_addr learned my addr 172.21.15.134:0/747884058 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.380+0000 7fda9ffff700 1 -- 172.21.15.134:0/747884058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa00ff390 msgr2=0x7fdaa019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:30.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.380+0000 7fda9ffff700 1 --2- 172.21.15.134:0/747884058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa00ff390 0x7fdaa019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.380+0000 7fda9ffff700 1 -- 172.21.15.134:0/747884058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda940095f0 con 0x7fdaa00ffd30 2024-04-13T11:05:30.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.380+0000 7fda9ffff700 1 --2- 172.21.15.134:0/747884058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa00ffd30 0x7fdaa019af80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00d930 tx=0x7fda8c00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:30.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.380+0000 7fda9dffb700 1 -- 172.21.15.134:0/747884058 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda8c00eb40 con 0x7fdaa00ffd30 2024-04-13T11:05:30.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.380+0000 7fda9dffb700 1 -- 172.21.15.134:0/747884058 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda8c00eca0 con 0x7fdaa00ffd30 2024-04-13T11:05:30.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.380+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/747884058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa0194d40 con 0x7fdaa00ffd30 2024-04-13T11:05:30.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.380+0000 7fda9dffb700 1 -- 172.21.15.134:0/747884058 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda8c014620 con 0x7fdaa00ffd30 2024-04-13T11:05:30.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.380+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/747884058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa0195290 con 0x7fdaa00ffd30 2024-04-13T11:05:30.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.382+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/747884058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa004ea50 con 0x7fdaa00ffd30 2024-04-13T11:05:30.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.382+0000 7fda9dffb700 1 -- 172.21.15.134:0/747884058 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fda8c016440 con 0x7fdaa00ffd30 2024-04-13T11:05:30.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.382+0000 7fda9dffb700 1 --2- 172.21.15.134:0/747884058 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fda9006cce0 0x7fda9006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:30.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.382+0000 7fda9dffb700 1 -- 172.21.15.134:0/747884058 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fda8c08dc90 con 0x7fdaa00ffd30 2024-04-13T11:05:30.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.382+0000 7fdaa4d90700 1 --2- 172.21.15.134:0/747884058 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fda9006cce0 0x7fda9006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:30.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.383+0000 7fdaa4d90700 1 --2- 172.21.15.134:0/747884058 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fda9006cce0 0x7fda9006f190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda94005f50 tx=0x7fda9401a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:30.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.387+0000 7fda9dffb700 1 -- 172.21.15.134:0/747884058 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fda8c05b730 con 0x7fdaa00ffd30 2024-04-13T11:05:30.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.601+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/747884058 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaa01957d0 con 0x7fda9006cce0 2024-04-13T11:05:30.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.602+0000 7fda9dffb700 1 -- 172.21.15.134:0/747884058 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdaa01957d0 con 0x7fda9006cce0 2024-04-13T11:05:30.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.604+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/747884058 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fda9006cce0 msgr2=0x7fda9006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:30.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.604+0000 7fdaa6ff4700 1 --2- 172.21.15.134:0/747884058 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fda9006cce0 0x7fda9006f190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda94005f50 tx=0x7fda9401a040 comp rx=0 tx=0).stop 2024-04-13T11:05:30.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.604+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/747884058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa00ffd30 msgr2=0x7fdaa019af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:30.605 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.604+0000 7fdaa6ff4700 1 --2- 172.21.15.134:0/747884058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa00ffd30 0x7fdaa019af80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00d930 tx=0x7fda8c00dc40 comp rx=0 tx=0).stop 2024-04-13T11:05:30.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.605+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/747884058 shutdown_connections 2024-04-13T11:05:30.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.605+0000 7fdaa6ff4700 1 --2- 172.21.15.134:0/747884058 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fda9006cce0 0x7fda9006f190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.605+0000 7fdaa6ff4700 1 --2- 172.21.15.134:0/747884058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa00ff390 0x7fdaa019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.605+0000 7fdaa6ff4700 1 --2- 172.21.15.134:0/747884058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa00ffd30 0x7fdaa019af80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.605+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/747884058 >> 172.21.15.134:0/747884058 conn(0x7fdaa0074f50 msgr2=0x7fdaa00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:30.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.605+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/747884058 shutdown_connections 2024-04-13T11:05:30.606 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.605+0000 7fdaa6ff4700 1 -- 172.21.15.134:0/747884058 wait complete. 2024-04-13T11:05:30.616 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:05:30.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.711+0000 7f5614fe2700 1 -- 172.21.15.134:0/3664382716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5610100d80 msgr2=0x7f5610104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:30.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.711+0000 7f5614fe2700 1 --2- 172.21.15.134:0/3664382716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5610100d80 0x7f5610104d50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5600009910 tx=0x7f5600009c20 comp rx=0 tx=0).stop 2024-04-13T11:05:30.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.711+0000 7f5614fe2700 1 -- 172.21.15.134:0/3664382716 shutdown_connections 2024-04-13T11:05:30.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.711+0000 7f5614fe2700 1 --2- 172.21.15.134:0/3664382716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5610100d80 0x7f5610104d50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.711+0000 7f5614fe2700 1 --2- 172.21.15.134:0/3664382716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56101003e0 0x7f56101007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.711+0000 7f5614fe2700 1 -- 172.21.15.134:0/3664382716 >> 172.21.15.134:0/3664382716 conn(0x7f56100fbca0 msgr2=0x7f56100fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:30.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.711+0000 7f5614fe2700 1 -- 172.21.15.134:0/3664382716 shutdown_connections 2024-04-13T11:05:30.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.711+0000 7f5614fe2700 1 -- 172.21.15.134:0/3664382716 wait complete. 2024-04-13T11:05:30.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.712+0000 7f5614fe2700 1 Processor -- start 2024-04-13T11:05:30.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.712+0000 7f5614fe2700 1 -- start start 2024-04-13T11:05:30.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.712+0000 7f5614fe2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56101003e0 0x7f5610195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:30.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.712+0000 7f5614fe2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5610100d80 0x7f5610196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:30.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.712+0000 7f5614fe2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56101968a0 con 0x7f5610100d80 2024-04-13T11:05:30.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.712+0000 7f5614fe2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56101995d0 con 0x7f56101003e0 2024-04-13T11:05:30.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.712+0000 7f560dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5610100d80 0x7f5610196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:30.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.712+0000 7f560dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5610100d80 0x7f5610196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35092/0 (socket says 172.21.15.134:35092) 2024-04-13T11:05:30.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.712+0000 7f560dd9b700 1 -- 172.21.15.134:0/3177961601 learned_addr learned my addr 172.21.15.134:0/3177961601 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:05:30.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.712+0000 7f560e59c700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56101003e0 0x7f5610195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:30.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.713+0000 7f560dd9b700 1 -- 172.21.15.134:0/3177961601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56101003e0 msgr2=0x7f5610195cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:30.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.713+0000 7f560dd9b700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56101003e0 0x7f5610195cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.713+0000 7f560dd9b700 1 -- 172.21.15.134:0/3177961601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56000095f0 con 0x7f5610100d80 2024-04-13T11:05:30.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.713+0000 7f560dd9b700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5610100d80 0x7f5610196210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5600000c00 tx=0x7f560000ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:30.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.713+0000 7f56077fe700 1 -- 172.21.15.134:0/3177961601 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560001d070 con 0x7f5610100d80 2024-04-13T11:05:30.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.713+0000 7f5614fe2700 1 -- 172.21.15.134:0/3177961601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5610199850 con 0x7f5610100d80 2024-04-13T11:05:30.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.713+0000 7f56077fe700 1 -- 172.21.15.134:0/3177961601 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f560000bed0 con 0x7f5610100d80 2024-04-13T11:05:30.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.713+0000 7f56077fe700 1 -- 172.21.15.134:0/3177961601 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560000fd90 con 0x7f5610100d80 2024-04-13T11:05:30.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.713+0000 7f5614fe2700 1 -- 172.21.15.134:0/3177961601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5610199ce0 con 0x7f5610100d80 2024-04-13T11:05:30.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.714+0000 7f5614fe2700 1 -- 172.21.15.134:0/3177961601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5610108750 con 0x7f5610100d80 2024-04-13T11:05:30.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.715+0000 7f56077fe700 1 -- 172.21.15.134:0/3177961601 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5600021410 con 0x7f5610100d80 2024-04-13T11:05:30.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.715+0000 7f56077fe700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f55fc06cce0 0x7f55fc06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:30.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.715+0000 7f56077fe700 1 -- 172.21.15.134:0/3177961601 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f560008d680 con 0x7f5610100d80 2024-04-13T11:05:30.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.715+0000 7f560e59c700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f55fc06cce0 0x7f55fc06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:30.718 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.715+0000 7f560e59c700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f55fc06cce0 0x7f55fc06f190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009c60 tx=0x7f55f8009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:30.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.719+0000 7f56077fe700 1 -- 172.21.15.134:0/3177961601 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f56000577f0 con 0x7f5610100d80 2024-04-13T11:05:30.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.931+0000 7f5614fe2700 1 -- 172.21.15.134:0/3177961601 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5610199f60 con 0x7f55fc06cce0 2024-04-13T11:05:30.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.932+0000 7f56077fe700 1 -- 172.21.15.134:0/3177961601 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5610199f60 con 0x7f55fc06cce0 2024-04-13T11:05:30.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:30 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-13T11:05:30.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 -- 172.21.15.134:0/3177961601 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f55fc06cce0 msgr2=0x7f55fc06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:30.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f55fc06cce0 0x7f55fc06f190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009c60 tx=0x7f55f8009260 comp rx=0 tx=0).stop 2024-04-13T11:05:30.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 -- 172.21.15.134:0/3177961601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5610100d80 msgr2=0x7f5610196210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:30.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5610100d80 0x7f5610196210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5600000c00 tx=0x7f560000ba70 comp rx=0 tx=0).stop 2024-04-13T11:05:30.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 -- 172.21.15.134:0/3177961601 shutdown_connections 2024-04-13T11:05:30.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f55fc06cce0 0x7f55fc06f190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56101003e0 0x7f5610195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 --2- 172.21.15.134:0/3177961601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5610100d80 0x7f5610196210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:30.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 -- 172.21.15.134:0/3177961601 >> 172.21.15.134:0/3177961601 conn(0x7f56100fbca0 msgr2=0x7f56100fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:30.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 -- 172.21.15.134:0/3177961601 shutdown_connections 2024-04-13T11:05:30.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:30.935+0000 7f5614fe2700 1 -- 172.21.15.134:0/3177961601 wait complete. 2024-04-13T11:05:30.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:30 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-13T11:05:31.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.039+0000 7f46a0606700 1 -- 172.21.15.134:0/1121983256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46980ff390 msgr2=0x7f46980ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:31.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.039+0000 7f46a0606700 1 --2- 172.21.15.134:0/1121983256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46980ff390 0x7f46980ff760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4694009910 tx=0x7f4694009c20 comp rx=0 tx=0).stop 2024-04-13T11:05:31.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.039+0000 7f46a0606700 1 -- 172.21.15.134:0/1121983256 shutdown_connections 2024-04-13T11:05:31.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.039+0000 7f46a0606700 1 --2- 172.21.15.134:0/1121983256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46980ffd30 0x7f4698103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.039+0000 7f46a0606700 1 --2- 172.21.15.134:0/1121983256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46980ff390 0x7f46980ff760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.039+0000 7f46a0606700 1 -- 172.21.15.134:0/1121983256 >> 172.21.15.134:0/1121983256 conn(0x7f4698074f50 msgr2=0x7f4698075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:31.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.039+0000 7f46a0606700 1 -- 172.21.15.134:0/1121983256 shutdown_connections 2024-04-13T11:05:31.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.039+0000 7f46a0606700 1 -- 172.21.15.134:0/1121983256 wait complete. 2024-04-13T11:05:31.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.040+0000 7f46a0606700 1 Processor -- start 2024-04-13T11:05:31.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.040+0000 7f46a0606700 1 -- start start 2024-04-13T11:05:31.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.040+0000 7f46a0606700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46980ff390 0x7f4698196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:31.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.040+0000 7f46a0606700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46980ffd30 0x7f4698197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:31.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.040+0000 7f46a0606700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698197720 con 0x7f46980ffd30 2024-04-13T11:05:31.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.040+0000 7f46a0606700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698197890 con 0x7f46980ff390 2024-04-13T11:05:31.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.040+0000 7f469dba1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46980ffd30 0x7f4698197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:31.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.040+0000 7f469dba1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46980ffd30 0x7f4698197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35104/0 (socket says 172.21.15.134:35104) 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.040+0000 7f469dba1700 1 -- 172.21.15.134:0/3123696845 learned_addr learned my addr 172.21.15.134:0/3123696845 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f469e3a2700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46980ff390 0x7f4698196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f469dba1700 1 -- 172.21.15.134:0/3123696845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46980ff390 msgr2=0x7f4698196bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f469dba1700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46980ff390 0x7f4698196bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f469dba1700 1 -- 172.21.15.134:0/3123696845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940095f0 con 0x7f46980ffd30 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f469e3a2700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46980ff390 0x7f4698196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f469dba1700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46980ffd30 0x7f4698197100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f468800b480 tx=0x7f468800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f468f7fe700 1 -- 172.21.15.134:0/3123696845 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46880118c0 con 0x7f46980ffd30 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f468f7fe700 1 -- 172.21.15.134:0/3123696845 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4688010380 con 0x7f46980ffd30 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f468f7fe700 1 -- 172.21.15.134:0/3123696845 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f468800f510 con 0x7f46980ffd30 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f46a0606700 1 -- 172.21.15.134:0/3123696845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469819fc30 con 0x7f46980ffd30 2024-04-13T11:05:31.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.041+0000 7f46a0606700 1 -- 172.21.15.134:0/3123696845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46981a0120 con 0x7f46980ffd30 2024-04-13T11:05:31.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.042+0000 7f46a0606700 1 -- 172.21.15.134:0/3123696845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4698107650 con 0x7f46980ffd30 2024-04-13T11:05:31.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.043+0000 7f468f7fe700 1 -- 172.21.15.134:0/3123696845 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f46880104f0 con 0x7f46980ffd30 2024-04-13T11:05:31.045 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.043+0000 7f468f7fe700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f468406cce0 0x7f468406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:31.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.043+0000 7f468f7fe700 1 -- 172.21.15.134:0/3123696845 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f468808c0c0 con 0x7f46980ffd30 2024-04-13T11:05:31.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.043+0000 7f469e3a2700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f468406cce0 0x7f468406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:31.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.043+0000 7f469e3a2700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f468406cce0 0x7f468406f190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f469400b5c0 tx=0x7f469401a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:31.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.047+0000 7f468f7fe700 1 -- 172.21.15.134:0/3123696845 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f4688056230 con 0x7f46980ffd30 2024-04-13T11:05:31.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.252+0000 7f46a0606700 1 -- 172.21.15.134:0/3123696845 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f469802cd20 con 0x7f468406cce0 2024-04-13T11:05:31.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.262+0000 7f468f7fe700 1 -- 172.21.15.134:0/3123696845 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f469802cd20 con 0x7f468406cce0 2024-04-13T11:05:31.263 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:05:31.263 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (4m) 21s ago 15m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:05:31.263 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (16m) 21s ago 16m 8300k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:05:31.263 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (14m) 118s ago 14m 7796k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:05:31.263 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (2m) 21s ago 15m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:05:31.263 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (2m) 118s ago 14m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:05:31.263 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (3m) 21s ago 15m 88.2M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:05:31.263 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (9m) 21s ago 9m 90.0M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:05:31.263 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (9m) 21s ago 9m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (9m) 118s ago 9m 16.1M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (9m) 118s ago 9m 19.6M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (7m) 21s ago 17m 507M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (5m) 118s ago 14m 452M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (2m) 21s ago 17m 45.2M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (2m) 118s ago 14m 28.7M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 21s ago 15m 18.4M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (5m) 118s ago 14m 16.6M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (100s) 21s ago 13m 92.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (64s) 21s ago 13m 88.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e fc8474d8910f 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (27s) 21s ago 12m 11.5M 1227M 18.2.2-1173-g5108bc67 3464fd31103e b24ce165bc9f 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (12m) 118s ago 12m 257M 2251M 18.2.0 dc2bc1663786 6de025865dec 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (11m) 118s ago 11m 215M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (11m) 118s ago 11m 219M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:05:31.264 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (4m) 21s ago 15m 66.8M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:05:31.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 -- 172.21.15.134:0/3123696845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f468406cce0 msgr2=0x7f468406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:31.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f468406cce0 0x7f468406f190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f469400b5c0 tx=0x7f469401a040 comp rx=0 tx=0).stop 2024-04-13T11:05:31.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 -- 172.21.15.134:0/3123696845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46980ffd30 msgr2=0x7f4698197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:31.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46980ffd30 0x7f4698197100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f468800b480 tx=0x7f468800b840 comp rx=0 tx=0).stop 2024-04-13T11:05:31.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 -- 172.21.15.134:0/3123696845 shutdown_connections 2024-04-13T11:05:31.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f468406cce0 0x7f468406f190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46980ff390 0x7f4698196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 --2- 172.21.15.134:0/3123696845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46980ffd30 0x7f4698197100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 -- 172.21.15.134:0/3123696845 >> 172.21.15.134:0/3123696845 conn(0x7f4698074f50 msgr2=0x7f46980fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:31.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 -- 172.21.15.134:0/3123696845 shutdown_connections 2024-04-13T11:05:31.266 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.264+0000 7f46a0606700 1 -- 172.21.15.134:0/3123696845 wait complete. 2024-04-13T11:05:31.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.367+0000 7f0af4d4d700 1 -- 172.21.15.134:0/484251016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00ffc60 msgr2=0x7f0af0103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:31.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.367+0000 7f0af4d4d700 1 --2- 172.21.15.134:0/484251016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00ffc60 0x7f0af0103c30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009910 tx=0x7f0ae0009c20 comp rx=0 tx=0).stop 2024-04-13T11:05:31.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.367+0000 7f0af4d4d700 1 -- 172.21.15.134:0/484251016 shutdown_connections 2024-04-13T11:05:31.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.367+0000 7f0af4d4d700 1 --2- 172.21.15.134:0/484251016 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00ffc60 0x7f0af0103c30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.367+0000 7f0af4d4d700 1 --2- 172.21.15.134:0/484251016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0af00ff2c0 0x7f0af00ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.367+0000 7f0af4d4d700 1 -- 172.21.15.134:0/484251016 >> 172.21.15.134:0/484251016 conn(0x7f0af00fab80 msgr2=0x7f0af00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:31.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.367+0000 7f0af4d4d700 1 -- 172.21.15.134:0/484251016 shutdown_connections 2024-04-13T11:05:31.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.367+0000 7f0af4d4d700 1 -- 172.21.15.134:0/484251016 wait complete. 2024-04-13T11:05:31.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.368+0000 7f0af4d4d700 1 Processor -- start 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.368+0000 7f0af4d4d700 1 -- start start 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.368+0000 7f0af4d4d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0af00ff2c0 0x7f0af0196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.368+0000 7f0af4d4d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00ffc60 0x7f0af0197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.368+0000 7f0af4d4d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0197650 con 0x7f0af00ffc60 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.368+0000 7f0af4d4d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0197790 con 0x7f0af00ff2c0 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.368+0000 7f0aedd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00ffc60 0x7f0af0197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.368+0000 7f0aedd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00ffc60 0x7f0af0197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35130/0 (socket says 172.21.15.134:35130) 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.368+0000 7f0aedd9b700 1 -- 172.21.15.134:0/3508714173 learned_addr learned my addr 172.21.15.134:0/3508714173 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.368+0000 7f0aee59c700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0af00ff2c0 0x7f0af0196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.369+0000 7f0aedd9b700 1 -- 172.21.15.134:0/3508714173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0af00ff2c0 msgr2=0x7f0af0196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.369+0000 7f0aedd9b700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0af00ff2c0 0x7f0af0196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.369+0000 7f0aedd9b700 1 -- 172.21.15.134:0/3508714173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae00095f0 con 0x7f0af00ffc60 2024-04-13T11:05:31.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.369+0000 7f0aedd9b700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00ffc60 0x7f0af0197030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000bda0 tx=0x7f0ae000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:31.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.369+0000 7f0adf7fe700 1 -- 172.21.15.134:0/3508714173 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae001d070 con 0x7f0af00ffc60 2024-04-13T11:05:31.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.369+0000 7f0adf7fe700 1 -- 172.21.15.134:0/3508714173 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ae0005710 con 0x7f0af00ffc60 2024-04-13T11:05:31.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.369+0000 7f0af4d4d700 1 -- 172.21.15.134:0/3508714173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af019fb60 con 0x7f0af00ffc60 2024-04-13T11:05:31.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.369+0000 7f0adf7fe700 1 -- 172.21.15.134:0/3508714173 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae000fe90 con 0x7f0af00ffc60 2024-04-13T11:05:31.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.369+0000 7f0af4d4d700 1 -- 172.21.15.134:0/3508714173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af019ff70 con 0x7f0af00ffc60 2024-04-13T11:05:31.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.370+0000 7f0af4d4d700 1 -- 172.21.15.134:0/3508714173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af0107630 con 0x7f0af00ffc60 2024-04-13T11:05:31.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.370+0000 7f0adf7fe700 1 -- 172.21.15.134:0/3508714173 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0ae000f6f0 con 0x7f0af00ffc60 2024-04-13T11:05:31.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.371+0000 7f0adf7fe700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0ad806cce0 0x7f0ad806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:31.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.371+0000 7f0aee59c700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0ad806cce0 0x7f0ad806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:31.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.371+0000 7f0adf7fe700 1 -- 172.21.15.134:0/3508714173 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f0ae008d5e0 con 0x7f0af00ffc60 2024-04-13T11:05:31.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.371+0000 7f0aee59c700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0ad806cce0 0x7f0ad806f190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4007be0 tx=0x7f0ae40073d0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.376+0000 7f0adf7fe700 1 -- 172.21.15.134:0/3508714173 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f0ae0057750 con 0x7f0af00ffc60 2024-04-13T11:05:31.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.652+0000 7f0af4d4d700 1 -- 172.21.15.134:0/3508714173 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0af004ea50 con 0x7f0af00ffc60 2024-04-13T11:05:31.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.652+0000 7f0adf7fe700 1 -- 172.21.15.134:0/3508714173 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f0ae005ad70 con 0x7f0af00ffc60 2024-04-13T11:05:31.654 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:05:31.654 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:05:31.654 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:05:31.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:05:31.654 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:05:31.654 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:05:31.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:05:31.655 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:05:31.655 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-04-13T11:05:31.655 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 3 2024-04-13T11:05:31.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:05:31.655 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:05:31.655 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:05:31.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:05:31.656 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:05:31.656 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-04-13T11:05:31.656 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 7 2024-04-13T11:05:31.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:05:31.656 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:05:31.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.654+0000 7f0af4d4d700 1 -- 172.21.15.134:0/3508714173 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0ad806cce0 msgr2=0x7f0ad806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:31.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.654+0000 7f0af4d4d700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0ad806cce0 0x7f0ad806f190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4007be0 tx=0x7f0ae40073d0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.654+0000 7f0af4d4d700 1 -- 172.21.15.134:0/3508714173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00ffc60 msgr2=0x7f0af0197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:31.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.654+0000 7f0af4d4d700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00ffc60 0x7f0af0197030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000bda0 tx=0x7f0ae000bdd0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.655+0000 7f0af4d4d700 1 -- 172.21.15.134:0/3508714173 shutdown_connections 2024-04-13T11:05:31.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.655+0000 7f0af4d4d700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0ad806cce0 0x7f0ad806f190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.655+0000 7f0af4d4d700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0af00ff2c0 0x7f0af0196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.655+0000 7f0af4d4d700 1 --2- 172.21.15.134:0/3508714173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0af00ffc60 0x7f0af0197030 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.655+0000 7f0af4d4d700 1 -- 172.21.15.134:0/3508714173 >> 172.21.15.134:0/3508714173 conn(0x7f0af00fab80 msgr2=0x7f0af00fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:31.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.655+0000 7f0af4d4d700 1 -- 172.21.15.134:0/3508714173 shutdown_connections 2024-04-13T11:05:31.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.655+0000 7f0af4d4d700 1 -- 172.21.15.134:0/3508714173 wait complete. 2024-04-13T11:05:31.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:31 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-13T11:05:31.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:31 smithi194 ceph-mon[83053]: Upgrade: osd.3 is safe to restart 2024-04-13T11:05:31.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:31 smithi194 ceph-mon[83053]: pgmap v194: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:05:31.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:31 smithi194 ceph-mon[83053]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:31.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:31 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:31.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:31 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-13T11:05:31.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:31 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:05:31.752 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:31 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3508714173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.760+0000 7fb03efa9700 1 -- 172.21.15.134:0/824086160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0381013a0 msgr2=0x7fb038101770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.761+0000 7fb03efa9700 1 --2- 172.21.15.134:0/824086160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0381013a0 0x7fb038101770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009910 tx=0x7fb02c009c20 comp rx=0 tx=0).stop 2024-04-13T11:05:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.761+0000 7fb03efa9700 1 -- 172.21.15.134:0/824086160 shutdown_connections 2024-04-13T11:05:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.761+0000 7fb03efa9700 1 --2- 172.21.15.134:0/824086160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb038101cb0 0x7fb03810a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.761+0000 7fb03efa9700 1 --2- 172.21.15.134:0/824086160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0381013a0 0x7fb038101770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.761+0000 7fb03efa9700 1 -- 172.21.15.134:0/824086160 >> 172.21.15.134:0/824086160 conn(0x7fb0380fab80 msgr2=0x7fb0380fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.761+0000 7fb03efa9700 1 -- 172.21.15.134:0/824086160 shutdown_connections 2024-04-13T11:05:31.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.761+0000 7fb03efa9700 1 -- 172.21.15.134:0/824086160 wait complete. 2024-04-13T11:05:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.761+0000 7fb03efa9700 1 Processor -- start 2024-04-13T11:05:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.761+0000 7fb03efa9700 1 -- start start 2024-04-13T11:05:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03efa9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0381013a0 0x7fb03819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03efa9700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb038101cb0 0x7fb03819bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03efa9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03819c630 con 0x7fb0381013a0 2024-04-13T11:05:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03efa9700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb038195ae0 con 0x7fb038101cb0 2024-04-13T11:05:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03cd45700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0381013a0 0x7fb03819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:31.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03cd45700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0381013a0 0x7fb03819ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35154/0 (socket says 172.21.15.134:35154) 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03cd45700 1 -- 172.21.15.134:0/687271295 learned_addr learned my addr 172.21.15.134:0/687271295 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb037fff700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb038101cb0 0x7fb03819bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03cd45700 1 -- 172.21.15.134:0/687271295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb038101cb0 msgr2=0x7fb03819bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03cd45700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb038101cb0 0x7fb03819bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03cd45700 1 -- 172.21.15.134:0/687271295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0095f0 con 0x7fb0381013a0 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03cd45700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0381013a0 0x7fb03819ba60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb02c000c00 tx=0x7fb02c00bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb035ffb700 1 -- 172.21.15.134:0/687271295 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb02c01d070 con 0x7fb0381013a0 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb03efa9700 1 -- 172.21.15.134:0/687271295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb038195d60 con 0x7fb0381013a0 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.762+0000 7fb035ffb700 1 -- 172.21.15.134:0/687271295 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb02c005dc0 con 0x7fb0381013a0 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.763+0000 7fb035ffb700 1 -- 172.21.15.134:0/687271295 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb02c0039d0 con 0x7fb0381013a0 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.763+0000 7fb03efa9700 1 -- 172.21.15.134:0/687271295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0381961f0 con 0x7fb0381013a0 2024-04-13T11:05:31.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.763+0000 7fb03efa9700 1 -- 172.21.15.134:0/687271295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb038107880 con 0x7fb0381013a0 2024-04-13T11:05:31.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.765+0000 7fb035ffb700 1 -- 172.21.15.134:0/687271295 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb02c004b70 con 0x7fb0381013a0 2024-04-13T11:05:31.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.765+0000 7fb035ffb700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb02806cce0 0x7fb02806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:31.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.765+0000 7fb035ffb700 1 -- 172.21.15.134:0/687271295 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb02c08e300 con 0x7fb0381013a0 2024-04-13T11:05:31.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.765+0000 7fb037fff700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb02806cce0 0x7fb02806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:31.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.766+0000 7fb037fff700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb02806cce0 0x7fb02806f190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb0380fc2e0 tx=0x7fb024009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:31.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:31.769+0000 7fb035ffb700 1 -- 172.21.15.134:0/687271295 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fb02c05be60 con 0x7fb0381013a0 2024-04-13T11:05:31.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:31 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-13T11:05:31.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:31 smithi134 ceph-mon[112184]: Upgrade: osd.3 is safe to restart 2024-04-13T11:05:31.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:31 smithi134 ceph-mon[112184]: pgmap v194: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:05:31.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:31 smithi134 ceph-mon[112184]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:31.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:31 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:31.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:31 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-13T11:05:31.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:31 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:05:31.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:31 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3508714173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:32.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.030+0000 7fb03efa9700 1 -- 172.21.15.134:0/687271295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb03804ea50 con 0x7fb0381013a0 2024-04-13T11:05:32.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.031+0000 7fb035ffb700 1 -- 172.21.15.134:0/687271295 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1880 (secure 0 0 0) 0x7fb02c026770 con 0x7fb0381013a0 2024-04-13T11:05:32.032 INFO:teuthology.orchestra.run.smithi134.stdout:e18 2024-04-13T11:05:32.032 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:05:32.032 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:05:32.032 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:05:32.032 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:05:32.032 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:05:32.032 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:05:32.032 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 18 2024-04-13T11:05:32.032 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T10:55:58.861624+0000 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:05:32.033 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14492} 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:05:32.034 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:05:32.035 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:05:32.035 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:05:32.035 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:05:32.035 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:05:32.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 -- 172.21.15.134:0/687271295 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb02806cce0 msgr2=0x7fb02806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:32.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb02806cce0 0x7fb02806f190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb0380fc2e0 tx=0x7fb024009260 comp rx=0 tx=0).stop 2024-04-13T11:05:32.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 -- 172.21.15.134:0/687271295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0381013a0 msgr2=0x7fb03819ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:32.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0381013a0 0x7fb03819ba60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb02c000c00 tx=0x7fb02c00bde0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 -- 172.21.15.134:0/687271295 shutdown_connections 2024-04-13T11:05:32.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb02806cce0 0x7fb02806f190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0381013a0 0x7fb03819ba60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 --2- 172.21.15.134:0/687271295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb038101cb0 0x7fb03819bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 -- 172.21.15.134:0/687271295 >> 172.21.15.134:0/687271295 conn(0x7fb0380fab80 msgr2=0x7fb0381049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:32.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 -- 172.21.15.134:0/687271295 shutdown_connections 2024-04-13T11:05:32.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.033+0000 7fb03efa9700 1 -- 172.21.15.134:0/687271295 wait complete. 2024-04-13T11:05:32.036 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T11:05:32.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.138+0000 7f2f8095f700 1 -- 172.21.15.134:0/877267670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f7c068630 msgr2=0x7f2f7c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:32.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.138+0000 7f2f8095f700 1 --2- 172.21.15.134:0/877267670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f7c068630 0x7f2f7c068a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009910 tx=0x7f2f70009c20 comp rx=0 tx=0).stop 2024-04-13T11:05:32.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.138+0000 7f2f8095f700 1 -- 172.21.15.134:0/877267670 shutdown_connections 2024-04-13T11:05:32.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.138+0000 7f2f8095f700 1 --2- 172.21.15.134:0/877267670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f7c068fd0 0x7f2f7c104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.138+0000 7f2f8095f700 1 --2- 172.21.15.134:0/877267670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f7c068630 0x7f2f7c068a00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.138+0000 7f2f8095f700 1 -- 172.21.15.134:0/877267670 >> 172.21.15.134:0/877267670 conn(0x7f2f7c074f50 msgr2=0x7f2f7c075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:32.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.138+0000 7f2f8095f700 1 -- 172.21.15.134:0/877267670 shutdown_connections 2024-04-13T11:05:32.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.138+0000 7f2f8095f700 1 -- 172.21.15.134:0/877267670 wait complete. 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.138+0000 7f2f8095f700 1 Processor -- start 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f8095f700 1 -- start start 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f8095f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f7c068630 0x7f2f7c0ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f8095f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f7c068fd0 0x7f2f7c0ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f8095f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0ffc80 con 0x7f2f7c068fd0 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f8095f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0ffdc0 con 0x7f2f7c068630 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f79d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f7c068fd0 0x7f2f7c0ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f7a59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f7c068630 0x7f2f7c0ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f79d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f7c068fd0 0x7f2f7c0ff740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35170/0 (socket says 172.21.15.134:35170) 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f79d9b700 1 -- 172.21.15.134:0/1376941147 learned_addr learned my addr 172.21.15.134:0/1376941147 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f79d9b700 1 -- 172.21.15.134:0/1376941147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f7c068630 msgr2=0x7f2f7c0ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f79d9b700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f7c068630 0x7f2f7c0ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f79d9b700 1 -- 172.21.15.134:0/1376941147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f700095f0 con 0x7f2f7c068fd0 2024-04-13T11:05:32.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f7a59c700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f7c068630 0x7f2f7c0ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T11:05:32.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.139+0000 7f2f79d9b700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f7c068fd0 0x7f2f7c0ff740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00e8f0 tx=0x7f2f6c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:32.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.140+0000 7f2f6b7fe700 1 -- 172.21.15.134:0/1376941147 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f6c009790 con 0x7f2f7c068fd0 2024-04-13T11:05:32.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.140+0000 7f2f6b7fe700 1 -- 172.21.15.134:0/1376941147 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f6c00c810 con 0x7f2f7c068fd0 2024-04-13T11:05:32.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.140+0000 7f2f8095f700 1 -- 172.21.15.134:0/1376941147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c1a1f10 con 0x7f2f7c068fd0 2024-04-13T11:05:32.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.140+0000 7f2f6b7fe700 1 -- 172.21.15.134:0/1376941147 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f6c005520 con 0x7f2f7c068fd0 2024-04-13T11:05:32.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.140+0000 7f2f8095f700 1 -- 172.21.15.134:0/1376941147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c1a2320 con 0x7f2f7c068fd0 2024-04-13T11:05:32.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.141+0000 7f2f8095f700 1 -- 172.21.15.134:0/1376941147 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c1086f0 con 0x7f2f7c068fd0 2024-04-13T11:05:32.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.141+0000 7f2f6b7fe700 1 -- 172.21.15.134:0/1376941147 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2f6c00c980 con 0x7f2f7c068fd0 2024-04-13T11:05:32.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.142+0000 7f2f6b7fe700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f6406cce0 0x7f2f6406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:32.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.142+0000 7f2f6b7fe700 1 -- 172.21.15.134:0/1376941147 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2f6c014070 con 0x7f2f7c068fd0 2024-04-13T11:05:32.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.142+0000 7f2f7a59c700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f6406cce0 0x7f2f6406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:32.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.142+0000 7f2f7a59c700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f6406cce0 0x7f2f6406f190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009fd0 tx=0x7f2f70005940 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:32.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.146+0000 7f2f6b7fe700 1 -- 172.21.15.134:0/1376941147 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f2f6c056920 con 0x7f2f7c068fd0 2024-04-13T11:05:32.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.362+0000 7f2f8095f700 1 -- 172.21.15.134:0/1376941147 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f7c02ccf0 con 0x7f2f6406cce0 2024-04-13T11:05:32.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.363+0000 7f2f6b7fe700 1 -- 172.21.15.134:0/1376941147 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2f7c02ccf0 con 0x7f2f6406cce0 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "9/23 daemons upgraded", 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-04-13T11:05:32.364 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:05:32.365 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:05:32.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 -- 172.21.15.134:0/1376941147 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f6406cce0 msgr2=0x7f2f6406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:32.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f6406cce0 0x7f2f6406f190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009fd0 tx=0x7f2f70005940 comp rx=0 tx=0).stop 2024-04-13T11:05:32.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 -- 172.21.15.134:0/1376941147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f7c068fd0 msgr2=0x7f2f7c0ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:32.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f7c068fd0 0x7f2f7c0ff740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00e8f0 tx=0x7f2f6c00ec00 comp rx=0 tx=0).stop 2024-04-13T11:05:32.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 -- 172.21.15.134:0/1376941147 shutdown_connections 2024-04-13T11:05:32.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2f6406cce0 0x7f2f6406f190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f7c068630 0x7f2f7c0ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 --2- 172.21.15.134:0/1376941147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f7c068fd0 0x7f2f7c0ff740 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 -- 172.21.15.134:0/1376941147 >> 172.21.15.134:0/1376941147 conn(0x7f2f7c074f50 msgr2=0x7f2f7c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:32.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 -- 172.21.15.134:0/1376941147 shutdown_connections 2024-04-13T11:05:32.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.365+0000 7f2f8095f700 1 -- 172.21.15.134:0/1376941147 wait complete. 2024-04-13T11:05:32.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.469+0000 7fab73939700 1 -- 172.21.15.134:0/3574148348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab6c0ffc60 msgr2=0x7fab6c103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:32.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.469+0000 7fab73939700 1 --2- 172.21.15.134:0/3574148348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab6c0ffc60 0x7fab6c103c30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009910 tx=0x7fab5c009c20 comp rx=0 tx=0).stop 2024-04-13T11:05:32.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.469+0000 7fab73939700 1 -- 172.21.15.134:0/3574148348 shutdown_connections 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.469+0000 7fab73939700 1 --2- 172.21.15.134:0/3574148348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab6c0ffc60 0x7fab6c103c30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.469+0000 7fab73939700 1 --2- 172.21.15.134:0/3574148348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c0ff2c0 0x7fab6c0ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.469+0000 7fab73939700 1 -- 172.21.15.134:0/3574148348 >> 172.21.15.134:0/3574148348 conn(0x7fab6c0fab80 msgr2=0x7fab6c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.469+0000 7fab73939700 1 -- 172.21.15.134:0/3574148348 shutdown_connections 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.469+0000 7fab73939700 1 -- 172.21.15.134:0/3574148348 wait complete. 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.469+0000 7fab73939700 1 Processor -- start 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.469+0000 7fab73939700 1 -- start start 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab73939700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c0ff2c0 0x7fab6c19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab73939700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab6c0ffc60 0x7fab6c19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab73939700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c19c5f0 con 0x7fab6c0ffc60 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab73939700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c195af0 con 0x7fab6c0ff2c0 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab70ed4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab6c0ffc60 0x7fab6c19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab70ed4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab6c0ffc60 0x7fab6c19bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35190/0 (socket says 172.21.15.134:35190) 2024-04-13T11:05:32.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab70ed4700 1 -- 172.21.15.134:0/2139155451 learned_addr learned my addr 172.21.15.134:0/2139155451 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:05:32.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab716d5700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c0ff2c0 0x7fab6c19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:32.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab70ed4700 1 -- 172.21.15.134:0/2139155451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c0ff2c0 msgr2=0x7fab6c19ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:32.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab70ed4700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c0ff2c0 0x7fab6c19ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab70ed4700 1 -- 172.21.15.134:0/2139155451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c0095f0 con 0x7fab6c0ffc60 2024-04-13T11:05:32.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab70ed4700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab6c0ffc60 0x7fab6c19bf60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab5c000c00 tx=0x7fab5c00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:32.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab627fc700 1 -- 172.21.15.134:0/2139155451 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5c01d070 con 0x7fab6c0ffc60 2024-04-13T11:05:32.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab627fc700 1 -- 172.21.15.134:0/2139155451 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab5c00bed0 con 0x7fab6c0ffc60 2024-04-13T11:05:32.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab73939700 1 -- 172.21.15.134:0/2139155451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c195d70 con 0x7fab6c0ffc60 2024-04-13T11:05:32.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab627fc700 1 -- 172.21.15.134:0/2139155451 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5c00fd90 con 0x7fab6c0ffc60 2024-04-13T11:05:32.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.470+0000 7fab73939700 1 -- 172.21.15.134:0/2139155451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c196200 con 0x7fab6c0ffc60 2024-04-13T11:05:32.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.471+0000 7fab73939700 1 -- 172.21.15.134:0/2139155451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c108640 con 0x7fab6c0ffc60 2024-04-13T11:05:32.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.472+0000 7fab627fc700 1 -- 172.21.15.134:0/2139155451 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fab5c021410 con 0x7fab6c0ffc60 2024-04-13T11:05:32.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.472+0000 7fab627fc700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab5806cce0 0x7fab5806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:05:32.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.472+0000 7fab627fc700 1 -- 172.21.15.134:0/2139155451 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fab5c08d680 con 0x7fab6c0ffc60 2024-04-13T11:05:32.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.472+0000 7fab716d5700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab5806cce0 0x7fab5806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:05:32.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.473+0000 7fab716d5700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab5806cce0 0x7fab5806f190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fab68009c60 tx=0x7fab68009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:05:32.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.477+0000 7fab627fc700 1 -- 172.21.15.134:0/2139155451 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fab5c05b280 con 0x7fab6c0ffc60 2024-04-13T11:05:32.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.756+0000 7fab73939700 1 -- 172.21.15.134:0/2139155451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fab6c04ea50 con 0x7fab6c0ffc60 2024-04-13T11:05:32.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.757+0000 7fab627fc700 1 -- 172.21.15.134:0/2139155451 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fab5c08be60 con 0x7fab6c0ffc60 2024-04-13T11:05:32.758 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:05:32.758 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:05:32.758 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:05:32.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 -- 172.21.15.134:0/2139155451 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab5806cce0 msgr2=0x7fab5806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:32.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab5806cce0 0x7fab5806f190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fab68009c60 tx=0x7fab68009260 comp rx=0 tx=0).stop 2024-04-13T11:05:32.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 -- 172.21.15.134:0/2139155451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab6c0ffc60 msgr2=0x7fab6c19bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:05:32.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab6c0ffc60 0x7fab6c19bf60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab5c000c00 tx=0x7fab5c00ba70 comp rx=0 tx=0).stop 2024-04-13T11:05:32.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 -- 172.21.15.134:0/2139155451 shutdown_connections 2024-04-13T11:05:32.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fab5806cce0 0x7fab5806f190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c0ff2c0 0x7fab6c19ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 --2- 172.21.15.134:0/2139155451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab6c0ffc60 0x7fab6c19bf60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:05:32.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 -- 172.21.15.134:0/2139155451 >> 172.21.15.134:0/2139155451 conn(0x7fab6c0fab80 msgr2=0x7fab6c068fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:05:32.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 -- 172.21.15.134:0/2139155451 shutdown_connections 2024-04-13T11:05:32.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:05:32.759+0000 7fab73939700 1 -- 172.21.15.134:0/2139155451 wait complete. 2024-04-13T11:05:32.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:32 smithi134 ceph-mon[112184]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:32.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:32 smithi134 ceph-mon[112184]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:32.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:32 smithi134 ceph-mon[112184]: Upgrade: Updating osd.3 2024-04-13T11:05:32.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:32 smithi134 ceph-mon[112184]: Deploying daemon osd.3 on smithi194 2024-04-13T11:05:32.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:32 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/687271295' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:05:32.946 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:32 smithi194 ceph-mon[83053]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:32.946 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:32 smithi194 ceph-mon[83053]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:32.946 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:32 smithi194 ceph-mon[83053]: Upgrade: Updating osd.3 2024-04-13T11:05:32.946 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:32 smithi194 ceph-mon[83053]: Deploying daemon osd.3 on smithi194 2024-04-13T11:05:32.947 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:32 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/687271295' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:05:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:33 smithi134 ceph-mon[112184]: pgmap v195: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:05:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:33 smithi134 ceph-mon[112184]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:33.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:33 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2139155451' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:05:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:33 smithi194 ceph-mon[83053]: pgmap v195: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:05:33.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:33 smithi194 ceph-mon[83053]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:05:33.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:33 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2139155451' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:05:35.461 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:35 smithi194 systemd[1]: Stopping Ceph osd.3 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:05:35.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:35 smithi194 ceph-mon[83053]: pgmap v196: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:05:35.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:35 smithi194 ceph-mon[83053]: osd.3 marked itself down and dead 2024-04-13T11:05:35.748 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:35 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[53643]: 2024-04-13T11:05:35.459+0000 7f888cb9e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:05:35.748 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:35 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[53643]: 2024-04-13T11:05:35.459+0000 7f888cb9e700 -1 osd.3 63 *** Got signal Terminated *** 2024-04-13T11:05:35.749 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:35 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[53643]: 2024-04-13T11:05:35.459+0000 7f888cb9e700 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:05:35.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:35 smithi134 ceph-mon[112184]: pgmap v196: 65 pgs: 65 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:05:35.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:35 smithi134 ceph-mon[112184]: osd.3 marked itself down and dead 2024-04-13T11:05:36.958 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:36 smithi134 ceph-mon[112184]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:05:36.959 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:36 smithi134 ceph-mon[112184]: osdmap e64: 6 total, 5 up, 6 in 2024-04-13T11:05:36.959 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:36 smithi134 ceph-mon[112184]: osdmap e65: 6 total, 5 up, 6 in 2024-04-13T11:05:36.999 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:36 smithi194 bash[93693]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3 2024-04-13T11:05:36.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:36 smithi194 ceph-mon[83053]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:05:36.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:36 smithi194 ceph-mon[83053]: osdmap e64: 6 total, 5 up, 6 in 2024-04-13T11:05:36.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:36 smithi194 ceph-mon[83053]: osdmap e65: 6 total, 5 up, 6 in 2024-04-13T11:05:37.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:37 smithi194 ceph-mon[83053]: pgmap v198: 65 pgs: 16 stale+active+clean, 49 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-13T11:05:38.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:37 smithi134 ceph-mon[112184]: pgmap v198: 65 pgs: 16 stale+active+clean, 49 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-13T11:05:38.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]: dispatch 2024-04-13T11:05:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]: dispatch 2024-04-13T11:05:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1e", "id": [0, 3]}]: dispatch 2024-04-13T11:05:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 2]}]: dispatch 2024-04-13T11:05:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [4, 0]}]: dispatch 2024-04-13T11:05:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 3]}]: dispatch 2024-04-13T11:05:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]: dispatch 2024-04-13T11:05:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:38 smithi194 ceph-mon[83053]: pgmap v200: 65 pgs: 3 active+undersized+degraded, 13 stale+active+clean, 4 active+undersized, 45 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 9/267 objects degraded (3.371%) 2024-04-13T11:05:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:38.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:05:38.999 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:38 smithi194 systemd[1]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.3.service: Succeeded. 2024-04-13T11:05:38.999 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:38 smithi194 systemd[1]: Stopped Ceph osd.3 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:05:39.000 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:38 smithi194 systemd[1]: Starting Ceph osd.3 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:05:39.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]: dispatch 2024-04-13T11:05:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]: dispatch 2024-04-13T11:05:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1e", "id": [0, 3]}]: dispatch 2024-04-13T11:05:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 2]}]: dispatch 2024-04-13T11:05:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [4, 0]}]: dispatch 2024-04-13T11:05:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 3]}]: dispatch 2024-04-13T11:05:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]: dispatch 2024-04-13T11:05:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:38 smithi134 ceph-mon[112184]: pgmap v200: 65 pgs: 3 active+undersized+degraded, 13 stale+active+clean, 4 active+undersized, 45 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 9/267 objects degraded (3.371%) 2024-04-13T11:05:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:05:39.998 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:39 smithi194 bash[93963]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-13T11:05:39.998 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:39 smithi194 bash[93963]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-13T11:05:39.998 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:39 smithi194 bash[93963]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-13T11:05:39.999 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:39 smithi194 bash[93963]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-13T11:05:39.999 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:39 smithi194 bash[93963]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-13T11:05:39.999 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:39 smithi194 bash[93963]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-13T11:05:39.999 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:39 smithi194 bash[93963]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-13T11:05:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:39 smithi194 ceph-mon[83053]: Health check failed: Degraded data redundancy: 9/267 objects degraded (3.371%), 3 pgs degraded (PG_DEGRADED) 2024-04-13T11:05:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:39 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]': finished 2024-04-13T11:05:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:39 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]': finished 2024-04-13T11:05:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:39 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1e", "id": [0, 3]}]': finished 2024-04-13T11:05:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:39 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 2]}]': finished 2024-04-13T11:05:39.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:39 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [4, 0]}]': finished 2024-04-13T11:05:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:39 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 3]}]': finished 2024-04-13T11:05:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:39 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]': finished 2024-04-13T11:05:40.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:39 smithi194 ceph-mon[83053]: osdmap e66: 6 total, 5 up, 6 in 2024-04-13T11:05:40.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:39 smithi134 ceph-mon[112184]: Health check failed: Degraded data redundancy: 9/267 objects degraded (3.371%), 3 pgs degraded (PG_DEGRADED) 2024-04-13T11:05:40.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:39 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]': finished 2024-04-13T11:05:40.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:39 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]': finished 2024-04-13T11:05:40.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:39 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1e", "id": [0, 3]}]': finished 2024-04-13T11:05:40.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:39 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 2]}]': finished 2024-04-13T11:05:40.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:39 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [4, 0]}]': finished 2024-04-13T11:05:40.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:39 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 3]}]': finished 2024-04-13T11:05:40.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:39 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]': finished 2024-04-13T11:05:40.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:39 smithi134 ceph-mon[112184]: osdmap e66: 6 total, 5 up, 6 in 2024-04-13T11:05:40.992 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:40 smithi194 ceph-mon[83053]: osdmap e67: 6 total, 5 up, 6 in 2024-04-13T11:05:40.992 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:40 smithi194 ceph-mon[83053]: pgmap v203: 65 pgs: 3 unknown, 4 peering, 16 active+undersized+degraded, 18 active+undersized, 24 active+clean; 241 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 52/255 objects degraded (20.392%) 2024-04-13T11:05:41.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:40 smithi134 ceph-mon[112184]: osdmap e67: 6 total, 5 up, 6 in 2024-04-13T11:05:41.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:40 smithi134 ceph-mon[112184]: pgmap v203: 65 pgs: 3 unknown, 4 peering, 16 active+undersized+degraded, 18 active+undersized, 24 active+clean; 241 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 52/255 objects degraded (20.392%) 2024-04-13T11:05:41.248 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:40 smithi194 ceph-osd[94288]: -- 172.21.15.194:0/2491773927 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562c5a9c31e0 con 0x562c5a992c00 2024-04-13T11:05:41.248 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:41 smithi194 bash[94250]: d909c0e8d07729d094bbc2416fba7c1220aca6320c2c0b6c589df8e0b036fee4 2024-04-13T11:05:41.248 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:41 smithi194 systemd[1]: Started Ceph osd.3 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:05:41.910 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:41 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[94265]: 2024-04-13T11:05:41.511+0000 7f1a6b5e17c0 -1 Falling back to public interface 2024-04-13T11:05:41.910 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:41 smithi194 ceph-mon[83053]: osdmap e68: 6 total, 5 up, 6 in 2024-04-13T11:05:41.911 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:41 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:41.911 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:41 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:41.911 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:41 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:05:42.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:41 smithi134 ceph-mon[112184]: osdmap e68: 6 total, 5 up, 6 in 2024-04-13T11:05:42.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:41 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:42.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:41 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:42.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:41 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:05:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:42 smithi194 ceph-mon[83053]: osdmap e69: 6 total, 5 up, 6 in 2024-04-13T11:05:42.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:42 smithi194 ceph-mon[83053]: pgmap v206: 65 pgs: 3 unknown, 4 peering, 16 active+undersized+degraded, 18 active+undersized, 24 active+clean; 241 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 52/255 objects degraded (20.392%) 2024-04-13T11:05:43.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:42 smithi134 ceph-mon[112184]: osdmap e69: 6 total, 5 up, 6 in 2024-04-13T11:05:43.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:42 smithi134 ceph-mon[112184]: pgmap v206: 65 pgs: 3 unknown, 4 peering, 16 active+undersized+degraded, 18 active+undersized, 24 active+clean; 241 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 52/255 objects degraded (20.392%) 2024-04-13T11:05:43.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:43 smithi194 ceph-mon[83053]: osdmap e70: 6 total, 5 up, 6 in 2024-04-13T11:05:44.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:43 smithi134 ceph-mon[112184]: osdmap e70: 6 total, 5 up, 6 in 2024-04-13T11:05:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:45 smithi194 ceph-mon[83053]: pgmap v208: 65 pgs: 3 active+clean+remapped, 2 unknown, 2 peering, 16 active+undersized+degraded, 18 active+undersized, 24 active+clean; 241 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 52/255 objects degraded (20.392%); 0 B/s, 67 objects/s recovering 2024-04-13T11:05:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:45 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:45 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:45 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:45 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:45.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:45 smithi134 ceph-mon[112184]: pgmap v208: 65 pgs: 3 active+clean+remapped, 2 unknown, 2 peering, 16 active+undersized+degraded, 18 active+undersized, 24 active+clean; 241 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 52/255 objects degraded (20.392%); 0 B/s, 67 objects/s recovering 2024-04-13T11:05:45.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:45 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:45.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:45 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:45.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:45 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:45.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:45 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:46.430 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:46 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[94265]: 2024-04-13T11:05:46.067+0000 7f1a6b5e17c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-04-13T11:05:46.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:46 smithi194 ceph-mon[83053]: from='osd.3 [v2:172.21.15.194:6800/1318422614,v1:172.21.15.194:6801/1318422614]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-13T11:05:46.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:46 smithi194 ceph-mon[83053]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-13T11:05:46.748 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:46 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[94265]: 2024-04-13T11:05:46.428+0000 7f1a6b5e17c0 -1 osd.3 63 log_to_monitors true 2024-04-13T11:05:46.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:46 smithi134 ceph-mon[112184]: from='osd.3 [v2:172.21.15.194:6800/1318422614,v1:172.21.15.194:6801/1318422614]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-13T11:05:46.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:46 smithi134 ceph-mon[112184]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-13T11:05:47.498 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:05:47 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[94265]: 2024-04-13T11:05:47.344+0000 7f1a58a33700 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T11:05:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:47 smithi134 ceph-mon[112184]: pgmap v209: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 18 active+undersized, 24 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 146 op/s; 52/267 objects degraded (19.476%); 10/267 objects misplaced (3.745%); 4.0 MiB/s, 93 objects/s recovering 2024-04-13T11:05:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:47 smithi134 ceph-mon[112184]: Health check update: Degraded data redundancy: 52/267 objects degraded (19.476%), 16 pgs degraded (PG_DEGRADED) 2024-04-13T11:05:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:47 smithi134 ceph-mon[112184]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-13T11:05:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:47 smithi134 ceph-mon[112184]: osdmap e71: 6 total, 5 up, 6 in 2024-04-13T11:05:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:47 smithi134 ceph-mon[112184]: from='osd.3 [v2:172.21.15.194:6800/1318422614,v1:172.21.15.194:6801/1318422614]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:05:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:47 smithi134 ceph-mon[112184]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:05:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:47 smithi134 ceph-mon[112184]: from='osd.3 ' entity='osd.3' 2024-04-13T11:05:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:47 smithi194 ceph-mon[83053]: pgmap v209: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 18 active+undersized, 24 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 146 op/s; 52/267 objects degraded (19.476%); 10/267 objects misplaced (3.745%); 4.0 MiB/s, 93 objects/s recovering 2024-04-13T11:05:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:47 smithi194 ceph-mon[83053]: Health check update: Degraded data redundancy: 52/267 objects degraded (19.476%), 16 pgs degraded (PG_DEGRADED) 2024-04-13T11:05:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:47 smithi194 ceph-mon[83053]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-13T11:05:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:47 smithi194 ceph-mon[83053]: osdmap e71: 6 total, 5 up, 6 in 2024-04-13T11:05:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:47 smithi194 ceph-mon[83053]: from='osd.3 [v2:172.21.15.194:6800/1318422614,v1:172.21.15.194:6801/1318422614]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:05:47.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:47 smithi194 ceph-mon[83053]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:05:47.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:47 smithi194 ceph-mon[83053]: from='osd.3 ' entity='osd.3' 2024-04-13T11:05:48.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:48 smithi134 ceph-mon[112184]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:05:49.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:48 smithi134 ceph-mon[112184]: osd.3 [v2:172.21.15.194:6800/1318422614,v1:172.21.15.194:6801/1318422614] boot 2024-04-13T11:05:49.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:48 smithi134 ceph-mon[112184]: osdmap e72: 6 total, 6 up, 6 in 2024-04-13T11:05:49.012 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:48 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T11:05:49.013 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:48 smithi194 ceph-mon[83053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:05:49.013 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:48 smithi194 ceph-mon[83053]: osd.3 [v2:172.21.15.194:6800/1318422614,v1:172.21.15.194:6801/1318422614] boot 2024-04-13T11:05:49.014 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:48 smithi194 ceph-mon[83053]: osdmap e72: 6 total, 6 up, 6 in 2024-04-13T11:05:49.014 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:48 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-13T11:05:49.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: pgmap v211: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 18 active+undersized, 24 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 141 op/s; 52/267 objects degraded (19.476%); 10/267 objects misplaced (3.745%); 3.8 MiB/s, 89 objects/s recovering 2024-04-13T11:05:49.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:49.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:49.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:05:49.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:05:49.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:49.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:05:49.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:49.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:49.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:49.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-13T11:05:49.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:49 smithi194 ceph-mon[83053]: osdmap e73: 6 total, 6 up, 6 in 2024-04-13T11:05:49.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: pgmap v211: 65 pgs: 7 active+clean+remapped, 16 active+undersized+degraded, 18 active+undersized, 24 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 141 op/s; 52/267 objects degraded (19.476%); 10/267 objects misplaced (3.745%); 3.8 MiB/s, 89 objects/s recovering 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-13T11:05:49.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:49 smithi134 ceph-mon[112184]: osdmap e73: 6 total, 6 up, 6 in 2024-04-13T11:05:50.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:50 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-13T11:05:50.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:50 smithi134 ceph-mon[112184]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-13T11:05:50.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:50 smithi134 ceph-mon[112184]: osdmap e74: 6 total, 6 up, 6 in 2024-04-13T11:05:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:50 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-13T11:05:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:50 smithi194 ceph-mon[83053]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-13T11:05:50.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:50 smithi194 ceph-mon[83053]: osdmap e74: 6 total, 6 up, 6 in 2024-04-13T11:05:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:51 smithi134 ceph-mon[112184]: pgmap v214: 65 pgs: 7 remapped+peering, 17 peering, 9 active+undersized+degraded, 8 active+undersized, 24 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 145 op/s; 28/267 objects degraded (10.487%); 4.0 MiB/s, 45 objects/s recovering 2024-04-13T11:05:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:51 smithi134 ceph-mon[112184]: osdmap e75: 6 total, 6 up, 6 in 2024-04-13T11:05:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:51 smithi194 ceph-mon[83053]: pgmap v214: 65 pgs: 7 remapped+peering, 17 peering, 9 active+undersized+degraded, 8 active+undersized, 24 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 145 op/s; 28/267 objects degraded (10.487%); 4.0 MiB/s, 45 objects/s recovering 2024-04-13T11:05:51.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:51 smithi194 ceph-mon[83053]: osdmap e75: 6 total, 6 up, 6 in 2024-04-13T11:05:52.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:52 smithi134 ceph-mon[112184]: Health check update: Degraded data redundancy: 28/267 objects degraded (10.487%), 9 pgs degraded (PG_DEGRADED) 2024-04-13T11:05:52.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:52 smithi134 ceph-mon[112184]: osdmap e76: 6 total, 6 up, 6 in 2024-04-13T11:05:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:52 smithi194 ceph-mon[83053]: Health check update: Degraded data redundancy: 28/267 objects degraded (10.487%), 9 pgs degraded (PG_DEGRADED) 2024-04-13T11:05:52.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:52 smithi194 ceph-mon[83053]: osdmap e76: 6 total, 6 up, 6 in 2024-04-13T11:05:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:53 smithi134 ceph-mon[112184]: pgmap v217: 65 pgs: 4 remapped+peering, 17 peering, 1 active+undersized+degraded, 3 active+undersized, 40 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 3/267 objects degraded (1.124%) 2024-04-13T11:05:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:05:53.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:53 smithi194 ceph-mon[83053]: pgmap v217: 65 pgs: 4 remapped+peering, 17 peering, 1 active+undersized+degraded, 3 active+undersized, 40 active+clean; 257 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 3/267 objects degraded (1.124%) 2024-04-13T11:05:53.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:05:53.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:05:54.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:54 smithi134 ceph-mon[112184]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/267 objects degraded (1.124%), 1 pg degraded) 2024-04-13T11:05:54.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:54 smithi194 ceph-mon[83053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/267 objects degraded (1.124%), 1 pg degraded) 2024-04-13T11:05:55.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:55 smithi134 ceph-mon[112184]: pgmap v219: 65 pgs: 2 remapped+peering, 2 peering, 61 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-04-13T11:05:55.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:55 smithi194 ceph-mon[83053]: pgmap v219: 65 pgs: 2 remapped+peering, 2 peering, 61 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-04-13T11:05:57.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:57 smithi134 ceph-mon[112184]: pgmap v220: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 2.0 MiB/s, 2 objects/s recovering 2024-04-13T11:05:57.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:57 smithi194 ceph-mon[83053]: pgmap v220: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 2.0 MiB/s, 2 objects/s recovering 2024-04-13T11:05:59.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:05:59 smithi134 ceph-mon[112184]: pgmap v221: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 1.6 MiB/s, 2 objects/s recovering 2024-04-13T11:05:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:05:59 smithi194 ceph-mon[83053]: pgmap v221: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 1.6 MiB/s, 2 objects/s recovering 2024-04-13T11:06:01.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:01 smithi134 ceph-mon[112184]: pgmap v222: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 1.4 MiB/s, 1 objects/s recovering 2024-04-13T11:06:01.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:01 smithi194 ceph-mon[83053]: pgmap v222: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 1.4 MiB/s, 1 objects/s recovering 2024-04-13T11:06:02.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.876+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/1371258272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb40ff320 msgr2=0x7fbdb40ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.876+0000 7fbdbaf6e700 1 --2- 172.21.15.134:0/1371258272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb40ff320 0x7fbdb40ff6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009940 tx=0x7fbda8009c50 comp rx=0 tx=0).stop 2024-04-13T11:06:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.876+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/1371258272 shutdown_connections 2024-04-13T11:06:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.876+0000 7fbdbaf6e700 1 --2- 172.21.15.134:0/1371258272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdb40ffc30 0x7fbdb410a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.876+0000 7fbdbaf6e700 1 --2- 172.21.15.134:0/1371258272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb40ff320 0x7fbdb40ff6f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.876+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/1371258272 >> 172.21.15.134:0/1371258272 conn(0x7fbdb40748b0 msgr2=0x7fbdb4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.876+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/1371258272 shutdown_connections 2024-04-13T11:06:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.876+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/1371258272 wait complete. 2024-04-13T11:06:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.876+0000 7fbdbaf6e700 1 Processor -- start 2024-04-13T11:06:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.876+0000 7fbdbaf6e700 1 -- start start 2024-04-13T11:06:02.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdbaf6e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdb40ff320 0x7fbdb4100500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdbaf6e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb40ffc30 0x7fbdb4100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdbaf6e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4100f80 con 0x7fbdb40ffc30 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdbaf6e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb41010c0 con 0x7fbdb40ff320 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb40ffc30 0x7fbdb4100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb40ffc30 0x7fbdb4100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54582/0 (socket says 172.21.15.134:54582) 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb3fff700 1 -- 172.21.15.134:0/344345876 learned_addr learned my addr 172.21.15.134:0/344345876 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb8d0a700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdb40ff320 0x7fbdb4100500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb3fff700 1 -- 172.21.15.134:0/344345876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdb40ff320 msgr2=0x7fbdb4100500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb3fff700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdb40ff320 0x7fbdb4100500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb3fff700 1 -- 172.21.15.134:0/344345876 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80095f0 con 0x7fbdb40ffc30 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb8d0a700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdb40ff320 0x7fbdb4100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb3fff700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb40ffc30 0x7fbdb4100a40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbda000c930 tx=0x7fbda000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:02.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb1ffb700 1 -- 172.21.15.134:0/344345876 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbda0007ad0 con 0x7fbdb40ffc30 2024-04-13T11:06:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb1ffb700 1 -- 172.21.15.134:0/344345876 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbda0007c30 con 0x7fbdb40ffc30 2024-04-13T11:06:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/344345876 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb41a1de0 con 0x7fbdb40ffc30 2024-04-13T11:06:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.877+0000 7fbdb1ffb700 1 -- 172.21.15.134:0/344345876 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbda0018630 con 0x7fbdb40ffc30 2024-04-13T11:06:02.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.878+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/344345876 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb41a2140 con 0x7fbdb40ffc30 2024-04-13T11:06:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.879+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/344345876 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb4107da0 con 0x7fbdb40ffc30 2024-04-13T11:06:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.879+0000 7fbdb1ffb700 1 -- 172.21.15.134:0/344345876 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fbda000f450 con 0x7fbdb40ffc30 2024-04-13T11:06:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.879+0000 7fbdb1ffb700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbda406cce0 0x7fbda406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.879+0000 7fbdb1ffb700 1 -- 172.21.15.134:0/344345876 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fbda008c7a0 con 0x7fbdb40ffc30 2024-04-13T11:06:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.879+0000 7fbdb8d0a700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbda406cce0 0x7fbda406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:02.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.880+0000 7fbdb8d0a700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbda406cce0 0x7fbda406f190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbda8005b40 tx=0x7fbda8005ad0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:02.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:02.884+0000 7fbdb1ffb700 1 -- 172.21.15.134:0/344345876 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fbda00568f0 con 0x7fbdb40ffc30 2024-04-13T11:06:03.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.100+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/344345876 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdb402ccf0 con 0x7fbda406cce0 2024-04-13T11:06:03.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.101+0000 7fbdb1ffb700 1 -- 172.21.15.134:0/344345876 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fbdb402ccf0 con 0x7fbda406cce0 2024-04-13T11:06:03.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.103+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/344345876 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbda406cce0 msgr2=0x7fbda406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.103+0000 7fbdbaf6e700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbda406cce0 0x7fbda406f190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbda8005b40 tx=0x7fbda8005ad0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.103+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/344345876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb40ffc30 msgr2=0x7fbdb4100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.103+0000 7fbdbaf6e700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb40ffc30 0x7fbdb4100a40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbda000c930 tx=0x7fbda000ccf0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.103+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/344345876 shutdown_connections 2024-04-13T11:06:03.104 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.103+0000 7fbdbaf6e700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbda406cce0 0x7fbda406f190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.103+0000 7fbdbaf6e700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdb40ff320 0x7fbdb4100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.103+0000 7fbdbaf6e700 1 --2- 172.21.15.134:0/344345876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdb40ffc30 0x7fbdb4100a40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.103+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/344345876 >> 172.21.15.134:0/344345876 conn(0x7fbdb40748b0 msgr2=0x7fbdb4104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.104+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/344345876 shutdown_connections 2024-04-13T11:06:03.105 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.104+0000 7fbdbaf6e700 1 -- 172.21.15.134:0/344345876 wait complete. 2024-04-13T11:06:03.115 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:06:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.209+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/471200359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e18101c50 msgr2=0x7f1e1810a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.209+0000 7f1e1cbb3700 1 --2- 172.21.15.134:0/471200359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e18101c50 0x7f1e1810a150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009940 tx=0x7f1e08009c50 comp rx=0 tx=0).stop 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.209+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/471200359 shutdown_connections 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.209+0000 7f1e1cbb3700 1 --2- 172.21.15.134:0/471200359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e18101c50 0x7f1e1810a150 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.209+0000 7f1e1cbb3700 1 --2- 172.21.15.134:0/471200359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e18101340 0x7f1e18101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.209+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/471200359 >> 172.21.15.134:0/471200359 conn(0x7f1e180fab80 msgr2=0x7f1e180fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.209+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/471200359 shutdown_connections 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.209+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/471200359 wait complete. 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e1cbb3700 1 Processor -- start 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e1cbb3700 1 -- start start 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e1cbb3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e18101340 0x7f1e180fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e1cbb3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e18101c50 0x7f1e180ff4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e1cbb3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180ffa20 con 0x7f1e18101c50 2024-04-13T11:06:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e1cbb3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180ffb60 con 0x7f1e18101340 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e15d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e18101c50 0x7f1e180ff4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e15d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e18101c50 0x7f1e180ff4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54602/0 (socket says 172.21.15.134:54602) 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e15d9b700 1 -- 172.21.15.134:0/4152697913 learned_addr learned my addr 172.21.15.134:0/4152697913 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e1659c700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e18101340 0x7f1e180fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e15d9b700 1 -- 172.21.15.134:0/4152697913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e18101340 msgr2=0x7f1e180fefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e15d9b700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e18101340 0x7f1e180fefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e15d9b700 1 -- 172.21.15.134:0/4152697913 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080095f0 con 0x7f1e18101c50 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e1659c700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e18101340 0x7f1e180fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.210+0000 7f1e15d9b700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e18101c50 0x7f1e180ff4e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800b7d0 tx=0x7f1e080056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.211+0000 7f1e077fe700 1 -- 172.21.15.134:0/4152697913 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e0801d070 con 0x7f1e18101c50 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.211+0000 7f1e077fe700 1 -- 172.21.15.134:0/4152697913 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e0800f460 con 0x7f1e18101c50 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.211+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/4152697913 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e180ffde0 con 0x7f1e18101c50 2024-04-13T11:06:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.211+0000 7f1e077fe700 1 -- 172.21.15.134:0/4152697913 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e08021640 con 0x7f1e18101c50 2024-04-13T11:06:03.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.211+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/4152697913 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e181a22b0 con 0x7f1e18101c50 2024-04-13T11:06:03.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.212+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/4152697913 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e181077c0 con 0x7f1e18101c50 2024-04-13T11:06:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.212+0000 7f1e077fe700 1 -- 172.21.15.134:0/4152697913 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1e0800fa40 con 0x7f1e18101c50 2024-04-13T11:06:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.212+0000 7f1e077fe700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e0006cce0 0x7f1e0006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.212+0000 7f1e077fe700 1 -- 172.21.15.134:0/4152697913 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f1e0808d8a0 con 0x7f1e18101c50 2024-04-13T11:06:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.212+0000 7f1e1659c700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e0006cce0 0x7f1e0006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.213+0000 7f1e1659c700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e0006cce0 0x7f1e0006f190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0099d0 tx=0x7f1e0c008040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:03.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.217+0000 7f1e077fe700 1 -- 172.21.15.134:0/4152697913 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f1e08057940 con 0x7f1e18101c50 2024-04-13T11:06:03.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.442+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/4152697913 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e1802cca0 con 0x7f1e0006cce0 2024-04-13T11:06:03.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.444+0000 7f1e077fe700 1 -- 172.21.15.134:0/4152697913 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1e1802cca0 con 0x7f1e0006cce0 2024-04-13T11:06:03.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/4152697913 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e0006cce0 msgr2=0x7f1e0006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e0006cce0 0x7f1e0006f190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0099d0 tx=0x7f1e0c008040 comp rx=0 tx=0).stop 2024-04-13T11:06:03.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/4152697913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e18101c50 msgr2=0x7f1e180ff4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e18101c50 0x7f1e180ff4e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800b7d0 tx=0x7f1e080056a0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/4152697913 shutdown_connections 2024-04-13T11:06:03.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1e0006cce0 0x7f1e0006f190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e18101340 0x7f1e180fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 --2- 172.21.15.134:0/4152697913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e18101c50 0x7f1e180ff4e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/4152697913 >> 172.21.15.134:0/4152697913 conn(0x7f1e180fab80 msgr2=0x7f1e18104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:03.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/4152697913 shutdown_connections 2024-04-13T11:06:03.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.446+0000 7f1e1cbb3700 1 -- 172.21.15.134:0/4152697913 wait complete. 2024-04-13T11:06:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.551+0000 7fc8ef0df700 1 -- 172.21.15.134:0/1272157253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8068fd0 msgr2=0x7fc8e8104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.551+0000 7fc8ef0df700 1 --2- 172.21.15.134:0/1272157253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8068fd0 0x7fc8e8104df0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009910 tx=0x7fc8d4009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 -- 172.21.15.134:0/1272157253 shutdown_connections 2024-04-13T11:06:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 --2- 172.21.15.134:0/1272157253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8068fd0 0x7fc8e8104df0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 --2- 172.21.15.134:0/1272157253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e8068630 0x7fc8e8068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 -- 172.21.15.134:0/1272157253 >> 172.21.15.134:0/1272157253 conn(0x7fc8e8074f50 msgr2=0x7fc8e8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 -- 172.21.15.134:0/1272157253 shutdown_connections 2024-04-13T11:06:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 -- 172.21.15.134:0/1272157253 wait complete. 2024-04-13T11:06:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 Processor -- start 2024-04-13T11:06:03.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 -- start start 2024-04-13T11:06:03.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8068630 0x7fc8e80ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:03.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e8068fd0 0x7fc8e80ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:03.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80ffc80 con 0x7fc8e8068630 2024-04-13T11:06:03.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ef0df700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80ffdc0 con 0x7fc8e8068fd0 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ece7b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8068630 0x7fc8e80ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ece7b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8068630 0x7fc8e80ff200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54622/0 (socket says 172.21.15.134:54622) 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.552+0000 7fc8ece7b700 1 -- 172.21.15.134:0/864464431 learned_addr learned my addr 172.21.15.134:0/864464431 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.553+0000 7fc8e7fff700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e8068fd0 0x7fc8e80ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.553+0000 7fc8ece7b700 1 -- 172.21.15.134:0/864464431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e8068fd0 msgr2=0x7fc8e80ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.553+0000 7fc8ece7b700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e8068fd0 0x7fc8e80ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.553+0000 7fc8ece7b700 1 -- 172.21.15.134:0/864464431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d40095f0 con 0x7fc8e8068630 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.553+0000 7fc8ece7b700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8068630 0x7fc8e80ff200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00c930 tx=0x7fc8dc00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.553+0000 7fc8e5ffb700 1 -- 172.21.15.134:0/864464431 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8dc007ad0 con 0x7fc8e8068630 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.553+0000 7fc8e5ffb700 1 -- 172.21.15.134:0/864464431 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8dc007c30 con 0x7fc8e8068630 2024-04-13T11:06:03.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.553+0000 7fc8ef0df700 1 -- 172.21.15.134:0/864464431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e81a1f30 con 0x7fc8e8068630 2024-04-13T11:06:03.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.553+0000 7fc8e5ffb700 1 -- 172.21.15.134:0/864464431 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8dc018630 con 0x7fc8e8068630 2024-04-13T11:06:03.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.553+0000 7fc8ef0df700 1 -- 172.21.15.134:0/864464431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e81a2290 con 0x7fc8e8068630 2024-04-13T11:06:03.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.554+0000 7fc8ef0df700 1 -- 172.21.15.134:0/864464431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e81086d0 con 0x7fc8e8068630 2024-04-13T11:06:03.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.554+0000 7fc8e5ffb700 1 -- 172.21.15.134:0/864464431 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc8dc00f450 con 0x7fc8e8068630 2024-04-13T11:06:03.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.555+0000 7fc8e5ffb700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc8d806cce0 0x7fc8d806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:03.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.555+0000 7fc8e5ffb700 1 -- 172.21.15.134:0/864464431 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fc8dc08c7a0 con 0x7fc8e8068630 2024-04-13T11:06:03.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.555+0000 7fc8e7fff700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc8d806cce0 0x7fc8d806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:03.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.555+0000 7fc8e7fff700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc8d806cce0 0x7fc8d806f190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc8e81009f0 tx=0x7fc8d401a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:03.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.559+0000 7fc8e5ffb700 1 -- 172.21.15.134:0/864464431 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fc8dc056910 con 0x7fc8e8068630 2024-04-13T11:06:03.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.767+0000 7fc8ef0df700 1 -- 172.21.15.134:0/864464431 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8e802cca0 con 0x7fc8d806cce0 2024-04-13T11:06:03.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.777+0000 7fc8e5ffb700 1 -- 172.21.15.134:0/864464431 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc8e802cca0 con 0x7fc8d806cce0 2024-04-13T11:06:03.778 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:06:03.778 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (4m) 53s ago 16m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:06:03.778 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (16m) 53s ago 16m 8300k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (15m) 19s ago 15m 7968k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (2m) 53s ago 16m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (2m) 19s ago 15m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (4m) 53s ago 16m 88.2M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (10m) 53s ago 10m 90.0M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (10m) 53s ago 10m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (10m) 19s ago 10m 17.0M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (10m) 19s ago 10m 20.5M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (7m) 53s ago 17m 507M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (6m) 19s ago 15m 453M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (3m) 53s ago 18m 45.2M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (2m) 19s ago 15m 38.4M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 53s ago 16m 18.4M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:06:03.779 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (5m) 19s ago 15m 17.3M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:06:03.780 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (2m) 53s ago 14m 92.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:06:03.780 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (96s) 53s ago 13m 88.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e fc8474d8910f 2024-04-13T11:06:03.780 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (60s) 53s ago 13m 11.5M 1227M 18.2.2-1173-g5108bc67 3464fd31103e b24ce165bc9f 2024-04-13T11:06:03.780 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (23s) 19s ago 12m 13.6M 2251M 18.2.2-1173-g5108bc67 3464fd31103e d909c0e8d077 2024-04-13T11:06:03.780 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (12m) 19s ago 12m 221M 2251M 18.2.0 dc2bc1663786 ad80938ec079 2024-04-13T11:06:03.780 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (11m) 19s ago 11m 232M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:06:03.780 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 53s ago 15m 66.8M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.779+0000 7fc8ef0df700 1 -- 172.21.15.134:0/864464431 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc8d806cce0 msgr2=0x7fc8d806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.779+0000 7fc8ef0df700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc8d806cce0 0x7fc8d806f190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc8e81009f0 tx=0x7fc8d401a040 comp rx=0 tx=0).stop 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.779+0000 7fc8ef0df700 1 -- 172.21.15.134:0/864464431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8068630 msgr2=0x7fc8e80ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.779+0000 7fc8ef0df700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8068630 0x7fc8e80ff200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00c930 tx=0x7fc8dc00ccf0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.780+0000 7fc8ef0df700 1 -- 172.21.15.134:0/864464431 shutdown_connections 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.780+0000 7fc8ef0df700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc8d806cce0 0x7fc8d806f190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.780+0000 7fc8ef0df700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e8068630 0x7fc8e80ff200 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.780+0000 7fc8ef0df700 1 --2- 172.21.15.134:0/864464431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e8068fd0 0x7fc8e80ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.780+0000 7fc8ef0df700 1 -- 172.21.15.134:0/864464431 >> 172.21.15.134:0/864464431 conn(0x7fc8e8074f50 msgr2=0x7fc8e80fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.780+0000 7fc8ef0df700 1 -- 172.21.15.134:0/864464431 shutdown_connections 2024-04-13T11:06:03.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.780+0000 7fc8ef0df700 1 -- 172.21.15.134:0/864464431 wait complete. 2024-04-13T11:06:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.882+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2115683970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4101c90 msgr2=0x7fd5d410a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.882+0000 7fd5da1bb700 1 --2- 172.21.15.134:0/2115683970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4101c90 0x7fd5d410a190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009910 tx=0x7fd5c8009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.882+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2115683970 shutdown_connections 2024-04-13T11:06:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.882+0000 7fd5da1bb700 1 --2- 172.21.15.134:0/2115683970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4101c90 0x7fd5d410a190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.882+0000 7fd5da1bb700 1 --2- 172.21.15.134:0/2115683970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d4101380 0x7fd5d4101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.882+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2115683970 >> 172.21.15.134:0/2115683970 conn(0x7fd5d40fab80 msgr2=0x7fd5d40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.882+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2115683970 shutdown_connections 2024-04-13T11:06:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.882+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2115683970 wait complete. 2024-04-13T11:06:03.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.882+0000 7fd5da1bb700 1 Processor -- start 2024-04-13T11:06:03.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.882+0000 7fd5da1bb700 1 -- start start 2024-04-13T11:06:03.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5da1bb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4101380 0x7fd5d40fefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:03.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5da1bb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d4101c90 0x7fd5d40ff520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:03.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5da1bb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d40ffa60 con 0x7fd5d4101380 2024-04-13T11:06:03.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5da1bb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d40ffba0 con 0x7fd5d4101c90 2024-04-13T11:06:03.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4101380 0x7fd5d40fefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:03.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4101380 0x7fd5d40fefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54642/0 (socket says 172.21.15.134:54642) 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d37fe700 1 -- 172.21.15.134:0/2654810571 learned_addr learned my addr 172.21.15.134:0/2654810571 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d2ffd700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d4101c90 0x7fd5d40ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d37fe700 1 -- 172.21.15.134:0/2654810571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d4101c90 msgr2=0x7fd5d40ff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d37fe700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d4101c90 0x7fd5d40ff520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d37fe700 1 -- 172.21.15.134:0/2654810571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80095f0 con 0x7fd5d4101380 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d37fe700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4101380 0x7fd5d40fefe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400b4b0 tx=0x7fd5c400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d0ff9700 1 -- 172.21.15.134:0/2654810571 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c4011800 con 0x7fd5d4101380 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d0ff9700 1 -- 172.21.15.134:0/2654810571 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5c4011e00 con 0x7fd5d4101380 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2654810571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d41a1f40 con 0x7fd5d4101380 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.883+0000 7fd5d0ff9700 1 -- 172.21.15.134:0/2654810571 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5c4010e50 con 0x7fd5d4101380 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.884+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2654810571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d41a2350 con 0x7fd5d4101380 2024-04-13T11:06:03.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.884+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2654810571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d4107800 con 0x7fd5d4101380 2024-04-13T11:06:03.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.885+0000 7fd5d0ff9700 1 -- 172.21.15.134:0/2654810571 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd5c4010380 con 0x7fd5d4101380 2024-04-13T11:06:03.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.885+0000 7fd5d0ff9700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd5bc06cce0 0x7fd5bc06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:03.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.885+0000 7fd5d0ff9700 1 -- 172.21.15.134:0/2654810571 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fd5c408c120 con 0x7fd5d4101380 2024-04-13T11:06:03.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.886+0000 7fd5d2ffd700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd5bc06cce0 0x7fd5bc06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:03.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.886+0000 7fd5d2ffd700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd5bc06cce0 0x7fd5bc06f190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd5d41007d0 tx=0x7fd5c801a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:03.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:03.890+0000 7fd5d0ff9700 1 -- 172.21.15.134:0/2654810571 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fd5c40561c0 con 0x7fd5d4101380 2024-04-13T11:06:03.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:03 smithi134 ceph-mon[112184]: pgmap v223: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 1.2 MiB/s, 55 objects/s recovering 2024-04-13T11:06:03.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:03 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:03 smithi194 ceph-mon[83053]: pgmap v223: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 1.2 MiB/s, 55 objects/s recovering 2024-04-13T11:06:03.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:03 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.169+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2654810571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd5d402cc30 con 0x7fd5d4101380 2024-04-13T11:06:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.169+0000 7fd5d0ff9700 1 -- 172.21.15.134:0/2654810571 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fd5c40597e0 con 0x7fd5d4101380 2024-04-13T11:06:04.170 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:06:04.170 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:06:04.170 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:06:04.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 4 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 8 2024-04-13T11:06:04.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:06:04.172 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:06:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.171+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2654810571 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd5bc06cce0 msgr2=0x7fd5bc06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.171+0000 7fd5da1bb700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd5bc06cce0 0x7fd5bc06f190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd5d41007d0 tx=0x7fd5c801a040 comp rx=0 tx=0).stop 2024-04-13T11:06:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.171+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2654810571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4101380 msgr2=0x7fd5d40fefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.171+0000 7fd5da1bb700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4101380 0x7fd5d40fefe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400b4b0 tx=0x7fd5c400b870 comp rx=0 tx=0).stop 2024-04-13T11:06:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.172+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2654810571 shutdown_connections 2024-04-13T11:06:04.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.172+0000 7fd5da1bb700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd5bc06cce0 0x7fd5bc06f190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.172+0000 7fd5da1bb700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5d4101380 0x7fd5d40fefe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.172+0000 7fd5da1bb700 1 --2- 172.21.15.134:0/2654810571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d4101c90 0x7fd5d40ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.172+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2654810571 >> 172.21.15.134:0/2654810571 conn(0x7fd5d40fab80 msgr2=0x7fd5d4104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:04.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.172+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2654810571 shutdown_connections 2024-04-13T11:06:04.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.172+0000 7fd5da1bb700 1 -- 172.21.15.134:0/2654810571 wait complete. 2024-04-13T11:06:04.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.276+0000 7ff499318700 1 -- 172.21.15.134:0/1968975699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff494100380 msgr2=0x7ff494100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.276+0000 7ff499318700 1 --2- 172.21.15.134:0/1968975699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff494100380 0x7ff494100750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009910 tx=0x7ff47c009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:04.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.276+0000 7ff499318700 1 -- 172.21.15.134:0/1968975699 shutdown_connections 2024-04-13T11:06:04.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.276+0000 7ff499318700 1 --2- 172.21.15.134:0/1968975699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff494100c90 0x7ff4941093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.276+0000 7ff499318700 1 --2- 172.21.15.134:0/1968975699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff494100380 0x7ff494100750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.277 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.276+0000 7ff499318700 1 -- 172.21.15.134:0/1968975699 >> 172.21.15.134:0/1968975699 conn(0x7ff494074850 msgr2=0x7ff494074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:04.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.276+0000 7ff499318700 1 -- 172.21.15.134:0/1968975699 shutdown_connections 2024-04-13T11:06:04.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.276+0000 7ff499318700 1 -- 172.21.15.134:0/1968975699 wait complete. 2024-04-13T11:06:04.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.277+0000 7ff499318700 1 Processor -- start 2024-04-13T11:06:04.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.277+0000 7ff499318700 1 -- start start 2024-04-13T11:06:04.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.277+0000 7ff499318700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff494100380 0x7ff49419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:04.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.277+0000 7ff499318700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff494100c90 0x7ff49419ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:04.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.277+0000 7ff499318700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49419b490 con 0x7ff494100380 2024-04-13T11:06:04.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.277+0000 7ff499318700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff494194940 con 0x7ff494100c90 2024-04-13T11:06:04.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.277+0000 7ff492ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff494100380 0x7ff49419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:04.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.277+0000 7ff492ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff494100380 0x7ff49419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54650/0 (socket says 172.21.15.134:54650) 2024-04-13T11:06:04.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.277+0000 7ff492ffd700 1 -- 172.21.15.134:0/365651616 learned_addr learned my addr 172.21.15.134:0/365651616 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:04.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.277+0000 7ff4927fc700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff494100c90 0x7ff49419ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.278+0000 7ff492ffd700 1 -- 172.21.15.134:0/365651616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff494100c90 msgr2=0x7ff49419ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.278+0000 7ff492ffd700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff494100c90 0x7ff49419ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.278+0000 7ff492ffd700 1 -- 172.21.15.134:0/365651616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0095f0 con 0x7ff494100380 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.278+0000 7ff4927fc700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff494100c90 0x7ff49419ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.278+0000 7ff492ffd700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff494100380 0x7ff49419a8c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0055f0 tx=0x7ff47c0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.278+0000 7ff48bfff700 1 -- 172.21.15.134:0/365651616 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47c01d070 con 0x7ff494100380 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.278+0000 7ff48bfff700 1 -- 172.21.15.134:0/365651616 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff47c00be90 con 0x7ff494100380 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.278+0000 7ff499318700 1 -- 172.21.15.134:0/365651616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff494194c20 con 0x7ff494100380 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.278+0000 7ff48bfff700 1 -- 172.21.15.134:0/365651616 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47c021410 con 0x7ff494100380 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.278+0000 7ff499318700 1 -- 172.21.15.134:0/365651616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff494195170 con 0x7ff494100380 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.279+0000 7ff499318700 1 -- 172.21.15.134:0/365651616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff494106ac0 con 0x7ff494100380 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.279+0000 7ff48bfff700 1 -- 172.21.15.134:0/365651616 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff47c00f460 con 0x7ff494100380 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.280+0000 7ff48bfff700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff48006cce0 0x7ff48006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:04.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.280+0000 7ff48bfff700 1 -- 172.21.15.134:0/365651616 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6273+0+0 (secure 0 0 0) 0x7ff47c08d7c0 con 0x7ff494100380 2024-04-13T11:06:04.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.280+0000 7ff4927fc700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff48006cce0 0x7ff48006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:04.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.280+0000 7ff4927fc700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff48006cce0 0x7ff48006f190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff484005950 tx=0x7ff4840058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:04.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.284+0000 7ff48bfff700 1 -- 172.21.15.134:0/365651616 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7ff47c05b2f0 con 0x7ff494100380 2024-04-13T11:06:04.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.523+0000 7ff499318700 1 -- 172.21.15.134:0/365651616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff49404ea50 con 0x7ff494100380 2024-04-13T11:06:04.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.523+0000 7ff48bfff700 1 -- 172.21.15.134:0/365651616 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1880 (secure 0 0 0) 0x7ff47c05ae80 con 0x7ff494100380 2024-04-13T11:06:04.524 INFO:teuthology.orchestra.run.smithi134.stdout:e18 2024-04-13T11:06:04.524 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:06:04.524 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:06:04.524 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 18 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T10:55:58.861624+0000 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:06:04.525 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14492} 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:06:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:06:04.527 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:06:04.527 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:06:04.527 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:06:04.527 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:06:04.527 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:06:04.527 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:06:04.527 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:06:04.527 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:06:04.527 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:06:04.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.525+0000 7ff499318700 1 -- 172.21.15.134:0/365651616 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff48006cce0 msgr2=0x7ff48006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.525+0000 7ff499318700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff48006cce0 0x7ff48006f190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff484005950 tx=0x7ff4840058e0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.525+0000 7ff499318700 1 -- 172.21.15.134:0/365651616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff494100380 msgr2=0x7ff49419a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.525+0000 7ff499318700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff494100380 0x7ff49419a8c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0055f0 tx=0x7ff47c0056d0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.525+0000 7ff499318700 1 -- 172.21.15.134:0/365651616 shutdown_connections 2024-04-13T11:06:04.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.525+0000 7ff499318700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff48006cce0 0x7ff48006f190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.525+0000 7ff499318700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff494100380 0x7ff49419a8c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.525+0000 7ff499318700 1 --2- 172.21.15.134:0/365651616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff494100c90 0x7ff49419ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.525+0000 7ff499318700 1 -- 172.21.15.134:0/365651616 >> 172.21.15.134:0/365651616 conn(0x7ff494074850 msgr2=0x7ff494103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:04.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.526+0000 7ff499318700 1 -- 172.21.15.134:0/365651616 shutdown_connections 2024-04-13T11:06:04.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.526+0000 7ff499318700 1 -- 172.21.15.134:0/365651616 wait complete. 2024-04-13T11:06:04.529 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T11:06:04.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.631+0000 7efdc2dc7700 1 -- 172.21.15.134:0/1791858632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdbc0ff390 msgr2=0x7efdbc0ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.631+0000 7efdc2dc7700 1 --2- 172.21.15.134:0/1791858632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdbc0ff390 0x7efdbc0ff760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009910 tx=0x7efdb0009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:04.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.631+0000 7efdc2dc7700 1 -- 172.21.15.134:0/1791858632 shutdown_connections 2024-04-13T11:06:04.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.631+0000 7efdc2dc7700 1 --2- 172.21.15.134:0/1791858632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdbc0ffd30 0x7efdbc103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.631+0000 7efdc2dc7700 1 --2- 172.21.15.134:0/1791858632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdbc0ff390 0x7efdbc0ff760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.631+0000 7efdc2dc7700 1 -- 172.21.15.134:0/1791858632 >> 172.21.15.134:0/1791858632 conn(0x7efdbc074f50 msgr2=0x7efdbc075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:04.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.631+0000 7efdc2dc7700 1 -- 172.21.15.134:0/1791858632 shutdown_connections 2024-04-13T11:06:04.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.631+0000 7efdc2dc7700 1 -- 172.21.15.134:0/1791858632 wait complete. 2024-04-13T11:06:04.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.631+0000 7efdc2dc7700 1 Processor -- start 2024-04-13T11:06:04.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.631+0000 7efdc2dc7700 1 -- start start 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc2dc7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdbc0ff390 0x7efdbc197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc2dc7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdbc0ffd30 0x7efdbc1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc2dc7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc198a80 con 0x7efdbc0ff390 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc2dc7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc19c810 con 0x7efdbc0ffd30 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc0b63700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdbc0ff390 0x7efdbc197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc0b63700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdbc0ff390 0x7efdbc197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54674/0 (socket says 172.21.15.134:54674) 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc0b63700 1 -- 172.21.15.134:0/296898817 learned_addr learned my addr 172.21.15.134:0/296898817 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdbbfff700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdbc0ffd30 0x7efdbc1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc0b63700 1 -- 172.21.15.134:0/296898817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdbc0ffd30 msgr2=0x7efdbc1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc0b63700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdbc0ffd30 0x7efdbc1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc0b63700 1 -- 172.21.15.134:0/296898817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00095f0 con 0x7efdbc0ff390 2024-04-13T11:06:04.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc0b63700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdbc0ff390 0x7efdbc197e60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efdb0000c00 tx=0x7efdb000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:04.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdb9ffb700 1 -- 172.21.15.134:0/296898817 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb001d070 con 0x7efdbc0ff390 2024-04-13T11:06:04.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdb9ffb700 1 -- 172.21.15.134:0/296898817 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efdb0005710 con 0x7efdbc0ff390 2024-04-13T11:06:04.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdc2dc7700 1 -- 172.21.15.134:0/296898817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc19ca90 con 0x7efdbc0ff390 2024-04-13T11:06:04.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.632+0000 7efdb9ffb700 1 -- 172.21.15.134:0/296898817 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb00039d0 con 0x7efdbc0ff390 2024-04-13T11:06:04.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.633+0000 7efdc2dc7700 1 -- 172.21.15.134:0/296898817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc19cf20 con 0x7efdbc0ff390 2024-04-13T11:06:04.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.634+0000 7efdc2dc7700 1 -- 172.21.15.134:0/296898817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc04ea50 con 0x7efdbc0ff390 2024-04-13T11:06:04.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.634+0000 7efdb9ffb700 1 -- 172.21.15.134:0/296898817 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7efdb0003c00 con 0x7efdbc0ff390 2024-04-13T11:06:04.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.634+0000 7efdb9ffb700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efdac06cce0 0x7efdac06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:04.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.635+0000 7efdbbfff700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efdac06cce0 0x7efdac06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:04.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.635+0000 7efdb9ffb700 1 -- 172.21.15.134:0/296898817 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6273+0+0 (secure 0 0 0) 0x7efdb008dab0 con 0x7efdbc0ff390 2024-04-13T11:06:04.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.635+0000 7efdbbfff700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efdac06cce0 0x7efdac06f190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efdbc199480 tx=0x7efda8009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:04.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.639+0000 7efdb9ffb700 1 -- 172.21.15.134:0/296898817 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7efdb0057d20 con 0x7efdbc0ff390 2024-04-13T11:06:04.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.854+0000 7efdc2dc7700 1 -- 172.21.15.134:0/296898817 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdbc19d4f0 con 0x7efdac06cce0 2024-04-13T11:06:04.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.855+0000 7efdb9ffb700 1 -- 172.21.15.134:0/296898817 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7efdbc19d4f0 con 0x7efdac06cce0 2024-04-13T11:06:04.856 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:06:04.856 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:06:04.856 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:06:04.856 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:06:04.856 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:06:04.857 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-04-13T11:06:04.857 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:06:04.857 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-04-13T11:06:04.857 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:06:04.857 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "10/23 daemons upgraded", 2024-04-13T11:06:04.857 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-04-13T11:06:04.857 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:06:04.857 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 -- 172.21.15.134:0/296898817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efdac06cce0 msgr2=0x7efdac06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efdac06cce0 0x7efdac06f190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efdbc199480 tx=0x7efda8009260 comp rx=0 tx=0).stop 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 -- 172.21.15.134:0/296898817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdbc0ff390 msgr2=0x7efdbc197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdbc0ff390 0x7efdbc197e60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efdb0000c00 tx=0x7efdb000bde0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 -- 172.21.15.134:0/296898817 shutdown_connections 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efdac06cce0 0x7efdac06f190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdbc0ff390 0x7efdbc197e60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 --2- 172.21.15.134:0/296898817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdbc0ffd30 0x7efdbc1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 -- 172.21.15.134:0/296898817 >> 172.21.15.134:0/296898817 conn(0x7efdbc074f50 msgr2=0x7efdbc068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 -- 172.21.15.134:0/296898817 shutdown_connections 2024-04-13T11:06:04.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.858+0000 7efdc2dc7700 1 -- 172.21.15.134:0/296898817 wait complete. 2024-04-13T11:06:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:04 smithi134 ceph-mon[112184]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:04 smithi134 ceph-mon[112184]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:04 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2654810571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:04 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-13T11:06:04.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:04 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/365651616' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:06:04.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.960+0000 7ffbb9211700 1 -- 172.21.15.134:0/4184038021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb4100d70 msgr2=0x7ffbb4104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.960+0000 7ffbb9211700 1 --2- 172.21.15.134:0/4184038021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb4100d70 0x7ffbb4104d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009910 tx=0x7ffba4009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.961+0000 7ffbb9211700 1 -- 172.21.15.134:0/4184038021 shutdown_connections 2024-04-13T11:06:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.961+0000 7ffbb9211700 1 --2- 172.21.15.134:0/4184038021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb4100d70 0x7ffbb4104d40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.961+0000 7ffbb9211700 1 --2- 172.21.15.134:0/4184038021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbb41003d0 0x7ffbb41007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.961+0000 7ffbb9211700 1 -- 172.21.15.134:0/4184038021 >> 172.21.15.134:0/4184038021 conn(0x7ffbb40fbc90 msgr2=0x7ffbb40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.961+0000 7ffbb9211700 1 -- 172.21.15.134:0/4184038021 shutdown_connections 2024-04-13T11:06:04.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.961+0000 7ffbb9211700 1 -- 172.21.15.134:0/4184038021 wait complete. 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.961+0000 7ffbb9211700 1 Processor -- start 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb9211700 1 -- start start 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb9211700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbb41003d0 0x7ffbb419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb9211700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb4100d70 0x7ffbb419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb9211700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb419c630 con 0x7ffbb4100d70 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb9211700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb4195ae0 con 0x7ffbb41003d0 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb4100d70 0x7ffbb419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb2d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbb41003d0 0x7ffbb419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb4100d70 0x7ffbb419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54684/0 (socket says 172.21.15.134:54684) 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb259c700 1 -- 172.21.15.134:0/3483896357 learned_addr learned my addr 172.21.15.134:0/3483896357 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:04.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb259c700 1 -- 172.21.15.134:0/3483896357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbb41003d0 msgr2=0x7ffbb419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:04.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb259c700 1 --2- 172.21.15.134:0/3483896357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbb41003d0 0x7ffbb419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:04.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb259c700 1 -- 172.21.15.134:0/3483896357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba40095f0 con 0x7ffbb4100d70 2024-04-13T11:06:04.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffbb259c700 1 --2- 172.21.15.134:0/3483896357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb4100d70 0x7ffbb419bfa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffba40092e0 tx=0x7ffba400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:04.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.962+0000 7ffb9bfff700 1 -- 172.21.15.134:0/3483896357 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffba401d070 con 0x7ffbb4100d70 2024-04-13T11:06:04.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.963+0000 7ffb9bfff700 1 -- 172.21.15.134:0/3483896357 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffba4005dc0 con 0x7ffbb4100d70 2024-04-13T11:06:04.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.963+0000 7ffbb9211700 1 -- 172.21.15.134:0/3483896357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb4195d60 con 0x7ffbb4100d70 2024-04-13T11:06:04.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.963+0000 7ffb9bfff700 1 -- 172.21.15.134:0/3483896357 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffba400fea0 con 0x7ffbb4100d70 2024-04-13T11:06:04.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.963+0000 7ffbb9211700 1 -- 172.21.15.134:0/3483896357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb4196250 con 0x7ffbb4100d70 2024-04-13T11:06:04.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.964+0000 7ffbb9211700 1 -- 172.21.15.134:0/3483896357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb4108740 con 0x7ffbb4100d70 2024-04-13T11:06:04.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.964+0000 7ffb9bfff700 1 -- 172.21.15.134:0/3483896357 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ffba4003a60 con 0x7ffbb4100d70 2024-04-13T11:06:04.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.964+0000 7ffb9bfff700 1 --2- 172.21.15.134:0/3483896357 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ffb9c06cce0 0x7ffb9c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:04.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.965+0000 7ffb9bfff700 1 -- 172.21.15.134:0/3483896357 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6273+0+0 (secure 0 0 0) 0x7ffba408d710 con 0x7ffbb4100d70 2024-04-13T11:06:04.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.965+0000 7ffbb2d9d700 1 --2- 172.21.15.134:0/3483896357 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ffb9c06cce0 0x7ffb9c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:04.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.965+0000 7ffbb2d9d700 1 --2- 172.21.15.134:0/3483896357 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ffb9c06cce0 0x7ffb9c06f190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffba8005950 tx=0x7ffba800b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:04.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:04.969+0000 7ffb9bfff700 1 -- 172.21.15.134:0/3483896357 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7ffba405b240 con 0x7ffbb4100d70 2024-04-13T11:06:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:04 smithi194 ceph-mon[83053]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:04 smithi194 ceph-mon[83053]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:04 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2654810571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:04.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:04 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-13T11:06:04.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:04 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/365651616' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:06:05.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.246+0000 7ffbb9211700 1 -- 172.21.15.134:0/3483896357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ffbb404ea50 con 0x7ffbb4100d70 2024-04-13T11:06:05.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.246+0000 7ffb9bfff700 1 -- 172.21.15.134:0/3483896357 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ffba4003d10 con 0x7ffbb4100d70 2024-04-13T11:06:05.247 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:06:05.247 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:06:05.247 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:06:05.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.248+0000 7ffbb9211700 1 -- 172.21.15.134:0/3483896357 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ffb9c06cce0 msgr2=0x7ffb9c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:05.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.248+0000 7ffbb9211700 1 --2- 172.21.15.134:0/3483896357 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ffb9c06cce0 0x7ffb9c06f190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffba8005950 tx=0x7ffba800b410 comp rx=0 tx=0).stop 2024-04-13T11:06:05.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.248+0000 7ffbb9211700 1 -- 172.21.15.134:0/3483896357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb4100d70 msgr2=0x7ffbb419bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:05.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.248+0000 7ffbb9211700 1 --2- 172.21.15.134:0/3483896357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb4100d70 0x7ffbb419bfa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffba40092e0 tx=0x7ffba400bd70 comp rx=0 tx=0).stop 2024-04-13T11:06:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.248+0000 7ffbb9211700 1 -- 172.21.15.134:0/3483896357 shutdown_connections 2024-04-13T11:06:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.248+0000 7ffbb9211700 1 --2- 172.21.15.134:0/3483896357 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ffb9c06cce0 0x7ffb9c06f190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.248+0000 7ffbb9211700 1 --2- 172.21.15.134:0/3483896357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbb41003d0 0x7ffbb419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.248+0000 7ffbb9211700 1 --2- 172.21.15.134:0/3483896357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffbb4100d70 0x7ffbb419bfa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.248+0000 7ffbb9211700 1 -- 172.21.15.134:0/3483896357 >> 172.21.15.134:0/3483896357 conn(0x7ffbb40fbc90 msgr2=0x7ffbb40fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.249+0000 7ffbb9211700 1 -- 172.21.15.134:0/3483896357 shutdown_connections 2024-04-13T11:06:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:05.249+0000 7ffbb9211700 1 -- 172.21.15.134:0/3483896357 wait complete. 2024-04-13T11:06:05.918 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:05 smithi194 ceph-mon[83053]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:05.918 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:05 smithi194 ceph-mon[83053]: pgmap v224: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 882 B/s rd, 1 op/s; 1.0 MiB/s, 47 objects/s recovering 2024-04-13T11:06:05.918 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:05 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-13T11:06:05.918 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:05 smithi194 ceph-mon[83053]: Upgrade: osd.4 is safe to restart 2024-04-13T11:06:05.918 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:05 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3483896357' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:06:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:05 smithi134 ceph-mon[112184]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:05 smithi134 ceph-mon[112184]: pgmap v224: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 882 B/s rd, 1 op/s; 1.0 MiB/s, 47 objects/s recovering 2024-04-13T11:06:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:05 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-13T11:06:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:05 smithi134 ceph-mon[112184]: Upgrade: osd.4 is safe to restart 2024-04-13T11:06:05.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:05 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3483896357' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:06:06.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:06 smithi194 ceph-mon[83053]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:06.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:06 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:06.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:06 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-13T11:06:06.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:06 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:06:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:06 smithi134 ceph-mon[112184]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:06.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:06 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:06.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:06 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-13T11:06:06.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:06 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:06:07.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:07 smithi134 ceph-mon[112184]: Upgrade: Updating osd.4 2024-04-13T11:06:07.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:07 smithi134 ceph-mon[112184]: pgmap v225: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 1024 KiB/s, 1 objects/s recovering 2024-04-13T11:06:07.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:07 smithi134 ceph-mon[112184]: Deploying daemon osd.4 on smithi194 2024-04-13T11:06:07.944 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:07 smithi194 ceph-mon[83053]: Upgrade: Updating osd.4 2024-04-13T11:06:07.944 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:07 smithi194 ceph-mon[83053]: pgmap v225: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 1024 KiB/s, 1 objects/s recovering 2024-04-13T11:06:07.944 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:07 smithi194 ceph-mon[83053]: Deploying daemon osd.4 on smithi194 2024-04-13T11:06:08.982 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:08 smithi194 ceph-mon[83053]: pgmap v226: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:06:08.982 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:08.982 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:06:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:08 smithi134 ceph-mon[112184]: pgmap v226: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:06:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:06:09.651 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:09 smithi194 systemd[1]: Stopping Ceph osd.4 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:06:09.986 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:09 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[59176]: 2024-04-13T11:06:09.767+0000 7fde0bb4f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:06:09.986 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:09 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[59176]: 2024-04-13T11:06:09.767+0000 7fde0bb4f700 -1 osd.4 76 *** Got signal Terminated *** 2024-04-13T11:06:09.987 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:09 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[59176]: 2024-04-13T11:06:09.767+0000 7fde0bb4f700 -1 osd.4 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:06:10.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:09 smithi194 ceph-mon[83053]: osd.4 marked itself down and dead 2024-04-13T11:06:10.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:09 smithi134 ceph-mon[112184]: osd.4 marked itself down and dead 2024-04-13T11:06:11.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:10 smithi194 bash[100023]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4 2024-04-13T11:06:11.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:10 smithi194 ceph-mon[83053]: pgmap v227: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:06:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:10 smithi194 ceph-mon[83053]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:06:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:10 smithi194 ceph-mon[83053]: osdmap e77: 6 total, 5 up, 6 in 2024-04-13T11:06:11.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:10 smithi134 ceph-mon[112184]: pgmap v227: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:06:11.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:10 smithi134 ceph-mon[112184]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:06:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:10 smithi134 ceph-mon[112184]: osdmap e77: 6 total, 5 up, 6 in 2024-04-13T11:06:12.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:11 smithi134 ceph-mon[112184]: osdmap e78: 6 total, 5 up, 6 in 2024-04-13T11:06:12.367 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:11 smithi194 ceph-mon[83053]: osdmap e78: 6 total, 5 up, 6 in 2024-04-13T11:06:12.998 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:12 smithi194 systemd[1]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.4.service: Succeeded. 2024-04-13T11:06:12.998 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:12 smithi194 systemd[1]: Stopped Ceph osd.4 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:06:12.998 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:12 smithi194 systemd[1]: Starting Ceph osd.4 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:06:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:12 smithi134 ceph-mon[112184]: pgmap v230: 65 pgs: 5 active+undersized+degraded, 5 stale+active+clean, 5 active+undersized, 50 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 22/267 objects degraded (8.240%) 2024-04-13T11:06:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:12 smithi134 ceph-mon[112184]: Health check failed: Degraded data redundancy: 22/267 objects degraded (8.240%), 5 pgs degraded (PG_DEGRADED) 2024-04-13T11:06:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:12 smithi194 ceph-mon[83053]: pgmap v230: 65 pgs: 5 active+undersized+degraded, 5 stale+active+clean, 5 active+undersized, 50 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 22/267 objects degraded (8.240%) 2024-04-13T11:06:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:12 smithi194 ceph-mon[83053]: Health check failed: Degraded data redundancy: 22/267 objects degraded (8.240%), 5 pgs degraded (PG_DEGRADED) 2024-04-13T11:06:14.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:13 smithi194 bash[100293]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-13T11:06:14.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:13 smithi194 bash[100293]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-13T11:06:14.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:13 smithi194 bash[100293]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-13T11:06:14.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:13 smithi194 bash[100293]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-13T11:06:14.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:13 smithi194 bash[100293]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-13T11:06:14.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:13 smithi194 bash[100293]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-13T11:06:14.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:13 smithi194 bash[100293]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-13T11:06:15.335 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:15 smithi194 ceph-mon[83053]: pgmap v231: 65 pgs: 15 active+undersized+degraded, 1 stale+active+clean, 15 active+undersized, 34 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-04-13T11:06:15.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:15 smithi134 ceph-mon[112184]: pgmap v231: 65 pgs: 15 active+undersized+degraded, 1 stale+active+clean, 15 active+undersized, 34 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-04-13T11:06:15.748 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:15 smithi194 ceph-osd[100617]: -- 172.21.15.194:0/535448409 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cd1e4ab1e0 con 0x55cd1e47b000 2024-04-13T11:06:15.748 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:15 smithi194 bash[100579]: 7f721487a63bd154798009bc1d1656c01b765dc1e69902bfdc5986cf74bfb8c1 2024-04-13T11:06:15.748 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:15 smithi194 systemd[1]: Started Ceph osd.4 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:06:16.163 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:15 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:06:15.855+0000 7f996f9b97c0 -1 Falling back to public interface 2024-04-13T11:06:16.723 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:16 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:16.723 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:16 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:16.723 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:16 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:16.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:16 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:16.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:16 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:16.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:16 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:17 smithi134 ceph-mon[112184]: pgmap v232: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/267 objects degraded (17.228%) 2024-04-13T11:06:17.722 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:17 smithi194 ceph-mon[83053]: pgmap v232: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/267 objects degraded (17.228%) 2024-04-13T11:06:19.852 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:19 smithi194 ceph-mon[83053]: pgmap v233: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-04-13T11:06:19.852 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:19.852 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:19.853 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:19.853 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:19.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:19 smithi134 ceph-mon[112184]: pgmap v233: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-04-13T11:06:19.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:19.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:19.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:19.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:20.654 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:20 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:06:20.340+0000 7f996f9b97c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-04-13T11:06:20.998 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:20 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:06:20.653+0000 7f996f9b97c0 -1 osd.4 76 log_to_monitors true 2024-04-13T11:06:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:21 smithi134 ceph-mon[112184]: pgmap v234: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 410 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-04-13T11:06:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:21 smithi134 ceph-mon[112184]: from='osd.4 [v2:172.21.15.194:6808/48937761,v1:172.21.15.194:6809/48937761]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-13T11:06:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:21 smithi134 ceph-mon[112184]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-13T11:06:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:21 smithi194 ceph-mon[83053]: pgmap v234: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 410 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-04-13T11:06:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:21 smithi194 ceph-mon[83053]: from='osd.4 [v2:172.21.15.194:6808/48937761,v1:172.21.15.194:6809/48937761]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-13T11:06:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:21 smithi194 ceph-mon[83053]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-13T11:06:22.730 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:06:22 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:06:22.496+0000 7f995ce0b700 -1 osd.4 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T11:06:22.730 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:22 smithi194 ceph-mon[83053]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-13T11:06:22.730 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:22 smithi194 ceph-mon[83053]: osdmap e79: 6 total, 5 up, 6 in 2024-04-13T11:06:22.731 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:22 smithi194 ceph-mon[83053]: from='osd.4 [v2:172.21.15.194:6808/48937761,v1:172.21.15.194:6809/48937761]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:06:22.731 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:22 smithi194 ceph-mon[83053]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:06:22.731 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:22 smithi194 ceph-mon[83053]: Health check update: Degraded data redundancy: 46/267 objects degraded (17.228%), 15 pgs degraded (PG_DEGRADED) 2024-04-13T11:06:22.731 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:22 smithi194 ceph-mon[83053]: from='osd.4 ' entity='osd.4' 2024-04-13T11:06:22.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:22 smithi134 ceph-mon[112184]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-13T11:06:22.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:22 smithi134 ceph-mon[112184]: osdmap e79: 6 total, 5 up, 6 in 2024-04-13T11:06:22.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:22 smithi134 ceph-mon[112184]: from='osd.4 [v2:172.21.15.194:6808/48937761,v1:172.21.15.194:6809/48937761]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:06:22.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:22 smithi134 ceph-mon[112184]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:06:22.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:22 smithi134 ceph-mon[112184]: Health check update: Degraded data redundancy: 46/267 objects degraded (17.228%), 15 pgs degraded (PG_DEGRADED) 2024-04-13T11:06:22.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:22 smithi134 ceph-mon[112184]: from='osd.4 ' entity='osd.4' 2024-04-13T11:06:23.938 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: pgmap v236: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 46/267 objects degraded (17.228%) 2024-04-13T11:06:23.938 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:23.938 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:06:23.938 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:23.938 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:23.938 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:23.938 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:06:23.938 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:06:23.938 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:23.938 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:23.939 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:23.939 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:23.939 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:23.939 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-13T11:06:23.939 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:06:23.939 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: osd.4 [v2:172.21.15.194:6808/48937761,v1:172.21.15.194:6809/48937761] boot 2024-04-13T11:06:23.939 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: osdmap e80: 6 total, 6 up, 6 in 2024-04-13T11:06:23.939 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T11:06:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: pgmap v236: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 46/267 objects degraded (17.228%) 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-13T11:06:23.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:06:24.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: osd.4 [v2:172.21.15.194:6808/48937761,v1:172.21.15.194:6809/48937761] boot 2024-04-13T11:06:24.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: osdmap e80: 6 total, 6 up, 6 in 2024-04-13T11:06:24.000 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-13T11:06:24.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:24 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-13T11:06:24.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:24 smithi134 ceph-mon[112184]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-04-13T11:06:24.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:24 smithi134 ceph-mon[112184]: osdmap e81: 6 total, 6 up, 6 in 2024-04-13T11:06:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:24 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-13T11:06:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:24 smithi194 ceph-mon[83053]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-04-13T11:06:24.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:24 smithi194 ceph-mon[83053]: osdmap e81: 6 total, 6 up, 6 in 2024-04-13T11:06:25.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:25 smithi134 ceph-mon[112184]: pgmap v238: 65 pgs: 10 peering, 10 active+undersized+degraded, 12 active+undersized, 33 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 34/267 objects degraded (12.734%) 2024-04-13T11:06:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:25 smithi194 ceph-mon[83053]: pgmap v238: 65 pgs: 10 peering, 10 active+undersized+degraded, 12 active+undersized, 33 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 34/267 objects degraded (12.734%) 2024-04-13T11:06:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:27 smithi134 ceph-mon[112184]: pgmap v240: 65 pgs: 11 peering, 10 active+undersized+degraded, 11 active+undersized, 33 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/267 objects degraded (12.734%) 2024-04-13T11:06:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:27 smithi134 ceph-mon[112184]: Health check update: Degraded data redundancy: 34/267 objects degraded (12.734%), 10 pgs degraded (PG_DEGRADED) 2024-04-13T11:06:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:27 smithi194 ceph-mon[83053]: pgmap v240: 65 pgs: 11 peering, 10 active+undersized+degraded, 11 active+undersized, 33 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/267 objects degraded (12.734%) 2024-04-13T11:06:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:27 smithi194 ceph-mon[83053]: Health check update: Degraded data redundancy: 34/267 objects degraded (12.734%), 10 pgs degraded (PG_DEGRADED) 2024-04-13T11:06:28.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:28 smithi134 ceph-mon[112184]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/267 objects degraded (12.734%), 10 pgs degraded) 2024-04-13T11:06:28.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:28 smithi194 ceph-mon[83053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/267 objects degraded (12.734%), 10 pgs degraded) 2024-04-13T11:06:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:29 smithi134 ceph-mon[112184]: pgmap v241: 65 pgs: 11 peering, 54 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 482 B/s rd, 0 op/s 2024-04-13T11:06:29.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:29 smithi194 ceph-mon[83053]: pgmap v241: 65 pgs: 11 peering, 54 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 482 B/s rd, 0 op/s 2024-04-13T11:06:31.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:31 smithi134 ceph-mon[112184]: pgmap v242: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2024-04-13T11:06:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:31 smithi194 ceph-mon[83053]: pgmap v242: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2024-04-13T11:06:33.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:32 smithi134 ceph-mon[112184]: pgmap v243: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 966 B/s rd, 1 op/s 2024-04-13T11:06:33.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:32 smithi194 ceph-mon[83053]: pgmap v243: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 966 B/s rd, 1 op/s 2024-04-13T11:06:35.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:35 smithi194 ceph-mon[83053]: pgmap v244: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-13T11:06:35.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.368+0000 7f7935200700 1 -- 172.21.15.134:0/3427901251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79300ff310 msgr2=0x7f79300ff6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.368+0000 7f7935200700 1 --2- 172.21.15.134:0/3427901251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79300ff310 0x7f79300ff6e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7918009910 tx=0x7f7918009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.368+0000 7f7935200700 1 -- 172.21.15.134:0/3427901251 shutdown_connections 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.368+0000 7f7935200700 1 --2- 172.21.15.134:0/3427901251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79300ffcb0 0x7f7930103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.368+0000 7f7935200700 1 --2- 172.21.15.134:0/3427901251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79300ff310 0x7f79300ff6e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.368+0000 7f7935200700 1 -- 172.21.15.134:0/3427901251 >> 172.21.15.134:0/3427901251 conn(0x7f79300fabd0 msgr2=0x7f79300fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.369+0000 7f7935200700 1 -- 172.21.15.134:0/3427901251 shutdown_connections 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.369+0000 7f7935200700 1 -- 172.21.15.134:0/3427901251 wait complete. 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.369+0000 7f7935200700 1 Processor -- start 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f7935200700 1 -- start start 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f7935200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79300ff310 0x7f7930100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f7935200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79300ffcb0 0x7f7930101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:35.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f7935200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79301017a0 con 0x7f79300ff310 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f7935200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79301018e0 con 0x7f79300ffcb0 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f792ed9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79300ff310 0x7f7930100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f792ed9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79300ff310 0x7f7930100d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41856/0 (socket says 172.21.15.134:41856) 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f792ed9d700 1 -- 172.21.15.134:0/4134711794 learned_addr learned my addr 172.21.15.134:0/4134711794 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f792e59c700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79300ffcb0 0x7f7930101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f792ed9d700 1 -- 172.21.15.134:0/4134711794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79300ffcb0 msgr2=0x7f7930101260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f792ed9d700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79300ffcb0 0x7f7930101260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f792ed9d700 1 -- 172.21.15.134:0/4134711794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79180095f0 con 0x7f79300ff310 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.370+0000 7f792ed9d700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79300ff310 0x7f7930100d20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7918006010 tx=0x7f791800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.371+0000 7f7927fff700 1 -- 172.21.15.134:0/4134711794 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f791801d070 con 0x7f79300ff310 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.371+0000 7f7935200700 1 -- 172.21.15.134:0/4134711794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7930101b60 con 0x7f79300ff310 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.371+0000 7f7927fff700 1 -- 172.21.15.134:0/4134711794 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7918005dc0 con 0x7f79300ff310 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.371+0000 7f7927fff700 1 -- 172.21.15.134:0/4134711794 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f791800fe20 con 0x7f79300ff310 2024-04-13T11:06:35.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.371+0000 7f7935200700 1 -- 172.21.15.134:0/4134711794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79301a2180 con 0x7f79300ff310 2024-04-13T11:06:35.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.372+0000 7f7935200700 1 -- 172.21.15.134:0/4134711794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7930108630 con 0x7f79300ff310 2024-04-13T11:06:35.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.372+0000 7f7927fff700 1 -- 172.21.15.134:0/4134711794 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f791800f660 con 0x7f79300ff310 2024-04-13T11:06:35.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.372+0000 7f7927fff700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f791c06cce0 0x7f791c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:35.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.373+0000 7f7927fff700 1 -- 172.21.15.134:0/4134711794 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f791808d680 con 0x7f79300ff310 2024-04-13T11:06:35.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.373+0000 7f792e59c700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f791c06cce0 0x7f791c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:35.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.373+0000 7f792e59c700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f791c06cce0 0x7f791c06f190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7930102510 tx=0x7f792000b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:35.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.377+0000 7f7927fff700 1 -- 172.21.15.134:0/4134711794 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f7918057720 con 0x7f79300ff310 2024-04-13T11:06:35.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:35 smithi134 ceph-mon[112184]: pgmap v244: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-13T11:06:35.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.596+0000 7f7935200700 1 -- 172.21.15.134:0/4134711794 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f793002ccd0 con 0x7f791c06cce0 2024-04-13T11:06:35.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.598+0000 7f7927fff700 1 -- 172.21.15.134:0/4134711794 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f793002ccd0 con 0x7f791c06cce0 2024-04-13T11:06:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 -- 172.21.15.134:0/4134711794 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f791c06cce0 msgr2=0x7f791c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f791c06cce0 0x7f791c06f190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7930102510 tx=0x7f792000b410 comp rx=0 tx=0).stop 2024-04-13T11:06:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 -- 172.21.15.134:0/4134711794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79300ff310 msgr2=0x7f7930100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79300ff310 0x7f7930100d20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7918006010 tx=0x7f791800bd70 comp rx=0 tx=0).stop 2024-04-13T11:06:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 -- 172.21.15.134:0/4134711794 shutdown_connections 2024-04-13T11:06:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f791c06cce0 0x7f791c06f190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79300ff310 0x7f7930100d20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 --2- 172.21.15.134:0/4134711794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79300ffcb0 0x7f7930101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 -- 172.21.15.134:0/4134711794 >> 172.21.15.134:0/4134711794 conn(0x7f79300fabd0 msgr2=0x7f7930068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:35.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 -- 172.21.15.134:0/4134711794 shutdown_connections 2024-04-13T11:06:35.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.600+0000 7f7935200700 1 -- 172.21.15.134:0/4134711794 wait complete. 2024-04-13T11:06:35.610 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:06:35.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.706+0000 7f864b0dd700 1 -- 172.21.15.134:0/2526027508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8644100d50 msgr2=0x7f8644104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:35.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.706+0000 7f864b0dd700 1 --2- 172.21.15.134:0/2526027508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8644100d50 0x7f8644104d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8630009910 tx=0x7f8630009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:35.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.706+0000 7f864b0dd700 1 -- 172.21.15.134:0/2526027508 shutdown_connections 2024-04-13T11:06:35.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.706+0000 7f864b0dd700 1 --2- 172.21.15.134:0/2526027508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8644100d50 0x7f8644104d20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.706+0000 7f864b0dd700 1 --2- 172.21.15.134:0/2526027508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86441003b0 0x7f8644100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.706+0000 7f864b0dd700 1 -- 172.21.15.134:0/2526027508 >> 172.21.15.134:0/2526027508 conn(0x7f86440fbc30 msgr2=0x7f86440fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.706+0000 7f864b0dd700 1 -- 172.21.15.134:0/2526027508 shutdown_connections 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.706+0000 7f864b0dd700 1 -- 172.21.15.134:0/2526027508 wait complete. 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.706+0000 7f864b0dd700 1 Processor -- start 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.706+0000 7f864b0dd700 1 -- start start 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f864b0dd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86441003b0 0x7f8644195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f864b0dd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644100d50 0x7f86441962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f864b0dd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441969a0 con 0x7f86441003b0 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f864b0dd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864419a730 con 0x7f8644100d50 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8648e79700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86441003b0 0x7f8644195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8648e79700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86441003b0 0x7f8644195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41874/0 (socket says 172.21.15.134:41874) 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8648e79700 1 -- 172.21.15.134:0/1025170826 learned_addr learned my addr 172.21.15.134:0/1025170826 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8643fff700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644100d50 0x7f86441962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:35.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8648e79700 1 -- 172.21.15.134:0/1025170826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644100d50 msgr2=0x7f86441962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:35.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8648e79700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644100d50 0x7f86441962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8648e79700 1 -- 172.21.15.134:0/1025170826 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86300095f0 con 0x7f86441003b0 2024-04-13T11:06:35.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8648e79700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86441003b0 0x7f8644195d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f863800b4b0 tx=0x7f863800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:35.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8641ffb700 1 -- 172.21.15.134:0/1025170826 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8638011800 con 0x7f86441003b0 2024-04-13T11:06:35.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8641ffb700 1 -- 172.21.15.134:0/1025170826 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8638011e00 con 0x7f86441003b0 2024-04-13T11:06:35.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f864b0dd700 1 -- 172.21.15.134:0/1025170826 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864419aa10 con 0x7f86441003b0 2024-04-13T11:06:35.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.707+0000 7f8641ffb700 1 -- 172.21.15.134:0/1025170826 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8638010e50 con 0x7f86441003b0 2024-04-13T11:06:35.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.708+0000 7f864b0dd700 1 -- 172.21.15.134:0/1025170826 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864419af60 con 0x7f86441003b0 2024-04-13T11:06:35.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.708+0000 7f864b0dd700 1 -- 172.21.15.134:0/1025170826 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8644108650 con 0x7f86441003b0 2024-04-13T11:06:35.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.709+0000 7f8641ffb700 1 -- 172.21.15.134:0/1025170826 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8638010380 con 0x7f86441003b0 2024-04-13T11:06:35.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.709+0000 7f8641ffb700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f863406cce0 0x7f863406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:35.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.709+0000 7f8641ffb700 1 -- 172.21.15.134:0/1025170826 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f863808c200 con 0x7f86441003b0 2024-04-13T11:06:35.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.709+0000 7f8643fff700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f863406cce0 0x7f863406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:35.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.710+0000 7f8643fff700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f863406cce0 0x7f863406f190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f863000b5c0 tx=0x7f8630005fd0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:35.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.714+0000 7f8641ffb700 1 -- 172.21.15.134:0/1025170826 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f8638056200 con 0x7f86441003b0 2024-04-13T11:06:35.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.927+0000 7f864b0dd700 1 -- 172.21.15.134:0/1025170826 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f864419b2a0 con 0x7f863406cce0 2024-04-13T11:06:35.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.928+0000 7f8641ffb700 1 -- 172.21.15.134:0/1025170826 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f864419b2a0 con 0x7f863406cce0 2024-04-13T11:06:35.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.930+0000 7f864b0dd700 1 -- 172.21.15.134:0/1025170826 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f863406cce0 msgr2=0x7f863406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:35.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.930+0000 7f864b0dd700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f863406cce0 0x7f863406f190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f863000b5c0 tx=0x7f8630005fd0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.930+0000 7f864b0dd700 1 -- 172.21.15.134:0/1025170826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86441003b0 msgr2=0x7f8644195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:35.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.930+0000 7f864b0dd700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86441003b0 0x7f8644195d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f863800b4b0 tx=0x7f863800b870 comp rx=0 tx=0).stop 2024-04-13T11:06:35.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.931+0000 7f864b0dd700 1 -- 172.21.15.134:0/1025170826 shutdown_connections 2024-04-13T11:06:35.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.931+0000 7f864b0dd700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f863406cce0 0x7f863406f190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.931+0000 7f864b0dd700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86441003b0 0x7f8644195d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.931+0000 7f864b0dd700 1 --2- 172.21.15.134:0/1025170826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8644100d50 0x7f86441962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:35.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.931+0000 7f864b0dd700 1 -- 172.21.15.134:0/1025170826 >> 172.21.15.134:0/1025170826 conn(0x7f86440fbc30 msgr2=0x7f86440fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:35.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.931+0000 7f864b0dd700 1 -- 172.21.15.134:0/1025170826 shutdown_connections 2024-04-13T11:06:35.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:35.931+0000 7f864b0dd700 1 -- 172.21.15.134:0/1025170826 wait complete. 2024-04-13T11:06:36.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.035+0000 7fbbf541d700 1 -- 172.21.15.134:0/1214072139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf00ff2c0 msgr2=0x7fbbf00ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:36.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.035+0000 7fbbf541d700 1 --2- 172.21.15.134:0/1214072139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf00ff2c0 0x7fbbf00ff690 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009910 tx=0x7fbbe0009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:36.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.035+0000 7fbbf541d700 1 -- 172.21.15.134:0/1214072139 shutdown_connections 2024-04-13T11:06:36.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.035+0000 7fbbf541d700 1 --2- 172.21.15.134:0/1214072139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf00ffc60 0x7fbbf0103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.035+0000 7fbbf541d700 1 --2- 172.21.15.134:0/1214072139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf00ff2c0 0x7fbbf00ff690 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.035+0000 7fbbf541d700 1 -- 172.21.15.134:0/1214072139 >> 172.21.15.134:0/1214072139 conn(0x7fbbf00fab80 msgr2=0x7fbbf00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:36.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.035+0000 7fbbf541d700 1 -- 172.21.15.134:0/1214072139 shutdown_connections 2024-04-13T11:06:36.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.035+0000 7fbbf541d700 1 -- 172.21.15.134:0/1214072139 wait complete. 2024-04-13T11:06:36.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.036+0000 7fbbf541d700 1 Processor -- start 2024-04-13T11:06:36.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.036+0000 7fbbf541d700 1 -- start start 2024-04-13T11:06:36.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.036+0000 7fbbf541d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf00ff2c0 0x7fbbf01948b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:36.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.036+0000 7fbbf541d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf00ffc60 0x7fbbf0194df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.036+0000 7fbbf541d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0195330 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.036+0000 7fbbf541d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf01954a0 con 0x7fbbf00ffc60 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.036+0000 7fbbeeffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf00ff2c0 0x7fbbf01948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.036+0000 7fbbeeffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf00ff2c0 0x7fbbf01948b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41890/0 (socket says 172.21.15.134:41890) 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.036+0000 7fbbeeffd700 1 -- 172.21.15.134:0/479911556 learned_addr learned my addr 172.21.15.134:0/479911556 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.036+0000 7fbbee7fc700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf00ffc60 0x7fbbf0194df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.037+0000 7fbbeeffd700 1 -- 172.21.15.134:0/479911556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf00ffc60 msgr2=0x7fbbf0194df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.037+0000 7fbbeeffd700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf00ffc60 0x7fbbf0194df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.037+0000 7fbbeeffd700 1 -- 172.21.15.134:0/479911556 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00095f0 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.037+0000 7fbbeeffd700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf00ff2c0 0x7fbbf01948b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0006010 tx=0x7fbbe000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.037+0000 7fbbd7fff700 1 -- 172.21.15.134:0/479911556 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbe001d070 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.037+0000 7fbbd7fff700 1 -- 172.21.15.134:0/479911556 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbbe0005710 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.037+0000 7fbbf541d700 1 -- 172.21.15.134:0/479911556 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf0195720 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.037+0000 7fbbd7fff700 1 -- 172.21.15.134:0/479911556 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbe000fe20 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.037+0000 7fbbf541d700 1 -- 172.21.15.134:0/479911556 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf01a21a0 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.038+0000 7fbbf541d700 1 -- 172.21.15.134:0/479911556 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf01075d0 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.039+0000 7fbbd7fff700 1 -- 172.21.15.134:0/479911556 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fbbe0003a60 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.039+0000 7fbbd7fff700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbbd806cce0 0x7fbbd806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:36.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.039+0000 7fbbd7fff700 1 -- 172.21.15.134:0/479911556 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fbbe008d5d0 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.039+0000 7fbbee7fc700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbbd806cce0 0x7fbbd806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:36.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.039+0000 7fbbee7fc700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbbd806cce0 0x7fbbd806f190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00695c0 tx=0x7fbbe400b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:36.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.043+0000 7fbbd7fff700 1 -- 172.21.15.134:0/479911556 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fbbe005b100 con 0x7fbbf00ff2c0 2024-04-13T11:06:36.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.248+0000 7fbbf541d700 1 -- 172.21.15.134:0/479911556 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbf0195720 con 0x7fbbd806cce0 2024-04-13T11:06:36.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.258+0000 7fbbd7fff700 1 -- 172.21.15.134:0/479911556 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fbbf0195720 con 0x7fbbd806cce0 2024-04-13T11:06:36.258 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:06:36.258 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (5m) 86s ago 16m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:06:36.258 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (17m) 86s ago 17m 8300k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:06:36.258 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (15m) 17s ago 15m 8019k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:06:36.258 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (3m) 86s ago 17m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:06:36.258 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (3m) 17s ago 15m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:06:36.258 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (4m) 86s ago 16m 88.2M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:06:36.258 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (10m) 86s ago 10m 90.0M - 18.2.0 dc2bc1663786 a9b9f65c8bf6 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (10m) 86s ago 10m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (10m) 17s ago 10m 17.3M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (10m) 17s ago 10m 20.8M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (8m) 86s ago 18m 507M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (6m) 17s ago 15m 453M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (3m) 86s ago 18m 45.2M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (3m) 17s ago 15m 38.6M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 86s ago 17m 18.4M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (6m) 17s ago 15m 17.1M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (2m) 86s ago 14m 92.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (2m) 86s ago 14m 88.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e fc8474d8910f 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (92s) 86s ago 13m 11.5M 1227M 18.2.2-1173-g5108bc67 3464fd31103e b24ce165bc9f 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (55s) 17s ago 13m 137M 2251M 18.2.2-1173-g5108bc67 3464fd31103e d909c0e8d077 2024-04-13T11:06:36.259 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (21s) 17s ago 12m 10.9M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 7f721487a63b 2024-04-13T11:06:36.260 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (12m) 17s ago 12m 230M 2251M 18.2.0 dc2bc1663786 780c6d3a2eda 2024-04-13T11:06:36.260 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 86s ago 16m 66.8M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 -- 172.21.15.134:0/479911556 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbbd806cce0 msgr2=0x7fbbd806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbbd806cce0 0x7fbbd806f190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00695c0 tx=0x7fbbe400b410 comp rx=0 tx=0).stop 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 -- 172.21.15.134:0/479911556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf00ff2c0 msgr2=0x7fbbf01948b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf00ff2c0 0x7fbbf01948b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0006010 tx=0x7fbbe000bd70 comp rx=0 tx=0).stop 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 -- 172.21.15.134:0/479911556 shutdown_connections 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fbbd806cce0 0x7fbbd806f190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbf00ff2c0 0x7fbbf01948b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 --2- 172.21.15.134:0/479911556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbf00ffc60 0x7fbbf0194df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 -- 172.21.15.134:0/479911556 >> 172.21.15.134:0/479911556 conn(0x7fbbf00fab80 msgr2=0x7fbbf00fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 -- 172.21.15.134:0/479911556 shutdown_connections 2024-04-13T11:06:36.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.260+0000 7fbbf541d700 1 -- 172.21.15.134:0/479911556 wait complete. 2024-04-13T11:06:36.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.363+0000 7f9dc32d0700 1 -- 172.21.15.134:0/3281401337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dbc0ff390 msgr2=0x7f9dbc0ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:36.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.363+0000 7f9dc32d0700 1 --2- 172.21.15.134:0/3281401337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dbc0ff390 0x7f9dbc0ff760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009910 tx=0x7f9dac009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:36.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.363+0000 7f9dc32d0700 1 -- 172.21.15.134:0/3281401337 shutdown_connections 2024-04-13T11:06:36.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.363+0000 7f9dc32d0700 1 --2- 172.21.15.134:0/3281401337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dbc0ffd30 0x7f9dbc103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.363+0000 7f9dc32d0700 1 --2- 172.21.15.134:0/3281401337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dbc0ff390 0x7f9dbc0ff760 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.363+0000 7f9dc32d0700 1 -- 172.21.15.134:0/3281401337 >> 172.21.15.134:0/3281401337 conn(0x7f9dbc074f50 msgr2=0x7f9dbc075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.363+0000 7f9dc32d0700 1 -- 172.21.15.134:0/3281401337 shutdown_connections 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.363+0000 7f9dc32d0700 1 -- 172.21.15.134:0/3281401337 wait complete. 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.363+0000 7f9dc32d0700 1 Processor -- start 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.363+0000 7f9dc32d0700 1 -- start start 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc32d0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dbc0ff390 0x7f9dbc196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc32d0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dbc0ffd30 0x7f9dbc1970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc32d0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1977a0 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc32d0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1978e0 con 0x7f9dbc0ff390 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc086b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dbc0ffd30 0x7f9dbc1970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc086b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dbc0ffd30 0x7f9dbc1970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41918/0 (socket says 172.21.15.134:41918) 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc086b700 1 -- 172.21.15.134:0/2541416478 learned_addr learned my addr 172.21.15.134:0/2541416478 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc106c700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dbc0ff390 0x7f9dbc196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc086b700 1 -- 172.21.15.134:0/2541416478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dbc0ff390 msgr2=0x7f9dbc196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:36.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc086b700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dbc0ff390 0x7f9dbc196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc086b700 1 -- 172.21.15.134:0/2541416478 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0095f0 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc086b700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dbc0ffd30 0x7f9dbc1970c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9db800b480 tx=0x7f9db800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:36.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9db27fc700 1 -- 172.21.15.134:0/2541416478 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9db80118c0 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9db27fc700 1 -- 172.21.15.134:0/2541416478 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9db8010380 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc32d0700 1 -- 172.21.15.134:0/2541416478 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc19fbf0 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9db27fc700 1 -- 172.21.15.134:0/2541416478 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9db800f510 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.364+0000 7f9dc32d0700 1 -- 172.21.15.134:0/2541416478 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc1a0110 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.365+0000 7f9dc32d0700 1 -- 172.21.15.134:0/2541416478 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc107650 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.366+0000 7f9db27fc700 1 -- 172.21.15.134:0/2541416478 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9db80104f0 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.366+0000 7f9db27fc700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9da806cce0 0x7f9da806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:36.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.366+0000 7f9db27fc700 1 -- 172.21.15.134:0/2541416478 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f9db808c0d0 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.366+0000 7f9dc106c700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9da806cce0 0x7f9da806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:36.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.367+0000 7f9dc106c700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9da806cce0 0x7f9da806f190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9dac006010 tx=0x7f9dac01a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:36.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.371+0000 7f9db27fc700 1 -- 172.21.15.134:0/2541416478 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f9db80561f0 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:36 smithi134 ceph-mon[112184]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:36.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:36 smithi194 ceph-mon[83053]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:36.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.648+0000 7f9dc32d0700 1 -- 172.21.15.134:0/2541416478 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9dbc04ea50 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.649+0000 7f9db27fc700 1 -- 172.21.15.134:0/2541416478 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f9db80107a0 con 0x7f9dbc0ffd30 2024-04-13T11:06:36.649 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:06:36.649 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:06:36.649 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:06:36.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:06:36.649 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:06:36.650 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:06:36.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:06:36.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:06:36.650 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-04-13T11:06:36.650 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 5 2024-04-13T11:06:36.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:06:36.650 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:06:36.650 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-04-13T11:06:36.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:06:36.650 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:06:36.651 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-04-13T11:06:36.651 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 9 2024-04-13T11:06:36.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:06:36.651 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:06:36.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 -- 172.21.15.134:0/2541416478 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9da806cce0 msgr2=0x7f9da806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:36.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9da806cce0 0x7f9da806f190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9dac006010 tx=0x7f9dac01a040 comp rx=0 tx=0).stop 2024-04-13T11:06:36.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 -- 172.21.15.134:0/2541416478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dbc0ffd30 msgr2=0x7f9dbc1970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:36.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dbc0ffd30 0x7f9dbc1970c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9db800b480 tx=0x7f9db800b840 comp rx=0 tx=0).stop 2024-04-13T11:06:36.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 -- 172.21.15.134:0/2541416478 shutdown_connections 2024-04-13T11:06:36.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9da806cce0 0x7f9da806f190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dbc0ff390 0x7f9dbc196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 --2- 172.21.15.134:0/2541416478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dbc0ffd30 0x7f9dbc1970c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 -- 172.21.15.134:0/2541416478 >> 172.21.15.134:0/2541416478 conn(0x7f9dbc074f50 msgr2=0x7f9dbc0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:36.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 -- 172.21.15.134:0/2541416478 shutdown_connections 2024-04-13T11:06:36.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.651+0000 7f9dc32d0700 1 -- 172.21.15.134:0/2541416478 wait complete. 2024-04-13T11:06:36.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.755+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/247260117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cc8100400 msgr2=0x7f6cc81007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:36.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.755+0000 7f6ccdf3d700 1 --2- 172.21.15.134:0/247260117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cc8100400 0x7f6cc81007d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009910 tx=0x7f6cbc009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:36.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.755+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/247260117 shutdown_connections 2024-04-13T11:06:36.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.755+0000 7f6ccdf3d700 1 --2- 172.21.15.134:0/247260117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cc8100da0 0x7f6cc8104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.755+0000 7f6ccdf3d700 1 --2- 172.21.15.134:0/247260117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cc8100400 0x7f6cc81007d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.755+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/247260117 >> 172.21.15.134:0/247260117 conn(0x7f6cc80fbca0 msgr2=0x7f6cc80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:36.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.755+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/247260117 shutdown_connections 2024-04-13T11:06:36.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.755+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/247260117 wait complete. 2024-04-13T11:06:36.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.755+0000 7f6ccdf3d700 1 Processor -- start 2024-04-13T11:06:36.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6ccdf3d700 1 -- start start 2024-04-13T11:06:36.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6ccdf3d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cc8100400 0x7f6cc8073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:36.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6ccdf3d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cc8100da0 0x7f6cc8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:36.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6ccdf3d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc8073ad0 con 0x7f6cc8100400 2024-04-13T11:06:36.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6ccdf3d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc8073c10 con 0x7f6cc8100da0 2024-04-13T11:06:36.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6cc77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cc8100400 0x7f6cc8073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:36.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6cc77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cc8100400 0x7f6cc8073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41940/0 (socket says 172.21.15.134:41940) 2024-04-13T11:06:36.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6cc77fe700 1 -- 172.21.15.134:0/3470679946 learned_addr learned my addr 172.21.15.134:0/3470679946 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:36.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6cc6ffd700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cc8100da0 0x7f6cc8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:36.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6cc77fe700 1 -- 172.21.15.134:0/3470679946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cc8100da0 msgr2=0x7f6cc8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:36.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6cc77fe700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cc8100da0 0x7f6cc8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:36.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6cc77fe700 1 -- 172.21.15.134:0/3470679946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc0095f0 con 0x7f6cc8100400 2024-04-13T11:06:36.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.756+0000 7f6cc77fe700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cc8100400 0x7f6cc8073050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc006010 tx=0x7f6cbc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:36.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.757+0000 7f6cc4ff9700 1 -- 172.21.15.134:0/3470679946 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cbc01d070 con 0x7f6cc8100400 2024-04-13T11:06:36.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.757+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/3470679946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc8073e90 con 0x7f6cc8100400 2024-04-13T11:06:36.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.757+0000 7f6cc4ff9700 1 -- 172.21.15.134:0/3470679946 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6cbc005710 con 0x7f6cc8100400 2024-04-13T11:06:36.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.757+0000 7f6cc4ff9700 1 -- 172.21.15.134:0/3470679946 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cbc00fe20 con 0x7f6cc8100400 2024-04-13T11:06:36.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.757+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/3470679946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc81a2140 con 0x7f6cc8100400 2024-04-13T11:06:36.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.758+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/3470679946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc8108710 con 0x7f6cc8100400 2024-04-13T11:06:36.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.758+0000 7f6cc4ff9700 1 -- 172.21.15.134:0/3470679946 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6cbc003a60 con 0x7f6cc8100400 2024-04-13T11:06:36.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.758+0000 7f6cc4ff9700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6cb006cce0 0x7f6cb006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:36.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.758+0000 7f6cc4ff9700 1 -- 172.21.15.134:0/3470679946 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f6cbc08d710 con 0x7f6cc8100400 2024-04-13T11:06:36.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.758+0000 7f6cc6ffd700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6cb006cce0 0x7f6cb006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:36.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.759+0000 7f6cc6ffd700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6cb006cce0 0x7f6cb006f190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8074840 tx=0x7f6cb800b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:36.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:36.763+0000 7f6cc4ff9700 1 -- 172.21.15.134:0/3470679946 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f6cbc0577b0 con 0x7f6cc8100400 2024-04-13T11:06:37.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.002+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/3470679946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6cc804ea50 con 0x7f6cc8100400 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.003+0000 7f6cc4ff9700 1 -- 172.21.15.134:0/3470679946 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1880 (secure 0 0 0) 0x7f6cbc003d10 con 0x7f6cc8100400 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stdout:e18 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 18 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:06:37.003 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T10:55:58.861624+0000 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 46 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:06:37.004 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14492} 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:14508} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2714299924,v1:172.21.15.134:6827/2714299924] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:06:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:06:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:06:37.006 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:06:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:06:37.006 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:06:37.006 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/3470679946 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6cb006cce0 msgr2=0x7f6cb006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6cb006cce0 0x7f6cb006f190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8074840 tx=0x7f6cb800b410 comp rx=0 tx=0).stop 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/3470679946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cc8100400 msgr2=0x7f6cc8073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cc8100400 0x7f6cc8073050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc006010 tx=0x7f6cbc00bd70 comp rx=0 tx=0).stop 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/3470679946 shutdown_connections 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6cb006cce0 0x7f6cb006f190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cc8100400 0x7f6cc8073050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 --2- 172.21.15.134:0/3470679946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cc8100da0 0x7f6cc8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/3470679946 >> 172.21.15.134:0/3470679946 conn(0x7f6cc80fbca0 msgr2=0x7f6cc80fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/3470679946 shutdown_connections 2024-04-13T11:06:37.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.005+0000 7f6ccdf3d700 1 -- 172.21.15.134:0/3470679946 wait complete. 2024-04-13T11:06:37.008 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-04-13T11:06:37.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.110+0000 7f763a6fd700 1 -- 172.21.15.134:0/2200694249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7634100da0 msgr2=0x7f7634104d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:37.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.110+0000 7f763a6fd700 1 --2- 172.21.15.134:0/2200694249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7634100da0 0x7f7634104d70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7628009910 tx=0x7f7628009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:37.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.110+0000 7f763a6fd700 1 -- 172.21.15.134:0/2200694249 shutdown_connections 2024-04-13T11:06:37.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.110+0000 7f763a6fd700 1 --2- 172.21.15.134:0/2200694249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7634100da0 0x7f7634104d70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.110+0000 7f763a6fd700 1 --2- 172.21.15.134:0/2200694249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7634100400 0x7f76341007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.110+0000 7f763a6fd700 1 -- 172.21.15.134:0/2200694249 >> 172.21.15.134:0/2200694249 conn(0x7f76340fbca0 msgr2=0x7f76340fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:37.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.111+0000 7f763a6fd700 1 -- 172.21.15.134:0/2200694249 shutdown_connections 2024-04-13T11:06:37.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.111+0000 7f763a6fd700 1 -- 172.21.15.134:0/2200694249 wait complete. 2024-04-13T11:06:37.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.111+0000 7f763a6fd700 1 Processor -- start 2024-04-13T11:06:37.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.111+0000 7f763a6fd700 1 -- start start 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.111+0000 7f763a6fd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7634100400 0x7f763419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f763a6fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7634100da0 0x7f763419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f763a6fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763419c5a0 con 0x7f7634100da0 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f763a6fd700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7634195ae0 con 0x7f7634100400 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f76337fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7634100da0 0x7f763419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f76337fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7634100da0 0x7f763419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41950/0 (socket says 172.21.15.134:41950) 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f76337fe700 1 -- 172.21.15.134:0/1052110590 learned_addr learned my addr 172.21.15.134:0/1052110590 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f76337fe700 1 -- 172.21.15.134:0/1052110590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7634100400 msgr2=0x7f763419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f76337fe700 1 --2- 172.21.15.134:0/1052110590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7634100400 0x7f763419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f76337fe700 1 -- 172.21.15.134:0/1052110590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76280095f0 con 0x7f7634100da0 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f76337fe700 1 --2- 172.21.15.134:0/1052110590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7634100da0 0x7f763419bfa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f762800bda0 tx=0x7f762800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:37.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f76317fa700 1 -- 172.21.15.134:0/1052110590 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f762801d070 con 0x7f7634100da0 2024-04-13T11:06:37.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f76317fa700 1 -- 172.21.15.134:0/1052110590 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f762800f460 con 0x7f7634100da0 2024-04-13T11:06:37.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f763a6fd700 1 -- 172.21.15.134:0/1052110590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7634195d60 con 0x7f7634100da0 2024-04-13T11:06:37.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f76317fa700 1 -- 172.21.15.134:0/1052110590 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7628021640 con 0x7f7634100da0 2024-04-13T11:06:37.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.112+0000 7f763a6fd700 1 -- 172.21.15.134:0/1052110590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7634196250 con 0x7f7634100da0 2024-04-13T11:06:37.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.113+0000 7f763a6fd700 1 -- 172.21.15.134:0/1052110590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7634108770 con 0x7f7634100da0 2024-04-13T11:06:37.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.114+0000 7f76317fa700 1 -- 172.21.15.134:0/1052110590 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f762800f9b0 con 0x7f7634100da0 2024-04-13T11:06:37.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.114+0000 7f76317fa700 1 --2- 172.21.15.134:0/1052110590 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f761c06cce0 0x7f761c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:37.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.114+0000 7f76317fa700 1 -- 172.21.15.134:0/1052110590 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f762808d850 con 0x7f7634100da0 2024-04-13T11:06:37.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.114+0000 7f7633fff700 1 --2- 172.21.15.134:0/1052110590 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f761c06cce0 0x7f761c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:37.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.114+0000 7f7633fff700 1 --2- 172.21.15.134:0/1052110590 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f761c06cce0 0x7f761c06f190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7624005fd0 tx=0x7f7624005d00 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:37.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.119+0000 7f76317fa700 1 -- 172.21.15.134:0/1052110590 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f762805b380 con 0x7f7634100da0 2024-04-13T11:06:37.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.333+0000 7f763a6fd700 1 -- 172.21.15.134:0/1052110590 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7634196470 con 0x7f761c06cce0 2024-04-13T11:06:37.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.335+0000 7f76317fa700 1 -- 172.21.15.134:0/1052110590 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7634196470 con 0x7f761c06cce0 2024-04-13T11:06:37.334 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "11/23 daemons upgraded", 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:06:37.335 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:06:37.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 -- 172.21.15.134:0/1052110590 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f761c06cce0 msgr2=0x7f761c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:37.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 --2- 172.21.15.134:0/1052110590 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f761c06cce0 0x7f761c06f190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7624005fd0 tx=0x7f7624005d00 comp rx=0 tx=0).stop 2024-04-13T11:06:37.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 -- 172.21.15.134:0/1052110590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7634100da0 msgr2=0x7f763419bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:37.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 --2- 172.21.15.134:0/1052110590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7634100da0 0x7f763419bfa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f762800bda0 tx=0x7f762800be80 comp rx=0 tx=0).stop 2024-04-13T11:06:37.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 -- 172.21.15.134:0/1052110590 shutdown_connections 2024-04-13T11:06:37.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 --2- 172.21.15.134:0/1052110590 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f761c06cce0 0x7f761c06f190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 --2- 172.21.15.134:0/1052110590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7634100400 0x7f763419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 --2- 172.21.15.134:0/1052110590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7634100da0 0x7f763419bfa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 -- 172.21.15.134:0/1052110590 >> 172.21.15.134:0/1052110590 conn(0x7f76340fbca0 msgr2=0x7f76340fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 -- 172.21.15.134:0/1052110590 shutdown_connections 2024-04-13T11:06:37.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.337+0000 7f763a6fd700 1 -- 172.21.15.134:0/1052110590 wait complete. 2024-04-13T11:06:37.373 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:37 smithi134 ceph-mon[112184]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:37.373 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:37 smithi134 ceph-mon[112184]: pgmap v245: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 713 B/s rd, 1 op/s 2024-04-13T11:06:37.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:37 smithi134 ceph-mon[112184]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:37.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:37 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2541416478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:37.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:37 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3470679946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:06:37.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.442+0000 7f352ac6c700 1 -- 172.21.15.134:0/2023582245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35240ff280 msgr2=0x7f35240ff650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:37.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.442+0000 7f352ac6c700 1 --2- 172.21.15.134:0/2023582245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35240ff280 0x7f35240ff650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3518009910 tx=0x7f3518009c20 comp rx=0 tx=0).stop 2024-04-13T11:06:37.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.442+0000 7f352ac6c700 1 -- 172.21.15.134:0/2023582245 shutdown_connections 2024-04-13T11:06:37.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.442+0000 7f352ac6c700 1 --2- 172.21.15.134:0/2023582245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35240ffc20 0x7f3524103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.442+0000 7f352ac6c700 1 --2- 172.21.15.134:0/2023582245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35240ff280 0x7f35240ff650 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.442+0000 7f352ac6c700 1 -- 172.21.15.134:0/2023582245 >> 172.21.15.134:0/2023582245 conn(0x7f35240fab00 msgr2=0x7f35240fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.442+0000 7f352ac6c700 1 -- 172.21.15.134:0/2023582245 shutdown_connections 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.442+0000 7f352ac6c700 1 -- 172.21.15.134:0/2023582245 wait complete. 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.443+0000 7f352ac6c700 1 Processor -- start 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.443+0000 7f352ac6c700 1 -- start start 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.443+0000 7f352ac6c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35240ff280 0x7f3524196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.443+0000 7f352ac6c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35240ffc20 0x7f3524197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.443+0000 7f352ac6c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524197630 con 0x7f35240ff280 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.443+0000 7f352ac6c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524197770 con 0x7f35240ffc20 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.443+0000 7f3528a08700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35240ff280 0x7f3524196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.443+0000 7f3528a08700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35240ff280 0x7f3524196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41978/0 (socket says 172.21.15.134:41978) 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.443+0000 7f3528a08700 1 -- 172.21.15.134:0/2906526400 learned_addr learned my addr 172.21.15.134:0/2906526400 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:06:37.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.444+0000 7f3528a08700 1 -- 172.21.15.134:0/2906526400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35240ffc20 msgr2=0x7f3524197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:37.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.444+0000 7f3528a08700 1 --2- 172.21.15.134:0/2906526400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35240ffc20 0x7f3524197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.444+0000 7f3528a08700 1 -- 172.21.15.134:0/2906526400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180095f0 con 0x7f35240ff280 2024-04-13T11:06:37.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.444+0000 7f3528a08700 1 --2- 172.21.15.134:0/2906526400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35240ff280 0x7f3524196ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3518006010 tx=0x7f351800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:37.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.444+0000 7f3521ffb700 1 -- 172.21.15.134:0/2906526400 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f351801d070 con 0x7f35240ff280 2024-04-13T11:06:37.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.444+0000 7f3521ffb700 1 -- 172.21.15.134:0/2906526400 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f351800f460 con 0x7f35240ff280 2024-04-13T11:06:37.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.444+0000 7f352ac6c700 1 -- 172.21.15.134:0/2906526400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352419fb40 con 0x7f35240ff280 2024-04-13T11:06:37.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.444+0000 7f3521ffb700 1 -- 172.21.15.134:0/2906526400 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3518021620 con 0x7f35240ff280 2024-04-13T11:06:37.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.444+0000 7f352ac6c700 1 -- 172.21.15.134:0/2906526400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352419ff50 con 0x7f35240ff280 2024-04-13T11:06:37.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.445+0000 7f352ac6c700 1 -- 172.21.15.134:0/2906526400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3524107590 con 0x7f35240ff280 2024-04-13T11:06:37.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.445+0000 7f3521ffb700 1 -- 172.21.15.134:0/2906526400 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f351800fa40 con 0x7f35240ff280 2024-04-13T11:06:37.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.446+0000 7f3521ffb700 1 --2- 172.21.15.134:0/2906526400 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f351406cce0 0x7f351406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:06:37.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.446+0000 7f3521ffb700 1 -- 172.21.15.134:0/2906526400 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f351808d760 con 0x7f35240ff280 2024-04-13T11:06:37.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.446+0000 7f3523fff700 1 --2- 172.21.15.134:0/2906526400 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f351406cce0 0x7f351406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:06:37.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.446+0000 7f3523fff700 1 --2- 172.21.15.134:0/2906526400 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f351406cce0 0x7f351406f190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3510005950 tx=0x7f35100058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:06:37.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.450+0000 7f3521ffb700 1 -- 172.21.15.134:0/2906526400 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f3518057800 con 0x7f35240ff280 2024-04-13T11:06:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:37 smithi194 ceph-mon[83053]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:37 smithi194 ceph-mon[83053]: pgmap v245: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 713 B/s rd, 1 op/s 2024-04-13T11:06:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:37 smithi194 ceph-mon[83053]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:37 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2541416478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:37 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3470679946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:06:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.731+0000 7f352ac6c700 1 -- 172.21.15.134:0/2906526400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f352402cc30 con 0x7f35240ff280 2024-04-13T11:06:37.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.731+0000 7f3521ffb700 1 -- 172.21.15.134:0/2906526400 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f351805ae20 con 0x7f35240ff280 2024-04-13T11:06:37.731 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:06:37.731 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:06:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:06:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 -- 172.21.15.134:0/2906526400 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f351406cce0 msgr2=0x7f351406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 --2- 172.21.15.134:0/2906526400 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f351406cce0 0x7f351406f190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3510005950 tx=0x7f35100058e0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 -- 172.21.15.134:0/2906526400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35240ff280 msgr2=0x7f3524196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:06:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 --2- 172.21.15.134:0/2906526400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35240ff280 0x7f3524196ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3518006010 tx=0x7f351800be20 comp rx=0 tx=0).stop 2024-04-13T11:06:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 -- 172.21.15.134:0/2906526400 shutdown_connections 2024-04-13T11:06:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 --2- 172.21.15.134:0/2906526400 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f351406cce0 0x7f351406f190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 --2- 172.21.15.134:0/2906526400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35240ff280 0x7f3524196ad0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 --2- 172.21.15.134:0/2906526400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35240ffc20 0x7f3524197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:06:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 -- 172.21.15.134:0/2906526400 >> 172.21.15.134:0/2906526400 conn(0x7f35240fab00 msgr2=0x7f35240fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:06:37.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 -- 172.21.15.134:0/2906526400 shutdown_connections 2024-04-13T11:06:37.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:06:37.733+0000 7f352ac6c700 1 -- 172.21.15.134:0/2906526400 wait complete. 2024-04-13T11:06:38.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:38 smithi134 ceph-mon[112184]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:38.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:38 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2906526400' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:06:38.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:38.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:06:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:38 smithi194 ceph-mon[83053]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:06:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:38 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2906526400' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:06:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:06:39.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:39 smithi134 ceph-mon[112184]: pgmap v246: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-13T11:06:39.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:39 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:39 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-13T11:06:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:39 smithi134 ceph-mon[112184]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-13T11:06:39.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:39 smithi134 ceph-mon[112184]: Upgrade: osd.5 is safe to restart 2024-04-13T11:06:39.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:39 smithi194 ceph-mon[83053]: pgmap v246: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-13T11:06:39.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:39 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:39.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:39 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-13T11:06:39.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:39 smithi194 ceph-mon[83053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-13T11:06:39.472 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:39 smithi194 ceph-mon[83053]: Upgrade: osd.5 is safe to restart 2024-04-13T11:06:41.491 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:41 smithi194 ceph-mon[83053]: pgmap v247: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:06:41.491 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:41 smithi194 ceph-mon[83053]: Upgrade: Updating osd.5 2024-04-13T11:06:41.491 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:41 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:41.491 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:41 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-13T11:06:41.491 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:41 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:06:41.491 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:41 smithi194 ceph-mon[83053]: Deploying daemon osd.5 on smithi194 2024-04-13T11:06:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:41 smithi134 ceph-mon[112184]: pgmap v247: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:06:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:41 smithi134 ceph-mon[112184]: Upgrade: Updating osd.5 2024-04-13T11:06:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:41 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:41.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:41 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-13T11:06:41.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:41 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:06:41.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:41 smithi134 ceph-mon[112184]: Deploying daemon osd.5 on smithi194 2024-04-13T11:06:42.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:42 smithi134 ceph-mon[112184]: pgmap v248: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:06:43.203 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:42 smithi194 ceph-mon[83053]: pgmap v248: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:06:43.841 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:43 smithi194 ceph-mon[83053]: osd.5 marked itself down and dead 2024-04-13T11:06:43.841 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:43 smithi194 systemd[1]: Stopping Ceph osd.5 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:06:43.841 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:43 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[64699]: 2024-04-13T11:06:43.741+0000 7f445d0f3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:06:43.842 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:43 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[64699]: 2024-04-13T11:06:43.741+0000 7f445d0f3700 -1 osd.5 81 *** Got signal Terminated *** 2024-04-13T11:06:43.842 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:43 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[64699]: 2024-04-13T11:06:43.741+0000 7f445d0f3700 -1 osd.5 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:06:44.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:43 smithi134 ceph-mon[112184]: osd.5 marked itself down and dead 2024-04-13T11:06:44.998 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:44 smithi194 bash[106961]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5 2024-04-13T11:06:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:44 smithi194 ceph-mon[83053]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:06:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:44 smithi194 ceph-mon[83053]: osdmap e82: 6 total, 5 up, 6 in 2024-04-13T11:06:44.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:44 smithi194 ceph-mon[83053]: pgmap v250: 65 pgs: 13 stale+active+clean, 52 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-04-13T11:06:45.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:44 smithi134 ceph-mon[112184]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-13T11:06:45.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:44 smithi134 ceph-mon[112184]: osdmap e82: 6 total, 5 up, 6 in 2024-04-13T11:06:45.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:44 smithi134 ceph-mon[112184]: pgmap v250: 65 pgs: 13 stale+active+clean, 52 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-04-13T11:06:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:45 smithi194 ceph-mon[83053]: osdmap e83: 6 total, 5 up, 6 in 2024-04-13T11:06:46.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:45 smithi134 ceph-mon[112184]: osdmap e83: 6 total, 5 up, 6 in 2024-04-13T11:06:47.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:46 smithi134 ceph-mon[112184]: pgmap v252: 65 pgs: 6 peering, 10 stale+active+clean, 49 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-13T11:06:47.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:46 smithi194 ceph-mon[83053]: pgmap v252: 65 pgs: 6 peering, 10 stale+active+clean, 49 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-13T11:06:47.249 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:46 smithi194 systemd[1]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.5.service: Succeeded. 2024-04-13T11:06:47.249 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:46 smithi194 systemd[1]: Stopped Ceph osd.5 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:06:47.249 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:46 smithi194 systemd[1]: Starting Ceph osd.5 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:06:48.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:47 smithi134 ceph-mon[112184]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-13T11:06:48.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:47 smithi194 ceph-mon[83053]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-13T11:06:48.249 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:47 smithi194 bash[107236]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-13T11:06:48.249 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:47 smithi194 bash[107236]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-13T11:06:48.249 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:47 smithi194 bash[107236]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-13T11:06:48.249 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:47 smithi194 bash[107236]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-13T11:06:48.249 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:47 smithi194 bash[107236]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-13T11:06:48.249 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:47 smithi194 bash[107236]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-13T11:06:48.250 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:47 smithi194 bash[107236]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-13T11:06:49.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:48 smithi134 ceph-mon[112184]: pgmap v253: 65 pgs: 9 active+undersized+degraded, 6 peering, 1 stale+active+clean, 11 active+undersized, 38 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 34/267 objects degraded (12.734%) 2024-04-13T11:06:49.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:48 smithi194 ceph-mon[83053]: pgmap v253: 65 pgs: 9 active+undersized+degraded, 6 peering, 1 stale+active+clean, 11 active+undersized, 38 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 34/267 objects degraded (12.734%) 2024-04-13T11:06:49.248 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:49 smithi194 ceph-osd[107558]: -- 172.21.15.194:0/3961310347 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bee167f1e0 con 0x55bee164ec00 2024-04-13T11:06:49.248 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:49 smithi194 bash[107520]: 1c4a65aaf4133cf9334d089d2ef33771567d87b4102bd14fbfaa61402f7280be 2024-04-13T11:06:49.248 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:49 smithi194 systemd[1]: Started Ceph osd.5 for 38dd2ea8-f983-11ee-bc8d-c7b262605968. 2024-04-13T11:06:49.873 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:49 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:06:49.549+0000 7fd40307e7c0 -1 Falling back to public interface 2024-04-13T11:06:50.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:49 smithi134 ceph-mon[112184]: Health check failed: Degraded data redundancy: 34/267 objects degraded (12.734%), 9 pgs degraded (PG_DEGRADED) 2024-04-13T11:06:50.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:50.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:50.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:49 smithi194 ceph-mon[83053]: Health check failed: Degraded data redundancy: 34/267 objects degraded (12.734%), 9 pgs degraded (PG_DEGRADED) 2024-04-13T11:06:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:50.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:50.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:51.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:50 smithi134 ceph-mon[112184]: pgmap v254: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 44/267 objects degraded (16.479%) 2024-04-13T11:06:51.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:50 smithi194 ceph-mon[83053]: pgmap v254: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 44/267 objects degraded (16.479%) 2024-04-13T11:06:52.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:51 smithi134 ceph-mon[112184]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-13T11:06:52.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:51 smithi194 ceph-mon[83053]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-13T11:06:53.641 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:53 smithi194 ceph-mon[83053]: pgmap v255: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 755 B/s rd, 1 op/s; 44/267 objects degraded (16.479%) 2024-04-13T11:06:53.641 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:53.642 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:53.642 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:53.642 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:06:53.642 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:53.642 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:53 smithi134 ceph-mon[112184]: pgmap v255: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 755 B/s rd, 1 op/s; 44/267 objects degraded (16.479%) 2024-04-13T11:06:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:06:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:53.998 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:53 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:06:53.721+0000 7fd40307e7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-04-13T11:06:54.352 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:54 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:06:54.012+0000 7fd40307e7c0 -1 osd.5 81 log_to_monitors true 2024-04-13T11:06:54.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:54 smithi134 ceph-mon[112184]: from='osd.5 [v2:172.21.15.194:6816/1702176960,v1:172.21.15.194:6817/1702176960]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-13T11:06:54.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:54 smithi134 ceph-mon[112184]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-13T11:06:54.708 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:06:54 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:06:54.407+0000 7fd3f44d8700 -1 osd.5 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T11:06:54.709 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:54 smithi194 ceph-mon[83053]: from='osd.5 [v2:172.21.15.194:6816/1702176960,v1:172.21.15.194:6817/1702176960]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-13T11:06:54.709 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:54 smithi194 ceph-mon[83053]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-13T11:06:55.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:55 smithi134 ceph-mon[112184]: pgmap v256: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 1 op/s; 44/267 objects degraded (16.479%) 2024-04-13T11:06:55.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:55 smithi134 ceph-mon[112184]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-13T11:06:55.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:55 smithi134 ceph-mon[112184]: osdmap e84: 6 total, 5 up, 6 in 2024-04-13T11:06:55.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:55 smithi134 ceph-mon[112184]: from='osd.5 [v2:172.21.15.194:6816/1702176960,v1:172.21.15.194:6817/1702176960]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:06:55.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:55 smithi134 ceph-mon[112184]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:06:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:55 smithi194 ceph-mon[83053]: pgmap v256: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 1 op/s; 44/267 objects degraded (16.479%) 2024-04-13T11:06:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:55 smithi194 ceph-mon[83053]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-13T11:06:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:55 smithi194 ceph-mon[83053]: osdmap e84: 6 total, 5 up, 6 in 2024-04-13T11:06:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:55 smithi194 ceph-mon[83053]: from='osd.5 [v2:172.21.15.194:6816/1702176960,v1:172.21.15.194:6817/1702176960]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:06:55.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:55 smithi194 ceph-mon[83053]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-04-13T11:06:56.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:56 smithi194 ceph-mon[83053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:06:56.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:56 smithi194 ceph-mon[83053]: osd.5 [v2:172.21.15.194:6816/1702176960,v1:172.21.15.194:6817/1702176960] boot 2024-04-13T11:06:56.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:56 smithi194 ceph-mon[83053]: osdmap e85: 6 total, 6 up, 6 in 2024-04-13T11:06:56.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T11:06:56.408 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:56 smithi194 ceph-mon[83053]: osdmap e86: 6 total, 6 up, 6 in 2024-04-13T11:06:56.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:56 smithi134 ceph-mon[112184]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-13T11:06:56.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:56 smithi134 ceph-mon[112184]: osd.5 [v2:172.21.15.194:6816/1702176960,v1:172.21.15.194:6817/1702176960] boot 2024-04-13T11:06:56.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:56 smithi134 ceph-mon[112184]: osdmap e85: 6 total, 6 up, 6 in 2024-04-13T11:06:56.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-13T11:06:56.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:56 smithi134 ceph-mon[112184]: osdmap e86: 6 total, 6 up, 6 in 2024-04-13T11:06:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: pgmap v259: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 44/267 objects degraded (16.479%) 2024-04-13T11:06:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: Health check update: Degraded data redundancy: 44/267 objects degraded (16.479%), 14 pgs degraded (PG_DEGRADED) 2024-04-13T11:06:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:57.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:06:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:06:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:57.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-13T11:06:57.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-13T11:06:57.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-13T11:06:57.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-13T11:06:57.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-13T11:06:57.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-13T11:06:57.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-13T11:06:57.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-13T11:06:57.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-13T11:06:57.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-13T11:06:57.688 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-13T11:06:57.688 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-13T11:06:57.688 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:57.688 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-13T11:06:57.688 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:57 smithi134 ceph-mon[112184]: osdmap e87: 6 total, 6 up, 6 in 2024-04-13T11:06:57.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: pgmap v259: 65 pgs: 14 active+undersized+degraded, 15 active+undersized, 36 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 44/267 objects degraded (16.479%) 2024-04-13T11:06:57.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: Health check update: Degraded data redundancy: 44/267 objects degraded (16.479%), 14 pgs degraded (PG_DEGRADED) 2024-04-13T11:06:57.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:57.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:57.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:06:57.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:06:57.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:57.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:57.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:57.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:57.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:57.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:57.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:57.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-13T11:06:57.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-13T11:06:57.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-13T11:06:57.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-13T11:06:57.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-13T11:06:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-13T11:06:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-13T11:06:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-13T11:06:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-13T11:06:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-13T11:06:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-13T11:06:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-13T11:06:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-13T11:06:57.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:57 smithi194 ceph-mon[83053]: osdmap e87: 6 total, 6 up, 6 in 2024-04-13T11:06:58.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: Upgrade: Setting container_image for all osd 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 2 up:standby 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:58.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:58.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: Upgrade: Setting container_image for all osd 2024-04-13T11:06:58.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 2 up:standby 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:58.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:06:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:59 smithi134 ceph-mon[112184]: pgmap v262: 65 pgs: 7 active+undersized+degraded, 11 active+undersized, 47 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 19/267 objects degraded (7.116%) 2024-04-13T11:06:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:59 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.134:6826/1858187827,v1:172.21.15.134:6827/1858187827] up:boot 2024-04-13T11:06:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:59 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 3 up:standby 2024-04-13T11:06:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:06:59 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T11:06:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:59 smithi194 ceph-mon[83053]: pgmap v262: 65 pgs: 7 active+undersized+degraded, 11 active+undersized, 47 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 19/267 objects degraded (7.116%) 2024-04-13T11:06:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:59 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.134:6826/1858187827,v1:172.21.15.134:6827/1858187827] up:boot 2024-04-13T11:06:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:59 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 3 up:standby 2024-04-13T11:06:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:06:59 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T11:07:00.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:00 smithi134 ceph-mon[112184]: Upgrade: Updating mds.cephfs.smithi134.hxpcfx 2024-04-13T11:07:00.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:00 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:00.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:00 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.hxpcfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T11:07:00.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:00 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:07:00.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:00 smithi134 ceph-mon[112184]: Deploying daemon mds.cephfs.smithi134.hxpcfx on smithi134 2024-04-13T11:07:00.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:00 smithi134 ceph-mon[112184]: pgmap v263: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 732 B/s rd, 1 op/s 2024-04-13T11:07:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:00 smithi194 ceph-mon[83053]: Upgrade: Updating mds.cephfs.smithi134.hxpcfx 2024-04-13T11:07:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:00 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:00 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.hxpcfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T11:07:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:00 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:07:01.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:00 smithi194 ceph-mon[83053]: Deploying daemon mds.cephfs.smithi134.hxpcfx on smithi134 2024-04-13T11:07:01.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:00 smithi194 ceph-mon[83053]: pgmap v263: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 732 B/s rd, 1 op/s 2024-04-13T11:07:02.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:01 smithi134 ceph-mon[112184]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/267 objects degraded (7.116%), 7 pgs degraded) 2024-04-13T11:07:02.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:01 smithi194 ceph-mon[83053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/267 objects degraded (7.116%), 7 pgs degraded) 2024-04-13T11:07:03.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:02 smithi134 ceph-mon[112184]: osdmap e88: 6 total, 6 up, 6 in 2024-04-13T11:07:03.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:02 smithi134 ceph-mon[112184]: pgmap v265: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:07:03.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:02 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 2 up:standby 2024-04-13T11:07:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:02 smithi194 ceph-mon[83053]: osdmap e88: 6 total, 6 up, 6 in 2024-04-13T11:07:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:02 smithi194 ceph-mon[83053]: pgmap v265: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:07:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:02 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 2 up:standby 2024-04-13T11:07:05.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:05 smithi134 ceph-mon[112184]: pgmap v266: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 674 B/s rd, 1 op/s 2024-04-13T11:07:05.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:05 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T11:07:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:05 smithi194 ceph-mon[83053]: pgmap v266: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 674 B/s rd, 1 op/s 2024-04-13T11:07:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:05 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T11:07:07.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:07 smithi134 ceph-mon[112184]: pgmap v267: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 115 B/s rd, 0 op/s 2024-04-13T11:07:07.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:07 smithi194 ceph-mon[83053]: pgmap v267: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 115 B/s rd, 0 op/s 2024-04-13T11:07:07.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.851+0000 7f4827a59700 1 -- 172.21.15.134:0/924896484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48200ff390 msgr2=0x7f48200ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:07.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.851+0000 7f4827a59700 1 --2- 172.21.15.134:0/924896484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48200ff390 0x7f48200ff760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f481c009910 tx=0x7f481c009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:07.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.851+0000 7f4827a59700 1 -- 172.21.15.134:0/924896484 shutdown_connections 2024-04-13T11:07:07.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.851+0000 7f4827a59700 1 --2- 172.21.15.134:0/924896484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48200ffd30 0x7f4820103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:07.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.851+0000 7f4827a59700 1 --2- 172.21.15.134:0/924896484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48200ff390 0x7f48200ff760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:07.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.851+0000 7f4827a59700 1 -- 172.21.15.134:0/924896484 >> 172.21.15.134:0/924896484 conn(0x7f4820074f50 msgr2=0x7f4820075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:07.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.851+0000 7f4827a59700 1 -- 172.21.15.134:0/924896484 shutdown_connections 2024-04-13T11:07:07.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.851+0000 7f4827a59700 1 -- 172.21.15.134:0/924896484 wait complete. 2024-04-13T11:07:07.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.851+0000 7f4827a59700 1 Processor -- start 2024-04-13T11:07:07.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f4827a59700 1 -- start start 2024-04-13T11:07:07.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f4827a59700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48200ff390 0x7f4820100d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:07.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f4827a59700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48200ffd30 0x7f48201012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:07.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f4827a59700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4820101890 con 0x7f48200ff390 2024-04-13T11:07:07.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f4827a59700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4820101a00 con 0x7f48200ffd30 2024-04-13T11:07:07.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f48257f5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48200ff390 0x7f4820100d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:07.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f48257f5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48200ff390 0x7f4820100d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39440/0 (socket says 172.21.15.134:39440) 2024-04-13T11:07:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f48257f5700 1 -- 172.21.15.134:0/2697758004 learned_addr learned my addr 172.21.15.134:0/2697758004 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f4824ff4700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48200ffd30 0x7f48201012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f48257f5700 1 -- 172.21.15.134:0/2697758004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48200ffd30 msgr2=0x7f48201012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f48257f5700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48200ffd30 0x7f48201012c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f48257f5700 1 -- 172.21.15.134:0/2697758004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c0095f0 con 0x7f48200ff390 2024-04-13T11:07:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f4824ff4700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48200ffd30 0x7f48201012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:07:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f48257f5700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48200ff390 0x7f4820100d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f481c006010 tx=0x7f481c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f48167fc700 1 -- 172.21.15.134:0/2697758004 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f481c01d070 con 0x7f48200ff390 2024-04-13T11:07:07.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.852+0000 7f48167fc700 1 -- 172.21.15.134:0/2697758004 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f481c00f460 con 0x7f48200ff390 2024-04-13T11:07:07.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.853+0000 7f48167fc700 1 -- 172.21.15.134:0/2697758004 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f481c021640 con 0x7f48200ff390 2024-04-13T11:07:07.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.853+0000 7f4827a59700 1 -- 172.21.15.134:0/2697758004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48201a1eb0 con 0x7f48200ff390 2024-04-13T11:07:07.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.853+0000 7f4827a59700 1 -- 172.21.15.134:0/2697758004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48201a2260 con 0x7f48200ff390 2024-04-13T11:07:07.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.854+0000 7f4827a59700 1 -- 172.21.15.134:0/2697758004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4820108660 con 0x7f48200ff390 2024-04-13T11:07:07.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.854+0000 7f48167fc700 1 -- 172.21.15.134:0/2697758004 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f481c00fa60 con 0x7f48200ff390 2024-04-13T11:07:07.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.854+0000 7f48167fc700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f480c06cce0 0x7f480c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:07.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.855+0000 7f48167fc700 1 -- 172.21.15.134:0/2697758004 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f481c08d850 con 0x7f48200ff390 2024-04-13T11:07:07.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.855+0000 7f4824ff4700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f480c06cce0 0x7f480c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:07.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.855+0000 7f4824ff4700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f480c06cce0 0x7f480c06f190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4820102570 tx=0x7f4810005f50 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:07.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:07.859+0000 7f48167fc700 1 -- 172.21.15.134:0/2697758004 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f481c0578f0 con 0x7f48200ff390 2024-04-13T11:07:08.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.106+0000 7f4827a59700 1 -- 172.21.15.134:0/2697758004 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f482002cca0 con 0x7f480c06cce0 2024-04-13T11:07:08.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.108+0000 7f48167fc700 1 -- 172.21.15.134:0/2697758004 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f482002cca0 con 0x7f480c06cce0 2024-04-13T11:07:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 -- 172.21.15.134:0/2697758004 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f480c06cce0 msgr2=0x7f480c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f480c06cce0 0x7f480c06f190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4820102570 tx=0x7f4810005f50 comp rx=0 tx=0).stop 2024-04-13T11:07:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 -- 172.21.15.134:0/2697758004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48200ff390 msgr2=0x7f4820100d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48200ff390 0x7f4820100d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f481c006010 tx=0x7f481c00be20 comp rx=0 tx=0).stop 2024-04-13T11:07:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 -- 172.21.15.134:0/2697758004 shutdown_connections 2024-04-13T11:07:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f480c06cce0 0x7f480c06f190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48200ff390 0x7f4820100d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 --2- 172.21.15.134:0/2697758004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48200ffd30 0x7f48201012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 -- 172.21.15.134:0/2697758004 >> 172.21.15.134:0/2697758004 conn(0x7f4820074f50 msgr2=0x7f48200686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 -- 172.21.15.134:0/2697758004 shutdown_connections 2024-04-13T11:07:08.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.110+0000 7f4827a59700 1 -- 172.21.15.134:0/2697758004 wait complete. 2024-04-13T11:07:08.123 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:07:08.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.220+0000 7f6f57dea700 1 -- 172.21.15.134:0/282723641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f500ff2c0 msgr2=0x7f6f500ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.220+0000 7f6f57dea700 1 --2- 172.21.15.134:0/282723641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f500ff2c0 0x7f6f500ff690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009910 tx=0x7f6f44009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:08.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.220+0000 7f6f57dea700 1 -- 172.21.15.134:0/282723641 shutdown_connections 2024-04-13T11:07:08.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.220+0000 7f6f57dea700 1 --2- 172.21.15.134:0/282723641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f500ffc60 0x7f6f50103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.220+0000 7f6f57dea700 1 --2- 172.21.15.134:0/282723641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f500ff2c0 0x7f6f500ff690 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.220+0000 7f6f57dea700 1 -- 172.21.15.134:0/282723641 >> 172.21.15.134:0/282723641 conn(0x7f6f500fab80 msgr2=0x7f6f500fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:08.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.220+0000 7f6f57dea700 1 -- 172.21.15.134:0/282723641 shutdown_connections 2024-04-13T11:07:08.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.220+0000 7f6f57dea700 1 -- 172.21.15.134:0/282723641 wait complete. 2024-04-13T11:07:08.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f57dea700 1 Processor -- start 2024-04-13T11:07:08.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f57dea700 1 -- start start 2024-04-13T11:07:08.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f57dea700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f500ff2c0 0x7f6f5019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:08.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f57dea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f500ffc60 0x7f6f5019bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f57dea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5019c5f0 con 0x7f6f500ffc60 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f57dea700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50195aa0 con 0x7f6f500ff2c0 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f55385700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f500ffc60 0x7f6f5019bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f55385700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f500ffc60 0x7f6f5019bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39452/0 (socket says 172.21.15.134:39452) 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f55385700 1 -- 172.21.15.134:0/679304859 learned_addr learned my addr 172.21.15.134:0/679304859 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f55385700 1 -- 172.21.15.134:0/679304859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f500ff2c0 msgr2=0x7f6f5019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f55385700 1 --2- 172.21.15.134:0/679304859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f500ff2c0 0x7f6f5019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f55385700 1 -- 172.21.15.134:0/679304859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f440095f0 con 0x7f6f500ffc60 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.221+0000 7f6f55385700 1 --2- 172.21.15.134:0/679304859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f500ffc60 0x7f6f5019bf60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00e8f0 tx=0x7f6f4c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.222+0000 7f6f42ffd700 1 -- 172.21.15.134:0/679304859 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f4c009790 con 0x7f6f500ffc60 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.222+0000 7f6f42ffd700 1 -- 172.21.15.134:0/679304859 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f4c004cd0 con 0x7f6f500ffc60 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.222+0000 7f6f57dea700 1 -- 172.21.15.134:0/679304859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f50195d80 con 0x7f6f500ffc60 2024-04-13T11:07:08.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.222+0000 7f6f42ffd700 1 -- 172.21.15.134:0/679304859 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f4c005580 con 0x7f6f500ffc60 2024-04-13T11:07:08.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.222+0000 7f6f57dea700 1 -- 172.21.15.134:0/679304859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f501962d0 con 0x7f6f500ffc60 2024-04-13T11:07:08.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.223+0000 7f6f57dea700 1 -- 172.21.15.134:0/679304859 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5004ea50 con 0x7f6f500ffc60 2024-04-13T11:07:08.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.223+0000 7f6f42ffd700 1 -- 172.21.15.134:0/679304859 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6f4c004750 con 0x7f6f500ffc60 2024-04-13T11:07:08.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.223+0000 7f6f42ffd700 1 --2- 172.21.15.134:0/679304859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6f3c06cce0 0x7f6f3c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:08.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.223+0000 7f6f42ffd700 1 -- 172.21.15.134:0/679304859 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f6f4c014070 con 0x7f6f500ffc60 2024-04-13T11:07:08.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.223+0000 7f6f55b86700 1 --2- 172.21.15.134:0/679304859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6f3c06cce0 0x7f6f3c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:08.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.224+0000 7f6f55b86700 1 --2- 172.21.15.134:0/679304859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6f3c06cce0 0x7f6f3c06f190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400b6e0 tx=0x7f6f44000bc0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:08.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.228+0000 7f6f42ffd700 1 -- 172.21.15.134:0/679304859 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f6f4c05a400 con 0x7f6f500ffc60 2024-04-13T11:07:08.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.457+0000 7f6f57dea700 1 -- 172.21.15.134:0/679304859 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f500008d0 con 0x7f6f3c06cce0 2024-04-13T11:07:08.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.459+0000 7f6f42ffd700 1 -- 172.21.15.134:0/679304859 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6f500008d0 con 0x7f6f3c06cce0 2024-04-13T11:07:08.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 -- 172.21.15.134:0/679304859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6f3c06cce0 msgr2=0x7f6f3c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 --2- 172.21.15.134:0/679304859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6f3c06cce0 0x7f6f3c06f190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400b6e0 tx=0x7f6f44000bc0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 -- 172.21.15.134:0/679304859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f500ffc60 msgr2=0x7f6f5019bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 --2- 172.21.15.134:0/679304859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f500ffc60 0x7f6f5019bf60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00e8f0 tx=0x7f6f4c00ecb0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 -- 172.21.15.134:0/679304859 shutdown_connections 2024-04-13T11:07:08.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 --2- 172.21.15.134:0/679304859 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6f3c06cce0 0x7f6f3c06f190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 --2- 172.21.15.134:0/679304859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f500ff2c0 0x7f6f5019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 --2- 172.21.15.134:0/679304859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f500ffc60 0x7f6f5019bf60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 -- 172.21.15.134:0/679304859 >> 172.21.15.134:0/679304859 conn(0x7f6f500fab80 msgr2=0x7f6f50068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:08.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 -- 172.21.15.134:0/679304859 shutdown_connections 2024-04-13T11:07:08.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.461+0000 7f6f57dea700 1 -- 172.21.15.134:0/679304859 wait complete. 2024-04-13T11:07:08.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.572+0000 7fa1ecec8700 1 -- 172.21.15.134:0/2127365468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1e80ffd30 msgr2=0x7fa1e8103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.572+0000 7fa1ecec8700 1 --2- 172.21.15.134:0/2127365468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1e80ffd30 0x7fa1e8103ce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009910 tx=0x7fa1dc009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:08.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.572+0000 7fa1ecec8700 1 -- 172.21.15.134:0/2127365468 shutdown_connections 2024-04-13T11:07:08.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.572+0000 7fa1ecec8700 1 --2- 172.21.15.134:0/2127365468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1e80ffd30 0x7fa1e8103ce0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.572+0000 7fa1ecec8700 1 --2- 172.21.15.134:0/2127365468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e80ff390 0x7fa1e80ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.572+0000 7fa1ecec8700 1 -- 172.21.15.134:0/2127365468 >> 172.21.15.134:0/2127365468 conn(0x7fa1e8074f50 msgr2=0x7fa1e8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:08.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.572+0000 7fa1ecec8700 1 -- 172.21.15.134:0/2127365468 shutdown_connections 2024-04-13T11:07:08.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.572+0000 7fa1ecec8700 1 -- 172.21.15.134:0/2127365468 wait complete. 2024-04-13T11:07:08.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1ecec8700 1 Processor -- start 2024-04-13T11:07:08.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1ecec8700 1 -- start start 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1ecec8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1e80ff390 0x7fa1e8197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1ecec8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e80ffd30 0x7fa1e81984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1ecec8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e8198b90 con 0x7fa1e80ff390 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1ecec8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e819c920 con 0x7fa1e80ffd30 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1e659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1e80ff390 0x7fa1e8197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1e659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1e80ff390 0x7fa1e8197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39470/0 (socket says 172.21.15.134:39470) 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1e659c700 1 -- 172.21.15.134:0/732497481 learned_addr learned my addr 172.21.15.134:0/732497481 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1e5d9b700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e80ffd30 0x7fa1e81984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1e659c700 1 -- 172.21.15.134:0/732497481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e80ffd30 msgr2=0x7fa1e81984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1e659c700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e80ffd30 0x7fa1e81984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1e659c700 1 -- 172.21.15.134:0/732497481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0095f0 con 0x7fa1e80ff390 2024-04-13T11:07:08.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.573+0000 7fa1e659c700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1e80ff390 0x7fa1e8197f70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800b4b0 tx=0x7fa1d800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:08.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.574+0000 7fa1d77fe700 1 -- 172.21.15.134:0/732497481 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d8011800 con 0x7fa1e80ff390 2024-04-13T11:07:08.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.574+0000 7fa1d77fe700 1 -- 172.21.15.134:0/732497481 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa1d8011e00 con 0x7fa1e80ff390 2024-04-13T11:07:08.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.574+0000 7fa1ecec8700 1 -- 172.21.15.134:0/732497481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e819cc00 con 0x7fa1e80ff390 2024-04-13T11:07:08.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.574+0000 7fa1d77fe700 1 -- 172.21.15.134:0/732497481 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d8010e60 con 0x7fa1e80ff390 2024-04-13T11:07:08.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.574+0000 7fa1ecec8700 1 -- 172.21.15.134:0/732497481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e819d150 con 0x7fa1e80ff390 2024-04-13T11:07:08.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.574+0000 7fa1ecec8700 1 -- 172.21.15.134:0/732497481 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e804ea50 con 0x7fa1e80ff390 2024-04-13T11:07:08.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.575+0000 7fa1d77fe700 1 -- 172.21.15.134:0/732497481 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa1d8011960 con 0x7fa1e80ff390 2024-04-13T11:07:08.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.575+0000 7fa1d77fe700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa1d006cce0 0x7fa1d006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:08.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.575+0000 7fa1d77fe700 1 -- 172.21.15.134:0/732497481 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fa1d808c010 con 0x7fa1e80ff390 2024-04-13T11:07:08.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.575+0000 7fa1e5d9b700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa1d006cce0 0x7fa1d006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:08.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.576+0000 7fa1e5d9b700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa1d006cce0 0x7fa1d006f190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8199590 tx=0x7fa1dc01a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:08.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.580+0000 7fa1d77fe700 1 -- 172.21.15.134:0/732497481 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fa1d8056130 con 0x7fa1e80ff390 2024-04-13T11:07:08.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.790+0000 7fa1ecec8700 1 -- 172.21.15.134:0/732497481 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1e819d590 con 0x7fa1d006cce0 2024-04-13T11:07:08.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.800+0000 7fa1d77fe700 1 -- 172.21.15.134:0/732497481 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa1e819d590 con 0x7fa1d006cce0 2024-04-13T11:07:08.801 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:07:08.801 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (5m) 118s ago 17m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:07:08.801 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (17m) 118s ago 17m 8300k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:07:08.801 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (16m) 16s ago 16m 8056k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:07:08.801 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (3m) 118s ago 17m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:07:08.801 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (3m) 16s ago 16m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (5m) 118s ago 17m 88.2M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 starting - - - - 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (11m) 118s ago 11m 161M - 18.2.0 dc2bc1663786 4521492b0214 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (11m) 16s ago 11m 17.5M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (11m) 16s ago 11m 21.0M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (8m) 118s ago 18m 507M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (7m) 16s ago 16m 453M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (4m) 118s ago 19m 45.2M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (4m) 16s ago 16m 38.8M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 118s ago 17m 18.4M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (6m) 16s ago 16m 17.0M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (3m) 118s ago 15m 92.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:07:08.802 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (2m) 118s ago 14m 88.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e fc8474d8910f 2024-04-13T11:07:08.803 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (2m) 118s ago 14m 11.5M 1227M 18.2.2-1173-g5108bc67 3464fd31103e b24ce165bc9f 2024-04-13T11:07:08.803 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (88s) 16s ago 13m 137M 2251M 18.2.2-1173-g5108bc67 3464fd31103e d909c0e8d077 2024-04-13T11:07:08.803 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (53s) 16s ago 13m 96.0M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 7f721487a63b 2024-04-13T11:07:08.803 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (20s) 16s ago 12m 11.1M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 1c4a65aaf413 2024-04-13T11:07:08.803 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 118s ago 16m 66.8M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.802+0000 7fa1ecec8700 1 -- 172.21.15.134:0/732497481 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa1d006cce0 msgr2=0x7fa1d006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.802+0000 7fa1ecec8700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa1d006cce0 0x7fa1d006f190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8199590 tx=0x7fa1dc01a040 comp rx=0 tx=0).stop 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.802+0000 7fa1ecec8700 1 -- 172.21.15.134:0/732497481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1e80ff390 msgr2=0x7fa1e8197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.802+0000 7fa1ecec8700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1e80ff390 0x7fa1e8197f70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800b4b0 tx=0x7fa1d800b7c0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.802+0000 7fa1ecec8700 1 -- 172.21.15.134:0/732497481 shutdown_connections 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.802+0000 7fa1ecec8700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa1d006cce0 0x7fa1d006f190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.802+0000 7fa1ecec8700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1e80ff390 0x7fa1e8197f70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.802+0000 7fa1ecec8700 1 --2- 172.21.15.134:0/732497481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e80ffd30 0x7fa1e81984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.802+0000 7fa1ecec8700 1 -- 172.21.15.134:0/732497481 >> 172.21.15.134:0/732497481 conn(0x7fa1e8074f50 msgr2=0x7fa1e8068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.803+0000 7fa1ecec8700 1 -- 172.21.15.134:0/732497481 shutdown_connections 2024-04-13T11:07:08.804 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.803+0000 7fa1ecec8700 1 -- 172.21.15.134:0/732497481 wait complete. 2024-04-13T11:07:08.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 -- 172.21.15.134:0/3858219933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b800ffd30 msgr2=0x7f3b80103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 --2- 172.21.15.134:0/3858219933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b800ffd30 0x7f3b80103ce0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009910 tx=0x7f3b6c009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 -- 172.21.15.134:0/3858219933 shutdown_connections 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 --2- 172.21.15.134:0/3858219933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b800ffd30 0x7f3b80103ce0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 --2- 172.21.15.134:0/3858219933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b800ff390 0x7f3b800ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 -- 172.21.15.134:0/3858219933 >> 172.21.15.134:0/3858219933 conn(0x7f3b80074f50 msgr2=0x7f3b80075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 -- 172.21.15.134:0/3858219933 shutdown_connections 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 -- 172.21.15.134:0/3858219933 wait complete. 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 Processor -- start 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 -- start start 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b800ff390 0x7f3b80197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b800ffd30 0x7f3b80198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:08.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80198ae0 con 0x7f3b800ffd30 2024-04-13T11:07:08.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.906+0000 7f3b87116700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8019c870 con 0x7f3b800ff390 2024-04-13T11:07:08.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b7ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b800ffd30 0x7f3b80198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:08.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b7ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b800ffd30 0x7f3b80198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39494/0 (socket says 172.21.15.134:39494) 2024-04-13T11:07:08.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b7ffff700 1 -- 172.21.15.134:0/2662202585 learned_addr learned my addr 172.21.15.134:0/2662202585 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:08.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b84eb2700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b800ff390 0x7f3b80197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:08.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b7ffff700 1 -- 172.21.15.134:0/2662202585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b800ff390 msgr2=0x7f3b80197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:08.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b7ffff700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b800ff390 0x7f3b80197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:08.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b7ffff700 1 -- 172.21.15.134:0/2662202585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0095f0 con 0x7f3b800ffd30 2024-04-13T11:07:08.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b7ffff700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b800ffd30 0x7f3b80198400 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0092e0 tx=0x7f3b6c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:08.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b7dffb700 1 -- 172.21.15.134:0/2662202585 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c01d070 con 0x7f3b800ffd30 2024-04-13T11:07:08.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b7dffb700 1 -- 172.21.15.134:0/2662202585 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b6c005940 con 0x7f3b800ffd30 2024-04-13T11:07:08.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b87116700 1 -- 172.21.15.134:0/2662202585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8019caf0 con 0x7f3b800ffd30 2024-04-13T11:07:08.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.907+0000 7f3b87116700 1 -- 172.21.15.134:0/2662202585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8019cfe0 con 0x7f3b800ffd30 2024-04-13T11:07:08.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.909+0000 7f3b7dffb700 1 -- 172.21.15.134:0/2662202585 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c00fe50 con 0x7f3b800ffd30 2024-04-13T11:07:08.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.909+0000 7f3b7dffb700 1 -- 172.21.15.134:0/2662202585 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3b6c02b440 con 0x7f3b800ffd30 2024-04-13T11:07:08.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.909+0000 7f3b7dffb700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3b7006cce0 0x7f3b7006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:08.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.909+0000 7f3b87116700 1 -- 172.21.15.134:0/2662202585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b640052f0 con 0x7f3b800ffd30 2024-04-13T11:07:08.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.909+0000 7f3b7dffb700 1 -- 172.21.15.134:0/2662202585 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f3b6c08e6a0 con 0x7f3b800ffd30 2024-04-13T11:07:08.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.909+0000 7f3b84eb2700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3b7006cce0 0x7f3b7006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:08.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.910+0000 7f3b84eb2700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3b7006cce0 0x7f3b7006f190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b74005950 tx=0x7f3b740058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:08.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:08.915+0000 7f3b7dffb700 1 -- 172.21.15.134:0/2662202585 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f3b6c0587b0 con 0x7f3b800ffd30 2024-04-13T11:07:08.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:08.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:07:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: pgmap v268: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-13T11:07:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:07:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] up:boot 2024-04-13T11:07:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 3 up:standby 2024-04-13T11:07:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T11:07:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:08.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:08 smithi134 ceph-mon[112184]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:07:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: pgmap v268: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-13T11:07:08.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:07:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] up:boot 2024-04-13T11:07:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi134.kachce=up:active} 3 up:standby 2024-04-13T11:07:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T11:07:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:08.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:08 smithi194 ceph-mon[83053]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:09.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.239+0000 7f3b87116700 1 -- 172.21.15.134:0/2662202585 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3b640061d0 con 0x7f3b800ffd30 2024-04-13T11:07:09.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.239+0000 7f3b7dffb700 1 -- 172.21.15.134:0/2662202585 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7f3b6c026070 con 0x7f3b800ffd30 2024-04-13T11:07:09.240 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:07:09.240 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 6 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-04-13T11:07:09.241 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 1 2024-04-13T11:07:09.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:07:09.242 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:07:09.242 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-04-13T11:07:09.242 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 11 2024-04-13T11:07:09.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:07:09.242 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.241+0000 7f3b87116700 1 -- 172.21.15.134:0/2662202585 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3b7006cce0 msgr2=0x7f3b7006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.241+0000 7f3b87116700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3b7006cce0 0x7f3b7006f190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b74005950 tx=0x7f3b740058e0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.241+0000 7f3b87116700 1 -- 172.21.15.134:0/2662202585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b800ffd30 msgr2=0x7f3b80198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.241+0000 7f3b87116700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b800ffd30 0x7f3b80198400 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0092e0 tx=0x7f3b6c00be20 comp rx=0 tx=0).stop 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.242+0000 7f3b87116700 1 -- 172.21.15.134:0/2662202585 shutdown_connections 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.242+0000 7f3b87116700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3b7006cce0 0x7f3b7006f190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.242+0000 7f3b87116700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b800ff390 0x7f3b80197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.242+0000 7f3b87116700 1 --2- 172.21.15.134:0/2662202585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b800ffd30 0x7f3b80198400 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.242+0000 7f3b87116700 1 -- 172.21.15.134:0/2662202585 >> 172.21.15.134:0/2662202585 conn(0x7f3b80074f50 msgr2=0x7f3b80102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.242+0000 7f3b87116700 1 -- 172.21.15.134:0/2662202585 shutdown_connections 2024-04-13T11:07:09.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.242+0000 7f3b87116700 1 -- 172.21.15.134:0/2662202585 wait complete. 2024-04-13T11:07:09.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.351+0000 7fad18f92700 1 -- 172.21.15.134:0/3972975935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad14101d30 msgr2=0x7fad1410a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:09.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.351+0000 7fad18f92700 1 --2- 172.21.15.134:0/3972975935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad14101d30 0x7fad1410a230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad04009910 tx=0x7fad04009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:09.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.351+0000 7fad18f92700 1 -- 172.21.15.134:0/3972975935 shutdown_connections 2024-04-13T11:07:09.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.351+0000 7fad18f92700 1 --2- 172.21.15.134:0/3972975935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad14101d30 0x7fad1410a230 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.351+0000 7fad18f92700 1 --2- 172.21.15.134:0/3972975935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14101420 0x7fad141017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.351+0000 7fad18f92700 1 -- 172.21.15.134:0/3972975935 >> 172.21.15.134:0/3972975935 conn(0x7fad140fabe0 msgr2=0x7fad140fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:09.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.351+0000 7fad18f92700 1 -- 172.21.15.134:0/3972975935 shutdown_connections 2024-04-13T11:07:09.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.351+0000 7fad18f92700 1 -- 172.21.15.134:0/3972975935 wait complete. 2024-04-13T11:07:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.352+0000 7fad18f92700 1 Processor -- start 2024-04-13T11:07:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.352+0000 7fad18f92700 1 -- start start 2024-04-13T11:07:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.352+0000 7fad18f92700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14101420 0x7fad1419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.352+0000 7fad18f92700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad14101d30 0x7fad1419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.352+0000 7fad18f92700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad14195a50 con 0x7fad14101d30 2024-04-13T11:07:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.352+0000 7fad18f92700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad14195bc0 con 0x7fad14101420 2024-04-13T11:07:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.352+0000 7fad11d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad14101d30 0x7fad1419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.352+0000 7fad11d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad14101d30 0x7fad1419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34962/0 (socket says 172.21.15.134:34962) 2024-04-13T11:07:09.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.352+0000 7fad11d9b700 1 -- 172.21.15.134:0/273009275 learned_addr learned my addr 172.21.15.134:0/273009275 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.352+0000 7fad1259c700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14101420 0x7fad1419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.353+0000 7fad11d9b700 1 -- 172.21.15.134:0/273009275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14101420 msgr2=0x7fad1419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.353+0000 7fad11d9b700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14101420 0x7fad1419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.353+0000 7fad11d9b700 1 -- 172.21.15.134:0/273009275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040095f0 con 0x7fad14101d30 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.353+0000 7fad1259c700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14101420 0x7fad1419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.353+0000 7fad11d9b700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad14101d30 0x7fad1419bfa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad04006010 tx=0x7fad0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.353+0000 7fad037fe700 1 -- 172.21.15.134:0/273009275 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0401d070 con 0x7fad14101d30 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.353+0000 7fad037fe700 1 -- 172.21.15.134:0/273009275 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad0400f460 con 0x7fad14101d30 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.353+0000 7fad18f92700 1 -- 172.21.15.134:0/273009275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad14195e40 con 0x7fad14101d30 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.353+0000 7fad037fe700 1 -- 172.21.15.134:0/273009275 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad04021640 con 0x7fad14101d30 2024-04-13T11:07:09.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.353+0000 7fad18f92700 1 -- 172.21.15.134:0/273009275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad14196330 con 0x7fad14101d30 2024-04-13T11:07:09.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.354+0000 7fad18f92700 1 -- 172.21.15.134:0/273009275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad141078a0 con 0x7fad14101d30 2024-04-13T11:07:09.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.355+0000 7fad037fe700 1 -- 172.21.15.134:0/273009275 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fad04003a60 con 0x7fad14101d30 2024-04-13T11:07:09.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.355+0000 7fad037fe700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7facfc06cce0 0x7facfc06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:09.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.355+0000 7fad037fe700 1 -- 172.21.15.134:0/273009275 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fad0408d8c0 con 0x7fad14101d30 2024-04-13T11:07:09.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.355+0000 7fad1259c700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7facfc06cce0 0x7facfc06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:09.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.356+0000 7fad1259c700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7facfc06cce0 0x7facfc06f190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fad08005fd0 tx=0x7fad08005dc0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:09.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.360+0000 7fad037fe700 1 -- 172.21.15.134:0/273009275 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fad04057960 con 0x7fad14101d30 2024-04-13T11:07:09.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.607+0000 7fad18f92700 1 -- 172.21.15.134:0/273009275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fad14196550 con 0x7fad14101d30 2024-04-13T11:07:09.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.607+0000 7fad037fe700 1 -- 172.21.15.134:0/273009275 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1852 (secure 0 0 0) 0x7fad0405af80 con 0x7fad14101d30 2024-04-13T11:07:09.608 INFO:teuthology.orchestra.run.smithi134.stdout:e22 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 19 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T11:06:58.091559+0000 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:07:09.609 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 0 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14492} 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:07:09.610 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/3278328584,v1:172.21.15.134:6829/3278328584] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:24251} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:07:09.611 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{-1:34322} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:07:09.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 -- 172.21.15.134:0/273009275 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7facfc06cce0 msgr2=0x7facfc06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:09.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7facfc06cce0 0x7facfc06f190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fad08005fd0 tx=0x7fad08005dc0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 -- 172.21.15.134:0/273009275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad14101d30 msgr2=0x7fad1419bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:09.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad14101d30 0x7fad1419bfa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad04006010 tx=0x7fad0400be20 comp rx=0 tx=0).stop 2024-04-13T11:07:09.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 -- 172.21.15.134:0/273009275 shutdown_connections 2024-04-13T11:07:09.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7facfc06cce0 0x7facfc06f190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14101420 0x7fad1419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 --2- 172.21.15.134:0/273009275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad14101d30 0x7fad1419bfa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 -- 172.21.15.134:0/273009275 >> 172.21.15.134:0/273009275 conn(0x7fad140fabe0 msgr2=0x7fad141049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 -- 172.21.15.134:0/273009275 shutdown_connections 2024-04-13T11:07:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.610+0000 7fad18f92700 1 -- 172.21.15.134:0/273009275 wait complete. 2024-04-13T11:07:09.613 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-04-13T11:07:09.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.716+0000 7fb21b579700 1 -- 172.21.15.134:0/191676469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2140ff2c0 msgr2=0x7fb2140ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.716+0000 7fb21b579700 1 --2- 172.21.15.134:0/191676469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2140ff2c0 0x7fb2140ff690 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb210009910 tx=0x7fb210009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.716+0000 7fb21b579700 1 -- 172.21.15.134:0/191676469 shutdown_connections 2024-04-13T11:07:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.716+0000 7fb21b579700 1 --2- 172.21.15.134:0/191676469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140ffc60 0x7fb214103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.716+0000 7fb21b579700 1 --2- 172.21.15.134:0/191676469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2140ff2c0 0x7fb2140ff690 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.716+0000 7fb21b579700 1 -- 172.21.15.134:0/191676469 >> 172.21.15.134:0/191676469 conn(0x7fb2140fab80 msgr2=0x7fb2140fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.716+0000 7fb21b579700 1 -- 172.21.15.134:0/191676469 shutdown_connections 2024-04-13T11:07:09.717 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.716+0000 7fb21b579700 1 -- 172.21.15.134:0/191676469 wait complete. 2024-04-13T11:07:09.719 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.716+0000 7fb21b579700 1 Processor -- start 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.716+0000 7fb21b579700 1 -- start start 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb21b579700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140ff2c0 0x7fb214196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb21b579700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2140ffc60 0x7fb214196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb21b579700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214197600 con 0x7fb2140ffc60 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb21b579700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214197770 con 0x7fb2140ff2c0 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb218b14700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2140ffc60 0x7fb214196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb218b14700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2140ffc60 0x7fb214196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34972/0 (socket says 172.21.15.134:34972) 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb218b14700 1 -- 172.21.15.134:0/3303639288 learned_addr learned my addr 172.21.15.134:0/3303639288 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb219315700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140ff2c0 0x7fb214196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb218b14700 1 -- 172.21.15.134:0/3303639288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140ff2c0 msgr2=0x7fb214196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb218b14700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140ff2c0 0x7fb214196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.720 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb218b14700 1 -- 172.21.15.134:0/3303639288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2100095f0 con 0x7fb2140ffc60 2024-04-13T11:07:09.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb219315700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140ff2c0 0x7fb214196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:07:09.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb218b14700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2140ffc60 0x7fb214196fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb20400d900 tx=0x7fb20400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:09.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb20a7fc700 1 -- 172.21.15.134:0/3303639288 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb204009900 con 0x7fb2140ffc60 2024-04-13T11:07:09.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb21b579700 1 -- 172.21.15.134:0/3303639288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21419fb10 con 0x7fb2140ffc60 2024-04-13T11:07:09.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.717+0000 7fb21b579700 1 -- 172.21.15.134:0/3303639288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2141a0000 con 0x7fb2140ffc60 2024-04-13T11:07:09.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.718+0000 7fb20a7fc700 1 -- 172.21.15.134:0/3303639288 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb204009c70 con 0x7fb2140ffc60 2024-04-13T11:07:09.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.718+0000 7fb20a7fc700 1 -- 172.21.15.134:0/3303639288 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb20400f660 con 0x7fb2140ffc60 2024-04-13T11:07:09.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.718+0000 7fb21b579700 1 -- 172.21.15.134:0/3303639288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f8005320 con 0x7fb2140ffc60 2024-04-13T11:07:09.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.719+0000 7fb20a7fc700 1 -- 172.21.15.134:0/3303639288 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb20400f7c0 con 0x7fb2140ffc60 2024-04-13T11:07:09.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.719+0000 7fb20a7fc700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb20006cce0 0x7fb20006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:09.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.720+0000 7fb219315700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb20006cce0 0x7fb20006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:09.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.720+0000 7fb20a7fc700 1 -- 172.21.15.134:0/3303639288 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb20408c370 con 0x7fb2140ffc60 2024-04-13T11:07:09.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.720+0000 7fb219315700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb20006cce0 0x7fb20006f190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb21000b5c0 tx=0x7fb21001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:09.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.726+0000 7fb20a7fc700 1 -- 172.21.15.134:0/3303639288 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fb204059ea0 con 0x7fb2140ffc60 2024-04-13T11:07:09.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.960+0000 7fb21b579700 1 -- 172.21.15.134:0/3303639288 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1f8000bf0 con 0x7fb20006cce0 2024-04-13T11:07:09.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.961+0000 7fb20a7fc700 1 -- 172.21.15.134:0/3303639288 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb1f8000bf0 con 0x7fb20006cce0 2024-04-13T11:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "osd", 2024-04-13T11:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-04-13T11:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-04-13T11:07:09.962 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "12/23 daemons upgraded", 2024-04-13T11:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mds daemons", 2024-04-13T11:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:07:09.963 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:07:09.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 -- 172.21.15.134:0/3303639288 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb20006cce0 msgr2=0x7fb20006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:09.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb20006cce0 0x7fb20006f190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb21000b5c0 tx=0x7fb21001a040 comp rx=0 tx=0).stop 2024-04-13T11:07:09.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 -- 172.21.15.134:0/3303639288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2140ffc60 msgr2=0x7fb214196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:09.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2140ffc60 0x7fb214196fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb20400d900 tx=0x7fb20400dcc0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 -- 172.21.15.134:0/3303639288 shutdown_connections 2024-04-13T11:07:09.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb20006cce0 0x7fb20006f190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2140ff2c0 0x7fb214196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 --2- 172.21.15.134:0/3303639288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2140ffc60 0x7fb214196fe0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:09.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 -- 172.21.15.134:0/3303639288 >> 172.21.15.134:0/3303639288 conn(0x7fb2140fab80 msgr2=0x7fb2140fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:09.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 -- 172.21.15.134:0/3303639288 shutdown_connections 2024-04-13T11:07:09.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:09.963+0000 7fb21b579700 1 -- 172.21.15.134:0/3303639288 wait complete. 2024-04-13T11:07:09.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:09 smithi194 ceph-mon[83053]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:09.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:09 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2662202585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:09.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:09 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/273009275' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:07:10.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.068+0000 7ff814406700 1 -- 172.21.15.134:0/1785110885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff80c0ff390 msgr2=0x7ff80c0ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:10.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.068+0000 7ff814406700 1 --2- 172.21.15.134:0/1785110885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff80c0ff390 0x7ff80c0ff760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009910 tx=0x7ff7fc009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:10.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.068+0000 7ff814406700 1 -- 172.21.15.134:0/1785110885 shutdown_connections 2024-04-13T11:07:10.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.068+0000 7ff814406700 1 --2- 172.21.15.134:0/1785110885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff80c0ffd30 0x7ff80c103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:10.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.068+0000 7ff814406700 1 --2- 172.21.15.134:0/1785110885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff80c0ff390 0x7ff80c0ff760 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:10.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.068+0000 7ff814406700 1 -- 172.21.15.134:0/1785110885 >> 172.21.15.134:0/1785110885 conn(0x7ff80c074f50 msgr2=0x7ff80c075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:10.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.068+0000 7ff814406700 1 -- 172.21.15.134:0/1785110885 shutdown_connections 2024-04-13T11:07:10.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.068+0000 7ff814406700 1 -- 172.21.15.134:0/1785110885 wait complete. 2024-04-13T11:07:10.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.069+0000 7ff814406700 1 Processor -- start 2024-04-13T11:07:10.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.069+0000 7ff814406700 1 -- start start 2024-04-13T11:07:10.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.069+0000 7ff814406700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff80c0ff390 0x7ff80c19bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:10.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.069+0000 7ff814406700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff80c0ffd30 0x7ff80c19c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.069+0000 7ff814406700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c195b10 con 0x7ff80c0ffd30 2024-04-13T11:07:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.069+0000 7ff814406700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c195c80 con 0x7ff80c0ff390 2024-04-13T11:07:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.069+0000 7ff8119a1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff80c0ffd30 0x7ff80c19c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.069+0000 7ff8119a1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff80c0ffd30 0x7ff80c19c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34986/0 (socket says 172.21.15.134:34986) 2024-04-13T11:07:10.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.069+0000 7ff8119a1700 1 -- 172.21.15.134:0/2319724889 learned_addr learned my addr 172.21.15.134:0/2319724889 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.069+0000 7ff8121a2700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff80c0ff390 0x7ff80c19bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.070+0000 7ff8119a1700 1 -- 172.21.15.134:0/2319724889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff80c0ff390 msgr2=0x7ff80c19bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.070+0000 7ff8119a1700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff80c0ff390 0x7ff80c19bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.070+0000 7ff8119a1700 1 -- 172.21.15.134:0/2319724889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc0095f0 con 0x7ff80c0ffd30 2024-04-13T11:07:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.070+0000 7ff8119a1700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff80c0ffd30 0x7ff80c19c060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff80800d900 tx=0x7ff80800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:10.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.070+0000 7ff8037fe700 1 -- 172.21.15.134:0/2319724889 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff808009900 con 0x7ff80c0ffd30 2024-04-13T11:07:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.070+0000 7ff8037fe700 1 -- 172.21.15.134:0/2319724889 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff808010460 con 0x7ff80c0ffd30 2024-04-13T11:07:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.070+0000 7ff814406700 1 -- 172.21.15.134:0/2319724889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80c195f60 con 0x7ff80c0ffd30 2024-04-13T11:07:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.070+0000 7ff8037fe700 1 -- 172.21.15.134:0/2319724889 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff80800f5f0 con 0x7ff80c0ffd30 2024-04-13T11:07:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.070+0000 7ff814406700 1 -- 172.21.15.134:0/2319724889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c1964b0 con 0x7ff80c0ffd30 2024-04-13T11:07:10.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.071+0000 7ff814406700 1 -- 172.21.15.134:0/2319724889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80c108660 con 0x7ff80c0ffd30 2024-04-13T11:07:10.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.072+0000 7ff8037fe700 1 -- 172.21.15.134:0/2319724889 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff8080105d0 con 0x7ff80c0ffd30 2024-04-13T11:07:10.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.073+0000 7ff8037fe700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7f806cce0 0x7ff7f806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:10.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.073+0000 7ff8037fe700 1 -- 172.21.15.134:0/2319724889 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6273+0+0 (secure 0 0 0) 0x7ff80808c160 con 0x7ff80c0ffd30 2024-04-13T11:07:10.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.073+0000 7ff8121a2700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7f806cce0 0x7ff7f806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:10.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.073+0000 7ff8121a2700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7f806cce0 0x7ff7f806f190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc006010 tx=0x7ff7fc01a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:10.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.076+0000 7ff8037fe700 1 -- 172.21.15.134:0/2319724889 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7ff808056260 con 0x7ff80c0ffd30 2024-04-13T11:07:10.162 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:09 smithi134 ceph-mon[112184]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:10.162 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:09 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2662202585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:10.162 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:09 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/273009275' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:07:10.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.368+0000 7ff814406700 1 -- 172.21.15.134:0/2319724889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff80c1966d0 con 0x7ff80c0ffd30 2024-04-13T11:07:10.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.369+0000 7ff8037fe700 1 -- 172.21.15.134:0/2319724889 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff8080170e0 con 0x7ff80c0ffd30 2024-04-13T11:07:10.370 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:07:10.371 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:07:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:07:10.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 -- 172.21.15.134:0/2319724889 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7f806cce0 msgr2=0x7ff7f806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:10.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7f806cce0 0x7ff7f806f190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc006010 tx=0x7ff7fc01a040 comp rx=0 tx=0).stop 2024-04-13T11:07:10.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 -- 172.21.15.134:0/2319724889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff80c0ffd30 msgr2=0x7ff80c19c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff80c0ffd30 0x7ff80c19c060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff80800d900 tx=0x7ff80800dc10 comp rx=0 tx=0).stop 2024-04-13T11:07:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 -- 172.21.15.134:0/2319724889 shutdown_connections 2024-04-13T11:07:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff7f806cce0 0x7ff7f806f190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff80c0ff390 0x7ff80c19bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:10.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 --2- 172.21.15.134:0/2319724889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff80c0ffd30 0x7ff80c19c060 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 -- 172.21.15.134:0/2319724889 >> 172.21.15.134:0/2319724889 conn(0x7ff80c074f50 msgr2=0x7ff80c0686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 -- 172.21.15.134:0/2319724889 shutdown_connections 2024-04-13T11:07:10.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:10.371+0000 7ff814406700 1 -- 172.21.15.134:0/2319724889 wait complete. 2024-04-13T11:07:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:10 smithi194 ceph-mon[83053]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:10 smithi194 ceph-mon[83053]: pgmap v269: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-13T11:07:10.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:10 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2319724889' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:07:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:10 smithi134 ceph-mon[112184]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:10 smithi134 ceph-mon[112184]: pgmap v269: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-04-13T11:07:11.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:10 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2319724889' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:07:13.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:13 smithi134 ceph-mon[112184]: pgmap v270: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:13 smithi194 ceph-mon[83053]: pgmap v270: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:14.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:14 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:14.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:14 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:14.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:14 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:14.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:14 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:14 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:14 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:14 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:14.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:14 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:15 smithi194 ceph-mon[83053]: pgmap v271: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:15.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:15 smithi134 ceph-mon[112184]: pgmap v271: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:17.583 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:17 smithi134 ceph-mon[112184]: pgmap v272: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:17.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:17 smithi194 ceph-mon[83053]: pgmap v272: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:18.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:18 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:18.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:18 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:18.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:18 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:07:18.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:18 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:07:18.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:18 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:18.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:18 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:07:18.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:18 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:18.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:18 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:18.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:18 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:18.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:18 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:18 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:18 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:18 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:07:18.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:18 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:07:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:18 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:18 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:07:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:18 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:18 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:18 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:18.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:18 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:19.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:19 smithi134 ceph-mon[112184]: pgmap v273: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:19.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:19.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.kachce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T11:07:19.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:19 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:07:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:19 smithi194 ceph-mon[83053]: pgmap v273: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.kachce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T11:07:19.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:19 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:07:20.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:20 smithi134 ceph-mon[112184]: Upgrade: Updating mds.cephfs.smithi134.kachce 2024-04-13T11:07:20.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:20 smithi134 ceph-mon[112184]: Deploying daemon mds.cephfs.smithi134.kachce on smithi134 2024-04-13T11:07:20.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:20 smithi194 ceph-mon[83053]: Upgrade: Updating mds.cephfs.smithi134.kachce 2024-04-13T11:07:20.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:20 smithi194 ceph-mon[83053]: Deploying daemon mds.cephfs.smithi134.kachce on smithi134 2024-04-13T11:07:21.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:21 smithi134 ceph-mon[112184]: pgmap v274: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:21.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:21 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134[112161]: 2024-04-13T11:07:21.786+0000 7fb93ee3c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T11:07:21.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:21 smithi194 ceph-mon[83053]: pgmap v274: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:22.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:22 smithi134 ceph-mon[112184]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-13T11:07:22.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:22 smithi134 ceph-mon[112184]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T11:07:22.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:22 smithi134 ceph-mon[112184]: osdmap e89: 6 total, 6 up, 6 in 2024-04-13T11:07:22.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:22 smithi134 ceph-mon[112184]: Standby daemon mds.cephfs.smithi194.wnddvg assigned to filesystem cephfs as rank 0 2024-04-13T11:07:22.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:22 smithi134 ceph-mon[112184]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-13T11:07:22.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:22 smithi134 ceph-mon[112184]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-13T11:07:22.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:22 smithi134 ceph-mon[112184]: fsmap cephfs:1/1 {0=cephfs.smithi194.wnddvg=up:replay} 2 up:standby 2024-04-13T11:07:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:22 smithi194 ceph-mon[83053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-13T11:07:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:22 smithi194 ceph-mon[83053]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T11:07:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:22 smithi194 ceph-mon[83053]: osdmap e89: 6 total, 6 up, 6 in 2024-04-13T11:07:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:22 smithi194 ceph-mon[83053]: Standby daemon mds.cephfs.smithi194.wnddvg assigned to filesystem cephfs as rank 0 2024-04-13T11:07:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:22 smithi194 ceph-mon[83053]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-13T11:07:22.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:22 smithi194 ceph-mon[83053]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-13T11:07:22.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:22 smithi194 ceph-mon[83053]: fsmap cephfs:1/1 {0=cephfs.smithi194.wnddvg=up:replay} 2 up:standby 2024-04-13T11:07:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:23 smithi134 ceph-mon[112184]: pgmap v276: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:23.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:07:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:23 smithi194 ceph-mon[83053]: pgmap v276: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-13T11:07:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:23.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:07:24.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:24 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.kachce"}]: dispatch 2024-04-13T11:07:24.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:24 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.kachce"}]: dispatch 2024-04-13T11:07:25.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:25 smithi194 ceph-mon[83053]: pgmap v277: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-04-13T11:07:26.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:25 smithi134 ceph-mon[112184]: pgmap v277: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-04-13T11:07:27.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:27 smithi194 ceph-mon[83053]: pgmap v278: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-04-13T11:07:28.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:27 smithi134 ceph-mon[112184]: pgmap v278: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-04-13T11:07:29.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:29 smithi134 ceph-mon[112184]: pgmap v279: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-13T11:07:29.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:29 smithi194 ceph-mon[83053]: pgmap v279: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-13T11:07:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:31 smithi194 ceph-mon[83053]: pgmap v280: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-04-13T11:07:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:31 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:31 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:31.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:31 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:07:32.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:31 smithi134 ceph-mon[112184]: pgmap v280: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-04-13T11:07:32.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:31 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:32.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:31 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:32.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:31 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:07:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:32 smithi194 ceph-mon[83053]: reconnect by client.24309 192.168.0.1:0/2362139874 after 0.00099998 2024-04-13T11:07:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:32 smithi194 ceph-mon[83053]: reconnect by client.14552 192.168.0.1:0/1312131006 after 0.00099998 2024-04-13T11:07:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:32 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] up:reconnect 2024-04-13T11:07:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:32 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.134:6828/3883973153,v1:172.21.15.134:6829/3883973153] up:boot 2024-04-13T11:07:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:32 smithi194 ceph-mon[83053]: fsmap cephfs:1/1 {0=cephfs.smithi194.wnddvg=up:reconnect} 3 up:standby 2024-04-13T11:07:32.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:32 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.kachce"}]: dispatch 2024-04-13T11:07:33.180 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:32 smithi134 ceph-mon[112184]: reconnect by client.24309 192.168.0.1:0/2362139874 after 0.00099998 2024-04-13T11:07:33.180 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:32 smithi134 ceph-mon[112184]: reconnect by client.14552 192.168.0.1:0/1312131006 after 0.00099998 2024-04-13T11:07:33.180 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:32 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] up:reconnect 2024-04-13T11:07:33.180 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:32 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.134:6828/3883973153,v1:172.21.15.134:6829/3883973153] up:boot 2024-04-13T11:07:33.180 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:32 smithi134 ceph-mon[112184]: fsmap cephfs:1/1 {0=cephfs.smithi194.wnddvg=up:reconnect} 3 up:standby 2024-04-13T11:07:33.180 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:32 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.kachce"}]: dispatch 2024-04-13T11:07:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:33 smithi194 ceph-mon[83053]: pgmap v281: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-04-13T11:07:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:33 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] up:rejoin 2024-04-13T11:07:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:33 smithi194 ceph-mon[83053]: fsmap cephfs:1/1 {0=cephfs.smithi194.wnddvg=up:rejoin} 3 up:standby 2024-04-13T11:07:33.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:33 smithi194 ceph-mon[83053]: daemon mds.cephfs.smithi194.wnddvg is now active in filesystem cephfs as rank 0 2024-04-13T11:07:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:33 smithi134 ceph-mon[112184]: pgmap v281: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-04-13T11:07:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:33 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] up:rejoin 2024-04-13T11:07:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:33 smithi134 ceph-mon[112184]: fsmap cephfs:1/1 {0=cephfs.smithi194.wnddvg=up:rejoin} 3 up:standby 2024-04-13T11:07:34.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:33 smithi134 ceph-mon[112184]: daemon mds.cephfs.smithi194.wnddvg is now active in filesystem cephfs as rank 0 2024-04-13T11:07:34.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:34 smithi134 ceph-mon[112184]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-13T11:07:34.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:34 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] up:active 2024-04-13T11:07:34.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:34 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi194.wnddvg=up:active} 3 up:standby 2024-04-13T11:07:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:34 smithi194 ceph-mon[83053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-13T11:07:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:34 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] up:active 2024-04-13T11:07:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:34 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi194.wnddvg=up:active} 3 up:standby 2024-04-13T11:07:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:35 smithi194 ceph-mon[83053]: pgmap v282: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-13T11:07:36.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:35 smithi134 ceph-mon[112184]: pgmap v282: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-13T11:07:36.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:36 smithi194 ceph-mon[83053]: pgmap v283: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 85 B/s wr, 6 op/s 2024-04-13T11:07:37.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:36 smithi134 ceph-mon[112184]: pgmap v283: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 85 B/s wr, 6 op/s 2024-04-13T11:07:38.224 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:37 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:38.224 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:37 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:38.224 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:37 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:38.224 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:37 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:38.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:37 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:38.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:37 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:38.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:37 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:38.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:37 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:39.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:07:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:38 smithi134 ceph-mon[112184]: pgmap v284: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 255 B/s wr, 7 op/s 2024-04-13T11:07:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:07:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:38 smithi194 ceph-mon[83053]: pgmap v284: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 255 B/s wr, 7 op/s 2024-04-13T11:07:40.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.484+0000 7fec1b905700 1 -- 172.21.15.134:0/1637337668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec140ffd30 msgr2=0x7fec14103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:40.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.484+0000 7fec1b905700 1 --2- 172.21.15.134:0/1637337668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec140ffd30 0x7fec14103ce0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fec04009910 tx=0x7fec04009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:40.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.484+0000 7fec1b905700 1 -- 172.21.15.134:0/1637337668 shutdown_connections 2024-04-13T11:07:40.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.484+0000 7fec1b905700 1 --2- 172.21.15.134:0/1637337668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec140ffd30 0x7fec14103ce0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:40.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.484+0000 7fec1b905700 1 --2- 172.21.15.134:0/1637337668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec140ff390 0x7fec140ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:40.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.484+0000 7fec1b905700 1 -- 172.21.15.134:0/1637337668 >> 172.21.15.134:0/1637337668 conn(0x7fec14074f50 msgr2=0x7fec14075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.484+0000 7fec1b905700 1 -- 172.21.15.134:0/1637337668 shutdown_connections 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.484+0000 7fec1b905700 1 -- 172.21.15.134:0/1637337668 wait complete. 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec1b905700 1 Processor -- start 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec1b905700 1 -- start start 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec1b905700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec140ff390 0x7fec1419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec1b905700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec140ffd30 0x7fec1419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec1b905700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1419c5c0 con 0x7fec140ff390 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec1b905700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec14195a70 con 0x7fec140ffd30 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec196a1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec140ff390 0x7fec1419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec196a1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec140ff390 0x7fec1419b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35592/0 (socket says 172.21.15.134:35592) 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec196a1700 1 -- 172.21.15.134:0/1879626699 learned_addr learned my addr 172.21.15.134:0/1879626699 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec18ea0700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec140ffd30 0x7fec1419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:40.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec196a1700 1 -- 172.21.15.134:0/1879626699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec140ffd30 msgr2=0x7fec1419bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:40.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec196a1700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec140ffd30 0x7fec1419bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:40.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.485+0000 7fec196a1700 1 -- 172.21.15.134:0/1879626699 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040095f0 con 0x7fec140ff390 2024-04-13T11:07:40.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.486+0000 7fec196a1700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec140ff390 0x7fec1419b9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec1000e920 tx=0x7fec1000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:40.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.486+0000 7fec0a7fc700 1 -- 172.21.15.134:0/1879626699 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1000c9d0 con 0x7fec140ff390 2024-04-13T11:07:40.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.486+0000 7fec1b905700 1 -- 172.21.15.134:0/1879626699 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec14195d50 con 0x7fec140ff390 2024-04-13T11:07:40.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.486+0000 7fec0a7fc700 1 -- 172.21.15.134:0/1879626699 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fec10010430 con 0x7fec140ff390 2024-04-13T11:07:40.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.486+0000 7fec0a7fc700 1 -- 172.21.15.134:0/1879626699 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec10018650 con 0x7fec140ff390 2024-04-13T11:07:40.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.486+0000 7fec1b905700 1 -- 172.21.15.134:0/1879626699 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec14196270 con 0x7fec140ff390 2024-04-13T11:07:40.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.487+0000 7fec1b905700 1 -- 172.21.15.134:0/1879626699 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1404ea50 con 0x7fec140ff390 2024-04-13T11:07:40.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.487+0000 7fec0a7fc700 1 -- 172.21.15.134:0/1879626699 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fec10018910 con 0x7fec140ff390 2024-04-13T11:07:40.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.488+0000 7fec0a7fc700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fec0006cce0 0x7fec0006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:40.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.488+0000 7fec0a7fc700 1 -- 172.21.15.134:0/1879626699 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fec10014070 con 0x7fec140ff390 2024-04-13T11:07:40.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.488+0000 7fec18ea0700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fec0006cce0 0x7fec0006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:40.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.488+0000 7fec18ea0700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fec0006cce0 0x7fec0006f190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec04009fd0 tx=0x7fec04005940 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:40.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.492+0000 7fec0a7fc700 1 -- 172.21.15.134:0/1879626699 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fec10052ab0 con 0x7fec140ff390 2024-04-13T11:07:40.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.741+0000 7fec1b905700 1 -- 172.21.15.134:0/1879626699 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec14196710 con 0x7fec0006cce0 2024-04-13T11:07:40.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.743+0000 7fec0a7fc700 1 -- 172.21.15.134:0/1879626699 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fec14196710 con 0x7fec0006cce0 2024-04-13T11:07:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 -- 172.21.15.134:0/1879626699 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fec0006cce0 msgr2=0x7fec0006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fec0006cce0 0x7fec0006f190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec04009fd0 tx=0x7fec04005940 comp rx=0 tx=0).stop 2024-04-13T11:07:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 -- 172.21.15.134:0/1879626699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec140ff390 msgr2=0x7fec1419b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec140ff390 0x7fec1419b9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec1000e920 tx=0x7fec1000ec30 comp rx=0 tx=0).stop 2024-04-13T11:07:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 -- 172.21.15.134:0/1879626699 shutdown_connections 2024-04-13T11:07:40.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fec0006cce0 0x7fec0006f190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec140ff390 0x7fec1419b9f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 --2- 172.21.15.134:0/1879626699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec140ffd30 0x7fec1419bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 -- 172.21.15.134:0/1879626699 >> 172.21.15.134:0/1879626699 conn(0x7fec14074f50 msgr2=0x7fec140fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 -- 172.21.15.134:0/1879626699 shutdown_connections 2024-04-13T11:07:40.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.745+0000 7fec1b905700 1 -- 172.21.15.134:0/1879626699 wait complete. 2024-04-13T11:07:40.757 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:07:40.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.855+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1629263636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5940ffd30 msgr2=0x7fd594103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:40.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.855+0000 7fd59b1ea700 1 --2- 172.21.15.134:0/1629263636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5940ffd30 0x7fd594103ce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd580009910 tx=0x7fd580009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:40.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.855+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1629263636 shutdown_connections 2024-04-13T11:07:40.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.855+0000 7fd59b1ea700 1 --2- 172.21.15.134:0/1629263636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5940ffd30 0x7fd594103ce0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:40.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.855+0000 7fd59b1ea700 1 --2- 172.21.15.134:0/1629263636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940ff390 0x7fd5940ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:40.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.855+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1629263636 >> 172.21.15.134:0/1629263636 conn(0x7fd594074f50 msgr2=0x7fd594075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:40.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.855+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1629263636 shutdown_connections 2024-04-13T11:07:40.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.855+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1629263636 wait complete. 2024-04-13T11:07:40.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.856+0000 7fd59b1ea700 1 Processor -- start 2024-04-13T11:07:40.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.856+0000 7fd59b1ea700 1 -- start start 2024-04-13T11:07:40.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.856+0000 7fd59b1ea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5940ff390 0x7fd59419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:40.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.856+0000 7fd59b1ea700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940ffd30 0x7fd59419afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:40.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.856+0000 7fd59b1ea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59419b630 con 0x7fd5940ff390 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.856+0000 7fd59b1ea700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd594194ae0 con 0x7fd5940ffd30 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.856+0000 7fd598f86700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5940ff390 0x7fd59419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.856+0000 7fd598f86700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5940ff390 0x7fd59419aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35610/0 (socket says 172.21.15.134:35610) 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.856+0000 7fd598f86700 1 -- 172.21.15.134:0/1712751673 learned_addr learned my addr 172.21.15.134:0/1712751673 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.857+0000 7fd593fff700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940ffd30 0x7fd59419afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.857+0000 7fd598f86700 1 -- 172.21.15.134:0/1712751673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940ffd30 msgr2=0x7fd59419afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.857+0000 7fd598f86700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940ffd30 0x7fd59419afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.857+0000 7fd598f86700 1 -- 172.21.15.134:0/1712751673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800095f0 con 0x7fd5940ff390 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.857+0000 7fd598f86700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5940ff390 0x7fd59419aa60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd58800b4b0 tx=0x7fd58800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.857+0000 7fd591ffb700 1 -- 172.21.15.134:0/1712751673 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd588011800 con 0x7fd5940ff390 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.857+0000 7fd591ffb700 1 -- 172.21.15.134:0/1712751673 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd588011e00 con 0x7fd5940ff390 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.857+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1712751673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd594194dc0 con 0x7fd5940ff390 2024-04-13T11:07:40.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.857+0000 7fd591ffb700 1 -- 172.21.15.134:0/1712751673 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd588010e50 con 0x7fd5940ff390 2024-04-13T11:07:40.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.857+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1712751673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd594195310 con 0x7fd5940ff390 2024-04-13T11:07:40.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.858+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1712751673 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd594107670 con 0x7fd5940ff390 2024-04-13T11:07:40.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.859+0000 7fd591ffb700 1 -- 172.21.15.134:0/1712751673 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd588010380 con 0x7fd5940ff390 2024-04-13T11:07:40.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.859+0000 7fd591ffb700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd58406cce0 0x7fd58406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:40.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.859+0000 7fd591ffb700 1 -- 172.21.15.134:0/1712751673 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fd58808c1d0 con 0x7fd5940ff390 2024-04-13T11:07:40.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.859+0000 7fd593fff700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd58406cce0 0x7fd58406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:40.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.859+0000 7fd593fff700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd58406cce0 0x7fd58406f190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd58000b5c0 tx=0x7fd580005fd0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:40.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:40.866+0000 7fd591ffb700 1 -- 172.21.15.134:0/1712751673 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fd588059cb0 con 0x7fd5940ff390 2024-04-13T11:07:41.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.095+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1712751673 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5941955e0 con 0x7fd58406cce0 2024-04-13T11:07:41.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.096+0000 7fd591ffb700 1 -- 172.21.15.134:0/1712751673 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd5941955e0 con 0x7fd58406cce0 2024-04-13T11:07:41.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1712751673 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd58406cce0 msgr2=0x7fd58406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd58406cce0 0x7fd58406f190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd58000b5c0 tx=0x7fd580005fd0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1712751673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5940ff390 msgr2=0x7fd59419aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5940ff390 0x7fd59419aa60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd58800b4b0 tx=0x7fd58800b870 comp rx=0 tx=0).stop 2024-04-13T11:07:41.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1712751673 shutdown_connections 2024-04-13T11:07:41.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd58406cce0 0x7fd58406f190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5940ff390 0x7fd59419aa60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 --2- 172.21.15.134:0/1712751673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940ffd30 0x7fd59419afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1712751673 >> 172.21.15.134:0/1712751673 conn(0x7fd594074f50 msgr2=0x7fd5940fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:41.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1712751673 shutdown_connections 2024-04-13T11:07:41.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.099+0000 7fd59b1ea700 1 -- 172.21.15.134:0/1712751673 wait complete. 2024-04-13T11:07:41.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.209+0000 7f6a23d5a700 1 -- 172.21.15.134:0/1600586558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c101c30 msgr2=0x7f6a1c10a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.209+0000 7f6a23d5a700 1 --2- 172.21.15.134:0/1600586558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c101c30 0x7f6a1c10a130 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009910 tx=0x7f6a0c009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:41.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.209+0000 7f6a23d5a700 1 -- 172.21.15.134:0/1600586558 shutdown_connections 2024-04-13T11:07:41.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.209+0000 7f6a23d5a700 1 --2- 172.21.15.134:0/1600586558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c101c30 0x7f6a1c10a130 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.209+0000 7f6a23d5a700 1 --2- 172.21.15.134:0/1600586558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c101320 0x7f6a1c1016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.209+0000 7f6a23d5a700 1 -- 172.21.15.134:0/1600586558 >> 172.21.15.134:0/1600586558 conn(0x7f6a1c0fab80 msgr2=0x7f6a1c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:41.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.209+0000 7f6a23d5a700 1 -- 172.21.15.134:0/1600586558 shutdown_connections 2024-04-13T11:07:41.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.209+0000 7f6a23d5a700 1 -- 172.21.15.134:0/1600586558 wait complete. 2024-04-13T11:07:41.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.209+0000 7f6a23d5a700 1 Processor -- start 2024-04-13T11:07:41.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a23d5a700 1 -- start start 2024-04-13T11:07:41.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a23d5a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c101320 0x7f6a1c19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:41.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a23d5a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c101c30 0x7f6a1c19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:41.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a23d5a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c19c5f0 con 0x7f6a1c101320 2024-04-13T11:07:41.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a23d5a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c195aa0 con 0x7f6a1c101c30 2024-04-13T11:07:41.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a21af6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c101320 0x7f6a1c19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:41.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a21af6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c101320 0x7f6a1c19ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35624/0 (socket says 172.21.15.134:35624) 2024-04-13T11:07:41.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a21af6700 1 -- 172.21.15.134:0/614118993 learned_addr learned my addr 172.21.15.134:0/614118993 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:41.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a212f5700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c101c30 0x7f6a1c19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:41.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a21af6700 1 -- 172.21.15.134:0/614118993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c101c30 msgr2=0x7f6a1c19bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a21af6700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c101c30 0x7f6a1c19bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a21af6700 1 -- 172.21.15.134:0/614118993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c0095f0 con 0x7f6a1c101320 2024-04-13T11:07:41.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a21af6700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c101320 0x7f6a1c19ba20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800d8d0 tx=0x7f6a1800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:41.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a12ffd700 1 -- 172.21.15.134:0/614118993 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a180098a0 con 0x7f6a1c101320 2024-04-13T11:07:41.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a12ffd700 1 -- 172.21.15.134:0/614118993 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a18010460 con 0x7f6a1c101320 2024-04-13T11:07:41.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a23d5a700 1 -- 172.21.15.134:0/614118993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c195d80 con 0x7f6a1c101320 2024-04-13T11:07:41.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.210+0000 7f6a12ffd700 1 -- 172.21.15.134:0/614118993 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a18009ea0 con 0x7f6a1c101320 2024-04-13T11:07:41.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.211+0000 7f6a23d5a700 1 -- 172.21.15.134:0/614118993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c1962d0 con 0x7f6a1c101320 2024-04-13T11:07:41.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.212+0000 7f6a23d5a700 1 -- 172.21.15.134:0/614118993 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c1077a0 con 0x7f6a1c101320 2024-04-13T11:07:41.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.212+0000 7f6a12ffd700 1 -- 172.21.15.134:0/614118993 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6a180105d0 con 0x7f6a1c101320 2024-04-13T11:07:41.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.212+0000 7f6a12ffd700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6a0806cce0 0x7f6a0806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:41.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.213+0000 7f6a212f5700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6a0806cce0 0x7f6a0806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:41.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.213+0000 7f6a12ffd700 1 -- 172.21.15.134:0/614118993 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f6a1808c4a0 con 0x7f6a1c101320 2024-04-13T11:07:41.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.213+0000 7f6a212f5700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6a0806cce0 0x7f6a0806f190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0fc330 tx=0x7f6a0c01a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:41.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.217+0000 7f6a12ffd700 1 -- 172.21.15.134:0/614118993 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f6a18059f80 con 0x7f6a1c101320 2024-04-13T11:07:41.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:41 smithi134 ceph-mon[112184]: pgmap v285: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.5 MiB/s rd, 426 B/s wr, 6 op/s 2024-04-13T11:07:41.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.434+0000 7f6a23d5a700 1 -- 172.21.15.134:0/614118993 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a1c196560 con 0x7f6a0806cce0 2024-04-13T11:07:41.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.445+0000 7f6a12ffd700 1 -- 172.21.15.134:0/614118993 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6a1c196560 con 0x7f6a0806cce0 2024-04-13T11:07:41.446 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:07:41.446 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 4s ago 17m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:07:41.446 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (18m) 4s ago 18m 8493k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:07:41.446 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (17m) 49s ago 17m 8056k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:07:41.446 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (4m) 4s ago 18m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:07:41.446 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (4m) 49s ago 17m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:07:41.446 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (6m) 4s ago 17m 90.5M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:07:41.446 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (34s) 4s ago 11m 13.3M - 18.2.2-1173-g5108bc67 3464fd31103e ed96357b7f55 2024-04-13T11:07:41.446 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (10s) 4s ago 11m 10.1M - 18.2.2-1173-g5108bc67 3464fd31103e 2bdb75429769 2024-04-13T11:07:41.446 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (11m) 49s ago 11m 17.5M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (11m) 49s ago 11m 21.0M - 18.2.0 dc2bc1663786 db8ac436e8e0 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (9m) 4s ago 19m 510M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (7m) 49s ago 16m 453M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (4m) 4s ago 19m 52.4M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (4m) 49s ago 16m 38.8M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 4s ago 18m 18.5M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (7m) 49s ago 16m 17.0M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (3m) 4s ago 15m 111M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (3m) 4s ago 15m 99.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e fc8474d8910f 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (2m) 4s ago 14m 106M 1227M 18.2.2-1173-g5108bc67 3464fd31103e b24ce165bc9f 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (2m) 49s ago 14m 137M 2251M 18.2.2-1173-g5108bc67 3464fd31103e d909c0e8d077 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (86s) 49s ago 14m 96.0M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 7f721487a63b 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (52s) 49s ago 13m 11.1M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 1c4a65aaf413 2024-04-13T11:07:41.447 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 4s ago 17m 67.4M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:07:41.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.447+0000 7f6a23d5a700 1 -- 172.21.15.134:0/614118993 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6a0806cce0 msgr2=0x7f6a0806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.447+0000 7f6a23d5a700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6a0806cce0 0x7f6a0806f190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0fc330 tx=0x7f6a0c01a040 comp rx=0 tx=0).stop 2024-04-13T11:07:41.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.447+0000 7f6a23d5a700 1 -- 172.21.15.134:0/614118993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c101320 msgr2=0x7f6a1c19ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.447+0000 7f6a23d5a700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c101320 0x7f6a1c19ba20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800d8d0 tx=0x7f6a1800dbe0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.447+0000 7f6a23d5a700 1 -- 172.21.15.134:0/614118993 shutdown_connections 2024-04-13T11:07:41.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.447+0000 7f6a23d5a700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f6a0806cce0 0x7f6a0806f190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.447+0000 7f6a23d5a700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a1c101320 0x7f6a1c19ba20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.447+0000 7f6a23d5a700 1 --2- 172.21.15.134:0/614118993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c101c30 0x7f6a1c19bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.447+0000 7f6a23d5a700 1 -- 172.21.15.134:0/614118993 >> 172.21.15.134:0/614118993 conn(0x7f6a1c0fab80 msgr2=0x7f6a1c1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:41.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.448+0000 7f6a23d5a700 1 -- 172.21.15.134:0/614118993 shutdown_connections 2024-04-13T11:07:41.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.448+0000 7f6a23d5a700 1 -- 172.21.15.134:0/614118993 wait complete. 2024-04-13T11:07:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:41 smithi194 ceph-mon[83053]: pgmap v285: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.5 MiB/s rd, 426 B/s wr, 6 op/s 2024-04-13T11:07:41.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.552+0000 7f8bfac9d700 1 -- 172.21.15.134:0/3055944733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf4068630 msgr2=0x7f8bf4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.552+0000 7f8bfac9d700 1 --2- 172.21.15.134:0/3055944733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf4068630 0x7f8bf4068a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009910 tx=0x7f8be8009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:41.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.552+0000 7f8bfac9d700 1 -- 172.21.15.134:0/3055944733 shutdown_connections 2024-04-13T11:07:41.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.552+0000 7f8bfac9d700 1 --2- 172.21.15.134:0/3055944733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf4068fd0 0x7f8bf4104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.552+0000 7f8bfac9d700 1 --2- 172.21.15.134:0/3055944733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf4068630 0x7f8bf4068a00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.552+0000 7f8bfac9d700 1 -- 172.21.15.134:0/3055944733 >> 172.21.15.134:0/3055944733 conn(0x7f8bf4074f50 msgr2=0x7f8bf4075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:41.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.552+0000 7f8bfac9d700 1 -- 172.21.15.134:0/3055944733 shutdown_connections 2024-04-13T11:07:41.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.552+0000 7f8bfac9d700 1 -- 172.21.15.134:0/3055944733 wait complete. 2024-04-13T11:07:41.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bfac9d700 1 Processor -- start 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bfac9d700 1 -- start start 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bfac9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf4068630 0x7f8bf4195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bfac9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf4068fd0 0x7f8bf4196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bfac9d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf4196960 con 0x7f8bf4068630 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bfac9d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf419a6f0 con 0x7f8bf4068fd0 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bf8a39700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf4068630 0x7f8bf4195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bf8a39700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf4068630 0x7f8bf4195d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35638/0 (socket says 172.21.15.134:35638) 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bf8a39700 1 -- 172.21.15.134:0/2265698028 learned_addr learned my addr 172.21.15.134:0/2265698028 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bf3fff700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf4068fd0 0x7f8bf4196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bf8a39700 1 -- 172.21.15.134:0/2265698028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf4068fd0 msgr2=0x7f8bf4196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bf8a39700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf4068fd0 0x7f8bf4196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bf8a39700 1 -- 172.21.15.134:0/2265698028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be80095f0 con 0x7f8bf4068630 2024-04-13T11:07:41.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.553+0000 7f8bf8a39700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf4068630 0x7f8bf4195d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8be8006010 tx=0x7f8be800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:41.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.554+0000 7f8bf1ffb700 1 -- 172.21.15.134:0/2265698028 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8be801d070 con 0x7f8bf4068630 2024-04-13T11:07:41.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.554+0000 7f8bf1ffb700 1 -- 172.21.15.134:0/2265698028 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8be800f460 con 0x7f8bf4068630 2024-04-13T11:07:41.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.554+0000 7f8bf1ffb700 1 -- 172.21.15.134:0/2265698028 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8be8021620 con 0x7f8bf4068630 2024-04-13T11:07:41.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.554+0000 7f8bfac9d700 1 -- 172.21.15.134:0/2265698028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf419a970 con 0x7f8bf4068630 2024-04-13T11:07:41.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.554+0000 7f8bfac9d700 1 -- 172.21.15.134:0/2265698028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf419ae60 con 0x7f8bf4068630 2024-04-13T11:07:41.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.555+0000 7f8bfac9d700 1 -- 172.21.15.134:0/2265698028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf41086d0 con 0x7f8bf4068630 2024-04-13T11:07:41.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.556+0000 7f8bf1ffb700 1 -- 172.21.15.134:0/2265698028 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8be800fa40 con 0x7f8bf4068630 2024-04-13T11:07:41.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.556+0000 7f8bf1ffb700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8be406cce0 0x7f8be406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:41.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.557+0000 7f8bf1ffb700 1 -- 172.21.15.134:0/2265698028 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f8be808dcb0 con 0x7f8bf4068630 2024-04-13T11:07:41.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.557+0000 7f8bf3fff700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8be406cce0 0x7f8be406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:41.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.557+0000 7f8bf3fff700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8be406cce0 0x7f8be406f190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8be0005950 tx=0x7f8be00058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:41.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.560+0000 7f8bf1ffb700 1 -- 172.21.15.134:0/2265698028 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f8be8057ce0 con 0x7f8bf4068630 2024-04-13T11:07:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.859+0000 7f8bfac9d700 1 -- 172.21.15.134:0/2265698028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8bf402cc30 con 0x7f8bf4068630 2024-04-13T11:07:41.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.860+0000 7f8bf1ffb700 1 -- 172.21.15.134:0/2265698028 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7f8be805b300 con 0x7f8bf4068630 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 6 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:07:41.861 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:07:41.862 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-04-13T11:07:41.862 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:07:41.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:07:41.862 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:07:41.862 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-04-13T11:07:41.862 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 12 2024-04-13T11:07:41.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:07:41.862 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:07:41.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 -- 172.21.15.134:0/2265698028 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8be406cce0 msgr2=0x7f8be406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8be406cce0 0x7f8be406f190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8be0005950 tx=0x7f8be00058e0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 -- 172.21.15.134:0/2265698028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf4068630 msgr2=0x7f8bf4195d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf4068630 0x7f8bf4195d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8be8006010 tx=0x7f8be800be20 comp rx=0 tx=0).stop 2024-04-13T11:07:41.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 -- 172.21.15.134:0/2265698028 shutdown_connections 2024-04-13T11:07:41.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8be406cce0 0x7f8be406f190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf4068630 0x7f8bf4195d40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 --2- 172.21.15.134:0/2265698028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf4068fd0 0x7f8bf4196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 -- 172.21.15.134:0/2265698028 >> 172.21.15.134:0/2265698028 conn(0x7f8bf4074f50 msgr2=0x7f8bf40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:41.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 -- 172.21.15.134:0/2265698028 shutdown_connections 2024-04-13T11:07:41.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.862+0000 7f8bfac9d700 1 -- 172.21.15.134:0/2265698028 wait complete. 2024-04-13T11:07:41.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.972+0000 7f54df83c700 1 -- 172.21.15.134:0/1867451469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d8100400 msgr2=0x7f54d81007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.972+0000 7f54df83c700 1 --2- 172.21.15.134:0/1867451469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d8100400 0x7f54d81007d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009910 tx=0x7f54d4009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:41.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.972+0000 7f54df83c700 1 -- 172.21.15.134:0/1867451469 shutdown_connections 2024-04-13T11:07:41.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.972+0000 7f54df83c700 1 --2- 172.21.15.134:0/1867451469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d8100da0 0x7f54d8104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.972+0000 7f54df83c700 1 --2- 172.21.15.134:0/1867451469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d8100400 0x7f54d81007d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.972+0000 7f54df83c700 1 -- 172.21.15.134:0/1867451469 >> 172.21.15.134:0/1867451469 conn(0x7f54d80fbca0 msgr2=0x7f54d80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:41.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.972+0000 7f54df83c700 1 -- 172.21.15.134:0/1867451469 shutdown_connections 2024-04-13T11:07:41.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.972+0000 7f54df83c700 1 -- 172.21.15.134:0/1867451469 wait complete. 2024-04-13T11:07:41.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.973+0000 7f54df83c700 1 Processor -- start 2024-04-13T11:07:41.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.973+0000 7f54df83c700 1 -- start start 2024-04-13T11:07:41.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.973+0000 7f54df83c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d8100400 0x7f54d819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:41.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.973+0000 7f54df83c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d8100da0 0x7f54d819bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:41.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.973+0000 7f54df83c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d819c5e0 con 0x7f54d8100400 2024-04-13T11:07:41.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.973+0000 7f54df83c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d8195a90 con 0x7f54d8100da0 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.973+0000 7f54dd5d8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d8100400 0x7f54d819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.973+0000 7f54dd5d8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d8100400 0x7f54d819ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35656/0 (socket says 172.21.15.134:35656) 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.973+0000 7f54dd5d8700 1 -- 172.21.15.134:0/2971475640 learned_addr learned my addr 172.21.15.134:0/2971475640 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.973+0000 7f54dcdd7700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d8100da0 0x7f54d819bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.974+0000 7f54dd5d8700 1 -- 172.21.15.134:0/2971475640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d8100da0 msgr2=0x7f54d819bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.974+0000 7f54dd5d8700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d8100da0 0x7f54d819bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.974+0000 7f54dd5d8700 1 -- 172.21.15.134:0/2971475640 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d40095f0 con 0x7f54d8100400 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.974+0000 7f54dd5d8700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d8100400 0x7f54d819ba10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f54d4006010 tx=0x7f54d400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.974+0000 7f54ce7fc700 1 -- 172.21.15.134:0/2971475640 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d401d070 con 0x7f54d8100400 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.974+0000 7f54df83c700 1 -- 172.21.15.134:0/2971475640 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d8195d10 con 0x7f54d8100400 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.974+0000 7f54ce7fc700 1 -- 172.21.15.134:0/2971475640 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54d4005710 con 0x7f54d8100400 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.974+0000 7f54ce7fc700 1 -- 172.21.15.134:0/2971475640 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d400fe20 con 0x7f54d8100400 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.974+0000 7f54df83c700 1 -- 172.21.15.134:0/2971475640 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d8196200 con 0x7f54d8100400 2024-04-13T11:07:41.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.975+0000 7f54df83c700 1 -- 172.21.15.134:0/2971475640 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d8108710 con 0x7f54d8100400 2024-04-13T11:07:41.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.975+0000 7f54ce7fc700 1 -- 172.21.15.134:0/2971475640 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f54d4003a60 con 0x7f54d8100400 2024-04-13T11:07:41.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.976+0000 7f54ce7fc700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f54c406cce0 0x7f54c406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:41.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.976+0000 7f54ce7fc700 1 -- 172.21.15.134:0/2971475640 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f54d408d7e0 con 0x7f54d8100400 2024-04-13T11:07:41.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.976+0000 7f54dcdd7700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f54c406cce0 0x7f54c406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:41.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.976+0000 7f54dcdd7700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f54c406cce0 0x7f54c406f190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f54d80fc4e0 tx=0x7f54c80073d0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:41.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:41.980+0000 7f54ce7fc700 1 -- 172.21.15.134:0/2971475640 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f54d405b2c0 con 0x7f54d8100400 2024-04-13T11:07:42.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:42 smithi134 ceph-mon[112184]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:42.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:42 smithi134 ceph-mon[112184]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:42.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:42 smithi134 ceph-mon[112184]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:42.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:42 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2265698028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:42.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:42 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:42.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:42 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:42.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:42 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:07:42.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:42 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:07:42.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:42 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:42.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:42 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:07:42.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.231+0000 7f54df83c700 1 -- 172.21.15.134:0/2971475640 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f54d804ea50 con 0x7f54d8100400 2024-04-13T11:07:42.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.231+0000 7f54ce7fc700 1 -- 172.21.15.134:0/2971475640 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1855 (secure 0 0 0) 0x7f54d405ae50 con 0x7f54d8100400 2024-04-13T11:07:42.232 INFO:teuthology.orchestra.run.smithi134.stdout:e27 2024-04-13T11:07:42.232 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 27 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T11:07:33.703063+0000 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:07:42.233 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 89 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=24251} 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:07:42.234 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{0:24251} state up:active seq 179 join_fscid=1 addr [v2:172.21.15.194:6824/3497839686,v1:172.21.15.194:6825/3497839686] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:24271} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{-1:34322} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:07:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{-1:34354} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/3883973153,v1:172.21.15.134:6829/3883973153] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:07:42.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.233+0000 7f54df83c700 1 -- 172.21.15.134:0/2971475640 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f54c406cce0 msgr2=0x7f54c406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:42.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.233+0000 7f54df83c700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f54c406cce0 0x7f54c406f190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f54d80fc4e0 tx=0x7f54c80073d0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.233+0000 7f54df83c700 1 -- 172.21.15.134:0/2971475640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d8100400 msgr2=0x7f54d819ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:42.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.233+0000 7f54df83c700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d8100400 0x7f54d819ba10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f54d4006010 tx=0x7f54d400bd70 comp rx=0 tx=0).stop 2024-04-13T11:07:42.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.233+0000 7f54df83c700 1 -- 172.21.15.134:0/2971475640 shutdown_connections 2024-04-13T11:07:42.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.233+0000 7f54df83c700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f54c406cce0 0x7f54c406f190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.233+0000 7f54df83c700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d8100400 0x7f54d819ba10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.233+0000 7f54df83c700 1 --2- 172.21.15.134:0/2971475640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54d8100da0 0x7f54d819bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.234+0000 7f54df83c700 1 -- 172.21.15.134:0/2971475640 >> 172.21.15.134:0/2971475640 conn(0x7f54d80fbca0 msgr2=0x7f54d80fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:42.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.234+0000 7f54df83c700 1 -- 172.21.15.134:0/2971475640 shutdown_connections 2024-04-13T11:07:42.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.234+0000 7f54df83c700 1 -- 172.21.15.134:0/2971475640 wait complete. 2024-04-13T11:07:42.237 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 27 2024-04-13T11:07:42.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.338+0000 7f2408a17700 1 -- 172.21.15.134:0/801315212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040ffd30 msgr2=0x7f2404103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:42.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.338+0000 7f2408a17700 1 --2- 172.21.15.134:0/801315212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040ffd30 0x7f2404103ce0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009910 tx=0x7f23f4009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:42.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.338+0000 7f2408a17700 1 -- 172.21.15.134:0/801315212 shutdown_connections 2024-04-13T11:07:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.338+0000 7f2408a17700 1 --2- 172.21.15.134:0/801315212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040ffd30 0x7f2404103ce0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.338+0000 7f2408a17700 1 --2- 172.21.15.134:0/801315212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24040ff390 0x7f24040ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.338+0000 7f2408a17700 1 -- 172.21.15.134:0/801315212 >> 172.21.15.134:0/801315212 conn(0x7f2404074f50 msgr2=0x7f2404075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.338+0000 7f2408a17700 1 -- 172.21.15.134:0/801315212 shutdown_connections 2024-04-13T11:07:42.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.338+0000 7f2408a17700 1 -- 172.21.15.134:0/801315212 wait complete. 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.339+0000 7f2408a17700 1 Processor -- start 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.339+0000 7f2408a17700 1 -- start start 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.339+0000 7f2408a17700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24040ff390 0x7f240419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.339+0000 7f2408a17700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040ffd30 0x7f240419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.339+0000 7f2408a17700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240419b4f0 con 0x7f24040ffd30 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.339+0000 7f2408a17700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24041949a0 con 0x7f24040ff390 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.339+0000 7f2401d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040ffd30 0x7f240419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.339+0000 7f2401d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040ffd30 0x7f240419ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35682/0 (socket says 172.21.15.134:35682) 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.339+0000 7f2401d9b700 1 -- 172.21.15.134:0/2566855002 learned_addr learned my addr 172.21.15.134:0/2566855002 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.340+0000 7f240259c700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24040ff390 0x7f240419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.340+0000 7f2401d9b700 1 -- 172.21.15.134:0/2566855002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24040ff390 msgr2=0x7f240419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:42.342 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.340+0000 7f2401d9b700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24040ff390 0x7f240419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.340+0000 7f2401d9b700 1 -- 172.21.15.134:0/2566855002 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f40095f0 con 0x7f24040ffd30 2024-04-13T11:07:42.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.340+0000 7f2401d9b700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040ffd30 0x7f240419ae60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23f400bda0 tx=0x7f23f400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:42.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.340+0000 7f23f37fe700 1 -- 172.21.15.134:0/2566855002 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23f401d070 con 0x7f24040ffd30 2024-04-13T11:07:42.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.340+0000 7f23f37fe700 1 -- 172.21.15.134:0/2566855002 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23f400f460 con 0x7f24040ffd30 2024-04-13T11:07:42.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.340+0000 7f2408a17700 1 -- 172.21.15.134:0/2566855002 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2404194c20 con 0x7f24040ffd30 2024-04-13T11:07:42.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.340+0000 7f23f37fe700 1 -- 172.21.15.134:0/2566855002 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23f4021640 con 0x7f24040ffd30 2024-04-13T11:07:42.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.340+0000 7f2408a17700 1 -- 172.21.15.134:0/2566855002 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2404195110 con 0x7f24040ffd30 2024-04-13T11:07:42.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.341+0000 7f2408a17700 1 -- 172.21.15.134:0/2566855002 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2404107600 con 0x7f24040ffd30 2024-04-13T11:07:42.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.342+0000 7f23f37fe700 1 -- 172.21.15.134:0/2566855002 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f23f400fa60 con 0x7f24040ffd30 2024-04-13T11:07:42.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.342+0000 7f23f37fe700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f23ec06cce0 0x7f23ec06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:42.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.342+0000 7f23f37fe700 1 -- 172.21.15.134:0/2566855002 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f23f408d6d0 con 0x7f24040ffd30 2024-04-13T11:07:42.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.342+0000 7f240259c700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f23ec06cce0 0x7f23ec06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:42.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.342+0000 7f240259c700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f23ec06cce0 0x7f23ec06f190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f23f8007be0 tx=0x7f23f80073d0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:42.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.346+0000 7f23f37fe700 1 -- 172.21.15.134:0/2566855002 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f23f405b1b0 con 0x7f24040ffd30 2024-04-13T11:07:42.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:42 smithi194 ceph-mon[83053]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:42 smithi194 ceph-mon[83053]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:42 smithi194 ceph-mon[83053]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:42 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2265698028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:42 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:42 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:42 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:07:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:42 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:07:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:42 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:42.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:42 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:07:42.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.562+0000 7f2408a17700 1 -- 172.21.15.134:0/2566855002 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24041953f0 con 0x7f23ec06cce0 2024-04-13T11:07:42.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.563+0000 7f23f37fe700 1 -- 172.21.15.134:0/2566855002 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f24041953f0 con 0x7f23ec06cce0 2024-04-13T11:07:42.564 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:07:42.564 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:07:42.564 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:07:42.564 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:07:42.564 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:07:42.564 INFO:teuthology.orchestra.run.smithi134.stdout: "osd", 2024-04-13T11:07:42.565 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-04-13T11:07:42.565 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:07:42.565 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-04-13T11:07:42.565 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:07:42.565 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "14/23 daemons upgraded", 2024-04-13T11:07:42.565 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mds daemons", 2024-04-13T11:07:42.565 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:07:42.565 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:07:42.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.565+0000 7f2408a17700 1 -- 172.21.15.134:0/2566855002 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f23ec06cce0 msgr2=0x7f23ec06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:42.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.565+0000 7f2408a17700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f23ec06cce0 0x7f23ec06f190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f23f8007be0 tx=0x7f23f80073d0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.565+0000 7f2408a17700 1 -- 172.21.15.134:0/2566855002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040ffd30 msgr2=0x7f240419ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:42.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.565+0000 7f2408a17700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040ffd30 0x7f240419ae60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23f400bda0 tx=0x7f23f400bdd0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.566+0000 7f2408a17700 1 -- 172.21.15.134:0/2566855002 shutdown_connections 2024-04-13T11:07:42.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.566+0000 7f2408a17700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f23ec06cce0 0x7f23ec06f190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.566+0000 7f2408a17700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24040ff390 0x7f240419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.566+0000 7f2408a17700 1 --2- 172.21.15.134:0/2566855002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040ffd30 0x7f240419ae60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.566+0000 7f2408a17700 1 -- 172.21.15.134:0/2566855002 >> 172.21.15.134:0/2566855002 conn(0x7f2404074f50 msgr2=0x7f24040fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:42.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.566+0000 7f2408a17700 1 -- 172.21.15.134:0/2566855002 shutdown_connections 2024-04-13T11:07:42.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.566+0000 7f2408a17700 1 -- 172.21.15.134:0/2566855002 wait complete. 2024-04-13T11:07:42.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.670+0000 7f45eb576700 1 -- 172.21.15.134:0/4123552103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e40ffd30 msgr2=0x7f45e4103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:42.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.670+0000 7f45eb576700 1 --2- 172.21.15.134:0/4123552103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e40ffd30 0x7f45e4103ce0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009910 tx=0x7f45d4009c20 comp rx=0 tx=0).stop 2024-04-13T11:07:42.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.670+0000 7f45eb576700 1 -- 172.21.15.134:0/4123552103 shutdown_connections 2024-04-13T11:07:42.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.670+0000 7f45eb576700 1 --2- 172.21.15.134:0/4123552103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e40ffd30 0x7f45e4103ce0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.670+0000 7f45eb576700 1 --2- 172.21.15.134:0/4123552103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45e40ff390 0x7f45e40ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.670+0000 7f45eb576700 1 -- 172.21.15.134:0/4123552103 >> 172.21.15.134:0/4123552103 conn(0x7f45e4074f50 msgr2=0x7f45e4075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:42.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.670+0000 7f45eb576700 1 -- 172.21.15.134:0/4123552103 shutdown_connections 2024-04-13T11:07:42.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.670+0000 7f45eb576700 1 -- 172.21.15.134:0/4123552103 wait complete. 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.670+0000 7f45eb576700 1 Processor -- start 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.670+0000 7f45eb576700 1 -- start start 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45eb576700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45e40ff390 0x7f45e4196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45eb576700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e40ffd30 0x7f45e4196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45eb576700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4197600 con 0x7f45e40ffd30 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45eb576700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4197770 con 0x7f45e40ff390 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45e8b11700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e40ffd30 0x7f45e4196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45e8b11700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e40ffd30 0x7f45e4196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35698/0 (socket says 172.21.15.134:35698) 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45e8b11700 1 -- 172.21.15.134:0/2905331816 learned_addr learned my addr 172.21.15.134:0/2905331816 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45e9312700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45e40ff390 0x7f45e4196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:42.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45e8b11700 1 -- 172.21.15.134:0/2905331816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45e40ff390 msgr2=0x7f45e4196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45e8b11700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45e40ff390 0x7f45e4196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45e8b11700 1 -- 172.21.15.134:0/2905331816 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d40095f0 con 0x7f45e40ffd30 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45e8b11700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e40ffd30 0x7f45e4196fe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f45d4000c00 tx=0x7f45d400ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45da7fc700 1 -- 172.21.15.134:0/2905331816 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d401d070 con 0x7f45e40ffd30 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45da7fc700 1 -- 172.21.15.134:0/2905331816 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f45d400bed0 con 0x7f45e40ffd30 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45eb576700 1 -- 172.21.15.134:0/2905331816 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e419fb10 con 0x7f45e40ffd30 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45da7fc700 1 -- 172.21.15.134:0/2905331816 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d400fd90 con 0x7f45e40ffd30 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.671+0000 7f45eb576700 1 -- 172.21.15.134:0/2905331816 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e419ff20 con 0x7f45e40ffd30 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.672+0000 7f45eb576700 1 -- 172.21.15.134:0/2905331816 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e4107600 con 0x7f45e40ffd30 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.673+0000 7f45da7fc700 1 -- 172.21.15.134:0/2905331816 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f45d4021410 con 0x7f45e40ffd30 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.673+0000 7f45da7fc700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f45d006cce0 0x7f45d006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.673+0000 7f45da7fc700 1 -- 172.21.15.134:0/2905331816 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f45d408d6b0 con 0x7f45e40ffd30 2024-04-13T11:07:42.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.673+0000 7f45e9312700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f45d006cce0 0x7f45d006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:07:42.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.674+0000 7f45e9312700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f45d006cce0 0x7f45d006f190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009c60 tx=0x7f45e0009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:07:42.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.678+0000 7f45da7fc700 1 -- 172.21.15.134:0/2905331816 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f45d4057780 con 0x7f45e40ffd30 2024-04-13T11:07:42.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.953+0000 7f45eb576700 1 -- 172.21.15.134:0/2905331816 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f45e404ea50 con 0x7f45e40ffd30 2024-04-13T11:07:42.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.954+0000 7f45da7fc700 1 -- 172.21.15.134:0/2905331816 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f45d405ada0 con 0x7f45e40ffd30 2024-04-13T11:07:42.955 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:07:42.955 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:07:42.955 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 -- 172.21.15.134:0/2905331816 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f45d006cce0 msgr2=0x7f45d006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f45d006cce0 0x7f45d006f190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009c60 tx=0x7f45e0009260 comp rx=0 tx=0).stop 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 -- 172.21.15.134:0/2905331816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e40ffd30 msgr2=0x7f45e4196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e40ffd30 0x7f45e4196fe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f45d4000c00 tx=0x7f45d400ba70 comp rx=0 tx=0).stop 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 -- 172.21.15.134:0/2905331816 shutdown_connections 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f45d006cce0 0x7f45d006f190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45e40ff390 0x7f45e4196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 --2- 172.21.15.134:0/2905331816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e40ffd30 0x7f45e4196fe0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 -- 172.21.15.134:0/2905331816 >> 172.21.15.134:0/2905331816 conn(0x7f45e4074f50 msgr2=0x7f45e40fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 -- 172.21.15.134:0/2905331816 shutdown_connections 2024-04-13T11:07:42.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:07:42.956+0000 7f45eb576700 1 -- 172.21.15.134:0/2905331816 wait complete. 2024-04-13T11:07:43.221 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:43 smithi194 ceph-mon[83053]: pgmap v286: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-04-13T11:07:43.221 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:43 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:43.221 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:43 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:43.221 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:43 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:43.221 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:43 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:43.221 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:43 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2971475640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:07:43.221 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:43 smithi194 ceph-mon[83053]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:43.221 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:43 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2905331816' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:07:43.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:43 smithi134 ceph-mon[112184]: pgmap v286: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-04-13T11:07:43.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:43 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:43.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:43 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:43.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:43 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:43.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:43 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:07:43.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:43 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2971475640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:07:43.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:43 smithi134 ceph-mon[112184]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:07:43.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:43 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2905331816' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:07:44.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:44 smithi134 ceph-mon[112184]: Upgrade: Updating mds.cephfs.smithi194.wnddvg 2024-04-13T11:07:44.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:44 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:44.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:44 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.wnddvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T11:07:44.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:44 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:07:44.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:44 smithi134 ceph-mon[112184]: Deploying daemon mds.cephfs.smithi194.wnddvg on smithi194 2024-04-13T11:07:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:44 smithi194 ceph-mon[83053]: Upgrade: Updating mds.cephfs.smithi194.wnddvg 2024-04-13T11:07:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:44 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:44 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.wnddvg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T11:07:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:44 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:07:44.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:44 smithi194 ceph-mon[83053]: Deploying daemon mds.cephfs.smithi194.wnddvg on smithi194 2024-04-13T11:07:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:45 smithi134 ceph-mon[112184]: pgmap v287: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2024-04-13T11:07:45.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:45 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134[112161]: 2024-04-13T11:07:45.817+0000 7fb93ee3c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T11:07:45.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:45 smithi194 ceph-mon[83053]: pgmap v287: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2024-04-13T11:07:46.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:46 smithi134 ceph-mon[112184]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-13T11:07:46.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:46 smithi134 ceph-mon[112184]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T11:07:46.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:46 smithi134 ceph-mon[112184]: osdmap e90: 6 total, 6 up, 6 in 2024-04-13T11:07:46.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:46 smithi134 ceph-mon[112184]: Standby daemon mds.cephfs.smithi194.svyrny assigned to filesystem cephfs as rank 0 2024-04-13T11:07:46.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:46 smithi134 ceph-mon[112184]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-13T11:07:46.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:46 smithi134 ceph-mon[112184]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-13T11:07:46.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:46 smithi134 ceph-mon[112184]: fsmap cephfs:1/1 {0=cephfs.smithi194.svyrny=up:replay} 2 up:standby 2024-04-13T11:07:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:46 smithi194 ceph-mon[83053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-13T11:07:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:46 smithi194 ceph-mon[83053]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T11:07:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:46 smithi194 ceph-mon[83053]: osdmap e90: 6 total, 6 up, 6 in 2024-04-13T11:07:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:46 smithi194 ceph-mon[83053]: Standby daemon mds.cephfs.smithi194.svyrny assigned to filesystem cephfs as rank 0 2024-04-13T11:07:46.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:46 smithi194 ceph-mon[83053]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-13T11:07:46.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:46 smithi194 ceph-mon[83053]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-13T11:07:46.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:46 smithi194 ceph-mon[83053]: fsmap cephfs:1/1 {0=cephfs.smithi194.svyrny=up:replay} 2 up:standby 2024-04-13T11:07:47.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:47 smithi134 ceph-mon[112184]: pgmap v289: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-04-13T11:07:47.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:47 smithi194 ceph-mon[83053]: pgmap v289: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-04-13T11:07:49.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:49 smithi134 ceph-mon[112184]: pgmap v290: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-04-13T11:07:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:49 smithi194 ceph-mon[83053]: pgmap v290: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-04-13T11:07:51.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:51 smithi134 ceph-mon[112184]: pgmap v291: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-13T11:07:51.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:51 smithi194 ceph-mon[83053]: pgmap v291: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-13T11:07:53.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:53 smithi134 ceph-mon[112184]: pgmap v292: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-13T11:07:53.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:53.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:07:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:53 smithi194 ceph-mon[83053]: pgmap v292: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-13T11:07:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:53.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:07:55.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:55 smithi134 ceph-mon[112184]: pgmap v293: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-13T11:07:55.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:55 smithi194 ceph-mon[83053]: pgmap v293: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-13T11:07:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:56 smithi134 ceph-mon[112184]: reconnect by client.24309 192.168.0.1:0/2362139874 after 0.00099998 2024-04-13T11:07:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:56 smithi134 ceph-mon[112184]: reconnect by client.14552 192.168.0.1:0/1312131006 after 0.00099998 2024-04-13T11:07:56.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:56 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] up:reconnect 2024-04-13T11:07:56.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:56 smithi134 ceph-mon[112184]: fsmap cephfs:1/1 {0=cephfs.smithi194.svyrny=up:reconnect} 2 up:standby 2024-04-13T11:07:56.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:56.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:56.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:07:56.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:56 smithi194 ceph-mon[83053]: reconnect by client.24309 192.168.0.1:0/2362139874 after 0.00099998 2024-04-13T11:07:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:56 smithi194 ceph-mon[83053]: reconnect by client.14552 192.168.0.1:0/1312131006 after 0.00099998 2024-04-13T11:07:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:56 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] up:reconnect 2024-04-13T11:07:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:56 smithi194 ceph-mon[83053]: fsmap cephfs:1/1 {0=cephfs.smithi194.svyrny=up:reconnect} 2 up:standby 2024-04-13T11:07:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:07:56.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:07:57.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:57 smithi134 ceph-mon[112184]: pgmap v294: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-04-13T11:07:57.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:57 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] up:rejoin 2024-04-13T11:07:57.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:57 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.194:6824/2092944903,v1:172.21.15.194:6825/2092944903] up:boot 2024-04-13T11:07:57.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:57 smithi134 ceph-mon[112184]: fsmap cephfs:1/1 {0=cephfs.smithi194.svyrny=up:rejoin} 3 up:standby 2024-04-13T11:07:57.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.wnddvg"}]: dispatch 2024-04-13T11:07:57.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:57 smithi134 ceph-mon[112184]: daemon mds.cephfs.smithi194.svyrny is now active in filesystem cephfs as rank 0 2024-04-13T11:07:57.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:57 smithi194 ceph-mon[83053]: pgmap v294: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-04-13T11:07:57.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:57 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] up:rejoin 2024-04-13T11:07:57.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:57 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.194:6824/2092944903,v1:172.21.15.194:6825/2092944903] up:boot 2024-04-13T11:07:57.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:57 smithi194 ceph-mon[83053]: fsmap cephfs:1/1 {0=cephfs.smithi194.svyrny=up:rejoin} 3 up:standby 2024-04-13T11:07:57.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.wnddvg"}]: dispatch 2024-04-13T11:07:57.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:57 smithi194 ceph-mon[83053]: daemon mds.cephfs.smithi194.svyrny is now active in filesystem cephfs as rank 0 2024-04-13T11:07:58.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:58 smithi134 ceph-mon[112184]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-13T11:07:58.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:58 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] up:active 2024-04-13T11:07:58.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:58 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi194.svyrny=up:active} 3 up:standby 2024-04-13T11:07:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:58 smithi194 ceph-mon[83053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-13T11:07:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:58 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.194:6826/3941085795,v1:172.21.15.194:6827/3941085795] up:active 2024-04-13T11:07:58.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:58 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi194.svyrny=up:active} 3 up:standby 2024-04-13T11:07:59.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:07:59 smithi134 ceph-mon[112184]: pgmap v295: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-13T11:07:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:07:59 smithi194 ceph-mon[83053]: pgmap v295: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-13T11:08:01.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:01 smithi134 ceph-mon[112184]: pgmap v296: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-04-13T11:08:01.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:01 smithi194 ceph-mon[83053]: pgmap v296: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-04-13T11:08:03.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:02 smithi134 ceph-mon[112184]: pgmap v297: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-13T11:08:03.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:02 smithi194 ceph-mon[83053]: pgmap v297: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-13T11:08:05.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:05 smithi194 ceph-mon[83053]: pgmap v298: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.2 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-13T11:08:05.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:05 smithi134 ceph-mon[112184]: pgmap v298: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.2 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-13T11:08:06.815 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:06 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:06.815 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:06 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:06.816 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:06 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:06.816 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:06 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:06.940 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:06 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:06.940 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:06 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:06.940 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:06 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:06.940 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:06 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:07 smithi134 ceph-mon[112184]: pgmap v299: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.2 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-13T11:08:07.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:07 smithi194 ceph-mon[83053]: pgmap v299: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.2 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-13T11:08:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:08:09.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:08 smithi194 ceph-mon[83053]: pgmap v300: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-13T11:08:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:08:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:08 smithi134 ceph-mon[112184]: pgmap v300: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-13T11:08:11.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: pgmap v301: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-13T11:08:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:08:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:11.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:10 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:11.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: pgmap v301: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-13T11:08:11.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:08:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:10 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.074+0000 7f0ff057f700 1 -- 172.21.15.134:0/4144308722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe80ff390 msgr2=0x7f0fe80ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.074+0000 7f0ff057f700 1 --2- 172.21.15.134:0/4144308722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe80ff390 0x7f0fe80ff760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009910 tx=0x7f0fd8009c20 comp rx=0 tx=0).stop 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.074+0000 7f0ff057f700 1 -- 172.21.15.134:0/4144308722 shutdown_connections 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.074+0000 7f0ff057f700 1 --2- 172.21.15.134:0/4144308722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe80ffd30 0x7f0fe8103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.074+0000 7f0ff057f700 1 --2- 172.21.15.134:0/4144308722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe80ff390 0x7f0fe80ff760 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.074+0000 7f0ff057f700 1 -- 172.21.15.134:0/4144308722 >> 172.21.15.134:0/4144308722 conn(0x7f0fe8074f50 msgr2=0x7f0fe8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.074+0000 7f0ff057f700 1 -- 172.21.15.134:0/4144308722 shutdown_connections 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.074+0000 7f0ff057f700 1 -- 172.21.15.134:0/4144308722 wait complete. 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.075+0000 7f0ff057f700 1 Processor -- start 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.075+0000 7f0ff057f700 1 -- start start 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.075+0000 7f0ff057f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe80ff390 0x7f0fe819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.075+0000 7f0ff057f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe80ffd30 0x7f0fe819bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:13.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.075+0000 7f0ff057f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe819c5d0 con 0x7f0fe80ff390 2024-04-13T11:08:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.075+0000 7f0ff057f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe8195a80 con 0x7f0fe80ffd30 2024-04-13T11:08:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.075+0000 7f0fee31b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe80ff390 0x7f0fe819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.075+0000 7f0fee31b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe80ff390 0x7f0fe819ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56442/0 (socket says 172.21.15.134:56442) 2024-04-13T11:08:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.075+0000 7f0fee31b700 1 -- 172.21.15.134:0/4022793359 learned_addr learned my addr 172.21.15.134:0/4022793359 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.075+0000 7f0fedb1a700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe80ffd30 0x7f0fe819bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.076+0000 7f0fee31b700 1 -- 172.21.15.134:0/4022793359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe80ffd30 msgr2=0x7f0fe819bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.076+0000 7f0fee31b700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe80ffd30 0x7f0fe819bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.076+0000 7f0fee31b700 1 -- 172.21.15.134:0/4022793359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd80095f0 con 0x7f0fe80ff390 2024-04-13T11:08:13.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.076+0000 7f0fee31b700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe80ff390 0x7f0fe819ba00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8006010 tx=0x7f0fd800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:13.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.076+0000 7f0fdf7fe700 1 -- 172.21.15.134:0/4022793359 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fd801d070 con 0x7f0fe80ff390 2024-04-13T11:08:13.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.076+0000 7f0fdf7fe700 1 -- 172.21.15.134:0/4022793359 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0fd800f460 con 0x7f0fe80ff390 2024-04-13T11:08:13.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.076+0000 7f0ff057f700 1 -- 172.21.15.134:0/4022793359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe8195d00 con 0x7f0fe80ff390 2024-04-13T11:08:13.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.076+0000 7f0fdf7fe700 1 -- 172.21.15.134:0/4022793359 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fd8021640 con 0x7f0fe80ff390 2024-04-13T11:08:13.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.076+0000 7f0ff057f700 1 -- 172.21.15.134:0/4022793359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe81961f0 con 0x7f0fe80ff390 2024-04-13T11:08:13.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.077+0000 7f0ff057f700 1 -- 172.21.15.134:0/4022793359 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe804ea50 con 0x7f0fe80ff390 2024-04-13T11:08:13.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.078+0000 7f0fdf7fe700 1 -- 172.21.15.134:0/4022793359 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0fd800fa20 con 0x7f0fe80ff390 2024-04-13T11:08:13.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.078+0000 7f0fdf7fe700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0fd406cce0 0x7f0fd406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:13.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.078+0000 7f0fdf7fe700 1 -- 172.21.15.134:0/4022793359 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f0fd808d930 con 0x7f0fe80ff390 2024-04-13T11:08:13.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.078+0000 7f0fedb1a700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0fd406cce0 0x7f0fd406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:13.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.078+0000 7f0fedb1a700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0fd406cce0 0x7f0fd406f190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4005fd0 tx=0x7f0fe400a560 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:13.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.083+0000 7f0fdf7fe700 1 -- 172.21.15.134:0/4022793359 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f0fd805b3c0 con 0x7f0fe80ff390 2024-04-13T11:08:13.163 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:12 smithi194 ceph-mon[83053]: Upgrade: Updating mds.cephfs.smithi194.svyrny 2024-04-13T11:08:13.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:12 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:13.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:12 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.svyrny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T11:08:13.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:12 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:13.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:12 smithi194 ceph-mon[83053]: Deploying daemon mds.cephfs.smithi194.svyrny on smithi194 2024-04-13T11:08:13.164 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:12 smithi194 ceph-mon[83053]: pgmap v302: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-04-13T11:08:13.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:12 smithi134 ceph-mon[112184]: Upgrade: Updating mds.cephfs.smithi194.svyrny 2024-04-13T11:08:13.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:12 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:13.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:12 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi194.svyrny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-13T11:08:13.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:12 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:13.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:12 smithi134 ceph-mon[112184]: Deploying daemon mds.cephfs.smithi194.svyrny on smithi194 2024-04-13T11:08:13.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:12 smithi134 ceph-mon[112184]: pgmap v302: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-04-13T11:08:13.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.300+0000 7f0ff057f700 1 -- 172.21.15.134:0/4022793359 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fe8196640 con 0x7f0fd406cce0 2024-04-13T11:08:13.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.301+0000 7f0fdf7fe700 1 -- 172.21.15.134:0/4022793359 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0fe8196640 con 0x7f0fd406cce0 2024-04-13T11:08:13.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.303+0000 7f0ff057f700 1 -- 172.21.15.134:0/4022793359 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0fd406cce0 msgr2=0x7f0fd406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.303+0000 7f0ff057f700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0fd406cce0 0x7f0fd406f190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4005fd0 tx=0x7f0fe400a560 comp rx=0 tx=0).stop 2024-04-13T11:08:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.303+0000 7f0ff057f700 1 -- 172.21.15.134:0/4022793359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe80ff390 msgr2=0x7f0fe819ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.303+0000 7f0ff057f700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe80ff390 0x7f0fe819ba00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8006010 tx=0x7f0fd800be20 comp rx=0 tx=0).stop 2024-04-13T11:08:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.303+0000 7f0ff057f700 1 -- 172.21.15.134:0/4022793359 shutdown_connections 2024-04-13T11:08:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.303+0000 7f0ff057f700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f0fd406cce0 0x7f0fd406f190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.303+0000 7f0ff057f700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe80ff390 0x7f0fe819ba00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.303+0000 7f0ff057f700 1 --2- 172.21.15.134:0/4022793359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe80ffd30 0x7f0fe819bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.303+0000 7f0ff057f700 1 -- 172.21.15.134:0/4022793359 >> 172.21.15.134:0/4022793359 conn(0x7f0fe8074f50 msgr2=0x7f0fe81034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.304+0000 7f0ff057f700 1 -- 172.21.15.134:0/4022793359 shutdown_connections 2024-04-13T11:08:13.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.304+0000 7f0ff057f700 1 -- 172.21.15.134:0/4022793359 wait complete. 2024-04-13T11:08:13.315 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:08:13.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.410+0000 7f0628b7d700 1 -- 172.21.15.134:0/258260291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06240ff390 msgr2=0x7f06240ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.410+0000 7f0628b7d700 1 --2- 172.21.15.134:0/258260291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06240ff390 0x7f06240ff760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0614009910 tx=0x7f0614009c20 comp rx=0 tx=0).stop 2024-04-13T11:08:13.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.410+0000 7f0628b7d700 1 -- 172.21.15.134:0/258260291 shutdown_connections 2024-04-13T11:08:13.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.410+0000 7f0628b7d700 1 --2- 172.21.15.134:0/258260291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06240ffd30 0x7f0624103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.410+0000 7f0628b7d700 1 --2- 172.21.15.134:0/258260291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06240ff390 0x7f06240ff760 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.410+0000 7f0628b7d700 1 -- 172.21.15.134:0/258260291 >> 172.21.15.134:0/258260291 conn(0x7f0624074f50 msgr2=0x7f0624075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:13.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.410+0000 7f0628b7d700 1 -- 172.21.15.134:0/258260291 shutdown_connections 2024-04-13T11:08:13.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.410+0000 7f0628b7d700 1 -- 172.21.15.134:0/258260291 wait complete. 2024-04-13T11:08:13.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f0628b7d700 1 Processor -- start 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f0628b7d700 1 -- start start 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f0628b7d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06240ff390 0x7f0624197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f0628b7d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06240ffd30 0x7f06241983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f0628b7d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624198a90 con 0x7f06240ff390 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f0628b7d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062419c820 con 0x7f06240ffd30 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f062259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06240ff390 0x7f0624197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f062259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06240ff390 0x7f0624197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56450/0 (socket says 172.21.15.134:56450) 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f062259c700 1 -- 172.21.15.134:0/1365010877 learned_addr learned my addr 172.21.15.134:0/1365010877 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f0621d9b700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06240ffd30 0x7f06241983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f062259c700 1 -- 172.21.15.134:0/1365010877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06240ffd30 msgr2=0x7f06241983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f062259c700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06240ffd30 0x7f06241983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f062259c700 1 -- 172.21.15.134:0/1365010877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06140095f0 con 0x7f06240ff390 2024-04-13T11:08:13.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f062259c700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06240ff390 0x7f0624197e70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0614000c00 tx=0x7f061400bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:13.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.411+0000 7f06137fe700 1 -- 172.21.15.134:0/1365010877 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f061401d070 con 0x7f06240ff390 2024-04-13T11:08:13.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.412+0000 7f06137fe700 1 -- 172.21.15.134:0/1365010877 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0614005710 con 0x7f06240ff390 2024-04-13T11:08:13.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.412+0000 7f0628b7d700 1 -- 172.21.15.134:0/1365010877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062419caa0 con 0x7f06240ff390 2024-04-13T11:08:13.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.412+0000 7f06137fe700 1 -- 172.21.15.134:0/1365010877 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06140039d0 con 0x7f06240ff390 2024-04-13T11:08:13.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.412+0000 7f0628b7d700 1 -- 172.21.15.134:0/1365010877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062419cf30 con 0x7f06240ff390 2024-04-13T11:08:13.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.413+0000 7f0628b7d700 1 -- 172.21.15.134:0/1365010877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062404ea50 con 0x7f06240ff390 2024-04-13T11:08:13.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.413+0000 7f06137fe700 1 -- 172.21.15.134:0/1365010877 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0614003c50 con 0x7f06240ff390 2024-04-13T11:08:13.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.413+0000 7f06137fe700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f060c06cce0 0x7f060c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:13.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.414+0000 7f06137fe700 1 -- 172.21.15.134:0/1365010877 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f061408dbe0 con 0x7f06240ff390 2024-04-13T11:08:13.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.414+0000 7f0621d9b700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f060c06cce0 0x7f060c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:13.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.414+0000 7f0621d9b700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f060c06cce0 0x7f060c06f190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0624199490 tx=0x7f0618009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:13.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.418+0000 7f06137fe700 1 -- 172.21.15.134:0/1365010877 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f0614057be0 con 0x7f06240ff390 2024-04-13T11:08:13.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.637+0000 7f0628b7d700 1 -- 172.21.15.134:0/1365010877 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f062419d450 con 0x7f060c06cce0 2024-04-13T11:08:13.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.638+0000 7f06137fe700 1 -- 172.21.15.134:0/1365010877 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f062419d450 con 0x7f060c06cce0 2024-04-13T11:08:13.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.640+0000 7f0628b7d700 1 -- 172.21.15.134:0/1365010877 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f060c06cce0 msgr2=0x7f060c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.640+0000 7f0628b7d700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f060c06cce0 0x7f060c06f190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0624199490 tx=0x7f0618009260 comp rx=0 tx=0).stop 2024-04-13T11:08:13.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.640+0000 7f0628b7d700 1 -- 172.21.15.134:0/1365010877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06240ff390 msgr2=0x7f0624197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.640+0000 7f0628b7d700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06240ff390 0x7f0624197e70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0614000c00 tx=0x7f061400bde0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.640+0000 7f0628b7d700 1 -- 172.21.15.134:0/1365010877 shutdown_connections 2024-04-13T11:08:13.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.640+0000 7f0628b7d700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f060c06cce0 0x7f060c06f190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.640+0000 7f0628b7d700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06240ff390 0x7f0624197e70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.640+0000 7f0628b7d700 1 --2- 172.21.15.134:0/1365010877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06240ffd30 0x7f06241983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.640+0000 7f0628b7d700 1 -- 172.21.15.134:0/1365010877 >> 172.21.15.134:0/1365010877 conn(0x7f0624074f50 msgr2=0x7f0624068d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:13.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.641+0000 7f0628b7d700 1 -- 172.21.15.134:0/1365010877 shutdown_connections 2024-04-13T11:08:13.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.641+0000 7f0628b7d700 1 -- 172.21.15.134:0/1365010877 wait complete. 2024-04-13T11:08:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.745+0000 7efe1eca6700 1 -- 172.21.15.134:0/2779927060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe180ffd30 msgr2=0x7efe18103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.745+0000 7efe1eca6700 1 --2- 172.21.15.134:0/2779927060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe180ffd30 0x7efe18103ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe04009910 tx=0x7efe04009c20 comp rx=0 tx=0).stop 2024-04-13T11:08:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.745+0000 7efe1eca6700 1 -- 172.21.15.134:0/2779927060 shutdown_connections 2024-04-13T11:08:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 --2- 172.21.15.134:0/2779927060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe180ffd30 0x7efe18103ce0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 --2- 172.21.15.134:0/2779927060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe180ff390 0x7efe180ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 -- 172.21.15.134:0/2779927060 >> 172.21.15.134:0/2779927060 conn(0x7efe18074f50 msgr2=0x7efe18075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 -- 172.21.15.134:0/2779927060 shutdown_connections 2024-04-13T11:08:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 -- 172.21.15.134:0/2779927060 wait complete. 2024-04-13T11:08:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 Processor -- start 2024-04-13T11:08:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 -- start start 2024-04-13T11:08:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe180ff390 0x7efe18196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:13.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe180ffd30 0x7efe18197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe18197620 con 0x7efe180ff390 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1eca6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe18197760 con 0x7efe180ffd30 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1ca42700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe180ff390 0x7efe18196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.746+0000 7efe1ca42700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe180ff390 0x7efe18196ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56476/0 (socket says 172.21.15.134:56476) 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe1ca42700 1 -- 172.21.15.134:0/3231516791 learned_addr learned my addr 172.21.15.134:0/3231516791 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe17fff700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe180ffd30 0x7efe18197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe1ca42700 1 -- 172.21.15.134:0/3231516791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe180ffd30 msgr2=0x7efe18197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe1ca42700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe180ffd30 0x7efe18197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe1ca42700 1 -- 172.21.15.134:0/3231516791 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040095f0 con 0x7efe180ff390 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe1ca42700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe180ff390 0x7efe18196ac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00e920 tx=0x7efe0c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:13.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe15ffb700 1 -- 172.21.15.134:0/3231516791 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0c00c9d0 con 0x7efe180ff390 2024-04-13T11:08:13.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe15ffb700 1 -- 172.21.15.134:0/3231516791 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe0c010430 con 0x7efe180ff390 2024-04-13T11:08:13.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe1eca6700 1 -- 172.21.15.134:0/3231516791 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1819fb30 con 0x7efe180ff390 2024-04-13T11:08:13.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe15ffb700 1 -- 172.21.15.134:0/3231516791 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0c018650 con 0x7efe180ff390 2024-04-13T11:08:13.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.747+0000 7efe1eca6700 1 -- 172.21.15.134:0/3231516791 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1819fff0 con 0x7efe180ff390 2024-04-13T11:08:13.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.748+0000 7efe1eca6700 1 -- 172.21.15.134:0/3231516791 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe18107600 con 0x7efe180ff390 2024-04-13T11:08:13.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.749+0000 7efe15ffb700 1 -- 172.21.15.134:0/3231516791 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7efe0c0105a0 con 0x7efe180ff390 2024-04-13T11:08:13.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.749+0000 7efe15ffb700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efe0806cce0 0x7efe0806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:13.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.749+0000 7efe15ffb700 1 -- 172.21.15.134:0/3231516791 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6445+0+0 (secure 0 0 0) 0x7efe0c014070 con 0x7efe180ff390 2024-04-13T11:08:13.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.749+0000 7efe17fff700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efe0806cce0 0x7efe0806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:13.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.750+0000 7efe17fff700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efe0806cce0 0x7efe0806f190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efe04009fd0 tx=0x7efe04005a90 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:13.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.754+0000 7efe15ffb700 1 -- 172.21.15.134:0/3231516791 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7efe0c052ab0 con 0x7efe180ff390 2024-04-13T11:08:13.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.958+0000 7efe1eca6700 1 -- 172.21.15.134:0/3231516791 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efe1802cca0 con 0x7efe0806cce0 2024-04-13T11:08:13.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.969+0000 7efe15ffb700 1 -- 172.21.15.134:0/3231516791 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7efe1802cca0 con 0x7efe0806cce0 2024-04-13T11:08:13.970 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:08:13.970 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (7m) 37s ago 18m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:08:13.970 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (18m) 37s ago 18m 8493k - 18.2.0 dc2bc1663786 6e1f93fb7755 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (17m) 8s ago 17m 8396k - 18.2.0 dc2bc1663786 366bad81a92e 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (4m) 37s ago 18m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (4m) 8s ago 17m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (6m) 37s ago 18m 90.5M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (66s) 37s ago 12m 13.3M - 18.2.2-1173-g5108bc67 3464fd31103e ed96357b7f55 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (43s) 37s ago 12m 10.1M - 18.2.2-1173-g5108bc67 3464fd31103e 2bdb75429769 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (12m) 8s ago 12m 136M - 18.2.0 dc2bc1663786 12119388b306 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (18s) 8s ago 12m 13.6M - 18.2.2-1173-g5108bc67 3464fd31103e 0fc2b64fc3ed 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (9m) 37s ago 20m 510M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (8m) 8s ago 17m 454M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:08:13.971 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (5m) 37s ago 20m 52.4M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:08:13.972 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (5m) 8s ago 17m 42.0M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:08:13.972 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 37s ago 18m 18.5M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:08:13.972 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (7m) 8s ago 17m 16.7M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:08:13.972 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (4m) 37s ago 16m 111M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:08:13.972 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (3m) 37s ago 16m 99.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e fc8474d8910f 2024-04-13T11:08:13.972 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (3m) 37s ago 15m 106M 1227M 18.2.2-1173-g5108bc67 3464fd31103e b24ce165bc9f 2024-04-13T11:08:13.972 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (2m) 8s ago 15m 135M 2251M 18.2.2-1173-g5108bc67 3464fd31103e d909c0e8d077 2024-04-13T11:08:13.972 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (119s) 8s ago 14m 102M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 7f721487a63b 2024-04-13T11:08:13.972 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (85s) 8s ago 14m 89.2M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 1c4a65aaf413 2024-04-13T11:08:13.972 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (7m) 37s ago 17m 67.4M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:08:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 -- 172.21.15.134:0/3231516791 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efe0806cce0 msgr2=0x7efe0806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efe0806cce0 0x7efe0806f190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efe04009fd0 tx=0x7efe04005a90 comp rx=0 tx=0).stop 2024-04-13T11:08:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 -- 172.21.15.134:0/3231516791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe180ff390 msgr2=0x7efe18196ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe180ff390 0x7efe18196ac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00e920 tx=0x7efe0c00ec30 comp rx=0 tx=0).stop 2024-04-13T11:08:13.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 -- 172.21.15.134:0/3231516791 shutdown_connections 2024-04-13T11:08:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7efe0806cce0 0x7efe0806f190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe180ff390 0x7efe18196ac0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 --2- 172.21.15.134:0/3231516791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe180ffd30 0x7efe18197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 -- 172.21.15.134:0/3231516791 >> 172.21.15.134:0/3231516791 conn(0x7efe18074f50 msgr2=0x7efe180fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 -- 172.21.15.134:0/3231516791 shutdown_connections 2024-04-13T11:08:13.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:13.971+0000 7efe1eca6700 1 -- 172.21.15.134:0/3231516791 wait complete. 2024-04-13T11:08:14.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.094+0000 7f645cbd6700 1 -- 172.21.15.134:0/564646239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458068630 msgr2=0x7f6458068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:14.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.094+0000 7f645cbd6700 1 --2- 172.21.15.134:0/564646239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458068630 0x7f6458068a00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6448009910 tx=0x7f6448009c20 comp rx=0 tx=0).stop 2024-04-13T11:08:14.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.094+0000 7f645cbd6700 1 -- 172.21.15.134:0/564646239 shutdown_connections 2024-04-13T11:08:14.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.094+0000 7f645cbd6700 1 --2- 172.21.15.134:0/564646239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6458068fd0 0x7f6458104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.094+0000 7f645cbd6700 1 --2- 172.21.15.134:0/564646239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458068630 0x7f6458068a00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.094+0000 7f645cbd6700 1 -- 172.21.15.134:0/564646239 >> 172.21.15.134:0/564646239 conn(0x7f6458074f50 msgr2=0x7f6458075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:14.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.094+0000 7f645cbd6700 1 -- 172.21.15.134:0/564646239 shutdown_connections 2024-04-13T11:08:14.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.094+0000 7f645cbd6700 1 -- 172.21.15.134:0/564646239 wait complete. 2024-04-13T11:08:14.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.095+0000 7f645cbd6700 1 Processor -- start 2024-04-13T11:08:14.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.095+0000 7f645cbd6700 1 -- start start 2024-04-13T11:08:14.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.095+0000 7f645cbd6700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6458068630 0x7f64580ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:14.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.095+0000 7f645cbd6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458068fd0 0x7f64580ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:14.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.095+0000 7f645cbd6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64580ffc80 con 0x7f6458068fd0 2024-04-13T11:08:14.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.095+0000 7f645cbd6700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64580ffdc0 con 0x7f6458068630 2024-04-13T11:08:14.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.095+0000 7f6455d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458068fd0 0x7f64580ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:14.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.095+0000 7f6455d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458068fd0 0x7f64580ff740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56494/0 (socket says 172.21.15.134:56494) 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.095+0000 7f6455d9b700 1 -- 172.21.15.134:0/1171153480 learned_addr learned my addr 172.21.15.134:0/1171153480 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.095+0000 7f645659c700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6458068630 0x7f64580ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.096+0000 7f6455d9b700 1 -- 172.21.15.134:0/1171153480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6458068630 msgr2=0x7f64580ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.096+0000 7f6455d9b700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6458068630 0x7f64580ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.096+0000 7f6455d9b700 1 -- 172.21.15.134:0/1171153480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480095f0 con 0x7f6458068fd0 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.096+0000 7f6455d9b700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458068fd0 0x7f64580ff740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c960 tx=0x7f644c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.096+0000 7f64477fe700 1 -- 172.21.15.134:0/1171153480 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f644c007a70 con 0x7f6458068fd0 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.096+0000 7f645cbd6700 1 -- 172.21.15.134:0/1171153480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64581a1f10 con 0x7f6458068fd0 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.096+0000 7f64477fe700 1 -- 172.21.15.134:0/1171153480 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f644c007bd0 con 0x7f6458068fd0 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.096+0000 7f64477fe700 1 -- 172.21.15.134:0/1171153480 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f644c018630 con 0x7f6458068fd0 2024-04-13T11:08:14.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.096+0000 7f645cbd6700 1 -- 172.21.15.134:0/1171153480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64581a2270 con 0x7f6458068fd0 2024-04-13T11:08:14.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.097+0000 7f645cbd6700 1 -- 172.21.15.134:0/1171153480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6438005320 con 0x7f6458068fd0 2024-04-13T11:08:14.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.098+0000 7f64477fe700 1 -- 172.21.15.134:0/1171153480 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f644c018790 con 0x7f6458068fd0 2024-04-13T11:08:14.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.098+0000 7f64477fe700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f644006cce0 0x7f644006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:14.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.098+0000 7f64477fe700 1 -- 172.21.15.134:0/1171153480 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f644c08c5d0 con 0x7f6458068fd0 2024-04-13T11:08:14.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.098+0000 7f645659c700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f644006cce0 0x7f644006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:14.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.099+0000 7f645659c700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f644006cce0 0x7f644006f190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6448006010 tx=0x7f644801a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:14.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.103+0000 7f64477fe700 1 -- 172.21.15.134:0/1171153480 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f644c057590 con 0x7f6458068fd0 2024-04-13T11:08:14.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:13 smithi134 ceph-mon[112184]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:14.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:13 smithi134 ceph-mon[112184]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:14.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134[112161]: 2024-04-13T11:08:14.000+0000 7fb93ee3c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T11:08:14.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:13 smithi194 ceph-mon[83053]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:14.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:13 smithi194 ceph-mon[83053]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:14.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.406+0000 7f645cbd6700 1 -- 172.21.15.134:0/1171153480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6438006200 con 0x7f6458068fd0 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.407+0000 7f64477fe700 1 -- 172.21.15.134:0/1171153480 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f644c055e60 con 0x7f6458068fd0 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 6 2024-04-13T11:08:14.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:08:14.409 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:08:14.409 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 3 2024-04-13T11:08:14.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:08:14.409 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:08:14.409 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 13 2024-04-13T11:08:14.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:08:14.409 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:08:14.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 -- 172.21.15.134:0/1171153480 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f644006cce0 msgr2=0x7f644006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:14.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f644006cce0 0x7f644006f190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6448006010 tx=0x7f644801a040 comp rx=0 tx=0).stop 2024-04-13T11:08:14.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 -- 172.21.15.134:0/1171153480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458068fd0 msgr2=0x7f64580ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:14.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458068fd0 0x7f64580ff740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c960 tx=0x7f644c00cc70 comp rx=0 tx=0).stop 2024-04-13T11:08:14.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 -- 172.21.15.134:0/1171153480 shutdown_connections 2024-04-13T11:08:14.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f644006cce0 0x7f644006f190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6458068630 0x7f64580ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 --2- 172.21.15.134:0/1171153480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6458068fd0 0x7f64580ff740 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 -- 172.21.15.134:0/1171153480 >> 172.21.15.134:0/1171153480 conn(0x7f6458074f50 msgr2=0x7f64580fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:14.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 -- 172.21.15.134:0/1171153480 shutdown_connections 2024-04-13T11:08:14.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.409+0000 7f645cbd6700 1 -- 172.21.15.134:0/1171153480 wait complete. 2024-04-13T11:08:14.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.524+0000 7f2e47fa3700 1 -- 172.21.15.134:0/4288799108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e400ffbb0 msgr2=0x7f2e400fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:14.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.524+0000 7f2e47fa3700 1 --2- 172.21.15.134:0/4288799108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e400ffbb0 0x7f2e400fff80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009940 tx=0x7f2e3c009c50 comp rx=0 tx=0).stop 2024-04-13T11:08:14.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.524+0000 7f2e47fa3700 1 -- 172.21.15.134:0/4288799108 shutdown_connections 2024-04-13T11:08:14.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.524+0000 7f2e47fa3700 1 --2- 172.21.15.134:0/4288799108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e401004c0 0x7f2e4010c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.524+0000 7f2e47fa3700 1 --2- 172.21.15.134:0/4288799108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e400ffbb0 0x7f2e400fff80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.524+0000 7f2e47fa3700 1 -- 172.21.15.134:0/4288799108 >> 172.21.15.134:0/4288799108 conn(0x7f2e40074f50 msgr2=0x7f2e40075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:14.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.524+0000 7f2e47fa3700 1 -- 172.21.15.134:0/4288799108 shutdown_connections 2024-04-13T11:08:14.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.524+0000 7f2e47fa3700 1 -- 172.21.15.134:0/4288799108 wait complete. 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.524+0000 7f2e47fa3700 1 Processor -- start 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e47fa3700 1 -- start start 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e47fa3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e400ffbb0 0x7f2e40197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e47fa3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e401004c0 0x7f2e401982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e47fa3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e40198990 con 0x7f2e400ffbb0 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e47fa3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4019c720 con 0x7f2e401004c0 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e45d3f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e400ffbb0 0x7f2e40197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e45d3f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e400ffbb0 0x7f2e40197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56516/0 (socket says 172.21.15.134:56516) 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e45d3f700 1 -- 172.21.15.134:0/1590052638 learned_addr learned my addr 172.21.15.134:0/1590052638 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e4553e700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e401004c0 0x7f2e401982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:14.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e45d3f700 1 -- 172.21.15.134:0/1590052638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e401004c0 msgr2=0x7f2e401982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:14.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e45d3f700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e401004c0 0x7f2e401982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e45d3f700 1 -- 172.21.15.134:0/1590052638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c0095f0 con 0x7f2e400ffbb0 2024-04-13T11:08:14.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.525+0000 7f2e45d3f700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e400ffbb0 0x7f2e40197d70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c006010 tx=0x7f2e3c0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:14.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.526+0000 7f2e36ffd700 1 -- 172.21.15.134:0/1590052638 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e3c01d070 con 0x7f2e400ffbb0 2024-04-13T11:08:14.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.526+0000 7f2e47fa3700 1 -- 172.21.15.134:0/1590052638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4019ca00 con 0x7f2e400ffbb0 2024-04-13T11:08:14.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.526+0000 7f2e36ffd700 1 -- 172.21.15.134:0/1590052638 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e3c00f460 con 0x7f2e400ffbb0 2024-04-13T11:08:14.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.526+0000 7f2e36ffd700 1 -- 172.21.15.134:0/1590052638 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e3c021620 con 0x7f2e400ffbb0 2024-04-13T11:08:14.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.526+0000 7f2e47fa3700 1 -- 172.21.15.134:0/1590052638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4019cf50 con 0x7f2e400ffbb0 2024-04-13T11:08:14.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.527+0000 7f2e47fa3700 1 -- 172.21.15.134:0/1590052638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e40109f10 con 0x7f2e400ffbb0 2024-04-13T11:08:14.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.527+0000 7f2e36ffd700 1 -- 172.21.15.134:0/1590052638 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2e3c00f5d0 con 0x7f2e400ffbb0 2024-04-13T11:08:14.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.527+0000 7f2e36ffd700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2e2c06cce0 0x7f2e2c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:14.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.528+0000 7f2e36ffd700 1 -- 172.21.15.134:0/1590052638 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f2e3c08d9c0 con 0x7f2e400ffbb0 2024-04-13T11:08:14.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.528+0000 7f2e4553e700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2e2c06cce0 0x7f2e2c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:14.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.528+0000 7f2e4553e700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2e2c06cce0 0x7f2e2c06f190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e30005fd0 tx=0x7f2e3000a560 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.532+0000 7f2e36ffd700 1 -- 172.21.15.134:0/1590052638 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f2e3c057960 con 0x7f2e400ffbb0 2024-04-13T11:08:14.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.809+0000 7f2e47fa3700 1 -- 172.21.15.134:0/1590052638 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2e4004ea50 con 0x7f2e400ffbb0 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.810+0000 7f2e36ffd700 1 -- 172.21.15.134:0/1590052638 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) v1 ==== 76+0+1675 (secure 0 0 0) 0x7f2e3c05af80 con 0x7f2e400ffbb0 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stdout:e34 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 34 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-13T11:08:14.811 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T11:08:14.013622+0000 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 91 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:08:14.812 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=34322} 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:34322} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:08:14.813 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{-1:34354} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/3883973153,v1:172.21.15.134:6829/3883973153] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:08:14.814 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6824/2092944903,v1:172.21.15.194:6825/2092944903] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:08:14.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 -- 172.21.15.134:0/1590052638 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2e2c06cce0 msgr2=0x7f2e2c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:14.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2e2c06cce0 0x7f2e2c06f190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e30005fd0 tx=0x7f2e3000a560 comp rx=0 tx=0).stop 2024-04-13T11:08:14.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 -- 172.21.15.134:0/1590052638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e400ffbb0 msgr2=0x7f2e40197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:14.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e400ffbb0 0x7f2e40197d70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c006010 tx=0x7f2e3c0056a0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 -- 172.21.15.134:0/1590052638 shutdown_connections 2024-04-13T11:08:14.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f2e2c06cce0 0x7f2e2c06f190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e400ffbb0 0x7f2e40197d70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 --2- 172.21.15.134:0/1590052638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e401004c0 0x7f2e401982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 -- 172.21.15.134:0/1590052638 >> 172.21.15.134:0/1590052638 conn(0x7f2e40074f50 msgr2=0x7f2e400fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:14.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 -- 172.21.15.134:0/1590052638 shutdown_connections 2024-04-13T11:08:14.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.813+0000 7f2e47fa3700 1 -- 172.21.15.134:0/1590052638 wait complete. 2024-04-13T11:08:14.815 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 34 2024-04-13T11:08:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.937+0000 7fb860e78700 1 -- 172.21.15.134:0/1594957401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb85c1003b0 msgr2=0x7fb85c100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.937+0000 7fb860e78700 1 --2- 172.21.15.134:0/1594957401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb85c1003b0 0x7fb85c100780 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009910 tx=0x7fb84c009c20 comp rx=0 tx=0).stop 2024-04-13T11:08:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.938+0000 7fb860e78700 1 -- 172.21.15.134:0/1594957401 shutdown_connections 2024-04-13T11:08:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.938+0000 7fb860e78700 1 --2- 172.21.15.134:0/1594957401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c100d50 0x7fb85c104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.938+0000 7fb860e78700 1 --2- 172.21.15.134:0/1594957401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb85c1003b0 0x7fb85c100780 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.938+0000 7fb860e78700 1 -- 172.21.15.134:0/1594957401 >> 172.21.15.134:0/1594957401 conn(0x7fb85c0fbc30 msgr2=0x7fb85c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.938+0000 7fb860e78700 1 -- 172.21.15.134:0/1594957401 shutdown_connections 2024-04-13T11:08:14.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.938+0000 7fb860e78700 1 -- 172.21.15.134:0/1594957401 wait complete. 2024-04-13T11:08:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb860e78700 1 Processor -- start 2024-04-13T11:08:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb860e78700 1 -- start start 2024-04-13T11:08:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb860e78700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb85c1003b0 0x7fb85c195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb860e78700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c100d50 0x7fb85c196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb860e78700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1968a0 con 0x7fb85c1003b0 2024-04-13T11:08:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb860e78700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1995d0 con 0x7fb85c100d50 2024-04-13T11:08:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb85a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb85c1003b0 0x7fb85c195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb85a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb85c1003b0 0x7fb85c195cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56534/0 (socket says 172.21.15.134:56534) 2024-04-13T11:08:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb85a59c700 1 -- 172.21.15.134:0/722254324 learned_addr learned my addr 172.21.15.134:0/722254324 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:14.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb859d9b700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c100d50 0x7fb85c196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:14.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb85a59c700 1 -- 172.21.15.134:0/722254324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c100d50 msgr2=0x7fb85c196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:14.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb85a59c700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c100d50 0x7fb85c196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:14.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.939+0000 7fb85a59c700 1 -- 172.21.15.134:0/722254324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c0095f0 con 0x7fb85c1003b0 2024-04-13T11:08:14.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.940+0000 7fb85a59c700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb85c1003b0 0x7fb85c195cd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb84c006010 tx=0x7fb84c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:14.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.940+0000 7fb84b7fe700 1 -- 172.21.15.134:0/722254324 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb84c01d070 con 0x7fb85c1003b0 2024-04-13T11:08:14.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.940+0000 7fb84b7fe700 1 -- 172.21.15.134:0/722254324 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb84c00f460 con 0x7fb85c1003b0 2024-04-13T11:08:14.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.940+0000 7fb860e78700 1 -- 172.21.15.134:0/722254324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c199850 con 0x7fb85c1003b0 2024-04-13T11:08:14.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.940+0000 7fb860e78700 1 -- 172.21.15.134:0/722254324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c199d40 con 0x7fb85c1003b0 2024-04-13T11:08:14.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.940+0000 7fb84b7fe700 1 -- 172.21.15.134:0/722254324 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb84c021620 con 0x7fb85c1003b0 2024-04-13T11:08:14.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.941+0000 7fb860e78700 1 -- 172.21.15.134:0/722254324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c005320 con 0x7fb85c1003b0 2024-04-13T11:08:14.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.941+0000 7fb84b7fe700 1 -- 172.21.15.134:0/722254324 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb84c02b440 con 0x7fb85c1003b0 2024-04-13T11:08:14.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.942+0000 7fb84b7fe700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb84406cce0 0x7fb84406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:14.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.942+0000 7fb84b7fe700 1 -- 172.21.15.134:0/722254324 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb84c08d750 con 0x7fb85c1003b0 2024-04-13T11:08:14.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.942+0000 7fb859d9b700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb84406cce0 0x7fb84406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:14.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.942+0000 7fb859d9b700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb84406cce0 0x7fb84406f190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb850005fd0 tx=0x7fb850005f60 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:14.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:14.946+0000 7fb84b7fe700 1 -- 172.21.15.134:0/722254324 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fb84c057770 con 0x7fb85c1003b0 2024-04-13T11:08:15.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: pgmap v303: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 0 B/s wr, 0 op/s 2024-04-13T11:08:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-13T11:08:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T11:08:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: osdmap e91: 6 total, 6 up, 6 in 2024-04-13T11:08:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: Standby daemon mds.cephfs.smithi134.hxpcfx assigned to filesystem cephfs as rank 0 2024-04-13T11:08:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-13T11:08:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-13T11:08:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: fsmap cephfs:1/1 {0=cephfs.smithi134.hxpcfx=up:replay} 2 up:standby 2024-04-13T11:08:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1171153480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:15.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:14 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1590052638' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:08:15.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.197+0000 7fb860e78700 1 -- 172.21.15.134:0/722254324 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb83c000bf0 con 0x7fb84406cce0 2024-04-13T11:08:15.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.199+0000 7fb84b7fe700 1 -- 172.21.15.134:0/722254324 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb83c000bf0 con 0x7fb84406cce0 2024-04-13T11:08:15.200 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:08:15.200 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:08:15.200 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:08:15.200 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:08:15.200 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:08:15.200 INFO:teuthology.orchestra.run.smithi134.stdout: "osd", 2024-04-13T11:08:15.200 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-04-13T11:08:15.200 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:08:15.201 INFO:teuthology.orchestra.run.smithi134.stdout: "mon" 2024-04-13T11:08:15.201 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:08:15.201 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "15/23 daemons upgraded", 2024-04-13T11:08:15.201 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mds daemons", 2024-04-13T11:08:15.201 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:08:15.201 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.201+0000 7fb860e78700 1 -- 172.21.15.134:0/722254324 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb84406cce0 msgr2=0x7fb84406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.201+0000 7fb860e78700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb84406cce0 0x7fb84406f190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb850005fd0 tx=0x7fb850005f60 comp rx=0 tx=0).stop 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.201+0000 7fb860e78700 1 -- 172.21.15.134:0/722254324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb85c1003b0 msgr2=0x7fb85c195cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.201+0000 7fb860e78700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb85c1003b0 0x7fb85c195cd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb84c006010 tx=0x7fb84c00be20 comp rx=0 tx=0).stop 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.202+0000 7fb860e78700 1 -- 172.21.15.134:0/722254324 shutdown_connections 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.202+0000 7fb860e78700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb84406cce0 0x7fb84406f190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.202+0000 7fb860e78700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb85c1003b0 0x7fb85c195cd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.202+0000 7fb860e78700 1 --2- 172.21.15.134:0/722254324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c100d50 0x7fb85c196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.202+0000 7fb860e78700 1 -- 172.21.15.134:0/722254324 >> 172.21.15.134:0/722254324 conn(0x7fb85c0fbc30 msgr2=0x7fb85c0fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.202+0000 7fb860e78700 1 -- 172.21.15.134:0/722254324 shutdown_connections 2024-04-13T11:08:15.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.202+0000 7fb860e78700 1 -- 172.21.15.134:0/722254324 wait complete. 2024-04-13T11:08:15.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:15.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: pgmap v303: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 0 B/s wr, 0 op/s 2024-04-13T11:08:15.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-13T11:08:15.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T11:08:15.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: osdmap e91: 6 total, 6 up, 6 in 2024-04-13T11:08:15.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: Standby daemon mds.cephfs.smithi134.hxpcfx assigned to filesystem cephfs as rank 0 2024-04-13T11:08:15.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-13T11:08:15.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-13T11:08:15.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: fsmap cephfs:1/1 {0=cephfs.smithi134.hxpcfx=up:replay} 2 up:standby 2024-04-13T11:08:15.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1171153480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:15.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:14 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1590052638' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:08:15.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.320+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3864134083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fac100d50 msgr2=0x7f9fac104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.320+0000 7f9fb1ce4700 1 --2- 172.21.15.134:0/3864134083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fac100d50 0x7f9fac104d20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009910 tx=0x7f9fa0009c20 comp rx=0 tx=0).stop 2024-04-13T11:08:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.320+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3864134083 shutdown_connections 2024-04-13T11:08:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.320+0000 7f9fb1ce4700 1 --2- 172.21.15.134:0/3864134083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fac100d50 0x7f9fac104d20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.320+0000 7f9fb1ce4700 1 --2- 172.21.15.134:0/3864134083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fac1003b0 0x7f9fac100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.320+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3864134083 >> 172.21.15.134:0/3864134083 conn(0x7f9fac0fbc30 msgr2=0x7f9fac0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.320+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3864134083 shutdown_connections 2024-04-13T11:08:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.320+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3864134083 wait complete. 2024-04-13T11:08:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.320+0000 7f9fb1ce4700 1 Processor -- start 2024-04-13T11:08:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.320+0000 7f9fb1ce4700 1 -- start start 2024-04-13T11:08:15.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fb1ce4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fac1003b0 0x7f9fac073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fb1ce4700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fac100d50 0x7f9fac073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fb1ce4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac073ad0 con 0x7f9fac1003b0 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fb1ce4700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac073c10 con 0x7f9fac100d50 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fab7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fac1003b0 0x7f9fac073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fab7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fac1003b0 0x7f9fac073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56552/0 (socket says 172.21.15.134:56552) 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fab7fe700 1 -- 172.21.15.134:0/3747749146 learned_addr learned my addr 172.21.15.134:0/3747749146 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9faaffd700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fac100d50 0x7f9fac073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fab7fe700 1 -- 172.21.15.134:0/3747749146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fac100d50 msgr2=0x7f9fac073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fab7fe700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fac100d50 0x7f9fac073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fab7fe700 1 -- 172.21.15.134:0/3747749146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa00095f0 con 0x7f9fac1003b0 2024-04-13T11:08:15.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fab7fe700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fac1003b0 0x7f9fac073050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00d8d0 tx=0x7f9f9c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fa8ff9700 1 -- 172.21.15.134:0/3747749146 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9c009940 con 0x7f9fac1003b0 2024-04-13T11:08:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3747749146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac1a1ed0 con 0x7f9fac1003b0 2024-04-13T11:08:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fa8ff9700 1 -- 172.21.15.134:0/3747749146 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f9c010460 con 0x7f9fac1003b0 2024-04-13T11:08:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.321+0000 7f9fa8ff9700 1 -- 172.21.15.134:0/3747749146 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9c00f5f0 con 0x7f9fac1003b0 2024-04-13T11:08:15.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.322+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3747749146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac1a22e0 con 0x7f9fac1003b0 2024-04-13T11:08:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.323+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3747749146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac108720 con 0x7f9fac1003b0 2024-04-13T11:08:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.323+0000 7f9fa8ff9700 1 -- 172.21.15.134:0/3747749146 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9f9c0105d0 con 0x7f9fac1003b0 2024-04-13T11:08:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.323+0000 7f9fa8ff9700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9f9406cce0 0x7f9f9406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.323+0000 7f9fa8ff9700 1 -- 172.21.15.134:0/3747749146 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f9f9c08c6b0 con 0x7f9fac1003b0 2024-04-13T11:08:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.324+0000 7f9faaffd700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9f9406cce0 0x7f9f9406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:15.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.324+0000 7f9faaffd700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9f9406cce0 0x7f9f9406f190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9fac074840 tx=0x7f9fa001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:15.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.328+0000 7f9fa8ff9700 1 -- 172.21.15.134:0/3747749146 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f9f9c056650 con 0x7f9fac1003b0 2024-04-13T11:08:15.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.622+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3747749146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9fac04ea50 con 0x7f9fac1003b0 2024-04-13T11:08:15.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.623+0000 7f9fa8ff9700 1 -- 172.21.15.134:0/3747749146 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7f9f9c010880 con 0x7f9fac1003b0 2024-04-13T11:08:15.624 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-04-13T11:08:15.624 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-13T11:08:15.624 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs is degraded 2024-04-13T11:08:15.624 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:08:15.624 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:08:15.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3747749146 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9f9406cce0 msgr2=0x7f9f9406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:15.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9f9406cce0 0x7f9f9406f190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9fac074840 tx=0x7f9fa001a040 comp rx=0 tx=0).stop 2024-04-13T11:08:15.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3747749146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fac1003b0 msgr2=0x7f9fac073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:15.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fac1003b0 0x7f9fac073050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00d8d0 tx=0x7f9f9c00dc90 comp rx=0 tx=0).stop 2024-04-13T11:08:15.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3747749146 shutdown_connections 2024-04-13T11:08:15.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9f9406cce0 0x7f9f9406f190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:15.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fac1003b0 0x7f9fac073050 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:15.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 --2- 172.21.15.134:0/3747749146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fac100d50 0x7f9fac073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:15.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3747749146 >> 172.21.15.134:0/3747749146 conn(0x7f9fac0fbc30 msgr2=0x7f9fac0fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:15.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3747749146 shutdown_connections 2024-04-13T11:08:15.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:15.625+0000 7f9fb1ce4700 1 -- 172.21.15.134:0/3747749146 wait complete. 2024-04-13T11:08:16.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:15 smithi134 ceph-mon[112184]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:16.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:15 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3747749146' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:08:16.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:15 smithi194 ceph-mon[83053]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:16.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:15 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3747749146' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:08:17.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:16 smithi134 ceph-mon[112184]: pgmap v305: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-04-13T11:08:17.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:16 smithi194 ceph-mon[83053]: pgmap v305: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-04-13T11:08:19.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:19 smithi134 ceph-mon[112184]: pgmap v306: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.0 MiB/s rd, 2 op/s 2024-04-13T11:08:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:19 smithi194 ceph-mon[83053]: pgmap v306: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.0 MiB/s rd, 2 op/s 2024-04-13T11:08:21.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:21 smithi194 ceph-mon[83053]: pgmap v307: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-13T11:08:21.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:21 smithi134 ceph-mon[112184]: pgmap v307: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-13T11:08:23.400 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:23 smithi194 ceph-mon[83053]: pgmap v308: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-13T11:08:23.400 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:23.400 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:08:23.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:23 smithi134 ceph-mon[112184]: pgmap v308: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-13T11:08:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:08:25.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:25 smithi194 ceph-mon[83053]: pgmap v309: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-04-13T11:08:25.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:25 smithi194 ceph-mon[83053]: reconnect by client.14552 192.168.0.1:0/1312131006 after 0.000999977 2024-04-13T11:08:25.409 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:25 smithi194 ceph-mon[83053]: reconnect by client.24309 192.168.0.1:0/2362139874 after 0.00199995 2024-04-13T11:08:25.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:25 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] up:reconnect 2024-04-13T11:08:25.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:25 smithi194 ceph-mon[83053]: fsmap cephfs:1/1 {0=cephfs.smithi134.hxpcfx=up:reconnect} 2 up:standby 2024-04-13T11:08:25.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:25 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:25.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:25 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:25.410 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:25 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:25.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:25 smithi134 ceph-mon[112184]: pgmap v309: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-04-13T11:08:25.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:25 smithi134 ceph-mon[112184]: reconnect by client.14552 192.168.0.1:0/1312131006 after 0.000999977 2024-04-13T11:08:25.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:25 smithi134 ceph-mon[112184]: reconnect by client.24309 192.168.0.1:0/2362139874 after 0.00199995 2024-04-13T11:08:25.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:25 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] up:reconnect 2024-04-13T11:08:25.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:25 smithi134 ceph-mon[112184]: fsmap cephfs:1/1 {0=cephfs.smithi134.hxpcfx=up:reconnect} 2 up:standby 2024-04-13T11:08:25.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:25 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:25.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:25 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:25.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:25 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:26 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] up:rejoin 2024-04-13T11:08:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:26 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.194:6826/2085856165,v1:172.21.15.194:6827/2085856165] up:boot 2024-04-13T11:08:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:26 smithi194 ceph-mon[83053]: fsmap cephfs:1/1 {0=cephfs.smithi134.hxpcfx=up:rejoin} 3 up:standby 2024-04-13T11:08:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:26 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T11:08:26.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:26 smithi194 ceph-mon[83053]: daemon mds.cephfs.smithi134.hxpcfx is now active in filesystem cephfs as rank 0 2024-04-13T11:08:26.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:26 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] up:rejoin 2024-04-13T11:08:26.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:26 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.194:6826/2085856165,v1:172.21.15.194:6827/2085856165] up:boot 2024-04-13T11:08:26.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:26 smithi134 ceph-mon[112184]: fsmap cephfs:1/1 {0=cephfs.smithi134.hxpcfx=up:rejoin} 3 up:standby 2024-04-13T11:08:26.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:26 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T11:08:26.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:26 smithi134 ceph-mon[112184]: daemon mds.cephfs.smithi134.hxpcfx is now active in filesystem cephfs as rank 0 2024-04-13T11:08:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:27 smithi134 ceph-mon[112184]: pgmap v310: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-13T11:08:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:27 smithi134 ceph-mon[112184]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-13T11:08:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:27 smithi134 ceph-mon[112184]: mds.? [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] up:active 2024-04-13T11:08:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:27 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 3 up:standby 2024-04-13T11:08:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:27 smithi194 ceph-mon[83053]: pgmap v310: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-13T11:08:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:27 smithi194 ceph-mon[83053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-13T11:08:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:27 smithi194 ceph-mon[83053]: mds.? [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] up:active 2024-04-13T11:08:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:27 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 3 up:standby 2024-04-13T11:08:29.208 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:28 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:29.208 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:28 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:29.208 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:28 smithi194 ceph-mon[83053]: pgmap v311: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-13T11:08:29.208 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:28 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:29.209 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:28 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:29.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:28 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:29.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:28 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:29.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:28 smithi134 ceph-mon[112184]: pgmap v311: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-13T11:08:29.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:28 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:29.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:28 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:31.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:31 smithi194 ceph-mon[83053]: pgmap v312: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-13T11:08:31.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:31 smithi134 ceph-mon[112184]: pgmap v312: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-13T11:08:33.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: pgmap v313: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.9 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-13T11:08:33.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:33.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:33.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:33.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:08:33.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:33.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:33.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:33.729 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: Upgrade: Setting container_image for all mds 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.hxpcfx"}]': finished 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.kachce"}]: dispatch 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.kachce"}]': finished 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.svyrny"}]': finished 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.wnddvg"}]: dispatch 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.wnddvg"}]': finished 2024-04-13T11:08:33.730 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: Upgrade: Setting filesystem cephfs Joinable 2024-04-13T11:08:33.731 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:33 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-13T11:08:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: pgmap v313: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.9 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-13T11:08:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:08:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: Upgrade: Setting container_image for all mds 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.hxpcfx"}]: dispatch 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.hxpcfx"}]': finished 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.kachce"}]: dispatch 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.kachce"}]': finished 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.svyrny"}]: dispatch 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.svyrny"}]': finished 2024-04-13T11:08:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.wnddvg"}]: dispatch 2024-04-13T11:08:33.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi194.wnddvg"}]': finished 2024-04-13T11:08:33.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: Upgrade: Setting filesystem cephfs Joinable 2024-04-13T11:08:33.750 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:33 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-13T11:08:34.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:34 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-13T11:08:34.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:34 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 3 up:standby 2024-04-13T11:08:34.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:34 smithi134 ceph-mon[112184]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-13T11:08:34.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:34 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-13T11:08:34.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:34 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-13T11:08:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:34 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 3 up:standby 2024-04-13T11:08:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:34 smithi194 ceph-mon[83053]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-13T11:08:34.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:34 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-13T11:08:35.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: pgmap v314: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 3 up:standby 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: Upgrade: Setting container_image for all rgw 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: Upgrade: Setting container_image for all rbd-mirror 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:35.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:35 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: pgmap v314: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-13T11:08:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-13T11:08:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 3 up:standby 2024-04-13T11:08:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T11:08:35.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:35.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:35.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: Upgrade: Setting container_image for all rgw 2024-04-13T11:08:35.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:35.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:35.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: Upgrade: Setting container_image for all rbd-mirror 2024-04-13T11:08:35.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:35.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:35 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:37.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:37 smithi134 ceph-mon[112184]: pgmap v315: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-13T11:08:37.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:37 smithi134 ceph-mon[112184]: Upgrade: Updating ceph-exporter.smithi134 (1/2) 2024-04-13T11:08:37.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:37 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:37.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:37 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-13T11:08:37.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:37 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:37.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:37 smithi134 ceph-mon[112184]: Deploying daemon ceph-exporter.smithi134 on smithi134 2024-04-13T11:08:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:37 smithi194 ceph-mon[83053]: pgmap v315: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-13T11:08:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:37 smithi194 ceph-mon[83053]: Upgrade: Updating ceph-exporter.smithi134 (1/2) 2024-04-13T11:08:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:37 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:37 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi134", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-13T11:08:37.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:37 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:37.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:37 smithi194 ceph-mon[83053]: Deploying daemon ceph-exporter.smithi134 on smithi134 2024-04-13T11:08:39.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:08:39.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:38 smithi134 ceph-mon[112184]: pgmap v316: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.2 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-13T11:08:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:08:39.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:38 smithi194 ceph-mon[83053]: pgmap v316: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.2 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-13T11:08:41.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:41 smithi134 ceph-mon[112184]: pgmap v317: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-04-13T11:08:41.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:41 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:41.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:41 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:41 smithi194 ceph-mon[83053]: pgmap v317: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-04-13T11:08:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:41 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:41 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:43.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:43 smithi194 ceph-mon[83053]: pgmap v318: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-04-13T11:08:43.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:43 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:43.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:43 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi194", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-13T11:08:43.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:43 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:43.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:43 smithi134 ceph-mon[112184]: pgmap v318: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-04-13T11:08:43.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:43 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:43.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:43 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi194", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-13T11:08:43.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:43 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:44.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:44 smithi134 ceph-mon[112184]: Upgrade: Updating ceph-exporter.smithi194 (2/2) 2024-04-13T11:08:44.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:44 smithi134 ceph-mon[112184]: Deploying daemon ceph-exporter.smithi194 on smithi194 2024-04-13T11:08:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:44 smithi194 ceph-mon[83053]: Upgrade: Updating ceph-exporter.smithi194 (2/2) 2024-04-13T11:08:44.497 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:44 smithi194 ceph-mon[83053]: Deploying daemon ceph-exporter.smithi194 on smithi194 2024-04-13T11:08:45.386 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:45 smithi194 ceph-mon[83053]: pgmap v319: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-04-13T11:08:45.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:45 smithi134 ceph-mon[112184]: pgmap v319: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-04-13T11:08:45.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.745+0000 7f75df69c700 1 -- 172.21.15.134:0/1439970030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75d8100d80 msgr2=0x7f75d8104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:45.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.745+0000 7f75df69c700 1 --2- 172.21.15.134:0/1439970030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75d8100d80 0x7f75d8104d50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009910 tx=0x7f75d4009c20 comp rx=0 tx=0).stop 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.745+0000 7f75df69c700 1 -- 172.21.15.134:0/1439970030 shutdown_connections 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.745+0000 7f75df69c700 1 --2- 172.21.15.134:0/1439970030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75d8100d80 0x7f75d8104d50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.745+0000 7f75df69c700 1 --2- 172.21.15.134:0/1439970030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d81003e0 0x7f75d81007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.745+0000 7f75df69c700 1 -- 172.21.15.134:0/1439970030 >> 172.21.15.134:0/1439970030 conn(0x7f75d80fbca0 msgr2=0x7f75d80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.746+0000 7f75df69c700 1 -- 172.21.15.134:0/1439970030 shutdown_connections 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.746+0000 7f75df69c700 1 -- 172.21.15.134:0/1439970030 wait complete. 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.746+0000 7f75df69c700 1 Processor -- start 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.746+0000 7f75df69c700 1 -- start start 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.746+0000 7f75df69c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d81003e0 0x7f75d8195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.746+0000 7f75df69c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75d8100d80 0x7f75d8196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.746+0000 7f75df69c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d81968a0 con 0x7f75d8100d80 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.746+0000 7f75df69c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d81995d0 con 0x7f75d81003e0 2024-04-13T11:08:45.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.746+0000 7f75dcc37700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75d8100d80 0x7f75d8196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75dd438700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d81003e0 0x7f75d8195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75dd438700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d81003e0 0x7f75d8195cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.134:40474/0 (socket says 172.21.15.134:40474) 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75dcc37700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75d8100d80 0x7f75d8196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39636/0 (socket says 172.21.15.134:39636) 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75dd438700 1 -- 172.21.15.134:0/1913122650 learned_addr learned my addr 172.21.15.134:0/1913122650 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75dd438700 1 -- 172.21.15.134:0/1913122650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75d8100d80 msgr2=0x7f75d8196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75dd438700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75d8100d80 0x7f75d8196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75dd438700 1 -- 172.21.15.134:0/1913122650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d40095f0 con 0x7f75d81003e0 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75dcc37700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75d8100d80 0x7f75d8196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75dd438700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d81003e0 0x7f75d8195cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75c800e920 tx=0x7f75c800ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75ce7fc700 1 -- 172.21.15.134:0/1913122650 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c800c9d0 con 0x7f75d81003e0 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75df69c700 1 -- 172.21.15.134:0/1913122650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d81998b0 con 0x7f75d81003e0 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75ce7fc700 1 -- 172.21.15.134:0/1913122650 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75c8010430 con 0x7f75d81003e0 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75ce7fc700 1 -- 172.21.15.134:0/1913122650 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c8018650 con 0x7f75d81003e0 2024-04-13T11:08:45.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.747+0000 7f75df69c700 1 -- 172.21.15.134:0/1913122650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d8199dd0 con 0x7f75d81003e0 2024-04-13T11:08:45.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.748+0000 7f75df69c700 1 -- 172.21.15.134:0/1913122650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d8108750 con 0x7f75d81003e0 2024-04-13T11:08:45.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.749+0000 7f75ce7fc700 1 -- 172.21.15.134:0/1913122650 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f75c80105a0 con 0x7f75d81003e0 2024-04-13T11:08:45.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.749+0000 7f75ce7fc700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f75c406cce0 0x7f75c406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:45.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.749+0000 7f75ce7fc700 1 -- 172.21.15.134:0/1913122650 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f75c8014070 con 0x7f75d81003e0 2024-04-13T11:08:45.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.749+0000 7f75dcc37700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f75c406cce0 0x7f75c406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:45.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.750+0000 7f75dcc37700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f75c406cce0 0x7f75c406f190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009fd0 tx=0x7f75d4005940 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:45.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.754+0000 7f75ce7fc700 1 -- 172.21.15.134:0/1913122650 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f75c8052ab0 con 0x7f75d81003e0 2024-04-13T11:08:45.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.973+0000 7f75df69c700 1 -- 172.21.15.134:0/1913122650 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75d8199fc0 con 0x7f75c406cce0 2024-04-13T11:08:45.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.974+0000 7f75ce7fc700 1 -- 172.21.15.134:0/1913122650 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f75d8199fc0 con 0x7f75c406cce0 2024-04-13T11:08:45.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 -- 172.21.15.134:0/1913122650 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f75c406cce0 msgr2=0x7f75c406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:45.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f75c406cce0 0x7f75c406f190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009fd0 tx=0x7f75d4005940 comp rx=0 tx=0).stop 2024-04-13T11:08:45.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 -- 172.21.15.134:0/1913122650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d81003e0 msgr2=0x7f75d8195cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:45.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d81003e0 0x7f75d8195cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75c800e920 tx=0x7f75c800ec30 comp rx=0 tx=0).stop 2024-04-13T11:08:45.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 -- 172.21.15.134:0/1913122650 shutdown_connections 2024-04-13T11:08:45.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f75c406cce0 0x7f75c406f190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:45.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75d81003e0 0x7f75d8195cd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:45.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 --2- 172.21.15.134:0/1913122650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75d8100d80 0x7f75d8196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:45.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 -- 172.21.15.134:0/1913122650 >> 172.21.15.134:0/1913122650 conn(0x7f75d80fbca0 msgr2=0x7f75d80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:45.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 -- 172.21.15.134:0/1913122650 shutdown_connections 2024-04-13T11:08:45.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:45.976+0000 7f75df69c700 1 -- 172.21.15.134:0/1913122650 wait complete. 2024-04-13T11:08:45.986 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:08:46.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.080+0000 7fe23bb77700 1 -- 172.21.15.134:0/2965133069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2340ffc30 msgr2=0x7fe23410a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:46.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.080+0000 7fe23bb77700 1 --2- 172.21.15.134:0/2965133069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2340ffc30 0x7fe23410a6a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe224009940 tx=0x7fe224009c50 comp rx=0 tx=0).stop 2024-04-13T11:08:46.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.080+0000 7fe23bb77700 1 -- 172.21.15.134:0/2965133069 shutdown_connections 2024-04-13T11:08:46.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.080+0000 7fe23bb77700 1 --2- 172.21.15.134:0/2965133069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2340ffc30 0x7fe23410a6a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.080+0000 7fe23bb77700 1 --2- 172.21.15.134:0/2965133069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340ff320 0x7fe2340ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.080+0000 7fe23bb77700 1 -- 172.21.15.134:0/2965133069 >> 172.21.15.134:0/2965133069 conn(0x7fe2340748b0 msgr2=0x7fe234074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:46.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.080+0000 7fe23bb77700 1 -- 172.21.15.134:0/2965133069 shutdown_connections 2024-04-13T11:08:46.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.081+0000 7fe23bb77700 1 -- 172.21.15.134:0/2965133069 wait complete. 2024-04-13T11:08:46.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.081+0000 7fe23bb77700 1 Processor -- start 2024-04-13T11:08:46.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.081+0000 7fe23bb77700 1 -- start start 2024-04-13T11:08:46.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.081+0000 7fe23bb77700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2340ff320 0x7fe23419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:46.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.081+0000 7fe23bb77700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340ffc30 0x7fe23419bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:46.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.081+0000 7fe23bb77700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23419c570 con 0x7fe2340ff320 2024-04-13T11:08:46.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.081+0000 7fe23bb77700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe234195a20 con 0x7fe2340ffc30 2024-04-13T11:08:46.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.081+0000 7fe239913700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2340ff320 0x7fe23419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:46.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.081+0000 7fe239913700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2340ff320 0x7fe23419b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39654/0 (socket says 172.21.15.134:39654) 2024-04-13T11:08:46.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.081+0000 7fe239913700 1 -- 172.21.15.134:0/284101839 learned_addr learned my addr 172.21.15.134:0/284101839 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:46.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.082+0000 7fe239112700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340ffc30 0x7fe23419bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:46.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.082+0000 7fe239913700 1 -- 172.21.15.134:0/284101839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340ffc30 msgr2=0x7fe23419bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:46.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.082+0000 7fe239913700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340ffc30 0x7fe23419bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.082+0000 7fe239913700 1 -- 172.21.15.134:0/284101839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2240095f0 con 0x7fe2340ff320 2024-04-13T11:08:46.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.082+0000 7fe239913700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2340ff320 0x7fe23419b9a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe23000d8d0 tx=0x7fe23000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:46.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.082+0000 7fe22affd700 1 -- 172.21.15.134:0/284101839 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe230009940 con 0x7fe2340ff320 2024-04-13T11:08:46.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.082+0000 7fe22affd700 1 -- 172.21.15.134:0/284101839 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe230010460 con 0x7fe2340ff320 2024-04-13T11:08:46.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.082+0000 7fe23bb77700 1 -- 172.21.15.134:0/284101839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe234195d00 con 0x7fe2340ff320 2024-04-13T11:08:46.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.082+0000 7fe22affd700 1 -- 172.21.15.134:0/284101839 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe23000f5f0 con 0x7fe2340ff320 2024-04-13T11:08:46.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.082+0000 7fe23bb77700 1 -- 172.21.15.134:0/284101839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe234196250 con 0x7fe2340ff320 2024-04-13T11:08:46.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.083+0000 7fe23bb77700 1 -- 172.21.15.134:0/284101839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe234107da0 con 0x7fe2340ff320 2024-04-13T11:08:46.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.083+0000 7fe22affd700 1 -- 172.21.15.134:0/284101839 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe2300105d0 con 0x7fe2340ff320 2024-04-13T11:08:46.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.084+0000 7fe22affd700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe22006cce0 0x7fe22006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:46.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.084+0000 7fe22affd700 1 -- 172.21.15.134:0/284101839 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fe23008c6b0 con 0x7fe2340ff320 2024-04-13T11:08:46.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.084+0000 7fe239112700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe22006cce0 0x7fe22006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:46.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.084+0000 7fe239112700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe22006cce0 0x7fe22006f190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe22400b7d0 tx=0x7fe224005fb0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:46.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.088+0000 7fe22affd700 1 -- 172.21.15.134:0/284101839 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fe23005a0e0 con 0x7fe2340ff320 2024-04-13T11:08:46.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.301+0000 7fe23bb77700 1 -- 172.21.15.134:0/284101839 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe234196530 con 0x7fe22006cce0 2024-04-13T11:08:46.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.302+0000 7fe22affd700 1 -- 172.21.15.134:0/284101839 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fe234196530 con 0x7fe22006cce0 2024-04-13T11:08:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 -- 172.21.15.134:0/284101839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe22006cce0 msgr2=0x7fe22006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe22006cce0 0x7fe22006f190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe22400b7d0 tx=0x7fe224005fb0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 -- 172.21.15.134:0/284101839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2340ff320 msgr2=0x7fe23419b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2340ff320 0x7fe23419b9a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe23000d8d0 tx=0x7fe23000dc90 comp rx=0 tx=0).stop 2024-04-13T11:08:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 -- 172.21.15.134:0/284101839 shutdown_connections 2024-04-13T11:08:46.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe22006cce0 0x7fe22006f190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2340ff320 0x7fe23419b9a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 --2- 172.21.15.134:0/284101839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2340ffc30 0x7fe23419bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 -- 172.21.15.134:0/284101839 >> 172.21.15.134:0/284101839 conn(0x7fe2340748b0 msgr2=0x7fe234104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 -- 172.21.15.134:0/284101839 shutdown_connections 2024-04-13T11:08:46.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.304+0000 7fe23bb77700 1 -- 172.21.15.134:0/284101839 wait complete. 2024-04-13T11:08:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.407+0000 7fca0125f700 1 -- 172.21.15.134:0/3999646998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9fc0ffd30 msgr2=0x7fc9fc103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.407+0000 7fca0125f700 1 --2- 172.21.15.134:0/3999646998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9fc0ffd30 0x7fc9fc103ce0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009910 tx=0x7fc9ec009c20 comp rx=0 tx=0).stop 2024-04-13T11:08:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.407+0000 7fca0125f700 1 -- 172.21.15.134:0/3999646998 shutdown_connections 2024-04-13T11:08:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.407+0000 7fca0125f700 1 --2- 172.21.15.134:0/3999646998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9fc0ffd30 0x7fc9fc103ce0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.407+0000 7fca0125f700 1 --2- 172.21.15.134:0/3999646998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9fc0ff390 0x7fc9fc0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.407+0000 7fca0125f700 1 -- 172.21.15.134:0/3999646998 >> 172.21.15.134:0/3999646998 conn(0x7fc9fc074f50 msgr2=0x7fc9fc075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:46.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.407+0000 7fca0125f700 1 -- 172.21.15.134:0/3999646998 shutdown_connections 2024-04-13T11:08:46.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.407+0000 7fca0125f700 1 -- 172.21.15.134:0/3999646998 wait complete. 2024-04-13T11:08:46.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.408+0000 7fca0125f700 1 Processor -- start 2024-04-13T11:08:46.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.408+0000 7fca0125f700 1 -- start start 2024-04-13T11:08:46.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.408+0000 7fca0125f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9fc0ff390 0x7fc9fc19b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.408+0000 7fca0125f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9fc0ffd30 0x7fc9fc19bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.408+0000 7fca0125f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc19c5c0 con 0x7fc9fc0ff390 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.408+0000 7fca0125f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc195a70 con 0x7fc9fc0ffd30 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.408+0000 7fc9fad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9fc0ff390 0x7fc9fc19b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9fad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9fc0ff390 0x7fc9fc19b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39674/0 (socket says 172.21.15.134:39674) 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9fad9d700 1 -- 172.21.15.134:0/481165438 learned_addr learned my addr 172.21.15.134:0/481165438 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9fa59c700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9fc0ffd30 0x7fc9fc19bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9fad9d700 1 -- 172.21.15.134:0/481165438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9fc0ffd30 msgr2=0x7fc9fc19bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9fad9d700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9fc0ffd30 0x7fc9fc19bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9fad9d700 1 -- 172.21.15.134:0/481165438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec0095f0 con 0x7fc9fc0ff390 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9fa59c700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9fc0ffd30 0x7fc9fc19bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9fad9d700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9fc0ff390 0x7fc9fc19b9f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400d900 tx=0x7fc9e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:46.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9f3fff700 1 -- 172.21.15.134:0/481165438 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9e40041f0 con 0x7fc9fc0ff390 2024-04-13T11:08:46.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9f3fff700 1 -- 172.21.15.134:0/481165438 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc9e4004cd0 con 0x7fc9fc0ff390 2024-04-13T11:08:46.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fca0125f700 1 -- 172.21.15.134:0/481165438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc195d50 con 0x7fc9fc0ff390 2024-04-13T11:08:46.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fc9f3fff700 1 -- 172.21.15.134:0/481165438 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9e40056d0 con 0x7fc9fc0ff390 2024-04-13T11:08:46.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.409+0000 7fca0125f700 1 -- 172.21.15.134:0/481165438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc1962a0 con 0x7fc9fc0ff390 2024-04-13T11:08:46.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.410+0000 7fca0125f700 1 -- 172.21.15.134:0/481165438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc04ea50 con 0x7fc9fc0ff390 2024-04-13T11:08:46.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.411+0000 7fc9f3fff700 1 -- 172.21.15.134:0/481165438 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc9e4004e40 con 0x7fc9fc0ff390 2024-04-13T11:08:46.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.411+0000 7fc9f3fff700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc9e806cc90 0x7fc9e806f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:46.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.411+0000 7fc9f3fff700 1 -- 172.21.15.134:0/481165438 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fc9e408c7e0 con 0x7fc9fc0ff390 2024-04-13T11:08:46.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.411+0000 7fc9fa59c700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc9e806cc90 0x7fc9e806f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:46.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.411+0000 7fc9fa59c700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc9e806cc90 0x7fc9e806f140 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec006010 tx=0x7fc9ec005960 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:46.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.416+0000 7fc9f3fff700 1 -- 172.21.15.134:0/481165438 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fc9e405a210 con 0x7fc9fc0ff390 2024-04-13T11:08:46.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.637+0000 7fca0125f700 1 -- 172.21.15.134:0/481165438 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9fc196740 con 0x7fc9e806cc90 2024-04-13T11:08:46.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.647+0000 7fc9f3fff700 1 -- 172.21.15.134:0/481165438 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fc9fc196740 con 0x7fc9e806cc90 2024-04-13T11:08:46.647 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:08:46.647 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (7m) 69s ago 19m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 starting - - - - 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 starting - - - - 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (5m) 69s ago 19m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (5m) 18s ago 18m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (7m) 69s ago 18m 90.5M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (99s) 69s ago 13m 13.3M - 18.2.2-1173-g5108bc67 3464fd31103e ed96357b7f55 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (76s) 69s ago 12m 10.1M - 18.2.2-1173-g5108bc67 3464fd31103e 2bdb75429769 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (22s) 18s ago 12m 12.5M - 18.2.2-1173-g5108bc67 3464fd31103e f47b63e9c1d0 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (51s) 18s ago 12m 15.9M - 18.2.2-1173-g5108bc67 3464fd31103e 0fc2b64fc3ed 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (10m) 69s ago 20m 510M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (8m) 18s ago 17m 454M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (5m) 69s ago 20m 52.4M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (5m) 18s ago 17m 42.8M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:08:46.648 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (8m) 69s ago 19m 18.5M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:08:46.649 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (8m) 18s ago 17m 17.2M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:08:46.649 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (4m) 69s ago 17m 111M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:08:46.649 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (4m) 69s ago 16m 99.0M 1227M 18.2.2-1173-g5108bc67 3464fd31103e fc8474d8910f 2024-04-13T11:08:46.649 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (3m) 69s ago 16m 106M 1227M 18.2.2-1173-g5108bc67 3464fd31103e b24ce165bc9f 2024-04-13T11:08:46.649 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (3m) 18s ago 15m 134M 2251M 18.2.2-1173-g5108bc67 3464fd31103e d909c0e8d077 2024-04-13T11:08:46.649 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (2m) 18s ago 15m 103M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 7f721487a63b 2024-04-13T11:08:46.649 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (118s) 18s ago 14m 89.6M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 1c4a65aaf413 2024-04-13T11:08:46.649 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (7m) 69s ago 18m 67.4M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 -- 172.21.15.134:0/481165438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc9e806cc90 msgr2=0x7fc9e806f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc9e806cc90 0x7fc9e806f140 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec006010 tx=0x7fc9ec005960 comp rx=0 tx=0).stop 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 -- 172.21.15.134:0/481165438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9fc0ff390 msgr2=0x7fc9fc19b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9fc0ff390 0x7fc9fc19b9f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400d900 tx=0x7fc9e400dcc0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 -- 172.21.15.134:0/481165438 shutdown_connections 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc9e806cc90 0x7fc9e806f140 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9fc0ff390 0x7fc9fc19b9f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 --2- 172.21.15.134:0/481165438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9fc0ffd30 0x7fc9fc19bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 -- 172.21.15.134:0/481165438 >> 172.21.15.134:0/481165438 conn(0x7fc9fc074f50 msgr2=0x7fc9fc1037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 -- 172.21.15.134:0/481165438 shutdown_connections 2024-04-13T11:08:46.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.650+0000 7fca0125f700 1 -- 172.21.15.134:0/481165438 wait complete. 2024-04-13T11:08:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.757+0000 7fc2c65ad700 1 -- 172.21.15.134:0/4183221195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00ff320 msgr2=0x7fc2c00ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.757+0000 7fc2c65ad700 1 --2- 172.21.15.134:0/4183221195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00ff320 0x7fc2c00ff790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400aa20 tx=0x7fc2b400ad30 comp rx=0 tx=0).stop 2024-04-13T11:08:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.757+0000 7fc2c65ad700 1 -- 172.21.15.134:0/4183221195 shutdown_connections 2024-04-13T11:08:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.757+0000 7fc2c65ad700 1 --2- 172.21.15.134:0/4183221195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00ff320 0x7fc2c00ff790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.757+0000 7fc2c65ad700 1 --2- 172.21.15.134:0/4183221195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c0103860 0x7fc2c0103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.757+0000 7fc2c65ad700 1 -- 172.21.15.134:0/4183221195 >> 172.21.15.134:0/4183221195 conn(0x7fc2c00748b0 msgr2=0x7fc2c0074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:46.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.757+0000 7fc2c65ad700 1 -- 172.21.15.134:0/4183221195 shutdown_connections 2024-04-13T11:08:46.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.757+0000 7fc2c65ad700 1 -- 172.21.15.134:0/4183221195 wait complete. 2024-04-13T11:08:46.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.757+0000 7fc2c65ad700 1 Processor -- start 2024-04-13T11:08:46.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.757+0000 7fc2c65ad700 1 -- start start 2024-04-13T11:08:46.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2c65ad700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00ff320 0x7fc2c019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2c65ad700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c0103860 0x7fc2c019beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2c65ad700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c019c540 con 0x7fc2c00ff320 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2c65ad700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c01959f0 con 0x7fc2c0103860 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2bffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00ff320 0x7fc2c019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2bffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00ff320 0x7fc2c019b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39688/0 (socket says 172.21.15.134:39688) 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2bffff700 1 -- 172.21.15.134:0/3852162730 learned_addr learned my addr 172.21.15.134:0/3852162730 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2bf7fe700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c0103860 0x7fc2c019beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2bffff700 1 -- 172.21.15.134:0/3852162730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c0103860 msgr2=0x7fc2c019beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2bffff700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c0103860 0x7fc2c019beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2bffff700 1 -- 172.21.15.134:0/3852162730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b400a700 con 0x7fc2c00ff320 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.758+0000 7fc2bffff700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00ff320 0x7fc2c019b970 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000e920 tx=0x7fc2b000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.759+0000 7fc2bd7fa700 1 -- 172.21.15.134:0/3852162730 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b000c9d0 con 0x7fc2c00ff320 2024-04-13T11:08:46.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.759+0000 7fc2bd7fa700 1 -- 172.21.15.134:0/3852162730 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc2b0010430 con 0x7fc2c00ff320 2024-04-13T11:08:46.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.759+0000 7fc2bd7fa700 1 -- 172.21.15.134:0/3852162730 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b0018650 con 0x7fc2c00ff320 2024-04-13T11:08:46.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.759+0000 7fc2c65ad700 1 -- 172.21.15.134:0/3852162730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c0195cd0 con 0x7fc2c00ff320 2024-04-13T11:08:46.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.759+0000 7fc2c65ad700 1 -- 172.21.15.134:0/3852162730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c0196220 con 0x7fc2c00ff320 2024-04-13T11:08:46.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.760+0000 7fc2c65ad700 1 -- 172.21.15.134:0/3852162730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c0106e00 con 0x7fc2c00ff320 2024-04-13T11:08:46.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.761+0000 7fc2bd7fa700 1 -- 172.21.15.134:0/3852162730 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc2b00105a0 con 0x7fc2c00ff320 2024-04-13T11:08:46.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.761+0000 7fc2bd7fa700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc2a806cce0 0x7fc2a806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:46.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.761+0000 7fc2bd7fa700 1 -- 172.21.15.134:0/3852162730 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fc2b0014070 con 0x7fc2c00ff320 2024-04-13T11:08:46.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.761+0000 7fc2bf7fe700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc2a806cce0 0x7fc2a806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:46.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.762+0000 7fc2bf7fe700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc2a806cce0 0x7fc2a806f190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0074f80 tx=0x7fc2b400c650 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:46.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:46.766+0000 7fc2bd7fa700 1 -- 172.21.15.134:0/3852162730 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fc2b005a510 con 0x7fc2c00ff320 2024-04-13T11:08:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.064+0000 7fc2c65ad700 1 -- 172.21.15.134:0/3852162730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc2c0196490 con 0x7fc2c00ff320 2024-04-13T11:08:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.064+0000 7fc2bd7fa700 1 -- 172.21.15.134:0/3852162730 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fc2b005a0a0 con 0x7fc2c00ff320 2024-04-13T11:08:47.064 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 6 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 4 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:08:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 14 2024-04-13T11:08:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:08:47.066 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:08:47.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 -- 172.21.15.134:0/3852162730 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc2a806cce0 msgr2=0x7fc2a806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc2a806cce0 0x7fc2a806f190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0074f80 tx=0x7fc2b400c650 comp rx=0 tx=0).stop 2024-04-13T11:08:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 -- 172.21.15.134:0/3852162730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00ff320 msgr2=0x7fc2c019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00ff320 0x7fc2c019b970 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000e920 tx=0x7fc2b000ec30 comp rx=0 tx=0).stop 2024-04-13T11:08:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 -- 172.21.15.134:0/3852162730 shutdown_connections 2024-04-13T11:08:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc2a806cce0 0x7fc2a806f190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00ff320 0x7fc2c019b970 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 --2- 172.21.15.134:0/3852162730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2c0103860 0x7fc2c019beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 -- 172.21.15.134:0/3852162730 >> 172.21.15.134:0/3852162730 conn(0x7fc2c00748b0 msgr2=0x7fc2c00fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 -- 172.21.15.134:0/3852162730 shutdown_connections 2024-04-13T11:08:47.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.067+0000 7fc2c65ad700 1 -- 172.21.15.134:0/3852162730 wait complete. 2024-04-13T11:08:47.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.173+0000 7f27bb50b700 1 -- 172.21.15.134:0/351385577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b40ff320 msgr2=0x7f27b40ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.173+0000 7f27bb50b700 1 --2- 172.21.15.134:0/351385577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b40ff320 0x7f27b40ff6f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009940 tx=0x7f27b0009c50 comp rx=0 tx=0).stop 2024-04-13T11:08:47.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.173+0000 7f27bb50b700 1 -- 172.21.15.134:0/351385577 shutdown_connections 2024-04-13T11:08:47.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.173+0000 7f27bb50b700 1 --2- 172.21.15.134:0/351385577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ffc30 0x7f27b410a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.173+0000 7f27bb50b700 1 --2- 172.21.15.134:0/351385577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b40ff320 0x7f27b40ff6f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.173+0000 7f27bb50b700 1 -- 172.21.15.134:0/351385577 >> 172.21.15.134:0/351385577 conn(0x7f27b40748b0 msgr2=0x7f27b4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:47.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.173+0000 7f27bb50b700 1 -- 172.21.15.134:0/351385577 shutdown_connections 2024-04-13T11:08:47.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.173+0000 7f27bb50b700 1 -- 172.21.15.134:0/351385577 wait complete. 2024-04-13T11:08:47.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27bb50b700 1 Processor -- start 2024-04-13T11:08:47.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27bb50b700 1 -- start start 2024-04-13T11:08:47.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27bb50b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b40ff320 0x7f27b419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:47.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27bb50b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ffc30 0x7f27b419bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:47.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27bb50b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b419c5b0 con 0x7f27b40ff320 2024-04-13T11:08:47.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27bb50b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b4195a60 con 0x7f27b40ffc30 2024-04-13T11:08:47.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27b92a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b40ff320 0x7f27b419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:47.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27b92a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b40ff320 0x7f27b419b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39702/0 (socket says 172.21.15.134:39702) 2024-04-13T11:08:47.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27b92a7700 1 -- 172.21.15.134:0/1219168213 learned_addr learned my addr 172.21.15.134:0/1219168213 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27b8aa6700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ffc30 0x7f27b419bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27b92a7700 1 -- 172.21.15.134:0/1219168213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ffc30 msgr2=0x7f27b419bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27b92a7700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ffc30 0x7f27b419bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.174+0000 7f27b92a7700 1 -- 172.21.15.134:0/1219168213 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b00095f0 con 0x7f27b40ff320 2024-04-13T11:08:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.175+0000 7f27b92a7700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b40ff320 0x7f27b419b9e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f27b000b580 tx=0x7f27b00055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.175+0000 7f27aa7fc700 1 -- 172.21.15.134:0/1219168213 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27b001d070 con 0x7f27b40ff320 2024-04-13T11:08:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.175+0000 7f27aa7fc700 1 -- 172.21.15.134:0/1219168213 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27b000bea0 con 0x7f27b40ff320 2024-04-13T11:08:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.175+0000 7f27bb50b700 1 -- 172.21.15.134:0/1219168213 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b4195d40 con 0x7f27b40ff320 2024-04-13T11:08:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.175+0000 7f27aa7fc700 1 -- 172.21.15.134:0/1219168213 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27b0021410 con 0x7f27b40ff320 2024-04-13T11:08:47.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.175+0000 7f27bb50b700 1 -- 172.21.15.134:0/1219168213 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b4196290 con 0x7f27b40ff320 2024-04-13T11:08:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.176+0000 7f27bb50b700 1 -- 172.21.15.134:0/1219168213 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b4107da0 con 0x7f27b40ff320 2024-04-13T11:08:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.176+0000 7f27aa7fc700 1 -- 172.21.15.134:0/1219168213 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f27b000f6f0 con 0x7f27b40ff320 2024-04-13T11:08:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.177+0000 7f27aa7fc700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27a006cce0 0x7f27a006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.177+0000 7f27aa7fc700 1 -- 172.21.15.134:0/1219168213 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f27b008d7e0 con 0x7f27b40ff320 2024-04-13T11:08:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.177+0000 7f27b8aa6700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27a006cce0 0x7f27a006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:47.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.177+0000 7f27b8aa6700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27a006cce0 0x7f27a006f190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f27b40fdf50 tx=0x7f27a40073d0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:47.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.181+0000 7f27aa7fc700 1 -- 172.21.15.134:0/1219168213 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f27b005b2d0 con 0x7f27b40ff320 2024-04-13T11:08:47.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.443+0000 7f27bb50b700 1 -- 172.21.15.134:0/1219168213 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f27b4196510 con 0x7f27b40ff320 2024-04-13T11:08:47.444 INFO:teuthology.orchestra.run.smithi134.stdout:e40 2024-04-13T11:08:47.444 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:08:47.444 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:08:47.444 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:08:47.444 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 40 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T11:08:34.674272+0000 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:08:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 91 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=34322} 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:08:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:08:47.447 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:08:47.447 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:34322} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:08:47.447 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:34354} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/3883973153,v1:172.21.15.134:6829/3883973153] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:08:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:08:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:08:47.447 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:08:47.447 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:08:47.447 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6824/2092944903,v1:172.21.15.194:6825/2092944903] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:08:47.447 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/2085856165,v1:172.21.15.194:6827/2085856165] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:08:47.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.444+0000 7f27aa7fc700 1 -- 172.21.15.134:0/1219168213 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 40 v40) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f27b005ae60 con 0x7f27b40ff320 2024-04-13T11:08:47.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 -- 172.21.15.134:0/1219168213 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27a006cce0 msgr2=0x7f27a006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27a006cce0 0x7f27a006f190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f27b40fdf50 tx=0x7f27a40073d0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 -- 172.21.15.134:0/1219168213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b40ff320 msgr2=0x7f27b419b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b40ff320 0x7f27b419b9e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f27b000b580 tx=0x7f27b00055f0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 -- 172.21.15.134:0/1219168213 shutdown_connections 2024-04-13T11:08:47.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f27a006cce0 0x7f27a006f190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27b40ff320 0x7f27b419b9e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 --2- 172.21.15.134:0/1219168213 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27b40ffc30 0x7f27b419bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 -- 172.21.15.134:0/1219168213 >> 172.21.15.134:0/1219168213 conn(0x7f27b40748b0 msgr2=0x7f27b4104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:47.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 -- 172.21.15.134:0/1219168213 shutdown_connections 2024-04-13T11:08:47.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.446+0000 7f27bb50b700 1 -- 172.21.15.134:0/1219168213 wait complete. 2024-04-13T11:08:47.449 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 40 2024-04-13T11:08:47.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.553+0000 7fe1b0a07700 1 -- 172.21.15.134:0/742246905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac0ff840 msgr2=0x7fe1ac10c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.553+0000 7fe1b0a07700 1 --2- 172.21.15.134:0/742246905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac0ff840 0x7fe1ac10c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009910 tx=0x7fe1a0009c20 comp rx=0 tx=0).stop 2024-04-13T11:08:47.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.554+0000 7fe1b0a07700 1 -- 172.21.15.134:0/742246905 shutdown_connections 2024-04-13T11:08:47.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.554+0000 7fe1b0a07700 1 --2- 172.21.15.134:0/742246905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac0ff840 0x7fe1ac10c5a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.554+0000 7fe1b0a07700 1 --2- 172.21.15.134:0/742246905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1ac0fef30 0x7fe1ac0ff300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.554+0000 7fe1b0a07700 1 -- 172.21.15.134:0/742246905 >> 172.21.15.134:0/742246905 conn(0x7fe1ac0fab80 msgr2=0x7fe1ac0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:47.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.554+0000 7fe1b0a07700 1 -- 172.21.15.134:0/742246905 shutdown_connections 2024-04-13T11:08:47.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.554+0000 7fe1b0a07700 1 -- 172.21.15.134:0/742246905 wait complete. 2024-04-13T11:08:47.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.554+0000 7fe1b0a07700 1 Processor -- start 2024-04-13T11:08:47.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.554+0000 7fe1b0a07700 1 -- start start 2024-04-13T11:08:47.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1b0a07700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1ac0fef30 0x7fe1ac197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:47.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1b0a07700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac0ff840 0x7fe1ac198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:47.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1b0a07700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac198a70 con 0x7fe1ac0ff840 2024-04-13T11:08:47.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1b0a07700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac19c800 con 0x7fe1ac0fef30 2024-04-13T11:08:47.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1a9d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac0ff840 0x7fe1ac198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:47.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1a9d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac0ff840 0x7fe1ac198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39722/0 (socket says 172.21.15.134:39722) 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1a9d9b700 1 -- 172.21.15.134:0/2769353200 learned_addr learned my addr 172.21.15.134:0/2769353200 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1aa59c700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1ac0fef30 0x7fe1ac197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1a9d9b700 1 -- 172.21.15.134:0/2769353200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1ac0fef30 msgr2=0x7fe1ac197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1a9d9b700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1ac0fef30 0x7fe1ac197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1a9d9b700 1 -- 172.21.15.134:0/2769353200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a00095f0 con 0x7fe1ac0ff840 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1a9d9b700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac0ff840 0x7fe1ac198390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0006010 tx=0x7fe1a000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe19b7fe700 1 -- 172.21.15.134:0/2769353200 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a001d070 con 0x7fe1ac0ff840 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1b0a07700 1 -- 172.21.15.134:0/2769353200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac19cae0 con 0x7fe1ac0ff840 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe19b7fe700 1 -- 172.21.15.134:0/2769353200 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1a0005710 con 0x7fe1ac0ff840 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe19b7fe700 1 -- 172.21.15.134:0/2769353200 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a000fe20 con 0x7fe1ac0ff840 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.555+0000 7fe1b0a07700 1 -- 172.21.15.134:0/2769353200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac19d030 con 0x7fe1ac0ff840 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.556+0000 7fe1b0a07700 1 -- 172.21.15.134:0/2769353200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac109d10 con 0x7fe1ac0ff840 2024-04-13T11:08:47.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.557+0000 7fe19b7fe700 1 -- 172.21.15.134:0/2769353200 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe1a002b440 con 0x7fe1ac0ff840 2024-04-13T11:08:47.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.557+0000 7fe19b7fe700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe19406cce0 0x7fe19406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:47.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.557+0000 7fe19b7fe700 1 -- 172.21.15.134:0/2769353200 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fe1a008d820 con 0x7fe1ac0ff840 2024-04-13T11:08:47.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.557+0000 7fe1aa59c700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe19406cce0 0x7fe19406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:47.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.558+0000 7fe1aa59c700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe19406cce0 0x7fe19406f190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe19c005950 tx=0x7fe19c00b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:47.561 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.562+0000 7fe19b7fe700 1 -- 172.21.15.134:0/2769353200 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fe1a00578a0 con 0x7fe1ac0ff840 2024-04-13T11:08:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:47 smithi134 ceph-mon[112184]: from='client.44339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:47 smithi134 ceph-mon[112184]: pgmap v320: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 5 op/s 2024-04-13T11:08:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:47 smithi134 ceph-mon[112184]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:47 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:47 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:47 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:47 smithi134 ceph-mon[112184]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:47 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3852162730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:47 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1219168213' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:08:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:47 smithi194 ceph-mon[83053]: from='client.44339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:47 smithi194 ceph-mon[83053]: pgmap v320: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 5 op/s 2024-04-13T11:08:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:47 smithi194 ceph-mon[83053]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:47 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:47 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:47 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:47 smithi194 ceph-mon[83053]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:47 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3852162730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:47 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1219168213' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:08:47.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.801+0000 7fe1b0a07700 1 -- 172.21.15.134:0/2769353200 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1ac19d310 con 0x7fe19406cce0 2024-04-13T11:08:47.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.803+0000 7fe19b7fe700 1 -- 172.21.15.134:0/2769353200 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fe1ac19d310 con 0x7fe19406cce0 2024-04-13T11:08:47.802 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d0f3373246181f8bd5bf4b498100ce7aec5216a82ea0749582fbd645c3287a39", 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "mds", 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "osd" 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "16/23 daemons upgraded", 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-04-13T11:08:47.803 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:08:47.804 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:08:47.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 -- 172.21.15.134:0/2769353200 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe19406cce0 msgr2=0x7fe19406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe19406cce0 0x7fe19406f190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe19c005950 tx=0x7fe19c00b410 comp rx=0 tx=0).stop 2024-04-13T11:08:47.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 -- 172.21.15.134:0/2769353200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac0ff840 msgr2=0x7fe1ac198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac0ff840 0x7fe1ac198390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0006010 tx=0x7fe1a000bd70 comp rx=0 tx=0).stop 2024-04-13T11:08:47.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 -- 172.21.15.134:0/2769353200 shutdown_connections 2024-04-13T11:08:47.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe19406cce0 0x7fe19406f190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1ac0fef30 0x7fe1ac197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 --2- 172.21.15.134:0/2769353200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac0ff840 0x7fe1ac198390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 -- 172.21.15.134:0/2769353200 >> 172.21.15.134:0/2769353200 conn(0x7fe1ac0fab80 msgr2=0x7fe1ac0fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:47.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 -- 172.21.15.134:0/2769353200 shutdown_connections 2024-04-13T11:08:47.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.805+0000 7fe1b0a07700 1 -- 172.21.15.134:0/2769353200 wait complete. 2024-04-13T11:08:47.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.912+0000 7fefe40ef700 1 -- 172.21.15.134:0/1534431311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc0ff390 msgr2=0x7fefdc0ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.912+0000 7fefe40ef700 1 --2- 172.21.15.134:0/1534431311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc0ff390 0x7fefdc0ff760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fefd400b0a0 tx=0x7fefd400b3b0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.912+0000 7fefe40ef700 1 -- 172.21.15.134:0/1534431311 shutdown_connections 2024-04-13T11:08:47.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.912+0000 7fefe40ef700 1 --2- 172.21.15.134:0/1534431311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefdc0ffd30 0x7fefdc103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.912+0000 7fefe40ef700 1 --2- 172.21.15.134:0/1534431311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc0ff390 0x7fefdc0ff760 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.912+0000 7fefe40ef700 1 -- 172.21.15.134:0/1534431311 >> 172.21.15.134:0/1534431311 conn(0x7fefdc074f50 msgr2=0x7fefdc075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:47.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.912+0000 7fefe40ef700 1 -- 172.21.15.134:0/1534431311 shutdown_connections 2024-04-13T11:08:47.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.912+0000 7fefe40ef700 1 -- 172.21.15.134:0/1534431311 wait complete. 2024-04-13T11:08:47.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.913+0000 7fefe40ef700 1 Processor -- start 2024-04-13T11:08:47.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.913+0000 7fefe40ef700 1 -- start start 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe40ef700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefdc0ff390 0x7fefdc19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe40ef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc0ffd30 0x7fefdc19ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe40ef700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc19b4e0 con 0x7fefdc0ffd30 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe40ef700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc194990 con 0x7fefdc0ff390 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe168a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc0ffd30 0x7fefdc19ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe168a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc0ffd30 0x7fefdc19ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39742/0 (socket says 172.21.15.134:39742) 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe168a700 1 -- 172.21.15.134:0/1766613875 learned_addr learned my addr 172.21.15.134:0/1766613875 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe1e8b700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefdc0ff390 0x7fefdc19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe168a700 1 -- 172.21.15.134:0/1766613875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefdc0ff390 msgr2=0x7fefdc19a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe168a700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefdc0ff390 0x7fefdc19a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:47.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe168a700 1 -- 172.21.15.134:0/1766613875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4009d00 con 0x7fefdc0ffd30 2024-04-13T11:08:47.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe168a700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc0ffd30 0x7fefdc19ae50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fefd000e8f0 tx=0x7fefd000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:47.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefdaffd700 1 -- 172.21.15.134:0/1766613875 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefd0009790 con 0x7fefdc0ffd30 2024-04-13T11:08:47.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefdaffd700 1 -- 172.21.15.134:0/1766613875 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fefd000c810 con 0x7fefdc0ffd30 2024-04-13T11:08:47.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe40ef700 1 -- 172.21.15.134:0/1766613875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc194c70 con 0x7fefdc0ffd30 2024-04-13T11:08:47.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefdaffd700 1 -- 172.21.15.134:0/1766613875 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefd0005520 con 0x7fefdc0ffd30 2024-04-13T11:08:47.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.914+0000 7fefe40ef700 1 -- 172.21.15.134:0/1766613875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc1951c0 con 0x7fefdc0ffd30 2024-04-13T11:08:47.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.915+0000 7fefe40ef700 1 -- 172.21.15.134:0/1766613875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc107650 con 0x7fefdc0ffd30 2024-04-13T11:08:47.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.916+0000 7fefdaffd700 1 -- 172.21.15.134:0/1766613875 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fefd000c980 con 0x7fefdc0ffd30 2024-04-13T11:08:47.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.916+0000 7fefdaffd700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fefc406cce0 0x7fefc406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:08:47.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.916+0000 7fefdaffd700 1 -- 172.21.15.134:0/1766613875 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fefd0014070 con 0x7fefdc0ffd30 2024-04-13T11:08:47.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.916+0000 7fefe1e8b700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fefc406cce0 0x7fefc406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:08:47.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.917+0000 7fefe1e8b700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fefc406cce0 0x7fefc406f190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefd4000f80 tx=0x7fefd40060c0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:08:47.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:47.921+0000 7fefdaffd700 1 -- 172.21.15.134:0/1766613875 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fefd005a330 con 0x7fefdc0ffd30 2024-04-13T11:08:48.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.211+0000 7fefe40ef700 1 -- 172.21.15.134:0/1766613875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fefdc04ea50 con 0x7fefdc0ffd30 2024-04-13T11:08:48.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.211+0000 7fefdaffd700 1 -- 172.21.15.134:0/1766613875 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fefd0056020 con 0x7fefdc0ffd30 2024-04-13T11:08:48.211 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:08:48.211 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:08:48.211 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:08:48.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 -- 172.21.15.134:0/1766613875 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fefc406cce0 msgr2=0x7fefc406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:48.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fefc406cce0 0x7fefc406f190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefd4000f80 tx=0x7fefd40060c0 comp rx=0 tx=0).stop 2024-04-13T11:08:48.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 -- 172.21.15.134:0/1766613875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc0ffd30 msgr2=0x7fefdc19ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:08:48.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc0ffd30 0x7fefdc19ae50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fefd000e8f0 tx=0x7fefd000ec00 comp rx=0 tx=0).stop 2024-04-13T11:08:48.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 -- 172.21.15.134:0/1766613875 shutdown_connections 2024-04-13T11:08:48.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fefc406cce0 0x7fefc406f190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:48.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefdc0ff390 0x7fefdc19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:48.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 --2- 172.21.15.134:0/1766613875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc0ffd30 0x7fefdc19ae50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:08:48.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 -- 172.21.15.134:0/1766613875 >> 172.21.15.134:0/1766613875 conn(0x7fefdc074f50 msgr2=0x7fefdc0fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:08:48.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 -- 172.21.15.134:0/1766613875 shutdown_connections 2024-04-13T11:08:48.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:08:48.213+0000 7fefe40ef700 1 -- 172.21.15.134:0/1766613875 wait complete. 2024-04-13T11:08:48.902 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:48 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1766613875' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:08:48.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:48 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1766613875' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:08:49.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:49 smithi134 ceph-mon[112184]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:49.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:49 smithi134 ceph-mon[112184]: pgmap v321: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-13T11:08:49.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:49.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:49 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:49 smithi194 ceph-mon[83053]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:08:49.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:49 smithi194 ceph-mon[83053]: pgmap v321: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-04-13T11:08:49.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:49.999 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:49 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:50.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:50 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:50.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:50 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:50.924 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:50 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:50.924 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:50 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:51.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:51 smithi194 ceph-mon[83053]: pgmap v322: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-04-13T11:08:51.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:51 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:51.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:51 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:51 smithi134 ceph-mon[112184]: pgmap v322: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-04-13T11:08:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:51 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:51.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:51 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:53.245 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:52 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:53.245 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:52 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:53.246 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:52 smithi194 ceph-mon[83053]: pgmap v323: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.5 MiB/s rd, 3 op/s 2024-04-13T11:08:53.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:52 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:53.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:52 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:53.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:52 smithi134 ceph-mon[112184]: pgmap v323: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.5 MiB/s rd, 3 op/s 2024-04-13T11:08:54.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:08:54.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:54.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:54.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:08:54.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:54.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:55.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:54 smithi194 ceph-mon[83053]: pgmap v324: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.9 MiB/s rd, 2 op/s 2024-04-13T11:08:55.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:54 smithi134 ceph-mon[112184]: pgmap v324: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.9 MiB/s rd, 2 op/s 2024-04-13T11:08:57.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:57.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:57.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: pgmap v325: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 1 op/s 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: Upgrade: Setting filesystem cephfs Joinable 2024-04-13T11:08:57.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:56 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: pgmap v325: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 1 op/s 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:57.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:57.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:57.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: Upgrade: Setting filesystem cephfs Joinable 2024-04-13T11:08:57.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:56 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-13T11:08:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-13T11:08:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T11:08:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.249 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: Upgrade: Setting container_image for all ceph-exporter 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi134"}]: dispatch 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi134"}]': finished 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi194"}]: dispatch 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi194"}]': finished 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: Upgrade: Setting container_image for all iscsi 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: Upgrade: Setting container_image for all nfs 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.250 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: Upgrade: Setting container_image for all nvmeof 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: Upgrade: Finalizing container_image settings 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.251 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-13T11:08:58.252 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-04-13T11:08:58.253 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: Upgrade: Complete! 2024-04-13T11:08:58.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-13T11:08:58.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-13T11:08:58.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:58.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:58.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:08:58.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:58.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:58.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:08:58.254 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:57 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-13T11:08:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: fsmap cephfs:1 {0=cephfs.smithi134.hxpcfx=up:active} 1 up:standby-replay 2 up:standby 2024-04-13T11:08:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: Upgrade: Setting container_image for all ceph-exporter 2024-04-13T11:08:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi134"}]: dispatch 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi134"}]': finished 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi194"}]: dispatch 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi194"}]': finished 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: Upgrade: Setting container_image for all iscsi 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: Upgrade: Setting container_image for all nfs 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: Upgrade: Setting container_image for all nvmeof 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.436 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: Upgrade: Finalizing container_image settings 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-13T11:08:58.437 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-13T11:08:58.438 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: Upgrade: Complete! 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-13T11:08:58.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:58.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:58.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:08:58.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:58.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:08:58.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:08:58.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:08:58.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:57 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:59 smithi134 ceph-mon[112184]: pgmap v326: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 191 KiB/s rd, 2 op/s 2024-04-13T11:08:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:08:59 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:08:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:59 smithi194 ceph-mon[83053]: pgmap v326: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 191 KiB/s rd, 2 op/s 2024-04-13T11:08:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:08:59 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:09:01.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:01 smithi134 ceph-mon[112184]: pgmap v327: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:01 smithi194 ceph-mon[83053]: pgmap v327: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:03.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:03 smithi134 ceph-mon[112184]: pgmap v328: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:03.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:03 smithi194 ceph-mon[83053]: pgmap v328: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:05.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:05 smithi134 ceph-mon[112184]: pgmap v329: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:05 smithi194 ceph-mon[83053]: pgmap v329: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:07.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:07 smithi134 ceph-mon[112184]: pgmap v330: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:07.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:07 smithi194 ceph-mon[83053]: pgmap v330: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:08.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:09:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:09:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:09 smithi134 ceph-mon[112184]: pgmap v331: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:09 smithi194 ceph-mon[83053]: pgmap v331: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:11.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:11 smithi134 ceph-mon[112184]: pgmap v332: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:11.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:11 smithi194 ceph-mon[83053]: pgmap v332: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:13 smithi134 ceph-mon[112184]: pgmap v333: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:13 smithi194 ceph-mon[83053]: pgmap v333: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:15.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:15 smithi134 ceph-mon[112184]: pgmap v334: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:15 smithi194 ceph-mon[83053]: pgmap v334: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:17.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:17 smithi134 ceph-mon[112184]: pgmap v335: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:17 smithi194 ceph-mon[83053]: pgmap v335: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:18.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.331+0000 7f028abbe700 1 -- 172.21.15.134:0/4238291666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0284103860 msgr2=0x7f0284103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.331+0000 7f028abbe700 1 --2- 172.21.15.134:0/4238291666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0284103860 0x7f0284103c30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0278009910 tx=0x7f0278009c20 comp rx=0 tx=0).stop 2024-04-13T11:09:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.331+0000 7f028abbe700 1 -- 172.21.15.134:0/4238291666 shutdown_connections 2024-04-13T11:09:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.331+0000 7f028abbe700 1 --2- 172.21.15.134:0/4238291666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02840ff320 0x7f02840ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.331+0000 7f028abbe700 1 --2- 172.21.15.134:0/4238291666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0284103860 0x7f0284103c30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.331+0000 7f028abbe700 1 -- 172.21.15.134:0/4238291666 >> 172.21.15.134:0/4238291666 conn(0x7f02840748b0 msgr2=0x7f0284074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:09:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.331+0000 7f028abbe700 1 -- 172.21.15.134:0/4238291666 shutdown_connections 2024-04-13T11:09:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.331+0000 7f028abbe700 1 -- 172.21.15.134:0/4238291666 wait complete. 2024-04-13T11:09:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.332+0000 7f028abbe700 1 Processor -- start 2024-04-13T11:09:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.332+0000 7f028abbe700 1 -- start start 2024-04-13T11:09:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.332+0000 7f028abbe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02840ff320 0x7f028419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.332+0000 7f028abbe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0284103860 0x7f028419bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.332+0000 7f028abbe700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028419c530 con 0x7f02840ff320 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.332+0000 7f028abbe700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02841959e0 con 0x7f0284103860 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.332+0000 7f028895a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02840ff320 0x7f028419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.332+0000 7f028895a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02840ff320 0x7f028419b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40460/0 (socket says 172.21.15.134:40460) 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.332+0000 7f028895a700 1 -- 172.21.15.134:0/3529472065 learned_addr learned my addr 172.21.15.134:0/3529472065 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.333+0000 7f028895a700 1 -- 172.21.15.134:0/3529472065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0284103860 msgr2=0x7f028419bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.333+0000 7f028895a700 1 --2- 172.21.15.134:0/3529472065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0284103860 0x7f028419bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.333+0000 7f028895a700 1 -- 172.21.15.134:0/3529472065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02780095f0 con 0x7f02840ff320 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.333+0000 7f028895a700 1 --2- 172.21.15.134:0/3529472065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02840ff320 0x7f028419b960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0278006010 tx=0x7f027800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.333+0000 7f0281ffb700 1 -- 172.21.15.134:0/3529472065 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027801d070 con 0x7f02840ff320 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.333+0000 7f0281ffb700 1 -- 172.21.15.134:0/3529472065 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f027800f460 con 0x7f02840ff320 2024-04-13T11:09:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.333+0000 7f028abbe700 1 -- 172.21.15.134:0/3529472065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0284195c60 con 0x7f02840ff320 2024-04-13T11:09:18.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.333+0000 7f0281ffb700 1 -- 172.21.15.134:0/3529472065 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0278021620 con 0x7f02840ff320 2024-04-13T11:09:18.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.333+0000 7f028abbe700 1 -- 172.21.15.134:0/3529472065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02841961d0 con 0x7f02840ff320 2024-04-13T11:09:18.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.334+0000 7f028abbe700 1 -- 172.21.15.134:0/3529472065 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0284108e30 con 0x7f02840ff320 2024-04-13T11:09:18.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.335+0000 7f0281ffb700 1 -- 172.21.15.134:0/3529472065 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f027800fa40 con 0x7f02840ff320 2024-04-13T11:09:18.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.335+0000 7f0281ffb700 1 --2- 172.21.15.134:0/3529472065 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f027406cce0 0x7f027406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:18.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.335+0000 7f0281ffb700 1 -- 172.21.15.134:0/3529472065 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f027808d790 con 0x7f02840ff320 2024-04-13T11:09:18.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.335+0000 7f0283fff700 1 --2- 172.21.15.134:0/3529472065 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f027406cce0 0x7f027406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:18.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.336+0000 7f0283fff700 1 --2- 172.21.15.134:0/3529472065 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f027406cce0 0x7f027406f190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0270005950 tx=0x7f02700058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:09:18.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.340+0000 7f0281ffb700 1 -- 172.21.15.134:0/3529472065 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f027805b240 con 0x7f02840ff320 2024-04-13T11:09:18.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.554+0000 7f028abbe700 1 -- 172.21.15.134:0/3529472065 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02841964b0 con 0x7f027406cce0 2024-04-13T11:09:18.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.555+0000 7f0281ffb700 1 -- 172.21.15.134:0/3529472065 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f02841964b0 con 0x7f027406cce0 2024-04-13T11:09:18.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.557+0000 7f028abbe700 1 -- 172.21.15.134:0/3529472065 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f027406cce0 msgr2=0x7f027406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:18.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.557+0000 7f028abbe700 1 --2- 172.21.15.134:0/3529472065 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f027406cce0 0x7f027406f190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0270005950 tx=0x7f02700058e0 comp rx=0 tx=0).stop 2024-04-13T11:09:18.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.557+0000 7f028abbe700 1 -- 172.21.15.134:0/3529472065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02840ff320 msgr2=0x7f028419b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:18.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.557+0000 7f028abbe700 1 --2- 172.21.15.134:0/3529472065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02840ff320 0x7f028419b960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0278006010 tx=0x7f027800be20 comp rx=0 tx=0).stop 2024-04-13T11:09:18.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.558+0000 7f028abbe700 1 -- 172.21.15.134:0/3529472065 shutdown_connections 2024-04-13T11:09:18.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.558+0000 7f028abbe700 1 --2- 172.21.15.134:0/3529472065 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f027406cce0 0x7f027406f190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:18.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.558+0000 7f028abbe700 1 --2- 172.21.15.134:0/3529472065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02840ff320 0x7f028419b960 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:18.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.558+0000 7f028abbe700 1 --2- 172.21.15.134:0/3529472065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0284103860 0x7f028419bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:18.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.558+0000 7f028abbe700 1 -- 172.21.15.134:0/3529472065 >> 172.21.15.134:0/3529472065 conn(0x7f02840748b0 msgr2=0x7f02840fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:09:18.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.558+0000 7f028abbe700 1 -- 172.21.15.134:0/3529472065 shutdown_connections 2024-04-13T11:09:18.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:18.558+0000 7f028abbe700 1 -- 172.21.15.134:0/3529472065 wait complete. 2024-04-13T11:09:19.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:19 smithi134 ceph-mon[112184]: pgmap v336: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:19.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:19 smithi134 ceph-mon[112184]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:09:19.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph orch ps' 2024-04-13T11:09:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:19 smithi194 ceph-mon[83053]: pgmap v336: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:19 smithi194 ceph-mon[83053]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:09:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:09:21.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:21 smithi134 ceph-mon[112184]: pgmap v337: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:21.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:21 smithi194 ceph-mon[83053]: pgmap v337: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:21.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.842+0000 7faf37568700 1 -- 172.21.15.134:0/2071978715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf300ff2c0 msgr2=0x7faf300ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:21.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.842+0000 7faf37568700 1 --2- 172.21.15.134:0/2071978715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf300ff2c0 0x7faf300ff690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faf20009910 tx=0x7faf20009c20 comp rx=0 tx=0).stop 2024-04-13T11:09:21.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.842+0000 7faf37568700 1 -- 172.21.15.134:0/2071978715 shutdown_connections 2024-04-13T11:09:21.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.842+0000 7faf37568700 1 --2- 172.21.15.134:0/2071978715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf300ffc60 0x7faf30103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:21.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.842+0000 7faf37568700 1 --2- 172.21.15.134:0/2071978715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf300ff2c0 0x7faf300ff690 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:21.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.842+0000 7faf37568700 1 -- 172.21.15.134:0/2071978715 >> 172.21.15.134:0/2071978715 conn(0x7faf300fab80 msgr2=0x7faf300fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:09:21.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.842+0000 7faf37568700 1 -- 172.21.15.134:0/2071978715 shutdown_connections 2024-04-13T11:09:21.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.842+0000 7faf37568700 1 -- 172.21.15.134:0/2071978715 wait complete. 2024-04-13T11:09:21.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.843+0000 7faf37568700 1 Processor -- start 2024-04-13T11:09:21.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.843+0000 7faf37568700 1 -- start start 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.843+0000 7faf37568700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf300ff2c0 0x7faf30100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.843+0000 7faf37568700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf300ffc60 0x7faf30101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.843+0000 7faf37568700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf30101750 con 0x7faf300ffc60 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.843+0000 7faf37568700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf30101890 con 0x7faf300ff2c0 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.843+0000 7faf34b03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf300ffc60 0x7faf30101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.843+0000 7faf34b03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf300ffc60 0x7faf30101210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38830/0 (socket says 172.21.15.134:38830) 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.843+0000 7faf34b03700 1 -- 172.21.15.134:0/2185312177 learned_addr learned my addr 172.21.15.134:0/2185312177 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.843+0000 7faf35304700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf300ff2c0 0x7faf30100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.844+0000 7faf34b03700 1 -- 172.21.15.134:0/2185312177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf300ff2c0 msgr2=0x7faf30100cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.844+0000 7faf34b03700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf300ff2c0 0x7faf30100cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.844+0000 7faf34b03700 1 -- 172.21.15.134:0/2185312177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200095f0 con 0x7faf300ffc60 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.844+0000 7faf34b03700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf300ffc60 0x7faf30101210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00b480 tx=0x7faf2c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.844+0000 7faf267fc700 1 -- 172.21.15.134:0/2185312177 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf2c011800 con 0x7faf300ffc60 2024-04-13T11:09:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.844+0000 7faf267fc700 1 -- 172.21.15.134:0/2185312177 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faf2c011e00 con 0x7faf300ffc60 2024-04-13T11:09:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.844+0000 7faf37568700 1 -- 172.21.15.134:0/2185312177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf301a1f00 con 0x7faf300ffc60 2024-04-13T11:09:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.844+0000 7faf267fc700 1 -- 172.21.15.134:0/2185312177 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf2c010e30 con 0x7faf300ffc60 2024-04-13T11:09:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.844+0000 7faf37568700 1 -- 172.21.15.134:0/2185312177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf301a2310 con 0x7faf300ffc60 2024-04-13T11:09:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.845+0000 7faf37568700 1 -- 172.21.15.134:0/2185312177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3004ea50 con 0x7faf300ffc60 2024-04-13T11:09:21.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.845+0000 7faf267fc700 1 -- 172.21.15.134:0/2185312177 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7faf2c011960 con 0x7faf300ffc60 2024-04-13T11:09:21.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.846+0000 7faf267fc700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faf1c06cce0 0x7faf1c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:21.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.846+0000 7faf267fc700 1 -- 172.21.15.134:0/2185312177 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7faf2c08c0d0 con 0x7faf300ffc60 2024-04-13T11:09:21.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.846+0000 7faf35304700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faf1c06cce0 0x7faf1c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:21.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.846+0000 7faf35304700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faf1c06cce0 0x7faf1c06f190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faf20006010 tx=0x7faf2001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:09:21.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:21.850+0000 7faf267fc700 1 -- 172.21.15.134:0/2185312177 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7faf2c0560f0 con 0x7faf300ffc60 2024-04-13T11:09:22.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.057+0000 7faf37568700 1 -- 172.21.15.134:0/2185312177 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf30068d00 con 0x7faf1c06cce0 2024-04-13T11:09:22.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.067+0000 7faf267fc700 1 -- 172.21.15.134:0/2185312177 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7faf30068d00 con 0x7faf1c06cce0 2024-04-13T11:09:22.068 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:09:22.068 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (8m) 30s ago 19m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:09:22.068 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (41s) 30s ago 19m 7046k - 18.2.2-1173-g5108bc67 3464fd31103e d15a22ad7e4b 2024-04-13T11:09:22.068 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (36s) 33s ago 18m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 28b8fa73679a 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (5m) 30s ago 19m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (5m) 33s ago 18m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (7m) 30s ago 19m 88.2M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (2m) 30s ago 13m 84.7M - 18.2.2-1173-g5108bc67 3464fd31103e ed96357b7f55 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (111s) 30s ago 13m 155M - 18.2.2-1173-g5108bc67 3464fd31103e 2bdb75429769 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (58s) 33s ago 13m 14.7M - 18.2.2-1173-g5108bc67 3464fd31103e f47b63e9c1d0 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (86s) 33s ago 13m 16.0M - 18.2.2-1173-g5108bc67 3464fd31103e 0fc2b64fc3ed 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (10m) 30s ago 21m 512M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (9m) 33s ago 18m 454M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (6m) 30s ago 21m 55.7M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (6m) 33s ago 18m 45.0M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (9m) 30s ago 19m 18.6M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (9m) 33s ago 18m 16.8M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (5m) 30s ago 17m 112M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:09:22.069 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (4m) 30s ago 17m 102M 1227M 18.2.2-1173-g5108bc67 3464fd31103e fc8474d8910f 2024-04-13T11:09:22.070 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (4m) 30s ago 16m 107M 1227M 18.2.2-1173-g5108bc67 3464fd31103e b24ce165bc9f 2024-04-13T11:09:22.070 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (3m) 33s ago 16m 135M 2251M 18.2.2-1173-g5108bc67 3464fd31103e d909c0e8d077 2024-04-13T11:09:22.070 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (3m) 33s ago 15m 104M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 7f721487a63b 2024-04-13T11:09:22.070 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (2m) 33s ago 15m 91.2M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 1c4a65aaf413 2024-04-13T11:09:22.070 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (8m) 30s ago 19m 67.9M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:09:22.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 -- 172.21.15.134:0/2185312177 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faf1c06cce0 msgr2=0x7faf1c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faf1c06cce0 0x7faf1c06f190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faf20006010 tx=0x7faf2001a040 comp rx=0 tx=0).stop 2024-04-13T11:09:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 -- 172.21.15.134:0/2185312177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf300ffc60 msgr2=0x7faf30101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf300ffc60 0x7faf30101210 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00b480 tx=0x7faf2c00b790 comp rx=0 tx=0).stop 2024-04-13T11:09:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 -- 172.21.15.134:0/2185312177 shutdown_connections 2024-04-13T11:09:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7faf1c06cce0 0x7faf1c06f190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf300ff2c0 0x7faf30100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 --2- 172.21.15.134:0/2185312177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf300ffc60 0x7faf30101210 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 -- 172.21.15.134:0/2185312177 >> 172.21.15.134:0/2185312177 conn(0x7faf300fab80 msgr2=0x7faf30103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:09:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 -- 172.21.15.134:0/2185312177 shutdown_connections 2024-04-13T11:09:22.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:22.070+0000 7faf37568700 1 -- 172.21.15.134:0/2185312177 wait complete. 2024-04-13T11:09:22.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph orch upgrade status' 2024-04-13T11:09:23.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:23 smithi134 ceph-mon[112184]: pgmap v338: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:23.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:23 smithi134 ceph-mon[112184]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:09:23.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:09:23.193 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:09:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:23 smithi194 ceph-mon[83053]: pgmap v338: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:23 smithi194 ceph-mon[83053]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:09:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:09:25.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.158+0000 7f3f00d03700 1 -- 172.21.15.134:0/1003851925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0ffc60 msgr2=0x7f3efc103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:25.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.158+0000 7f3f00d03700 1 --2- 172.21.15.134:0/1003851925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0ffc60 0x7f3efc103c30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009910 tx=0x7f3eec009c20 comp rx=0 tx=0).stop 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.158+0000 7f3f00d03700 1 -- 172.21.15.134:0/1003851925 shutdown_connections 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.158+0000 7f3f00d03700 1 --2- 172.21.15.134:0/1003851925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0ffc60 0x7f3efc103c30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.158+0000 7f3f00d03700 1 --2- 172.21.15.134:0/1003851925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc0ff2c0 0x7f3efc0ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.158+0000 7f3f00d03700 1 -- 172.21.15.134:0/1003851925 >> 172.21.15.134:0/1003851925 conn(0x7f3efc0fab80 msgr2=0x7f3efc0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.159+0000 7f3f00d03700 1 -- 172.21.15.134:0/1003851925 shutdown_connections 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.159+0000 7f3f00d03700 1 -- 172.21.15.134:0/1003851925 wait complete. 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.159+0000 7f3f00d03700 1 Processor -- start 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.159+0000 7f3f00d03700 1 -- start start 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.159+0000 7f3f00d03700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc0ff2c0 0x7f3efc19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3f00d03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0ffc60 0x7f3efc19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3f00d03700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc19c5f0 con 0x7f3efc0ffc60 2024-04-13T11:09:25.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3f00d03700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc195af0 con 0x7f3efc0ff2c0 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3ef9d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0ffc60 0x7f3efc19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3ef9d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0ffc60 0x7f3efc19bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38846/0 (socket says 172.21.15.134:38846) 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3ef9d9b700 1 -- 172.21.15.134:0/3060768576 learned_addr learned my addr 172.21.15.134:0/3060768576 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3efa59c700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc0ff2c0 0x7f3efc19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3ef9d9b700 1 -- 172.21.15.134:0/3060768576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc0ff2c0 msgr2=0x7f3efc19ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3ef9d9b700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc0ff2c0 0x7f3efc19ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3ef9d9b700 1 -- 172.21.15.134:0/3060768576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0095f0 con 0x7f3efc0ffc60 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3ef9d9b700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0ffc60 0x7f3efc19bf60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00bd70 tx=0x7f3eec00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3ef37fe700 1 -- 172.21.15.134:0/3060768576 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eec01d070 con 0x7f3efc0ffc60 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3ef37fe700 1 -- 172.21.15.134:0/3060768576 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3eec00f460 con 0x7f3efc0ffc60 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3f00d03700 1 -- 172.21.15.134:0/3060768576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc195d70 con 0x7f3efc0ffc60 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3ef37fe700 1 -- 172.21.15.134:0/3060768576 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eec021640 con 0x7f3efc0ffc60 2024-04-13T11:09:25.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.160+0000 7f3f00d03700 1 -- 172.21.15.134:0/3060768576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc196260 con 0x7f3efc0ffc60 2024-04-13T11:09:25.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.161+0000 7f3f00d03700 1 -- 172.21.15.134:0/3060768576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc108640 con 0x7f3efc0ffc60 2024-04-13T11:09:25.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.162+0000 7f3ef37fe700 1 -- 172.21.15.134:0/3060768576 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3eec00f9e0 con 0x7f3efc0ffc60 2024-04-13T11:09:25.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.162+0000 7f3ef37fe700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3ee806cce0 0x7f3ee806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:25.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.162+0000 7f3efa59c700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3ee806cce0 0x7f3ee806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:25.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.162+0000 7f3ef37fe700 1 -- 172.21.15.134:0/3060768576 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f3eec08d780 con 0x7f3efc0ffc60 2024-04-13T11:09:25.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.163+0000 7f3efa59c700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3ee806cce0 0x7f3ee806f190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4005950 tx=0x7f3ee400b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:09:25.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.167+0000 7f3ef37fe700 1 -- 172.21.15.134:0/3060768576 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f3eec05b1b0 con 0x7f3efc0ffc60 2024-04-13T11:09:25.384 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.383+0000 7f3f00d03700 1 -- 172.21.15.134:0/3060768576 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3efc02ccf0 con 0x7f3ee806cce0 2024-04-13T11:09:25.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.384+0000 7f3ef37fe700 1 -- 172.21.15.134:0/3060768576 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f3efc02ccf0 con 0x7f3ee806cce0 2024-04-13T11:09:25.385 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:09:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": null, 2024-04-13T11:09:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": false, 2024-04-13T11:09:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "", 2024-04-13T11:09:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-04-13T11:09:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": null, 2024-04-13T11:09:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-04-13T11:09:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-04-13T11:09:25.385 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:09:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 -- 172.21.15.134:0/3060768576 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3ee806cce0 msgr2=0x7f3ee806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3ee806cce0 0x7f3ee806f190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4005950 tx=0x7f3ee400b410 comp rx=0 tx=0).stop 2024-04-13T11:09:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 -- 172.21.15.134:0/3060768576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0ffc60 msgr2=0x7f3efc19bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0ffc60 0x7f3efc19bf60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00bd70 tx=0x7f3eec00bda0 comp rx=0 tx=0).stop 2024-04-13T11:09:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 -- 172.21.15.134:0/3060768576 shutdown_connections 2024-04-13T11:09:25.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3ee806cce0 0x7f3ee806f190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:25.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3efc0ff2c0 0x7f3efc19ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:25.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 --2- 172.21.15.134:0/3060768576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0ffc60 0x7f3efc19bf60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:25.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 -- 172.21.15.134:0/3060768576 >> 172.21.15.134:0/3060768576 conn(0x7f3efc0fab80 msgr2=0x7f3efc068fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:09:25.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 -- 172.21.15.134:0/3060768576 shutdown_connections 2024-04-13T11:09:25.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:25.387+0000 7f3f00d03700 1 -- 172.21.15.134:0/3060768576 wait complete. 2024-04-13T11:09:25.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:25 smithi134 ceph-mon[112184]: pgmap v339: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:25.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:25 smithi194 ceph-mon[83053]: pgmap v339: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:26.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:26 smithi134 ceph-mon[112184]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:09:26.350 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph health detail' 2024-04-13T11:09:26.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:26 smithi194 ceph-mon[83053]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:09:26.581 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:09:27.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:27 smithi134 ceph-mon[112184]: pgmap v340: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:27 smithi194 ceph-mon[83053]: pgmap v340: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.662+0000 7f327c64d700 1 -- 172.21.15.134:0/2883213502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740ffc60 msgr2=0x7f3274103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.662+0000 7f327c64d700 1 --2- 172.21.15.134:0/2883213502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740ffc60 0x7f3274103c30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3264009910 tx=0x7f3264009c20 comp rx=0 tx=0).stop 2024-04-13T11:09:28.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.662+0000 7f327c64d700 1 -- 172.21.15.134:0/2883213502 shutdown_connections 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.662+0000 7f327c64d700 1 --2- 172.21.15.134:0/2883213502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740ffc60 0x7f3274103c30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.662+0000 7f327c64d700 1 --2- 172.21.15.134:0/2883213502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff2c0 0x7f32740ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.662+0000 7f327c64d700 1 -- 172.21.15.134:0/2883213502 >> 172.21.15.134:0/2883213502 conn(0x7f32740fab80 msgr2=0x7f32740fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.662+0000 7f327c64d700 1 -- 172.21.15.134:0/2883213502 shutdown_connections 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.662+0000 7f327c64d700 1 -- 172.21.15.134:0/2883213502 wait complete. 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f327c64d700 1 Processor -- start 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f327c64d700 1 -- start start 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f327c64d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff2c0 0x7f32741948e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f327c64d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740ffc60 0x7f3274194e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f327c64d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3274195360 con 0x7f32740ffc60 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f327c64d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32741954d0 con 0x7f32740ff2c0 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f3279be8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740ffc60 0x7f3274194e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:28.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f3279be8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740ffc60 0x7f3274194e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38860/0 (socket says 172.21.15.134:38860) 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f3279be8700 1 -- 172.21.15.134:0/1769787519 learned_addr learned my addr 172.21.15.134:0/1769787519 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f327a3e9700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff2c0 0x7f32741948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f3279be8700 1 -- 172.21.15.134:0/1769787519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff2c0 msgr2=0x7f32741948e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f3279be8700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff2c0 0x7f32741948e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f3279be8700 1 -- 172.21.15.134:0/1769787519 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640095f0 con 0x7f32740ffc60 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f327a3e9700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff2c0 0x7f32741948e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f3279be8700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740ffc60 0x7f3274194e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f32640092e0 tx=0x7f326400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f326b7fe700 1 -- 172.21.15.134:0/1769787519 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f326401d070 con 0x7f32740ffc60 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f326b7fe700 1 -- 172.21.15.134:0/1769787519 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f326400f460 con 0x7f32740ffc60 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f327c64d700 1 -- 172.21.15.134:0/1769787519 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3274195750 con 0x7f32740ffc60 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.663+0000 7f326b7fe700 1 -- 172.21.15.134:0/1769787519 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3264021600 con 0x7f32740ffc60 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.664+0000 7f327c64d700 1 -- 172.21.15.134:0/1769787519 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32741a21d0 con 0x7f32740ffc60 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.664+0000 7f327c64d700 1 -- 172.21.15.134:0/1769787519 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3274107630 con 0x7f32740ffc60 2024-04-13T11:09:28.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.665+0000 7f326b7fe700 1 -- 172.21.15.134:0/1769787519 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f326400f5d0 con 0x7f32740ffc60 2024-04-13T11:09:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.665+0000 7f326b7fe700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f326006cce0 0x7f326006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.665+0000 7f326b7fe700 1 -- 172.21.15.134:0/1769787519 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f326408d6d0 con 0x7f32740ffc60 2024-04-13T11:09:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.665+0000 7f327a3e9700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f326006cce0 0x7f326006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.666+0000 7f327a3e9700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f326006cce0 0x7f326006f190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3270005950 tx=0x7f3270005f50 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:09:28.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.670+0000 7f326b7fe700 1 -- 172.21.15.134:0/1769787519 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f326405b100 con 0x7f32740ffc60 2024-04-13T11:09:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.944+0000 7f327c64d700 1 -- 172.21.15.134:0/1769787519 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f327404ea50 con 0x7f32740ffc60 2024-04-13T11:09:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.944+0000 7f326b7fe700 1 -- 172.21.15.134:0/1769787519 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f326405ac90 con 0x7f32740ffc60 2024-04-13T11:09:28.944 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:09:28.945 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-13T11:09:28.945 INFO:teuthology.orchestra.run.smithi134.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-13T11:09:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.946+0000 7f327c64d700 1 -- 172.21.15.134:0/1769787519 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f326006cce0 msgr2=0x7f326006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.946+0000 7f327c64d700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f326006cce0 0x7f326006f190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3270005950 tx=0x7f3270005f50 comp rx=0 tx=0).stop 2024-04-13T11:09:28.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.946+0000 7f327c64d700 1 -- 172.21.15.134:0/1769787519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740ffc60 msgr2=0x7f3274194e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.946+0000 7f327c64d700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740ffc60 0x7f3274194e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f32640092e0 tx=0x7f326400be20 comp rx=0 tx=0).stop 2024-04-13T11:09:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.946+0000 7f327c64d700 1 -- 172.21.15.134:0/1769787519 shutdown_connections 2024-04-13T11:09:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.946+0000 7f327c64d700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f326006cce0 0x7f326006f190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.946+0000 7f327c64d700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32740ff2c0 0x7f32741948e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.946+0000 7f327c64d700 1 --2- 172.21.15.134:0/1769787519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32740ffc60 0x7f3274194e20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.946+0000 7f327c64d700 1 -- 172.21.15.134:0/1769787519 >> 172.21.15.134:0/1769787519 conn(0x7f32740fab80 msgr2=0x7f32740fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:09:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.947+0000 7f327c64d700 1 -- 172.21.15.134:0/1769787519 shutdown_connections 2024-04-13T11:09:28.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:28.947+0000 7f327c64d700 1 -- 172.21.15.134:0/1769787519 wait complete. 2024-04-13T11:09:29.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:29 smithi134 ceph-mon[112184]: pgmap v341: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:29.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:29 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1769787519' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:09:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:29 smithi194 ceph-mon[83053]: pgmap v341: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:29 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1769787519' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-13T11:09:29.689 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph versions' 2024-04-13T11:09:29.919 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:09:31.307 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:31 smithi134 ceph-mon[112184]: pgmap v342: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:31.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:31 smithi194 ceph-mon[83053]: pgmap v342: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:31.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.875+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1606270574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d80ff320 msgr2=0x7fa6d80ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:31.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.875+0000 7fa6df7ec700 1 --2- 172.21.15.134:0/1606270574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d80ff320 0x7fa6d80ff6f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009940 tx=0x7fa6c8009c50 comp rx=0 tx=0).stop 2024-04-13T11:09:31.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.875+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1606270574 shutdown_connections 2024-04-13T11:09:31.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.875+0000 7fa6df7ec700 1 --2- 172.21.15.134:0/1606270574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ffc30 0x7fa6d810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:31.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.875+0000 7fa6df7ec700 1 --2- 172.21.15.134:0/1606270574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d80ff320 0x7fa6d80ff6f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:31.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.875+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1606270574 >> 172.21.15.134:0/1606270574 conn(0x7fa6d80748b0 msgr2=0x7fa6d8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:09:31.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.875+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1606270574 shutdown_connections 2024-04-13T11:09:31.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.875+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1606270574 wait complete. 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6df7ec700 1 Processor -- start 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6df7ec700 1 -- start start 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6df7ec700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d80ff320 0x7fa6d819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6df7ec700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ffc30 0x7fa6d819bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6df7ec700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d819c5b0 con 0x7fa6d80ff320 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6df7ec700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8195a60 con 0x7fa6d80ffc30 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6dd588700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d80ff320 0x7fa6d819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6dd588700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d80ff320 0x7fa6d819b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58352/0 (socket says 172.21.15.134:58352) 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6dd588700 1 -- 172.21.15.134:0/1668169108 learned_addr learned my addr 172.21.15.134:0/1668169108 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6dcd87700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ffc30 0x7fa6d819bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6dd588700 1 -- 172.21.15.134:0/1668169108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ffc30 msgr2=0x7fa6d819bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6dd588700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ffc30 0x7fa6d819bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:31.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6dd588700 1 -- 172.21.15.134:0/1668169108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80095f0 con 0x7fa6d80ff320 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6dd588700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d80ff320 0x7fa6d819b9e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800b580 tx=0x7fa6c80055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6ce7fc700 1 -- 172.21.15.134:0/1668169108 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6c801d070 con 0x7fa6d80ff320 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6ce7fc700 1 -- 172.21.15.134:0/1668169108 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa6c800bea0 con 0x7fa6d80ff320 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6ce7fc700 1 -- 172.21.15.134:0/1668169108 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6c8021410 con 0x7fa6d80ff320 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.876+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1668169108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d8195d40 con 0x7fa6d80ff320 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.877+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1668169108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d8196240 con 0x7fa6d80ff320 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.877+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1668169108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d8107da0 con 0x7fa6d80ff320 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.878+0000 7fa6ce7fc700 1 -- 172.21.15.134:0/1668169108 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa6c800f6f0 con 0x7fa6d80ff320 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.878+0000 7fa6ce7fc700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa6c406cce0 0x7fa6c406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.878+0000 7fa6ce7fc700 1 -- 172.21.15.134:0/1668169108 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fa6c808d7e0 con 0x7fa6d80ff320 2024-04-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.878+0000 7fa6dcd87700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa6c406cce0 0x7fa6c406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:09:31.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.879+0000 7fa6dcd87700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa6c406cce0 0x7fa6c406f190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80fdf50 tx=0x7fa6d400b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:09:31.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:31.883+0000 7fa6ce7fc700 1 -- 172.21.15.134:0/1668169108 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fa6c805b2d0 con 0x7fa6d80ff320 2024-04-13T11:09:32.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.159+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1668169108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa6d8196510 con 0x7fa6d80ff320 2024-04-13T11:09:32.159 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.160+0000 7fa6ce7fc700 1 -- 172.21.15.134:0/1668169108 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fa6c805ae60 con 0x7fa6d80ff320 2024-04-13T11:09:32.160 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:09:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:09:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:09:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:09:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:09:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:09:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:09:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:09:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 6 2024-04-13T11:09:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:09:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:09:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 4 2024-04-13T11:09:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:09:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:09:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 14 2024-04-13T11:09:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:09:32.161 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:09:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1668169108 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa6c406cce0 msgr2=0x7fa6c406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa6c406cce0 0x7fa6c406f190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80fdf50 tx=0x7fa6d400b410 comp rx=0 tx=0).stop 2024-04-13T11:09:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1668169108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d80ff320 msgr2=0x7fa6d819b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:09:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d80ff320 0x7fa6d819b9e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800b580 tx=0x7fa6c80055f0 comp rx=0 tx=0).stop 2024-04-13T11:09:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1668169108 shutdown_connections 2024-04-13T11:09:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa6c406cce0 0x7fa6c406f190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6d80ff320 0x7fa6d819b9e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 --2- 172.21.15.134:0/1668169108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d80ffc30 0x7fa6d819bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:09:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1668169108 >> 172.21.15.134:0/1668169108 conn(0x7fa6d80748b0 msgr2=0x7fa6d8104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:09:32.162 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1668169108 shutdown_connections 2024-04-13T11:09:32.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:09:32.162+0000 7fa6df7ec700 1 -- 172.21.15.134:0/1668169108 wait complete. 2024-04-13T11:09:33.002 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-13T11:09:33.235 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:09:33.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:33 smithi134 ceph-mon[112184]: pgmap v343: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:33.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:33 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1668169108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:09:33.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:33 smithi194 ceph-mon[83053]: pgmap v343: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:33.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:33 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1668169108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:09:35.169 INFO:teuthology.orchestra.run.smithi134.stdout:wait for servicemap items w/ changing names to refresh 2024-04-13T11:09:35.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:35 smithi134 ceph-mon[112184]: pgmap v344: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:35 smithi194 ceph-mon[83053]: pgmap v344: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:35.946 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'sleep 60' 2024-04-13T11:09:36.180 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:09:37.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:37 smithi194 ceph-mon[83053]: pgmap v345: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:37.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:37 smithi134 ceph-mon[112184]: pgmap v345: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:38.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:09:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:09:39.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:39 smithi134 ceph-mon[112184]: pgmap v346: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:39.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:39 smithi194 ceph-mon[83053]: pgmap v346: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:41.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:41 smithi134 ceph-mon[112184]: pgmap v347: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:41 smithi194 ceph-mon[83053]: pgmap v347: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:43.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:43 smithi134 ceph-mon[112184]: pgmap v348: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:43.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:43 smithi194 ceph-mon[83053]: pgmap v348: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:45.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:45 smithi134 ceph-mon[112184]: pgmap v349: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:45 smithi194 ceph-mon[83053]: pgmap v349: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:47.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:47 smithi194 ceph-mon[83053]: pgmap v350: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:47.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:47 smithi134 ceph-mon[112184]: pgmap v350: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:49.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:49 smithi134 ceph-mon[112184]: pgmap v351: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:49 smithi194 ceph-mon[83053]: pgmap v351: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:51.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:51 smithi134 ceph-mon[112184]: pgmap v352: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:51.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:51 smithi194 ceph-mon[83053]: pgmap v352: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:53.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:53 smithi134 ceph-mon[112184]: pgmap v353: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:53.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:09:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:53 smithi194 ceph-mon[83053]: pgmap v353: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:09:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:09:55.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:55 smithi134 ceph-mon[112184]: pgmap v354: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:55 smithi194 ceph-mon[83053]: pgmap v354: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:57.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:57 smithi134 ceph-mon[112184]: pgmap v355: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:57 smithi194 ceph-mon[83053]: pgmap v355: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:09:58.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:09:58.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:09:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:09:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:09:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:09:58.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:58 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:09:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:09:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:09:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:09:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:09:58.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:09:58.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:58 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:09:59.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:09:59 smithi194 ceph-mon[83053]: pgmap v356: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:00.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:09:59 smithi134 ceph-mon[112184]: pgmap v356: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:00.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:00 smithi194 ceph-mon[83053]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:10:01.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:00 smithi134 ceph-mon[112184]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-13T11:10:01.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:01 smithi194 ceph-mon[83053]: pgmap v357: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:02.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:01 smithi134 ceph-mon[112184]: pgmap v357: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:03.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:02 smithi134 ceph-mon[112184]: pgmap v358: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:02 smithi194 ceph-mon[83053]: pgmap v358: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:05.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:05 smithi134 ceph-mon[112184]: pgmap v359: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:05 smithi194 ceph-mon[83053]: pgmap v359: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:07.373 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:07 smithi134 ceph-mon[112184]: pgmap v360: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:07.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:07 smithi194 ceph-mon[83053]: pgmap v360: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:08.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:10:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:10:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:09 smithi134 ceph-mon[112184]: pgmap v361: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:09 smithi194 ceph-mon[83053]: pgmap v361: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:11.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:11 smithi134 ceph-mon[112184]: pgmap v362: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:11.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:11 smithi194 ceph-mon[83053]: pgmap v362: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:13 smithi134 ceph-mon[112184]: pgmap v363: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:13 smithi194 ceph-mon[83053]: pgmap v363: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:15.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:15 smithi134 ceph-mon[112184]: pgmap v364: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:15 smithi194 ceph-mon[83053]: pgmap v364: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:17.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:17 smithi134 ceph-mon[112184]: pgmap v365: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:17 smithi194 ceph-mon[83053]: pgmap v365: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:19.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:19 smithi134 ceph-mon[112184]: pgmap v366: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:19 smithi194 ceph-mon[83053]: pgmap v366: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:21.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:21 smithi134 ceph-mon[112184]: pgmap v367: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:21.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:21 smithi194 ceph-mon[83053]: pgmap v367: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:23.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:23 smithi134 ceph-mon[112184]: pgmap v368: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:10:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:23 smithi194 ceph-mon[83053]: pgmap v368: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:10:25.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:25 smithi134 ceph-mon[112184]: pgmap v369: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:25.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:25 smithi194 ceph-mon[83053]: pgmap v369: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:27.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:27 smithi134 ceph-mon[112184]: pgmap v370: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:27 smithi194 ceph-mon[83053]: pgmap v370: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:29.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:29 smithi134 ceph-mon[112184]: pgmap v371: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:29 smithi194 ceph-mon[83053]: pgmap v371: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:31.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:31 smithi134 ceph-mon[112184]: pgmap v372: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:31.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:31 smithi194 ceph-mon[83053]: pgmap v372: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:33.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:33 smithi134 ceph-mon[112184]: pgmap v373: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:33.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:33 smithi194 ceph-mon[83053]: pgmap v373: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:35.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:35 smithi134 ceph-mon[112184]: pgmap v374: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:35 smithi194 ceph-mon[83053]: pgmap v374: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:37.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:37 smithi134 ceph-mon[112184]: pgmap v375: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:37.453 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:37 smithi194 ceph-mon[83053]: pgmap v375: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:38.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:10:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:10:38.896 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph orch ps' 2024-04-13T11:10:39.132 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:10:39.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:39 smithi134 ceph-mon[112184]: pgmap v376: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:39.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:39 smithi194 ceph-mon[83053]: pgmap v376: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:41.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.192+0000 7f50af9f1700 1 -- 172.21.15.134:0/2518730408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50a80ff2e0 msgr2=0x7f50a80ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:41.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.192+0000 7f50af9f1700 1 --2- 172.21.15.134:0/2518730408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50a80ff2e0 0x7f50a80ff6b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009910 tx=0x7f50a4009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:41.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.192+0000 7f50af9f1700 1 -- 172.21.15.134:0/2518730408 shutdown_connections 2024-04-13T11:10:41.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.192+0000 7f50af9f1700 1 --2- 172.21.15.134:0/2518730408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a80ffc80 0x7f50a8103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:41.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.192+0000 7f50af9f1700 1 --2- 172.21.15.134:0/2518730408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50a80ff2e0 0x7f50a80ff6b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:41.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.192+0000 7f50af9f1700 1 -- 172.21.15.134:0/2518730408 >> 172.21.15.134:0/2518730408 conn(0x7f50a80fab80 msgr2=0x7f50a80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:41.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.192+0000 7f50af9f1700 1 -- 172.21.15.134:0/2518730408 shutdown_connections 2024-04-13T11:10:41.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.192+0000 7f50af9f1700 1 -- 172.21.15.134:0/2518730408 wait complete. 2024-04-13T11:10:41.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.192+0000 7f50af9f1700 1 Processor -- start 2024-04-13T11:10:41.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.192+0000 7f50af9f1700 1 -- start start 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50af9f1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50a80ff2e0 0x7f50a8196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50af9f1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a80ffc80 0x7f50a8197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50af9f1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8197630 con 0x7f50a80ff2e0 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50af9f1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8197770 con 0x7f50a80ffc80 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50ad78d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50a80ff2e0 0x7f50a8196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50ad78d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50a80ff2e0 0x7f50a8196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33950/0 (socket says 172.21.15.134:33950) 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50ad78d700 1 -- 172.21.15.134:0/365137172 learned_addr learned my addr 172.21.15.134:0/365137172 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50acf8c700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a80ffc80 0x7f50a8197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50ad78d700 1 -- 172.21.15.134:0/365137172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a80ffc80 msgr2=0x7f50a8197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50ad78d700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a80ffc80 0x7f50a8197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50ad78d700 1 -- 172.21.15.134:0/365137172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40095f0 con 0x7f50a80ff2e0 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50acf8c700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a80ffc80 0x7f50a8197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50ad78d700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50a80ff2e0 0x7f50a8196ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f50a4006010 tx=0x7f50a400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f509e7fc700 1 -- 172.21.15.134:0/365137172 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50a401d070 con 0x7f50a80ff2e0 2024-04-13T11:10:41.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f509e7fc700 1 -- 172.21.15.134:0/365137172 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f50a400f460 con 0x7f50a80ff2e0 2024-04-13T11:10:41.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50af9f1700 1 -- 172.21.15.134:0/365137172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a819fb40 con 0x7f50a80ff2e0 2024-04-13T11:10:41.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f509e7fc700 1 -- 172.21.15.134:0/365137172 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50a4021640 con 0x7f50a80ff2e0 2024-04-13T11:10:41.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.193+0000 7f50af9f1700 1 -- 172.21.15.134:0/365137172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a819ff50 con 0x7f50a80ff2e0 2024-04-13T11:10:41.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.194+0000 7f50af9f1700 1 -- 172.21.15.134:0/365137172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a81075f0 con 0x7f50a80ff2e0 2024-04-13T11:10:41.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.195+0000 7f509e7fc700 1 -- 172.21.15.134:0/365137172 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f50a400f9e0 con 0x7f50a80ff2e0 2024-04-13T11:10:41.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.195+0000 7f509e7fc700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f509406cce0 0x7f509406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:41.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.195+0000 7f509e7fc700 1 -- 172.21.15.134:0/365137172 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f50a408d9d0 con 0x7f50a80ff2e0 2024-04-13T11:10:41.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.195+0000 7f50acf8c700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f509406cce0 0x7f509406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:41.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.196+0000 7f50acf8c700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f509406cce0 0x7f509406f190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5098005fd0 tx=0x7f5098005de0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:41.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.200+0000 7f509e7fc700 1 -- 172.21.15.134:0/365137172 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f50a4057970 con 0x7f50a80ff2e0 2024-04-13T11:10:41.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.404+0000 7f50af9f1700 1 -- 172.21.15.134:0/365137172 --> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f50a802cca0 con 0x7f509406cce0 2024-04-13T11:10:41.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.414+0000 7f509e7fc700 1 -- 172.21.15.134:0/365137172 <== mgr.14668 v2:172.21.15.134:6800/4065241196 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f50a802cca0 con 0x7f509406cce0 2024-04-13T11:10:41.415 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-13T11:10:41.415 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (9m) 110s ago 20m 26.4M - 0.25.0 c8568f914cd2 5d3efe9d1454 2024-04-13T11:10:41.415 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi134 smithi134 running (2m) 110s ago 21m 7046k - 18.2.2-1173-g5108bc67 3464fd31103e d15a22ad7e4b 2024-04-13T11:10:41.415 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-exporter.smithi194 smithi194 running (115s) 112s ago 20m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 28b8fa73679a 2024-04-13T11:10:41.415 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (7m) 110s ago 21m 6647k - 18.2.2-1173-g5108bc67 3464fd31103e 45bc0d8c0ea7 2024-04-13T11:10:41.415 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi194 smithi194 running (7m) 112s ago 20m 6656k - 18.2.2-1173-g5108bc67 3464fd31103e 871083c784c7 2024-04-13T11:10:41.415 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (9m) 110s ago 20m 88.2M - 9.4.7 954c08fa6188 87c206ab1c50 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.hxpcfx smithi134 running (3m) 110s ago 14m 84.7M - 18.2.2-1173-g5108bc67 3464fd31103e ed96357b7f55 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.kachce smithi134 running (3m) 110s ago 14m 155M - 18.2.2-1173-g5108bc67 3464fd31103e 2bdb75429769 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.svyrny smithi194 running (2m) 112s ago 14m 14.7M - 18.2.2-1173-g5108bc67 3464fd31103e f47b63e9c1d0 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi194.wnddvg smithi194 running (2m) 112s ago 14m 16.0M - 18.2.2-1173-g5108bc67 3464fd31103e 0fc2b64fc3ed 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.tmanda smithi134 *:8443,9283,8765 running (12m) 110s ago 22m 512M - 18.2.2-1173-g5108bc67 3464fd31103e 2792490b4186 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi194.tcpynt smithi194 *:8443,9283,8765 running (10m) 112s ago 19m 454M - 18.2.2-1173-g5108bc67 3464fd31103e 996cb11166e0 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (7m) 110s ago 22m 55.7M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 1cfd91f5cdea 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi194 smithi194 running (7m) 112s ago 19m 45.0M 2048M 18.2.2-1173-g5108bc67 3464fd31103e 90c450150c9c 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (10m) 110s ago 21m 18.6M - 1.5.0 0da6a335fe13 80d568427aa4 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi194 smithi194 *:9100 running (10m) 112s ago 19m 16.8M - 1.5.0 0da6a335fe13 16113fc0d4f5 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (6m) 110s ago 18m 112M 1227M 18.2.2-1173-g5108bc67 3464fd31103e c27312e25d54 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (6m) 110s ago 18m 102M 1227M 18.2.2-1173-g5108bc67 3464fd31103e fc8474d8910f 2024-04-13T11:10:41.416 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (5m) 110s ago 17m 107M 1227M 18.2.2-1173-g5108bc67 3464fd31103e b24ce165bc9f 2024-04-13T11:10:41.417 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi194 running (5m) 112s ago 17m 135M 2251M 18.2.2-1173-g5108bc67 3464fd31103e d909c0e8d077 2024-04-13T11:10:41.417 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi194 running (4m) 112s ago 17m 104M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 7f721487a63b 2024-04-13T11:10:41.417 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi194 running (3m) 112s ago 16m 91.2M 2251M 18.2.2-1173-g5108bc67 3464fd31103e 1c4a65aaf413 2024-04-13T11:10:41.417 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (9m) 110s ago 20m 67.9M - 2.43.0 a07b618ecd1d 4cb2998599c3 2024-04-13T11:10:41.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 -- 172.21.15.134:0/365137172 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f509406cce0 msgr2=0x7f509406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:41.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f509406cce0 0x7f509406f190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5098005fd0 tx=0x7f5098005de0 comp rx=0 tx=0).stop 2024-04-13T11:10:41.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 -- 172.21.15.134:0/365137172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50a80ff2e0 msgr2=0x7f50a8196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:41.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50a80ff2e0 0x7f50a8196ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f50a4006010 tx=0x7f50a400be20 comp rx=0 tx=0).stop 2024-04-13T11:10:41.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 -- 172.21.15.134:0/365137172 shutdown_connections 2024-04-13T11:10:41.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f509406cce0 0x7f509406f190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:41.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50a80ff2e0 0x7f50a8196ad0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:41.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 --2- 172.21.15.134:0/365137172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a80ffc80 0x7f50a8197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:41.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 -- 172.21.15.134:0/365137172 >> 172.21.15.134:0/365137172 conn(0x7f50a80fab80 msgr2=0x7f50a80fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:41.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 -- 172.21.15.134:0/365137172 shutdown_connections 2024-04-13T11:10:41.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:41.416+0000 7f50af9f1700 1 -- 172.21.15.134:0/365137172 wait complete. 2024-04-13T11:10:41.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:41 smithi134 ceph-mon[112184]: pgmap v377: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:41 smithi194 ceph-mon[83053]: pgmap v377: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:42.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph versions' 2024-04-13T11:10:42.381 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:10:42.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:42 smithi134 ceph-mon[112184]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:10:42.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:42 smithi194 ceph-mon[83053]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-13T11:10:43.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:43 smithi134 ceph-mon[112184]: pgmap v378: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:43.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:43 smithi194 ceph-mon[83053]: pgmap v378: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.619+0000 7fc34f9aa700 1 -- 172.21.15.134:0/2461380921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3480ff320 msgr2=0x7fc3480ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.619+0000 7fc34f9aa700 1 --2- 172.21.15.134:0/2461380921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3480ff320 0x7fc3480ff6f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc344009940 tx=0x7fc344009c50 comp rx=0 tx=0).stop 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 -- 172.21.15.134:0/2461380921 shutdown_connections 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 --2- 172.21.15.134:0/2461380921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3480ffc30 0x7fc34810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 --2- 172.21.15.134:0/2461380921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3480ff320 0x7fc3480ff6f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 -- 172.21.15.134:0/2461380921 >> 172.21.15.134:0/2461380921 conn(0x7fc3480748b0 msgr2=0x7fc348074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 -- 172.21.15.134:0/2461380921 shutdown_connections 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 -- 172.21.15.134:0/2461380921 wait complete. 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 Processor -- start 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 -- start start 2024-04-13T11:10:44.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3480ff320 0x7fc348100500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3480ffc30 0x7fc348100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc348100f80 con 0x7fc3480ff320 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.620+0000 7fc34f9aa700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3481010c0 con 0x7fc3480ffc30 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc34d746700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3480ff320 0x7fc348100500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc34d746700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3480ff320 0x7fc348100500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33966/0 (socket says 172.21.15.134:33966) 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc34d746700 1 -- 172.21.15.134:0/1122774883 learned_addr learned my addr 172.21.15.134:0/1122774883 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc34d746700 1 -- 172.21.15.134:0/1122774883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3480ffc30 msgr2=0x7fc348100a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc34d746700 1 --2- 172.21.15.134:0/1122774883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3480ffc30 0x7fc348100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc34d746700 1 -- 172.21.15.134:0/1122774883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3440095f0 con 0x7fc3480ff320 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc34d746700 1 --2- 172.21.15.134:0/1122774883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3480ff320 0x7fc348100500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc344006010 tx=0x7fc3440056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:44.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc33e7fc700 1 -- 172.21.15.134:0/1122774883 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc34401d070 con 0x7fc3480ff320 2024-04-13T11:10:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc33e7fc700 1 -- 172.21.15.134:0/1122774883 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc34400bea0 con 0x7fc3480ff320 2024-04-13T11:10:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc34f9aa700 1 -- 172.21.15.134:0/1122774883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3481a1de0 con 0x7fc3480ff320 2024-04-13T11:10:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc33e7fc700 1 -- 172.21.15.134:0/1122774883 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc344021410 con 0x7fc3480ff320 2024-04-13T11:10:44.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.621+0000 7fc34f9aa700 1 -- 172.21.15.134:0/1122774883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3481a21f0 con 0x7fc3480ff320 2024-04-13T11:10:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.622+0000 7fc34f9aa700 1 -- 172.21.15.134:0/1122774883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc348107da0 con 0x7fc3480ff320 2024-04-13T11:10:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.623+0000 7fc33e7fc700 1 -- 172.21.15.134:0/1122774883 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc34400f460 con 0x7fc3480ff320 2024-04-13T11:10:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.623+0000 7fc33e7fc700 1 --2- 172.21.15.134:0/1122774883 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc33406cce0 0x7fc33406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.623+0000 7fc33e7fc700 1 -- 172.21.15.134:0/1122774883 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fc34408dcf0 con 0x7fc3480ff320 2024-04-13T11:10:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.624+0000 7fc34cf45700 1 --2- 172.21.15.134:0/1122774883 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc33406cce0 0x7fc33406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:44.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.624+0000 7fc34cf45700 1 --2- 172.21.15.134:0/1122774883 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc33406cce0 0x7fc33406f190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc338005950 tx=0x7fc3380058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:44.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.627+0000 7fc33e7fc700 1 -- 172.21.15.134:0/1122774883 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fc344057d10 con 0x7fc3480ff320 2024-04-13T11:10:44.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.903+0000 7fc34f9aa700 1 -- 172.21.15.134:0/1122774883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc34802cc60 con 0x7fc3480ff320 2024-04-13T11:10:44.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.903+0000 7fc33e7fc700 1 -- 172.21.15.134:0/1122774883 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fc34405b330 con 0x7fc3480ff320 2024-04-13T11:10:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-13T11:10:44.904 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-04-13T11:10:44.904 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:10:44.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:10:44.904 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 2 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 6 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 4 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)": 14 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-13T11:10:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-13T11:10:44.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 -- 172.21.15.134:0/1122774883 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc33406cce0 msgr2=0x7fc33406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:44.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 --2- 172.21.15.134:0/1122774883 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc33406cce0 0x7fc33406f190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc338005950 tx=0x7fc3380058e0 comp rx=0 tx=0).stop 2024-04-13T11:10:44.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 -- 172.21.15.134:0/1122774883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3480ff320 msgr2=0x7fc348100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:44.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 --2- 172.21.15.134:0/1122774883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3480ff320 0x7fc348100500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc344006010 tx=0x7fc3440056a0 comp rx=0 tx=0).stop 2024-04-13T11:10:44.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 -- 172.21.15.134:0/1122774883 shutdown_connections 2024-04-13T11:10:44.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 --2- 172.21.15.134:0/1122774883 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc33406cce0 0x7fc33406f190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:44.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 --2- 172.21.15.134:0/1122774883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3480ff320 0x7fc348100500 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:44.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 --2- 172.21.15.134:0/1122774883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3480ffc30 0x7fc348100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:44.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 -- 172.21.15.134:0/1122774883 >> 172.21.15.134:0/1122774883 conn(0x7fc3480748b0 msgr2=0x7fc348104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:44.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 -- 172.21.15.134:0/1122774883 shutdown_connections 2024-04-13T11:10:44.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:44.905+0000 7fc34f9aa700 1 -- 172.21.15.134:0/1122774883 wait complete. 2024-04-13T11:10:45.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:45 smithi134 ceph-mon[112184]: pgmap v379: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:45.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:45 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1122774883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:10:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:45 smithi194 ceph-mon[83053]: pgmap v379: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:45 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1122774883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:10:45.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-13T11:10:45.971 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:10:47.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:47 smithi134 ceph-mon[112184]: pgmap v380: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:47.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:47 smithi194 ceph-mon[83053]: pgmap v380: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:48.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.014+0000 7fa01644b700 1 -- 172.21.15.134:0/146949239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa010101320 msgr2=0x7fa0101016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:48.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.014+0000 7fa01644b700 1 --2- 172.21.15.134:0/146949239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa010101320 0x7fa0101016f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa000009910 tx=0x7fa000009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.014+0000 7fa01644b700 1 -- 172.21.15.134:0/146949239 shutdown_connections 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.014+0000 7fa01644b700 1 --2- 172.21.15.134:0/146949239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa010101c30 0x7fa01010a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.014+0000 7fa01644b700 1 --2- 172.21.15.134:0/146949239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa010101320 0x7fa0101016f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.014+0000 7fa01644b700 1 -- 172.21.15.134:0/146949239 >> 172.21.15.134:0/146949239 conn(0x7fa0100fab80 msgr2=0x7fa0100fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.014+0000 7fa01644b700 1 -- 172.21.15.134:0/146949239 shutdown_connections 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.014+0000 7fa01644b700 1 -- 172.21.15.134:0/146949239 wait complete. 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa01644b700 1 Processor -- start 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa01644b700 1 -- start start 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa01644b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa010101320 0x7fa01019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa01644b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa010101c30 0x7fa01019bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:48.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa01644b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01019c610 con 0x7fa010101320 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa01644b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010195ac0 con 0x7fa010101c30 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa00ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa010101320 0x7fa01019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa00ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa010101320 0x7fa01019ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33986/0 (socket says 172.21.15.134:33986) 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa00ffff700 1 -- 172.21.15.134:0/1078971887 learned_addr learned my addr 172.21.15.134:0/1078971887 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa00f7fe700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa010101c30 0x7fa01019bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa00ffff700 1 -- 172.21.15.134:0/1078971887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa010101c30 msgr2=0x7fa01019bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa00ffff700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa010101c30 0x7fa01019bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.015+0000 7fa00ffff700 1 -- 172.21.15.134:0/1078971887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0000095f0 con 0x7fa010101320 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.016+0000 7fa00ffff700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa010101320 0x7fa01019ba40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa000006010 tx=0x7fa00000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.016+0000 7fa00d7fa700 1 -- 172.21.15.134:0/1078971887 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa00001d070 con 0x7fa010101320 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.016+0000 7fa00d7fa700 1 -- 172.21.15.134:0/1078971887 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa00000f460 con 0x7fa010101320 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.016+0000 7fa01644b700 1 -- 172.21.15.134:0/1078971887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa010195d40 con 0x7fa010101320 2024-04-13T11:10:48.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.016+0000 7fa00d7fa700 1 -- 172.21.15.134:0/1078971887 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa000021640 con 0x7fa010101320 2024-04-13T11:10:48.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.016+0000 7fa01644b700 1 -- 172.21.15.134:0/1078971887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa010196230 con 0x7fa010101320 2024-04-13T11:10:48.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.017+0000 7fa01644b700 1 -- 172.21.15.134:0/1078971887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa010107800 con 0x7fa010101320 2024-04-13T11:10:48.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.017+0000 7fa00d7fa700 1 -- 172.21.15.134:0/1078971887 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa00000f9e0 con 0x7fa010101320 2024-04-13T11:10:48.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.018+0000 7fa00d7fa700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9ff806cce0 0x7f9ff806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:48.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.018+0000 7fa00d7fa700 1 -- 172.21.15.134:0/1078971887 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fa00008da40 con 0x7fa010101320 2024-04-13T11:10:48.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.018+0000 7fa00f7fe700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9ff806cce0 0x7f9ff806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:48.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.018+0000 7fa00f7fe700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9ff806cce0 0x7f9ff806f190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa0100fc2e0 tx=0x7fa004005cf0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:48.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.022+0000 7fa00d7fa700 1 -- 172.21.15.134:0/1078971887 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fa00005b470 con 0x7fa010101320 2024-04-13T11:10:48.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.300+0000 7fa01644b700 1 -- 172.21.15.134:0/1078971887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0101071e0 con 0x7fa010101320 2024-04-13T11:10:48.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.300+0000 7fa00d7fa700 1 -- 172.21.15.134:0/1078971887 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fa00005b000 con 0x7fa010101320 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 -- 172.21.15.134:0/1078971887 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9ff806cce0 msgr2=0x7f9ff806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9ff806cce0 0x7f9ff806f190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa0100fc2e0 tx=0x7fa004005cf0 comp rx=0 tx=0).stop 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 -- 172.21.15.134:0/1078971887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa010101320 msgr2=0x7fa01019ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa010101320 0x7fa01019ba40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa000006010 tx=0x7fa00000be20 comp rx=0 tx=0).stop 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 -- 172.21.15.134:0/1078971887 shutdown_connections 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f9ff806cce0 0x7f9ff806f190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa010101320 0x7fa01019ba40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 --2- 172.21.15.134:0/1078971887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa010101c30 0x7fa01019bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 -- 172.21.15.134:0/1078971887 >> 172.21.15.134:0/1078971887 conn(0x7fa0100fab80 msgr2=0x7fa010104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 -- 172.21.15.134:0/1078971887 shutdown_connections 2024-04-13T11:10:48.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:48.303+0000 7fa01644b700 1 -- 172.21.15.134:0/1078971887 wait complete. 2024-04-13T11:10:48.314 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-04-13T11:10:49.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -e sha1=5108bc67b831101bc32a1061150595384640c56c -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-13T11:10:49.293 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:10:49.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:49 smithi134 ceph-mon[112184]: pgmap v381: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:49.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:49 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1078971887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:10:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:49 smithi194 ceph-mon[83053]: pgmap v381: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:49 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1078971887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:10:51.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.238+0000 7f7a44570700 1 -- 172.21.15.134:0/247068867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a3c0ff390 msgr2=0x7f7a3c0ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:51.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.238+0000 7f7a44570700 1 --2- 172.21.15.134:0/247068867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a3c0ff390 0x7f7a3c0ff760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009910 tx=0x7f7a38009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:51.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.238+0000 7f7a44570700 1 -- 172.21.15.134:0/247068867 shutdown_connections 2024-04-13T11:10:51.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.238+0000 7f7a44570700 1 --2- 172.21.15.134:0/247068867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a3c0ffd30 0x7f7a3c103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:51.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.238+0000 7f7a44570700 1 --2- 172.21.15.134:0/247068867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a3c0ff390 0x7f7a3c0ff760 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:51.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.238+0000 7f7a44570700 1 -- 172.21.15.134:0/247068867 >> 172.21.15.134:0/247068867 conn(0x7f7a3c074f50 msgr2=0x7f7a3c075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:51.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.238+0000 7f7a44570700 1 -- 172.21.15.134:0/247068867 shutdown_connections 2024-04-13T11:10:51.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.238+0000 7f7a44570700 1 -- 172.21.15.134:0/247068867 wait complete. 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a44570700 1 Processor -- start 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a44570700 1 -- start start 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a44570700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a3c0ff390 0x7f7a3c196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a44570700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a3c0ffd30 0x7f7a3c196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a44570700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c197580 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a44570700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c1976c0 con 0x7f7a3c0ff390 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a41b0b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a3c0ffd30 0x7f7a3c196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a41b0b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a3c0ffd30 0x7f7a3c196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35070/0 (socket says 172.21.15.134:35070) 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a41b0b700 1 -- 172.21.15.134:0/2358563017 learned_addr learned my addr 172.21.15.134:0/2358563017 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a4230c700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a3c0ff390 0x7f7a3c196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a41b0b700 1 -- 172.21.15.134:0/2358563017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a3c0ff390 msgr2=0x7f7a3c196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a41b0b700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a3c0ff390 0x7f7a3c196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.239+0000 7f7a41b0b700 1 -- 172.21.15.134:0/2358563017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380095f0 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.240+0000 7f7a41b0b700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a3c0ffd30 0x7f7a3c196ff0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00c960 tx=0x7f7a2c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.240+0000 7f7a337fe700 1 -- 172.21.15.134:0/2358563017 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a2c007a70 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.240+0000 7f7a337fe700 1 -- 172.21.15.134:0/2358563017 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a2c007bd0 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.240+0000 7f7a44570700 1 -- 172.21.15.134:0/2358563017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3c19fb20 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.240+0000 7f7a337fe700 1 -- 172.21.15.134:0/2358563017 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a2c018630 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.240+0000 7f7a44570700 1 -- 172.21.15.134:0/2358563017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3c19ff90 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.241+0000 7f7a44570700 1 -- 172.21.15.134:0/2358563017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3c107650 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.241+0000 7f7a337fe700 1 -- 172.21.15.134:0/2358563017 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7a2c00f9f0 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.242+0000 7f7a337fe700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f7a2806cd30 0x7f7a2806f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.242+0000 7f7a337fe700 1 -- 172.21.15.134:0/2358563017 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f7a2c08c740 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.242+0000 7f7a4230c700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f7a2806cd30 0x7f7a2806f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.242+0000 7f7a4230c700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f7a2806cd30 0x7f7a2806f1e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800b5c0 tx=0x7f7a38005fb0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:51.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.246+0000 7f7a337fe700 1 -- 172.21.15.134:0/2358563017 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f7a2c05a0d0 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:51 smithi134 ceph-mon[112184]: pgmap v382: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:51.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:51 smithi194 ceph-mon[83053]: pgmap v382: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:51.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.523+0000 7f7a44570700 1 -- 172.21.15.134:0/2358563017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7a3c04ea50 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.523+0000 7f7a337fe700 1 -- 172.21.15.134:0/2358563017 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f7a2c059c60 con 0x7f7a3c0ffd30 2024-04-13T11:10:51.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.525+0000 7f7a44570700 1 -- 172.21.15.134:0/2358563017 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f7a2806cd30 msgr2=0x7f7a2806f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:51.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.525+0000 7f7a44570700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f7a2806cd30 0x7f7a2806f1e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800b5c0 tx=0x7f7a38005fb0 comp rx=0 tx=0).stop 2024-04-13T11:10:51.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.525+0000 7f7a44570700 1 -- 172.21.15.134:0/2358563017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a3c0ffd30 msgr2=0x7f7a3c196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:51.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.525+0000 7f7a44570700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a3c0ffd30 0x7f7a3c196ff0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00c960 tx=0x7f7a2c00cd20 comp rx=0 tx=0).stop 2024-04-13T11:10:51.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.526+0000 7f7a44570700 1 -- 172.21.15.134:0/2358563017 shutdown_connections 2024-04-13T11:10:51.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.526+0000 7f7a44570700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f7a2806cd30 0x7f7a2806f1e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:51.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.526+0000 7f7a44570700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a3c0ff390 0x7f7a3c196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:51.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.526+0000 7f7a44570700 1 --2- 172.21.15.134:0/2358563017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a3c0ffd30 0x7f7a3c196ff0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:51.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.526+0000 7f7a44570700 1 -- 172.21.15.134:0/2358563017 >> 172.21.15.134:0/2358563017 conn(0x7f7a3c074f50 msgr2=0x7f7a3c0fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:51.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.526+0000 7f7a44570700 1 -- 172.21.15.134:0/2358563017 shutdown_connections 2024-04-13T11:10:51.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:51.526+0000 7f7a44570700 1 -- 172.21.15.134:0/2358563017 wait complete. 2024-04-13T11:10:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 18.2.2-1173-g5108bc67 (5108bc67b831101bc32a1061150595384640c56c) reef (stable)" 2024-04-13T11:10:52.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:52 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2358563017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:10:52.305 DEBUG:teuthology.parallel:result is None 2024-04-13T11:10:52.305 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-13T11:10:52.316 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T11:10:52.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-13T11:10:52.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:52 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2358563017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-13T11:10:52.545 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/mon.smithi134/config 2024-04-13T11:10:53.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:53 smithi134 ceph-mon[112184]: pgmap v383: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:53.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:10:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:53 smithi194 ceph-mon[83053]: pgmap v383: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:10:54.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.541+0000 7f1f24767700 1 -- 172.21.15.134:0/3265602687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f1c0ffcb0 msgr2=0x7f1f1c103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.541+0000 7f1f24767700 1 --2- 172.21.15.134:0/3265602687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f1c0ffcb0 0x7f1f1c103c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009910 tx=0x7f1f18009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.541+0000 7f1f24767700 1 -- 172.21.15.134:0/3265602687 shutdown_connections 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.541+0000 7f1f24767700 1 --2- 172.21.15.134:0/3265602687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f1c0ffcb0 0x7f1f1c103c80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.541+0000 7f1f24767700 1 --2- 172.21.15.134:0/3265602687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f1c0ff310 0x7f1f1c0ff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.541+0000 7f1f24767700 1 -- 172.21.15.134:0/3265602687 >> 172.21.15.134:0/3265602687 conn(0x7f1f1c0fabd0 msgr2=0x7f1f1c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.541+0000 7f1f24767700 1 -- 172.21.15.134:0/3265602687 shutdown_connections 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.541+0000 7f1f24767700 1 -- 172.21.15.134:0/3265602687 wait complete. 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f24767700 1 Processor -- start 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f24767700 1 -- start start 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f24767700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f1c0ff310 0x7f1f1c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f24767700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f1c0ffcb0 0x7f1f1c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:54.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f24767700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c198ba0 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f24767700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c19c930 con 0x7f1f1c0ff310 2024-04-13T11:10:54.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f21d02700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f1c0ffcb0 0x7f1f1c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:54.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f21d02700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f1c0ffcb0 0x7f1f1c1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35084/0 (socket says 172.21.15.134:35084) 2024-04-13T11:10:54.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f21d02700 1 -- 172.21.15.134:0/2967642211 learned_addr learned my addr 172.21.15.134:0/2967642211 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:54.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f22503700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f1c0ff310 0x7f1f1c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:54.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f21d02700 1 -- 172.21.15.134:0/2967642211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f1c0ff310 msgr2=0x7f1f1c197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:54.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f21d02700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f1c0ff310 0x7f1f1c197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:54.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f21d02700 1 -- 172.21.15.134:0/2967642211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f180095f0 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f22503700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f1c0ff310 0x7f1f1c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:10:54.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f21d02700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f1c0ffcb0 0x7f1f1c1984c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800bda0 tx=0x7f1f1800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:54.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.542+0000 7f1f137fe700 1 -- 172.21.15.134:0/2967642211 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f1801d070 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.543+0000 7f1f24767700 1 -- 172.21.15.134:0/2967642211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c19cbb0 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.543+0000 7f1f137fe700 1 -- 172.21.15.134:0/2967642211 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f1800f460 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.543+0000 7f1f137fe700 1 -- 172.21.15.134:0/2967642211 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f18021640 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.543+0000 7f1f24767700 1 -- 172.21.15.134:0/2967642211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c19d0a0 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.544+0000 7f1f24767700 1 -- 172.21.15.134:0/2967642211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1c04ea50 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.545+0000 7f1f137fe700 1 -- 172.21.15.134:0/2967642211 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1f1800f9d0 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.545+0000 7f1f137fe700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1f0806cce0 0x7f1f0806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:54.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.545+0000 7f1f137fe700 1 -- 172.21.15.134:0/2967642211 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f1f1808dd50 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.545+0000 7f1f22503700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1f0806cce0 0x7f1f0806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:54.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.546+0000 7f1f22503700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1f0806cce0 0x7f1f0806f190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c007900 tx=0x7f1f0c008040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:54.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.550+0000 7f1f137fe700 1 -- 172.21.15.134:0/2967642211 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f1f18057d70 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.789+0000 7f1f24767700 1 -- 172.21.15.134:0/2967642211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1f1c1992e0 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.790+0000 7f1f137fe700 1 -- 172.21.15.134:0/2967642211 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f1f1805b390 con 0x7f1f1c0ffcb0 2024-04-13T11:10:54.790 INFO:teuthology.orchestra.run.smithi134.stdout:e41 2024-04-13T11:10:54.790 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-13T11:10:54.790 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:10:54.790 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-04-13T11:10:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:54.790 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-04-13T11:10:54.790 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-04-13T11:10:54.790 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 41 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-04-13T10:55:40.674498+0000 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-04-13T11:08:56.971752+0000 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 91 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-04-13T11:10:54.791 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=34322} 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data enabled 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.hxpcfx{0:34322} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.134:6826/3173053746,v1:172.21.15.134:6827/3173053746] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.kachce{0:34354} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/3883973153,v1:172.21.15.134:6829/3883973153] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:10:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:54.793 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-04-13T11:10:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:54.793 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.wnddvg{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6824/2092944903,v1:172.21.15.194:6825/2092944903] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:10:54.793 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi194.svyrny{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.194:6826/2085856165,v1:172.21.15.194:6827/2085856165] compat {c=[1],r=[1],i=[7ff]}] 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 -- 172.21.15.134:0/2967642211 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1f0806cce0 msgr2=0x7f1f0806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1f0806cce0 0x7f1f0806f190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c007900 tx=0x7f1f0c008040 comp rx=0 tx=0).stop 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 -- 172.21.15.134:0/2967642211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f1c0ffcb0 msgr2=0x7f1f1c1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f1c0ffcb0 0x7f1f1c1984c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800bda0 tx=0x7f1f1800be80 comp rx=0 tx=0).stop 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 -- 172.21.15.134:0/2967642211 shutdown_connections 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f1f0806cce0 0x7f1f0806f190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f1c0ff310 0x7f1f1c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 --2- 172.21.15.134:0/2967642211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f1c0ffcb0 0x7f1f1c1984c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 -- 172.21.15.134:0/2967642211 >> 172.21.15.134:0/2967642211 conn(0x7f1f1c0fabd0 msgr2=0x7f1f1c069680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 -- 172.21.15.134:0/2967642211 shutdown_connections 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:54.792+0000 7f1f24767700 1 -- 172.21.15.134:0/2967642211 wait complete. 2024-04-13T11:10:54.794 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 41 2024-04-13T11:10:55.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:55 smithi134 ceph-mon[112184]: pgmap v384: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:55.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:55 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2967642211' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:10:55.444 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-13T11:10:55.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T11:10:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:55 smithi194 ceph-mon[83053]: pgmap v384: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:55.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:55 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2967642211' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-13T11:10:55.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.583+0000 7f63e1751700 1 -- 172.21.15.134:0/3687607223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63dc0ff440 msgr2=0x7f63dc0ff810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:55.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.583+0000 7f63e1751700 1 --2- 172.21.15.134:0/3687607223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63dc0ff440 0x7f63dc0ff810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009910 tx=0x7f63cc009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:55.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.583+0000 7f63e1751700 1 -- 172.21.15.134:0/3687607223 shutdown_connections 2024-04-13T11:10:55.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.583+0000 7f63e1751700 1 --2- 172.21.15.134:0/3687607223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0ffde0 0x7f63dc103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:55.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.583+0000 7f63e1751700 1 --2- 172.21.15.134:0/3687607223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63dc0ff440 0x7f63dc0ff810 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:55.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.583+0000 7f63e1751700 1 -- 172.21.15.134:0/3687607223 >> 172.21.15.134:0/3687607223 conn(0x7f63dc0facd0 msgr2=0x7f63dc0fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:55.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.583+0000 7f63e1751700 1 -- 172.21.15.134:0/3687607223 shutdown_connections 2024-04-13T11:10:55.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.583+0000 7f63e1751700 1 -- 172.21.15.134:0/3687607223 wait complete. 2024-04-13T11:10:55.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.584+0000 7f63e1751700 1 Processor -- start 2024-04-13T11:10:55.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63e1751700 1 -- start start 2024-04-13T11:10:55.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63e1751700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63dc0ff440 0x7f63dc196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63e1751700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0ffde0 0x7f63dc1970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63e1751700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc1976f0 con 0x7f63dc0ff440 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63e1751700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc197860 con 0x7f63dc0ffde0 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63daffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63dc0ff440 0x7f63dc196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63daffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63dc0ff440 0x7f63dc196b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35092/0 (socket says 172.21.15.134:35092) 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63daffd700 1 -- 172.21.15.134:0/1137236293 learned_addr learned my addr 172.21.15.134:0/1137236293 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63da7fc700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0ffde0 0x7f63dc1970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63daffd700 1 -- 172.21.15.134:0/1137236293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0ffde0 msgr2=0x7f63dc1970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63daffd700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0ffde0 0x7f63dc1970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63daffd700 1 -- 172.21.15.134:0/1137236293 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc0095f0 con 0x7f63dc0ff440 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63daffd700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63dc0ff440 0x7f63dc196b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f63cc006010 tx=0x7f63cc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63c3fff700 1 -- 172.21.15.134:0/1137236293 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63cc01d070 con 0x7f63dc0ff440 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63e1751700 1 -- 172.21.15.134:0/1137236293 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc19fc00 con 0x7f63dc0ff440 2024-04-13T11:10:55.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63c3fff700 1 -- 172.21.15.134:0/1137236293 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f63cc005710 con 0x7f63dc0ff440 2024-04-13T11:10:55.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63c3fff700 1 -- 172.21.15.134:0/1137236293 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63cc00fe20 con 0x7f63dc0ff440 2024-04-13T11:10:55.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.585+0000 7f63e1751700 1 -- 172.21.15.134:0/1137236293 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc1a0080 con 0x7f63dc0ff440 2024-04-13T11:10:55.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.586+0000 7f63e1751700 1 -- 172.21.15.134:0/1137236293 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc107740 con 0x7f63dc0ff440 2024-04-13T11:10:55.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.587+0000 7f63c3fff700 1 -- 172.21.15.134:0/1137236293 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f63cc003a60 con 0x7f63dc0ff440 2024-04-13T11:10:55.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.587+0000 7f63c3fff700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f63c406cda0 0x7f63c406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:55.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.587+0000 7f63c3fff700 1 -- 172.21.15.134:0/1137236293 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f63cc08d860 con 0x7f63dc0ff440 2024-04-13T11:10:55.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.587+0000 7f63da7fc700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f63c406cda0 0x7f63c406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:55.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.588+0000 7f63da7fc700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f63c406cda0 0x7f63c406f250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0696f0 tx=0x7f63d000b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:55.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.591+0000 7f63c3fff700 1 -- 172.21.15.134:0/1137236293 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f63cc057800 con 0x7f63dc0ff440 2024-04-13T11:10:55.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.786+0000 7f63e1751700 1 -- 172.21.15.134:0/1137236293 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63dc04ea50 con 0x7f63dc0ff440 2024-04-13T11:10:55.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.787+0000 7f63c3fff700 1 -- 172.21.15.134:0/1137236293 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16683 (secure 0 0 0) 0x7f63cc003d10 con 0x7f63dc0ff440 2024-04-13T11:10:55.787 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:55.787 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":91,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","created":"2024-04-13T10:48:00.547311+0000","modified":"2024-04-13T11:08:14.000670+0000","last_up_change":"2024-04-13T11:06:55.382409+0000","last_in_change":"2024-04-13T10:53:56.134815+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T10:52:52.594710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-13T10:55:39.381684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-13T10:55:39.903105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02af0f03-a267-4906-8417-d15189c8da92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":85,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6803","nonce":3712938281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6805","nonce":3712938281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6809","nonce":3712938281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6807","nonce":3712938281}]},"public_addr":"172.21.15.134:6803/3712938281","cluster_addr":"172.21.15.134:6805/3712938281","heartbeat_back_addr":"172.21.15.134:6809/3712938281","heartbeat_front_addr":"172.21.15.134:6807/3712938281","state":["exists","up"]},{"osd":1,"uuid":"ce202f5e-9c58-4cd6-b85b-1422131948d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":85,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6811","nonce":1751594116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6813","nonce":1751594116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6817","nonce":1751594116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6815","nonce":1751594116}]},"public_addr":"172.21.15.134:6811/1751594116","cluster_addr":"172.21.15.134:6813/1751594116","heartbeat_back_addr":"172.21.15.134:6817/1751594116","heartbeat_front_addr":"172.21.15.134:6815/1751594116","state":["exists","up"]},{"osd":2,"uuid":"7a2fef79-8403-416e-9037-079ddb080611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":85,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6819","nonce":1661014044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6821","nonce":1661014044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6825","nonce":1661014044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6823","nonce":1661014044}]},"public_addr":"172.21.15.134:6819/1661014044","cluster_addr":"172.21.15.134:6821/1661014044","heartbeat_back_addr":"172.21.15.134:6825/1661014044","heartbeat_front_addr":"172.21.15.134:6823/1661014044","state":["exists","up"]},{"osd":3,"uuid":"44c0411c-d9e0-4d23-b97d-f613b89943a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":72,"up_thru":85,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6801","nonce":1318422614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6803","nonce":1318422614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6807","nonce":1318422614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6805","nonce":1318422614}]},"public_addr":"172.21.15.194:6801/1318422614","cluster_addr":"172.21.15.194:6803/1318422614","heartbeat_back_addr":"172.21.15.194:6807/1318422614","heartbeat_front_addr":"172.21.15.194:6805/1318422614","state":["exists","up"]},{"osd":4,"uuid":"91533b98-bd92-4d8e-afa6-59c396f95799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":76,"up_from":80,"up_thru":85,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6809","nonce":48937761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6811","nonce":48937761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6815","nonce":48937761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6813","nonce":48937761}]},"public_addr":"172.21.15.194:6809/48937761","cluster_addr":"172.21.15.194:6811/48937761","heartbeat_back_addr":"172.21.15.194:6815/48937761","heartbeat_front_addr":"172.21.15.194:6813/48937761","state":["exists","up"]},{"osd":5,"uuid":"3e198b03-2011-435c-afd8-16d8521b9991","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":81,"up_from":85,"up_thru":85,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6817","nonce":1702176960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6819","nonce":1702176960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6823","nonce":1702176960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6821","nonce":1702176960}]},"public_addr":"172.21.15.194:6817/1702176960","cluster_addr":"172.21.15.194:6819/1702176960","heartbeat_back_addr":"172.21.15.194:6823/1702176960","heartbeat_front_addr":"172.21.15.194:6821/1702176960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:51:48.117416+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:17.805248+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:49.973117+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:17.604636+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:46.014087+0000","dead_epoch":76},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:54:14.654274+0000","dead_epoch":81}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":0,"to":2}]},{"pgid":"2.e","mappings":[{"from":0,"to":5}]},{"pgid":"2.1e","mappings":[{"from":0,"to":3}]},{"pgid":"3.a","mappings":[{"from":1,"to":2}]},{"pgid":"3.d","mappings":[{"from":4,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":3}]},{"pgid":"3.1c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6824/3497839686":"2024-04-14T11:07:45.818363+0000","172.21.15.134:6828/3278328584":"2024-04-14T11:07:21.786115+0000","172.21.15.134:6800/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/565739211":"2024-04-14T10:49:08.875132+0000","172.21.15.194:0/1967347374":"2024-04-14T10:59:37.865154+0000","172.21.15.134:6801/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/323045534":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/3055528347":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6801/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.134:6800/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.194:0/2417054087":"2024-04-14T10:59:37.865154+0000","172.21.15.194:6826/3941085795":"2024-04-14T11:08:14.000645+0000","172.21.15.134:6800/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.194:6829/1685298182":"2024-04-14T10:59:37.865154+0000","172.21.15.134:6829/3278328584":"2024-04-14T11:07:21.786115+0000","172.21.15.134:0/2783735336":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6827/3726339659":"2024-04-14T10:55:55.830791+0000","172.21.15.134:0/1977594888":"2024-04-14T10:57:57.426837+0000","172.21.15.194:0/2477915964":"2024-04-14T10:59:37.865154+0000","172.21.15.134:0/2590154845":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/471716030":"2024-04-14T10:49:08.875132+0000","172.21.15.134:6801/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.194:6825/3497839686":"2024-04-14T11:07:45.818363+0000","172.21.15.134:0/4116995009":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/1090834434":"2024-04-14T10:48:33.849227+0000","172.21.15.194:6828/1685298182":"2024-04-14T10:59:37.865154+0000","172.21.15.134:0/4115016009":"2024-04-14T10:57:57.426837+0000","172.21.15.134:6826/3726339659":"2024-04-14T10:55:55.830791+0000","172.21.15.134:0/3281134012":"2024-04-14T10:57:57.426837+0000","172.21.15.134:6800/2958657378":"2024-04-14T10:57:57.426837+0000","172.21.15.134:6801/2958657378":"2024-04-14T10:57:57.426837+0000","172.21.15.194:6827/3941085795":"2024-04-14T11:08:14.000645+0000","172.21.15.134:0/3885996389":"2024-04-14T10:48:33.849227+0000","172.21.15.194:0/365752214":"2024-04-14T10:59:37.865154+0000","172.21.15.134:0/1158318696":"2024-04-14T10:57:57.426837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T11:10:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 -- 172.21.15.134:0/1137236293 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f63c406cda0 msgr2=0x7f63c406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f63c406cda0 0x7f63c406f250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0696f0 tx=0x7f63d000b410 comp rx=0 tx=0).stop 2024-04-13T11:10:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 -- 172.21.15.134:0/1137236293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63dc0ff440 msgr2=0x7f63dc196b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63dc0ff440 0x7f63dc196b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f63cc006010 tx=0x7f63cc00bd70 comp rx=0 tx=0).stop 2024-04-13T11:10:55.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 -- 172.21.15.134:0/1137236293 shutdown_connections 2024-04-13T11:10:55.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f63c406cda0 0x7f63c406f250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:55.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63dc0ff440 0x7f63dc196b90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:55.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 --2- 172.21.15.134:0/1137236293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63dc0ffde0 0x7f63dc1970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:55.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 -- 172.21.15.134:0/1137236293 >> 172.21.15.134:0/1137236293 conn(0x7f63dc0facd0 msgr2=0x7f63dc0fb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:55.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 -- 172.21.15.134:0/1137236293 shutdown_connections 2024-04-13T11:10:55.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.789+0000 7f63e1751700 1 -- 172.21.15.134:0/1137236293 wait complete. 2024-04-13T11:10:55.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T10:52:52.594710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-13T10:55:39.381684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-13T10:55:39.903105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T11:10:55.803 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T11:10:55.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 -- 172.21.15.134:0/795357290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50580ffaa0 msgr2=0x7f50580fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 --2- 172.21.15.134:0/795357290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50580ffaa0 0x7f50580fff10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5054009910 tx=0x7f5054009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 -- 172.21.15.134:0/795357290 shutdown_connections 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 --2- 172.21.15.134:0/795357290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50580ffaa0 0x7f50580fff10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 --2- 172.21.15.134:0/795357290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5058105070 0x7f5058105440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 -- 172.21.15.134:0/795357290 >> 172.21.15.134:0/795357290 conn(0x7f5058074fa0 msgr2=0x7f50580753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 -- 172.21.15.134:0/795357290 shutdown_connections 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 -- 172.21.15.134:0/795357290 wait complete. 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 Processor -- start 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 -- start start 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50580ffaa0 0x7f5058196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5058105070 0x7f5058196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.928+0000 7f505fad3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50581975e0 con 0x7f50580ffaa0 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f505fad3700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5058197750 con 0x7f5058105070 2024-04-13T11:10:55.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f505d86f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50580ffaa0 0x7f5058196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f505d86f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50580ffaa0 0x7f5058196a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35116/0 (socket says 172.21.15.134:35116) 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f505d86f700 1 -- 172.21.15.134:0/485805183 learned_addr learned my addr 172.21.15.134:0/485805183 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f505d86f700 1 -- 172.21.15.134:0/485805183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5058105070 msgr2=0x7f5058196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f505d86f700 1 --2- 172.21.15.134:0/485805183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5058105070 0x7f5058196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f505d86f700 1 -- 172.21.15.134:0/485805183 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50540095f0 con 0x7f50580ffaa0 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f505d86f700 1 --2- 172.21.15.134:0/485805183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50580ffaa0 0x7f5058196a80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f504800c8a0 tx=0x7f504800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f504effd700 1 -- 172.21.15.134:0/485805183 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504800cea0 con 0x7f50580ffaa0 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f504effd700 1 -- 172.21.15.134:0/485805183 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5048004830 con 0x7f50580ffaa0 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f505fad3700 1 -- 172.21.15.134:0/485805183 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505819faf0 con 0x7f50580ffaa0 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f504effd700 1 -- 172.21.15.134:0/485805183 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5048005500 con 0x7f50580ffaa0 2024-04-13T11:10:55.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.929+0000 7f505fad3700 1 -- 172.21.15.134:0/485805183 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505819fff0 con 0x7f50580ffaa0 2024-04-13T11:10:55.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.930+0000 7f505fad3700 1 -- 172.21.15.134:0/485805183 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50581022f0 con 0x7f50580ffaa0 2024-04-13T11:10:55.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.931+0000 7f504effd700 1 -- 172.21.15.134:0/485805183 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f50480049a0 con 0x7f50580ffaa0 2024-04-13T11:10:55.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.931+0000 7f504effd700 1 --2- 172.21.15.134:0/485805183 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f504406cce0 0x7f504406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:55.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.931+0000 7f504effd700 1 -- 172.21.15.134:0/485805183 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f504808c270 con 0x7f50580ffaa0 2024-04-13T11:10:55.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.931+0000 7f505d06e700 1 --2- 172.21.15.134:0/485805183 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f504406cce0 0x7f504406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:55.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.932+0000 7f505d06e700 1 --2- 172.21.15.134:0/485805183 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f504406cce0 0x7f504406f190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f505400b5c0 tx=0x7f5054005960 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:55.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:55.936+0000 7f504effd700 1 -- 172.21.15.134:0/485805183 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f5048056290 con 0x7f50580ffaa0 2024-04-13T11:10:56.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.129+0000 7f505fad3700 1 -- 172.21.15.134:0/485805183 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f505802ccd0 con 0x7f50580ffaa0 2024-04-13T11:10:56.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.129+0000 7f504effd700 1 -- 172.21.15.134:0/485805183 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50480598b0 con 0x7f50580ffaa0 2024-04-13T11:10:56.129 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-04-13T11:10:56.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 -- 172.21.15.134:0/485805183 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f504406cce0 msgr2=0x7f504406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 --2- 172.21.15.134:0/485805183 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f504406cce0 0x7f504406f190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f505400b5c0 tx=0x7f5054005960 comp rx=0 tx=0).stop 2024-04-13T11:10:56.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 -- 172.21.15.134:0/485805183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50580ffaa0 msgr2=0x7f5058196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.131 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 --2- 172.21.15.134:0/485805183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50580ffaa0 0x7f5058196a80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f504800c8a0 tx=0x7f504800cc60 comp rx=0 tx=0).stop 2024-04-13T11:10:56.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 -- 172.21.15.134:0/485805183 shutdown_connections 2024-04-13T11:10:56.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 --2- 172.21.15.134:0/485805183 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f504406cce0 0x7f504406f190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 --2- 172.21.15.134:0/485805183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50580ffaa0 0x7f5058196a80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 --2- 172.21.15.134:0/485805183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5058105070 0x7f5058196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 -- 172.21.15.134:0/485805183 >> 172.21.15.134:0/485805183 conn(0x7f5058074fa0 msgr2=0x7f50580fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:56.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 -- 172.21.15.134:0/485805183 shutdown_connections 2024-04-13T11:10:56.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.131+0000 7f505fad3700 1 -- 172.21.15.134:0/485805183 wait complete. 2024-04-13T11:10:56.143 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-13T11:10:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.269+0000 7f034d561700 1 -- 172.21.15.134:0/686764143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03480ff100 msgr2=0x7f03480ff4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.269+0000 7f034d561700 1 --2- 172.21.15.134:0/686764143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03480ff100 0x7f03480ff4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f033c009940 tx=0x7f033c009c50 comp rx=0 tx=0).stop 2024-04-13T11:10:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.269+0000 7f034d561700 1 -- 172.21.15.134:0/686764143 shutdown_connections 2024-04-13T11:10:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.269+0000 7f034d561700 1 --2- 172.21.15.134:0/686764143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03480ffa10 0x7f034810a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.269+0000 7f034d561700 1 --2- 172.21.15.134:0/686764143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03480ff100 0x7f03480ff4d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.269+0000 7f034d561700 1 -- 172.21.15.134:0/686764143 >> 172.21.15.134:0/686764143 conn(0x7f0348074700 msgr2=0x7f0348074b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.269+0000 7f034d561700 1 -- 172.21.15.134:0/686764143 shutdown_connections 2024-04-13T11:10:56.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.269+0000 7f034d561700 1 -- 172.21.15.134:0/686764143 wait complete. 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f034d561700 1 Processor -- start 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f034d561700 1 -- start start 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f034d561700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03480ff100 0x7f034819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f034d561700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03480ffa10 0x7f034819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f034d561700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034819c3d0 con 0x7f03480ff100 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f034d561700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348195870 con 0x7f03480ffa10 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f0346ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03480ff100 0x7f034819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f0346ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03480ff100 0x7f034819b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35136/0 (socket says 172.21.15.134:35136) 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f0346ffd700 1 -- 172.21.15.134:0/3622973924 learned_addr learned my addr 172.21.15.134:0/3622973924 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f03467fc700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03480ffa10 0x7f034819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:56.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f0346ffd700 1 -- 172.21.15.134:0/3622973924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03480ffa10 msgr2=0x7f034819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f0346ffd700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03480ffa10 0x7f034819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f0346ffd700 1 -- 172.21.15.134:0/3622973924 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0095f0 con 0x7f03480ff100 2024-04-13T11:10:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f03467fc700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03480ffa10 0x7f034819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:10:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.270+0000 7f0346ffd700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03480ff100 0x7f034819b800 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f033c006010 tx=0x7f033c0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.271+0000 7f032ffff700 1 -- 172.21.15.134:0/3622973924 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f033c01d070 con 0x7f03480ff100 2024-04-13T11:10:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.271+0000 7f032ffff700 1 -- 172.21.15.134:0/3622973924 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f033c00bea0 con 0x7f03480ff100 2024-04-13T11:10:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.271+0000 7f034d561700 1 -- 172.21.15.134:0/3622973924 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0348195b50 con 0x7f03480ff100 2024-04-13T11:10:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.271+0000 7f032ffff700 1 -- 172.21.15.134:0/3622973924 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f033c021410 con 0x7f03480ff100 2024-04-13T11:10:56.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.271+0000 7f034d561700 1 -- 172.21.15.134:0/3622973924 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0348196130 con 0x7f03480ff100 2024-04-13T11:10:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.272+0000 7f034d561700 1 -- 172.21.15.134:0/3622973924 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0348107b80 con 0x7f03480ff100 2024-04-13T11:10:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.272+0000 7f032ffff700 1 -- 172.21.15.134:0/3622973924 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f033c00f460 con 0x7f03480ff100 2024-04-13T11:10:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.272+0000 7f032ffff700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f033006cce0 0x7f033006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.272+0000 7f032ffff700 1 -- 172.21.15.134:0/3622973924 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f033c08d8a0 con 0x7f03480ff100 2024-04-13T11:10:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.272+0000 7f03467fc700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f033006cce0 0x7f033006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:56.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.273+0000 7f03467fc700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f033006cce0 0x7f033006f190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0338005950 tx=0x7f03380058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:56.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.277+0000 7f032ffff700 1 -- 172.21.15.134:0/3622973924 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f033c05b2d0 con 0x7f03480ff100 2024-04-13T11:10:56.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:56 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1137236293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T11:10:56.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:56 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/485805183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-13T11:10:56.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.471+0000 7f034d561700 1 -- 172.21.15.134:0/3622973924 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f034804ea50 con 0x7f03480ff100 2024-04-13T11:10:56.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.471+0000 7f032ffff700 1 -- 172.21.15.134:0/3622973924 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7f033c00f740 con 0x7f03480ff100 2024-04-13T11:10:56.472 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-04-13T11:10:56.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 -- 172.21.15.134:0/3622973924 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f033006cce0 msgr2=0x7f033006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f033006cce0 0x7f033006f190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0338005950 tx=0x7f03380058e0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 -- 172.21.15.134:0/3622973924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03480ff100 msgr2=0x7f034819b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03480ff100 0x7f034819b800 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f033c006010 tx=0x7f033c0056a0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 -- 172.21.15.134:0/3622973924 shutdown_connections 2024-04-13T11:10:56.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f033006cce0 0x7f033006f190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03480ff100 0x7f034819b800 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 --2- 172.21.15.134:0/3622973924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03480ffa10 0x7f034819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 -- 172.21.15.134:0/3622973924 >> 172.21.15.134:0/3622973924 conn(0x7f0348074700 msgr2=0x7f0348104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:56.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 -- 172.21.15.134:0/3622973924 shutdown_connections 2024-04-13T11:10:56.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.474+0000 7f034d561700 1 -- 172.21.15.134:0/3622973924 wait complete. 2024-04-13T11:10:56.486 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-13T11:10:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:56 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1137236293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T11:10:56.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:56 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/485805183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-13T11:10:56.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.611+0000 7f870c208700 1 -- 172.21.15.134:0/808386815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87041002f0 msgr2=0x7f87041006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.611+0000 7f870c208700 1 --2- 172.21.15.134:0/808386815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87041002f0 0x7f87041006c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8700009910 tx=0x7f8700009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:56.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.611+0000 7f870c208700 1 -- 172.21.15.134:0/808386815 shutdown_connections 2024-04-13T11:10:56.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.611+0000 7f870c208700 1 --2- 172.21.15.134:0/808386815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8704100c90 0x7f8704104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.611+0000 7f870c208700 1 --2- 172.21.15.134:0/808386815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87041002f0 0x7f87041006c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.611+0000 7f870c208700 1 -- 172.21.15.134:0/808386815 >> 172.21.15.134:0/808386815 conn(0x7f87040fbb40 msgr2=0x7f87040fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:56.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.612+0000 7f870c208700 1 -- 172.21.15.134:0/808386815 shutdown_connections 2024-04-13T11:10:56.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.612+0000 7f870c208700 1 -- 172.21.15.134:0/808386815 wait complete. 2024-04-13T11:10:56.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.612+0000 7f870c208700 1 Processor -- start 2024-04-13T11:10:56.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.612+0000 7f870c208700 1 -- start start 2024-04-13T11:10:56.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f870c208700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87041002f0 0x7f870419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:56.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f870c208700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8704100c90 0x7f870419bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:56.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f870c208700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870419c550 con 0x7f87041002f0 2024-04-13T11:10:56.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f870c208700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704195a80 con 0x7f8704100c90 2024-04-13T11:10:56.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f8709fa4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87041002f0 0x7f870419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:56.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f8709fa4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87041002f0 0x7f870419ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35164/0 (socket says 172.21.15.134:35164) 2024-04-13T11:10:56.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f8709fa4700 1 -- 172.21.15.134:0/2160033169 learned_addr learned my addr 172.21.15.134:0/2160033169 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:56.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f8709fa4700 1 -- 172.21.15.134:0/2160033169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8704100c90 msgr2=0x7f870419bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f8709fa4700 1 --2- 172.21.15.134:0/2160033169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8704100c90 0x7f870419bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f8709fa4700 1 -- 172.21.15.134:0/2160033169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87000095f0 con 0x7f87041002f0 2024-04-13T11:10:56.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f8709fa4700 1 --2- 172.21.15.134:0/2160033169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87041002f0 0x7f870419ba10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8700006010 tx=0x7f870000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:56.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f86faffd700 1 -- 172.21.15.134:0/2160033169 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870001d070 con 0x7f87041002f0 2024-04-13T11:10:56.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f870c208700 1 -- 172.21.15.134:0/2160033169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8704195d00 con 0x7f87041002f0 2024-04-13T11:10:56.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f86faffd700 1 -- 172.21.15.134:0/2160033169 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f870000f460 con 0x7f87041002f0 2024-04-13T11:10:56.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f86faffd700 1 -- 172.21.15.134:0/2160033169 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8700021640 con 0x7f87041002f0 2024-04-13T11:10:56.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.613+0000 7f870c208700 1 -- 172.21.15.134:0/2160033169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8704196200 con 0x7f87041002f0 2024-04-13T11:10:56.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.614+0000 7f870c208700 1 -- 172.21.15.134:0/2160033169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87041085f0 con 0x7f87041002f0 2024-04-13T11:10:56.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.615+0000 7f86faffd700 1 -- 172.21.15.134:0/2160033169 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f870000fa20 con 0x7f87041002f0 2024-04-13T11:10:56.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.615+0000 7f86faffd700 1 --2- 172.21.15.134:0/2160033169 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f86f006cce0 0x7f86f006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:56.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.615+0000 7f86faffd700 1 -- 172.21.15.134:0/2160033169 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f870008d990 con 0x7f87041002f0 2024-04-13T11:10:56.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.615+0000 7f87097a3700 1 --2- 172.21.15.134:0/2160033169 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f86f006cce0 0x7f86f006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:56.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.616+0000 7f87097a3700 1 --2- 172.21.15.134:0/2160033169 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f86f006cce0 0x7f86f006f190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005fd0 tx=0x7f86f4005d00 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:56.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.620+0000 7f86faffd700 1 -- 172.21.15.134:0/2160033169 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f870005b3c0 con 0x7f87041002f0 2024-04-13T11:10:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.813+0000 7f870c208700 1 -- 172.21.15.134:0/2160033169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f8704107fd0 con 0x7f87041002f0 2024-04-13T11:10:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.813+0000 7f86faffd700 1 -- 172.21.15.134:0/2160033169 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7f870005af50 con 0x7f87041002f0 2024-04-13T11:10:56.813 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-04-13T11:10:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.815+0000 7f870c208700 1 -- 172.21.15.134:0/2160033169 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f86f006cce0 msgr2=0x7f86f006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.815 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.815+0000 7f870c208700 1 --2- 172.21.15.134:0/2160033169 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f86f006cce0 0x7f86f006f190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005fd0 tx=0x7f86f4005d00 comp rx=0 tx=0).stop 2024-04-13T11:10:56.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.815+0000 7f870c208700 1 -- 172.21.15.134:0/2160033169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87041002f0 msgr2=0x7f870419ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.815+0000 7f870c208700 1 --2- 172.21.15.134:0/2160033169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87041002f0 0x7f870419ba10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8700006010 tx=0x7f870000be20 comp rx=0 tx=0).stop 2024-04-13T11:10:56.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.815+0000 7f870c208700 1 -- 172.21.15.134:0/2160033169 shutdown_connections 2024-04-13T11:10:56.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.815+0000 7f870c208700 1 --2- 172.21.15.134:0/2160033169 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f86f006cce0 0x7f86f006f190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.815+0000 7f870c208700 1 --2- 172.21.15.134:0/2160033169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87041002f0 0x7f870419ba10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.815+0000 7f870c208700 1 --2- 172.21.15.134:0/2160033169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8704100c90 0x7f870419bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.815+0000 7f870c208700 1 -- 172.21.15.134:0/2160033169 >> 172.21.15.134:0/2160033169 conn(0x7f87040fbb40 msgr2=0x7f87040fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:56.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.816+0000 7f870c208700 1 -- 172.21.15.134:0/2160033169 shutdown_connections 2024-04-13T11:10:56.816 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.816+0000 7f870c208700 1 -- 172.21.15.134:0/2160033169 wait complete. 2024-04-13T11:10:56.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T11:10:56.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.949+0000 7fa831756700 1 -- 172.21.15.134:0/1522922721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0ffde0 msgr2=0x7fa82c103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.949+0000 7fa831756700 1 --2- 172.21.15.134:0/1522922721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0ffde0 0x7fa82c103da0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009910 tx=0x7fa81c009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:56.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.949+0000 7fa831756700 1 -- 172.21.15.134:0/1522922721 shutdown_connections 2024-04-13T11:10:56.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.949+0000 7fa831756700 1 --2- 172.21.15.134:0/1522922721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0ffde0 0x7fa82c103da0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.949+0000 7fa831756700 1 --2- 172.21.15.134:0/1522922721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa82c0ff440 0x7fa82c0ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.949+0000 7fa831756700 1 -- 172.21.15.134:0/1522922721 >> 172.21.15.134:0/1522922721 conn(0x7fa82c0facd0 msgr2=0x7fa82c0fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:56.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.949+0000 7fa831756700 1 -- 172.21.15.134:0/1522922721 shutdown_connections 2024-04-13T11:10:56.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.949+0000 7fa831756700 1 -- 172.21.15.134:0/1522922721 wait complete. 2024-04-13T11:10:56.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa831756700 1 Processor -- start 2024-04-13T11:10:56.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa831756700 1 -- start start 2024-04-13T11:10:56.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa831756700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0ff440 0x7fa82c196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:56.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa831756700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa82c0ffde0 0x7fa82c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:56.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa831756700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c1976d0 con 0x7fa82c0ff440 2024-04-13T11:10:56.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa831756700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c197840 con 0x7fa82c0ffde0 2024-04-13T11:10:56.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa82affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0ff440 0x7fa82c196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:56.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa82affd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0ff440 0x7fa82c196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35178/0 (socket says 172.21.15.134:35178) 2024-04-13T11:10:56.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa82affd700 1 -- 172.21.15.134:0/26898807 learned_addr learned my addr 172.21.15.134:0/26898807 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:56.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa82a7fc700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa82c0ffde0 0x7fa82c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:56.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa82affd700 1 -- 172.21.15.134:0/26898807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa82c0ffde0 msgr2=0x7fa82c1970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:56.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa82affd700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa82c0ffde0 0x7fa82c1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:56.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.950+0000 7fa82affd700 1 -- 172.21.15.134:0/26898807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0095f0 con 0x7fa82c0ff440 2024-04-13T11:10:56.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.951+0000 7fa82affd700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0ff440 0x7fa82c196b70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa82000e920 tx=0x7fa82000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:56.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.951+0000 7fa813fff700 1 -- 172.21.15.134:0/26898807 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa820009790 con 0x7fa82c0ff440 2024-04-13T11:10:56.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.951+0000 7fa813fff700 1 -- 172.21.15.134:0/26898807 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa82000cba0 con 0x7fa82c0ff440 2024-04-13T11:10:56.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.951+0000 7fa831756700 1 -- 172.21.15.134:0/26898807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c19fbe0 con 0x7fa82c0ff440 2024-04-13T11:10:56.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.951+0000 7fa813fff700 1 -- 172.21.15.134:0/26898807 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa820018650 con 0x7fa82c0ff440 2024-04-13T11:10:56.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.951+0000 7fa831756700 1 -- 172.21.15.134:0/26898807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c1a00e0 con 0x7fa82c0ff440 2024-04-13T11:10:56.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.952+0000 7fa831756700 1 -- 172.21.15.134:0/26898807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82c1077a0 con 0x7fa82c0ff440 2024-04-13T11:10:56.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.952+0000 7fa813fff700 1 -- 172.21.15.134:0/26898807 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa82000cd10 con 0x7fa82c0ff440 2024-04-13T11:10:56.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.953+0000 7fa813fff700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa81406cda0 0x7fa81406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:56.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.953+0000 7fa813fff700 1 -- 172.21.15.134:0/26898807 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fa820014070 con 0x7fa82c0ff440 2024-04-13T11:10:56.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.953+0000 7fa82a7fc700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa81406cda0 0x7fa81406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:56.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.953+0000 7fa82a7fc700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa81406cda0 0x7fa81406f250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00b6e0 tx=0x7fa81c009f70 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:56.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:56.957+0000 7fa813fff700 1 -- 172.21.15.134:0/26898807 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fa820052ab0 con 0x7fa82c0ff440 2024-04-13T11:10:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.196+0000 7fa831756700 1 -- 172.21.15.134:0/26898807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa82c069540 con 0x7fa82c0ff440 2024-04-13T11:10:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.197+0000 7fa813fff700 1 -- 172.21.15.134:0/26898807 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4846 (secure 0 0 0) 0x7fa82005a450 con 0x7fa82c0ff440 2024-04-13T11:10:57.197 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:57.197 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":44335,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/2085856165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2085856165},{"type":"v1","addr":"172.21.15.194:6827","nonce":2085856165}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:08:56.971752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":0,"incarnation":34,"state":"up:active","state_seq":22,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34354":{"gid":34354,"name":"cephfs.smithi134.kachce","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:10:57.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 -- 172.21.15.134:0/26898807 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa81406cda0 msgr2=0x7fa81406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:57.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa81406cda0 0x7fa81406f250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00b6e0 tx=0x7fa81c009f70 comp rx=0 tx=0).stop 2024-04-13T11:10:57.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 -- 172.21.15.134:0/26898807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0ff440 msgr2=0x7fa82c196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:57.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0ff440 0x7fa82c196b70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa82000e920 tx=0x7fa82000ece0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 -- 172.21.15.134:0/26898807 shutdown_connections 2024-04-13T11:10:57.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fa81406cda0 0x7fa81406f250 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa82c0ff440 0x7fa82c196b70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 --2- 172.21.15.134:0/26898807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa82c0ffde0 0x7fa82c1970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 -- 172.21.15.134:0/26898807 >> 172.21.15.134:0/26898807 conn(0x7fa82c0facd0 msgr2=0x7fa82c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:57.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 -- 172.21.15.134:0/26898807 shutdown_connections 2024-04-13T11:10:57.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.199+0000 7fa831756700 1 -- 172.21.15.134:0/26898807 wait complete. 2024-04-13T11:10:57.201 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 41 2024-04-13T11:10:57.211 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 1, 'flags': 50} 2024-04-13T11:10:57.211 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-13T11:10:57.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.336+0000 7f47b34f0700 1 -- 172.21.15.134:0/200521286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47ac067d60 msgr2=0x7f47ac0681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:57.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.336+0000 7f47b34f0700 1 --2- 172.21.15.134:0/200521286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47ac067d60 0x7f47ac0681b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f479c009910 tx=0x7f479c009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:57.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.336+0000 7f47b34f0700 1 -- 172.21.15.134:0/200521286 shutdown_connections 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.336+0000 7f47b34f0700 1 --2- 172.21.15.134:0/200521286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47ac067d60 0x7f47ac0681b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.336+0000 7f47b34f0700 1 --2- 172.21.15.134:0/200521286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac1060c0 0x7f47ac106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.336+0000 7f47b34f0700 1 -- 172.21.15.134:0/200521286 >> 172.21.15.134:0/200521286 conn(0x7f47ac074d90 msgr2=0x7f47ac075190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.336+0000 7f47b34f0700 1 -- 172.21.15.134:0/200521286 shutdown_connections 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.336+0000 7f47b34f0700 1 -- 172.21.15.134:0/200521286 wait complete. 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b34f0700 1 Processor -- start 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b34f0700 1 -- start start 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b34f0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47ac067d60 0x7f47ac19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b34f0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac1060c0 0x7f47ac19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b34f0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac19c460 con 0x7f47ac067d60 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b34f0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac195900 con 0x7f47ac1060c0 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b128c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47ac067d60 0x7f47ac19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b128c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47ac067d60 0x7f47ac19b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35200/0 (socket says 172.21.15.134:35200) 2024-04-13T11:10:57.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b128c700 1 -- 172.21.15.134:0/245982455 learned_addr learned my addr 172.21.15.134:0/245982455 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b0a8b700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac1060c0 0x7f47ac19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b128c700 1 -- 172.21.15.134:0/245982455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac1060c0 msgr2=0x7f47ac19bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b128c700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac1060c0 0x7f47ac19bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b128c700 1 -- 172.21.15.134:0/245982455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0095f0 con 0x7f47ac067d60 2024-04-13T11:10:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.337+0000 7f47b128c700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47ac067d60 0x7f47ac19b890 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f47a800d900 tx=0x7f47a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.338+0000 7f47a27fc700 1 -- 172.21.15.134:0/245982455 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47a80041f0 con 0x7f47ac067d60 2024-04-13T11:10:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.338+0000 7f47b34f0700 1 -- 172.21.15.134:0/245982455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ac195be0 con 0x7f47ac067d60 2024-04-13T11:10:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.338+0000 7f47a27fc700 1 -- 172.21.15.134:0/245982455 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f47a8004cd0 con 0x7f47ac067d60 2024-04-13T11:10:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.338+0000 7f47a27fc700 1 -- 172.21.15.134:0/245982455 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47a80056d0 con 0x7f47ac067d60 2024-04-13T11:10:57.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.338+0000 7f47b34f0700 1 -- 172.21.15.134:0/245982455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac196140 con 0x7f47ac067d60 2024-04-13T11:10:57.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.339+0000 7f47b34f0700 1 -- 172.21.15.134:0/245982455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ac04ea50 con 0x7f47ac067d60 2024-04-13T11:10:57.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.339+0000 7f47a27fc700 1 -- 172.21.15.134:0/245982455 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f47a8004e40 con 0x7f47ac067d60 2024-04-13T11:10:57.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.340+0000 7f47a27fc700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4798071150 0x7f4798073600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:57.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.340+0000 7f47b0a8b700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4798071150 0x7f4798073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:57.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.340+0000 7f47a27fc700 1 -- 172.21.15.134:0/245982455 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f47a808cd40 con 0x7f47ac067d60 2024-04-13T11:10:57.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.340+0000 7f47b0a8b700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4798071150 0x7f4798073600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0fd390 tx=0x7f479c01a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:57.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.344+0000 7f47a27fc700 1 -- 172.21.15.134:0/245982455 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f47a805a790 con 0x7f47ac067d60 2024-04-13T11:10:57.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:57 smithi134 ceph-mon[112184]: pgmap v385: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:57.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:57 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3622973924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-13T11:10:57.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:57 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2160033169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-13T11:10:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:57 smithi194 ceph-mon[83053]: pgmap v385: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:10:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:57 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3622973924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-13T11:10:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:57 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2160033169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-13T11:10:57.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.584+0000 7f47b34f0700 1 -- 172.21.15.134:0/245982455 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f47ac196e10 con 0x7f47ac067d60 2024-04-13T11:10:57.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.585+0000 7f47a27fc700 1 -- 172.21.15.134:0/245982455 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v41) v1 ==== 107+0+4056 (secure 0 0 0) 0x7f47a8016020 con 0x7f47ac067d60 2024-04-13T11:10:57.585 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:57.585 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/3497839686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3497839686},{"type":"v1","addr":"172.21.15.194:6825","nonce":3497839686}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:06:58.091559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14492":{"gid":14492,"name":"cephfs.smithi134.kachce","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6829/3278328584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3278328584},{"type":"v1","addr":"172.21.15.134:6829","nonce":3278328584}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:10:57.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 -- 172.21.15.134:0/245982455 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4798071150 msgr2=0x7f4798073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:57.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4798071150 0x7f4798073600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0fd390 tx=0x7f479c01a040 comp rx=0 tx=0).stop 2024-04-13T11:10:57.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 -- 172.21.15.134:0/245982455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47ac067d60 msgr2=0x7f47ac19b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:57.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47ac067d60 0x7f47ac19b890 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f47a800d900 tx=0x7f47a800dcc0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 -- 172.21.15.134:0/245982455 shutdown_connections 2024-04-13T11:10:57.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f4798071150 0x7f4798073600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47ac067d60 0x7f47ac19b890 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 --2- 172.21.15.134:0/245982455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac1060c0 0x7f47ac19bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 -- 172.21.15.134:0/245982455 >> 172.21.15.134:0/245982455 conn(0x7f47ac074d90 msgr2=0x7f47ac0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:57.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 -- 172.21.15.134:0/245982455 shutdown_connections 2024-04-13T11:10:57.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.587+0000 7f47b34f0700 1 -- 172.21.15.134:0/245982455 wait complete. 2024-04-13T11:10:57.588 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 19 2024-04-13T11:10:57.599 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-04-13T11:10:57.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-13T11:10:57.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.722+0000 7fd1e818c700 1 -- 172.21.15.134:0/1150398827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1e0101e10 msgr2=0x7fd1e010a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.722+0000 7fd1e818c700 1 --2- 172.21.15.134:0/1150398827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1e0101e10 0x7fd1e010a300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009940 tx=0x7fd1d0009c50 comp rx=0 tx=0).stop 2024-04-13T11:10:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.722+0000 7fd1e818c700 1 -- 172.21.15.134:0/1150398827 shutdown_connections 2024-04-13T11:10:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.722+0000 7fd1e818c700 1 --2- 172.21.15.134:0/1150398827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1e0101e10 0x7fd1e010a300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.722+0000 7fd1e818c700 1 --2- 172.21.15.134:0/1150398827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1e0101500 0x7fd1e01018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.723+0000 7fd1e818c700 1 -- 172.21.15.134:0/1150398827 >> 172.21.15.134:0/1150398827 conn(0x7fd1e00fac70 msgr2=0x7fd1e00fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.723+0000 7fd1e818c700 1 -- 172.21.15.134:0/1150398827 shutdown_connections 2024-04-13T11:10:57.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.723+0000 7fd1e818c700 1 -- 172.21.15.134:0/1150398827 wait complete. 2024-04-13T11:10:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.723+0000 7fd1e818c700 1 Processor -- start 2024-04-13T11:10:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.723+0000 7fd1e818c700 1 -- start start 2024-04-13T11:10:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e818c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1e0101500 0x7fd1e019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e818c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1e0101e10 0x7fd1e019c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e818c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e019c6a0 con 0x7fd1e0101e10 2024-04-13T11:10:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e818c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e0195b40 con 0x7fd1e0101500 2024-04-13T11:10:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e5727700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1e0101e10 0x7fd1e019c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e5727700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1e0101e10 0x7fd1e019c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35226/0 (socket says 172.21.15.134:35226) 2024-04-13T11:10:57.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e5727700 1 -- 172.21.15.134:0/1407283864 learned_addr learned my addr 172.21.15.134:0/1407283864 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e5f28700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1e0101500 0x7fd1e019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e5727700 1 -- 172.21.15.134:0/1407283864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1e0101500 msgr2=0x7fd1e019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e5727700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1e0101500 0x7fd1e019bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e5727700 1 -- 172.21.15.134:0/1407283864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00095f0 con 0x7fd1e0101e10 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e5727700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1e0101e10 0x7fd1e019c010 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000be10 tx=0x7fd1d000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1d6ffd700 1 -- 172.21.15.134:0/1407283864 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1d001d070 con 0x7fd1e0101e10 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1d6ffd700 1 -- 172.21.15.134:0/1407283864 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd1d0005dc0 con 0x7fd1e0101e10 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e818c700 1 -- 172.21.15.134:0/1407283864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e0195dc0 con 0x7fd1e0101e10 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1d6ffd700 1 -- 172.21.15.134:0/1407283864 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1d000fe60 con 0x7fd1e0101e10 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.724+0000 7fd1e818c700 1 -- 172.21.15.134:0/1407283864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e01962c0 con 0x7fd1e0101e10 2024-04-13T11:10:57.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.725+0000 7fd1e818c700 1 -- 172.21.15.134:0/1407283864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e0107a00 con 0x7fd1e0101e10 2024-04-13T11:10:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.726+0000 7fd1d6ffd700 1 -- 172.21.15.134:0/1407283864 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd1d000f460 con 0x7fd1e0101e10 2024-04-13T11:10:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.726+0000 7fd1d6ffd700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1cc06cda0 0x7fd1cc06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.726+0000 7fd1e5f28700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1cc06cda0 0x7fd1cc06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:57.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.726+0000 7fd1d6ffd700 1 -- 172.21.15.134:0/1407283864 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd1d008d8a0 con 0x7fd1e0101e10 2024-04-13T11:10:57.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.727+0000 7fd1e5f28700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1cc06cda0 0x7fd1cc06f250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009b30 tx=0x7fd1dc009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:57.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.731+0000 7fd1d6ffd700 1 -- 172.21.15.134:0/1407283864 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fd1d005b2d0 con 0x7fd1e0101e10 2024-04-13T11:10:57.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.968+0000 7fd1e818c700 1 -- 172.21.15.134:0/1407283864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fd1e004ea50 con 0x7fd1e0101e10 2024-04-13T11:10:57.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.968+0000 7fd1d6ffd700 1 -- 172.21.15.134:0/1407283864 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v41) v1 ==== 107+0+4838 (secure 0 0 0) 0x7fd1d005ae60 con 0x7fd1e0101e10 2024-04-13T11:10:57.968 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:57.968 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/3497839686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3497839686},{"type":"v1","addr":"172.21.15.194:6825","nonce":3497839686}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34318,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/1858187827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1858187827},{"type":"v1","addr":"172.21.15.134:6827","nonce":1858187827}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:06:58.091559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14492":{"gid":14492,"name":"cephfs.smithi134.kachce","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6829/3278328584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3278328584},{"type":"v1","addr":"172.21.15.134:6829","nonce":3278328584}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:10:57.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.970+0000 7fd1e818c700 1 -- 172.21.15.134:0/1407283864 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1cc06cda0 msgr2=0x7fd1cc06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:57.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.970+0000 7fd1e818c700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1cc06cda0 0x7fd1cc06f250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009b30 tx=0x7fd1dc009260 comp rx=0 tx=0).stop 2024-04-13T11:10:57.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.970+0000 7fd1e818c700 1 -- 172.21.15.134:0/1407283864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1e0101e10 msgr2=0x7fd1e019c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:57.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.970+0000 7fd1e818c700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1e0101e10 0x7fd1e019c010 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000be10 tx=0x7fd1d000bef0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.970+0000 7fd1e818c700 1 -- 172.21.15.134:0/1407283864 shutdown_connections 2024-04-13T11:10:57.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.971+0000 7fd1e818c700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd1cc06cda0 0x7fd1cc06f250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.971+0000 7fd1e818c700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1e0101500 0x7fd1e019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.971+0000 7fd1e818c700 1 --2- 172.21.15.134:0/1407283864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1e0101e10 0x7fd1e019c010 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:57.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.971+0000 7fd1e818c700 1 -- 172.21.15.134:0/1407283864 >> 172.21.15.134:0/1407283864 conn(0x7fd1e00fac70 msgr2=0x7fd1e0104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:57.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.971+0000 7fd1e818c700 1 -- 172.21.15.134:0/1407283864 shutdown_connections 2024-04-13T11:10:57.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:57.971+0000 7fd1e818c700 1 -- 172.21.15.134:0/1407283864 wait complete. 2024-04-13T11:10:57.972 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-04-13T11:10:57.983 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-04-13T11:10:57.983 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-13T11:10:58.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.106+0000 7f851ae4a700 1 -- 172.21.15.134:0/41688430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85140ff2b0 msgr2=0x7f85140ff680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.106+0000 7f851ae4a700 1 --2- 172.21.15.134:0/41688430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85140ff2b0 0x7f85140ff680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8508009910 tx=0x7f8508009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.106+0000 7f851ae4a700 1 -- 172.21.15.134:0/41688430 shutdown_connections 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.106+0000 7f851ae4a700 1 --2- 172.21.15.134:0/41688430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85140ffc50 0x7f8514103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.106+0000 7f851ae4a700 1 --2- 172.21.15.134:0/41688430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85140ff2b0 0x7f85140ff680 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.106+0000 7f851ae4a700 1 -- 172.21.15.134:0/41688430 >> 172.21.15.134:0/41688430 conn(0x7f8514074d90 msgr2=0x7f8514075190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.106+0000 7f851ae4a700 1 -- 172.21.15.134:0/41688430 shutdown_connections 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.106+0000 7f851ae4a700 1 -- 172.21.15.134:0/41688430 wait complete. 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f851ae4a700 1 Processor -- start 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f851ae4a700 1 -- start start 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f851ae4a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85140ff2b0 0x7f851419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f851ae4a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85140ffc50 0x7f851419ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f851ae4a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851419b3c0 con 0x7f85140ffc50 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f851ae4a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514194860 con 0x7f85140ff2b0 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8513fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85140ffc50 0x7f851419ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8513fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85140ffc50 0x7f851419ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35248/0 (socket says 172.21.15.134:35248) 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8513fff700 1 -- 172.21.15.134:0/55623845 learned_addr learned my addr 172.21.15.134:0/55623845 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8518be6700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85140ff2b0 0x7f851419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8513fff700 1 -- 172.21.15.134:0/55623845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85140ff2b0 msgr2=0x7f851419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8513fff700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85140ff2b0 0x7f851419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8513fff700 1 -- 172.21.15.134:0/55623845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85080095f0 con 0x7f85140ffc50 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8513fff700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85140ffc50 0x7f851419ad30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f850000d8d0 tx=0x7f850000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8511ffb700 1 -- 172.21.15.134:0/55623845 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f850000f860 con 0x7f85140ffc50 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f851ae4a700 1 -- 172.21.15.134:0/55623845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8514194b40 con 0x7f85140ffc50 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8511ffb700 1 -- 172.21.15.134:0/55623845 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f850000fe60 con 0x7f85140ffc50 2024-04-13T11:10:58.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.107+0000 7f8511ffb700 1 -- 172.21.15.134:0/55623845 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f850000e3b0 con 0x7f85140ffc50 2024-04-13T11:10:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.108+0000 7f851ae4a700 1 -- 172.21.15.134:0/55623845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85141950a0 con 0x7f85140ffc50 2024-04-13T11:10:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.109+0000 7f851ae4a700 1 -- 172.21.15.134:0/55623845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8514107500 con 0x7f85140ffc50 2024-04-13T11:10:58.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.109+0000 7f8511ffb700 1 -- 172.21.15.134:0/55623845 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8500010840 con 0x7f85140ffc50 2024-04-13T11:10:58.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.109+0000 7f8511ffb700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850406cda0 0x7f850406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:58.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.109+0000 7f8511ffb700 1 -- 172.21.15.134:0/55623845 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f850008c2c0 con 0x7f85140ffc50 2024-04-13T11:10:58.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.109+0000 7f8518be6700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850406cda0 0x7f850406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:58.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.110+0000 7f8518be6700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850406cda0 0x7f850406f250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8508006010 tx=0x7f850801a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:58.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.114+0000 7f8511ffb700 1 -- 172.21.15.134:0/55623845 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f85000599c0 con 0x7f85140ffc50 2024-04-13T11:10:58.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.376+0000 7f851ae4a700 1 -- 172.21.15.134:0/55623845 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f851404ea50 con 0x7f85140ffc50 2024-04-13T11:10:58.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.377+0000 7f8511ffb700 1 -- 172.21.15.134:0/55623845 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v41) v1 ==== 107+0+4056 (secure 0 0 0) 0x7f85000597e0 con 0x7f85140ffc50 2024-04-13T11:10:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:58.378 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/3497839686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3497839686},{"type":"v1","addr":"172.21.15.194:6825","nonce":3497839686}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:06:58.091559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14492":{"gid":14492,"name":"cephfs.smithi134.kachce","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6829/3278328584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3278328584},{"type":"v1","addr":"172.21.15.134:6829","nonce":3278328584}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:10:58.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.379+0000 7f851ae4a700 1 -- 172.21.15.134:0/55623845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850406cda0 msgr2=0x7f850406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:58.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.379+0000 7f851ae4a700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850406cda0 0x7f850406f250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8508006010 tx=0x7f850801a040 comp rx=0 tx=0).stop 2024-04-13T11:10:58.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.379+0000 7f851ae4a700 1 -- 172.21.15.134:0/55623845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85140ffc50 msgr2=0x7f851419ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:58.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.379+0000 7f851ae4a700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85140ffc50 0x7f851419ad30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f850000d8d0 tx=0x7f850000dbe0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.379+0000 7f851ae4a700 1 -- 172.21.15.134:0/55623845 shutdown_connections 2024-04-13T11:10:58.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.379+0000 7f851ae4a700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850406cda0 0x7f850406f250 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.379+0000 7f851ae4a700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85140ff2b0 0x7f851419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.379+0000 7f851ae4a700 1 --2- 172.21.15.134:0/55623845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85140ffc50 0x7f851419ad30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.379+0000 7f851ae4a700 1 -- 172.21.15.134:0/55623845 >> 172.21.15.134:0/55623845 conn(0x7f8514074d90 msgr2=0x7f85140fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:58.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.380+0000 7f851ae4a700 1 -- 172.21.15.134:0/55623845 shutdown_connections 2024-04-13T11:10:58.380 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.380+0000 7f851ae4a700 1 -- 172.21.15.134:0/55623845 wait complete. 2024-04-13T11:10:58.381 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 21 2024-04-13T11:10:58.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:58 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/26898807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-13T11:10:58.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:58 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/245982455' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-13T11:10:58.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:58 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1407283864' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-13T11:10:58.392 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-04-13T11:10:58.393 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-13T11:10:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:58 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/26898807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-13T11:10:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:58 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/245982455' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-13T11:10:58.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:58 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1407283864' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-13T11:10:58.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.521+0000 7f786b34b700 1 -- 172.21.15.134:0/2166503330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78641060c0 msgr2=0x7f7864106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:58.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.521+0000 7f786b34b700 1 --2- 172.21.15.134:0/2166503330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78641060c0 0x7f7864106490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7860009910 tx=0x7f7860009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:58.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.521+0000 7f786b34b700 1 -- 172.21.15.134:0/2166503330 shutdown_connections 2024-04-13T11:10:58.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.521+0000 7f786b34b700 1 --2- 172.21.15.134:0/2166503330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7864067d60 0x7f78640681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.521+0000 7f786b34b700 1 --2- 172.21.15.134:0/2166503330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78641060c0 0x7f7864106490 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.521+0000 7f786b34b700 1 -- 172.21.15.134:0/2166503330 >> 172.21.15.134:0/2166503330 conn(0x7f7864074d90 msgr2=0x7f7864075190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:58.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.521+0000 7f786b34b700 1 -- 172.21.15.134:0/2166503330 shutdown_connections 2024-04-13T11:10:58.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.521+0000 7f786b34b700 1 -- 172.21.15.134:0/2166503330 wait complete. 2024-04-13T11:10:58.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f786b34b700 1 Processor -- start 2024-04-13T11:10:58.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f786b34b700 1 -- start start 2024-04-13T11:10:58.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f786b34b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7864067d60 0x7f786419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:58.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f786b34b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78641060c0 0x7f786419bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:58.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f786b34b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7864195a00 con 0x7f7864067d60 2024-04-13T11:10:58.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f786b34b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7864195b70 con 0x7f78641060c0 2024-04-13T11:10:58.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f78690e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7864067d60 0x7f786419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:58.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f78690e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7864067d60 0x7f786419ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35268/0 (socket says 172.21.15.134:35268) 2024-04-13T11:10:58.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f78690e7700 1 -- 172.21.15.134:0/2507467328 learned_addr learned my addr 172.21.15.134:0/2507467328 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:58.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f78688e6700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78641060c0 0x7f786419bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:58.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f78690e7700 1 -- 172.21.15.134:0/2507467328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78641060c0 msgr2=0x7f786419bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:58.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f78690e7700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78641060c0 0x7f786419bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.522+0000 7f78690e7700 1 -- 172.21.15.134:0/2507467328 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600095f0 con 0x7f7864067d60 2024-04-13T11:10:58.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.523+0000 7f78690e7700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7864067d60 0x7f786419ba20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7860000c00 tx=0x7f786000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:58.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.523+0000 7f785a7fc700 1 -- 172.21.15.134:0/2507467328 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f786001d070 con 0x7f7864067d60 2024-04-13T11:10:58.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.523+0000 7f785a7fc700 1 -- 172.21.15.134:0/2507467328 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7860005dc0 con 0x7f7864067d60 2024-04-13T11:10:58.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.523+0000 7f786b34b700 1 -- 172.21.15.134:0/2507467328 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7864195df0 con 0x7f7864067d60 2024-04-13T11:10:58.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.523+0000 7f785a7fc700 1 -- 172.21.15.134:0/2507467328 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7860003940 con 0x7f7864067d60 2024-04-13T11:10:58.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.523+0000 7f786b34b700 1 -- 172.21.15.134:0/2507467328 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7864196290 con 0x7f7864067d60 2024-04-13T11:10:58.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.524+0000 7f786b34b700 1 -- 172.21.15.134:0/2507467328 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78641085d0 con 0x7f7864067d60 2024-04-13T11:10:58.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.524+0000 7f785a7fc700 1 -- 172.21.15.134:0/2507467328 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f7860004ae0 con 0x7f7864067d60 2024-04-13T11:10:58.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.525+0000 7f785a7fc700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f785006cda0 0x7f785006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:58.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.525+0000 7f785a7fc700 1 -- 172.21.15.134:0/2507467328 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f786008dc60 con 0x7f7864067d60 2024-04-13T11:10:58.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.525+0000 7f78688e6700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f785006cda0 0x7f785006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:58.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.525+0000 7f78688e6700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f785006cda0 0x7f785006f250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7864197230 tx=0x7f7854009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:58.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.529+0000 7f785a7fc700 1 -- 172.21.15.134:0/2507467328 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f7860057c00 con 0x7f7864067d60 2024-04-13T11:10:58.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.818+0000 7f786b34b700 1 -- 172.21.15.134:0/2507467328 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f7864196f30 con 0x7f7864067d60 2024-04-13T11:10:58.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.818+0000 7f785a7fc700 1 -- 172.21.15.134:0/2507467328 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v41) v1 ==== 107+0+4838 (secure 0 0 0) 0x7f786005b220 con 0x7f7864067d60 2024-04-13T11:10:58.819 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:58.819 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/3497839686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3497839686},{"type":"v1","addr":"172.21.15.194:6825","nonce":3497839686}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:06:58.091559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14492":{"gid":14492,"name":"cephfs.smithi134.kachce","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6829/3278328584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3278328584},{"type":"v1","addr":"172.21.15.134:6829","nonce":3278328584}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:10:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 -- 172.21.15.134:0/2507467328 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f785006cda0 msgr2=0x7f785006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f785006cda0 0x7f785006f250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7864197230 tx=0x7f7854009260 comp rx=0 tx=0).stop 2024-04-13T11:10:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 -- 172.21.15.134:0/2507467328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7864067d60 msgr2=0x7f786419ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7864067d60 0x7f786419ba20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7860000c00 tx=0x7f786000bde0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 -- 172.21.15.134:0/2507467328 shutdown_connections 2024-04-13T11:10:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f785006cda0 0x7f785006f250 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7864067d60 0x7f786419ba20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 --2- 172.21.15.134:0/2507467328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78641060c0 0x7f786419bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 -- 172.21.15.134:0/2507467328 >> 172.21.15.134:0/2507467328 conn(0x7f7864074d90 msgr2=0x7f78640fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:58.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 -- 172.21.15.134:0/2507467328 shutdown_connections 2024-04-13T11:10:58.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.821+0000 7f786b34b700 1 -- 172.21.15.134:0/2507467328 wait complete. 2024-04-13T11:10:58.822 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-04-13T11:10:58.833 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-04-13T11:10:58.834 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-13T11:10:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.956+0000 7f8cc1378700 1 -- 172.21.15.134:0/4012905916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cbc0ffda0 msgr2=0x7f8cbc103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.956+0000 7f8cc1378700 1 --2- 172.21.15.134:0/4012905916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cbc0ffda0 0x7f8cbc103d60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009910 tx=0x7f8cac009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.956+0000 7f8cc1378700 1 -- 172.21.15.134:0/4012905916 shutdown_connections 2024-04-13T11:10:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.956+0000 7f8cc1378700 1 --2- 172.21.15.134:0/4012905916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cbc0ffda0 0x7f8cbc103d60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.956+0000 7f8cc1378700 1 --2- 172.21.15.134:0/4012905916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cbc0ff400 0x7f8cbc0ff7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.956+0000 7f8cc1378700 1 -- 172.21.15.134:0/4012905916 >> 172.21.15.134:0/4012905916 conn(0x7f8cbc0fac70 msgr2=0x7f8cbc0fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.956+0000 7f8cc1378700 1 -- 172.21.15.134:0/4012905916 shutdown_connections 2024-04-13T11:10:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.956+0000 7f8cc1378700 1 -- 172.21.15.134:0/4012905916 wait complete. 2024-04-13T11:10:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.956+0000 7f8cc1378700 1 Processor -- start 2024-04-13T11:10:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cc1378700 1 -- start start 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cc1378700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cbc0ff400 0x7f8cbc1949c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cc1378700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cbc0ffda0 0x7f8cbc194f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cc1378700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc195440 con 0x7f8cbc0ff400 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cc1378700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc1955b0 con 0x7f8cbc0ffda0 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cbaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cbc0ff400 0x7f8cbc1949c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cbaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cbc0ff400 0x7f8cbc1949c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35274/0 (socket says 172.21.15.134:35274) 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cbaffd700 1 -- 172.21.15.134:0/3334381471 learned_addr learned my addr 172.21.15.134:0/3334381471 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cba7fc700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cbc0ffda0 0x7f8cbc194f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cbaffd700 1 -- 172.21.15.134:0/3334381471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cbc0ffda0 msgr2=0x7f8cbc194f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cbaffd700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cbc0ffda0 0x7f8cbc194f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cbaffd700 1 -- 172.21.15.134:0/3334381471 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0095f0 con 0x7f8cbc0ff400 2024-04-13T11:10:58.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.957+0000 7f8cbaffd700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cbc0ff400 0x7f8cbc1949c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000d8d0 tx=0x7f8cb000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:58.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.958+0000 7f8ca3fff700 1 -- 172.21.15.134:0/3334381471 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb00098a0 con 0x7f8cbc0ff400 2024-04-13T11:10:58.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.958+0000 7f8cc1378700 1 -- 172.21.15.134:0/3334381471 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cbc1a2030 con 0x7f8cbc0ff400 2024-04-13T11:10:58.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.958+0000 7f8ca3fff700 1 -- 172.21.15.134:0/3334381471 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8cb0010460 con 0x7f8cbc0ff400 2024-04-13T11:10:58.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.958+0000 7f8ca3fff700 1 -- 172.21.15.134:0/3334381471 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb0009ea0 con 0x7f8cbc0ff400 2024-04-13T11:10:58.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.958+0000 7f8cc1378700 1 -- 172.21.15.134:0/3334381471 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cbc1a23a0 con 0x7f8cbc0ff400 2024-04-13T11:10:58.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.959+0000 7f8cc1378700 1 -- 172.21.15.134:0/3334381471 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cbc107760 con 0x7f8cbc0ff400 2024-04-13T11:10:58.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.959+0000 7f8ca3fff700 1 -- 172.21.15.134:0/3334381471 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8cb00105d0 con 0x7f8cbc0ff400 2024-04-13T11:10:58.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.959+0000 7f8ca3fff700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8ca406cda0 0x7f8ca406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:58.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.960+0000 7f8cba7fc700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8ca406cda0 0x7f8ca406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:58.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.960+0000 7f8ca3fff700 1 -- 172.21.15.134:0/3334381471 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f8cb008c4e0 con 0x7f8cbc0ff400 2024-04-13T11:10:58.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.960+0000 7f8cba7fc700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8ca406cda0 0x7f8ca406f250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8cac006010 tx=0x7f8cac01a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:58.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:58.964+0000 7f8ca3fff700 1 -- 172.21.15.134:0/3334381471 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f8cb0059f10 con 0x7f8cbc0ff400 2024-04-13T11:10:59.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.212+0000 7f8cc1378700 1 -- 172.21.15.134:0/3334381471 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f8cbc04ea50 con 0x7f8cbc0ff400 2024-04-13T11:10:59.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.213+0000 7f8ca3fff700 1 -- 172.21.15.134:0/3334381471 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v41) v1 ==== 107+0+4046 (secure 0 0 0) 0x7f8cb0010880 con 0x7f8cbc0ff400 2024-04-13T11:10:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:59.213 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.194:6825/3497839686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3497839686},{"type":"v1","addr":"172.21.15.194:6825","nonce":3497839686}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:07:21.786606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 -- 172.21.15.134:0/3334381471 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8ca406cda0 msgr2=0x7f8ca406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8ca406cda0 0x7f8ca406f250 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8cac006010 tx=0x7f8cac01a040 comp rx=0 tx=0).stop 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 -- 172.21.15.134:0/3334381471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cbc0ff400 msgr2=0x7f8cbc1949c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cbc0ff400 0x7f8cbc1949c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000d8d0 tx=0x7f8cb000dbe0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 -- 172.21.15.134:0/3334381471 shutdown_connections 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f8ca406cda0 0x7f8ca406f250 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cbc0ff400 0x7f8cbc1949c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 --2- 172.21.15.134:0/3334381471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cbc0ffda0 0x7f8cbc194f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 -- 172.21.15.134:0/3334381471 >> 172.21.15.134:0/3334381471 conn(0x7f8cbc0fac70 msgr2=0x7f8cbc0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 -- 172.21.15.134:0/3334381471 shutdown_connections 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.215+0000 7f8cc1378700 1 -- 172.21.15.134:0/3334381471 wait complete. 2024-04-13T11:10:59.216 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 23 2024-04-13T11:10:59.227 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-04-13T11:10:59.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-13T11:10:59.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.350+0000 7f50eb66a700 1 -- 172.21.15.134:0/1006954320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ffc50 msgr2=0x7f50e4103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:59.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.350+0000 7f50eb66a700 1 --2- 172.21.15.134:0/1006954320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ffc50 0x7f50e4103b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009910 tx=0x7f50d4009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:59.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.350+0000 7f50eb66a700 1 -- 172.21.15.134:0/1006954320 shutdown_connections 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 --2- 172.21.15.134:0/1006954320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ffc50 0x7f50e4103b90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 --2- 172.21.15.134:0/1006954320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ff2b0 0x7f50e40ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 -- 172.21.15.134:0/1006954320 >> 172.21.15.134:0/1006954320 conn(0x7f50e4074d90 msgr2=0x7f50e4075190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 -- 172.21.15.134:0/1006954320 shutdown_connections 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 -- 172.21.15.134:0/1006954320 wait complete. 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 Processor -- start 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 -- start start 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ff2b0 0x7f50e419b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ffc50 0x7f50e419be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e419c440 con 0x7f50e40ff2b0 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50eb66a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4195970 con 0x7f50e40ffc50 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50e9406700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ff2b0 0x7f50e419b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50e9406700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ff2b0 0x7f50e419b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53850/0 (socket says 172.21.15.134:53850) 2024-04-13T11:10:59.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.351+0000 7f50e9406700 1 -- 172.21.15.134:0/1810816986 learned_addr learned my addr 172.21.15.134:0/1810816986 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50e8c05700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ffc50 0x7f50e419be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50e9406700 1 -- 172.21.15.134:0/1810816986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ffc50 msgr2=0x7f50e419be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50e9406700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ffc50 0x7f50e419be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50e9406700 1 -- 172.21.15.134:0/1810816986 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40095f0 con 0x7f50e40ff2b0 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50e8c05700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ffc50 0x7f50e419be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50e9406700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ff2b0 0x7f50e419b900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f50e000c930 tx=0x7f50e000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50da7fc700 1 -- 172.21.15.134:0/1810816986 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50e0007ad0 con 0x7f50e40ff2b0 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50eb66a700 1 -- 172.21.15.134:0/1810816986 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e4195c50 con 0x7f50e40ff2b0 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50da7fc700 1 -- 172.21.15.134:0/1810816986 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f50e0007c30 con 0x7f50e40ff2b0 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50da7fc700 1 -- 172.21.15.134:0/1810816986 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50e0018630 con 0x7f50e40ff2b0 2024-04-13T11:10:59.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.352+0000 7f50eb66a700 1 -- 172.21.15.134:0/1810816986 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e4196180 con 0x7f50e40ff2b0 2024-04-13T11:10:59.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.353+0000 7f50eb66a700 1 -- 172.21.15.134:0/1810816986 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e404ea50 con 0x7f50e40ff2b0 2024-04-13T11:10:59.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.353+0000 7f50da7fc700 1 -- 172.21.15.134:0/1810816986 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f50e000f450 con 0x7f50e40ff2b0 2024-04-13T11:10:59.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.354+0000 7f50da7fc700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f50d006cda0 0x7f50d006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:59.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.354+0000 7f50da7fc700 1 -- 172.21.15.134:0/1810816986 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f50e008c940 con 0x7f50e40ff2b0 2024-04-13T11:10:59.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.354+0000 7f50e8c05700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f50d006cda0 0x7f50d006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:59.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.354+0000 7f50e8c05700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f50d006cda0 0x7f50d006f250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f50d4006010 tx=0x7f50d401a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:59.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.358+0000 7f50da7fc700 1 -- 172.21.15.134:0/1810816986 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f50e005a380 con 0x7f50e40ff2b0 2024-04-13T11:10:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:59 smithi134 ceph-mon[112184]: pgmap v386: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:59 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:10:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:59 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/55623845' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-13T11:10:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:59 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:10:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:59 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:10:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:59 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2507467328' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-13T11:10:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:59 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:10:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:59 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:10:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:10:59 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:10:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:59 smithi194 ceph-mon[83053]: pgmap v386: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:10:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:59 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:10:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:59 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/55623845' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-13T11:10:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:59 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:10:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:59 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:10:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:59 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2507467328' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-13T11:10:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:59 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:10:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:59 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:10:59.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:10:59 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:10:59.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.597+0000 7f50eb66a700 1 -- 172.21.15.134:0/1810816986 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f50e41964d0 con 0x7f50e40ff2b0 2024-04-13T11:10:59.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.597+0000 7f50da7fc700 1 -- 172.21.15.134:0/1810816986 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v41) v1 ==== 107+0+4057 (secure 0 0 0) 0x7f50e0059f10 con 0x7f50e40ff2b0 2024-04-13T11:10:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:59.599 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:07:21.792903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24251":{"gid":24251,"name":"cephfs.smithi194.wnddvg","rank":0,"incarnation":24,"state":"up:replay","state_seq":3,"addr":"172.21.15.194:6825/3497839686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3497839686},{"type":"v1","addr":"172.21.15.194:6825","nonce":3497839686}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:10:59.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.599+0000 7f50eb66a700 1 -- 172.21.15.134:0/1810816986 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f50d006cda0 msgr2=0x7f50d006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:59.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.599+0000 7f50eb66a700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f50d006cda0 0x7f50d006f250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f50d4006010 tx=0x7f50d401a040 comp rx=0 tx=0).stop 2024-04-13T11:10:59.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.599+0000 7f50eb66a700 1 -- 172.21.15.134:0/1810816986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ff2b0 msgr2=0x7f50e419b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:59.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.599+0000 7f50eb66a700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ff2b0 0x7f50e419b900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f50e000c930 tx=0x7f50e000ccf0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.599+0000 7f50eb66a700 1 -- 172.21.15.134:0/1810816986 shutdown_connections 2024-04-13T11:10:59.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.600+0000 7f50eb66a700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f50d006cda0 0x7f50d006f250 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.600+0000 7f50eb66a700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50e40ff2b0 0x7f50e419b900 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.600+0000 7f50eb66a700 1 --2- 172.21.15.134:0/1810816986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50e40ffc50 0x7f50e419be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.600+0000 7f50eb66a700 1 -- 172.21.15.134:0/1810816986 >> 172.21.15.134:0/1810816986 conn(0x7f50e4074d90 msgr2=0x7f50e41032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.600+0000 7f50eb66a700 1 -- 172.21.15.134:0/1810816986 shutdown_connections 2024-04-13T11:10:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.600+0000 7f50eb66a700 1 -- 172.21.15.134:0/1810816986 wait complete. 2024-04-13T11:10:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 24 2024-04-13T11:10:59.612 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-04-13T11:10:59.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-13T11:10:59.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.734+0000 7f3df5e62700 1 -- 172.21.15.134:0/1601500086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df00ff440 msgr2=0x7f3df00ff810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:59.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.735+0000 7f3df5e62700 1 --2- 172.21.15.134:0/1601500086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df00ff440 0x7f3df00ff810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009910 tx=0x7f3de4009c20 comp rx=0 tx=0).stop 2024-04-13T11:10:59.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.735+0000 7f3df5e62700 1 -- 172.21.15.134:0/1601500086 shutdown_connections 2024-04-13T11:10:59.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.735+0000 7f3df5e62700 1 --2- 172.21.15.134:0/1601500086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00ffde0 0x7f3df0103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.735+0000 7f3df5e62700 1 --2- 172.21.15.134:0/1601500086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df00ff440 0x7f3df00ff810 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.735+0000 7f3df5e62700 1 -- 172.21.15.134:0/1601500086 >> 172.21.15.134:0/1601500086 conn(0x7f3df00facd0 msgr2=0x7f3df00fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:59.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.735+0000 7f3df5e62700 1 -- 172.21.15.134:0/1601500086 shutdown_connections 2024-04-13T11:10:59.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.735+0000 7f3df5e62700 1 -- 172.21.15.134:0/1601500086 wait complete. 2024-04-13T11:10:59.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.735+0000 7f3df5e62700 1 Processor -- start 2024-04-13T11:10:59.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.735+0000 7f3df5e62700 1 -- start start 2024-04-13T11:10:59.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3df5e62700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df00ff440 0x7f3df0196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:59.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3df5e62700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00ffde0 0x7f3df01970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:59.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3df5e62700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0197710 con 0x7f3df00ff440 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3df5e62700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0197850 con 0x7f3df00ffde0 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3def7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df00ff440 0x7f3df0196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3def7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df00ff440 0x7f3df0196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53862/0 (socket says 172.21.15.134:53862) 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3def7fe700 1 -- 172.21.15.134:0/1930435144 learned_addr learned my addr 172.21.15.134:0/1930435144 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3deeffd700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00ffde0 0x7f3df01970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3def7fe700 1 -- 172.21.15.134:0/1930435144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00ffde0 msgr2=0x7f3df01970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3def7fe700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00ffde0 0x7f3df01970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3def7fe700 1 -- 172.21.15.134:0/1930435144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de40095f0 con 0x7f3df00ff440 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3def7fe700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df00ff440 0x7f3df0196bb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3de4000c00 tx=0x7f3de400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3decff9700 1 -- 172.21.15.134:0/1930435144 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de401d070 con 0x7f3df00ff440 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3decff9700 1 -- 172.21.15.134:0/1930435144 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3de40044c0 con 0x7f3df00ff440 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3df5e62700 1 -- 172.21.15.134:0/1930435144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df019fc20 con 0x7f3df00ff440 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3decff9700 1 -- 172.21.15.134:0/1930435144 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de40039d0 con 0x7f3df00ff440 2024-04-13T11:10:59.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.736+0000 7f3df5e62700 1 -- 172.21.15.134:0/1930435144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df019ffe0 con 0x7f3df00ff440 2024-04-13T11:10:59.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.737+0000 7f3df5e62700 1 -- 172.21.15.134:0/1930435144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df0107740 con 0x7f3df00ff440 2024-04-13T11:10:59.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.738+0000 7f3decff9700 1 -- 172.21.15.134:0/1930435144 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3de40048e0 con 0x7f3df00ff440 2024-04-13T11:10:59.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.738+0000 7f3decff9700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3dd806cda0 0x7f3dd806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:10:59.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.738+0000 7f3deeffd700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3dd806cda0 0x7f3dd806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:10:59.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.738+0000 7f3decff9700 1 -- 172.21.15.134:0/1930435144 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f3de408dd30 con 0x7f3df00ff440 2024-04-13T11:10:59.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.739+0000 7f3deeffd700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3dd806cda0 0x7f3dd806f250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3df00696d0 tx=0x7f3de0009260 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:10:59.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.743+0000 7f3decff9700 1 -- 172.21.15.134:0/1930435144 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f3de4057cd0 con 0x7f3df00ff440 2024-04-13T11:10:59.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.983+0000 7f3df5e62700 1 -- 172.21.15.134:0/1930435144 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f3df004ea50 con 0x7f3df00ff440 2024-04-13T11:10:59.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.983+0000 7f3decff9700 1 -- 172.21.15.134:0/1930435144 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v41) v1 ==== 107+0+4844 (secure 0 0 0) 0x7f3de405b2f0 con 0x7f3df00ff440 2024-04-13T11:10:59.983 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:10:59.983 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:07:31.692828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24251":{"gid":24251,"name":"cephfs.smithi194.wnddvg","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":177,"addr":"172.21.15.194:6825/3497839686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3497839686},{"type":"v1","addr":"172.21.15.194:6825","nonce":3497839686}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.985+0000 7f3df5e62700 1 -- 172.21.15.134:0/1930435144 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3dd806cda0 msgr2=0x7f3dd806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.985+0000 7f3df5e62700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3dd806cda0 0x7f3dd806f250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3df00696d0 tx=0x7f3de0009260 comp rx=0 tx=0).stop 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.986+0000 7f3df5e62700 1 -- 172.21.15.134:0/1930435144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df00ff440 msgr2=0x7f3df0196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.986+0000 7f3df5e62700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df00ff440 0x7f3df0196bb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3de4000c00 tx=0x7f3de400be90 comp rx=0 tx=0).stop 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.986+0000 7f3df5e62700 1 -- 172.21.15.134:0/1930435144 shutdown_connections 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.986+0000 7f3df5e62700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3dd806cda0 0x7f3dd806f250 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.986+0000 7f3df5e62700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3df00ff440 0x7f3df0196bb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.986+0000 7f3df5e62700 1 --2- 172.21.15.134:0/1930435144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00ffde0 0x7f3df01970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.986+0000 7f3df5e62700 1 -- 172.21.15.134:0/1930435144 >> 172.21.15.134:0/1930435144 conn(0x7f3df00facd0 msgr2=0x7f3df00fb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.986+0000 7f3df5e62700 1 -- 172.21.15.134:0/1930435144 shutdown_connections 2024-04-13T11:10:59.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:10:59.986+0000 7f3df5e62700 1 -- 172.21.15.134:0/1930435144 wait complete. 2024-04-13T11:10:59.987 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 25 2024-04-13T11:10:59.998 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-04-13T11:10:59.998 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-13T11:11:00.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.121+0000 7f593d5ff700 1 -- 172.21.15.134:0/145381761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5938100cf0 msgr2=0x7f5938104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:00.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.121+0000 7f593d5ff700 1 --2- 172.21.15.134:0/145381761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5938100cf0 0x7f5938104cb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f592c009910 tx=0x7f592c009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:00.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.121+0000 7f593d5ff700 1 -- 172.21.15.134:0/145381761 shutdown_connections 2024-04-13T11:11:00.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.121+0000 7f593d5ff700 1 --2- 172.21.15.134:0/145381761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5938100cf0 0x7f5938104cb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.121+0000 7f593d5ff700 1 --2- 172.21.15.134:0/145381761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5938100350 0x7f5938100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.121+0000 7f593d5ff700 1 -- 172.21.15.134:0/145381761 >> 172.21.15.134:0/145381761 conn(0x7f59380fbbe0 msgr2=0x7f59380fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.121+0000 7f593d5ff700 1 -- 172.21.15.134:0/145381761 shutdown_connections 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.121+0000 7f593d5ff700 1 -- 172.21.15.134:0/145381761 wait complete. 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.122+0000 7f593d5ff700 1 Processor -- start 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.122+0000 7f593d5ff700 1 -- start start 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.122+0000 7f593d5ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5938100350 0x7f5938073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.122+0000 7f593d5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5938100cf0 0x7f5938073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.122+0000 7f593d5ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938073ad0 con 0x7f5938100350 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.122+0000 7f593d5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938073c10 con 0x7f5938100cf0 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.122+0000 7f5936ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5938100350 0x7f5938073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.122+0000 7f5936ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5938100350 0x7f5938073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53890/0 (socket says 172.21.15.134:53890) 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.122+0000 7f5936ffd700 1 -- 172.21.15.134:0/1301549037 learned_addr learned my addr 172.21.15.134:0/1301549037 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:00.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.123+0000 7f59367fc700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5938100cf0 0x7f5938073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.123+0000 7f5936ffd700 1 -- 172.21.15.134:0/1301549037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5938100cf0 msgr2=0x7f5938073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.123+0000 7f5936ffd700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5938100cf0 0x7f5938073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.123+0000 7f5936ffd700 1 -- 172.21.15.134:0/1301549037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0095f0 con 0x7f5938100350 2024-04-13T11:11:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.123+0000 7f5936ffd700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5938100350 0x7f5938073050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f592800d8d0 tx=0x7f592800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.123+0000 7f591ffff700 1 -- 172.21.15.134:0/1301549037 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59280098a0 con 0x7f5938100350 2024-04-13T11:11:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.123+0000 7f591ffff700 1 -- 172.21.15.134:0/1301549037 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5928010460 con 0x7f5938100350 2024-04-13T11:11:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.123+0000 7f593d5ff700 1 -- 172.21.15.134:0/1301549037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59381a1d30 con 0x7f5938100350 2024-04-13T11:11:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.123+0000 7f591ffff700 1 -- 172.21.15.134:0/1301549037 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5928009ea0 con 0x7f5938100350 2024-04-13T11:11:00.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.123+0000 7f593d5ff700 1 -- 172.21.15.134:0/1301549037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59381a20f0 con 0x7f5938100350 2024-04-13T11:11:00.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.124+0000 7f593d5ff700 1 -- 172.21.15.134:0/1301549037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59381086b0 con 0x7f5938100350 2024-04-13T11:11:00.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.124+0000 7f591ffff700 1 -- 172.21.15.134:0/1301549037 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f59280105d0 con 0x7f5938100350 2024-04-13T11:11:00.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.125+0000 7f591ffff700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f592006cda0 0x7f592006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:00.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.125+0000 7f591ffff700 1 -- 172.21.15.134:0/1301549037 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f592808c510 con 0x7f5938100350 2024-04-13T11:11:00.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.125+0000 7f59367fc700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f592006cda0 0x7f592006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:00.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.125+0000 7f59367fc700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f592006cda0 0x7f592006f250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f592c009fd0 tx=0x7f592c01a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:00.129 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.129+0000 7f591ffff700 1 -- 172.21.15.134:0/1301549037 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f59280564a0 con 0x7f5938100350 2024-04-13T11:11:00.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.373+0000 7f593d5ff700 1 -- 172.21.15.134:0/1301549037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f593804ea50 con 0x7f5938100350 2024-04-13T11:11:00.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.373+0000 7f591ffff700 1 -- 172.21.15.134:0/1301549037 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v41) v1 ==== 107+0+4841 (secure 0 0 0) 0x7f5928010880 con 0x7f5938100350 2024-04-13T11:11:00.373 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:00.373 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:07:32.697953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24251":{"gid":24251,"name":"cephfs.smithi194.wnddvg","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":178,"addr":"172.21.15.194:6825/3497839686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3497839686},{"type":"v1","addr":"172.21.15.194:6825","nonce":3497839686}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.375+0000 7f593d5ff700 1 -- 172.21.15.134:0/1301549037 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f592006cda0 msgr2=0x7f592006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.375+0000 7f593d5ff700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f592006cda0 0x7f592006f250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f592c009fd0 tx=0x7f592c01a040 comp rx=0 tx=0).stop 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.375+0000 7f593d5ff700 1 -- 172.21.15.134:0/1301549037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5938100350 msgr2=0x7f5938073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.375+0000 7f593d5ff700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5938100350 0x7f5938073050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f592800d8d0 tx=0x7f592800dbe0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.376+0000 7f593d5ff700 1 -- 172.21.15.134:0/1301549037 shutdown_connections 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.376+0000 7f593d5ff700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f592006cda0 0x7f592006f250 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.376+0000 7f593d5ff700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5938100350 0x7f5938073050 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.376+0000 7f593d5ff700 1 --2- 172.21.15.134:0/1301549037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5938100cf0 0x7f5938073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.376+0000 7f593d5ff700 1 -- 172.21.15.134:0/1301549037 >> 172.21.15.134:0/1301549037 conn(0x7f59380fbbe0 msgr2=0x7f59380fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.376+0000 7f593d5ff700 1 -- 172.21.15.134:0/1301549037 shutdown_connections 2024-04-13T11:11:00.376 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.376+0000 7f593d5ff700 1 -- 172.21.15.134:0/1301549037 wait complete. 2024-04-13T11:11:00.377 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 26 2024-04-13T11:11:00.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:00 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3334381471' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-13T11:11:00.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:00 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1810816986' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-13T11:11:00.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:00 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1930435144' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-13T11:11:00.388 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-04-13T11:11:00.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-13T11:11:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:00 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3334381471' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-13T11:11:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:00 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1810816986' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-13T11:11:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:00 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1930435144' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-13T11:11:00.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.510+0000 7f0378aa0700 1 -- 172.21.15.134:0/431487263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740ffd80 msgr2=0x7f0374103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:00.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.510+0000 7f0378aa0700 1 --2- 172.21.15.134:0/431487263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740ffd80 0x7f0374103330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f036800aa20 tx=0x7f036800ad30 comp rx=0 tx=0).stop 2024-04-13T11:11:00.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.510+0000 7f0378aa0700 1 -- 172.21.15.134:0/431487263 shutdown_connections 2024-04-13T11:11:00.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.510+0000 7f0378aa0700 1 --2- 172.21.15.134:0/431487263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740ffd80 0x7f0374103330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.511+0000 7f0378aa0700 1 --2- 172.21.15.134:0/431487263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03740ff3e0 0x7f03740ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.511+0000 7f0378aa0700 1 -- 172.21.15.134:0/431487263 >> 172.21.15.134:0/431487263 conn(0x7f03740747a0 msgr2=0x7f0374074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:00.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.511+0000 7f0378aa0700 1 -- 172.21.15.134:0/431487263 shutdown_connections 2024-04-13T11:11:00.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.511+0000 7f0378aa0700 1 -- 172.21.15.134:0/431487263 wait complete. 2024-04-13T11:11:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.511+0000 7f0378aa0700 1 Processor -- start 2024-04-13T11:11:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f0378aa0700 1 -- start start 2024-04-13T11:11:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f0378aa0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740ff3e0 0x7f03741996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f0378aa0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03740ffd80 0x7f0374199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f0378aa0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037419a2a0 con 0x7f03740ff3e0 2024-04-13T11:11:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f0378aa0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0374193740 con 0x7f03740ffd80 2024-04-13T11:11:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f037259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740ff3e0 0x7f03741996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f037259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740ff3e0 0x7f03741996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53920/0 (socket says 172.21.15.134:53920) 2024-04-13T11:11:00.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f037259c700 1 -- 172.21.15.134:0/3348568787 learned_addr learned my addr 172.21.15.134:0/3348568787 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f0371d9b700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03740ffd80 0x7f0374199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f037259c700 1 -- 172.21.15.134:0/3348568787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03740ffd80 msgr2=0x7f0374199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f037259c700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03740ffd80 0x7f0374199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f037259c700 1 -- 172.21.15.134:0/3348568787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036800a700 con 0x7f03740ff3e0 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.512+0000 7f037259c700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740ff3e0 0x7f03741996d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f036400c8f0 tx=0x7f036400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.513+0000 7f03637fe700 1 -- 172.21.15.134:0/3348568787 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0364007a70 con 0x7f03740ff3e0 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.513+0000 7f0378aa0700 1 -- 172.21.15.134:0/3348568787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0374193a20 con 0x7f03740ff3e0 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.513+0000 7f03637fe700 1 -- 172.21.15.134:0/3348568787 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0364007bd0 con 0x7f03740ff3e0 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.513+0000 7f03637fe700 1 -- 172.21.15.134:0/3348568787 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0364018630 con 0x7f03740ff3e0 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.513+0000 7f0378aa0700 1 -- 172.21.15.134:0/3348568787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0374193f50 con 0x7f03740ff3e0 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.513+0000 7f0378aa0700 1 -- 172.21.15.134:0/3348568787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0374106bd0 con 0x7f03740ff3e0 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.514+0000 7f03637fe700 1 -- 172.21.15.134:0/3348568787 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f036400f450 con 0x7f03740ff3e0 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.514+0000 7f03637fe700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f035c06cda0 0x7f035c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:00.516 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.514+0000 7f03637fe700 1 -- 172.21.15.134:0/3348568787 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f036408c650 con 0x7f03740ff3e0 2024-04-13T11:11:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.514+0000 7f0371d9b700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f035c06cda0 0x7f035c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:00.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.515+0000 7f0371d9b700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f035c06cda0 0x7f035c06f250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f036800afd0 tx=0x7f036800c690 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:00.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.519+0000 7f03637fe700 1 -- 172.21.15.134:0/3348568787 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f036405a080 con 0x7f03740ff3e0 2024-04-13T11:11:00.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.758+0000 7f0378aa0700 1 -- 172.21.15.134:0/3348568787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f037404ea50 con 0x7f03740ff3e0 2024-04-13T11:11:00.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.759+0000 7f03637fe700 1 -- 172.21.15.134:0/3348568787 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v41) v1 ==== 107+0+4841 (secure 0 0 0) 0x7f0364059c10 con 0x7f03740ff3e0 2024-04-13T11:11:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:00.759 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:07:33.703063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24251":{"gid":24251,"name":"cephfs.smithi194.wnddvg","rank":0,"incarnation":24,"state":"up:active","state_seq":179,"addr":"172.21.15.194:6825/3497839686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3497839686},{"type":"v1","addr":"172.21.15.194:6825","nonce":3497839686}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 -- 172.21.15.134:0/3348568787 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f035c06cda0 msgr2=0x7f035c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:00.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f035c06cda0 0x7f035c06f250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f036800afd0 tx=0x7f036800c690 comp rx=0 tx=0).stop 2024-04-13T11:11:00.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 -- 172.21.15.134:0/3348568787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740ff3e0 msgr2=0x7f03741996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:00.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740ff3e0 0x7f03741996d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f036400c8f0 tx=0x7f036400ccb0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 -- 172.21.15.134:0/3348568787 shutdown_connections 2024-04-13T11:11:00.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f035c06cda0 0x7f035c06f250 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740ff3e0 0x7f03741996d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 --2- 172.21.15.134:0/3348568787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03740ffd80 0x7f0374199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 -- 172.21.15.134:0/3348568787 >> 172.21.15.134:0/3348568787 conn(0x7f03740747a0 msgr2=0x7f0374102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:00.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 -- 172.21.15.134:0/3348568787 shutdown_connections 2024-04-13T11:11:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.761+0000 7f0378aa0700 1 -- 172.21.15.134:0/3348568787 wait complete. 2024-04-13T11:11:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 27 2024-04-13T11:11:00.773 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-04-13T11:11:00.773 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-13T11:11:00.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.895+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/1057505300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b0101dd0 msgr2=0x7ff3b010a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:00.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.895+0000 7ff3b5a3c700 1 --2- 172.21.15.134:0/1057505300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b0101dd0 0x7ff3b010a2c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009910 tx=0x7ff3a4009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:00.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.895+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/1057505300 shutdown_connections 2024-04-13T11:11:00.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.895+0000 7ff3b5a3c700 1 --2- 172.21.15.134:0/1057505300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b0101dd0 0x7ff3b010a2c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.895+0000 7ff3b5a3c700 1 --2- 172.21.15.134:0/1057505300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b01014c0 0x7ff3b0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.895+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/1057505300 >> 172.21.15.134:0/1057505300 conn(0x7ff3b00fac70 msgr2=0x7ff3b00fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:00.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.895+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/1057505300 shutdown_connections 2024-04-13T11:11:00.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.895+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/1057505300 wait complete. 2024-04-13T11:11:00.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.896+0000 7ff3b5a3c700 1 Processor -- start 2024-04-13T11:11:00.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.896+0000 7ff3b5a3c700 1 -- start start 2024-04-13T11:11:00.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.896+0000 7ff3b5a3c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b01014c0 0x7ff3b0195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.896+0000 7ff3b5a3c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b0101dd0 0x7ff3b0196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.896+0000 7ff3b5a3c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0196a20 con 0x7ff3b01014c0 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.896+0000 7ff3b5a3c700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b019a7a0 con 0x7ff3b0101dd0 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.896+0000 7ff3aeffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b01014c0 0x7ff3b0195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.896+0000 7ff3aeffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b01014c0 0x7ff3b0195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53934/0 (socket says 172.21.15.134:53934) 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.896+0000 7ff3aeffd700 1 -- 172.21.15.134:0/898173503 learned_addr learned my addr 172.21.15.134:0/898173503 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3ae7fc700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b0101dd0 0x7ff3b0196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3aeffd700 1 -- 172.21.15.134:0/898173503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b0101dd0 msgr2=0x7ff3b0196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3aeffd700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b0101dd0 0x7ff3b0196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3aeffd700 1 -- 172.21.15.134:0/898173503 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a40095f0 con 0x7ff3b01014c0 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3ae7fc700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b0101dd0 0x7ff3b0196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3aeffd700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b01014c0 0x7ff3b0195e00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000b4b0 tx=0x7ff3a000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:00.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3b4a3a700 1 -- 172.21.15.134:0/898173503 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a0011800 con 0x7ff3b01014c0 2024-04-13T11:11:00.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/898173503 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b019aa80 con 0x7ff3b01014c0 2024-04-13T11:11:00.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3b4a3a700 1 -- 172.21.15.134:0/898173503 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff3a0011e00 con 0x7ff3b01014c0 2024-04-13T11:11:00.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3b4a3a700 1 -- 172.21.15.134:0/898173503 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a0010e50 con 0x7ff3b01014c0 2024-04-13T11:11:00.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.897+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/898173503 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b019afe0 con 0x7ff3b01014c0 2024-04-13T11:11:00.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.898+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/898173503 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b01079c0 con 0x7ff3b01014c0 2024-04-13T11:11:00.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.898+0000 7ff3b4a3a700 1 -- 172.21.15.134:0/898173503 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff3a0010380 con 0x7ff3b01014c0 2024-04-13T11:11:00.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.899+0000 7ff3b4a3a700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff39806cda0 0x7ff39806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:00.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.899+0000 7ff3b4a3a700 1 -- 172.21.15.134:0/898173503 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7ff3a008c260 con 0x7ff3b01014c0 2024-04-13T11:11:00.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.899+0000 7ff3ae7fc700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff39806cda0 0x7ff39806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:00.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.899+0000 7ff3ae7fc700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff39806cda0 0x7ff39806f250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400b5c0 tx=0x7ff3a4005960 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:00.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:00.903+0000 7ff3b4a3a700 1 -- 172.21.15.134:0/898173503 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7ff3a0056200 con 0x7ff3b01014c0 2024-04-13T11:11:01.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.144+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/898173503 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7ff3b0197210 con 0x7ff3b01014c0 2024-04-13T11:11:01.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.145+0000 7ff3b4a3a700 1 -- 172.21.15.134:0/898173503 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v41) v1 ==== 107+0+4046 (secure 0 0 0) 0x7ff3a0059820 con 0x7ff3b01014c0 2024-04-13T11:11:01.145 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:01.145 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:07:45.818859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:01.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/898173503 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff39806cda0 msgr2=0x7ff39806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:01.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff39806cda0 0x7ff39806f250 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400b5c0 tx=0x7ff3a4005960 comp rx=0 tx=0).stop 2024-04-13T11:11:01.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/898173503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b01014c0 msgr2=0x7ff3b0195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:01.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b01014c0 0x7ff3b0195e00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000b4b0 tx=0x7ff3a000b870 comp rx=0 tx=0).stop 2024-04-13T11:11:01.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/898173503 shutdown_connections 2024-04-13T11:11:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff39806cda0 0x7ff39806f250 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3b01014c0 0x7ff3b0195e00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 --2- 172.21.15.134:0/898173503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3b0101dd0 0x7ff3b0196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/898173503 >> 172.21.15.134:0/898173503 conn(0x7ff3b00fac70 msgr2=0x7ff3b0104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/898173503 shutdown_connections 2024-04-13T11:11:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.147+0000 7ff3b5a3c700 1 -- 172.21.15.134:0/898173503 wait complete. 2024-04-13T11:11:01.148 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 28 2024-04-13T11:11:01.159 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-04-13T11:11:01.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-13T11:11:01.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.283+0000 7fe732808700 1 -- 172.21.15.134:0/1658850521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0ff410 msgr2=0x7fe72c0ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.283+0000 7fe732808700 1 --2- 172.21.15.134:0/1658850521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0ff410 0x7fe72c0ff7e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe714009910 tx=0x7fe714009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.283+0000 7fe732808700 1 -- 172.21.15.134:0/1658850521 shutdown_connections 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.283+0000 7fe732808700 1 --2- 172.21.15.134:0/1658850521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe72c0ffdb0 0x7fe72c103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.283+0000 7fe732808700 1 --2- 172.21.15.134:0/1658850521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0ff410 0x7fe72c0ff7e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.283+0000 7fe732808700 1 -- 172.21.15.134:0/1658850521 >> 172.21.15.134:0/1658850521 conn(0x7fe72c0faca0 msgr2=0x7fe72c0fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.283+0000 7fe732808700 1 -- 172.21.15.134:0/1658850521 shutdown_connections 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.283+0000 7fe732808700 1 -- 172.21.15.134:0/1658850521 wait complete. 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.283+0000 7fe732808700 1 Processor -- start 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.283+0000 7fe732808700 1 -- start start 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe732808700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe72c0ff410 0x7fe72c195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe732808700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0ffdb0 0x7fe72c196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe732808700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c1969e0 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe732808700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c19a760 con 0x7fe72c0ff410 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe72b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0ffdb0 0x7fe72c196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe72b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0ffdb0 0x7fe72c196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53942/0 (socket says 172.21.15.134:53942) 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe72b7fe700 1 -- 172.21.15.134:0/1846775391 learned_addr learned my addr 172.21.15.134:0/1846775391 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe72bfff700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe72c0ff410 0x7fe72c195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe72b7fe700 1 -- 172.21.15.134:0/1846775391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe72c0ff410 msgr2=0x7fe72c195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe72b7fe700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe72c0ff410 0x7fe72c195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe72b7fe700 1 -- 172.21.15.134:0/1846775391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7140095f0 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe72bfff700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe72c0ff410 0x7fe72c195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe72b7fe700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0ffdb0 0x7fe72c196300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00e8c0 tx=0x7fe71c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe7297fa700 1 -- 172.21.15.134:0/1846775391 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe71c00cba0 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe732808700 1 -- 172.21.15.134:0/1846775391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72c19aa40 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe7297fa700 1 -- 172.21.15.134:0/1846775391 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe71c00eec0 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe7297fa700 1 -- 172.21.15.134:0/1846775391 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe71c018650 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.284+0000 7fe732808700 1 -- 172.21.15.134:0/1846775391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72c19afa0 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.285+0000 7fe732808700 1 -- 172.21.15.134:0/1846775391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72c04ea50 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.286+0000 7fe7297fa700 1 -- 172.21.15.134:0/1846775391 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe71c010430 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.286+0000 7fe7297fa700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe71806cda0 0x7fe71806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.286+0000 7fe7297fa700 1 -- 172.21.15.134:0/1846775391 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fe71c014070 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.286+0000 7fe72bfff700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe71806cda0 0x7fe71806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:01.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.287+0000 7fe72bfff700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe71806cda0 0x7fe71806f250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe7140059d0 tx=0x7fe714005940 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:01.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.291+0000 7fe7297fa700 1 -- 172.21.15.134:0/1846775391 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fe71c052ab0 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:01 smithi134 ceph-mon[112184]: pgmap v387: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:01.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:01 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1301549037' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-13T11:11:01.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:01 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3348568787' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-13T11:11:01.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:01 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/898173503' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-13T11:11:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:01 smithi194 ceph-mon[83053]: pgmap v387: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:01 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1301549037' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-13T11:11:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:01 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3348568787' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-13T11:11:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:01 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/898173503' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-13T11:11:01.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.529+0000 7fe732808700 1 -- 172.21.15.134:0/1846775391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fe72c0672b0 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.530+0000 7fe7297fa700 1 -- 172.21.15.134:0/1846775391 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v41) v1 ==== 107+0+4057 (secure 0 0 0) 0x7fe71c056970 con 0x7fe72c0ffdb0 2024-04-13T11:11:01.530 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:01.531 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:07:45.826256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:01.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 -- 172.21.15.134:0/1846775391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe71806cda0 msgr2=0x7fe71806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:01.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe71806cda0 0x7fe71806f250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe7140059d0 tx=0x7fe714005940 comp rx=0 tx=0).stop 2024-04-13T11:11:01.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 -- 172.21.15.134:0/1846775391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0ffdb0 msgr2=0x7fe72c196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:01.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0ffdb0 0x7fe72c196300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00e8c0 tx=0x7fe71c00ec80 comp rx=0 tx=0).stop 2024-04-13T11:11:01.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 -- 172.21.15.134:0/1846775391 shutdown_connections 2024-04-13T11:11:01.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe71806cda0 0x7fe71806f250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe72c0ff410 0x7fe72c195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 --2- 172.21.15.134:0/1846775391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe72c0ffdb0 0x7fe72c196300 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 -- 172.21.15.134:0/1846775391 >> 172.21.15.134:0/1846775391 conn(0x7fe72c0faca0 msgr2=0x7fe72c068de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 -- 172.21.15.134:0/1846775391 shutdown_connections 2024-04-13T11:11:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.532+0000 7fe732808700 1 -- 172.21.15.134:0/1846775391 wait complete. 2024-04-13T11:11:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 29 2024-04-13T11:11:01.544 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-04-13T11:11:01.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-13T11:11:01.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.667+0000 7feda0a4b700 1 -- 172.21.15.134:0/1268386548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c100300 msgr2=0x7fed9c1006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:01.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.667+0000 7feda0a4b700 1 --2- 172.21.15.134:0/1268386548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c100300 0x7fed9c1006d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009940 tx=0x7fed8c009c50 comp rx=0 tx=0).stop 2024-04-13T11:11:01.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.667+0000 7feda0a4b700 1 -- 172.21.15.134:0/1268386548 shutdown_connections 2024-04-13T11:11:01.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.667+0000 7feda0a4b700 1 --2- 172.21.15.134:0/1268386548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c100c10 0x7fed9c109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.667+0000 7feda0a4b700 1 --2- 172.21.15.134:0/1268386548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c100300 0x7fed9c1006d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.667+0000 7feda0a4b700 1 -- 172.21.15.134:0/1268386548 >> 172.21.15.134:0/1268386548 conn(0x7fed9c074730 msgr2=0x7fed9c074b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.667+0000 7feda0a4b700 1 -- 172.21.15.134:0/1268386548 shutdown_connections 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.667+0000 7feda0a4b700 1 -- 172.21.15.134:0/1268386548 wait complete. 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.668+0000 7feda0a4b700 1 Processor -- start 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.668+0000 7feda0a4b700 1 -- start start 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.668+0000 7feda0a4b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c100300 0x7fed9c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.668+0000 7feda0a4b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c100c10 0x7fed9c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.668+0000 7feda0a4b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c19c520 con 0x7fed9c100c10 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.668+0000 7feda0a4b700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1959c0 con 0x7fed9c100300 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.668+0000 7fed99d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c100c10 0x7fed9c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed99d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c100c10 0x7fed9c19be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53958/0 (socket says 172.21.15.134:53958) 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed99d9b700 1 -- 172.21.15.134:0/3727503437 learned_addr learned my addr 172.21.15.134:0/3727503437 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:01.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed9a59c700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c100300 0x7fed9c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed99d9b700 1 -- 172.21.15.134:0/3727503437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c100300 msgr2=0x7fed9c19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed99d9b700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c100300 0x7fed9c19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed99d9b700 1 -- 172.21.15.134:0/3727503437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0095f0 con 0x7fed9c100c10 2024-04-13T11:11:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed9a59c700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c100300 0x7fed9c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:11:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed99d9b700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c100c10 0x7fed9c19be90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fed9000b4b0 tx=0x7fed9000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed8b7fe700 1 -- 172.21.15.134:0/3727503437 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed90011800 con 0x7fed9c100c10 2024-04-13T11:11:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed8b7fe700 1 -- 172.21.15.134:0/3727503437 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fed90011e00 con 0x7fed9c100c10 2024-04-13T11:11:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7fed8b7fe700 1 -- 172.21.15.134:0/3727503437 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed90010e50 con 0x7fed9c100c10 2024-04-13T11:11:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7feda0a4b700 1 -- 172.21.15.134:0/3727503437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c195ca0 con 0x7fed9c100c10 2024-04-13T11:11:01.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.669+0000 7feda0a4b700 1 -- 172.21.15.134:0/3727503437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c196200 con 0x7fed9c100c10 2024-04-13T11:11:01.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.670+0000 7feda0a4b700 1 -- 172.21.15.134:0/3727503437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c107ce0 con 0x7fed9c100c10 2024-04-13T11:11:01.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.670+0000 7fed8b7fe700 1 -- 172.21.15.134:0/3727503437 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fed90011960 con 0x7fed9c100c10 2024-04-13T11:11:01.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.671+0000 7fed8b7fe700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fed8406cda0 0x7fed8406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:01.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.671+0000 7fed9a59c700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fed8406cda0 0x7fed8406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:01.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.671+0000 7fed8b7fe700 1 -- 172.21.15.134:0/3727503437 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fed9008c270 con 0x7fed9c100c10 2024-04-13T11:11:01.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.671+0000 7fed9a59c700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fed8406cda0 0x7fed8406f250 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fed8c000c00 tx=0x7fed8c005fb0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:01.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.675+0000 7fed8b7fe700 1 -- 172.21.15.134:0/3727503437 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fed90059ca0 con 0x7fed9c100c10 2024-04-13T11:11:01.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.916+0000 7feda0a4b700 1 -- 172.21.15.134:0/3727503437 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fed9c04ea50 con 0x7fed9c100c10 2024-04-13T11:11:01.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.917+0000 7fed8b7fe700 1 -- 172.21.15.134:0/3727503437 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v41) v1 ==== 107+0+4062 (secure 0 0 0) 0x7fed90059830 con 0x7fed9c100c10 2024-04-13T11:11:01.917 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:01.917 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:07:55.644104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":181,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 -- 172.21.15.134:0/3727503437 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fed8406cda0 msgr2=0x7fed8406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fed8406cda0 0x7fed8406f250 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fed8c000c00 tx=0x7fed8c005fb0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 -- 172.21.15.134:0/3727503437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c100c10 msgr2=0x7fed9c19be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c100c10 0x7fed9c19be90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fed9000b4b0 tx=0x7fed9000b870 comp rx=0 tx=0).stop 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 -- 172.21.15.134:0/3727503437 shutdown_connections 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fed8406cda0 0x7fed8406f250 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed9c100300 0x7fed9c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 --2- 172.21.15.134:0/3727503437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed9c100c10 0x7fed9c19be90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 -- 172.21.15.134:0/3727503437 >> 172.21.15.134:0/3727503437 conn(0x7fed9c074730 msgr2=0x7fed9c0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 -- 172.21.15.134:0/3727503437 shutdown_connections 2024-04-13T11:11:01.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:01.919+0000 7feda0a4b700 1 -- 172.21.15.134:0/3727503437 wait complete. 2024-04-13T11:11:01.920 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 30 2024-04-13T11:11:01.931 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-04-13T11:11:01.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-13T11:11:02.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.053+0000 7f852a6f5700 1 -- 172.21.15.134:0/1401158623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85240ff170 msgr2=0x7f85240ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:02.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.053+0000 7f852a6f5700 1 --2- 172.21.15.134:0/1401158623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85240ff170 0x7f85240ff540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8514009910 tx=0x7f8514009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:02.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.053+0000 7f852a6f5700 1 -- 172.21.15.134:0/1401158623 shutdown_connections 2024-04-13T11:11:02.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.053+0000 7f852a6f5700 1 --2- 172.21.15.134:0/1401158623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85240ffa80 0x7f852410a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.053+0000 7f852a6f5700 1 --2- 172.21.15.134:0/1401158623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85240ff170 0x7f85240ff540 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.053+0000 7f852a6f5700 1 -- 172.21.15.134:0/1401158623 >> 172.21.15.134:0/1401158623 conn(0x7f85240747a0 msgr2=0x7f8524074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.053+0000 7f852a6f5700 1 -- 172.21.15.134:0/1401158623 shutdown_connections 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.053+0000 7f852a6f5700 1 -- 172.21.15.134:0/1401158623 wait complete. 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.054+0000 7f852a6f5700 1 Processor -- start 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.054+0000 7f852a6f5700 1 -- start start 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.054+0000 7f852a6f5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85240ff170 0x7f852419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.054+0000 7f852a6f5700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85240ffa80 0x7f852419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.054+0000 7f852a6f5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852419c440 con 0x7f85240ff170 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.054+0000 7f852a6f5700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85241958e0 con 0x7f85240ffa80 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.054+0000 7f8523fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85240ff170 0x7f852419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.054+0000 7f8523fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85240ff170 0x7f852419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53980/0 (socket says 172.21.15.134:53980) 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.054+0000 7f8523fff700 1 -- 172.21.15.134:0/953878439 learned_addr learned my addr 172.21.15.134:0/953878439 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:02.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.055+0000 7f85237fe700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85240ffa80 0x7f852419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:02.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.055+0000 7f8523fff700 1 -- 172.21.15.134:0/953878439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85240ffa80 msgr2=0x7f852419bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:02.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.055+0000 7f8523fff700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85240ffa80 0x7f852419bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.055+0000 7f8523fff700 1 -- 172.21.15.134:0/953878439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85140095f0 con 0x7f85240ff170 2024-04-13T11:11:02.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.055+0000 7f8523fff700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85240ff170 0x7f852419b870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f85140055f0 tx=0x7f85140056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:02.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.055+0000 7f85217fa700 1 -- 172.21.15.134:0/953878439 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851401d070 con 0x7f85240ff170 2024-04-13T11:11:02.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.055+0000 7f852a6f5700 1 -- 172.21.15.134:0/953878439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8524195b60 con 0x7f85240ff170 2024-04-13T11:11:02.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.055+0000 7f85217fa700 1 -- 172.21.15.134:0/953878439 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f851400f460 con 0x7f85240ff170 2024-04-13T11:11:02.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.055+0000 7f85217fa700 1 -- 172.21.15.134:0/953878439 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8514021640 con 0x7f85240ff170 2024-04-13T11:11:02.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.055+0000 7f852a6f5700 1 -- 172.21.15.134:0/953878439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8524196140 con 0x7f85240ff170 2024-04-13T11:11:02.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.056+0000 7f852a6f5700 1 -- 172.21.15.134:0/953878439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8524107bf0 con 0x7f85240ff170 2024-04-13T11:11:02.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.056+0000 7f85217fa700 1 -- 172.21.15.134:0/953878439 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8514003a60 con 0x7f85240ff170 2024-04-13T11:11:02.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.057+0000 7f85217fa700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850c06cda0 0x7f850c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:02.058 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.057+0000 7f85217fa700 1 -- 172.21.15.134:0/953878439 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f851408d920 con 0x7f85240ff170 2024-04-13T11:11:02.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.057+0000 7f85237fe700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850c06cda0 0x7f850c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:02.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.057+0000 7f85237fe700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850c06cda0 0x7f850c06f250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8518005fd0 tx=0x7f851800a560 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:02.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.061+0000 7f85217fa700 1 -- 172.21.15.134:0/953878439 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f851405b350 con 0x7f85240ff170 2024-04-13T11:11:02.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.299+0000 7f852a6f5700 1 -- 172.21.15.134:0/953878439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f85241964c0 con 0x7f85240ff170 2024-04-13T11:11:02.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.299+0000 7f85217fa700 1 -- 172.21.15.134:0/953878439 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v41) v1 ==== 107+0+4841 (secure 0 0 0) 0x7f851405aee0 con 0x7f85240ff170 2024-04-13T11:11:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:02.300 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:07:56.645762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":0,"incarnation":29,"state":"up:rejoin","state_seq":182,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:02.301 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.301+0000 7f852a6f5700 1 -- 172.21.15.134:0/953878439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850c06cda0 msgr2=0x7f850c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:02.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.301+0000 7f852a6f5700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850c06cda0 0x7f850c06f250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8518005fd0 tx=0x7f851800a560 comp rx=0 tx=0).stop 2024-04-13T11:11:02.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.301+0000 7f852a6f5700 1 -- 172.21.15.134:0/953878439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85240ff170 msgr2=0x7f852419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:02.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.301+0000 7f852a6f5700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85240ff170 0x7f852419b870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f85140055f0 tx=0x7f85140056d0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.302+0000 7f852a6f5700 1 -- 172.21.15.134:0/953878439 shutdown_connections 2024-04-13T11:11:02.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.302+0000 7f852a6f5700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f850c06cda0 0x7f850c06f250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.302+0000 7f852a6f5700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85240ff170 0x7f852419b870 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.302+0000 7f852a6f5700 1 --2- 172.21.15.134:0/953878439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85240ffa80 0x7f852419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.302+0000 7f852a6f5700 1 -- 172.21.15.134:0/953878439 >> 172.21.15.134:0/953878439 conn(0x7f85240747a0 msgr2=0x7f8524104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:02.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.302+0000 7f852a6f5700 1 -- 172.21.15.134:0/953878439 shutdown_connections 2024-04-13T11:11:02.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.302+0000 7f852a6f5700 1 -- 172.21.15.134:0/953878439 wait complete. 2024-04-13T11:11:02.303 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 31 2024-04-13T11:11:02.314 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-04-13T11:11:02.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-13T11:11:02.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.441+0000 7f78adce2700 1 -- 172.21.15.134:0/2493781616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a8067d60 msgr2=0x7f78a80681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:02.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.441+0000 7f78adce2700 1 --2- 172.21.15.134:0/2493781616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a8067d60 0x7f78a80681b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7898009910 tx=0x7f7898009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:02.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.441+0000 7f78adce2700 1 -- 172.21.15.134:0/2493781616 shutdown_connections 2024-04-13T11:11:02.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.441+0000 7f78adce2700 1 --2- 172.21.15.134:0/2493781616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a8067d60 0x7f78a80681b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.441+0000 7f78adce2700 1 --2- 172.21.15.134:0/2493781616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78a81060c0 0x7f78a8106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.441+0000 7f78adce2700 1 -- 172.21.15.134:0/2493781616 >> 172.21.15.134:0/2493781616 conn(0x7f78a8074d90 msgr2=0x7f78a8075190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:02.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.441+0000 7f78adce2700 1 -- 172.21.15.134:0/2493781616 shutdown_connections 2024-04-13T11:11:02.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.441+0000 7f78adce2700 1 -- 172.21.15.134:0/2493781616 wait complete. 2024-04-13T11:11:02.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78adce2700 1 Processor -- start 2024-04-13T11:11:02.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78adce2700 1 -- start start 2024-04-13T11:11:02.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78adce2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a8067d60 0x7f78a819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:02.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78adce2700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78a81060c0 0x7f78a819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:02.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78adce2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a819c460 con 0x7f78a8067d60 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78adce2700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8195900 con 0x7f78a81060c0 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78a77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a8067d60 0x7f78a819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78a77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a8067d60 0x7f78a819b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54000/0 (socket says 172.21.15.134:54000) 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78a77fe700 1 -- 172.21.15.134:0/375626391 learned_addr learned my addr 172.21.15.134:0/375626391 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78a6ffd700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78a81060c0 0x7f78a819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78a77fe700 1 -- 172.21.15.134:0/375626391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78a81060c0 msgr2=0x7f78a819bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78a77fe700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78a81060c0 0x7f78a819bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78a77fe700 1 -- 172.21.15.134:0/375626391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78980095f0 con 0x7f78a8067d60 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.442+0000 7f78a6ffd700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78a81060c0 0x7f78a819bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.443+0000 7f78a77fe700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a8067d60 0x7f78a819b890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f789c00d8d0 tx=0x7f789c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.443+0000 7f78a4ff9700 1 -- 172.21.15.134:0/375626391 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f789c009940 con 0x7f78a8067d60 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.443+0000 7f78a4ff9700 1 -- 172.21.15.134:0/375626391 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f789c010460 con 0x7f78a8067d60 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.443+0000 7f78adce2700 1 -- 172.21.15.134:0/375626391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a8195be0 con 0x7f78a8067d60 2024-04-13T11:11:02.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.443+0000 7f78a4ff9700 1 -- 172.21.15.134:0/375626391 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f789c00f5f0 con 0x7f78a8067d60 2024-04-13T11:11:02.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.443+0000 7f78adce2700 1 -- 172.21.15.134:0/375626391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a8196140 con 0x7f78a8067d60 2024-04-13T11:11:02.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.444+0000 7f78adce2700 1 -- 172.21.15.134:0/375626391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a804ea50 con 0x7f78a8067d60 2024-04-13T11:11:02.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.444+0000 7f78a4ff9700 1 -- 172.21.15.134:0/375626391 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f789c0105d0 con 0x7f78a8067d60 2024-04-13T11:11:02.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.445+0000 7f78a4ff9700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f789006cda0 0x7f789006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:02.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.445+0000 7f78a6ffd700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f789006cda0 0x7f789006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:02.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.445+0000 7f78a4ff9700 1 -- 172.21.15.134:0/375626391 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f789c08c6b0 con 0x7f78a8067d60 2024-04-13T11:11:02.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.445+0000 7f78a6ffd700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f789006cda0 0x7f789006f250 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7898006010 tx=0x7f789800b540 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:02.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.449+0000 7f78a4ff9700 1 -- 172.21.15.134:0/375626391 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f789c05a0e0 con 0x7f78a8067d60 2024-04-13T11:11:02.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:02 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1846775391' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-13T11:11:02.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:02 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3727503437' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-13T11:11:02.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:02 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1846775391' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-13T11:11:02.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:02 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3727503437' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-13T11:11:02.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.686+0000 7f78adce2700 1 -- 172.21.15.134:0/375626391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f78a81965a0 con 0x7f78a8067d60 2024-04-13T11:11:02.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.686+0000 7f78a4ff9700 1 -- 172.21.15.134:0/375626391 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v41) v1 ==== 107+0+4841 (secure 0 0 0) 0x7f789c010880 con 0x7f78a8067d60 2024-04-13T11:11:02.686 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:02.686 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:07:57.651524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi194.svyrny","rank":0,"incarnation":29,"state":"up:active","state_seq":183,"addr":"172.21.15.194:6827/3941085795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":3941085795},{"type":"v1","addr":"172.21.15.194:6827","nonce":3941085795}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 -- 172.21.15.134:0/375626391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f789006cda0 msgr2=0x7f789006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f789006cda0 0x7f789006f250 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7898006010 tx=0x7f789800b540 comp rx=0 tx=0).stop 2024-04-13T11:11:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 -- 172.21.15.134:0/375626391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a8067d60 msgr2=0x7f78a819b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a8067d60 0x7f78a819b890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f789c00d8d0 tx=0x7f789c00dc90 comp rx=0 tx=0).stop 2024-04-13T11:11:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 -- 172.21.15.134:0/375626391 shutdown_connections 2024-04-13T11:11:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f789006cda0 0x7f789006f250 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78a8067d60 0x7f78a819b890 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 --2- 172.21.15.134:0/375626391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78a81060c0 0x7f78a819bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 -- 172.21.15.134:0/375626391 >> 172.21.15.134:0/375626391 conn(0x7f78a8074d90 msgr2=0x7f78a80fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 -- 172.21.15.134:0/375626391 shutdown_connections 2024-04-13T11:11:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.689+0000 7f78adce2700 1 -- 172.21.15.134:0/375626391 wait complete. 2024-04-13T11:11:02.690 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 32 2024-04-13T11:11:02.701 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-04-13T11:11:02.701 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-13T11:11:02.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.823+0000 7fb13aeff700 1 -- 172.21.15.134:0/2498139222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1340ff170 msgr2=0x7fb1340ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:02.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.823+0000 7fb13aeff700 1 --2- 172.21.15.134:0/2498139222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1340ff170 0x7fb1340ff540 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb128009910 tx=0x7fb128009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:02.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.823+0000 7fb13aeff700 1 -- 172.21.15.134:0/2498139222 shutdown_connections 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.823+0000 7fb13aeff700 1 --2- 172.21.15.134:0/2498139222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1340ffa80 0x7fb13410a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.823+0000 7fb13aeff700 1 --2- 172.21.15.134:0/2498139222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1340ff170 0x7fb1340ff540 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.823+0000 7fb13aeff700 1 -- 172.21.15.134:0/2498139222 >> 172.21.15.134:0/2498139222 conn(0x7fb1340747a0 msgr2=0x7fb134074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.823+0000 7fb13aeff700 1 -- 172.21.15.134:0/2498139222 shutdown_connections 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.823+0000 7fb13aeff700 1 -- 172.21.15.134:0/2498139222 wait complete. 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb13aeff700 1 Processor -- start 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb13aeff700 1 -- start start 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb13aeff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1340ff170 0x7fb13419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb13aeff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1340ffa80 0x7fb13419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb13aeff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13419c440 con 0x7fb1340ffa80 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb13aeff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1341958e0 con 0x7fb1340ff170 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb133fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1340ffa80 0x7fb13419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:02.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb133fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1340ffa80 0x7fb13419bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54020/0 (socket says 172.21.15.134:54020) 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb133fff700 1 -- 172.21.15.134:0/2563510737 learned_addr learned my addr 172.21.15.134:0/2563510737 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb138c9b700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1340ff170 0x7fb13419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb133fff700 1 -- 172.21.15.134:0/2563510737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1340ff170 msgr2=0x7fb13419b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb133fff700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1340ff170 0x7fb13419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.824+0000 7fb133fff700 1 -- 172.21.15.134:0/2563510737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280095f0 con 0x7fb1340ffa80 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.825+0000 7fb133fff700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1340ffa80 0x7fb13419bdb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb12000c8a0 tx=0x7fb12000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.825+0000 7fb131ffb700 1 -- 172.21.15.134:0/2563510737 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb12000cea0 con 0x7fb1340ffa80 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.825+0000 7fb131ffb700 1 -- 172.21.15.134:0/2563510737 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb120004830 con 0x7fb1340ffa80 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.825+0000 7fb13aeff700 1 -- 172.21.15.134:0/2563510737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb134195bc0 con 0x7fb1340ffa80 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.825+0000 7fb131ffb700 1 -- 172.21.15.134:0/2563510737 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb120005500 con 0x7fb1340ffa80 2024-04-13T11:11:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.825+0000 7fb13aeff700 1 -- 172.21.15.134:0/2563510737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1341961a0 con 0x7fb1340ffa80 2024-04-13T11:11:02.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.826+0000 7fb13aeff700 1 -- 172.21.15.134:0/2563510737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb134107bf0 con 0x7fb1340ffa80 2024-04-13T11:11:02.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.826+0000 7fb131ffb700 1 -- 172.21.15.134:0/2563510737 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb1200049a0 con 0x7fb1340ffa80 2024-04-13T11:11:02.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.826+0000 7fb131ffb700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb12406cda0 0x7fb12406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:02.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.827+0000 7fb131ffb700 1 -- 172.21.15.134:0/2563510737 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb12008c420 con 0x7fb1340ffa80 2024-04-13T11:11:02.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.827+0000 7fb138c9b700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb12406cda0 0x7fb12406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:02.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.827+0000 7fb138c9b700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb12406cda0 0x7fb12406f250 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb128000c00 tx=0x7fb128005fb0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:02.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:02.831+0000 7fb131ffb700 1 -- 172.21.15.134:0/2563510737 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fb120059db0 con 0x7fb1340ffa80 2024-04-13T11:11:03.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.069+0000 7fb13aeff700 1 -- 172.21.15.134:0/2563510737 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fb13404ea50 con 0x7fb1340ffa80 2024-04-13T11:11:03.070 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.069+0000 7fb131ffb700 1 -- 172.21.15.134:0/2563510737 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v41) v1 ==== 107+0+4046 (secure 0 0 0) 0x7fb120059940 con 0x7fb1340ffa80 2024-04-13T11:11:03.071 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:03.071 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:08:14.001124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:03.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 -- 172.21.15.134:0/2563510737 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb12406cda0 msgr2=0x7fb12406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb12406cda0 0x7fb12406f250 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb128000c00 tx=0x7fb128005fb0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 -- 172.21.15.134:0/2563510737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1340ffa80 msgr2=0x7fb13419bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1340ffa80 0x7fb13419bdb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb12000c8a0 tx=0x7fb12000cc60 comp rx=0 tx=0).stop 2024-04-13T11:11:03.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 -- 172.21.15.134:0/2563510737 shutdown_connections 2024-04-13T11:11:03.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb12406cda0 0x7fb12406f250 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1340ff170 0x7fb13419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 --2- 172.21.15.134:0/2563510737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1340ffa80 0x7fb13419bdb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 -- 172.21.15.134:0/2563510737 >> 172.21.15.134:0/2563510737 conn(0x7fb1340747a0 msgr2=0x7fb134104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:03.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 -- 172.21.15.134:0/2563510737 shutdown_connections 2024-04-13T11:11:03.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.072+0000 7fb13aeff700 1 -- 172.21.15.134:0/2563510737 wait complete. 2024-04-13T11:11:03.074 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 33 2024-04-13T11:11:03.085 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-04-13T11:11:03.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-13T11:11:03.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.207+0000 7f153fe31700 1 -- 172.21.15.134:0/3200385233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15380ffc00 msgr2=0x7f1538103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.207+0000 7f153fe31700 1 --2- 172.21.15.134:0/3200385233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15380ffc00 0x7f1538103bc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1534009910 tx=0x7f1534009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:03.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.207+0000 7f153fe31700 1 -- 172.21.15.134:0/3200385233 shutdown_connections 2024-04-13T11:11:03.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.207+0000 7f153fe31700 1 --2- 172.21.15.134:0/3200385233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15380ffc00 0x7f1538103bc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.207+0000 7f153fe31700 1 --2- 172.21.15.134:0/3200385233 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15380ff260 0x7f15380ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.207+0000 7f153fe31700 1 -- 172.21.15.134:0/3200385233 >> 172.21.15.134:0/3200385233 conn(0x7f15380faad0 msgr2=0x7f15380fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.207+0000 7f153fe31700 1 -- 172.21.15.134:0/3200385233 shutdown_connections 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.207+0000 7f153fe31700 1 -- 172.21.15.134:0/3200385233 wait complete. 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153fe31700 1 Processor -- start 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153fe31700 1 -- start start 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153fe31700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15380ff260 0x7f153819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153fe31700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15380ffc00 0x7f153819bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153fe31700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153819c4d0 con 0x7f15380ff260 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153fe31700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1538195a00 con 0x7f15380ffc00 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153dbcd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15380ff260 0x7f153819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153dbcd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15380ff260 0x7f153819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54024/0 (socket says 172.21.15.134:54024) 2024-04-13T11:11:03.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153dbcd700 1 -- 172.21.15.134:0/2833227827 learned_addr learned my addr 172.21.15.134:0/2833227827 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153dbcd700 1 -- 172.21.15.134:0/2833227827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15380ffc00 msgr2=0x7f153819bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153d3cc700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15380ffc00 0x7f153819bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153dbcd700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15380ffc00 0x7f153819bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153dbcd700 1 -- 172.21.15.134:0/2833227827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15340095f0 con 0x7f15380ff260 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153d3cc700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15380ffc00 0x7f153819bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f153dbcd700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15380ff260 0x7f153819b990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f152800c930 tx=0x7f152800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.208+0000 7f152effd700 1 -- 172.21.15.134:0/2833227827 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1528007ad0 con 0x7f15380ff260 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.209+0000 7f153fe31700 1 -- 172.21.15.134:0/2833227827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1538195ce0 con 0x7f15380ff260 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.209+0000 7f153fe31700 1 -- 172.21.15.134:0/2833227827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1538196240 con 0x7f15380ff260 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.209+0000 7f152effd700 1 -- 172.21.15.134:0/2833227827 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f152800a5f0 con 0x7f15380ff260 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.209+0000 7f152effd700 1 -- 172.21.15.134:0/2833227827 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1528018630 con 0x7f15380ff260 2024-04-13T11:11:03.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.209+0000 7f153fe31700 1 -- 172.21.15.134:0/2833227827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c005310 con 0x7f15380ff260 2024-04-13T11:11:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.210+0000 7f152effd700 1 -- 172.21.15.134:0/2833227827 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1528007c30 con 0x7f15380ff260 2024-04-13T11:11:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.210+0000 7f152effd700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f152406cda0 0x7f152406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.210+0000 7f152effd700 1 -- 172.21.15.134:0/2833227827 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f152808c7a0 con 0x7f15380ff260 2024-04-13T11:11:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.210+0000 7f153d3cc700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f152406cda0 0x7f152406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:03.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.211+0000 7f153d3cc700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f152406cda0 0x7f152406f250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f153400b5c0 tx=0x7f1534005fd0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:03.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.215+0000 7f152effd700 1 -- 172.21.15.134:0/2833227827 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f152805a1d0 con 0x7f15380ff260 2024-04-13T11:11:03.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:03 smithi134 ceph-mon[112184]: pgmap v388: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:03.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:03 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/953878439' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-13T11:11:03.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:03 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/375626391' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-13T11:11:03.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:03 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2563510737' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-13T11:11:03.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.457+0000 7f153fe31700 1 -- 172.21.15.134:0/2833227827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f151c005180 con 0x7f15380ff260 2024-04-13T11:11:03.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.457+0000 7f152effd700 1 -- 172.21.15.134:0/2833227827 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v41) v1 ==== 107+0+4057 (secure 0 0 0) 0x7f1528059d60 con 0x7f15380ff260 2024-04-13T11:11:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:03.458 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:08:14.013622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":0,"incarnation":34,"state":"up:replay","state_seq":1,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:03.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 -- 172.21.15.134:0/2833227827 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f152406cda0 msgr2=0x7f152406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f152406cda0 0x7f152406f250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f153400b5c0 tx=0x7f1534005fd0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 -- 172.21.15.134:0/2833227827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15380ff260 msgr2=0x7f153819b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15380ff260 0x7f153819b990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f152800c930 tx=0x7f152800ccf0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 -- 172.21.15.134:0/2833227827 shutdown_connections 2024-04-13T11:11:03.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f152406cda0 0x7f152406f250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15380ff260 0x7f153819b990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 --2- 172.21.15.134:0/2833227827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15380ffc00 0x7f153819bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 -- 172.21.15.134:0/2833227827 >> 172.21.15.134:0/2833227827 conn(0x7f15380faad0 msgr2=0x7f1538068980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:03.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 -- 172.21.15.134:0/2833227827 shutdown_connections 2024-04-13T11:11:03.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.460+0000 7f153fe31700 1 -- 172.21.15.134:0/2833227827 wait complete. 2024-04-13T11:11:03.462 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 34 2024-04-13T11:11:03.473 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-04-13T11:11:03.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-04-13T11:11:03.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:03 smithi194 ceph-mon[83053]: pgmap v388: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:03.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:03 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/953878439' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-13T11:11:03.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:03 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/375626391' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-13T11:11:03.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:03 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2563510737' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-13T11:11:03.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.596+0000 7fc88fcc0700 1 -- 172.21.15.134:0/3605189124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8880ff170 msgr2=0x7fc8880ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.596+0000 7fc88fcc0700 1 --2- 172.21.15.134:0/3605189124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8880ff170 0x7fc8880ff540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc878009910 tx=0x7fc878009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:03.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.596+0000 7fc88fcc0700 1 -- 172.21.15.134:0/3605189124 shutdown_connections 2024-04-13T11:11:03.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.596+0000 7fc88fcc0700 1 --2- 172.21.15.134:0/3605189124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8880ffa80 0x7fc88810a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.596+0000 7fc88fcc0700 1 --2- 172.21.15.134:0/3605189124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8880ff170 0x7fc8880ff540 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.596+0000 7fc88fcc0700 1 -- 172.21.15.134:0/3605189124 >> 172.21.15.134:0/3605189124 conn(0x7fc8880747a0 msgr2=0x7fc888074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:03.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.596+0000 7fc88fcc0700 1 -- 172.21.15.134:0/3605189124 shutdown_connections 2024-04-13T11:11:03.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.596+0000 7fc88fcc0700 1 -- 172.21.15.134:0/3605189124 wait complete. 2024-04-13T11:11:03.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88fcc0700 1 Processor -- start 2024-04-13T11:11:03.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88fcc0700 1 -- start start 2024-04-13T11:11:03.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88fcc0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8880ff170 0x7fc88819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:03.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88fcc0700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8880ffa80 0x7fc88819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:03.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88fcc0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88819c4e0 con 0x7fc8880ff170 2024-04-13T11:11:03.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88fcc0700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888195980 con 0x7fc8880ffa80 2024-04-13T11:11:03.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88da5c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8880ff170 0x7fc88819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88da5c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8880ff170 0x7fc88819b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54040/0 (socket says 172.21.15.134:54040) 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88da5c700 1 -- 172.21.15.134:0/1459731568 learned_addr learned my addr 172.21.15.134:0/1459731568 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88d25b700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8880ffa80 0x7fc88819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88da5c700 1 -- 172.21.15.134:0/1459731568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8880ffa80 msgr2=0x7fc88819be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88da5c700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8880ffa80 0x7fc88819be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88da5c700 1 -- 172.21.15.134:0/1459731568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780095f0 con 0x7fc8880ff170 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.597+0000 7fc88da5c700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8880ff170 0x7fc88819b910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc878006010 tx=0x7fc87800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.598+0000 7fc87effd700 1 -- 172.21.15.134:0/1459731568 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc87801d070 con 0x7fc8880ff170 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.598+0000 7fc87effd700 1 -- 172.21.15.134:0/1459731568 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc87800f460 con 0x7fc8880ff170 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.598+0000 7fc87effd700 1 -- 172.21.15.134:0/1459731568 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc878021640 con 0x7fc8880ff170 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.598+0000 7fc88fcc0700 1 -- 172.21.15.134:0/1459731568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc888195c60 con 0x7fc8880ff170 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.598+0000 7fc88fcc0700 1 -- 172.21.15.134:0/1459731568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc888196240 con 0x7fc8880ff170 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.598+0000 7fc88fcc0700 1 -- 172.21.15.134:0/1459731568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc888107bf0 con 0x7fc8880ff170 2024-04-13T11:11:03.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.599+0000 7fc87effd700 1 -- 172.21.15.134:0/1459731568 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc87800fa60 con 0x7fc8880ff170 2024-04-13T11:11:03.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.599+0000 7fc87effd700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc87406cda0 0x7fc87406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:03.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.599+0000 7fc87effd700 1 -- 172.21.15.134:0/1459731568 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fc87808d8b0 con 0x7fc8880ff170 2024-04-13T11:11:03.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.600+0000 7fc88d25b700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc87406cda0 0x7fc87406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:03.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.600+0000 7fc88d25b700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc87406cda0 0x7fc87406f250 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc884006fd0 tx=0x7fc884008040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:03.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.604+0000 7fc87effd700 1 -- 172.21.15.134:0/1459731568 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fc87805b360 con 0x7fc8880ff170 2024-04-13T11:11:03.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.842+0000 7fc88fcc0700 1 -- 172.21.15.134:0/1459731568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fc88804ea50 con 0x7fc8880ff170 2024-04-13T11:11:03.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.843+0000 7fc87effd700 1 -- 172.21.15.134:0/1459731568 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v41) v1 ==== 107+0+4061 (secure 0 0 0) 0x7fc87805aef0 con 0x7fc8880ff170 2024-04-13T11:11:03.844 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:03.844 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:08:24.054078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":0,"incarnation":34,"state":"up:reconnect","state_seq":20,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.845+0000 7fc88fcc0700 1 -- 172.21.15.134:0/1459731568 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc87406cda0 msgr2=0x7fc87406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.845+0000 7fc88fcc0700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc87406cda0 0x7fc87406f250 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc884006fd0 tx=0x7fc884008040 comp rx=0 tx=0).stop 2024-04-13T11:11:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.845+0000 7fc88fcc0700 1 -- 172.21.15.134:0/1459731568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8880ff170 msgr2=0x7fc88819b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.845+0000 7fc88fcc0700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8880ff170 0x7fc88819b910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc878006010 tx=0x7fc87800be20 comp rx=0 tx=0).stop 2024-04-13T11:11:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.845+0000 7fc88fcc0700 1 -- 172.21.15.134:0/1459731568 shutdown_connections 2024-04-13T11:11:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.845+0000 7fc88fcc0700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc87406cda0 0x7fc87406f250 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.845+0000 7fc88fcc0700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8880ff170 0x7fc88819b910 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.845+0000 7fc88fcc0700 1 --2- 172.21.15.134:0/1459731568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8880ffa80 0x7fc88819be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.845+0000 7fc88fcc0700 1 -- 172.21.15.134:0/1459731568 >> 172.21.15.134:0/1459731568 conn(0x7fc8880747a0 msgr2=0x7fc888104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.845+0000 7fc88fcc0700 1 -- 172.21.15.134:0/1459731568 shutdown_connections 2024-04-13T11:11:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.846+0000 7fc88fcc0700 1 -- 172.21.15.134:0/1459731568 wait complete. 2024-04-13T11:11:03.848 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 35 2024-04-13T11:11:03.859 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-04-13T11:11:03.859 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.980+0000 7fb82e76f700 1 -- 172.21.15.134:0/2437904704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8280ffbc0 msgr2=0x7fb828103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.980+0000 7fb82e76f700 1 --2- 172.21.15.134:0/2437904704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8280ffbc0 0x7fb828103b80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009910 tx=0x7fb81c009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.980+0000 7fb82e76f700 1 -- 172.21.15.134:0/2437904704 shutdown_connections 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.980+0000 7fb82e76f700 1 --2- 172.21.15.134:0/2437904704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8280ffbc0 0x7fb828103b80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.980+0000 7fb82e76f700 1 --2- 172.21.15.134:0/2437904704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280ff220 0x7fb8280ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.980+0000 7fb82e76f700 1 -- 172.21.15.134:0/2437904704 >> 172.21.15.134:0/2437904704 conn(0x7fb8280faa70 msgr2=0x7fb8280fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.980+0000 7fb82e76f700 1 -- 172.21.15.134:0/2437904704 shutdown_connections 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.980+0000 7fb82e76f700 1 -- 172.21.15.134:0/2437904704 wait complete. 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.980+0000 7fb82e76f700 1 Processor -- start 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.980+0000 7fb82e76f700 1 -- start start 2024-04-13T11:11:03.983 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb82e76f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8280ff220 0x7fb828196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb82e76f700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280ffbc0 0x7fb828196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb82e76f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb828197560 con 0x7fb8280ff220 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb82e76f700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8281976a0 con 0x7fb8280ffbc0 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb827fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8280ff220 0x7fb828196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb827fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8280ff220 0x7fb828196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54048/0 (socket says 172.21.15.134:54048) 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb827fff700 1 -- 172.21.15.134:0/3893549309 learned_addr learned my addr 172.21.15.134:0/3893549309 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb8277fe700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280ffbc0 0x7fb828196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb827fff700 1 -- 172.21.15.134:0/3893549309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280ffbc0 msgr2=0x7fb828196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb827fff700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280ffbc0 0x7fb828196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb827fff700 1 -- 172.21.15.134:0/3893549309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c0095f0 con 0x7fb8280ff220 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb8277fe700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280ffbc0 0x7fb828196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb827fff700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8280ff220 0x7fb828196a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb81800e920 tx=0x7fb81800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:03.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb8257fa700 1 -- 172.21.15.134:0/3893549309 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb818009790 con 0x7fb8280ff220 2024-04-13T11:11:03.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb8257fa700 1 -- 172.21.15.134:0/3893549309 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb81800cba0 con 0x7fb8280ff220 2024-04-13T11:11:03.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.981+0000 7fb82e76f700 1 -- 172.21.15.134:0/3893549309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82819fa70 con 0x7fb8280ff220 2024-04-13T11:11:03.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.982+0000 7fb8257fa700 1 -- 172.21.15.134:0/3893549309 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb818018650 con 0x7fb8280ff220 2024-04-13T11:11:03.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.982+0000 7fb82e76f700 1 -- 172.21.15.134:0/3893549309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82819ff40 con 0x7fb8280ff220 2024-04-13T11:11:03.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.982+0000 7fb82e76f700 1 -- 172.21.15.134:0/3893549309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb828107580 con 0x7fb8280ff220 2024-04-13T11:11:03.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.983+0000 7fb8257fa700 1 -- 172.21.15.134:0/3893549309 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb81800cd10 con 0x7fb8280ff220 2024-04-13T11:11:03.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.983+0000 7fb8257fa700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb81006cda0 0x7fb81006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:03.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.983+0000 7fb8257fa700 1 -- 172.21.15.134:0/3893549309 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb818014070 con 0x7fb8280ff220 2024-04-13T11:11:03.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.983+0000 7fb8277fe700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb81006cda0 0x7fb81006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:03.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.984+0000 7fb8277fe700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb81006cda0 0x7fb81006f250 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb828069190 tx=0x7fb81c005940 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:03.988 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:03.988+0000 7fb8257fa700 1 -- 172.21.15.134:0/3893549309 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fb818052ab0 con 0x7fb8280ff220 2024-04-13T11:11:04.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.227+0000 7fb82e76f700 1 -- 172.21.15.134:0/3893549309 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7fb82804ea50 con 0x7fb8280ff220 2024-04-13T11:11:04.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.228+0000 7fb8257fa700 1 -- 172.21.15.134:0/3893549309 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v41) v1 ==== 107+0+4840 (secure 0 0 0) 0x7fb81805a450 con 0x7fb8280ff220 2024-04-13T11:11:04.229 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:04.229 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":44335,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/2085856165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2085856165},{"type":"v1","addr":"172.21.15.194:6827","nonce":2085856165}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:08:25.059261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":0,"incarnation":34,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:04.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 -- 172.21.15.134:0/3893549309 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb81006cda0 msgr2=0x7fb81006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:04.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb81006cda0 0x7fb81006f250 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb828069190 tx=0x7fb81c005940 comp rx=0 tx=0).stop 2024-04-13T11:11:04.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 -- 172.21.15.134:0/3893549309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8280ff220 msgr2=0x7fb828196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:04.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8280ff220 0x7fb828196a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb81800e920 tx=0x7fb81800ece0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 -- 172.21.15.134:0/3893549309 shutdown_connections 2024-04-13T11:11:04.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fb81006cda0 0x7fb81006f250 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8280ff220 0x7fb828196a00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 --2- 172.21.15.134:0/3893549309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8280ffbc0 0x7fb828196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 -- 172.21.15.134:0/3893549309 >> 172.21.15.134:0/3893549309 conn(0x7fb8280faa70 msgr2=0x7fb8280fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:04.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 -- 172.21.15.134:0/3893549309 shutdown_connections 2024-04-13T11:11:04.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.230+0000 7fb82e76f700 1 -- 172.21.15.134:0/3893549309 wait complete. 2024-04-13T11:11:04.232 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 36 2024-04-13T11:11:04.244 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-04-13T11:11:04.244 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-04-13T11:11:04.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.365+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2924102500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140ffbc0 msgr2=0x7fd314103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.365+0000 7fd31a3c1700 1 --2- 172.21.15.134:0/2924102500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140ffbc0 0x7fd314103b80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd308009910 tx=0x7fd308009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.365+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2924102500 shutdown_connections 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.365+0000 7fd31a3c1700 1 --2- 172.21.15.134:0/2924102500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140ffbc0 0x7fd314103b80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.365+0000 7fd31a3c1700 1 --2- 172.21.15.134:0/2924102500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140ff220 0x7fd3140ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.365+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2924102500 >> 172.21.15.134:0/2924102500 conn(0x7fd3140faa70 msgr2=0x7fd3140fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.365+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2924102500 shutdown_connections 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.365+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2924102500 wait complete. 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.365+0000 7fd31a3c1700 1 Processor -- start 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.365+0000 7fd31a3c1700 1 -- start start 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd31a3c1700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140ff220 0x7fd314100c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd31a3c1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140ffbc0 0x7fd314101160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:04.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd31a3c1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141016a0 con 0x7fd3140ffbc0 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd31a3c1700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141017e0 con 0x7fd3140ff220 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd3137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140ffbc0 0x7fd314101160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd3137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140ffbc0 0x7fd314101160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54070/0 (socket says 172.21.15.134:54070) 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd3137fe700 1 -- 172.21.15.134:0/2908905964 learned_addr learned my addr 172.21.15.134:0/2908905964 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd313fff700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140ff220 0x7fd314100c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd3137fe700 1 -- 172.21.15.134:0/2908905964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140ff220 msgr2=0x7fd314100c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd3137fe700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140ff220 0x7fd314100c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd3137fe700 1 -- 172.21.15.134:0/2908905964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3080095f0 con 0x7fd3140ffbc0 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd3137fe700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140ffbc0 0x7fd314101160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd30800bd70 tx=0x7fd30800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd3117fa700 1 -- 172.21.15.134:0/2908905964 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd30801d070 con 0x7fd3140ffbc0 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd3117fa700 1 -- 172.21.15.134:0/2908905964 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd30800f460 con 0x7fd3140ffbc0 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2908905964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd314101a60 con 0x7fd3140ffbc0 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.366+0000 7fd3117fa700 1 -- 172.21.15.134:0/2908905964 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd308021640 con 0x7fd3140ffbc0 2024-04-13T11:11:04.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.367+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2908905964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3141a1fc0 con 0x7fd3140ffbc0 2024-04-13T11:11:04.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.368+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2908905964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31404ea50 con 0x7fd3140ffbc0 2024-04-13T11:11:04.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.368+0000 7fd3117fa700 1 -- 172.21.15.134:0/2908905964 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd308003a60 con 0x7fd3140ffbc0 2024-04-13T11:11:04.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.368+0000 7fd3117fa700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd2fc06cda0 0x7fd2fc06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:04.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.368+0000 7fd3117fa700 1 -- 172.21.15.134:0/2908905964 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd30808d8d0 con 0x7fd3140ffbc0 2024-04-13T11:11:04.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.368+0000 7fd313fff700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd2fc06cda0 0x7fd2fc06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:04.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.369+0000 7fd313fff700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd2fc06cda0 0x7fd2fc06f250 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd30400ac50 tx=0x7fd30400a380 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:04.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.373+0000 7fd3117fa700 1 -- 172.21.15.134:0/2908905964 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fd308057870 con 0x7fd3140ffbc0 2024-04-13T11:11:04.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:04 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2833227827' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-13T11:11:04.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:04 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1459731568' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-13T11:11:04.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.616+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2908905964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fd3141a2370 con 0x7fd3140ffbc0 2024-04-13T11:11:04.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.616+0000 7fd3117fa700 1 -- 172.21.15.134:0/2908905964 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v41) v1 ==== 107+0+4840 (secure 0 0 0) 0x7fd30805ae90 con 0x7fd3140ffbc0 2024-04-13T11:11:04.617 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:04.617 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":44335,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/2085856165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2085856165},{"type":"v1","addr":"172.21.15.194:6827","nonce":2085856165}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:08:26.065323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":0,"incarnation":34,"state":"up:active","state_seq":22,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:04.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.618+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2908905964 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd2fc06cda0 msgr2=0x7fd2fc06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:04.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.618+0000 7fd31a3c1700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd2fc06cda0 0x7fd2fc06f250 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd30400ac50 tx=0x7fd30400a380 comp rx=0 tx=0).stop 2024-04-13T11:11:04.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.618+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2908905964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140ffbc0 msgr2=0x7fd314101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:04.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.618+0000 7fd31a3c1700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140ffbc0 0x7fd314101160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd30800bd70 tx=0x7fd30800bda0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.619+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2908905964 shutdown_connections 2024-04-13T11:11:04.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.619+0000 7fd31a3c1700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd2fc06cda0 0x7fd2fc06f250 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.619+0000 7fd31a3c1700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140ff220 0x7fd314100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.619+0000 7fd31a3c1700 1 --2- 172.21.15.134:0/2908905964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140ffbc0 0x7fd314101160 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.619+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2908905964 >> 172.21.15.134:0/2908905964 conn(0x7fd3140faa70 msgr2=0x7fd314103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:04.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.619+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2908905964 shutdown_connections 2024-04-13T11:11:04.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.619+0000 7fd31a3c1700 1 -- 172.21.15.134:0/2908905964 wait complete. 2024-04-13T11:11:04.620 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 37 2024-04-13T11:11:04.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:04 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2833227827' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-13T11:11:04.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:04 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1459731568' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-13T11:11:04.631 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-04-13T11:11:04.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-04-13T11:11:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.754+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3930257511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e80ff3e0 msgr2=0x7fd4e80ff7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.754+0000 7fd4ecc21700 1 --2- 172.21.15.134:0/3930257511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e80ff3e0 0x7fd4e80ff7b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009910 tx=0x7fd4d8009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.754+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3930257511 shutdown_connections 2024-04-13T11:11:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.754+0000 7fd4ecc21700 1 --2- 172.21.15.134:0/3930257511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4e80ffd80 0x7fd4e8103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.754+0000 7fd4ecc21700 1 --2- 172.21.15.134:0/3930257511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e80ff3e0 0x7fd4e80ff7b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.754+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3930257511 >> 172.21.15.134:0/3930257511 conn(0x7fd4e80747a0 msgr2=0x7fd4e8074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.754+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3930257511 shutdown_connections 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.754+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3930257511 wait complete. 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4ecc21700 1 Processor -- start 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4ecc21700 1 -- start start 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4ecc21700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4e80ff3e0 0x7fd4e8194940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4ecc21700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e80ffd80 0x7fd4e8194e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4ecc21700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81953c0 con 0x7fd4e80ffd80 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4ecc21700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8195530 con 0x7fd4e80ff3e0 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4e5d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e80ffd80 0x7fd4e8194e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4e5d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e80ffd80 0x7fd4e8194e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54076/0 (socket says 172.21.15.134:54076) 2024-04-13T11:11:04.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4e5d9b700 1 -- 172.21.15.134:0/3906099229 learned_addr learned my addr 172.21.15.134:0/3906099229 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4e659c700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4e80ff3e0 0x7fd4e8194940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4e5d9b700 1 -- 172.21.15.134:0/3906099229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4e80ff3e0 msgr2=0x7fd4e8194940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4e5d9b700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4e80ff3e0 0x7fd4e8194940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4e5d9b700 1 -- 172.21.15.134:0/3906099229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d80095f0 con 0x7fd4e80ffd80 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4e5d9b700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e80ffd80 0x7fd4e8194e80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00b4d0 tx=0x7fd4dc00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4d77fe700 1 -- 172.21.15.134:0/3906099229 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4dc011800 con 0x7fd4e80ffd80 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3906099229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e81a1fb0 con 0x7fd4e80ffd80 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4d77fe700 1 -- 172.21.15.134:0/3906099229 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd4dc011e00 con 0x7fd4e80ffd80 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.755+0000 7fd4d77fe700 1 -- 172.21.15.134:0/3906099229 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4dc010e00 con 0x7fd4e80ffd80 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.756+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3906099229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e81a2320 con 0x7fd4e80ffd80 2024-04-13T11:11:04.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.756+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3906099229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e8106c80 con 0x7fd4e80ffd80 2024-04-13T11:11:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.757+0000 7fd4d77fe700 1 -- 172.21.15.134:0/3906099229 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd4dc011960 con 0x7fd4e80ffd80 2024-04-13T11:11:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.757+0000 7fd4d77fe700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd4d006cda0 0x7fd4d006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.757+0000 7fd4d77fe700 1 -- 172.21.15.134:0/3906099229 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd4dc08c0d0 con 0x7fd4e80ffd80 2024-04-13T11:11:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.757+0000 7fd4e659c700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd4d006cda0 0x7fd4d006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:04.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.758+0000 7fd4e659c700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd4d006cda0 0x7fd4d006f250 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009fd0 tx=0x7fd4d801a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:04.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:04.762+0000 7fd4d77fe700 1 -- 172.21.15.134:0/3906099229 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fd4dc059b00 con 0x7fd4e80ffd80 2024-04-13T11:11:05.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.002+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3906099229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7fd4e804ea50 con 0x7fd4e80ffd80 2024-04-13T11:11:05.004 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.003+0000 7fd4d77fe700 1 -- 172.21.15.134:0/3906099229 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v41) v1 ==== 107+0+4840 (secure 0 0 0) 0x7fd4dc059690 con 0x7fd4e80ffd80 2024-04-13T11:11:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:05.004 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":44335,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/2085856165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2085856165},{"type":"v1","addr":"172.21.15.194:6827","nonce":2085856165}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:08:33.662953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":0,"incarnation":34,"state":"up:active","state_seq":22,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:05.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3906099229 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd4d006cda0 msgr2=0x7fd4d006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:05.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd4d006cda0 0x7fd4d006f250 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009fd0 tx=0x7fd4d801a040 comp rx=0 tx=0).stop 2024-04-13T11:11:05.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3906099229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e80ffd80 msgr2=0x7fd4e8194e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:05.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e80ffd80 0x7fd4e8194e80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00b4d0 tx=0x7fd4dc00b7e0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3906099229 shutdown_connections 2024-04-13T11:11:05.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fd4d006cda0 0x7fd4d006f250 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4e80ff3e0 0x7fd4e8194940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 --2- 172.21.15.134:0/3906099229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4e80ffd80 0x7fd4e8194e80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3906099229 >> 172.21.15.134:0/3906099229 conn(0x7fd4e80747a0 msgr2=0x7fd4e80fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:05.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3906099229 shutdown_connections 2024-04-13T11:11:05.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.005+0000 7fd4ecc21700 1 -- 172.21.15.134:0/3906099229 wait complete. 2024-04-13T11:11:05.007 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 38 2024-04-13T11:11:05.018 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-04-13T11:11:05.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-04-13T11:11:05.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.140+0000 7f2645d2a700 1 -- 172.21.15.134:0/287367237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400ffc50 msgr2=0x7f2640103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:05.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.140+0000 7f2645d2a700 1 --2- 172.21.15.134:0/287367237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400ffc50 0x7f2640103b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2630009910 tx=0x7f2630009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:05.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.140+0000 7f2645d2a700 1 -- 172.21.15.134:0/287367237 shutdown_connections 2024-04-13T11:11:05.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.140+0000 7f2645d2a700 1 --2- 172.21.15.134:0/287367237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400ffc50 0x7f2640103b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.140+0000 7f2645d2a700 1 --2- 172.21.15.134:0/287367237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26400ff2b0 0x7f26400ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.140+0000 7f2645d2a700 1 -- 172.21.15.134:0/287367237 >> 172.21.15.134:0/287367237 conn(0x7f2640074d90 msgr2=0x7f2640075190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:05.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.140+0000 7f2645d2a700 1 -- 172.21.15.134:0/287367237 shutdown_connections 2024-04-13T11:11:05.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.140+0000 7f2645d2a700 1 -- 172.21.15.134:0/287367237 wait complete. 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f2645d2a700 1 Processor -- start 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f2645d2a700 1 -- start start 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f2645d2a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400ff2b0 0x7f264019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f2645d2a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26400ffc50 0x7f264019bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f2645d2a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264019c5f0 con 0x7f26400ff2b0 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f2645d2a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2640195a90 con 0x7f26400ffc50 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f263f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400ff2b0 0x7f264019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f263f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400ff2b0 0x7f264019ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54096/0 (socket says 172.21.15.134:54096) 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f263f7fe700 1 -- 172.21.15.134:0/789418517 learned_addr learned my addr 172.21.15.134:0/789418517 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f263effd700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26400ffc50 0x7f264019bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f263f7fe700 1 -- 172.21.15.134:0/789418517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26400ffc50 msgr2=0x7f264019bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f263f7fe700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26400ffc50 0x7f264019bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f263f7fe700 1 -- 172.21.15.134:0/789418517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300095f0 con 0x7f26400ff2b0 2024-04-13T11:11:05.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f263effd700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26400ffc50 0x7f264019bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:11:05.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.141+0000 7f263f7fe700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400ff2b0 0x7f264019ba20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f263400b4b0 tx=0x7f263400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:05.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.142+0000 7f263cff9700 1 -- 172.21.15.134:0/789418517 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2634011800 con 0x7f26400ff2b0 2024-04-13T11:11:05.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.142+0000 7f2645d2a700 1 -- 172.21.15.134:0/789418517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2640195d70 con 0x7f26400ff2b0 2024-04-13T11:11:05.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.142+0000 7f263cff9700 1 -- 172.21.15.134:0/789418517 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2634011e00 con 0x7f26400ff2b0 2024-04-13T11:11:05.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.142+0000 7f263cff9700 1 -- 172.21.15.134:0/789418517 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2634010e50 con 0x7f26400ff2b0 2024-04-13T11:11:05.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.142+0000 7f2645d2a700 1 -- 172.21.15.134:0/789418517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26401962a0 con 0x7f26400ff2b0 2024-04-13T11:11:05.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.143+0000 7f2645d2a700 1 -- 172.21.15.134:0/789418517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264004ea50 con 0x7f26400ff2b0 2024-04-13T11:11:05.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.143+0000 7f263cff9700 1 -- 172.21.15.134:0/789418517 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f2634010380 con 0x7f26400ff2b0 2024-04-13T11:11:05.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.143+0000 7f263cff9700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f262806cda0 0x7f262806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:05.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.144+0000 7f263cff9700 1 -- 172.21.15.134:0/789418517 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f263408c220 con 0x7f26400ff2b0 2024-04-13T11:11:05.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.144+0000 7f263effd700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f262806cda0 0x7f262806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:05.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.144+0000 7f263effd700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f262806cda0 0x7f262806f250 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2630006010 tx=0x7f263001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:05.149 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.148+0000 7f263cff9700 1 -- 172.21.15.134:0/789418517 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f2634059c50 con 0x7f26400ff2b0 2024-04-13T11:11:05.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.392+0000 7f2645d2a700 1 -- 172.21.15.134:0/789418517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f26401966f0 con 0x7f26400ff2b0 2024-04-13T11:11:05.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.392+0000 7f263cff9700 1 -- 172.21.15.134:0/789418517 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v41) v1 ==== 107+0+4839 (secure 0 0 0) 0x7f26340597e0 con 0x7f26400ff2b0 2024-04-13T11:11:05.394 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:05.394 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34354,"name":"cephfs.smithi134.kachce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":44335,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/2085856165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2085856165},{"type":"v1","addr":"172.21.15.194:6827","nonce":2085856165}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:08:34.664999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":0,"incarnation":34,"state":"up:active","state_seq":22,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:05.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 -- 172.21.15.134:0/789418517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f262806cda0 msgr2=0x7f262806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:05.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f262806cda0 0x7f262806f250 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2630006010 tx=0x7f263001a040 comp rx=0 tx=0).stop 2024-04-13T11:11:05.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 -- 172.21.15.134:0/789418517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400ff2b0 msgr2=0x7f264019ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:05.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400ff2b0 0x7f264019ba20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f263400b4b0 tx=0x7f263400b870 comp rx=0 tx=0).stop 2024-04-13T11:11:05.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 -- 172.21.15.134:0/789418517 shutdown_connections 2024-04-13T11:11:05.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f262806cda0 0x7f262806f250 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400ff2b0 0x7f264019ba20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 --2- 172.21.15.134:0/789418517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26400ffc50 0x7f264019bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 -- 172.21.15.134:0/789418517 >> 172.21.15.134:0/789418517 conn(0x7f2640074d90 msgr2=0x7f26400fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:05.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 -- 172.21.15.134:0/789418517 shutdown_connections 2024-04-13T11:11:05.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.395+0000 7f2645d2a700 1 -- 172.21.15.134:0/789418517 wait complete. 2024-04-13T11:11:05.397 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 39 2024-04-13T11:11:05.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:05 smithi134 ceph-mon[112184]: pgmap v389: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:05.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:05 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3893549309' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-04-13T11:11:05.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:05 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2908905964' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-04-13T11:11:05.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:05 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3906099229' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-04-13T11:11:05.408 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-04-13T11:11:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:05 smithi194 ceph-mon[83053]: pgmap v389: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:05 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3893549309' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-04-13T11:11:05.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:05 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2908905964' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-04-13T11:11:05.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:05 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3906099229' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-04-13T11:11:05.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.529+0000 7fe5c4301700 1 -- 172.21.15.134:0/993173914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5bc0ffc50 msgr2=0x7fe5bc103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:05.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.529+0000 7fe5c4301700 1 --2- 172.21.15.134:0/993173914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5bc0ffc50 0x7fe5bc103b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009910 tx=0x7fe5ac009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:05.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.530+0000 7fe5c4301700 1 -- 172.21.15.134:0/993173914 shutdown_connections 2024-04-13T11:11:05.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.530+0000 7fe5c4301700 1 --2- 172.21.15.134:0/993173914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5bc0ffc50 0x7fe5bc103b90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.530+0000 7fe5c4301700 1 --2- 172.21.15.134:0/993173914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5bc0ff2b0 0x7fe5bc0ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.530+0000 7fe5c4301700 1 -- 172.21.15.134:0/993173914 >> 172.21.15.134:0/993173914 conn(0x7fe5bc074d90 msgr2=0x7fe5bc075190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:05.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.530+0000 7fe5c4301700 1 -- 172.21.15.134:0/993173914 shutdown_connections 2024-04-13T11:11:05.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.530+0000 7fe5c4301700 1 -- 172.21.15.134:0/993173914 wait complete. 2024-04-13T11:11:05.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.530+0000 7fe5c4301700 1 Processor -- start 2024-04-13T11:11:05.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.530+0000 7fe5c4301700 1 -- start start 2024-04-13T11:11:05.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c4301700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5bc0ff2b0 0x7fe5bc196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:05.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c4301700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5bc0ffc50 0x7fe5bc196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:05.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c4301700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc1974e0 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c4301700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc197620 con 0x7fe5bc0ff2b0 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c189c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5bc0ffc50 0x7fe5bc196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c189c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5bc0ffc50 0x7fe5bc196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54122/0 (socket says 172.21.15.134:54122) 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c189c700 1 -- 172.21.15.134:0/3661884214 learned_addr learned my addr 172.21.15.134:0/3661884214 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c209d700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5bc0ff2b0 0x7fe5bc196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c189c700 1 -- 172.21.15.134:0/3661884214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5bc0ff2b0 msgr2=0x7fe5bc196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c189c700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5bc0ff2b0 0x7fe5bc196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c189c700 1 -- 172.21.15.134:0/3661884214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac0095f0 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c189c700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5bc0ffc50 0x7fe5bc196ec0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac000c00 tx=0x7fe5ac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5b37fe700 1 -- 172.21.15.134:0/3661884214 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ac01d070 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5b37fe700 1 -- 172.21.15.134:0/3661884214 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5ac00f460 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c4301700 1 -- 172.21.15.134:0/3661884214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc19f9f0 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5b37fe700 1 -- 172.21.15.134:0/3661884214 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ac021640 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.531+0000 7fe5c4301700 1 -- 172.21.15.134:0/3661884214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc19fe10 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.532+0000 7fe5c4301700 1 -- 172.21.15.134:0/3661884214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc107470 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.533+0000 7fe5b37fe700 1 -- 172.21.15.134:0/3661884214 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe5ac00f9e0 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.533+0000 7fe5b37fe700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe5a806cda0 0x7fe5a806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:05.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.533+0000 7fe5c209d700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe5a806cda0 0x7fe5a806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:05.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.533+0000 7fe5b37fe700 1 -- 172.21.15.134:0/3661884214 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fe5ac08d820 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.534+0000 7fe5c209d700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe5a806cda0 0x7fe5a806f250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005950 tx=0x7fe5b80058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:05.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.538+0000 7fe5b37fe700 1 -- 172.21.15.134:0/3661884214 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fe5ac0577c0 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.780+0000 7fe5c4301700 1 -- 172.21.15.134:0/3661884214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7fe5bc02cd90 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.781+0000 7fe5b37fe700 1 -- 172.21.15.134:0/3661884214 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v41) v1 ==== 107+0+4846 (secure 0 0 0) 0x7fe5ac05ade0 con 0x7fe5bc0ffc50 2024-04-13T11:11:05.782 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:05.782 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44309,"name":"cephfs.smithi194.wnddvg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6825/2092944903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2092944903},{"type":"v1","addr":"172.21.15.194:6825","nonce":2092944903}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":44335,"name":"cephfs.smithi194.svyrny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6827/2085856165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2085856165},{"type":"v1","addr":"172.21.15.194:6827","nonce":2085856165}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-13T10:55:40.674498+0000","modified":"2024-04-13T11:08:34.674272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34322":{"gid":34322,"name":"cephfs.smithi134.hxpcfx","rank":0,"incarnation":34,"state":"up:active","state_seq":22,"addr":"172.21.15.134:6827/3173053746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3173053746},{"type":"v1","addr":"172.21.15.134:6827","nonce":3173053746}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34354":{"gid":34354,"name":"cephfs.smithi134.kachce","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6829/3883973153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3883973153},{"type":"v1","addr":"172.21.15.134:6829","nonce":3883973153}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-13T11:11:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 -- 172.21.15.134:0/3661884214 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe5a806cda0 msgr2=0x7fe5a806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe5a806cda0 0x7fe5a806f250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005950 tx=0x7fe5b80058e0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 -- 172.21.15.134:0/3661884214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5bc0ffc50 msgr2=0x7fe5bc196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5bc0ffc50 0x7fe5bc196ec0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac000c00 tx=0x7fe5ac00be20 comp rx=0 tx=0).stop 2024-04-13T11:11:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 -- 172.21.15.134:0/3661884214 shutdown_connections 2024-04-13T11:11:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fe5a806cda0 0x7fe5a806f250 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5bc0ff2b0 0x7fe5bc196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 --2- 172.21.15.134:0/3661884214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5bc0ffc50 0x7fe5bc196ec0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 -- 172.21.15.134:0/3661884214 >> 172.21.15.134:0/3661884214 conn(0x7fe5bc074d90 msgr2=0x7fe5bc0fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:05.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 -- 172.21.15.134:0/3661884214 shutdown_connections 2024-04-13T11:11:05.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:05.783+0000 7fe5c4301700 1 -- 172.21.15.134:0/3661884214 wait complete. 2024-04-13T11:11:05.785 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 40 2024-04-13T11:11:05.796 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-13T11:11:05.808 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-13T11:11:05.808 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T11:11:05.808 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T11:11:05.828 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T11:11:05.828 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T11:11:05.887 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T11:11:06.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.048+0000 7f357e55a700 1 -- 172.21.15.134:0/1583811356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35780ffbc0 msgr2=0x7f3578103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.048+0000 7f357e55a700 1 --2- 172.21.15.134:0/1583811356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35780ffbc0 0x7f3578103b80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3560009910 tx=0x7f3560009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:06.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.048+0000 7f357e55a700 1 -- 172.21.15.134:0/1583811356 shutdown_connections 2024-04-13T11:11:06.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.048+0000 7f357e55a700 1 --2- 172.21.15.134:0/1583811356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35780ffbc0 0x7f3578103b80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.048+0000 7f357e55a700 1 --2- 172.21.15.134:0/1583811356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35780ff220 0x7f35780ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.048+0000 7f357e55a700 1 -- 172.21.15.134:0/1583811356 >> 172.21.15.134:0/1583811356 conn(0x7f35780faa70 msgr2=0x7f35780fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:06.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.048+0000 7f357e55a700 1 -- 172.21.15.134:0/1583811356 shutdown_connections 2024-04-13T11:11:06.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.048+0000 7f357e55a700 1 -- 172.21.15.134:0/1583811356 wait complete. 2024-04-13T11:11:06.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f357e55a700 1 Processor -- start 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f357e55a700 1 -- start start 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f357e55a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35780ff220 0x7f35781969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f357e55a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35780ffbc0 0x7f3578196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f357e55a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3578197530 con 0x7f35780ff220 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f357e55a700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35781976a0 con 0x7f35780ffbc0 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f3577fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35780ff220 0x7f35781969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f3577fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35780ff220 0x7f35781969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54138/0 (socket says 172.21.15.134:54138) 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f3577fff700 1 -- 172.21.15.134:0/1459680094 learned_addr learned my addr 172.21.15.134:0/1459680094 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f35777fe700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35780ffbc0 0x7f3578196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f3577fff700 1 -- 172.21.15.134:0/1459680094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35780ffbc0 msgr2=0x7f3578196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f3577fff700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35780ffbc0 0x7f3578196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.049+0000 7f3577fff700 1 -- 172.21.15.134:0/1459680094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600095f0 con 0x7f35780ff220 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.050+0000 7f3577fff700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35780ff220 0x7f35781969d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f356800c8a0 tx=0x7f356800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:06.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.050+0000 7f35757fa700 1 -- 172.21.15.134:0/1459680094 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35680078e0 con 0x7f35780ff220 2024-04-13T11:11:06.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.050+0000 7f357e55a700 1 -- 172.21.15.134:0/1459680094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357819fa40 con 0x7f35780ff220 2024-04-13T11:11:06.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.050+0000 7f35757fa700 1 -- 172.21.15.134:0/1459680094 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f356800f450 con 0x7f35780ff220 2024-04-13T11:11:06.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.050+0000 7f35757fa700 1 -- 172.21.15.134:0/1459680094 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f356800e5e0 con 0x7f35780ff220 2024-04-13T11:11:06.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.050+0000 7f357e55a700 1 -- 172.21.15.134:0/1459680094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357819ff10 con 0x7f35780ff220 2024-04-13T11:11:06.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.051+0000 7f357e55a700 1 -- 172.21.15.134:0/1459680094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3578107580 con 0x7f35780ff220 2024-04-13T11:11:06.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.051+0000 7f35757fa700 1 -- 172.21.15.134:0/1459680094 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f356800f5c0 con 0x7f35780ff220 2024-04-13T11:11:06.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.052+0000 7f35757fa700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f356406cda0 0x7f356406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:06.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.052+0000 7f35757fa700 1 -- 172.21.15.134:0/1459680094 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f356808c2a0 con 0x7f35780ff220 2024-04-13T11:11:06.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.052+0000 7f35777fe700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f356406cda0 0x7f356406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:06.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.052+0000 7f35777fe700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f356406cda0 0x7f356406f250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3560009fd0 tx=0x7f356001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:06.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.056+0000 7f35757fa700 1 -- 172.21.15.134:0/1459680094 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f3568056240 con 0x7f35780ff220 2024-04-13T11:11:06.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.251+0000 7f357e55a700 1 -- 172.21.15.134:0/1459680094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f357804ea50 con 0x7f35780ff220 2024-04-13T11:11:06.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.252+0000 7f35757fa700 1 -- 172.21.15.134:0/1459680094 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16683 (secure 0 0 0) 0x7f3568059860 con 0x7f35780ff220 2024-04-13T11:11:06.254 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:06.254 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":91,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","created":"2024-04-13T10:48:00.547311+0000","modified":"2024-04-13T11:08:14.000670+0000","last_up_change":"2024-04-13T11:06:55.382409+0000","last_in_change":"2024-04-13T10:53:56.134815+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T10:52:52.594710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-13T10:55:39.381684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-13T10:55:39.903105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02af0f03-a267-4906-8417-d15189c8da92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":85,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6803","nonce":3712938281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6805","nonce":3712938281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6809","nonce":3712938281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6807","nonce":3712938281}]},"public_addr":"172.21.15.134:6803/3712938281","cluster_addr":"172.21.15.134:6805/3712938281","heartbeat_back_addr":"172.21.15.134:6809/3712938281","heartbeat_front_addr":"172.21.15.134:6807/3712938281","state":["exists","up"]},{"osd":1,"uuid":"ce202f5e-9c58-4cd6-b85b-1422131948d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":85,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6811","nonce":1751594116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6813","nonce":1751594116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6817","nonce":1751594116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6815","nonce":1751594116}]},"public_addr":"172.21.15.134:6811/1751594116","cluster_addr":"172.21.15.134:6813/1751594116","heartbeat_back_addr":"172.21.15.134:6817/1751594116","heartbeat_front_addr":"172.21.15.134:6815/1751594116","state":["exists","up"]},{"osd":2,"uuid":"7a2fef79-8403-416e-9037-079ddb080611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":85,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6819","nonce":1661014044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6821","nonce":1661014044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6825","nonce":1661014044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6823","nonce":1661014044}]},"public_addr":"172.21.15.134:6819/1661014044","cluster_addr":"172.21.15.134:6821/1661014044","heartbeat_back_addr":"172.21.15.134:6825/1661014044","heartbeat_front_addr":"172.21.15.134:6823/1661014044","state":["exists","up"]},{"osd":3,"uuid":"44c0411c-d9e0-4d23-b97d-f613b89943a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":72,"up_thru":85,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6801","nonce":1318422614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6803","nonce":1318422614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6807","nonce":1318422614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6805","nonce":1318422614}]},"public_addr":"172.21.15.194:6801/1318422614","cluster_addr":"172.21.15.194:6803/1318422614","heartbeat_back_addr":"172.21.15.194:6807/1318422614","heartbeat_front_addr":"172.21.15.194:6805/1318422614","state":["exists","up"]},{"osd":4,"uuid":"91533b98-bd92-4d8e-afa6-59c396f95799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":76,"up_from":80,"up_thru":85,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6809","nonce":48937761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6811","nonce":48937761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6815","nonce":48937761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6813","nonce":48937761}]},"public_addr":"172.21.15.194:6809/48937761","cluster_addr":"172.21.15.194:6811/48937761","heartbeat_back_addr":"172.21.15.194:6815/48937761","heartbeat_front_addr":"172.21.15.194:6813/48937761","state":["exists","up"]},{"osd":5,"uuid":"3e198b03-2011-435c-afd8-16d8521b9991","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":81,"up_from":85,"up_thru":85,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6817","nonce":1702176960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6819","nonce":1702176960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6823","nonce":1702176960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6821","nonce":1702176960}]},"public_addr":"172.21.15.194:6817/1702176960","cluster_addr":"172.21.15.194:6819/1702176960","heartbeat_back_addr":"172.21.15.194:6823/1702176960","heartbeat_front_addr":"172.21.15.194:6821/1702176960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:51:48.117416+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:17.805248+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:49.973117+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:17.604636+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:46.014087+0000","dead_epoch":76},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:54:14.654274+0000","dead_epoch":81}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":0,"to":2}]},{"pgid":"2.e","mappings":[{"from":0,"to":5}]},{"pgid":"2.1e","mappings":[{"from":0,"to":3}]},{"pgid":"3.a","mappings":[{"from":1,"to":2}]},{"pgid":"3.d","mappings":[{"from":4,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":3}]},{"pgid":"3.1c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6824/3497839686":"2024-04-14T11:07:45.818363+0000","172.21.15.134:6828/3278328584":"2024-04-14T11:07:21.786115+0000","172.21.15.134:6800/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/565739211":"2024-04-14T10:49:08.875132+0000","172.21.15.194:0/1967347374":"2024-04-14T10:59:37.865154+0000","172.21.15.134:6801/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/323045534":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/3055528347":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6801/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.134:6800/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.194:0/2417054087":"2024-04-14T10:59:37.865154+0000","172.21.15.194:6826/3941085795":"2024-04-14T11:08:14.000645+0000","172.21.15.134:6800/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.194:6829/1685298182":"2024-04-14T10:59:37.865154+0000","172.21.15.134:6829/3278328584":"2024-04-14T11:07:21.786115+0000","172.21.15.134:0/2783735336":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6827/3726339659":"2024-04-14T10:55:55.830791+0000","172.21.15.134:0/1977594888":"2024-04-14T10:57:57.426837+0000","172.21.15.194:0/2477915964":"2024-04-14T10:59:37.865154+0000","172.21.15.134:0/2590154845":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/471716030":"2024-04-14T10:49:08.875132+0000","172.21.15.134:6801/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.194:6825/3497839686":"2024-04-14T11:07:45.818363+0000","172.21.15.134:0/4116995009":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/1090834434":"2024-04-14T10:48:33.849227+0000","172.21.15.194:6828/1685298182":"2024-04-14T10:59:37.865154+0000","172.21.15.134:0/4115016009":"2024-04-14T10:57:57.426837+0000","172.21.15.134:6826/3726339659":"2024-04-14T10:55:55.830791+0000","172.21.15.134:0/3281134012":"2024-04-14T10:57:57.426837+0000","172.21.15.134:6800/2958657378":"2024-04-14T10:57:57.426837+0000","172.21.15.134:6801/2958657378":"2024-04-14T10:57:57.426837+0000","172.21.15.194:6827/3941085795":"2024-04-14T11:08:14.000645+0000","172.21.15.134:0/3885996389":"2024-04-14T10:48:33.849227+0000","172.21.15.194:0/365752214":"2024-04-14T10:59:37.865154+0000","172.21.15.134:0/1158318696":"2024-04-14T10:57:57.426837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T11:11:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 -- 172.21.15.134:0/1459680094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f356406cda0 msgr2=0x7f356406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f356406cda0 0x7f356406f250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3560009fd0 tx=0x7f356001a040 comp rx=0 tx=0).stop 2024-04-13T11:11:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 -- 172.21.15.134:0/1459680094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35780ff220 msgr2=0x7f35781969d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35780ff220 0x7f35781969d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f356800c8a0 tx=0x7f356800cbb0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 -- 172.21.15.134:0/1459680094 shutdown_connections 2024-04-13T11:11:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f356406cda0 0x7f356406f250 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35780ff220 0x7f35781969d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 --2- 172.21.15.134:0/1459680094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35780ffbc0 0x7f3578196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 -- 172.21.15.134:0/1459680094 >> 172.21.15.134:0/1459680094 conn(0x7f35780faa70 msgr2=0x7f35780fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 -- 172.21.15.134:0/1459680094 shutdown_connections 2024-04-13T11:11:06.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.255+0000 7f357e55a700 1 -- 172.21.15.134:0/1459680094 wait complete. 2024-04-13T11:11:06.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T10:52:52.594710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-13T10:55:39.381684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-13T10:55:39.903105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T11:11:06.269 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T11:11:06.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.392+0000 7f58b6689700 1 -- 172.21.15.134:0/2659939313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b0067d60 msgr2=0x7f58b00681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.392+0000 7f58b6689700 1 --2- 172.21.15.134:0/2659939313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b0067d60 0x7f58b00681d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009910 tx=0x7f58a4009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.392+0000 7f58b6689700 1 -- 172.21.15.134:0/2659939313 shutdown_connections 2024-04-13T11:11:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.392+0000 7f58b6689700 1 --2- 172.21.15.134:0/2659939313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b0067d60 0x7f58b00681d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.392+0000 7f58b6689700 1 --2- 172.21.15.134:0/2659939313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b01061d0 0x7f58b01065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.392+0000 7f58b6689700 1 -- 172.21.15.134:0/2659939313 >> 172.21.15.134:0/2659939313 conn(0x7f58b0074fa0 msgr2=0x7f58b00753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.392+0000 7f58b6689700 1 -- 172.21.15.134:0/2659939313 shutdown_connections 2024-04-13T11:11:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.392+0000 7f58b6689700 1 -- 172.21.15.134:0/2659939313 wait complete. 2024-04-13T11:11:06.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.393+0000 7f58b6689700 1 Processor -- start 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.393+0000 7f58b6689700 1 -- start start 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.393+0000 7f58b6689700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b0067d60 0x7f58b019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.393+0000 7f58b6689700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b01061d0 0x7f58b019bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.393+0000 7f58b6689700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b019c5a0 con 0x7f58b01061d0 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.393+0000 7f58b6689700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b0195a40 con 0x7f58b0067d60 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.393+0000 7f58af7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b01061d0 0x7f58b019bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.393+0000 7f58af7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b01061d0 0x7f58b019bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54158/0 (socket says 172.21.15.134:54158) 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.393+0000 7f58af7fe700 1 -- 172.21.15.134:0/2281802551 learned_addr learned my addr 172.21.15.134:0/2281802551 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58affff700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b0067d60 0x7f58b019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58af7fe700 1 -- 172.21.15.134:0/2281802551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b0067d60 msgr2=0x7f58b019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58af7fe700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b0067d60 0x7f58b019b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58af7fe700 1 -- 172.21.15.134:0/2281802551 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40095f0 con 0x7f58b01061d0 2024-04-13T11:11:06.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58affff700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b0067d60 0x7f58b019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:11:06.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58af7fe700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b01061d0 0x7f58b019bf10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f58a4006010 tx=0x7f58a400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:06.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58ad7fa700 1 -- 172.21.15.134:0/2281802551 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a401d070 con 0x7f58b01061d0 2024-04-13T11:11:06.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58b6689700 1 -- 172.21.15.134:0/2281802551 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b0195cc0 con 0x7f58b01061d0 2024-04-13T11:11:06.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58ad7fa700 1 -- 172.21.15.134:0/2281802551 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f58a400f460 con 0x7f58b01061d0 2024-04-13T11:11:06.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58ad7fa700 1 -- 172.21.15.134:0/2281802551 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a4021640 con 0x7f58b01061d0 2024-04-13T11:11:06.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.394+0000 7f58b6689700 1 -- 172.21.15.134:0/2281802551 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b0196240 con 0x7f58b01061d0 2024-04-13T11:11:06.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.395+0000 7f58b6689700 1 -- 172.21.15.134:0/2281802551 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b0103450 con 0x7f58b01061d0 2024-04-13T11:11:06.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.395+0000 7f58ad7fa700 1 -- 172.21.15.134:0/2281802551 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f58a400fa60 con 0x7f58b01061d0 2024-04-13T11:11:06.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.396+0000 7f58ad7fa700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f589806cce0 0x7f589806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:06.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.396+0000 7f58ad7fa700 1 -- 172.21.15.134:0/2281802551 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f58a408d950 con 0x7f58b01061d0 2024-04-13T11:11:06.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.396+0000 7f58affff700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f589806cce0 0x7f589806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:06.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.396+0000 7f58affff700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f589806cce0 0x7f589806f190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f58a0007900 tx=0x7f58a0008040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:06.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.400+0000 7f58ad7fa700 1 -- 172.21.15.134:0/2281802551 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f58a405b380 con 0x7f58b01061d0 2024-04-13T11:11:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:06 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/789418517' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-04-13T11:11:06.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:06 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3661884214' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-04-13T11:11:06.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.595+0000 7f58b6689700 1 -- 172.21.15.134:0/2281802551 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58b0196500 con 0x7f58b01061d0 2024-04-13T11:11:06.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.595+0000 7f58ad7fa700 1 -- 172.21.15.134:0/2281802551 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58a405af10 con 0x7f58b01061d0 2024-04-13T11:11:06.596 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-04-13T11:11:06.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 -- 172.21.15.134:0/2281802551 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f589806cce0 msgr2=0x7f589806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f589806cce0 0x7f589806f190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f58a0007900 tx=0x7f58a0008040 comp rx=0 tx=0).stop 2024-04-13T11:11:06.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 -- 172.21.15.134:0/2281802551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b01061d0 msgr2=0x7f58b019bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b01061d0 0x7f58b019bf10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f58a4006010 tx=0x7f58a400be20 comp rx=0 tx=0).stop 2024-04-13T11:11:06.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 -- 172.21.15.134:0/2281802551 shutdown_connections 2024-04-13T11:11:06.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f589806cce0 0x7f589806f190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58b0067d60 0x7f58b019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 --2- 172.21.15.134:0/2281802551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58b01061d0 0x7f58b019bf10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 -- 172.21.15.134:0/2281802551 >> 172.21.15.134:0/2281802551 conn(0x7f58b0074fa0 msgr2=0x7f58b00fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:06.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 -- 172.21.15.134:0/2281802551 shutdown_connections 2024-04-13T11:11:06.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.598+0000 7f58b6689700 1 -- 172.21.15.134:0/2281802551 wait complete. 2024-04-13T11:11:06.609 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:06 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/789418517' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-04-13T11:11:06.610 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:06 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3661884214' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-04-13T11:11:06.611 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-13T11:11:06.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.735+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/4210147290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e980ffa80 msgr2=0x7f5e9810a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.735+0000 7f5e9f3b8700 1 --2- 172.21.15.134:0/4210147290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e980ffa80 0x7f5e9810a4f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009910 tx=0x7f5e88009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:06.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.735+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/4210147290 shutdown_connections 2024-04-13T11:11:06.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.735+0000 7f5e9f3b8700 1 --2- 172.21.15.134:0/4210147290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e980ffa80 0x7f5e9810a4f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.735+0000 7f5e9f3b8700 1 --2- 172.21.15.134:0/4210147290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e980ff170 0x7f5e980ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.735+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/4210147290 >> 172.21.15.134:0/4210147290 conn(0x7f5e980747a0 msgr2=0x7f5e98074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:06.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.735+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/4210147290 shutdown_connections 2024-04-13T11:11:06.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.735+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/4210147290 wait complete. 2024-04-13T11:11:06.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9f3b8700 1 Processor -- start 2024-04-13T11:11:06.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9f3b8700 1 -- start start 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9f3b8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e980ff170 0x7f5e9819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9f3b8700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e980ffa80 0x7f5e9819be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9f3b8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9819c4d0 con 0x7f5e980ff170 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9f3b8700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98195970 con 0x7f5e980ffa80 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9d154700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e980ff170 0x7f5e9819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9d154700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e980ff170 0x7f5e9819b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54176/0 (socket says 172.21.15.134:54176) 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9d154700 1 -- 172.21.15.134:0/1999717982 learned_addr learned my addr 172.21.15.134:0/1999717982 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9c953700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e980ffa80 0x7f5e9819be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9d154700 1 -- 172.21.15.134:0/1999717982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e980ffa80 msgr2=0x7f5e9819be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9d154700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e980ffa80 0x7f5e9819be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9d154700 1 -- 172.21.15.134:0/1999717982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e880095f0 con 0x7f5e980ff170 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9d154700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e980ff170 0x7f5e9819b900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5e90007e90 tx=0x7f5e9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e8e7fc700 1 -- 172.21.15.134:0/1999717982 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e9000de60 con 0x7f5e980ff170 2024-04-13T11:11:06.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e8e7fc700 1 -- 172.21.15.134:0/1999717982 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e9000f040 con 0x7f5e980ff170 2024-04-13T11:11:06.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/1999717982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e98195c50 con 0x7f5e980ff170 2024-04-13T11:11:06.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e8e7fc700 1 -- 172.21.15.134:0/1999717982 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e90004520 con 0x7f5e980ff170 2024-04-13T11:11:06.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.736+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/1999717982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e981961b0 con 0x7f5e980ff170 2024-04-13T11:11:06.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.737+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/1999717982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e98107bf0 con 0x7f5e980ff170 2024-04-13T11:11:06.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.738+0000 7f5e8e7fc700 1 -- 172.21.15.134:0/1999717982 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5e90004790 con 0x7f5e980ff170 2024-04-13T11:11:06.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.738+0000 7f5e8e7fc700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5e8406cce0 0x7f5e8406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:06.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.738+0000 7f5e8e7fc700 1 -- 172.21.15.134:0/1999717982 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f5e9008c2a0 con 0x7f5e980ff170 2024-04-13T11:11:06.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.738+0000 7f5e9c953700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5e8406cce0 0x7f5e8406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:06.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.739+0000 7f5e9c953700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5e8406cce0 0x7f5e8406f190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5e980fdd40 tx=0x7f5e8801a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:06.743 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.743+0000 7f5e8e7fc700 1 -- 172.21.15.134:0/1999717982 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f5e90059cd0 con 0x7f5e980ff170 2024-04-13T11:11:06.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.939+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/1999717982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f5e9804ea50 con 0x7f5e980ff170 2024-04-13T11:11:06.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.939+0000 7f5e8e7fc700 1 -- 172.21.15.134:0/1999717982 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7f5e90004ad0 con 0x7f5e980ff170 2024-04-13T11:11:06.940 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-04-13T11:11:06.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/1999717982 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5e8406cce0 msgr2=0x7f5e8406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5e8406cce0 0x7f5e8406f190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5e980fdd40 tx=0x7f5e8801a040 comp rx=0 tx=0).stop 2024-04-13T11:11:06.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/1999717982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e980ff170 msgr2=0x7f5e9819b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:06.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e980ff170 0x7f5e9819b900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5e90007e90 tx=0x7f5e9000d3b0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/1999717982 shutdown_connections 2024-04-13T11:11:06.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f5e8406cce0 0x7f5e8406f190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e980ff170 0x7f5e9819b900 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 --2- 172.21.15.134:0/1999717982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e980ffa80 0x7f5e9819be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:06.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/1999717982 >> 172.21.15.134:0/1999717982 conn(0x7f5e980747a0 msgr2=0x7f5e98104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:06.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/1999717982 shutdown_connections 2024-04-13T11:11:06.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:06.941+0000 7f5e9f3b8700 1 -- 172.21.15.134:0/1999717982 wait complete. 2024-04-13T11:11:06.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-13T11:11:07.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.078+0000 7f725b6cb700 1 -- 172.21.15.134:0/1621766020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72540ffaa0 msgr2=0x7f72540fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:07.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.078+0000 7f725b6cb700 1 --2- 172.21.15.134:0/1621766020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72540ffaa0 0x7f72540fff10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7250009910 tx=0x7f7250009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:07.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.078+0000 7f725b6cb700 1 -- 172.21.15.134:0/1621766020 shutdown_connections 2024-04-13T11:11:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.078+0000 7f725b6cb700 1 --2- 172.21.15.134:0/1621766020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72540ffaa0 0x7f72540fff10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.078+0000 7f725b6cb700 1 --2- 172.21.15.134:0/1621766020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7254105070 0x7f7254105440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.078+0000 7f725b6cb700 1 -- 172.21.15.134:0/1621766020 >> 172.21.15.134:0/1621766020 conn(0x7f7254074fa0 msgr2=0x7f72540753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.078+0000 7f725b6cb700 1 -- 172.21.15.134:0/1621766020 shutdown_connections 2024-04-13T11:11:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.078+0000 7f725b6cb700 1 -- 172.21.15.134:0/1621766020 wait complete. 2024-04-13T11:11:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f725b6cb700 1 Processor -- start 2024-04-13T11:11:07.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f725b6cb700 1 -- start start 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f725b6cb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72540ffaa0 0x7f725419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f725b6cb700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7254105070 0x7f725419ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f725b6cb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725419b4e0 con 0x7f72540ffaa0 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f725b6cb700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254194980 con 0x7f7254105070 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f7259467700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72540ffaa0 0x7f725419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f7259467700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72540ffaa0 0x7f725419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54192/0 (socket says 172.21.15.134:54192) 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f7259467700 1 -- 172.21.15.134:0/3293004623 learned_addr learned my addr 172.21.15.134:0/3293004623 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f7258c66700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7254105070 0x7f725419ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f7259467700 1 -- 172.21.15.134:0/3293004623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7254105070 msgr2=0x7f725419ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f7259467700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7254105070 0x7f725419ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f7259467700 1 -- 172.21.15.134:0/3293004623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72500095f0 con 0x7f72540ffaa0 2024-04-13T11:11:07.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.079+0000 7f7258c66700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7254105070 0x7f725419ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.080+0000 7f7259467700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72540ffaa0 0x7f725419a910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f724400d8d0 tx=0x7f724400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.080+0000 7f724a7fc700 1 -- 172.21.15.134:0/3293004623 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7244009940 con 0x7f72540ffaa0 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.080+0000 7f724a7fc700 1 -- 172.21.15.134:0/3293004623 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7244010460 con 0x7f72540ffaa0 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.080+0000 7f725b6cb700 1 -- 172.21.15.134:0/3293004623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7254194c60 con 0x7f72540ffaa0 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.080+0000 7f724a7fc700 1 -- 172.21.15.134:0/3293004623 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f724400f5f0 con 0x7f72540ffaa0 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.080+0000 7f725b6cb700 1 -- 172.21.15.134:0/3293004623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72541951c0 con 0x7f72540ffaa0 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.081+0000 7f725b6cb700 1 -- 172.21.15.134:0/3293004623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72541022f0 con 0x7f72540ffaa0 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.081+0000 7f724a7fc700 1 -- 172.21.15.134:0/3293004623 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f72440105d0 con 0x7f72540ffaa0 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.082+0000 7f724a7fc700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f724006cce0 0x7f724006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.082+0000 7f724a7fc700 1 -- 172.21.15.134:0/3293004623 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f724408c620 con 0x7f72540ffaa0 2024-04-13T11:11:07.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.082+0000 7f7258c66700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f724006cce0 0x7f724006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:07.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.082+0000 7f7258c66700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f724006cce0 0x7f724006f190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7250005b40 tx=0x7f725001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:07.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.086+0000 7f724a7fc700 1 -- 172.21.15.134:0/3293004623 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f724405a180 con 0x7f72540ffaa0 2024-04-13T11:11:07.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.282+0000 7f725b6cb700 1 -- 172.21.15.134:0/3293004623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f725404ea50 con 0x7f72540ffaa0 2024-04-13T11:11:07.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.283+0000 7f724a7fc700 1 -- 172.21.15.134:0/3293004623 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7244010880 con 0x7f72540ffaa0 2024-04-13T11:11:07.284 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-04-13T11:11:07.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 -- 172.21.15.134:0/3293004623 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f724006cce0 msgr2=0x7f724006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:07.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f724006cce0 0x7f724006f190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7250005b40 tx=0x7f725001a040 comp rx=0 tx=0).stop 2024-04-13T11:11:07.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 -- 172.21.15.134:0/3293004623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72540ffaa0 msgr2=0x7f725419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:07.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72540ffaa0 0x7f725419a910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f724400d8d0 tx=0x7f724400dc90 comp rx=0 tx=0).stop 2024-04-13T11:11:07.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 -- 172.21.15.134:0/3293004623 shutdown_connections 2024-04-13T11:11:07.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f724006cce0 0x7f724006f190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72540ffaa0 0x7f725419a910 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 --2- 172.21.15.134:0/3293004623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7254105070 0x7f725419ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 -- 172.21.15.134:0/3293004623 >> 172.21.15.134:0/3293004623 conn(0x7f7254074fa0 msgr2=0x7f72540fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:07.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 -- 172.21.15.134:0/3293004623 shutdown_connections 2024-04-13T11:11:07.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.285+0000 7f725b6cb700 1 -- 172.21.15.134:0/3293004623 wait complete. 2024-04-13T11:11:07.298 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-13T11:11:07.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 -- 172.21.15.134:0/1781936813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70067d60 msgr2=0x7fdf700681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 --2- 172.21.15.134:0/1781936813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70067d60 0x7fdf700681b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009910 tx=0x7fdf60009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 -- 172.21.15.134:0/1781936813 shutdown_connections 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 --2- 172.21.15.134:0/1781936813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70067d60 0x7fdf700681b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 --2- 172.21.15.134:0/1781936813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf701060c0 0x7fdf70106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 -- 172.21.15.134:0/1781936813 >> 172.21.15.134:0/1781936813 conn(0x7fdf70074d90 msgr2=0x7fdf70075190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 -- 172.21.15.134:0/1781936813 shutdown_connections 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 -- 172.21.15.134:0/1781936813 wait complete. 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 Processor -- start 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 -- start start 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.425+0000 7fdf782e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70067d60 0x7fdf7019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf782e7700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf701060c0 0x7fdf7019bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf782e7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7019c3d0 con 0x7fdf70067d60 2024-04-13T11:11:07.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf782e7700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70195900 con 0x7fdf701060c0 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf76083700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70067d60 0x7fdf7019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf76083700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70067d60 0x7fdf7019b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54200/0 (socket says 172.21.15.134:54200) 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf76083700 1 -- 172.21.15.134:0/824581839 learned_addr learned my addr 172.21.15.134:0/824581839 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf75882700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf701060c0 0x7fdf7019bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf76083700 1 -- 172.21.15.134:0/824581839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf701060c0 msgr2=0x7fdf7019bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf76083700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf701060c0 0x7fdf7019bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf76083700 1 -- 172.21.15.134:0/824581839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf600095f0 con 0x7fdf70067d60 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf75882700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf701060c0 0x7fdf7019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf76083700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70067d60 0x7fdf7019b890 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00c930 tx=0x7fdf6c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf677fe700 1 -- 172.21.15.134:0/824581839 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf6c007ad0 con 0x7fdf70067d60 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf782e7700 1 -- 172.21.15.134:0/824581839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf70195be0 con 0x7fdf70067d60 2024-04-13T11:11:07.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf782e7700 1 -- 172.21.15.134:0/824581839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf70196140 con 0x7fdf70067d60 2024-04-13T11:11:07.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf677fe700 1 -- 172.21.15.134:0/824581839 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf6c00a5f0 con 0x7fdf70067d60 2024-04-13T11:11:07.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.426+0000 7fdf677fe700 1 -- 172.21.15.134:0/824581839 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf6c018630 con 0x7fdf70067d60 2024-04-13T11:11:07.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.428+0000 7fdf782e7700 1 -- 172.21.15.134:0/824581839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf54005310 con 0x7fdf70067d60 2024-04-13T11:11:07.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.428+0000 7fdf677fe700 1 -- 172.21.15.134:0/824581839 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fdf6c018790 con 0x7fdf70067d60 2024-04-13T11:11:07.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.428+0000 7fdf677fe700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fdf5c06cda0 0x7fdf5c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:07.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.428+0000 7fdf677fe700 1 -- 172.21.15.134:0/824581839 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fdf6c08c740 con 0x7fdf70067d60 2024-04-13T11:11:07.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.428+0000 7fdf75882700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fdf5c06cda0 0x7fdf5c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:07.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.429+0000 7fdf75882700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fdf5c06cda0 0x7fdf5c06f250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000b5c0 tx=0x7fdf60005fd0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:07.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.433+0000 7fdf677fe700 1 -- 172.21.15.134:0/824581839 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fdf6c05b230 con 0x7fdf70067d60 2024-04-13T11:11:07.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:07 smithi194 ceph-mon[83053]: pgmap v390: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:07.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:07 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1459680094' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T11:11:07.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:07 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2281802551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-13T11:11:07.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:07 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1999717982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-13T11:11:07.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.645+0000 7fdf782e7700 1 -- 172.21.15.134:0/824581839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdf54005f60 con 0x7fdf70067d60 2024-04-13T11:11:07.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.645+0000 7fdf677fe700 1 -- 172.21.15.134:0/824581839 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v91) v1 ==== 81+0+2115 (secure 0 0 0) 0x7fdf6c05adc0 con 0x7fdf70067d60 2024-04-13T11:11:07.646 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6824/3497839686 2024-04-14T11:07:45.818363+0000 2024-04-13T11:11:07.646 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6828/3278328584 2024-04-14T11:07:21.786115+0000 2024-04-13T11:11:07.646 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/3448754383 2024-04-14T10:48:33.849227+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/565739211 2024-04-14T10:49:08.875132+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:0/1967347374 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/3448754383 2024-04-14T10:48:33.849227+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/323045534 2024-04-14T10:50:28.273144+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3055528347 2024-04-14T10:50:28.273144+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/1656434316 2024-04-14T10:49:08.875132+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/1656434316 2024-04-14T10:49:08.875132+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:0/2417054087 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6826/3941085795 2024-04-14T11:08:14.000645+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/2524753251 2024-04-14T10:50:28.273144+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6829/1685298182 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6829/3278328584 2024-04-14T11:07:21.786115+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2783735336 2024-04-14T10:48:33.849227+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6827/3726339659 2024-04-14T10:55:55.830791+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1977594888 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:0/2477915964 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2590154845 2024-04-14T10:50:28.273144+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/471716030 2024-04-14T10:49:08.875132+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/2524753251 2024-04-14T10:50:28.273144+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6825/3497839686 2024-04-14T11:07:45.818363+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/4116995009 2024-04-14T10:49:08.875132+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1090834434 2024-04-14T10:48:33.849227+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6828/1685298182 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/4115016009 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6826/3726339659 2024-04-14T10:55:55.830791+0000 2024-04-13T11:11:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3281134012 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/2958657378 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/2958657378 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6827/3941085795 2024-04-14T11:08:14.000645+0000 2024-04-13T11:11:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3885996389 2024-04-14T10:48:33.849227+0000 2024-04-13T11:11:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:0/365752214 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1158318696 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 -- 172.21.15.134:0/824581839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fdf5c06cda0 msgr2=0x7fdf5c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fdf5c06cda0 0x7fdf5c06f250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000b5c0 tx=0x7fdf60005fd0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 -- 172.21.15.134:0/824581839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70067d60 msgr2=0x7fdf7019b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70067d60 0x7fdf7019b890 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00c930 tx=0x7fdf6c00ccf0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 -- 172.21.15.134:0/824581839 shutdown_connections 2024-04-13T11:11:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fdf5c06cda0 0x7fdf5c06f250 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf70067d60 0x7fdf7019b890 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 --2- 172.21.15.134:0/824581839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf701060c0 0x7fdf7019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 -- 172.21.15.134:0/824581839 >> 172.21.15.134:0/824581839 conn(0x7fdf70074d90 msgr2=0x7fdf700fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 -- 172.21.15.134:0/824581839 shutdown_connections 2024-04-13T11:11:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.647+0000 7fdf782e7700 1 -- 172.21.15.134:0/824581839 wait complete. 2024-04-13T11:11:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:listed 35 entries 2024-04-13T11:11:07.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:07 smithi134 ceph-mon[112184]: pgmap v390: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:07.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:07 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1459680094' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T11:11:07.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:07 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2281802551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-13T11:11:07.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:07 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1999717982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-13T11:11:07.661 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-13T11:11:07.661 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T11:11:07.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T11:11:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.842+0000 7fc97886e700 1 -- 172.21.15.134:0/1578664573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9740ff170 msgr2=0x7fc9740ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.842+0000 7fc97886e700 1 --2- 172.21.15.134:0/1578664573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9740ff170 0x7fc9740ff540 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc968009910 tx=0x7fc968009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.842+0000 7fc97886e700 1 -- 172.21.15.134:0/1578664573 shutdown_connections 2024-04-13T11:11:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.842+0000 7fc97886e700 1 --2- 172.21.15.134:0/1578664573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9740ffa80 0x7fc97410a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.842+0000 7fc97886e700 1 --2- 172.21.15.134:0/1578664573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9740ff170 0x7fc9740ff540 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.842+0000 7fc97886e700 1 -- 172.21.15.134:0/1578664573 >> 172.21.15.134:0/1578664573 conn(0x7fc9740747a0 msgr2=0x7fc974074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.842+0000 7fc97886e700 1 -- 172.21.15.134:0/1578664573 shutdown_connections 2024-04-13T11:11:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.842+0000 7fc97886e700 1 -- 172.21.15.134:0/1578664573 wait complete. 2024-04-13T11:11:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.843+0000 7fc97886e700 1 Processor -- start 2024-04-13T11:11:07.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.843+0000 7fc97886e700 1 -- start start 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.843+0000 7fc97886e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9740ff170 0x7fc97419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.843+0000 7fc97886e700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9740ffa80 0x7fc97419be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.843+0000 7fc97886e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97419c4e0 con 0x7fc9740ff170 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.843+0000 7fc97886e700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc974195980 con 0x7fc9740ffa80 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.843+0000 7fc97259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9740ff170 0x7fc97419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.843+0000 7fc97259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9740ff170 0x7fc97419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54206/0 (socket says 172.21.15.134:54206) 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.843+0000 7fc97259c700 1 -- 172.21.15.134:0/2493375252 learned_addr learned my addr 172.21.15.134:0/2493375252 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.843+0000 7fc971d9b700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9740ffa80 0x7fc97419be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.844+0000 7fc97259c700 1 -- 172.21.15.134:0/2493375252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9740ffa80 msgr2=0x7fc97419be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.844+0000 7fc97259c700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9740ffa80 0x7fc97419be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.844+0000 7fc97259c700 1 -- 172.21.15.134:0/2493375252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680095f0 con 0x7fc9740ff170 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.844+0000 7fc97259c700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9740ff170 0x7fc97419b910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc968006010 tx=0x7fc96800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:07.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.844+0000 7fc9637fe700 1 -- 172.21.15.134:0/2493375252 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc96801d070 con 0x7fc9740ff170 2024-04-13T11:11:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.844+0000 7fc9637fe700 1 -- 172.21.15.134:0/2493375252 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc96800f460 con 0x7fc9740ff170 2024-04-13T11:11:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.844+0000 7fc97886e700 1 -- 172.21.15.134:0/2493375252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc974195c60 con 0x7fc9740ff170 2024-04-13T11:11:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.844+0000 7fc9637fe700 1 -- 172.21.15.134:0/2493375252 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc968021640 con 0x7fc9740ff170 2024-04-13T11:11:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.844+0000 7fc97886e700 1 -- 172.21.15.134:0/2493375252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc974196240 con 0x7fc9740ff170 2024-04-13T11:11:07.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.845+0000 7fc97886e700 1 -- 172.21.15.134:0/2493375252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc974107bf0 con 0x7fc9740ff170 2024-04-13T11:11:07.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.845+0000 7fc9637fe700 1 -- 172.21.15.134:0/2493375252 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc96800f9e0 con 0x7fc9740ff170 2024-04-13T11:11:07.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.846+0000 7fc9637fe700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc95c06cda0 0x7fc95c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:07.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.846+0000 7fc9637fe700 1 -- 172.21.15.134:0/2493375252 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fc96808d900 con 0x7fc9740ff170 2024-04-13T11:11:07.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.846+0000 7fc971d9b700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc95c06cda0 0x7fc95c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:07.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.846+0000 7fc971d9b700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc95c06cda0 0x7fc95c06f250 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc964006fd0 tx=0x7fc964008040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:07.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:07.850+0000 7fc9637fe700 1 -- 172.21.15.134:0/2493375252 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7fc96805b330 con 0x7fc9740ff170 2024-04-13T11:11:08.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.048+0000 7fc97886e700 1 -- 172.21.15.134:0/2493375252 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9741965c0 con 0x7fc9740ff170 2024-04-13T11:11:08.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.049+0000 7fc9637fe700 1 -- 172.21.15.134:0/2493375252 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16683 (secure 0 0 0) 0x7fc968057020 con 0x7fc9740ff170 2024-04-13T11:11:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-13T11:11:08.051 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":91,"fsid":"38dd2ea8-f983-11ee-bc8d-c7b262605968","created":"2024-04-13T10:48:00.547311+0000","modified":"2024-04-13T11:08:14.000670+0000","last_up_change":"2024-04-13T11:06:55.382409+0000","last_in_change":"2024-04-13T10:53:56.134815+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T10:52:52.594710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-13T10:55:39.381684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-13T10:55:39.903105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02af0f03-a267-4906-8417-d15189c8da92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":85,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6803","nonce":3712938281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6805","nonce":3712938281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6809","nonce":3712938281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3712938281},{"type":"v1","addr":"172.21.15.134:6807","nonce":3712938281}]},"public_addr":"172.21.15.134:6803/3712938281","cluster_addr":"172.21.15.134:6805/3712938281","heartbeat_back_addr":"172.21.15.134:6809/3712938281","heartbeat_front_addr":"172.21.15.134:6807/3712938281","state":["exists","up"]},{"osd":1,"uuid":"ce202f5e-9c58-4cd6-b85b-1422131948d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":85,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6811","nonce":1751594116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6813","nonce":1751594116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6817","nonce":1751594116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1751594116},{"type":"v1","addr":"172.21.15.134:6815","nonce":1751594116}]},"public_addr":"172.21.15.134:6811/1751594116","cluster_addr":"172.21.15.134:6813/1751594116","heartbeat_back_addr":"172.21.15.134:6817/1751594116","heartbeat_front_addr":"172.21.15.134:6815/1751594116","state":["exists","up"]},{"osd":2,"uuid":"7a2fef79-8403-416e-9037-079ddb080611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":85,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6819","nonce":1661014044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6821","nonce":1661014044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6825","nonce":1661014044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1661014044},{"type":"v1","addr":"172.21.15.134:6823","nonce":1661014044}]},"public_addr":"172.21.15.134:6819/1661014044","cluster_addr":"172.21.15.134:6821/1661014044","heartbeat_back_addr":"172.21.15.134:6825/1661014044","heartbeat_front_addr":"172.21.15.134:6823/1661014044","state":["exists","up"]},{"osd":3,"uuid":"44c0411c-d9e0-4d23-b97d-f613b89943a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":72,"up_thru":85,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6801","nonce":1318422614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6803","nonce":1318422614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6807","nonce":1318422614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1318422614},{"type":"v1","addr":"172.21.15.194:6805","nonce":1318422614}]},"public_addr":"172.21.15.194:6801/1318422614","cluster_addr":"172.21.15.194:6803/1318422614","heartbeat_back_addr":"172.21.15.194:6807/1318422614","heartbeat_front_addr":"172.21.15.194:6805/1318422614","state":["exists","up"]},{"osd":4,"uuid":"91533b98-bd92-4d8e-afa6-59c396f95799","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":76,"up_from":80,"up_thru":85,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6809","nonce":48937761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6811","nonce":48937761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6815","nonce":48937761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":48937761},{"type":"v1","addr":"172.21.15.194:6813","nonce":48937761}]},"public_addr":"172.21.15.194:6809/48937761","cluster_addr":"172.21.15.194:6811/48937761","heartbeat_back_addr":"172.21.15.194:6815/48937761","heartbeat_front_addr":"172.21.15.194:6813/48937761","state":["exists","up"]},{"osd":5,"uuid":"3e198b03-2011-435c-afd8-16d8521b9991","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":81,"up_from":85,"up_thru":85,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6817","nonce":1702176960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6819","nonce":1702176960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6823","nonce":1702176960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1702176960},{"type":"v1","addr":"172.21.15.194:6821","nonce":1702176960}]},"public_addr":"172.21.15.194:6817/1702176960","cluster_addr":"172.21.15.194:6819/1702176960","heartbeat_back_addr":"172.21.15.194:6823/1702176960","heartbeat_front_addr":"172.21.15.194:6821/1702176960","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:51:48.117416+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:17.805248+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:52:49.973117+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:17.604636+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:53:46.014087+0000","dead_epoch":76},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T10:54:14.654274+0000","dead_epoch":81}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":0,"to":2}]},{"pgid":"2.e","mappings":[{"from":0,"to":5}]},{"pgid":"2.1e","mappings":[{"from":0,"to":3}]},{"pgid":"3.a","mappings":[{"from":1,"to":2}]},{"pgid":"3.d","mappings":[{"from":4,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":3}]},{"pgid":"3.1c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6824/3497839686":"2024-04-14T11:07:45.818363+0000","172.21.15.134:6828/3278328584":"2024-04-14T11:07:21.786115+0000","172.21.15.134:6800/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/565739211":"2024-04-14T10:49:08.875132+0000","172.21.15.194:0/1967347374":"2024-04-14T10:59:37.865154+0000","172.21.15.134:6801/3448754383":"2024-04-14T10:48:33.849227+0000","172.21.15.134:0/323045534":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/3055528347":"2024-04-14T10:50:28.273144+0000","172.21.15.134:6801/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.134:6800/1656434316":"2024-04-14T10:49:08.875132+0000","172.21.15.194:0/2417054087":"2024-04-14T10:59:37.865154+0000","172.21.15.194:6826/3941085795":"2024-04-14T11:08:14.000645+0000","172.21.15.134:6800/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.194:6829/1685298182":"2024-04-14T10:59:37.865154+0000","172.21.15.134:6829/3278328584":"2024-04-14T11:07:21.786115+0000","172.21.15.134:0/2783735336":"2024-04-14T10:48:33.849227+0000","172.21.15.134:6827/3726339659":"2024-04-14T10:55:55.830791+0000","172.21.15.134:0/1977594888":"2024-04-14T10:57:57.426837+0000","172.21.15.194:0/2477915964":"2024-04-14T10:59:37.865154+0000","172.21.15.134:0/2590154845":"2024-04-14T10:50:28.273144+0000","172.21.15.134:0/471716030":"2024-04-14T10:49:08.875132+0000","172.21.15.134:6801/2524753251":"2024-04-14T10:50:28.273144+0000","172.21.15.194:6825/3497839686":"2024-04-14T11:07:45.818363+0000","172.21.15.134:0/4116995009":"2024-04-14T10:49:08.875132+0000","172.21.15.134:0/1090834434":"2024-04-14T10:48:33.849227+0000","172.21.15.194:6828/1685298182":"2024-04-14T10:59:37.865154+0000","172.21.15.134:0/4115016009":"2024-04-14T10:57:57.426837+0000","172.21.15.134:6826/3726339659":"2024-04-14T10:55:55.830791+0000","172.21.15.134:0/3281134012":"2024-04-14T10:57:57.426837+0000","172.21.15.134:6800/2958657378":"2024-04-14T10:57:57.426837+0000","172.21.15.134:6801/2958657378":"2024-04-14T10:57:57.426837+0000","172.21.15.194:6827/3941085795":"2024-04-14T11:08:14.000645+0000","172.21.15.134:0/3885996389":"2024-04-14T10:48:33.849227+0000","172.21.15.194:0/365752214":"2024-04-14T10:59:37.865154+0000","172.21.15.134:0/1158318696":"2024-04-14T10:57:57.426837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T11:11:08.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 -- 172.21.15.134:0/2493375252 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc95c06cda0 msgr2=0x7fc95c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc95c06cda0 0x7fc95c06f250 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc964006fd0 tx=0x7fc964008040 comp rx=0 tx=0).stop 2024-04-13T11:11:08.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 -- 172.21.15.134:0/2493375252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9740ff170 msgr2=0x7fc97419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9740ff170 0x7fc97419b910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc968006010 tx=0x7fc96800be20 comp rx=0 tx=0).stop 2024-04-13T11:11:08.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 -- 172.21.15.134:0/2493375252 shutdown_connections 2024-04-13T11:11:08.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7fc95c06cda0 0x7fc95c06f250 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9740ff170 0x7fc97419b910 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 --2- 172.21.15.134:0/2493375252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9740ffa80 0x7fc97419be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 -- 172.21.15.134:0/2493375252 >> 172.21.15.134:0/2493375252 conn(0x7fc9740747a0 msgr2=0x7fc974104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:08.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 -- 172.21.15.134:0/2493375252 shutdown_connections 2024-04-13T11:11:08.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.052+0000 7fc97886e700 1 -- 172.21.15.134:0/2493375252 wait complete. 2024-04-13T11:11:08.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T10:52:52.594710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-13T10:55:39.381684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-13T10:55:39.903105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T11:11:08.066 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T11:11:08.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.190+0000 7ff85bbed700 1 -- 172.21.15.134:0/666580466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8540ffba0 msgr2=0x7ff854103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.190+0000 7ff85bbed700 1 --2- 172.21.15.134:0/666580466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8540ffba0 0x7ff854103b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff850009910 tx=0x7ff850009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:08.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.190+0000 7ff85bbed700 1 -- 172.21.15.134:0/666580466 shutdown_connections 2024-04-13T11:11:08.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.190+0000 7ff85bbed700 1 --2- 172.21.15.134:0/666580466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8540ffba0 0x7ff854103b60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.190+0000 7ff85bbed700 1 --2- 172.21.15.134:0/666580466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8540ff200 0x7ff8540ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.190+0000 7ff85bbed700 1 -- 172.21.15.134:0/666580466 >> 172.21.15.134:0/666580466 conn(0x7ff8540faa90 msgr2=0x7ff8540fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:08.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.190+0000 7ff85bbed700 1 -- 172.21.15.134:0/666580466 shutdown_connections 2024-04-13T11:11:08.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.190+0000 7ff85bbed700 1 -- 172.21.15.134:0/666580466 wait complete. 2024-04-13T11:11:08.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff85bbed700 1 Processor -- start 2024-04-13T11:11:08.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff85bbed700 1 -- start start 2024-04-13T11:11:08.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff85bbed700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8540ff200 0x7ff85419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:08.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff85bbed700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8540ffba0 0x7ff85419ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:08.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff85bbed700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85419b4b0 con 0x7ff8540ff200 2024-04-13T11:11:08.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff85bbed700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff854194950 con 0x7ff8540ffba0 2024-04-13T11:11:08.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff859989700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8540ff200 0x7ff85419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:08.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff859989700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8540ff200 0x7ff85419a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54218/0 (socket says 172.21.15.134:54218) 2024-04-13T11:11:08.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff859989700 1 -- 172.21.15.134:0/530886860 learned_addr learned my addr 172.21.15.134:0/530886860 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:08.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff859188700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8540ffba0 0x7ff85419ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:08.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff859989700 1 -- 172.21.15.134:0/530886860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8540ffba0 msgr2=0x7ff85419ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff859989700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8540ffba0 0x7ff85419ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.191+0000 7ff859989700 1 -- 172.21.15.134:0/530886860 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500095f0 con 0x7ff8540ff200 2024-04-13T11:11:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.192+0000 7ff859989700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8540ff200 0x7ff85419a8e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff84400d8d0 tx=0x7ff84400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.192+0000 7ff84affd700 1 -- 172.21.15.134:0/530886860 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff844009940 con 0x7ff8540ff200 2024-04-13T11:11:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.192+0000 7ff85bbed700 1 -- 172.21.15.134:0/530886860 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff854194c30 con 0x7ff8540ff200 2024-04-13T11:11:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.192+0000 7ff84affd700 1 -- 172.21.15.134:0/530886860 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff844010460 con 0x7ff8540ff200 2024-04-13T11:11:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.192+0000 7ff84affd700 1 -- 172.21.15.134:0/530886860 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff84400f5f0 con 0x7ff8540ff200 2024-04-13T11:11:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.192+0000 7ff85bbed700 1 -- 172.21.15.134:0/530886860 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff854195160 con 0x7ff8540ff200 2024-04-13T11:11:08.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.193+0000 7ff85bbed700 1 -- 172.21.15.134:0/530886860 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff854107560 con 0x7ff8540ff200 2024-04-13T11:11:08.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.193+0000 7ff84affd700 1 -- 172.21.15.134:0/530886860 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff8440105d0 con 0x7ff8540ff200 2024-04-13T11:11:08.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.194+0000 7ff84affd700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff84006cce0 0x7ff84006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:08.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.194+0000 7ff859188700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff84006cce0 0x7ff84006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:08.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.194+0000 7ff84affd700 1 -- 172.21.15.134:0/530886860 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7ff84408c6b0 con 0x7ff8540ff200 2024-04-13T11:11:08.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.194+0000 7ff859188700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff84006cce0 0x7ff84006f190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff850006010 tx=0x7ff85001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:08.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.198+0000 7ff84affd700 1 -- 172.21.15.134:0/530886860 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7ff84405a0e0 con 0x7ff8540ff200 2024-04-13T11:11:08.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.395+0000 7ff85bbed700 1 -- 172.21.15.134:0/530886860 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff854195440 con 0x7ff8540ff200 2024-04-13T11:11:08.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.395+0000 7ff84affd700 1 -- 172.21.15.134:0/530886860 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff844010880 con 0x7ff8540ff200 2024-04-13T11:11:08.396 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-04-13T11:11:08.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 -- 172.21.15.134:0/530886860 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff84006cce0 msgr2=0x7ff84006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff84006cce0 0x7ff84006f190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff850006010 tx=0x7ff85001a040 comp rx=0 tx=0).stop 2024-04-13T11:11:08.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 -- 172.21.15.134:0/530886860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8540ff200 msgr2=0x7ff85419a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8540ff200 0x7ff85419a8e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff84400d8d0 tx=0x7ff84400dc90 comp rx=0 tx=0).stop 2024-04-13T11:11:08.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 -- 172.21.15.134:0/530886860 shutdown_connections 2024-04-13T11:11:08.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7ff84006cce0 0x7ff84006f190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8540ff200 0x7ff85419a8e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 --2- 172.21.15.134:0/530886860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8540ffba0 0x7ff85419ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 -- 172.21.15.134:0/530886860 >> 172.21.15.134:0/530886860 conn(0x7ff8540faa90 msgr2=0x7ff8540fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:08.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 -- 172.21.15.134:0/530886860 shutdown_connections 2024-04-13T11:11:08.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.397+0000 7ff85bbed700 1 -- 172.21.15.134:0/530886860 wait complete. 2024-04-13T11:11:08.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:08 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/3293004623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-13T11:11:08.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:08 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/824581839' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-13T11:11:08.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:11:08.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:08 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/2493375252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T11:11:08.411 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-13T11:11:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:08 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/3293004623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-13T11:11:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:08 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/824581839' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-13T11:11:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:11:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:08 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/2493375252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-13T11:11:08.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 -- 172.21.15.134:0/1027596678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff68105070 msgr2=0x7eff68105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 --2- 172.21.15.134:0/1027596678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff68105070 0x7eff68105440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff58009910 tx=0x7eff58009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:08.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 -- 172.21.15.134:0/1027596678 shutdown_connections 2024-04-13T11:11:08.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 --2- 172.21.15.134:0/1027596678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff680ffaa0 0x7eff680fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 --2- 172.21.15.134:0/1027596678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff68105070 0x7eff68105440 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 -- 172.21.15.134:0/1027596678 >> 172.21.15.134:0/1027596678 conn(0x7eff68074fa0 msgr2=0x7eff680753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:08.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 -- 172.21.15.134:0/1027596678 shutdown_connections 2024-04-13T11:11:08.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 -- 172.21.15.134:0/1027596678 wait complete. 2024-04-13T11:11:08.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 Processor -- start 2024-04-13T11:11:08.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 -- start start 2024-04-13T11:11:08.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff680ffaa0 0x7eff68196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:08.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68105070 0x7eff68196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:08.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff68197570 con 0x7eff680ffaa0 2024-04-13T11:11:08.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.535+0000 7eff6fa96700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff681976e0 con 0x7eff68105070 2024-04-13T11:11:08.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6d832700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff680ffaa0 0x7eff68196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:08.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6d832700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff680ffaa0 0x7eff68196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54230/0 (socket says 172.21.15.134:54230) 2024-04-13T11:11:08.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6d832700 1 -- 172.21.15.134:0/1503066424 learned_addr learned my addr 172.21.15.134:0/1503066424 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:08.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6d031700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68105070 0x7eff68196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:08.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6d832700 1 -- 172.21.15.134:0/1503066424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68105070 msgr2=0x7eff68196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6d832700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68105070 0x7eff68196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6d832700 1 -- 172.21.15.134:0/1503066424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff580095f0 con 0x7eff680ffaa0 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6d031700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68105070 0x7eff68196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6d832700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff680ffaa0 0x7eff68196a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff58006010 tx=0x7eff5800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff5effd700 1 -- 172.21.15.134:0/1503066424 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff5801d070 con 0x7eff680ffaa0 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6fa96700 1 -- 172.21.15.134:0/1503066424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6819fa80 con 0x7eff680ffaa0 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff5effd700 1 -- 172.21.15.134:0/1503066424 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff5800f460 con 0x7eff680ffaa0 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff5effd700 1 -- 172.21.15.134:0/1503066424 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff58021620 con 0x7eff680ffaa0 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.536+0000 7eff6fa96700 1 -- 172.21.15.134:0/1503066424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6819ff00 con 0x7eff680ffaa0 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.537+0000 7eff6fa96700 1 -- 172.21.15.134:0/1503066424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6804ea50 con 0x7eff680ffaa0 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.538+0000 7eff5effd700 1 -- 172.21.15.134:0/1503066424 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7eff5800fa40 con 0x7eff680ffaa0 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.538+0000 7eff5effd700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7eff5406cce0 0x7eff5406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:08.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.538+0000 7eff5effd700 1 -- 172.21.15.134:0/1503066424 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7eff5808d860 con 0x7eff680ffaa0 2024-04-13T11:11:08.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.538+0000 7eff6d031700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7eff5406cce0 0x7eff5406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:08.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.538+0000 7eff6d031700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7eff5406cce0 0x7eff5406f190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff64005950 tx=0x7eff640058e0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:08.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.542+0000 7eff5effd700 1 -- 172.21.15.134:0/1503066424 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7eff58057800 con 0x7eff680ffaa0 2024-04-13T11:11:08.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.738+0000 7eff6fa96700 1 -- 172.21.15.134:0/1503066424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7eff68068370 con 0x7eff680ffaa0 2024-04-13T11:11:08.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.738+0000 7eff5effd700 1 -- 172.21.15.134:0/1503066424 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7eff5805ae20 con 0x7eff680ffaa0 2024-04-13T11:11:08.739 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.740+0000 7eff6fa96700 1 -- 172.21.15.134:0/1503066424 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7eff5406cce0 msgr2=0x7eff5406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.740+0000 7eff6fa96700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7eff5406cce0 0x7eff5406f190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff64005950 tx=0x7eff640058e0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.740+0000 7eff6fa96700 1 -- 172.21.15.134:0/1503066424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff680ffaa0 msgr2=0x7eff68196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.740+0000 7eff6fa96700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff680ffaa0 0x7eff68196a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff58006010 tx=0x7eff5800be20 comp rx=0 tx=0).stop 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.741+0000 7eff6fa96700 1 -- 172.21.15.134:0/1503066424 shutdown_connections 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.741+0000 7eff6fa96700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7eff5406cce0 0x7eff5406f190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.741+0000 7eff6fa96700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff680ffaa0 0x7eff68196a10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.741+0000 7eff6fa96700 1 --2- 172.21.15.134:0/1503066424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68105070 0x7eff68196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.741+0000 7eff6fa96700 1 -- 172.21.15.134:0/1503066424 >> 172.21.15.134:0/1503066424 conn(0x7eff68074fa0 msgr2=0x7eff680fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.741+0000 7eff6fa96700 1 -- 172.21.15.134:0/1503066424 shutdown_connections 2024-04-13T11:11:08.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.741+0000 7eff6fa96700 1 -- 172.21.15.134:0/1503066424 wait complete. 2024-04-13T11:11:08.754 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-13T11:11:08.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.877+0000 7f3d1e512700 1 -- 172.21.15.134:0/3687022183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d180ffaa0 msgr2=0x7f3d1810a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.877+0000 7f3d1e512700 1 --2- 172.21.15.134:0/3687022183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d180ffaa0 0x7f3d1810a510 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009910 tx=0x7f3d0c009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:08.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.877+0000 7f3d1e512700 1 -- 172.21.15.134:0/3687022183 shutdown_connections 2024-04-13T11:11:08.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.877+0000 7f3d1e512700 1 --2- 172.21.15.134:0/3687022183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d180ffaa0 0x7f3d1810a510 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.877+0000 7f3d1e512700 1 --2- 172.21.15.134:0/3687022183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180ff190 0x7f3d180ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.877+0000 7f3d1e512700 1 -- 172.21.15.134:0/3687022183 >> 172.21.15.134:0/3687022183 conn(0x7f3d180747a0 msgr2=0x7f3d18074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:08.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.877+0000 7f3d1e512700 1 -- 172.21.15.134:0/3687022183 shutdown_connections 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.877+0000 7f3d1e512700 1 -- 172.21.15.134:0/3687022183 wait complete. 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.878+0000 7f3d1e512700 1 Processor -- start 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.878+0000 7f3d1e512700 1 -- start start 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.878+0000 7f3d1e512700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180ff190 0x7f3d1819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.878+0000 7f3d1e512700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d180ffaa0 0x7f3d1819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.878+0000 7f3d1e512700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1819c4e0 con 0x7f3d180ffaa0 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.878+0000 7f3d1e512700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18195980 con 0x7f3d180ff190 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.878+0000 7f3d177fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d180ffaa0 0x7f3d1819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.878+0000 7f3d177fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d180ffaa0 0x7f3d1819be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54252/0 (socket says 172.21.15.134:54252) 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.878+0000 7f3d177fe700 1 -- 172.21.15.134:0/985020467 learned_addr learned my addr 172.21.15.134:0/985020467 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.879+0000 7f3d17fff700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180ff190 0x7f3d1819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.879+0000 7f3d177fe700 1 -- 172.21.15.134:0/985020467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180ff190 msgr2=0x7f3d1819b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:08.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.879+0000 7f3d177fe700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180ff190 0x7f3d1819b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:08.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.879+0000 7f3d177fe700 1 -- 172.21.15.134:0/985020467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0095f0 con 0x7f3d180ffaa0 2024-04-13T11:11:08.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.879+0000 7f3d177fe700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d180ffaa0 0x7f3d1819be50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c005620 tx=0x7f3d0c005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:08.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.879+0000 7f3d157fa700 1 -- 172.21.15.134:0/985020467 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d0c01d070 con 0x7f3d180ffaa0 2024-04-13T11:11:08.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.879+0000 7f3d157fa700 1 -- 172.21.15.134:0/985020467 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d0c00be90 con 0x7f3d180ffaa0 2024-04-13T11:11:08.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.879+0000 7f3d157fa700 1 -- 172.21.15.134:0/985020467 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d0c00fe20 con 0x7f3d180ffaa0 2024-04-13T11:11:08.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.879+0000 7f3d1e512700 1 -- 172.21.15.134:0/985020467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d18195c00 con 0x7f3d180ffaa0 2024-04-13T11:11:08.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.879+0000 7f3d1e512700 1 -- 172.21.15.134:0/985020467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d181961e0 con 0x7f3d180ffaa0 2024-04-13T11:11:08.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.880+0000 7f3d1e512700 1 -- 172.21.15.134:0/985020467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d18107c10 con 0x7f3d180ffaa0 2024-04-13T11:11:08.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.880+0000 7f3d157fa700 1 -- 172.21.15.134:0/985020467 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f3d0c00f660 con 0x7f3d180ffaa0 2024-04-13T11:11:08.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.881+0000 7f3d157fa700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3d0006cce0 0x7f3d0006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:08.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.881+0000 7f3d157fa700 1 -- 172.21.15.134:0/985020467 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f3d0c08d7e0 con 0x7f3d180ffaa0 2024-04-13T11:11:08.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.881+0000 7f3d17fff700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3d0006cce0 0x7f3d0006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:08.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.881+0000 7f3d17fff700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3d0006cce0 0x7f3d0006f190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3d08005950 tx=0x7f3d0800b410 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:08.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:08.885+0000 7f3d157fa700 1 -- 172.21.15.134:0/985020467 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f3d0c05b290 con 0x7f3d180ffaa0 2024-04-13T11:11:09.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.077+0000 7f3d1e512700 1 -- 172.21.15.134:0/985020467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f3d1804ea50 con 0x7f3d180ffaa0 2024-04-13T11:11:09.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.078+0000 7f3d157fa700 1 -- 172.21.15.134:0/985020467 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3d0c05ae20 con 0x7f3d180ffaa0 2024-04-13T11:11:09.079 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-04-13T11:11:09.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 -- 172.21.15.134:0/985020467 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3d0006cce0 msgr2=0x7f3d0006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:09.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3d0006cce0 0x7f3d0006f190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3d08005950 tx=0x7f3d0800b410 comp rx=0 tx=0).stop 2024-04-13T11:11:09.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 -- 172.21.15.134:0/985020467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d180ffaa0 msgr2=0x7f3d1819be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:09.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d180ffaa0 0x7f3d1819be50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c005620 tx=0x7f3d0c005650 comp rx=0 tx=0).stop 2024-04-13T11:11:09.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 -- 172.21.15.134:0/985020467 shutdown_connections 2024-04-13T11:11:09.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f3d0006cce0 0x7f3d0006f190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:09.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d180ff190 0x7f3d1819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:09.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 --2- 172.21.15.134:0/985020467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d180ffaa0 0x7f3d1819be50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:09.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 -- 172.21.15.134:0/985020467 >> 172.21.15.134:0/985020467 conn(0x7f3d180747a0 msgr2=0x7f3d18104d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:09.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 -- 172.21.15.134:0/985020467 shutdown_connections 2024-04-13T11:11:09.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.080+0000 7f3d1e512700 1 -- 172.21.15.134:0/985020467 wait complete. 2024-04-13T11:11:09.094 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-13T11:11:09.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.217+0000 7f8646a54700 1 -- 172.21.15.134:0/2032039172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86401060c0 msgr2=0x7f8640106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:09.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.217+0000 7f8646a54700 1 --2- 172.21.15.134:0/2032039172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86401060c0 0x7f8640106490 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8630009910 tx=0x7f8630009c20 comp rx=0 tx=0).stop 2024-04-13T11:11:09.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.217+0000 7f8646a54700 1 -- 172.21.15.134:0/2032039172 shutdown_connections 2024-04-13T11:11:09.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.217+0000 7f8646a54700 1 --2- 172.21.15.134:0/2032039172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8640067d60 0x7f86400681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:09.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.217+0000 7f8646a54700 1 --2- 172.21.15.134:0/2032039172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86401060c0 0x7f8640106490 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.217+0000 7f8646a54700 1 -- 172.21.15.134:0/2032039172 >> 172.21.15.134:0/2032039172 conn(0x7f8640074d90 msgr2=0x7f8640075190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.217+0000 7f8646a54700 1 -- 172.21.15.134:0/2032039172 shutdown_connections 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.217+0000 7f8646a54700 1 -- 172.21.15.134:0/2032039172 wait complete. 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8646a54700 1 Processor -- start 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8646a54700 1 -- start start 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8646a54700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8640067d60 0x7f864019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8646a54700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86401060c0 0x7f864019bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8646a54700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8640195a00 con 0x7f86401060c0 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8646a54700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8640195b70 con 0x7f8640067d60 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8637fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86401060c0 0x7f864019bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8637fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86401060c0 0x7f864019bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54256/0 (socket says 172.21.15.134:54256) 2024-04-13T11:11:09.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8637fff700 1 -- 172.21.15.134:0/1537459402 learned_addr learned my addr 172.21.15.134:0/1537459402 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-04-13T11:11:09.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f863ffff700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8640067d60 0x7f864019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:09.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8637fff700 1 -- 172.21.15.134:0/1537459402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8640067d60 msgr2=0x7f864019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:09.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8637fff700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8640067d60 0x7f864019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:09.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8637fff700 1 -- 172.21.15.134:0/1537459402 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86300095f0 con 0x7f86401060c0 2024-04-13T11:11:09.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.218+0000 7f8637fff700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86401060c0 0x7f864019bf60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f862800d8d0 tx=0x7f862800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:09.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.219+0000 7f863dffb700 1 -- 172.21.15.134:0/1537459402 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86280098a0 con 0x7f86401060c0 2024-04-13T11:11:09.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.219+0000 7f863dffb700 1 -- 172.21.15.134:0/1537459402 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8628010460 con 0x7f86401060c0 2024-04-13T11:11:09.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.219+0000 7f863dffb700 1 -- 172.21.15.134:0/1537459402 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8628009ea0 con 0x7f86401060c0 2024-04-13T11:11:09.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.219+0000 7f8646a54700 1 -- 172.21.15.134:0/1537459402 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8640195e50 con 0x7f86401060c0 2024-04-13T11:11:09.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.219+0000 7f8646a54700 1 -- 172.21.15.134:0/1537459402 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86401963b0 con 0x7f86401060c0 2024-04-13T11:11:09.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.220+0000 7f8646a54700 1 -- 172.21.15.134:0/1537459402 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86401085d0 con 0x7f86401060c0 2024-04-13T11:11:09.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.220+0000 7f863dffb700 1 -- 172.21.15.134:0/1537459402 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f86280105d0 con 0x7f86401060c0 2024-04-13T11:11:09.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.220+0000 7f863dffb700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862c06cda0 0x7f862c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T11:11:09.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.221+0000 7f863ffff700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862c06cda0 0x7f862c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T11:11:09.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.221+0000 7f863dffb700 1 -- 172.21.15.134:0/1537459402 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f862808c470 con 0x7f86401060c0 2024-04-13T11:11:09.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.221+0000 7f863ffff700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862c06cda0 0x7f862c06f250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8630006010 tx=0x7f863001a040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T11:11:09.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.225+0000 7f863dffb700 1 -- 172.21.15.134:0/1537459402 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182936 (secure 0 0 0) 0x7f8628056490 con 0x7f86401060c0 2024-04-13T11:11:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:09 smithi134 ceph-mon[112184]: pgmap v391: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:09 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/530886860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-13T11:11:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:09 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1503066424' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-13T11:11:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:09 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/985020467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-13T11:11:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.437+0000 7f8646a54700 1 -- 172.21.15.134:0/1537459402 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8640196fd0 con 0x7f86401060c0 2024-04-13T11:11:09.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.438+0000 7f863dffb700 1 -- 172.21.15.134:0/1537459402 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v91) v1 ==== 81+0+2115 (secure 0 0 0) 0x7f8628010880 con 0x7f86401060c0 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6824/3497839686 2024-04-14T11:07:45.818363+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6828/3278328584 2024-04-14T11:07:21.786115+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/3448754383 2024-04-14T10:48:33.849227+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/565739211 2024-04-14T10:49:08.875132+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:0/1967347374 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/3448754383 2024-04-14T10:48:33.849227+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/323045534 2024-04-14T10:50:28.273144+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3055528347 2024-04-14T10:50:28.273144+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/1656434316 2024-04-14T10:49:08.875132+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/1656434316 2024-04-14T10:49:08.875132+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:0/2417054087 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:09.439 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6826/3941085795 2024-04-14T11:08:14.000645+0000 2024-04-13T11:11:09.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/2524753251 2024-04-14T10:50:28.273144+0000 2024-04-13T11:11:09.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6829/1685298182 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:09.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6829/3278328584 2024-04-14T11:07:21.786115+0000 2024-04-13T11:11:09.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2783735336 2024-04-14T10:48:33.849227+0000 2024-04-13T11:11:09.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6827/3726339659 2024-04-14T10:55:55.830791+0000 2024-04-13T11:11:09.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1977594888 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:09.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:0/2477915964 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:09.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2590154845 2024-04-14T10:50:28.273144+0000 2024-04-13T11:11:09.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/471716030 2024-04-14T10:49:08.875132+0000 2024-04-13T11:11:09.440 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/2524753251 2024-04-14T10:50:28.273144+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6825/3497839686 2024-04-14T11:07:45.818363+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/4116995009 2024-04-14T10:49:08.875132+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1090834434 2024-04-14T10:48:33.849227+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6828/1685298182 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/4115016009 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6826/3726339659 2024-04-14T10:55:55.830791+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3281134012 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/2958657378 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/2958657378 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:6827/3941085795 2024-04-14T11:08:14.000645+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3885996389 2024-04-14T10:48:33.849227+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.194:0/365752214 2024-04-14T10:59:37.865154+0000 2024-04-13T11:11:09.441 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1158318696 2024-04-14T10:57:57.426837+0000 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 -- 172.21.15.134:0/1537459402 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862c06cda0 msgr2=0x7f862c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862c06cda0 0x7f862c06f250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8630006010 tx=0x7f863001a040 comp rx=0 tx=0).stop 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 -- 172.21.15.134:0/1537459402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86401060c0 msgr2=0x7f864019bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86401060c0 0x7f864019bf60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f862800d8d0 tx=0x7f862800dbe0 comp rx=0 tx=0).stop 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 -- 172.21.15.134:0/1537459402 shutdown_connections 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.134:6800/4065241196,v1:172.21.15.134:6801/4065241196] conn(0x7f862c06cda0 0x7f862c06f250 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8640067d60 0x7f864019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 --2- 172.21.15.134:0/1537459402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86401060c0 0x7f864019bf60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 -- 172.21.15.134:0/1537459402 >> 172.21.15.134:0/1537459402 conn(0x7f8640074d90 msgr2=0x7f86400fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 -- 172.21.15.134:0/1537459402 shutdown_connections 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-13T11:11:09.440+0000 7f8646a54700 1 -- 172.21.15.134:0/1537459402 wait complete. 2024-04-13T11:11:09.443 INFO:teuthology.orchestra.run.smithi134.stderr:listed 35 entries 2024-04-13T11:11:09.453 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi134.front.sepia.ceph.com... 2024-04-13T11:11:09.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T11:11:09.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-13T11:11:09.490 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T11:11:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:09 smithi194 ceph-mon[83053]: pgmap v391: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:09 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/530886860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-13T11:11:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:09 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1503066424' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-13T11:11:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:09 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/985020467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-13T11:11:10.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:10 smithi194 ceph-mon[83053]: from='client.? 172.21.15.134:0/1537459402' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-13T11:11:10.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:10 smithi134 ceph-mon[112184]: from='client.? 172.21.15.134:0/1537459402' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-13T11:11:11.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:11 smithi194 ceph-mon[83053]: pgmap v392: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:11.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:11 smithi134 ceph-mon[112184]: pgmap v392: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:13 smithi194 ceph-mon[83053]: pgmap v393: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:13 smithi134 ceph-mon[112184]: pgmap v393: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:15 smithi194 ceph-mon[83053]: pgmap v394: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:15.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:15 smithi134 ceph-mon[112184]: pgmap v394: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:17 smithi194 ceph-mon[83053]: pgmap v395: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:17.506 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:17 smithi134 ceph-mon[112184]: pgmap v395: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:19.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:19 smithi194 ceph-mon[83053]: pgmap v396: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:19 smithi134 ceph-mon[112184]: pgmap v396: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:21.501 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:21 smithi194 ceph-mon[83053]: pgmap v397: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:21.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:21 smithi134 ceph-mon[112184]: pgmap v397: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:23.500 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:23 smithi194 ceph-mon[83053]: pgmap v398: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:23.535 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:11:23.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:23 smithi134 ceph-mon[112184]: pgmap v398: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:23.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:11:25.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:25 smithi194 ceph-mon[83053]: pgmap v399: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:25 smithi134 ceph-mon[112184]: pgmap v399: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:27 smithi194 ceph-mon[83053]: pgmap v400: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:27.616 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:27 smithi134 ceph-mon[112184]: pgmap v400: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:29 smithi194 ceph-mon[83053]: pgmap v401: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:29.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:29 smithi134 ceph-mon[112184]: pgmap v401: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:31.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:31 smithi134 ceph-mon[112184]: pgmap v402: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:31 smithi194 ceph-mon[83053]: pgmap v402: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:33.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:33 smithi134 ceph-mon[112184]: pgmap v403: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:33 smithi194 ceph-mon[83053]: pgmap v403: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:35.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:35 smithi134 ceph-mon[112184]: pgmap v404: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:35.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:35 smithi194 ceph-mon[83053]: pgmap v404: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:37.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:37 smithi134 ceph-mon[112184]: pgmap v405: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:37.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:37 smithi194 ceph-mon[83053]: pgmap v405: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:38.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:11:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:11:39.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:39 smithi134 ceph-mon[112184]: pgmap v406: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:39 smithi194 ceph-mon[83053]: pgmap v406: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:41 smithi134 ceph-mon[112184]: pgmap v407: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:41 smithi194 ceph-mon[83053]: pgmap v407: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:43.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:43 smithi194 ceph-mon[83053]: pgmap v408: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:43 smithi134 ceph-mon[112184]: pgmap v408: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:45.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:45 smithi134 ceph-mon[112184]: pgmap v409: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:45 smithi194 ceph-mon[83053]: pgmap v409: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:47 smithi134 ceph-mon[112184]: pgmap v410: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:47 smithi194 ceph-mon[83053]: pgmap v410: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:49.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:49 smithi134 ceph-mon[112184]: pgmap v411: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:49.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:49 smithi194 ceph-mon[83053]: pgmap v411: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:51.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:51 smithi134 ceph-mon[112184]: pgmap v412: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:51.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:51 smithi194 ceph-mon[83053]: pgmap v412: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:53 smithi194 ceph-mon[83053]: pgmap v413: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:53.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:11:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:53 smithi134 ceph-mon[112184]: pgmap v413: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:11:55.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:55 smithi134 ceph-mon[112184]: pgmap v414: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:55 smithi194 ceph-mon[83053]: pgmap v414: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:57 smithi134 ceph-mon[112184]: pgmap v415: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:57.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:57 smithi194 ceph-mon[83053]: pgmap v415: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:11:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:59 smithi134 ceph-mon[112184]: pgmap v416: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:59.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:11:59 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:11:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:59 smithi194 ceph-mon[83053]: pgmap v416: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:11:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:11:59 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:12:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:00 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:12:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:00 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:12:00.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:00 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:12:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:00 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:12:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:00 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:12:00.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:00 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:12:01.998 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:01 smithi194 ceph-mon[83053]: pgmap v417: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:02.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:01 smithi134 ceph-mon[112184]: pgmap v417: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:03.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:02 smithi134 ceph-mon[112184]: pgmap v418: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:03.237 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:02 smithi194 ceph-mon[83053]: pgmap v418: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:05.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:05 smithi134 ceph-mon[112184]: pgmap v419: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:05 smithi194 ceph-mon[83053]: pgmap v419: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:07.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:07 smithi134 ceph-mon[112184]: pgmap v420: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:07.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:07 smithi194 ceph-mon[83053]: pgmap v420: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:08.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:12:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:12:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:09 smithi134 ceph-mon[112184]: pgmap v421: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:09 smithi194 ceph-mon[83053]: pgmap v421: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:11.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:11 smithi134 ceph-mon[112184]: pgmap v422: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:11.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:11 smithi194 ceph-mon[83053]: pgmap v422: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:13 smithi134 ceph-mon[112184]: pgmap v423: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:13 smithi194 ceph-mon[83053]: pgmap v423: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:15.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:15 smithi134 ceph-mon[112184]: pgmap v424: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:15 smithi194 ceph-mon[83053]: pgmap v424: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:17.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:17 smithi134 ceph-mon[112184]: pgmap v425: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:17 smithi194 ceph-mon[83053]: pgmap v425: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:19.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:19 smithi134 ceph-mon[112184]: pgmap v426: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:19.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:19 smithi194 ceph-mon[83053]: pgmap v426: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:21.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:21 smithi134 ceph-mon[112184]: pgmap v427: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:21.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:21 smithi194 ceph-mon[83053]: pgmap v427: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:23.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:23 smithi194 ceph-mon[83053]: pgmap v428: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:23.421 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:12:23.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:23 smithi134 ceph-mon[112184]: pgmap v428: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:23.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:12:25.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:25 smithi134 ceph-mon[112184]: pgmap v429: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:25.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:25 smithi194 ceph-mon[83053]: pgmap v429: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:27.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:27 smithi134 ceph-mon[112184]: pgmap v430: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:27 smithi194 ceph-mon[83053]: pgmap v430: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:29.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:29 smithi134 ceph-mon[112184]: pgmap v431: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:29 smithi194 ceph-mon[83053]: pgmap v431: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:31.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:31 smithi134 ceph-mon[112184]: pgmap v432: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:31.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:31 smithi194 ceph-mon[83053]: pgmap v432: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:33.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:33 smithi134 ceph-mon[112184]: pgmap v433: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:33.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:33 smithi194 ceph-mon[83053]: pgmap v433: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:35.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:35 smithi134 ceph-mon[112184]: pgmap v434: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:35 smithi194 ceph-mon[83053]: pgmap v434: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:37.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:37 smithi134 ceph-mon[112184]: pgmap v435: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:37 smithi194 ceph-mon[83053]: pgmap v435: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:38.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:12:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:12:39.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:39 smithi134 ceph-mon[112184]: pgmap v436: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:39.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:39 smithi194 ceph-mon[83053]: pgmap v436: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:41.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:41 smithi134 ceph-mon[112184]: pgmap v437: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:41 smithi194 ceph-mon[83053]: pgmap v437: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:43.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:43 smithi134 ceph-mon[112184]: pgmap v438: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:43.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:43 smithi194 ceph-mon[83053]: pgmap v438: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:45.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:45 smithi134 ceph-mon[112184]: pgmap v439: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:45 smithi194 ceph-mon[83053]: pgmap v439: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:47.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:47 smithi194 ceph-mon[83053]: pgmap v440: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:47 smithi134 ceph-mon[112184]: pgmap v440: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:49 smithi194 ceph-mon[83053]: pgmap v441: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:49.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:49 smithi134 ceph-mon[112184]: pgmap v441: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:51.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:51 smithi194 ceph-mon[83053]: pgmap v442: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:51.686 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:51 smithi134 ceph-mon[112184]: pgmap v442: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:12:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:53 smithi194 ceph-mon[83053]: pgmap v443: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:53.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:12:53.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:53 smithi134 ceph-mon[112184]: pgmap v443: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:53.679 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:12:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:55 smithi194 ceph-mon[83053]: pgmap v444: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:12:55.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:55 smithi134 ceph-mon[112184]: pgmap v444: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:12:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:57 smithi194 ceph-mon[83053]: pgmap v445: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:12:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:57 smithi134 ceph-mon[112184]: pgmap v445: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:12:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:12:59 smithi194 ceph-mon[83053]: pgmap v446: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:12:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:12:59 smithi134 ceph-mon[112184]: pgmap v446: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:00.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:00 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:13:00.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:00 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:13:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:01 smithi194 ceph-mon[83053]: pgmap v447: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:13:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:01 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:13:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:01 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:13:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:01 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:13:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:01 smithi134 ceph-mon[112184]: pgmap v447: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-13T11:13:01.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:01 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:13:01.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:01 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:13:01.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:01 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:13:03.185 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:02 smithi134 ceph-mon[112184]: pgmap v448: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:03.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:02 smithi194 ceph-mon[83053]: pgmap v448: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:05.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:05 smithi134 ceph-mon[112184]: pgmap v449: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:05 smithi194 ceph-mon[83053]: pgmap v449: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:07.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:07 smithi134 ceph-mon[112184]: pgmap v450: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:07.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:07 smithi194 ceph-mon[83053]: pgmap v450: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:08.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:13:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:13:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:09 smithi134 ceph-mon[112184]: pgmap v451: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:09 smithi194 ceph-mon[83053]: pgmap v451: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:11.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:11 smithi134 ceph-mon[112184]: pgmap v452: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:11.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:11 smithi194 ceph-mon[83053]: pgmap v452: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:13.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:13 smithi134 ceph-mon[112184]: pgmap v453: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:13 smithi194 ceph-mon[83053]: pgmap v453: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:15.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:15 smithi134 ceph-mon[112184]: pgmap v454: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:15 smithi194 ceph-mon[83053]: pgmap v454: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:17.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:17 smithi134 ceph-mon[112184]: pgmap v455: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:17.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:17 smithi194 ceph-mon[83053]: pgmap v455: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:19.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:19 smithi194 ceph-mon[83053]: pgmap v456: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:19.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:19 smithi134 ceph-mon[112184]: pgmap v456: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:21.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:21 smithi134 ceph-mon[112184]: pgmap v457: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:21.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:21 smithi194 ceph-mon[83053]: pgmap v457: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:23.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:23 smithi134 ceph-mon[112184]: pgmap v458: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:23.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:13:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:23 smithi194 ceph-mon[83053]: pgmap v458: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:23.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:13:25.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:25 smithi134 ceph-mon[112184]: pgmap v459: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:25.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:25 smithi194 ceph-mon[83053]: pgmap v459: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:27.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:27 smithi134 ceph-mon[112184]: pgmap v460: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:27.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:27 smithi194 ceph-mon[83053]: pgmap v460: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:29.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:29 smithi134 ceph-mon[112184]: pgmap v461: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:29.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:29 smithi194 ceph-mon[83053]: pgmap v461: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:31.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:31 smithi134 ceph-mon[112184]: pgmap v462: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:31.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:31 smithi194 ceph-mon[83053]: pgmap v462: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:33.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:33 smithi134 ceph-mon[112184]: pgmap v463: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:33.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:33 smithi194 ceph-mon[83053]: pgmap v463: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:35.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:35 smithi134 ceph-mon[112184]: pgmap v464: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:35 smithi194 ceph-mon[83053]: pgmap v464: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:37.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:37 smithi134 ceph-mon[112184]: pgmap v465: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:37.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:37 smithi194 ceph-mon[83053]: pgmap v465: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:38.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:13:38.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:13:39.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:39 smithi134 ceph-mon[112184]: pgmap v466: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:39.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:39 smithi194 ceph-mon[83053]: pgmap v466: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:41.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:41 smithi194 ceph-mon[83053]: pgmap v467: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:41 smithi134 ceph-mon[112184]: pgmap v467: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:43.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:43 smithi194 ceph-mon[83053]: pgmap v468: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:43 smithi134 ceph-mon[112184]: pgmap v468: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:45.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:45 smithi194 ceph-mon[83053]: pgmap v469: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:45.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:45 smithi134 ceph-mon[112184]: pgmap v469: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:47.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:47 smithi194 ceph-mon[83053]: pgmap v470: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:47.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:47 smithi134 ceph-mon[112184]: pgmap v470: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:49.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:49 smithi134 ceph-mon[112184]: pgmap v471: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:49.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:49 smithi194 ceph-mon[83053]: pgmap v471: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:51.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:51 smithi194 ceph-mon[83053]: pgmap v472: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:51.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:51 smithi134 ceph-mon[112184]: pgmap v472: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:53 smithi194 ceph-mon[83053]: pgmap v473: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:53.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:13:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:53 smithi134 ceph-mon[112184]: pgmap v473: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:13:55.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:55 smithi194 ceph-mon[83053]: pgmap v474: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:55.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:55 smithi134 ceph-mon[112184]: pgmap v474: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:57.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:57 smithi194 ceph-mon[83053]: pgmap v475: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:57 smithi134 ceph-mon[112184]: pgmap v475: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:13:59.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:13:59 smithi194 ceph-mon[83053]: pgmap v476: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:13:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:13:59 smithi134 ceph-mon[112184]: pgmap v476: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:01 smithi194 ceph-mon[83053]: pgmap v477: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:01 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:14:01.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:01 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:14:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:01 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:14:01.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:01 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:14:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:01 smithi134 ceph-mon[112184]: pgmap v477: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:01.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:01 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:14:01.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:01 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:14:01.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:01 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:14:01.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:01 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:14:03.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:03 smithi194 ceph-mon[83053]: pgmap v478: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:03.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:03 smithi134 ceph-mon[112184]: pgmap v478: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:05.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:05 smithi194 ceph-mon[83053]: pgmap v479: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:05.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:05 smithi134 ceph-mon[112184]: pgmap v479: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:07.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:07 smithi194 ceph-mon[83053]: pgmap v480: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:07 smithi134 ceph-mon[112184]: pgmap v480: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:08.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:14:08.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:14:09.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:09 smithi194 ceph-mon[83053]: pgmap v481: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:09.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:09 smithi134 ceph-mon[112184]: pgmap v481: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:11.499 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:11 smithi194 ceph-mon[83053]: pgmap v482: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:11.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:11 smithi134 ceph-mon[112184]: pgmap v482: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:13.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:13 smithi194 ceph-mon[83053]: pgmap v483: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:13.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:13 smithi134 ceph-mon[112184]: pgmap v483: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:15.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:15 smithi194 ceph-mon[83053]: pgmap v484: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:15.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:15 smithi134 ceph-mon[112184]: pgmap v484: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:17.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:17 smithi134 ceph-mon[112184]: pgmap v485: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:17.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:17 smithi194 ceph-mon[83053]: pgmap v485: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:19 smithi134 ceph-mon[112184]: pgmap v486: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:19 smithi194 ceph-mon[83053]: pgmap v486: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:21.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:21 smithi134 ceph-mon[112184]: pgmap v487: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:21 smithi194 ceph-mon[83053]: pgmap v487: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:23.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:23 smithi134 ceph-mon[112184]: pgmap v488: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:23.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:14:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:23 smithi194 ceph-mon[83053]: pgmap v488: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:14:25.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:25 smithi134 ceph-mon[112184]: pgmap v489: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:25 smithi194 ceph-mon[83053]: pgmap v489: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:27 smithi134 ceph-mon[112184]: pgmap v490: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:27 smithi194 ceph-mon[83053]: pgmap v490: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:29.580 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:29 smithi194 ceph-mon[83053]: pgmap v491: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:29.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:29 smithi134 ceph-mon[112184]: pgmap v491: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:31.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:31 smithi134 ceph-mon[112184]: pgmap v492: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:31 smithi194 ceph-mon[83053]: pgmap v492: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:33.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:33 smithi134 ceph-mon[112184]: pgmap v493: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:33.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:33 smithi194 ceph-mon[83053]: pgmap v493: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:35.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:35 smithi134 ceph-mon[112184]: pgmap v494: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:35.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:35 smithi194 ceph-mon[83053]: pgmap v494: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:37.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:37 smithi134 ceph-mon[112184]: pgmap v495: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:37.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:37 smithi194 ceph-mon[83053]: pgmap v495: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:38.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:14:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:14:39.672 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:39 smithi194 ceph-mon[83053]: pgmap v496: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:39.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:39 smithi134 ceph-mon[112184]: pgmap v496: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:41 smithi134 ceph-mon[112184]: pgmap v497: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:41 smithi194 ceph-mon[83053]: pgmap v497: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:43.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:43 smithi134 ceph-mon[112184]: pgmap v498: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:43 smithi194 ceph-mon[83053]: pgmap v498: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:45.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:45 smithi134 ceph-mon[112184]: pgmap v499: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:45 smithi194 ceph-mon[83053]: pgmap v499: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:47 smithi134 ceph-mon[112184]: pgmap v500: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:47.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:47 smithi194 ceph-mon[83053]: pgmap v500: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:49.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:49 smithi134 ceph-mon[112184]: pgmap v501: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:49.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:49 smithi194 ceph-mon[83053]: pgmap v501: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:51.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:51 smithi134 ceph-mon[112184]: pgmap v502: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:51.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:51 smithi194 ceph-mon[83053]: pgmap v502: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:53 smithi134 ceph-mon[112184]: pgmap v503: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:14:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:53 smithi194 ceph-mon[83053]: pgmap v503: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:53.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:14:55.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:55 smithi134 ceph-mon[112184]: pgmap v504: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:55 smithi194 ceph-mon[83053]: pgmap v504: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:57 smithi134 ceph-mon[112184]: pgmap v505: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:57.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:57 smithi194 ceph-mon[83053]: pgmap v505: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:14:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:14:59 smithi134 ceph-mon[112184]: pgmap v506: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:14:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:14:59 smithi194 ceph-mon[83053]: pgmap v506: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:01 smithi134 ceph-mon[112184]: pgmap v507: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:01.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:01 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:15:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:01 smithi194 ceph-mon[83053]: pgmap v507: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:01 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:15:02.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:15:02.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:15:02.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:15:02.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:15:02.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:15:02.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:15:03.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:03 smithi134 ceph-mon[112184]: pgmap v508: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:03.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:03 smithi194 ceph-mon[83053]: pgmap v508: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:05.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:05 smithi134 ceph-mon[112184]: pgmap v509: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:05 smithi194 ceph-mon[83053]: pgmap v509: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:07 smithi134 ceph-mon[112184]: pgmap v510: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:07.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:07 smithi194 ceph-mon[83053]: pgmap v510: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:08.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:15:08.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:15:09.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:09 smithi134 ceph-mon[112184]: pgmap v511: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:09.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:09 smithi194 ceph-mon[83053]: pgmap v511: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:11.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:11 smithi134 ceph-mon[112184]: pgmap v512: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:11.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:11 smithi194 ceph-mon[83053]: pgmap v512: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:13.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:13 smithi134 ceph-mon[112184]: pgmap v513: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:13.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:13 smithi194 ceph-mon[83053]: pgmap v513: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:15.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:15 smithi134 ceph-mon[112184]: pgmap v514: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:15.751 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:15 smithi194 ceph-mon[83053]: pgmap v514: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:17.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:17 smithi134 ceph-mon[112184]: pgmap v515: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:17.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:17 smithi194 ceph-mon[83053]: pgmap v515: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:19.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:19 smithi134 ceph-mon[112184]: pgmap v516: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:19.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:19 smithi194 ceph-mon[83053]: pgmap v516: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:21.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:21 smithi134 ceph-mon[112184]: pgmap v517: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:21.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:21 smithi194 ceph-mon[83053]: pgmap v517: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:23.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:23 smithi134 ceph-mon[112184]: pgmap v518: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:23.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:23 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:15:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:23 smithi194 ceph-mon[83053]: pgmap v518: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:23.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:23 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:15:25.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:25 smithi134 ceph-mon[112184]: pgmap v519: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:25.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:25 smithi194 ceph-mon[83053]: pgmap v519: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:27.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:27 smithi134 ceph-mon[112184]: pgmap v520: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:27.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:27 smithi194 ceph-mon[83053]: pgmap v520: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:29.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:29 smithi134 ceph-mon[112184]: pgmap v521: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:29.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:29 smithi194 ceph-mon[83053]: pgmap v521: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:31.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:31 smithi134 ceph-mon[112184]: pgmap v522: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:31.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:31 smithi194 ceph-mon[83053]: pgmap v522: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:33.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:33 smithi134 ceph-mon[112184]: pgmap v523: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:33.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:33 smithi194 ceph-mon[83053]: pgmap v523: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:35.498 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:35 smithi194 ceph-mon[83053]: pgmap v524: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:35.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:35 smithi134 ceph-mon[112184]: pgmap v524: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:37.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:37 smithi134 ceph-mon[112184]: pgmap v525: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:37.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:37 smithi194 ceph-mon[83053]: pgmap v525: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:38.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:38 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:15:38.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:38 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:15:39.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:39 smithi134 ceph-mon[112184]: pgmap v526: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:39.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:39 smithi194 ceph-mon[83053]: pgmap v526: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:41.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:41 smithi134 ceph-mon[112184]: pgmap v527: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:41.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:41 smithi194 ceph-mon[83053]: pgmap v527: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:43.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:43 smithi134 ceph-mon[112184]: pgmap v528: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:43.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:43 smithi194 ceph-mon[83053]: pgmap v528: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:45.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:45 smithi134 ceph-mon[112184]: pgmap v529: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:45.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:45 smithi194 ceph-mon[83053]: pgmap v529: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:47.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:47 smithi134 ceph-mon[112184]: pgmap v530: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:47.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:47 smithi194 ceph-mon[83053]: pgmap v530: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:49.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:49 smithi134 ceph-mon[112184]: pgmap v531: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:49.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:49 smithi194 ceph-mon[83053]: pgmap v531: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:51.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:51 smithi134 ceph-mon[112184]: pgmap v532: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:51.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:51 smithi194 ceph-mon[83053]: pgmap v532: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:53.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:53 smithi134 ceph-mon[112184]: pgmap v533: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:53.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:53 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:15:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:53 smithi194 ceph-mon[83053]: pgmap v533: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:53.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:53 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:15:55.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:55 smithi134 ceph-mon[112184]: pgmap v534: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:55.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:55 smithi194 ceph-mon[83053]: pgmap v534: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:57.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:57 smithi134 ceph-mon[112184]: pgmap v535: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:57.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:57 smithi194 ceph-mon[83053]: pgmap v535: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:15:59.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:15:59 smithi134 ceph-mon[112184]: pgmap v536: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:15:59.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:15:59 smithi194 ceph-mon[83053]: pgmap v536: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:16:01.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:01 smithi134 ceph-mon[112184]: pgmap v537: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:16:01.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:01 smithi194 ceph-mon[83053]: pgmap v537: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:16:02.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:16:02.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:16:02.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:16:02.685 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:02 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:16:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-13T11:16:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-13T11:16:02.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-13T11:16:02.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:02 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' 2024-04-13T11:16:03.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:03 smithi134 ceph-mon[112184]: pgmap v538: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:16:03.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:03 smithi194 ceph-mon[83053]: pgmap v538: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-13T11:16:05.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:05 smithi134 ceph-mon[112184]: pgmap v539: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:16:05.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:05 smithi194 ceph-mon[83053]: pgmap v539: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:16:07.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:07 smithi134 ceph-mon[112184]: pgmap v540: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:16:07.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:07 smithi194 ceph-mon[83053]: pgmap v540: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-13T11:16:08.562 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-04-13T11:16:08.562 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-13T11:16:08.564 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-13T11:16:08.577 INFO:tasks.cephadm:Teardown begin 2024-04-13T11:16:08.577 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/cephadm.py", line 1750, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-13T11:16:08.579 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-13T11:16:08.615 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-13T11:16:08.653 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-13T11:16:08.653 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-13T11:16:08.675 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-13T11:16:08.684 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:08 smithi134 ceph-mon[112184]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:16:08.713 INFO:tasks.cephadm:Stopping all daemons... 2024-04-13T11:16:08.714 INFO:tasks.cephadm.mon.smithi134:Stopping mon.smithi134... 2024-04-13T11:16:08.714 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi134 2024-04-13T11:16:08.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:08 smithi194 ceph-mon[83053]: from='mgr.14668 172.21.15.134:0/2105979503' entity='mgr.smithi134.tmanda' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-13T11:16:09.077 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:08 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:16:09.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:09 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134[112161]: 2024-04-13T11:16:09.075+0000 7fb944647700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:16:09.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:09 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134[112161]: 2024-04-13T11:16:09.075+0000 7fb944647700 -1 mon.smithi134@0(leader) e2 *** Got Signal Terminated *** 2024-04-13T11:16:09.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Apr 13 11:16:09 smithi134 bash[168423]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi134 2024-04-13T11:16:10.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi134.service' 2024-04-13T11:16:10.106 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-13T11:16:10.106 INFO:tasks.cephadm.mon.smithi134:Stopped mon.smithi134 2024-04-13T11:16:10.106 INFO:tasks.cephadm.mon.smithi194:Stopping mon.smithi194... 2024-04-13T11:16:10.106 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi194 2024-04-13T11:16:10.442 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:10 smithi194 systemd[1]: Stopping Ceph mon.smithi194 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:16:10.748 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:10 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi194[83030]: 2024-04-13T11:16:10.440+0000 7f114cf2f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi194 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:16:10.749 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:10 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi194[83030]: 2024-04-13T11:16:10.440+0000 7f114cf2f700 -1 mon.smithi194@1(peon) e2 *** Got Signal Terminated *** 2024-04-13T11:16:11.248 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Apr 13 11:16:11 smithi194 bash[129512]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-mon-smithi194 2024-04-13T11:16:11.516 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@mon.smithi194.service' 2024-04-13T11:16:11.563 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-13T11:16:11.563 INFO:tasks.cephadm.mon.smithi194:Stopped mon.smithi194 2024-04-13T11:16:11.563 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-13T11:16:11.564 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.0 2024-04-13T11:16:11.856 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:16:11 smithi134 systemd[1]: Stopping Ceph osd.0 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:16:12.184 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:16:11 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[124094]: 2024-04-13T11:16:11.855+0000 7f4783cbc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:16:12.185 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:16:11 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[124094]: 2024-04-13T11:16:11.855+0000 7f4783cbc700 -1 osd.0 91 *** Got signal Terminated *** 2024-04-13T11:16:12.185 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:16:11 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0[124094]: 2024-04-13T11:16:11.855+0000 7f4783cbc700 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:16:17.935 INFO:journalctl@ceph.osd.0.smithi134.stdout:Apr 13 11:16:17 smithi134 bash[168586]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-0 2024-04-13T11:16:19.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.0.service' 2024-04-13T11:16:19.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-13T11:16:19.440 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-13T11:16:19.441 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-13T11:16:19.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.1 2024-04-13T11:16:19.684 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:16:19 smithi134 systemd[1]: Stopping Ceph osd.1 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:16:20.184 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:16:19 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1[131107]: 2024-04-13T11:16:19.748+0000 7feb8fce2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:16:20.185 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:16:19 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1[131107]: 2024-04-13T11:16:19.748+0000 7feb8fce2700 -1 osd.1 91 *** Got signal Terminated *** 2024-04-13T11:16:20.185 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:16:19 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1[131107]: 2024-04-13T11:16:19.748+0000 7feb8fce2700 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:16:25.685 INFO:journalctl@ceph.osd.1.smithi134.stdout:Apr 13 11:16:25 smithi134 bash[168856]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-1 2024-04-13T11:16:27.248 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.1.service' 2024-04-13T11:16:27.290 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-13T11:16:27.290 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-13T11:16:27.290 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-13T11:16:27.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.2 2024-04-13T11:16:27.596 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:16:27 smithi134 systemd[1]: Stopping Ceph osd.2 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:16:27.935 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:16:27 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2[137844]: 2024-04-13T11:16:27.595+0000 7fd6901b4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:16:27.935 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:16:27 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2[137844]: 2024-04-13T11:16:27.595+0000 7fd6901b4700 -1 osd.2 91 *** Got signal Terminated *** 2024-04-13T11:16:27.935 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:16:27 smithi134 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2[137844]: 2024-04-13T11:16:27.595+0000 7fd6901b4700 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:16:33.686 INFO:journalctl@ceph.osd.2.smithi134.stdout:Apr 13 11:16:33 smithi134 bash[169124]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-2 2024-04-13T11:16:34.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.2.service' 2024-04-13T11:16:35.031 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-13T11:16:35.031 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-13T11:16:35.032 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-13T11:16:35.032 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.3 2024-04-13T11:16:35.498 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:16:35 smithi194 systemd[1]: Stopping Ceph osd.3 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:16:35.499 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:16:35 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[94265]: 2024-04-13T11:16:35.284+0000 7f1a61447700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:16:35.499 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:16:35 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[94265]: 2024-04-13T11:16:35.284+0000 7f1a61447700 -1 osd.3 91 *** Got signal Terminated *** 2024-04-13T11:16:35.499 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:16:35 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[94265]: 2024-04-13T11:16:35.284+0000 7f1a61447700 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:16:39.498 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:16:39 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[94265]: 2024-04-13T11:16:39.024+0000 7f1a5a236700 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.216319+0000 front 2024-04-13T11:16:15.216204+0000 (oldest deadline 2024-04-13T11:16:38.716028+0000) 2024-04-13T11:16:40.478 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:16:40 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3[94265]: 2024-04-13T11:16:40.007+0000 7f1a5a236700 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.216319+0000 front 2024-04-13T11:16:15.216204+0000 (oldest deadline 2024-04-13T11:16:38.716028+0000) 2024-04-13T11:16:40.749 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:40 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:40.478+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:41.454 INFO:journalctl@ceph.osd.3.smithi194.stdout:Apr 13 11:16:41 smithi194 bash[129661]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-3 2024-04-13T11:16:41.748 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:41 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:41.453+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:42.576 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:42 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:42.428+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:42.903 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.3.service' 2024-04-13T11:16:42.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-13T11:16:42.946 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-13T11:16:42.946 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-13T11:16:42.946 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.4 2024-04-13T11:16:43.248 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:43 smithi194 systemd[1]: Stopping Ceph osd.4 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:16:43.249 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:43 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:16:43.146+0000 7f995e60e700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:16.331653+0000 front 2024-04-13T11:16:16.331663+0000 (oldest deadline 2024-04-13T11:16:42.231541+0000) 2024-04-13T11:16:43.748 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:43 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:43.440+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:43.749 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:43 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:16:43.257+0000 7f996581f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:16:43.749 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:43 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:16:43.257+0000 7f996581f700 -1 osd.4 91 *** Got signal Terminated *** 2024-04-13T11:16:43.749 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:43 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:16:43.257+0000 7f996581f700 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:16:44.431 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:44 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:16:44.154+0000 7f995e60e700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:16.331653+0000 front 2024-04-13T11:16:16.331663+0000 (oldest deadline 2024-04-13T11:16:42.231541+0000) 2024-04-13T11:16:44.748 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:44 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:44.430+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:45.498 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:45 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:16:45.186+0000 7f995e60e700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:16.331653+0000 front 2024-04-13T11:16:16.331663+0000 (oldest deadline 2024-04-13T11:16:42.231541+0000) 2024-04-13T11:16:45.499 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:45 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:45.398+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:46.498 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:46 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:16:46.186+0000 7f995e60e700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:16.331653+0000 front 2024-04-13T11:16:16.331663+0000 (oldest deadline 2024-04-13T11:16:42.231541+0000) 2024-04-13T11:16:46.499 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:46 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:46.381+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:47.498 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:47 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:16:47.210+0000 7f995e60e700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:16.331653+0000 front 2024-04-13T11:16:16.331663+0000 (oldest deadline 2024-04-13T11:16:42.231541+0000) 2024-04-13T11:16:47.499 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:47 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:47.403+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:48.420 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:48 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:16:48.162+0000 7f995e60e700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:16.331653+0000 front 2024-04-13T11:16:16.331663+0000 (oldest deadline 2024-04-13T11:16:42.231541+0000) 2024-04-13T11:16:48.420 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:48 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4[100594]: 2024-04-13T11:16:48.162+0000 7f995e60e700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-04-13T11:16:23.932393+0000 front 2024-04-13T11:16:23.932403+0000 (oldest deadline 2024-04-13T11:16:47.432335+0000) 2024-04-13T11:16:48.749 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:48 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:48.418+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:48.749 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:48 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:48.418+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-04-13T11:16:22.191365+0000 front 2024-04-13T11:16:22.191408+0000 (oldest deadline 2024-04-13T11:16:47.491300+0000) 2024-04-13T11:16:49.249 INFO:journalctl@ceph.osd.4.smithi194.stdout:Apr 13 11:16:49 smithi194 bash[129929]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-4 2024-04-13T11:16:49.698 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:49 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:49.433+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:49.698 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:49 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:49.433+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-04-13T11:16:22.191365+0000 front 2024-04-13T11:16:22.191408+0000 (oldest deadline 2024-04-13T11:16:47.491300+0000) 2024-04-13T11:16:50.689 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:50 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:50.460+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:50.689 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:50 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:50.460+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-04-13T11:16:22.191365+0000 front 2024-04-13T11:16:22.191408+0000 (oldest deadline 2024-04-13T11:16:47.491300+0000) 2024-04-13T11:16:50.696 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.4.service' 2024-04-13T11:16:50.737 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-13T11:16:50.737 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-13T11:16:50.738 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-13T11:16:50.738 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.5 2024-04-13T11:16:50.998 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:50 smithi194 systemd[1]: Stopping Ceph osd.5 for 38dd2ea8-f983-11ee-bc8d-c7b262605968... 2024-04-13T11:16:51.499 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:51 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:51.036+0000 7fd3f8ee4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-13T11:16:51.499 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:51 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:51.036+0000 7fd3f8ee4700 -1 osd.5 91 *** Got signal Terminated *** 2024-04-13T11:16:51.499 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:51 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:51.036+0000 7fd3f8ee4700 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-13T11:16:51.998 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:51 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:51.509+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:51.998 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:51 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:51.509+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-04-13T11:16:22.191365+0000 front 2024-04-13T11:16:22.191408+0000 (oldest deadline 2024-04-13T11:16:47.491300+0000) 2024-04-13T11:16:52.998 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:52 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:52.528+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:52.998 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:52 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:52.528+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-04-13T11:16:22.191365+0000 front 2024-04-13T11:16:22.191408+0000 (oldest deadline 2024-04-13T11:16:47.491300+0000) 2024-04-13T11:16:53.748 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:53 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:53.491+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:53.748 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:53 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:53.491+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-04-13T11:16:22.191365+0000 front 2024-04-13T11:16:22.191408+0000 (oldest deadline 2024-04-13T11:16:47.491300+0000) 2024-04-13T11:16:54.748 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:54 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:54.477+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:54.749 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:54 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:54.477+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-04-13T11:16:22.191365+0000 front 2024-04-13T11:16:22.191408+0000 (oldest deadline 2024-04-13T11:16:47.491300+0000) 2024-04-13T11:16:55.748 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:55 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:55.452+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-04-13T11:16:15.290074+0000 front 2024-04-13T11:16:15.290088+0000 (oldest deadline 2024-04-13T11:16:39.989985+0000) 2024-04-13T11:16:55.748 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:55 smithi194 ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5[107535]: 2024-04-13T11:16:55.452+0000 7fd3f5cdb700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-04-13T11:16:22.191365+0000 front 2024-04-13T11:16:22.191408+0000 (oldest deadline 2024-04-13T11:16:47.491300+0000) 2024-04-13T11:16:57.248 INFO:journalctl@ceph.osd.5.smithi194.stdout:Apr 13 11:16:56 smithi194 bash[130197]: ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968-osd-5 2024-04-13T11:16:58.547 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-38dd2ea8-f983-11ee-bc8d-c7b262605968@osd.5.service' 2024-04-13T11:16:58.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-13T11:16:58.589 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-13T11:16:58.590 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 --force --keep-logs 2024-04-13T11:16:58.771 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T11:17:02.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi134.stderr:ceph-fuse[86231]: fuse finished with error 0 and tester_r 0 2024-04-13T11:17:16.303 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 --force --keep-logs 2024-04-13T11:17:16.485 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T11:17:29.628 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-13T11:17:29.666 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-13T11:17:29.697 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-13T11:17:29.699 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624/remote/smithi134/crash 2024-04-13T11:17:29.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/crash -- . 2024-04-13T11:17:29.736 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/crash: Cannot open: No such file or directory 2024-04-13T11:17:29.736 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-04-13T11:17:29.738 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624/remote/smithi194/crash 2024-04-13T11:17:29.739 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/crash -- . 2024-04-13T11:17:29.766 INFO:teuthology.orchestra.run.smithi194.stderr:tar: /var/lib/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/crash: Cannot open: No such file or directory 2024-04-13T11:17:29.766 INFO:teuthology.orchestra.run.smithi194.stderr:tar: Error is not recoverable: exiting now 2024-04-13T11:17:29.767 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-13T11:17:29.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-04-13T11:17:29.809 INFO:teuthology.orchestra.run.smithi134.stderr:grep: /var/log/ceph/38dd2ea8-f983-11ee-bc8d-c7b262605968/ceph.log: No such file or directory 2024-04-13T11:17:29.811 INFO:tasks.cephadm:Compressing logs... 2024-04-13T11:17:29.812 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-13T11:17:29.855 DEBUG:teuthology.orchestra.run.smithi194:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-13T11:17:29.880 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-13T11:17:29.881 INFO:teuthology.orchestra.run.smithi194.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-13T11:17:46.663 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-04-13T11:17:47.059 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/ceph-client.0.log: file size changed while zipping 2024-04-13T11:20:07.560 INFO:tasks.cephadm:Archiving logs... 2024-04-13T11:20:07.561 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624/remote/smithi134/log 2024-04-13T11:20:07.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-13T11:20:26.758 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624/remote/smithi194/log 2024-04-13T11:20:26.759 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-13T11:20:32.124 INFO:tasks.cephadm:Removing cluster... 2024-04-13T11:20:32.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 --force 2024-04-13T11:20:32.310 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T11:20:32.695 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 38dd2ea8-f983-11ee-bc8d-c7b262605968 --force 2024-04-13T11:20:32.881 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 38dd2ea8-f983-11ee-bc8d-c7b262605968 2024-04-13T11:20:33.148 INFO:tasks.cephadm:Removing cephadm ... 2024-04-13T11:20:33.148 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-13T11:20:33.168 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-13T11:20:33.188 INFO:tasks.cephadm:Teardown complete 2024-04-13T11:20:33.188 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-13T11:20:33.200 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-13T11:20:33.201 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-13T11:20:33.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-13T11:20:33.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-13T11:20:33.303 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-13T11:20:33.317 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-13T11:20:33.317 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-13T11:20:33.320 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-13T11:20:33.335 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2024-04-13T11:20:33.336 INFO:teuthology.orchestra.run.smithi194.stderr:bash: ntpq: command not found 2024-04-13T11:20:33.339 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-13T11:20:33.339 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-04-13T11:20:33.340 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 +843us[ +838us] +/- 46ms 2024-04-13T11:20:33.340 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -1174us[-1179us] +/- 53ms 2024-04-13T11:20:33.340 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +172us[ +172us] +/- 73ms 2024-04-13T11:20:33.340 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T11:20:33.342 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-13T11:20:33.342 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-04-13T11:20:33.342 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +867us[ +847us] +/- 46ms 2024-04-13T11:20:33.342 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -1157us[-1157us] +/- 53ms 2024-04-13T11:20:33.342 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +169us[ +149us] +/- 73ms 2024-04-13T11:20:33.342 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T11:20:33.342 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-13T11:20:33.354 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-13T11:20:33.355 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-13T11:20:33.365 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-13T11:20:33.457 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-13T11:20:33.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-13T11:20:33.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T11:20:33.559 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-13T11:20:33.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T11:20:33.589 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-13T11:20:33.601 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-13T11:20:33.631 INFO:teuthology.task.internal:Duration was 2541.615225 seconds 2024-04-13T11:20:33.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-13T11:20:33.643 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-13T11:20:33.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-13T11:20:33.646 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-13T11:20:33.690 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-13T11:20:33.692 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-13T11:20:33.946 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-13T11:20:33.946 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-04-13T11:20:33.947 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-13T11:20:33.969 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-04-13T11:20:33.969 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-13T11:20:33.992 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-13T11:20:33.993 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-13T11:20:34.012 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-13T11:20:34.087 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-13T11:20:34.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-13T11:20:34.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-13T11:20:34.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-13T11:20:34.234 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-13T11:20:34.234 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-13T11:20:34.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-13T11:20:34.290 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-13T11:20:34.302 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-13T11:20:34.305 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-13T11:20:34.329 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-04-13T11:20:34.356 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-04-13T11:20:34.380 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-13T11:20:34.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T11:20:34.430 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-13T11:20:34.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T11:20:34.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-13T11:20:34.462 INFO:teuthology.task.internal:Transferring archived files... 2024-04-13T11:20:34.463 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624/remote/smithi134 2024-04-13T11:20:34.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-13T11:20:34.516 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624/remote/smithi194 2024-04-13T11:20:34.517 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-13T11:20:34.558 INFO:teuthology.task.internal:Removing archive directory... 2024-04-13T11:20:34.559 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-13T11:20:34.561 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-13T11:20:34.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-13T11:20:34.623 INFO:teuthology.task.internal:Not uploading archives. 2024-04-13T11:20:34.624 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-13T11:20:34.636 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-13T11:20:34.636 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-13T11:20:34.639 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-13T11:20:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: 525969 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 13 11:20 /home/ubuntu/cephtest 2024-04-13T11:20:34.654 INFO:teuthology.orchestra.run.smithi134.stdout: 526216 4 d--------- 2 ubuntu ubuntu 4096 Apr 13 10:56 /home/ubuntu/cephtest/mnt.0 2024-04-13T11:20:34.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T11:20:34.656 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-04-13T11:20:34.656 INFO:teuthology.orchestra.run.smithi134.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-13T11:20:34.656 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_d540ebaca6b131a1dd560e7f69e024b133bbaa42/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi134 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-13T11:20:34.657 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-13T11:20:34.675 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-13T11:20:34.694 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-13T11:20:34.694 INFO:teuthology.nuke:Checking targets against current locks 2024-04-13T11:20:34.719 DEBUG:teuthology.nuke:shortname: smithi134 2024-04-13T11:20:34.720 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-13T11:20:34.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 10:30:09.901230', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEaWXPfAFzMiodwxKKfpGEv9GNBJtG32Qcn2qo5Te2LpTFHZ06mu+pWqzHeKquUk73oJEQJTzgDAKjdNJHib01M='} 2024-04-13T11:20:34.750 DEBUG:teuthology.nuke:shortname: smithi194 2024-04-13T11:20:34.751 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-13T11:20:34.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-08_22:08:01-orch-reef-distro-default-smithi/7646624', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 10:30:09.902511', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZ3N5aBmLn4o0oQqVBcUzyNsUPfRvA3hsp7qIFOl9b3WNOjHC6yfKipPoQP3wc2h/FQVdfWGyocMX3aynA9eP8='} 2024-04-13T11:20:34.803 INFO:teuthology.orchestra.console.smithi134:Power off 2024-04-13T11:20:34.803 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T11:20:34.820 INFO:teuthology.orchestra.console.smithi194:Power off 2024-04-13T11:20:34.820 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T11:20:34.829 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2024-04-13T11:20:34.829 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T11:20:34.841 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-04-13T11:20:34.841 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T11:20:34.852 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-04-13T11:20:34.865 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-04-13T11:20:38.853 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T11:20:38.866 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T11:20:38.965 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-04-13T11:20:38.976 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-04-13T11:20:42.970 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T11:20:42.979 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T11:20:43.081 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-04-13T11:20:43.090 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-04-13T11:20:47.086 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T11:20:47.094 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T11:20:47.197 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-04-13T11:20:47.204 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-04-13T11:20:47.298 INFO:teuthology.orchestra.console.smithi134:Power off completed 2024-04-13T11:20:47.305 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-04-13T11:20:47.410 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2541.615225315094 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-13T11:20:47.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T11:20:47.495 INFO:teuthology.run:FAIL